[2023-03-12 01:38:38,546][124505] Saving configuration to /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/config.json... [2023-03-12 01:38:38,560][124505] Rollout worker 0 uses device cpu [2023-03-12 01:38:38,560][124505] Rollout worker 1 uses device cpu [2023-03-12 01:38:38,561][124505] Rollout worker 2 uses device cpu [2023-03-12 01:38:38,561][124505] Rollout worker 3 uses device cpu [2023-03-12 01:38:38,561][124505] Rollout worker 4 uses device cpu [2023-03-12 01:38:38,561][124505] Rollout worker 5 uses device cpu [2023-03-12 01:38:38,561][124505] Rollout worker 6 uses device cpu [2023-03-12 01:38:38,561][124505] Rollout worker 7 uses device cpu [2023-03-12 01:38:38,561][124505] In synchronous mode, we only accumulate one batch. Setting num_batches_to_accumulate to 1 [2023-03-12 01:38:38,572][124505] InferenceWorker_p0-w0: min num requests: 2 [2023-03-12 01:38:38,588][124505] Starting all processes... [2023-03-12 01:38:38,588][124505] Starting process learner_proc0 [2023-03-12 01:38:38,638][124505] Starting all processes... [2023-03-12 01:38:38,673][124505] Starting process inference_proc0-0 [2023-03-12 01:38:38,673][124505] Starting process rollout_proc0 [2023-03-12 01:38:38,674][124505] Starting process rollout_proc1 [2023-03-12 01:38:38,674][124505] Starting process rollout_proc2 [2023-03-12 01:38:38,674][124505] Starting process rollout_proc3 [2023-03-12 01:38:38,674][124505] Starting process rollout_proc4 [2023-03-12 01:38:38,674][124505] Starting process rollout_proc5 [2023-03-12 01:38:38,675][124505] Starting process rollout_proc6 [2023-03-12 01:38:38,676][124505] Starting process rollout_proc7 [2023-03-12 01:38:40,129][124749] Starting seed is not provided [2023-03-12 01:38:40,129][124749] Initializing actor-critic model on device cpu [2023-03-12 01:38:40,129][124749] RunningMeanStd input shape: (39,) [2023-03-12 01:38:40,130][124749] RunningMeanStd input shape: (1,) [2023-03-12 01:38:40,141][124798] Worker 5 uses CPU cores [20, 21, 22, 23] [2023-03-12 01:38:40,191][124749] Created Actor Critic model with architecture: [2023-03-12 01:38:40,191][124749] ActorCriticSharedWeights( (obs_normalizer): ObservationNormalizer( (running_mean_std): RunningMeanStdDictInPlace( (running_mean_std): ModuleDict( (obs): RunningMeanStdInPlace() ) ) ) (returns_normalizer): RecursiveScriptModule(original_name=RunningMeanStdInPlace) (encoder): MultiInputEncoder( (encoders): ModuleDict( (obs): MlpEncoder( (mlp_head): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Linear) (1): RecursiveScriptModule(original_name=Tanh) (2): RecursiveScriptModule(original_name=Linear) (3): RecursiveScriptModule(original_name=Tanh) ) ) ) ) (core): ModelCoreIdentity() (decoder): MlpDecoder( (mlp): Identity() ) (critic_linear): Linear(in_features=64, out_features=1, bias=True) (action_parameterization): ActionParameterizationContinuousNonAdaptiveStddev( (distribution_linear): Linear(in_features=64, out_features=4, bias=True) ) ) [2023-03-12 01:38:40,224][124832] Worker 7 uses CPU cores [28, 29, 30, 31] [2023-03-12 01:38:40,440][124796] Worker 2 uses CPU cores [8, 9, 10, 11] [2023-03-12 01:38:40,486][124749] Using optimizer [2023-03-12 01:38:40,486][124749] No checkpoints found [2023-03-12 01:38:40,486][124749] Did not load from checkpoint, starting from scratch! [2023-03-12 01:38:40,487][124749] Initialized policy 0 weights for model version 0 [2023-03-12 01:38:40,487][124797] Worker 4 uses CPU cores [16, 17, 18, 19] [2023-03-12 01:38:40,488][124749] LearnerWorker_p0 finished initialization! [2023-03-12 01:38:40,489][124793] RunningMeanStd input shape: (39,) [2023-03-12 01:38:40,489][124793] RunningMeanStd input shape: (1,) [2023-03-12 01:38:40,549][124505] Inference worker 0-0 is ready! [2023-03-12 01:38:40,549][124505] All inference workers are ready! Signal rollout workers to start! [2023-03-12 01:38:40,580][124800] Worker 6 uses CPU cores [24, 25, 26, 27] [2023-03-12 01:38:40,682][124795] Worker 1 uses CPU cores [4, 5, 6, 7] [2023-03-12 01:38:40,800][124799] Worker 3 uses CPU cores [12, 13, 14, 15] [2023-03-12 01:38:40,880][124794] Worker 0 uses CPU cores [0, 1, 2, 3] [2023-03-12 01:38:41,005][124505] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 0. Throughput: 0: nan. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-12 01:38:46,005][124505] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-12 01:38:46,087][124798] Decorrelating experience for 0 frames... [2023-03-12 01:38:46,087][124796] Decorrelating experience for 0 frames... [2023-03-12 01:38:46,098][124797] Decorrelating experience for 0 frames... [2023-03-12 01:38:46,109][124798] Decorrelating experience for 64 frames... [2023-03-12 01:38:46,109][124796] Decorrelating experience for 64 frames... [2023-03-12 01:38:46,119][124832] Decorrelating experience for 0 frames... [2023-03-12 01:38:46,120][124797] Decorrelating experience for 64 frames... [2023-03-12 01:38:46,142][124832] Decorrelating experience for 64 frames... [2023-03-12 01:38:46,144][124800] Decorrelating experience for 0 frames... [2023-03-12 01:38:46,160][124798] Decorrelating experience for 128 frames... [2023-03-12 01:38:46,160][124796] Decorrelating experience for 128 frames... [2023-03-12 01:38:46,166][124800] Decorrelating experience for 64 frames... [2023-03-12 01:38:46,170][124797] Decorrelating experience for 128 frames... [2023-03-12 01:38:46,192][124832] Decorrelating experience for 128 frames... [2023-03-12 01:38:46,216][124800] Decorrelating experience for 128 frames... [2023-03-12 01:38:46,237][124796] Decorrelating experience for 192 frames... [2023-03-12 01:38:46,237][124798] Decorrelating experience for 192 frames... [2023-03-12 01:38:46,248][124797] Decorrelating experience for 192 frames... [2023-03-12 01:38:46,269][124832] Decorrelating experience for 192 frames... [2023-03-12 01:38:46,287][124795] Decorrelating experience for 0 frames... [2023-03-12 01:38:46,293][124800] Decorrelating experience for 192 frames... [2023-03-12 01:38:46,310][124795] Decorrelating experience for 64 frames... [2023-03-12 01:38:46,360][124795] Decorrelating experience for 128 frames... [2023-03-12 01:38:46,413][124799] Decorrelating experience for 0 frames... [2023-03-12 01:38:46,435][124799] Decorrelating experience for 64 frames... [2023-03-12 01:38:46,437][124795] Decorrelating experience for 192 frames... [2023-03-12 01:38:46,469][124794] Decorrelating experience for 0 frames... [2023-03-12 01:38:46,485][124799] Decorrelating experience for 128 frames... [2023-03-12 01:38:46,491][124794] Decorrelating experience for 64 frames... [2023-03-12 01:38:46,541][124794] Decorrelating experience for 128 frames... [2023-03-12 01:38:46,562][124799] Decorrelating experience for 192 frames... [2023-03-12 01:38:46,618][124794] Decorrelating experience for 192 frames... [2023-03-12 01:38:51,005][124505] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-12 01:38:51,017][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000000000_0.pth... [2023-03-12 01:38:51,775][124798] Decorrelating experience for 256 frames... [2023-03-12 01:38:51,781][124796] Decorrelating experience for 256 frames... [2023-03-12 01:38:51,809][124797] Decorrelating experience for 256 frames... [2023-03-12 01:38:51,821][124832] Decorrelating experience for 256 frames... [2023-03-12 01:38:51,846][124800] Decorrelating experience for 256 frames... [2023-03-12 01:38:51,907][124798] Decorrelating experience for 320 frames... [2023-03-12 01:38:51,913][124796] Decorrelating experience for 320 frames... [2023-03-12 01:38:51,940][124797] Decorrelating experience for 320 frames... [2023-03-12 01:38:51,952][124832] Decorrelating experience for 320 frames... [2023-03-12 01:38:51,978][124800] Decorrelating experience for 320 frames... [2023-03-12 01:38:51,995][124795] Decorrelating experience for 256 frames... [2023-03-12 01:38:52,068][124798] Decorrelating experience for 384 frames... [2023-03-12 01:38:52,072][124796] Decorrelating experience for 384 frames... [2023-03-12 01:38:52,099][124797] Decorrelating experience for 384 frames... [2023-03-12 01:38:52,115][124832] Decorrelating experience for 384 frames... [2023-03-12 01:38:52,118][124799] Decorrelating experience for 256 frames... [2023-03-12 01:38:52,128][124795] Decorrelating experience for 320 frames... [2023-03-12 01:38:52,137][124800] Decorrelating experience for 384 frames... [2023-03-12 01:38:52,172][124794] Decorrelating experience for 256 frames... [2023-03-12 01:38:52,252][124799] Decorrelating experience for 320 frames... [2023-03-12 01:38:52,254][124798] Decorrelating experience for 448 frames... [2023-03-12 01:38:52,258][124796] Decorrelating experience for 448 frames... [2023-03-12 01:38:52,285][124797] Decorrelating experience for 448 frames... [2023-03-12 01:38:52,288][124795] Decorrelating experience for 384 frames... [2023-03-12 01:38:52,300][124832] Decorrelating experience for 448 frames... [2023-03-12 01:38:52,304][124794] Decorrelating experience for 320 frames... [2023-03-12 01:38:52,322][124800] Decorrelating experience for 448 frames... [2023-03-12 01:38:52,411][124799] Decorrelating experience for 384 frames... [2023-03-12 01:38:52,464][124794] Decorrelating experience for 384 frames... [2023-03-12 01:38:52,487][124795] Decorrelating experience for 448 frames... [2023-03-12 01:38:52,596][124799] Decorrelating experience for 448 frames... [2023-03-12 01:38:52,650][124794] Decorrelating experience for 448 frames... [2023-03-12 01:38:56,005][124505] Fps is (10 sec: 2867.2, 60 sec: 1911.5, 300 sec: 1911.5). Total num frames: 28672. Throughput: 0: 1869.1. Samples: 28036. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:38:56,016][124505] Avg episode reward: [(0, '173.678')] [2023-03-12 01:38:56,704][124793] Updated weights for policy 0, policy_version 80 (0.0005) [2023-03-12 01:38:58,568][124505] Heartbeat connected on Batcher_0 [2023-03-12 01:38:58,569][124505] Heartbeat connected on LearnerWorker_p0 [2023-03-12 01:38:58,573][124505] Heartbeat connected on InferenceWorker_p0-w0 [2023-03-12 01:38:58,577][124505] Heartbeat connected on RolloutWorker_w0 [2023-03-12 01:38:58,578][124505] Heartbeat connected on RolloutWorker_w1 [2023-03-12 01:38:58,580][124505] Heartbeat connected on RolloutWorker_w2 [2023-03-12 01:38:58,583][124505] Heartbeat connected on RolloutWorker_w3 [2023-03-12 01:38:58,585][124505] Heartbeat connected on RolloutWorker_w4 [2023-03-12 01:38:58,586][124505] Heartbeat connected on RolloutWorker_w5 [2023-03-12 01:38:58,588][124505] Heartbeat connected on RolloutWorker_w6 [2023-03-12 01:38:58,591][124505] Heartbeat connected on RolloutWorker_w7 [2023-03-12 01:39:00,477][124793] Updated weights for policy 0, policy_version 160 (0.0005) [2023-03-12 01:39:01,005][124505] Fps is (10 sec: 8601.6, 60 sec: 4300.8, 300 sec: 4300.8). Total num frames: 86016. Throughput: 0: 3120.8. Samples: 62416. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:39:01,016][124505] Avg episode reward: [(0, '408.893')] [2023-03-12 01:39:04,857][124793] Updated weights for policy 0, policy_version 240 (0.0005) [2023-03-12 01:39:06,005][124505] Fps is (10 sec: 10240.0, 60 sec: 5242.9, 300 sec: 5242.9). Total num frames: 131072. Throughput: 0: 4794.1. Samples: 119852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:39:06,005][124505] Avg episode reward: [(0, '464.426')] [2023-03-12 01:39:06,049][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000000264_135168.pth... [2023-03-12 01:39:06,051][124749] Saving new best policy, reward=464.426! [2023-03-12 01:39:08,895][124793] Updated weights for policy 0, policy_version 320 (0.0005) [2023-03-12 01:39:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 6144.0, 300 sec: 6144.0). Total num frames: 184320. Throughput: 0: 6015.5. Samples: 180464. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:39:11,005][124505] Avg episode reward: [(0, '631.178')] [2023-03-12 01:39:11,006][124749] Saving new best policy, reward=631.178! [2023-03-12 01:39:12,923][124793] Updated weights for policy 0, policy_version 400 (0.0005) [2023-03-12 01:39:16,005][124505] Fps is (10 sec: 10240.0, 60 sec: 6670.6, 300 sec: 6670.6). Total num frames: 233472. Throughput: 0: 6050.5. Samples: 211768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:39:16,005][124505] Avg episode reward: [(0, '830.446')] [2023-03-12 01:39:16,006][124749] Saving new best policy, reward=830.446! [2023-03-12 01:39:16,941][124793] Updated weights for policy 0, policy_version 480 (0.0005) [2023-03-12 01:39:21,005][124505] Fps is (10 sec: 9830.3, 60 sec: 7065.6, 300 sec: 7065.6). Total num frames: 282624. Throughput: 0: 6765.1. Samples: 270604. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 01:39:21,006][124505] Avg episode reward: [(0, '1655.702')] [2023-03-12 01:39:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000000552_282624.pth... [2023-03-12 01:39:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000000000_0.pth [2023-03-12 01:39:21,012][124749] Saving new best policy, reward=1655.702! [2023-03-12 01:39:21,207][124793] Updated weights for policy 0, policy_version 560 (0.0005) [2023-03-12 01:39:25,609][124793] Updated weights for policy 0, policy_version 640 (0.0004) [2023-03-12 01:39:26,005][124505] Fps is (10 sec: 9420.7, 60 sec: 7281.8, 300 sec: 7281.8). Total num frames: 327680. Throughput: 0: 7281.9. Samples: 327688. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:39:26,005][124505] Avg episode reward: [(0, '2477.243')] [2023-03-12 01:39:26,061][124749] Saving new best policy, reward=2477.243! [2023-03-12 01:39:30,046][124793] Updated weights for policy 0, policy_version 720 (0.0005) [2023-03-12 01:39:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 7536.6, 300 sec: 7536.6). Total num frames: 376832. Throughput: 0: 7902.8. Samples: 355628. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:39:31,005][124505] Avg episode reward: [(0, '3166.434')] [2023-03-12 01:39:31,006][124749] Saving new best policy, reward=3166.434! [2023-03-12 01:39:34,625][124793] Updated weights for policy 0, policy_version 800 (0.0005) [2023-03-12 01:39:36,005][124505] Fps is (10 sec: 9420.9, 60 sec: 7670.7, 300 sec: 7670.7). Total num frames: 421888. Throughput: 0: 9102.2. Samples: 409600. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:39:36,005][124505] Avg episode reward: [(0, '3896.242')] [2023-03-12 01:39:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000000824_421888.pth... [2023-03-12 01:39:36,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000000264_135168.pth [2023-03-12 01:39:36,010][124749] Saving new best policy, reward=3896.242! [2023-03-12 01:39:39,092][124793] Updated weights for policy 0, policy_version 880 (0.0005) [2023-03-12 01:39:41,005][124505] Fps is (10 sec: 9011.3, 60 sec: 7782.4, 300 sec: 7782.4). Total num frames: 466944. Throughput: 0: 9696.0. Samples: 464356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:39:41,005][124505] Avg episode reward: [(0, '3814.644')] [2023-03-12 01:39:43,414][124793] Updated weights for policy 0, policy_version 960 (0.0005) [2023-03-12 01:39:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 8601.6, 300 sec: 7939.9). Total num frames: 516096. Throughput: 0: 9573.5. Samples: 493224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:39:46,005][124505] Avg episode reward: [(0, '3827.304')] [2023-03-12 01:39:47,691][124793] Updated weights for policy 0, policy_version 1040 (0.0005) [2023-03-12 01:39:51,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 8016.4). Total num frames: 561152. Throughput: 0: 9564.3. Samples: 550248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:39:51,006][124505] Avg episode reward: [(0, '4186.142')] [2023-03-12 01:39:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000001096_561152.pth... [2023-03-12 01:39:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000000552_282624.pth [2023-03-12 01:39:51,012][124749] Saving new best policy, reward=4186.142! [2023-03-12 01:39:52,104][124793] Updated weights for policy 0, policy_version 1120 (0.0005) [2023-03-12 01:39:56,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 8137.4). Total num frames: 610304. Throughput: 0: 9490.1. Samples: 607520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:39:56,005][124505] Avg episode reward: [(0, '4243.098')] [2023-03-12 01:39:56,006][124749] Saving new best policy, reward=4243.098! [2023-03-12 01:39:56,311][124793] Updated weights for policy 0, policy_version 1200 (0.0005) [2023-03-12 01:40:00,667][124793] Updated weights for policy 0, policy_version 1280 (0.0004) [2023-03-12 01:40:01,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 8192.0). Total num frames: 655360. Throughput: 0: 9418.2. Samples: 635588. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:40:01,005][124505] Avg episode reward: [(0, '4355.150')] [2023-03-12 01:40:01,006][124749] Saving new best policy, reward=4355.150! [2023-03-12 01:40:05,083][124793] Updated weights for policy 0, policy_version 1360 (0.0005) [2023-03-12 01:40:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 8288.4). Total num frames: 704512. Throughput: 0: 9368.3. Samples: 692176. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:40:06,005][124505] Avg episode reward: [(0, '4239.667')] [2023-03-12 01:40:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000001376_704512.pth... [2023-03-12 01:40:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000000824_421888.pth [2023-03-12 01:40:09,573][124793] Updated weights for policy 0, policy_version 1440 (0.0005) [2023-03-12 01:40:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 8328.5). Total num frames: 749568. Throughput: 0: 9312.9. Samples: 746768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:40:11,005][124505] Avg episode reward: [(0, '4278.600')] [2023-03-12 01:40:13,803][124793] Updated weights for policy 0, policy_version 1520 (0.0005) [2023-03-12 01:40:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 8407.6). Total num frames: 798720. Throughput: 0: 9339.6. Samples: 775908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:40:16,005][124505] Avg episode reward: [(0, '4080.061')] [2023-03-12 01:40:17,486][124793] Updated weights for policy 0, policy_version 1600 (0.0004) [2023-03-12 01:40:21,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9489.1, 300 sec: 8519.7). Total num frames: 851968. Throughput: 0: 9587.9. Samples: 841056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:40:21,005][124505] Avg episode reward: [(0, '4156.848')] [2023-03-12 01:40:21,041][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000001672_856064.pth... [2023-03-12 01:40:21,043][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000001096_561152.pth [2023-03-12 01:40:21,425][124793] Updated weights for policy 0, policy_version 1680 (0.0005) [2023-03-12 01:40:25,363][124793] Updated weights for policy 0, policy_version 1760 (0.0005) [2023-03-12 01:40:26,005][124505] Fps is (10 sec: 10649.6, 60 sec: 9625.6, 300 sec: 8621.1). Total num frames: 905216. Throughput: 0: 9758.3. Samples: 903480. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:40:26,005][124505] Avg episode reward: [(0, '4260.106')] [2023-03-12 01:40:29,367][124793] Updated weights for policy 0, policy_version 1840 (0.0005) [2023-03-12 01:40:31,005][124505] Fps is (10 sec: 10649.6, 60 sec: 9693.9, 300 sec: 8713.3). Total num frames: 958464. Throughput: 0: 9794.0. Samples: 933952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:40:31,005][124505] Avg episode reward: [(0, '4265.542')] [2023-03-12 01:40:33,067][124793] Updated weights for policy 0, policy_version 1920 (0.0004) [2023-03-12 01:40:36,005][124505] Fps is (10 sec: 10649.5, 60 sec: 9830.4, 300 sec: 8797.5). Total num frames: 1011712. Throughput: 0: 9988.1. Samples: 999712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:40:36,005][124505] Avg episode reward: [(0, '4262.617')] [2023-03-12 01:40:36,013][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000001984_1015808.pth... [2023-03-12 01:40:36,015][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000001376_704512.pth [2023-03-12 01:40:36,773][124793] Updated weights for policy 0, policy_version 2000 (0.0005) [2023-03-12 01:40:40,763][124793] Updated weights for policy 0, policy_version 2080 (0.0005) [2023-03-12 01:40:41,005][124505] Fps is (10 sec: 10649.6, 60 sec: 9966.9, 300 sec: 8874.7). Total num frames: 1064960. Throughput: 0: 10132.2. Samples: 1063468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:40:41,005][124505] Avg episode reward: [(0, '3944.249')] [2023-03-12 01:40:44,799][124793] Updated weights for policy 0, policy_version 2160 (0.0005) [2023-03-12 01:40:46,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 8912.9). Total num frames: 1114112. Throughput: 0: 10180.1. Samples: 1093696. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:40:46,006][124505] Avg episode reward: [(0, '4315.671')] [2023-03-12 01:40:48,903][124793] Updated weights for policy 0, policy_version 2240 (0.0005) [2023-03-12 01:40:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 8948.2). Total num frames: 1163264. Throughput: 0: 10249.9. Samples: 1153420. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 01:40:51,005][124505] Avg episode reward: [(0, '4324.718')] [2023-03-12 01:40:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000002272_1163264.pth... [2023-03-12 01:40:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000001672_856064.pth [2023-03-12 01:40:53,213][124793] Updated weights for policy 0, policy_version 2320 (0.0005) [2023-03-12 01:40:56,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 8980.9). Total num frames: 1212416. Throughput: 0: 10326.1. Samples: 1211444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:40:56,005][124505] Avg episode reward: [(0, '4532.158')] [2023-03-12 01:40:56,006][124749] Saving new best policy, reward=4532.158! [2023-03-12 01:40:57,461][124793] Updated weights for policy 0, policy_version 2400 (0.0005) [2023-03-12 01:41:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 9011.2). Total num frames: 1261568. Throughput: 0: 10308.6. Samples: 1239796. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 01:41:01,005][124505] Avg episode reward: [(0, '4531.806')] [2023-03-12 01:41:01,673][124793] Updated weights for policy 0, policy_version 2480 (0.0005) [2023-03-12 01:41:05,876][124793] Updated weights for policy 0, policy_version 2560 (0.0005) [2023-03-12 01:41:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 9039.4). Total num frames: 1310720. Throughput: 0: 10163.9. Samples: 1298432. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 01:41:06,005][124505] Avg episode reward: [(0, '4535.230')] [2023-03-12 01:41:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000002560_1310720.pth... [2023-03-12 01:41:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000001984_1015808.pth [2023-03-12 01:41:06,012][124749] Saving new best policy, reward=4535.230! [2023-03-12 01:41:10,132][124793] Updated weights for policy 0, policy_version 2640 (0.0005) [2023-03-12 01:41:11,005][124505] Fps is (10 sec: 9830.3, 60 sec: 10171.7, 300 sec: 9065.8). Total num frames: 1359872. Throughput: 0: 10053.2. Samples: 1355872. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:41:11,005][124505] Avg episode reward: [(0, '4550.084')] [2023-03-12 01:41:11,006][124749] Saving new best policy, reward=4550.084! [2023-03-12 01:41:14,383][124793] Updated weights for policy 0, policy_version 2720 (0.0005) [2023-03-12 01:41:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 10103.5, 300 sec: 9064.0). Total num frames: 1404928. Throughput: 0: 10024.2. Samples: 1385040. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:41:16,005][124505] Avg episode reward: [(0, '4561.768')] [2023-03-12 01:41:16,051][124749] Saving new best policy, reward=4561.768! [2023-03-12 01:41:18,615][124793] Updated weights for policy 0, policy_version 2800 (0.0005) [2023-03-12 01:41:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 10035.2, 300 sec: 9088.0). Total num frames: 1454080. Throughput: 0: 9848.1. Samples: 1442876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:41:21,005][124505] Avg episode reward: [(0, '4576.429')] [2023-03-12 01:41:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000002840_1454080.pth... [2023-03-12 01:41:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000002272_1163264.pth [2023-03-12 01:41:21,012][124749] Saving new best policy, reward=4576.429! [2023-03-12 01:41:22,871][124793] Updated weights for policy 0, policy_version 2880 (0.0005) [2023-03-12 01:41:26,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9110.5). Total num frames: 1503232. Throughput: 0: 9721.5. Samples: 1500936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:41:26,005][124505] Avg episode reward: [(0, '4574.957')] [2023-03-12 01:41:27,058][124793] Updated weights for policy 0, policy_version 2960 (0.0005) [2023-03-12 01:41:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9131.7). Total num frames: 1552384. Throughput: 0: 9717.7. Samples: 1530992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:41:31,005][124505] Avg episode reward: [(0, '4569.056')] [2023-03-12 01:41:31,265][124793] Updated weights for policy 0, policy_version 3040 (0.0005) [2023-03-12 01:41:35,313][124793] Updated weights for policy 0, policy_version 3120 (0.0005) [2023-03-12 01:41:36,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9151.6). Total num frames: 1601536. Throughput: 0: 9689.3. Samples: 1589440. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:41:36,006][124505] Avg episode reward: [(0, '4563.001')] [2023-03-12 01:41:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000003128_1601536.pth... [2023-03-12 01:41:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000002560_1310720.pth [2023-03-12 01:41:39,441][124793] Updated weights for policy 0, policy_version 3200 (0.0004) [2023-03-12 01:41:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9170.5). Total num frames: 1650688. Throughput: 0: 9750.8. Samples: 1650228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:41:41,005][124505] Avg episode reward: [(0, '4558.191')] [2023-03-12 01:41:43,621][124793] Updated weights for policy 0, policy_version 3280 (0.0005) [2023-03-12 01:41:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9762.2, 300 sec: 9188.3). Total num frames: 1699840. Throughput: 0: 9768.1. Samples: 1679360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:41:46,005][124505] Avg episode reward: [(0, '4533.472')] [2023-03-12 01:41:47,932][124793] Updated weights for policy 0, policy_version 3360 (0.0005) [2023-03-12 01:41:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9205.2). Total num frames: 1748992. Throughput: 0: 9739.6. Samples: 1736712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:41:51,005][124505] Avg episode reward: [(0, '4523.856')] [2023-03-12 01:41:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000003416_1748992.pth... [2023-03-12 01:41:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000002840_1454080.pth [2023-03-12 01:41:52,211][124793] Updated weights for policy 0, policy_version 3440 (0.0005) [2023-03-12 01:41:56,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9200.2). Total num frames: 1794048. Throughput: 0: 9737.3. Samples: 1794048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:41:56,005][124505] Avg episode reward: [(0, '4552.065')] [2023-03-12 01:41:56,481][124793] Updated weights for policy 0, policy_version 3520 (0.0005) [2023-03-12 01:42:00,680][124793] Updated weights for policy 0, policy_version 3600 (0.0005) [2023-03-12 01:42:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9216.0). Total num frames: 1843200. Throughput: 0: 9726.2. Samples: 1822720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:42:01,005][124505] Avg episode reward: [(0, '4529.910')] [2023-03-12 01:42:04,689][124793] Updated weights for policy 0, policy_version 3680 (0.0005) [2023-03-12 01:42:06,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9762.1, 300 sec: 9251.0). Total num frames: 1896448. Throughput: 0: 9786.6. Samples: 1883272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:42:06,005][124505] Avg episode reward: [(0, '4536.600')] [2023-03-12 01:42:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000003704_1896448.pth... [2023-03-12 01:42:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000003128_1601536.pth [2023-03-12 01:42:08,643][124793] Updated weights for policy 0, policy_version 3760 (0.0005) [2023-03-12 01:42:11,005][124505] Fps is (10 sec: 10649.6, 60 sec: 9830.4, 300 sec: 9284.3). Total num frames: 1949696. Throughput: 0: 9881.7. Samples: 1945612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:42:11,005][124505] Avg episode reward: [(0, '4577.973')] [2023-03-12 01:42:11,006][124749] Saving new best policy, reward=4577.973! [2023-03-12 01:42:12,597][124793] Updated weights for policy 0, policy_version 3840 (0.0005) [2023-03-12 01:42:16,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9297.0). Total num frames: 1998848. Throughput: 0: 9887.1. Samples: 1975912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:42:16,005][124505] Avg episode reward: [(0, '4590.877')] [2023-03-12 01:42:16,006][124749] Saving new best policy, reward=4590.877! [2023-03-12 01:42:16,520][124793] Updated weights for policy 0, policy_version 3920 (0.0004) [2023-03-12 01:42:20,365][124793] Updated weights for policy 0, policy_version 4000 (0.0005) [2023-03-12 01:42:21,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9327.7). Total num frames: 2052096. Throughput: 0: 10008.4. Samples: 2039816. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:42:21,005][124505] Avg episode reward: [(0, '4585.746')] [2023-03-12 01:42:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000004008_2052096.pth... [2023-03-12 01:42:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000003416_1748992.pth [2023-03-12 01:42:24,311][124793] Updated weights for policy 0, policy_version 4080 (0.0004) [2023-03-12 01:42:26,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10035.2, 300 sec: 9357.1). Total num frames: 2105344. Throughput: 0: 10047.3. Samples: 2102356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:42:26,005][124505] Avg episode reward: [(0, '4552.265')] [2023-03-12 01:42:28,219][124793] Updated weights for policy 0, policy_version 4160 (0.0004) [2023-03-12 01:42:31,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10103.5, 300 sec: 9385.2). Total num frames: 2158592. Throughput: 0: 10103.5. Samples: 2134016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:42:31,005][124505] Avg episode reward: [(0, '4539.170')] [2023-03-12 01:42:32,124][124793] Updated weights for policy 0, policy_version 4240 (0.0004) [2023-03-12 01:42:36,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9394.7). Total num frames: 2207744. Throughput: 0: 10210.8. Samples: 2196200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:42:36,005][124505] Avg episode reward: [(0, '4555.065')] [2023-03-12 01:42:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000004312_2207744.pth... [2023-03-12 01:42:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000003704_1896448.pth [2023-03-12 01:42:36,105][124793] Updated weights for policy 0, policy_version 4320 (0.0005) [2023-03-12 01:42:40,062][124793] Updated weights for policy 0, policy_version 4400 (0.0005) [2023-03-12 01:42:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9420.8). Total num frames: 2260992. Throughput: 0: 10317.4. Samples: 2258332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:42:41,005][124505] Avg episode reward: [(0, '4573.043')] [2023-03-12 01:42:43,962][124793] Updated weights for policy 0, policy_version 4480 (0.0004) [2023-03-12 01:42:46,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10240.0, 300 sec: 9445.9). Total num frames: 2314240. Throughput: 0: 10378.0. Samples: 2289728. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 01:42:46,005][124505] Avg episode reward: [(0, '4581.747')] [2023-03-12 01:42:47,837][124793] Updated weights for policy 0, policy_version 4560 (0.0003) [2023-03-12 01:42:51,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10308.3, 300 sec: 9469.9). Total num frames: 2367488. Throughput: 0: 10437.4. Samples: 2352956. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:42:51,005][124505] Avg episode reward: [(0, '4576.348')] [2023-03-12 01:42:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000004624_2367488.pth... [2023-03-12 01:42:51,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000004008_2052096.pth [2023-03-12 01:42:51,772][124793] Updated weights for policy 0, policy_version 4640 (0.0004) [2023-03-12 01:42:55,704][124793] Updated weights for policy 0, policy_version 4720 (0.0005) [2023-03-12 01:42:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10376.5, 300 sec: 9477.0). Total num frames: 2416640. Throughput: 0: 10445.8. Samples: 2415672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:42:56,005][124505] Avg episode reward: [(0, '4574.311')] [2023-03-12 01:42:59,627][124793] Updated weights for policy 0, policy_version 4800 (0.0004) [2023-03-12 01:43:01,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10444.8, 300 sec: 9499.6). Total num frames: 2469888. Throughput: 0: 10453.5. Samples: 2446320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:43:01,005][124505] Avg episode reward: [(0, '4516.051')] [2023-03-12 01:43:03,543][124793] Updated weights for policy 0, policy_version 4880 (0.0004) [2023-03-12 01:43:06,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10444.8, 300 sec: 9521.3). Total num frames: 2523136. Throughput: 0: 10438.8. Samples: 2509560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:43:06,005][124505] Avg episode reward: [(0, '4573.423')] [2023-03-12 01:43:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000004928_2523136.pth... [2023-03-12 01:43:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000004312_2207744.pth [2023-03-12 01:43:07,456][124793] Updated weights for policy 0, policy_version 4960 (0.0005) [2023-03-12 01:43:11,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10444.8, 300 sec: 9542.2). Total num frames: 2576384. Throughput: 0: 10455.2. Samples: 2572840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:43:11,005][124505] Avg episode reward: [(0, '4528.238')] [2023-03-12 01:43:11,268][124793] Updated weights for policy 0, policy_version 5040 (0.0004) [2023-03-12 01:43:15,219][124793] Updated weights for policy 0, policy_version 5120 (0.0004) [2023-03-12 01:43:16,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10444.8, 300 sec: 9547.4). Total num frames: 2625536. Throughput: 0: 10450.3. Samples: 2604280. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:43:16,005][124505] Avg episode reward: [(0, '4254.040')] [2023-03-12 01:43:19,139][124793] Updated weights for policy 0, policy_version 5200 (0.0003) [2023-03-12 01:43:21,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10444.8, 300 sec: 9567.1). Total num frames: 2678784. Throughput: 0: 10452.4. Samples: 2666560. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:43:21,005][124505] Avg episode reward: [(0, '4553.175')] [2023-03-12 01:43:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000005232_2678784.pth... [2023-03-12 01:43:21,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000004624_2367488.pth [2023-03-12 01:43:23,213][124793] Updated weights for policy 0, policy_version 5280 (0.0005) [2023-03-12 01:43:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10376.5, 300 sec: 9571.7). Total num frames: 2727936. Throughput: 0: 10425.3. Samples: 2727468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:43:26,005][124505] Avg episode reward: [(0, '4576.419')] [2023-03-12 01:43:27,291][124793] Updated weights for policy 0, policy_version 5360 (0.0005) [2023-03-12 01:43:31,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10376.5, 300 sec: 9590.3). Total num frames: 2781184. Throughput: 0: 10393.0. Samples: 2757412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:43:31,005][124505] Avg episode reward: [(0, '4588.795')] [2023-03-12 01:43:31,264][124793] Updated weights for policy 0, policy_version 5440 (0.0005) [2023-03-12 01:43:35,280][124793] Updated weights for policy 0, policy_version 5520 (0.0005) [2023-03-12 01:43:36,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10376.5, 300 sec: 9594.4). Total num frames: 2830336. Throughput: 0: 10352.3. Samples: 2818808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:43:36,005][124505] Avg episode reward: [(0, '4565.130')] [2023-03-12 01:43:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000005528_2830336.pth... [2023-03-12 01:43:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000004928_2523136.pth [2023-03-12 01:43:39,345][124793] Updated weights for policy 0, policy_version 5600 (0.0005) [2023-03-12 01:43:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10376.5, 300 sec: 9774.9). Total num frames: 2883584. Throughput: 0: 10308.6. Samples: 2879560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:43:41,005][124505] Avg episode reward: [(0, '4558.762')] [2023-03-12 01:43:43,454][124793] Updated weights for policy 0, policy_version 5680 (0.0005) [2023-03-12 01:43:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10240.0, 300 sec: 9927.6). Total num frames: 2928640. Throughput: 0: 10290.7. Samples: 2909400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:43:46,005][124505] Avg episode reward: [(0, '4535.853')] [2023-03-12 01:43:47,797][124793] Updated weights for policy 0, policy_version 5760 (0.0005) [2023-03-12 01:43:51,005][124505] Fps is (10 sec: 9420.7, 60 sec: 10171.7, 300 sec: 9997.0). Total num frames: 2977792. Throughput: 0: 10133.5. Samples: 2965568. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 01:43:51,005][124505] Avg episode reward: [(0, '4576.143')] [2023-03-12 01:43:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000005816_2977792.pth... [2023-03-12 01:43:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000005232_2678784.pth [2023-03-12 01:43:52,221][124793] Updated weights for policy 0, policy_version 5840 (0.0006) [2023-03-12 01:43:56,005][124505] Fps is (10 sec: 9420.6, 60 sec: 10103.4, 300 sec: 9955.4). Total num frames: 3022848. Throughput: 0: 10000.5. Samples: 3022864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:43:56,006][124505] Avg episode reward: [(0, '4584.911')] [2023-03-12 01:43:56,456][124793] Updated weights for policy 0, policy_version 5920 (0.0006) [2023-03-12 01:44:00,759][124793] Updated weights for policy 0, policy_version 6000 (0.0006) [2023-03-12 01:44:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 10035.2, 300 sec: 9969.2). Total num frames: 3072000. Throughput: 0: 9938.7. Samples: 3051520. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 01:44:01,005][124505] Avg episode reward: [(0, '4577.741')] [2023-03-12 01:44:05,046][124793] Updated weights for policy 0, policy_version 6080 (0.0004) [2023-03-12 01:44:06,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9955.4). Total num frames: 3121152. Throughput: 0: 9829.0. Samples: 3108864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:44:06,005][124505] Avg episode reward: [(0, '4546.605')] [2023-03-12 01:44:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000006096_3121152.pth... [2023-03-12 01:44:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000005528_2830336.pth [2023-03-12 01:44:09,235][124793] Updated weights for policy 0, policy_version 6160 (0.0004) [2023-03-12 01:44:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 3170304. Throughput: 0: 9781.9. Samples: 3167652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:44:11,005][124505] Avg episode reward: [(0, '4544.502')] [2023-03-12 01:44:13,281][124793] Updated weights for policy 0, policy_version 6240 (0.0005) [2023-03-12 01:44:16,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9955.4). Total num frames: 3219456. Throughput: 0: 9792.4. Samples: 3198068. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:44:16,005][124505] Avg episode reward: [(0, '4508.736')] [2023-03-12 01:44:17,234][124793] Updated weights for policy 0, policy_version 6320 (0.0004) [2023-03-12 01:44:21,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9983.1). Total num frames: 3272704. Throughput: 0: 9803.8. Samples: 3259980. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:44:21,005][124505] Avg episode reward: [(0, '4581.576')] [2023-03-12 01:44:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000006392_3272704.pth... [2023-03-12 01:44:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000005816_2977792.pth [2023-03-12 01:44:21,231][124793] Updated weights for policy 0, policy_version 6400 (0.0005) [2023-03-12 01:44:25,224][124793] Updated weights for policy 0, policy_version 6480 (0.0005) [2023-03-12 01:44:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9983.1). Total num frames: 3321856. Throughput: 0: 9826.3. Samples: 3321744. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:44:26,005][124505] Avg episode reward: [(0, '4545.546')] [2023-03-12 01:44:29,194][124793] Updated weights for policy 0, policy_version 6560 (0.0005) [2023-03-12 01:44:31,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 10010.9). Total num frames: 3375104. Throughput: 0: 9848.1. Samples: 3352564. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:44:31,005][124505] Avg episode reward: [(0, '4544.498')] [2023-03-12 01:44:33,324][124793] Updated weights for policy 0, policy_version 6640 (0.0005) [2023-03-12 01:44:36,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 10024.8). Total num frames: 3424256. Throughput: 0: 9920.2. Samples: 3411976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:44:36,005][124505] Avg episode reward: [(0, '4570.022')] [2023-03-12 01:44:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000006688_3424256.pth... [2023-03-12 01:44:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000006096_3121152.pth [2023-03-12 01:44:37,571][124793] Updated weights for policy 0, policy_version 6720 (0.0006) [2023-03-12 01:44:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 10024.8). Total num frames: 3473408. Throughput: 0: 9922.7. Samples: 3469384. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:44:41,005][124505] Avg episode reward: [(0, '4521.469')] [2023-03-12 01:44:41,852][124793] Updated weights for policy 0, policy_version 6800 (0.0006) [2023-03-12 01:44:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 10024.8). Total num frames: 3518464. Throughput: 0: 9923.0. Samples: 3498056. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:44:46,005][124505] Avg episode reward: [(0, '4543.900')] [2023-03-12 01:44:46,096][124793] Updated weights for policy 0, policy_version 6880 (0.0006) [2023-03-12 01:44:50,259][124793] Updated weights for policy 0, policy_version 6960 (0.0006) [2023-03-12 01:44:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 10024.8). Total num frames: 3567616. Throughput: 0: 9949.5. Samples: 3556592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:44:51,016][124505] Avg episode reward: [(0, '4575.444')] [2023-03-12 01:44:51,018][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000006968_3567616.pth... [2023-03-12 01:44:51,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000006392_3272704.pth [2023-03-12 01:44:54,419][124793] Updated weights for policy 0, policy_version 7040 (0.0005) [2023-03-12 01:44:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 10038.7). Total num frames: 3616768. Throughput: 0: 9964.8. Samples: 3616068. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 01:44:56,005][124505] Avg episode reward: [(0, '4561.983')] [2023-03-12 01:44:58,605][124793] Updated weights for policy 0, policy_version 7120 (0.0005) [2023-03-12 01:45:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 10038.7). Total num frames: 3665920. Throughput: 0: 9942.1. Samples: 3645464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:45:01,005][124505] Avg episode reward: [(0, '4586.022')] [2023-03-12 01:45:02,804][124793] Updated weights for policy 0, policy_version 7200 (0.0005) [2023-03-12 01:45:06,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 10066.4). Total num frames: 3719168. Throughput: 0: 9892.7. Samples: 3705152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:45:06,005][124505] Avg episode reward: [(0, '4330.819')] [2023-03-12 01:45:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000007264_3719168.pth... [2023-03-12 01:45:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000006688_3424256.pth [2023-03-12 01:45:06,724][124793] Updated weights for policy 0, policy_version 7280 (0.0005) [2023-03-12 01:45:10,543][124793] Updated weights for policy 0, policy_version 7360 (0.0004) [2023-03-12 01:45:11,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10035.2, 300 sec: 10080.3). Total num frames: 3772416. Throughput: 0: 9926.3. Samples: 3768428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:45:11,005][124505] Avg episode reward: [(0, '4584.248')] [2023-03-12 01:45:14,491][124793] Updated weights for policy 0, policy_version 7440 (0.0006) [2023-03-12 01:45:16,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10103.5, 300 sec: 10080.3). Total num frames: 3825664. Throughput: 0: 9942.8. Samples: 3799992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:45:16,016][124505] Avg episode reward: [(0, '4576.632')] [2023-03-12 01:45:18,370][124793] Updated weights for policy 0, policy_version 7520 (0.0005) [2023-03-12 01:45:21,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10066.4). Total num frames: 3874816. Throughput: 0: 10012.3. Samples: 3862528. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 01:45:21,016][124505] Avg episode reward: [(0, '4565.292')] [2023-03-12 01:45:21,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000007568_3874816.pth... [2023-03-12 01:45:21,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000006968_3567616.pth [2023-03-12 01:45:22,322][124793] Updated weights for policy 0, policy_version 7600 (0.0005) [2023-03-12 01:45:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10066.4). Total num frames: 3928064. Throughput: 0: 10172.2. Samples: 3927132. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:45:26,016][124505] Avg episode reward: [(0, '4580.217')] [2023-03-12 01:45:26,067][124793] Updated weights for policy 0, policy_version 7680 (0.0005) [2023-03-12 01:45:29,749][124793] Updated weights for policy 0, policy_version 7760 (0.0004) [2023-03-12 01:45:31,005][124505] Fps is (10 sec: 11059.3, 60 sec: 10171.7, 300 sec: 10080.3). Total num frames: 3985408. Throughput: 0: 10281.2. Samples: 3960708. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:45:31,016][124505] Avg episode reward: [(0, '4581.484')] [2023-03-12 01:45:33,497][124793] Updated weights for policy 0, policy_version 7840 (0.0005) [2023-03-12 01:45:36,005][124505] Fps is (10 sec: 11059.1, 60 sec: 10240.0, 300 sec: 10080.3). Total num frames: 4038656. Throughput: 0: 10439.5. Samples: 4026368. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:45:36,016][124505] Avg episode reward: [(0, '4588.314')] [2023-03-12 01:45:36,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000007888_4038656.pth... [2023-03-12 01:45:36,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000007264_3719168.pth [2023-03-12 01:45:37,388][124793] Updated weights for policy 0, policy_version 7920 (0.0005) [2023-03-12 01:45:41,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10240.0, 300 sec: 10080.3). Total num frames: 4087808. Throughput: 0: 10483.1. Samples: 4087808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:45:41,016][124505] Avg episode reward: [(0, '4589.597')] [2023-03-12 01:45:41,389][124793] Updated weights for policy 0, policy_version 8000 (0.0006) [2023-03-12 01:45:45,373][124793] Updated weights for policy 0, policy_version 8080 (0.0005) [2023-03-12 01:45:46,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10376.5, 300 sec: 10094.2). Total num frames: 4141056. Throughput: 0: 10524.3. Samples: 4119056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:45:46,005][124505] Avg episode reward: [(0, '4588.737')] [2023-03-12 01:45:49,380][124793] Updated weights for policy 0, policy_version 8160 (0.0006) [2023-03-12 01:45:51,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10444.8, 300 sec: 10108.1). Total num frames: 4194304. Throughput: 0: 10551.6. Samples: 4179976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:45:51,005][124505] Avg episode reward: [(0, '4547.087')] [2023-03-12 01:45:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000008192_4194304.pth... [2023-03-12 01:45:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000007568_3874816.pth [2023-03-12 01:45:53,175][124793] Updated weights for policy 0, policy_version 8240 (0.0004) [2023-03-12 01:45:56,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10513.1, 300 sec: 10122.0). Total num frames: 4247552. Throughput: 0: 10562.5. Samples: 4243740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:45:56,005][124505] Avg episode reward: [(0, '4525.181')] [2023-03-12 01:45:57,120][124793] Updated weights for policy 0, policy_version 8320 (0.0004) [2023-03-12 01:46:01,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10513.1, 300 sec: 10122.0). Total num frames: 4296704. Throughput: 0: 10574.0. Samples: 4275820. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 01:46:01,005][124505] Avg episode reward: [(0, '4498.115')] [2023-03-12 01:46:01,034][124793] Updated weights for policy 0, policy_version 8400 (0.0004) [2023-03-12 01:46:04,901][124793] Updated weights for policy 0, policy_version 8480 (0.0003) [2023-03-12 01:46:06,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10513.1, 300 sec: 10135.9). Total num frames: 4349952. Throughput: 0: 10573.0. Samples: 4338312. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 01:46:06,005][124505] Avg episode reward: [(0, '4515.787')] [2023-03-12 01:46:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000008504_4354048.pth... [2023-03-12 01:46:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000007888_4038656.pth [2023-03-12 01:46:08,719][124793] Updated weights for policy 0, policy_version 8560 (0.0004) [2023-03-12 01:46:11,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10513.1, 300 sec: 10163.6). Total num frames: 4403200. Throughput: 0: 10556.7. Samples: 4402184. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 01:46:11,005][124505] Avg episode reward: [(0, '4579.674')] [2023-03-12 01:46:12,740][124793] Updated weights for policy 0, policy_version 8640 (0.0006) [2023-03-12 01:46:16,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10513.1, 300 sec: 10177.5). Total num frames: 4456448. Throughput: 0: 10476.3. Samples: 4432140. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:46:16,005][124505] Avg episode reward: [(0, '4589.953')] [2023-03-12 01:46:16,679][124793] Updated weights for policy 0, policy_version 8720 (0.0005) [2023-03-12 01:46:20,669][124793] Updated weights for policy 0, policy_version 8800 (0.0005) [2023-03-12 01:46:21,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10513.1, 300 sec: 10177.5). Total num frames: 4505600. Throughput: 0: 10416.5. Samples: 4495108. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:46:21,005][124505] Avg episode reward: [(0, '4574.315')] [2023-03-12 01:46:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000008800_4505600.pth... [2023-03-12 01:46:21,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000008192_4194304.pth [2023-03-12 01:46:24,618][124793] Updated weights for policy 0, policy_version 8880 (0.0005) [2023-03-12 01:46:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10513.1, 300 sec: 10191.4). Total num frames: 4558848. Throughput: 0: 10415.6. Samples: 4556512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:46:26,005][124505] Avg episode reward: [(0, '4586.953')] [2023-03-12 01:46:28,692][124793] Updated weights for policy 0, policy_version 8960 (0.0005) [2023-03-12 01:46:31,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10376.5, 300 sec: 10191.4). Total num frames: 4608000. Throughput: 0: 10403.9. Samples: 4587232. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:46:31,005][124505] Avg episode reward: [(0, '4589.537')] [2023-03-12 01:46:32,691][124793] Updated weights for policy 0, policy_version 9040 (0.0005) [2023-03-12 01:46:36,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10376.5, 300 sec: 10205.3). Total num frames: 4661248. Throughput: 0: 10411.7. Samples: 4648500. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:46:36,005][124505] Avg episode reward: [(0, '4584.199')] [2023-03-12 01:46:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000009104_4661248.pth... [2023-03-12 01:46:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000008504_4354048.pth [2023-03-12 01:46:36,691][124793] Updated weights for policy 0, policy_version 9120 (0.0005) [2023-03-12 01:46:40,683][124793] Updated weights for policy 0, policy_version 9200 (0.0005) [2023-03-12 01:46:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10376.5, 300 sec: 10205.3). Total num frames: 4710400. Throughput: 0: 10351.7. Samples: 4709564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:46:41,005][124505] Avg episode reward: [(0, '4574.273')] [2023-03-12 01:46:44,668][124793] Updated weights for policy 0, policy_version 9280 (0.0005) [2023-03-12 01:46:46,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10376.5, 300 sec: 10219.2). Total num frames: 4763648. Throughput: 0: 10304.3. Samples: 4739512. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 01:46:46,005][124505] Avg episode reward: [(0, '4503.873')] [2023-03-12 01:46:48,640][124793] Updated weights for policy 0, policy_version 9360 (0.0005) [2023-03-12 01:46:51,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10308.3, 300 sec: 10233.1). Total num frames: 4812800. Throughput: 0: 10305.6. Samples: 4802064. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 01:46:51,005][124505] Avg episode reward: [(0, '4518.223')] [2023-03-12 01:46:51,060][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000009408_4816896.pth... [2023-03-12 01:46:51,063][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000008800_4505600.pth [2023-03-12 01:46:52,658][124793] Updated weights for policy 0, policy_version 9440 (0.0005) [2023-03-12 01:46:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10308.3, 300 sec: 10246.9). Total num frames: 4866048. Throughput: 0: 10249.3. Samples: 4863404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:46:56,005][124505] Avg episode reward: [(0, '4507.692')] [2023-03-12 01:46:56,605][124793] Updated weights for policy 0, policy_version 9520 (0.0005) [2023-03-12 01:47:00,576][124793] Updated weights for policy 0, policy_version 9600 (0.0005) [2023-03-12 01:47:01,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10376.5, 300 sec: 10246.9). Total num frames: 4919296. Throughput: 0: 10281.1. Samples: 4894792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:47:01,005][124505] Avg episode reward: [(0, '4539.480')] [2023-03-12 01:47:04,619][124793] Updated weights for policy 0, policy_version 9680 (0.0005) [2023-03-12 01:47:06,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10308.3, 300 sec: 10233.1). Total num frames: 4968448. Throughput: 0: 10245.6. Samples: 4956160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:47:06,005][124505] Avg episode reward: [(0, '4545.370')] [2023-03-12 01:47:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000009704_4968448.pth... [2023-03-12 01:47:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000009104_4661248.pth [2023-03-12 01:47:08,633][124793] Updated weights for policy 0, policy_version 9760 (0.0005) [2023-03-12 01:47:11,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10240.0, 300 sec: 10233.1). Total num frames: 5017600. Throughput: 0: 10246.2. Samples: 5017588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:47:11,005][124505] Avg episode reward: [(0, '4538.743')] [2023-03-12 01:47:12,659][124793] Updated weights for policy 0, policy_version 9840 (0.0005) [2023-03-12 01:47:16,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10308.3, 300 sec: 10246.9). Total num frames: 5074944. Throughput: 0: 10236.7. Samples: 5047884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:47:16,005][124505] Avg episode reward: [(0, '4391.502')] [2023-03-12 01:47:16,419][124793] Updated weights for policy 0, policy_version 9920 (0.0004) [2023-03-12 01:47:20,469][124793] Updated weights for policy 0, policy_version 10000 (0.0005) [2023-03-12 01:47:21,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10308.3, 300 sec: 10233.1). Total num frames: 5124096. Throughput: 0: 10285.2. Samples: 5111336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:47:21,005][124505] Avg episode reward: [(0, '4560.708')] [2023-03-12 01:47:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000010008_5124096.pth... [2023-03-12 01:47:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000009408_4816896.pth [2023-03-12 01:47:24,220][124793] Updated weights for policy 0, policy_version 10080 (0.0004) [2023-03-12 01:47:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10308.3, 300 sec: 10233.1). Total num frames: 5177344. Throughput: 0: 10367.4. Samples: 5176100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:47:26,005][124505] Avg episode reward: [(0, '4501.068')] [2023-03-12 01:47:27,953][124793] Updated weights for policy 0, policy_version 10160 (0.0004) [2023-03-12 01:47:31,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10444.8, 300 sec: 10260.8). Total num frames: 5234688. Throughput: 0: 10435.6. Samples: 5209116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:47:31,005][124505] Avg episode reward: [(0, '4560.468')] [2023-03-12 01:47:31,691][124793] Updated weights for policy 0, policy_version 10240 (0.0004) [2023-03-12 01:47:35,640][124793] Updated weights for policy 0, policy_version 10320 (0.0005) [2023-03-12 01:47:36,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10376.5, 300 sec: 10246.9). Total num frames: 5283840. Throughput: 0: 10461.9. Samples: 5272852. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:47:36,005][124505] Avg episode reward: [(0, '4560.794')] [2023-03-12 01:47:36,053][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000010328_5287936.pth... [2023-03-12 01:47:36,055][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000009704_4968448.pth [2023-03-12 01:47:39,648][124793] Updated weights for policy 0, policy_version 10400 (0.0005) [2023-03-12 01:47:41,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10444.8, 300 sec: 10246.9). Total num frames: 5337088. Throughput: 0: 10462.3. Samples: 5334208. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:47:41,005][124505] Avg episode reward: [(0, '4569.900')] [2023-03-12 01:47:43,643][124793] Updated weights for policy 0, policy_version 10480 (0.0004) [2023-03-12 01:47:46,005][124505] Fps is (10 sec: 10240.2, 60 sec: 10376.5, 300 sec: 10233.1). Total num frames: 5386240. Throughput: 0: 10461.5. Samples: 5365560. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:47:46,005][124505] Avg episode reward: [(0, '4567.557')] [2023-03-12 01:47:47,664][124793] Updated weights for policy 0, policy_version 10560 (0.0005) [2023-03-12 01:47:51,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10444.8, 300 sec: 10246.9). Total num frames: 5439488. Throughput: 0: 10439.6. Samples: 5425940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:47:51,005][124505] Avg episode reward: [(0, '3629.232')] [2023-03-12 01:47:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000010624_5439488.pth... [2023-03-12 01:47:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000010008_5124096.pth [2023-03-12 01:47:51,715][124793] Updated weights for policy 0, policy_version 10640 (0.0004) [2023-03-12 01:47:55,703][124793] Updated weights for policy 0, policy_version 10720 (0.0005) [2023-03-12 01:47:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10376.5, 300 sec: 10233.1). Total num frames: 5488640. Throughput: 0: 10446.3. Samples: 5487672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:47:56,005][124505] Avg episode reward: [(0, '4456.148')] [2023-03-12 01:47:59,671][124793] Updated weights for policy 0, policy_version 10800 (0.0003) [2023-03-12 01:48:01,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10376.5, 300 sec: 10233.1). Total num frames: 5541888. Throughput: 0: 10439.5. Samples: 5517660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:48:01,005][124505] Avg episode reward: [(0, '4528.160')] [2023-03-12 01:48:03,389][124793] Updated weights for policy 0, policy_version 10880 (0.0003) [2023-03-12 01:48:06,005][124505] Fps is (10 sec: 11059.1, 60 sec: 10513.1, 300 sec: 10246.9). Total num frames: 5599232. Throughput: 0: 10496.4. Samples: 5583676. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:48:06,005][124505] Avg episode reward: [(0, '4465.312')] [2023-03-12 01:48:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000010936_5599232.pth... [2023-03-12 01:48:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000010328_5287936.pth [2023-03-12 01:48:07,131][124793] Updated weights for policy 0, policy_version 10960 (0.0004) [2023-03-12 01:48:11,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10513.1, 300 sec: 10246.9). Total num frames: 5648384. Throughput: 0: 10493.6. Samples: 5648312. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:48:11,005][124505] Avg episode reward: [(0, '4539.767')] [2023-03-12 01:48:11,016][124793] Updated weights for policy 0, policy_version 11040 (0.0005) [2023-03-12 01:48:14,988][124793] Updated weights for policy 0, policy_version 11120 (0.0005) [2023-03-12 01:48:16,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10444.8, 300 sec: 10246.9). Total num frames: 5701632. Throughput: 0: 10432.3. Samples: 5678568. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:48:16,005][124505] Avg episode reward: [(0, '4501.213')] [2023-03-12 01:48:18,698][124793] Updated weights for policy 0, policy_version 11200 (0.0004) [2023-03-12 01:48:21,005][124505] Fps is (10 sec: 11059.1, 60 sec: 10581.3, 300 sec: 10274.7). Total num frames: 5758976. Throughput: 0: 10477.3. Samples: 5744328. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:48:21,005][124505] Avg episode reward: [(0, '4548.551')] [2023-03-12 01:48:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000011248_5758976.pth... [2023-03-12 01:48:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000010624_5439488.pth [2023-03-12 01:48:22,448][124793] Updated weights for policy 0, policy_version 11280 (0.0004) [2023-03-12 01:48:26,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10581.3, 300 sec: 10274.7). Total num frames: 5812224. Throughput: 0: 10572.7. Samples: 5809980. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:48:26,005][124505] Avg episode reward: [(0, '4387.995')] [2023-03-12 01:48:26,182][124793] Updated weights for policy 0, policy_version 11360 (0.0004) [2023-03-12 01:48:29,828][124793] Updated weights for policy 0, policy_version 11440 (0.0004) [2023-03-12 01:48:31,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10581.3, 300 sec: 10302.5). Total num frames: 5869568. Throughput: 0: 10616.6. Samples: 5843308. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:48:31,005][124505] Avg episode reward: [(0, '4584.783')] [2023-03-12 01:48:33,548][124793] Updated weights for policy 0, policy_version 11520 (0.0004) [2023-03-12 01:48:36,005][124505] Fps is (10 sec: 11059.1, 60 sec: 10649.6, 300 sec: 10302.5). Total num frames: 5922816. Throughput: 0: 10749.8. Samples: 5909680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:48:36,005][124505] Avg episode reward: [(0, '4402.247')] [2023-03-12 01:48:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000011568_5922816.pth... [2023-03-12 01:48:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000010936_5599232.pth [2023-03-12 01:48:37,468][124793] Updated weights for policy 0, policy_version 11600 (0.0005) [2023-03-12 01:48:41,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10581.3, 300 sec: 10316.4). Total num frames: 5971968. Throughput: 0: 10762.1. Samples: 5971968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:48:41,005][124505] Avg episode reward: [(0, '4557.620')] [2023-03-12 01:48:41,448][124793] Updated weights for policy 0, policy_version 11680 (0.0005) [2023-03-12 01:48:45,464][124793] Updated weights for policy 0, policy_version 11760 (0.0004) [2023-03-12 01:48:46,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10649.6, 300 sec: 10330.3). Total num frames: 6025216. Throughput: 0: 10766.2. Samples: 6002140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:48:46,005][124505] Avg episode reward: [(0, '4528.611')] [2023-03-12 01:48:49,385][124793] Updated weights for policy 0, policy_version 11840 (0.0005) [2023-03-12 01:48:51,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10649.6, 300 sec: 10358.0). Total num frames: 6078464. Throughput: 0: 10676.4. Samples: 6064112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:48:51,005][124505] Avg episode reward: [(0, '4554.930')] [2023-03-12 01:48:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000011872_6078464.pth... [2023-03-12 01:48:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000011248_5758976.pth [2023-03-12 01:48:53,065][124793] Updated weights for policy 0, policy_version 11920 (0.0004) [2023-03-12 01:48:56,005][124505] Fps is (10 sec: 11059.4, 60 sec: 10786.2, 300 sec: 10385.8). Total num frames: 6135808. Throughput: 0: 10730.5. Samples: 6131184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:48:56,005][124505] Avg episode reward: [(0, '4582.135')] [2023-03-12 01:48:56,715][124793] Updated weights for policy 0, policy_version 12000 (0.0005) [2023-03-12 01:49:00,323][124793] Updated weights for policy 0, policy_version 12080 (0.0004) [2023-03-12 01:49:01,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10786.1, 300 sec: 10399.7). Total num frames: 6189056. Throughput: 0: 10815.9. Samples: 6165284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:49:01,005][124505] Avg episode reward: [(0, '4580.229')] [2023-03-12 01:49:03,980][124793] Updated weights for policy 0, policy_version 12160 (0.0004) [2023-03-12 01:49:06,005][124505] Fps is (10 sec: 11059.0, 60 sec: 10786.1, 300 sec: 10427.4). Total num frames: 6246400. Throughput: 0: 10846.7. Samples: 6232432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:49:06,005][124505] Avg episode reward: [(0, '4532.573')] [2023-03-12 01:49:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000012200_6246400.pth... [2023-03-12 01:49:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000011568_5922816.pth [2023-03-12 01:49:07,644][124793] Updated weights for policy 0, policy_version 12240 (0.0004) [2023-03-12 01:49:11,005][124505] Fps is (10 sec: 11468.8, 60 sec: 10922.6, 300 sec: 10455.2). Total num frames: 6303744. Throughput: 0: 10897.4. Samples: 6300364. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:49:11,016][124505] Avg episode reward: [(0, '4552.648')] [2023-03-12 01:49:11,200][124793] Updated weights for policy 0, policy_version 12320 (0.0004) [2023-03-12 01:49:14,795][124793] Updated weights for policy 0, policy_version 12400 (0.0004) [2023-03-12 01:49:16,005][124505] Fps is (10 sec: 11468.9, 60 sec: 10990.9, 300 sec: 10469.1). Total num frames: 6361088. Throughput: 0: 10938.2. Samples: 6335528. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:49:16,016][124505] Avg episode reward: [(0, '4561.477')] [2023-03-12 01:49:18,499][124793] Updated weights for policy 0, policy_version 12480 (0.0005) [2023-03-12 01:49:21,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 10483.0). Total num frames: 6414336. Throughput: 0: 10941.7. Samples: 6402056. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:49:21,016][124505] Avg episode reward: [(0, '4539.133')] [2023-03-12 01:49:21,018][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000012528_6414336.pth... [2023-03-12 01:49:21,020][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000011872_6078464.pth [2023-03-12 01:49:22,142][124793] Updated weights for policy 0, policy_version 12560 (0.0004) [2023-03-12 01:49:25,948][124793] Updated weights for policy 0, policy_version 12640 (0.0004) [2023-03-12 01:49:26,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 10496.9). Total num frames: 6471680. Throughput: 0: 11017.3. Samples: 6467748. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:49:26,016][124505] Avg episode reward: [(0, '4512.424')] [2023-03-12 01:49:29,848][124793] Updated weights for policy 0, policy_version 12720 (0.0005) [2023-03-12 01:49:31,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10854.4, 300 sec: 10496.9). Total num frames: 6520832. Throughput: 0: 11060.7. Samples: 6499872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:49:31,016][124505] Avg episode reward: [(0, '4569.943')] [2023-03-12 01:49:33,717][124793] Updated weights for policy 0, policy_version 12800 (0.0005) [2023-03-12 01:49:36,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10854.4, 300 sec: 10510.8). Total num frames: 6574080. Throughput: 0: 11068.8. Samples: 6562208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:49:36,016][124505] Avg episode reward: [(0, '4569.774')] [2023-03-12 01:49:36,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000012840_6574080.pth... [2023-03-12 01:49:36,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000012200_6246400.pth [2023-03-12 01:49:37,492][124793] Updated weights for policy 0, policy_version 12880 (0.0004) [2023-03-12 01:49:41,005][124505] Fps is (10 sec: 11059.1, 60 sec: 10990.9, 300 sec: 10552.4). Total num frames: 6631424. Throughput: 0: 11069.4. Samples: 6629308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:49:41,016][124505] Avg episode reward: [(0, '4518.962')] [2023-03-12 01:49:41,115][124793] Updated weights for policy 0, policy_version 12960 (0.0004) [2023-03-12 01:49:44,649][124793] Updated weights for policy 0, policy_version 13040 (0.0005) [2023-03-12 01:49:46,005][124505] Fps is (10 sec: 11468.9, 60 sec: 11059.2, 300 sec: 10580.2). Total num frames: 6688768. Throughput: 0: 11087.0. Samples: 6664200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:49:46,016][124505] Avg episode reward: [(0, '4572.037')] [2023-03-12 01:49:48,287][124793] Updated weights for policy 0, policy_version 13120 (0.0004) [2023-03-12 01:49:51,005][124505] Fps is (10 sec: 11468.8, 60 sec: 11127.5, 300 sec: 10607.9). Total num frames: 6746112. Throughput: 0: 11101.3. Samples: 6731988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:49:51,016][124505] Avg episode reward: [(0, '4581.406')] [2023-03-12 01:49:51,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000013176_6746112.pth... [2023-03-12 01:49:51,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000012528_6414336.pth [2023-03-12 01:49:52,045][124793] Updated weights for policy 0, policy_version 13200 (0.0004) [2023-03-12 01:49:55,848][124793] Updated weights for policy 0, policy_version 13280 (0.0005) [2023-03-12 01:49:56,005][124505] Fps is (10 sec: 11059.1, 60 sec: 11059.2, 300 sec: 10621.8). Total num frames: 6799360. Throughput: 0: 11022.9. Samples: 6796396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:49:56,005][124505] Avg episode reward: [(0, '4560.659')] [2023-03-12 01:49:59,474][124793] Updated weights for policy 0, policy_version 13360 (0.0004) [2023-03-12 01:50:01,005][124505] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 10635.7). Total num frames: 6856704. Throughput: 0: 10989.9. Samples: 6830076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:50:01,005][124505] Avg episode reward: [(0, '4583.842')] [2023-03-12 01:50:03,250][124793] Updated weights for policy 0, policy_version 13440 (0.0005) [2023-03-12 01:50:06,005][124505] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 10635.7). Total num frames: 6909952. Throughput: 0: 10983.3. Samples: 6896304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:50:06,006][124505] Avg episode reward: [(0, '4534.188')] [2023-03-12 01:50:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000013496_6909952.pth... [2023-03-12 01:50:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000012840_6574080.pth [2023-03-12 01:50:06,967][124793] Updated weights for policy 0, policy_version 13520 (0.0004) [2023-03-12 01:50:10,811][124793] Updated weights for policy 0, policy_version 13600 (0.0005) [2023-03-12 01:50:11,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10990.9, 300 sec: 10635.7). Total num frames: 6963200. Throughput: 0: 10952.8. Samples: 6960624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:50:11,005][124505] Avg episode reward: [(0, '4589.107')] [2023-03-12 01:50:14,731][124793] Updated weights for policy 0, policy_version 13680 (0.0005) [2023-03-12 01:50:16,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10922.7, 300 sec: 10649.6). Total num frames: 7016448. Throughput: 0: 10944.7. Samples: 6992384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:50:16,005][124505] Avg episode reward: [(0, '4521.405')] [2023-03-12 01:50:18,722][124793] Updated weights for policy 0, policy_version 13760 (0.0005) [2023-03-12 01:50:21,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10854.4, 300 sec: 10635.7). Total num frames: 7065600. Throughput: 0: 10925.1. Samples: 7053836. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:50:21,005][124505] Avg episode reward: [(0, '4549.058')] [2023-03-12 01:50:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000013800_7065600.pth... [2023-03-12 01:50:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000013176_6746112.pth [2023-03-12 01:50:22,696][124793] Updated weights for policy 0, policy_version 13840 (0.0005) [2023-03-12 01:50:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10786.1, 300 sec: 10621.8). Total num frames: 7118848. Throughput: 0: 10806.0. Samples: 7115580. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:50:26,005][124505] Avg episode reward: [(0, '4458.654')] [2023-03-12 01:50:26,676][124793] Updated weights for policy 0, policy_version 13920 (0.0005) [2023-03-12 01:50:30,668][124793] Updated weights for policy 0, policy_version 14000 (0.0005) [2023-03-12 01:50:31,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10786.1, 300 sec: 10607.9). Total num frames: 7168000. Throughput: 0: 10716.1. Samples: 7146424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:50:31,005][124505] Avg episode reward: [(0, '4499.022')] [2023-03-12 01:50:34,537][124793] Updated weights for policy 0, policy_version 14080 (0.0005) [2023-03-12 01:50:36,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10786.1, 300 sec: 10621.8). Total num frames: 7221248. Throughput: 0: 10604.0. Samples: 7209168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:50:36,005][124505] Avg episode reward: [(0, '4602.067')] [2023-03-12 01:50:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000014104_7221248.pth... [2023-03-12 01:50:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000013496_6909952.pth [2023-03-12 01:50:36,012][124749] Saving new best policy, reward=4602.067! [2023-03-12 01:50:38,552][124793] Updated weights for policy 0, policy_version 14160 (0.0005) [2023-03-12 01:50:41,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10717.9, 300 sec: 10621.8). Total num frames: 7274496. Throughput: 0: 10535.6. Samples: 7270496. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:50:41,005][124505] Avg episode reward: [(0, '4570.970')] [2023-03-12 01:50:42,624][124793] Updated weights for policy 0, policy_version 14240 (0.0005) [2023-03-12 01:50:46,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10581.3, 300 sec: 10607.9). Total num frames: 7323648. Throughput: 0: 10452.7. Samples: 7300448. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:50:46,005][124505] Avg episode reward: [(0, '4450.646')] [2023-03-12 01:50:46,668][124793] Updated weights for policy 0, policy_version 14320 (0.0005) [2023-03-12 01:50:50,511][124793] Updated weights for policy 0, policy_version 14400 (0.0005) [2023-03-12 01:50:51,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10513.1, 300 sec: 10607.9). Total num frames: 7376896. Throughput: 0: 10379.5. Samples: 7363380. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 01:50:51,005][124505] Avg episode reward: [(0, '4553.591')] [2023-03-12 01:50:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000014408_7376896.pth... [2023-03-12 01:50:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000013800_7065600.pth [2023-03-12 01:50:54,391][124793] Updated weights for policy 0, policy_version 14480 (0.0005) [2023-03-12 01:50:56,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10513.1, 300 sec: 10621.8). Total num frames: 7430144. Throughput: 0: 10344.4. Samples: 7426120. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 01:50:56,005][124505] Avg episode reward: [(0, '4588.823')] [2023-03-12 01:50:58,302][124793] Updated weights for policy 0, policy_version 14560 (0.0005) [2023-03-12 01:51:01,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10376.6, 300 sec: 10607.9). Total num frames: 7479296. Throughput: 0: 10346.0. Samples: 7457952. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:51:01,005][124505] Avg episode reward: [(0, '4578.169')] [2023-03-12 01:51:02,232][124793] Updated weights for policy 0, policy_version 14640 (0.0005) [2023-03-12 01:51:06,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10376.5, 300 sec: 10607.9). Total num frames: 7532544. Throughput: 0: 10359.8. Samples: 7520028. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:51:06,005][124505] Avg episode reward: [(0, '4540.822')] [2023-03-12 01:51:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000014712_7532544.pth... [2023-03-12 01:51:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000014104_7221248.pth [2023-03-12 01:51:06,264][124793] Updated weights for policy 0, policy_version 14720 (0.0005) [2023-03-12 01:51:10,308][124793] Updated weights for policy 0, policy_version 14800 (0.0005) [2023-03-12 01:51:11,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10308.3, 300 sec: 10594.1). Total num frames: 7581696. Throughput: 0: 10335.2. Samples: 7580664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:51:11,005][124505] Avg episode reward: [(0, '4490.520')] [2023-03-12 01:51:14,291][124793] Updated weights for policy 0, policy_version 14880 (0.0005) [2023-03-12 01:51:16,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10308.3, 300 sec: 10607.9). Total num frames: 7634944. Throughput: 0: 10323.7. Samples: 7610992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:51:16,005][124505] Avg episode reward: [(0, '4487.484')] [2023-03-12 01:51:18,272][124793] Updated weights for policy 0, policy_version 14960 (0.0005) [2023-03-12 01:51:21,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10376.5, 300 sec: 10607.9). Total num frames: 7688192. Throughput: 0: 10320.9. Samples: 7673608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:51:21,005][124505] Avg episode reward: [(0, '4547.823')] [2023-03-12 01:51:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000015016_7688192.pth... [2023-03-12 01:51:21,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000014408_7376896.pth [2023-03-12 01:51:22,119][124793] Updated weights for policy 0, policy_version 15040 (0.0005) [2023-03-12 01:51:26,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10308.3, 300 sec: 10607.9). Total num frames: 7737344. Throughput: 0: 10355.6. Samples: 7736496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:51:26,005][124505] Avg episode reward: [(0, '4564.953')] [2023-03-12 01:51:26,064][124793] Updated weights for policy 0, policy_version 15120 (0.0005) [2023-03-12 01:51:29,991][124793] Updated weights for policy 0, policy_version 15200 (0.0005) [2023-03-12 01:51:31,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10376.5, 300 sec: 10607.9). Total num frames: 7790592. Throughput: 0: 10386.3. Samples: 7767832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:51:31,005][124505] Avg episode reward: [(0, '4573.045')] [2023-03-12 01:51:33,956][124793] Updated weights for policy 0, policy_version 15280 (0.0005) [2023-03-12 01:51:36,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10376.5, 300 sec: 10621.8). Total num frames: 7843840. Throughput: 0: 10373.7. Samples: 7830196. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:51:36,005][124505] Avg episode reward: [(0, '4578.269')] [2023-03-12 01:51:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000015320_7843840.pth... [2023-03-12 01:51:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000014712_7532544.pth [2023-03-12 01:51:37,918][124793] Updated weights for policy 0, policy_version 15360 (0.0005) [2023-03-12 01:51:41,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10308.3, 300 sec: 10607.9). Total num frames: 7892992. Throughput: 0: 10354.7. Samples: 7892080. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:51:41,005][124505] Avg episode reward: [(0, '4575.039')] [2023-03-12 01:51:41,843][124793] Updated weights for policy 0, policy_version 15440 (0.0005) [2023-03-12 01:51:45,795][124793] Updated weights for policy 0, policy_version 15520 (0.0005) [2023-03-12 01:51:46,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10376.5, 300 sec: 10621.8). Total num frames: 7946240. Throughput: 0: 10340.2. Samples: 7923260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:51:46,005][124505] Avg episode reward: [(0, '4582.598')] [2023-03-12 01:51:49,852][124793] Updated weights for policy 0, policy_version 15600 (0.0005) [2023-03-12 01:51:51,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10308.3, 300 sec: 10607.9). Total num frames: 7995392. Throughput: 0: 10317.9. Samples: 7984332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:51:51,005][124505] Avg episode reward: [(0, '4561.672')] [2023-03-12 01:51:51,048][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000015624_7999488.pth... [2023-03-12 01:51:51,051][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000015016_7688192.pth [2023-03-12 01:51:53,849][124793] Updated weights for policy 0, policy_version 15680 (0.0005) [2023-03-12 01:51:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10308.3, 300 sec: 10607.9). Total num frames: 8048640. Throughput: 0: 10350.5. Samples: 8046436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:51:56,005][124505] Avg episode reward: [(0, '4581.300')] [2023-03-12 01:51:57,768][124793] Updated weights for policy 0, policy_version 15760 (0.0005) [2023-03-12 01:52:01,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10376.5, 300 sec: 10621.8). Total num frames: 8101888. Throughput: 0: 10364.5. Samples: 8077396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:52:01,005][124505] Avg episode reward: [(0, '4551.768')] [2023-03-12 01:52:01,752][124793] Updated weights for policy 0, policy_version 15840 (0.0005) [2023-03-12 01:52:05,852][124793] Updated weights for policy 0, policy_version 15920 (0.0005) [2023-03-12 01:52:06,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10308.3, 300 sec: 10621.8). Total num frames: 8151040. Throughput: 0: 10336.5. Samples: 8138752. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:52:06,005][124505] Avg episode reward: [(0, '3604.514')] [2023-03-12 01:52:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000015920_8151040.pth... [2023-03-12 01:52:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000015320_7843840.pth [2023-03-12 01:52:09,925][124793] Updated weights for policy 0, policy_version 16000 (0.0005) [2023-03-12 01:52:11,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10308.3, 300 sec: 10594.1). Total num frames: 8200192. Throughput: 0: 10286.5. Samples: 8199388. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:52:11,005][124505] Avg episode reward: [(0, '3962.155')] [2023-03-12 01:52:13,971][124793] Updated weights for policy 0, policy_version 16080 (0.0005) [2023-03-12 01:52:16,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10308.3, 300 sec: 10607.9). Total num frames: 8253440. Throughput: 0: 10245.4. Samples: 8228876. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:52:16,005][124505] Avg episode reward: [(0, '4235.923')] [2023-03-12 01:52:17,585][124793] Updated weights for policy 0, policy_version 16160 (0.0004) [2023-03-12 01:52:21,005][124505] Fps is (10 sec: 11059.1, 60 sec: 10376.5, 300 sec: 10621.8). Total num frames: 8310784. Throughput: 0: 10340.9. Samples: 8295536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:52:21,005][124505] Avg episode reward: [(0, '4522.656')] [2023-03-12 01:52:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000016232_8310784.pth... [2023-03-12 01:52:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000015624_7999488.pth [2023-03-12 01:52:21,370][124793] Updated weights for policy 0, policy_version 16240 (0.0005) [2023-03-12 01:52:25,159][124793] Updated weights for policy 0, policy_version 16320 (0.0004) [2023-03-12 01:52:26,005][124505] Fps is (10 sec: 11059.1, 60 sec: 10444.8, 300 sec: 10607.9). Total num frames: 8364032. Throughput: 0: 10398.2. Samples: 8360000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:52:26,006][124505] Avg episode reward: [(0, '4549.652')] [2023-03-12 01:52:29,035][124793] Updated weights for policy 0, policy_version 16400 (0.0005) [2023-03-12 01:52:31,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10444.8, 300 sec: 10621.8). Total num frames: 8417280. Throughput: 0: 10422.8. Samples: 8392284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:52:31,005][124505] Avg episode reward: [(0, '4571.320')] [2023-03-12 01:52:33,049][124793] Updated weights for policy 0, policy_version 16480 (0.0005) [2023-03-12 01:52:36,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10376.5, 300 sec: 10607.9). Total num frames: 8466432. Throughput: 0: 10433.8. Samples: 8453852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:52:36,005][124505] Avg episode reward: [(0, '4415.526')] [2023-03-12 01:52:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000016536_8466432.pth... [2023-03-12 01:52:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000015920_8151040.pth [2023-03-12 01:52:37,002][124793] Updated weights for policy 0, policy_version 16560 (0.0005) [2023-03-12 01:52:40,727][124793] Updated weights for policy 0, policy_version 16640 (0.0004) [2023-03-12 01:52:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10444.8, 300 sec: 10621.8). Total num frames: 8519680. Throughput: 0: 10483.8. Samples: 8518208. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:52:41,005][124505] Avg episode reward: [(0, '4455.245')] [2023-03-12 01:52:44,375][124793] Updated weights for policy 0, policy_version 16720 (0.0004) [2023-03-12 01:52:46,005][124505] Fps is (10 sec: 11059.3, 60 sec: 10513.1, 300 sec: 10635.7). Total num frames: 8577024. Throughput: 0: 10550.5. Samples: 8552168. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:52:46,005][124505] Avg episode reward: [(0, '4566.142')] [2023-03-12 01:52:48,053][124793] Updated weights for policy 0, policy_version 16800 (0.0004) [2023-03-12 01:52:51,005][124505] Fps is (10 sec: 11468.8, 60 sec: 10649.6, 300 sec: 10663.5). Total num frames: 8634368. Throughput: 0: 10666.4. Samples: 8618740. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:52:51,005][124505] Avg episode reward: [(0, '4575.004')] [2023-03-12 01:52:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000016864_8634368.pth... [2023-03-12 01:52:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000016232_8310784.pth [2023-03-12 01:52:51,682][124793] Updated weights for policy 0, policy_version 16880 (0.0004) [2023-03-12 01:52:55,441][124793] Updated weights for policy 0, policy_version 16960 (0.0005) [2023-03-12 01:52:56,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10649.6, 300 sec: 10663.5). Total num frames: 8687616. Throughput: 0: 10793.1. Samples: 8685080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:52:56,005][124505] Avg episode reward: [(0, '4567.788')] [2023-03-12 01:52:59,058][124793] Updated weights for policy 0, policy_version 17040 (0.0005) [2023-03-12 01:53:01,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10717.9, 300 sec: 10663.5). Total num frames: 8744960. Throughput: 0: 10894.0. Samples: 8719108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:53:01,005][124505] Avg episode reward: [(0, '4573.017')] [2023-03-12 01:53:02,712][124793] Updated weights for policy 0, policy_version 17120 (0.0004) [2023-03-12 01:53:06,005][124505] Fps is (10 sec: 11468.8, 60 sec: 10854.4, 300 sec: 10691.3). Total num frames: 8802304. Throughput: 0: 10906.9. Samples: 8786348. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:53:06,005][124505] Avg episode reward: [(0, '4567.946')] [2023-03-12 01:53:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000017192_8802304.pth... [2023-03-12 01:53:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000016536_8466432.pth [2023-03-12 01:53:06,327][124793] Updated weights for policy 0, policy_version 17200 (0.0004) [2023-03-12 01:53:10,020][124793] Updated weights for policy 0, policy_version 17280 (0.0004) [2023-03-12 01:53:11,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 10691.3). Total num frames: 8855552. Throughput: 0: 10959.6. Samples: 8853180. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:53:11,005][124505] Avg episode reward: [(0, '4573.755')] [2023-03-12 01:53:13,739][124793] Updated weights for policy 0, policy_version 17360 (0.0004) [2023-03-12 01:53:16,005][124505] Fps is (10 sec: 11059.3, 60 sec: 10990.9, 300 sec: 10691.3). Total num frames: 8912896. Throughput: 0: 10984.2. Samples: 8886572. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:53:16,005][124505] Avg episode reward: [(0, '4573.822')] [2023-03-12 01:53:17,361][124793] Updated weights for policy 0, policy_version 17440 (0.0004) [2023-03-12 01:53:21,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 10691.3). Total num frames: 8966144. Throughput: 0: 11091.4. Samples: 8952964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:53:21,005][124505] Avg episode reward: [(0, '4566.453')] [2023-03-12 01:53:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000017512_8966144.pth... [2023-03-12 01:53:21,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000016864_8634368.pth [2023-03-12 01:53:21,275][124793] Updated weights for policy 0, policy_version 17520 (0.0005) [2023-03-12 01:53:25,204][124793] Updated weights for policy 0, policy_version 17600 (0.0005) [2023-03-12 01:53:26,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10922.7, 300 sec: 10677.4). Total num frames: 9019392. Throughput: 0: 11047.8. Samples: 9015360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:53:26,005][124505] Avg episode reward: [(0, '4580.230')] [2023-03-12 01:53:29,173][124793] Updated weights for policy 0, policy_version 17680 (0.0005) [2023-03-12 01:53:31,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10854.4, 300 sec: 10663.5). Total num frames: 9068544. Throughput: 0: 10983.5. Samples: 9046424. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:53:31,005][124505] Avg episode reward: [(0, '4579.069')] [2023-03-12 01:53:33,223][124793] Updated weights for policy 0, policy_version 17760 (0.0005) [2023-03-12 01:53:36,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10922.7, 300 sec: 10677.4). Total num frames: 9121792. Throughput: 0: 10858.3. Samples: 9107364. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:53:36,005][124505] Avg episode reward: [(0, '4587.908')] [2023-03-12 01:53:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000017816_9121792.pth... [2023-03-12 01:53:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000017192_8802304.pth [2023-03-12 01:53:37,115][124793] Updated weights for policy 0, policy_version 17840 (0.0005) [2023-03-12 01:53:40,755][124793] Updated weights for policy 0, policy_version 17920 (0.0004) [2023-03-12 01:53:41,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10922.7, 300 sec: 10677.4). Total num frames: 9175040. Throughput: 0: 10844.4. Samples: 9173076. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:53:41,005][124505] Avg episode reward: [(0, '4534.421')] [2023-03-12 01:53:44,583][124793] Updated weights for policy 0, policy_version 18000 (0.0005) [2023-03-12 01:53:46,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10854.4, 300 sec: 10677.4). Total num frames: 9228288. Throughput: 0: 10783.4. Samples: 9204360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:53:46,005][124505] Avg episode reward: [(0, '4483.764')] [2023-03-12 01:53:48,348][124793] Updated weights for policy 0, policy_version 18080 (0.0004) [2023-03-12 01:53:51,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10854.4, 300 sec: 10677.4). Total num frames: 9285632. Throughput: 0: 10760.4. Samples: 9270564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:53:51,016][124505] Avg episode reward: [(0, '4328.177')] [2023-03-12 01:53:51,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000018136_9285632.pth... [2023-03-12 01:53:51,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000017512_8966144.pth [2023-03-12 01:53:52,117][124793] Updated weights for policy 0, policy_version 18160 (0.0004) [2023-03-12 01:53:55,873][124793] Updated weights for policy 0, policy_version 18240 (0.0004) [2023-03-12 01:53:56,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10854.4, 300 sec: 10677.4). Total num frames: 9338880. Throughput: 0: 10723.4. Samples: 9335732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:53:56,016][124505] Avg episode reward: [(0, '4358.922')] [2023-03-12 01:53:59,590][124793] Updated weights for policy 0, policy_version 18320 (0.0004) [2023-03-12 01:54:01,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10786.1, 300 sec: 10663.5). Total num frames: 9392128. Throughput: 0: 10710.6. Samples: 9368548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:54:01,016][124505] Avg episode reward: [(0, '4512.985')] [2023-03-12 01:54:03,261][124793] Updated weights for policy 0, policy_version 18400 (0.0004) [2023-03-12 01:54:06,005][124505] Fps is (10 sec: 11059.1, 60 sec: 10786.1, 300 sec: 10663.5). Total num frames: 9449472. Throughput: 0: 10722.1. Samples: 9435460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:54:06,016][124505] Avg episode reward: [(0, '4541.750')] [2023-03-12 01:54:06,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000018456_9449472.pth... [2023-03-12 01:54:06,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000017816_9121792.pth [2023-03-12 01:54:06,946][124793] Updated weights for policy 0, policy_version 18480 (0.0004) [2023-03-12 01:54:10,692][124793] Updated weights for policy 0, policy_version 18560 (0.0004) [2023-03-12 01:54:11,005][124505] Fps is (10 sec: 11059.1, 60 sec: 10786.1, 300 sec: 10649.6). Total num frames: 9502720. Throughput: 0: 10799.4. Samples: 9501332. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:54:11,016][124505] Avg episode reward: [(0, '4584.515')] [2023-03-12 01:54:14,644][124793] Updated weights for policy 0, policy_version 18640 (0.0005) [2023-03-12 01:54:16,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10717.9, 300 sec: 10649.6). Total num frames: 9555968. Throughput: 0: 10807.3. Samples: 9532752. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:54:16,016][124505] Avg episode reward: [(0, '4494.272')] [2023-03-12 01:54:18,370][124793] Updated weights for policy 0, policy_version 18720 (0.0005) [2023-03-12 01:54:21,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10786.1, 300 sec: 10649.6). Total num frames: 9613312. Throughput: 0: 10912.6. Samples: 9598432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:54:21,016][124505] Avg episode reward: [(0, '4556.940')] [2023-03-12 01:54:21,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000018776_9613312.pth... [2023-03-12 01:54:21,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000018136_9285632.pth [2023-03-12 01:54:22,002][124793] Updated weights for policy 0, policy_version 18800 (0.0004) [2023-03-12 01:54:25,686][124793] Updated weights for policy 0, policy_version 18880 (0.0004) [2023-03-12 01:54:26,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10786.1, 300 sec: 10663.5). Total num frames: 9666560. Throughput: 0: 10938.2. Samples: 9665296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:54:26,016][124505] Avg episode reward: [(0, '4571.567')] [2023-03-12 01:54:29,490][124793] Updated weights for policy 0, policy_version 18960 (0.0005) [2023-03-12 01:54:31,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 10677.4). Total num frames: 9723904. Throughput: 0: 10960.8. Samples: 9697596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:54:31,016][124505] Avg episode reward: [(0, '4579.441')] [2023-03-12 01:54:33,178][124793] Updated weights for policy 0, policy_version 19040 (0.0004) [2023-03-12 01:54:36,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 10663.5). Total num frames: 9777152. Throughput: 0: 10969.3. Samples: 9764184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:54:36,016][124505] Avg episode reward: [(0, '4580.149')] [2023-03-12 01:54:36,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000019096_9777152.pth... [2023-03-12 01:54:36,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000018456_9449472.pth [2023-03-12 01:54:36,916][124793] Updated weights for policy 0, policy_version 19120 (0.0004) [2023-03-12 01:54:40,665][124793] Updated weights for policy 0, policy_version 19200 (0.0004) [2023-03-12 01:54:41,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10922.7, 300 sec: 10649.6). Total num frames: 9830400. Throughput: 0: 10978.5. Samples: 9829764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:54:41,016][124505] Avg episode reward: [(0, '4578.613')] [2023-03-12 01:54:44,488][124793] Updated weights for policy 0, policy_version 19280 (0.0004) [2023-03-12 01:54:46,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 10649.6). Total num frames: 9887744. Throughput: 0: 10962.1. Samples: 9861844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:54:46,005][124505] Avg episode reward: [(0, '4566.137')] [2023-03-12 01:54:48,245][124793] Updated weights for policy 0, policy_version 19360 (0.0004) [2023-03-12 01:54:51,005][124505] Fps is (10 sec: 11059.1, 60 sec: 10922.7, 300 sec: 10649.6). Total num frames: 9940992. Throughput: 0: 10924.1. Samples: 9927044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:54:51,005][124505] Avg episode reward: [(0, '4579.934')] [2023-03-12 01:54:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000019416_9940992.pth... [2023-03-12 01:54:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000018776_9613312.pth [2023-03-12 01:54:51,943][124793] Updated weights for policy 0, policy_version 19440 (0.0004) [2023-03-12 01:54:55,723][124793] Updated weights for policy 0, policy_version 19520 (0.0004) [2023-03-12 01:54:56,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10922.7, 300 sec: 10635.7). Total num frames: 9994240. Throughput: 0: 10921.2. Samples: 9992784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:54:56,005][124505] Avg episode reward: [(0, '4582.293')] [2023-03-12 01:54:59,453][124793] Updated weights for policy 0, policy_version 19600 (0.0004) [2023-03-12 01:55:01,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 10649.6). Total num frames: 10051584. Throughput: 0: 10956.4. Samples: 10025792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:55:01,005][124505] Avg episode reward: [(0, '4585.082')] [2023-03-12 01:55:03,288][124793] Updated weights for policy 0, policy_version 19680 (0.0005) [2023-03-12 01:55:06,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 10649.6). Total num frames: 10104832. Throughput: 0: 10932.7. Samples: 10090404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:55:06,005][124505] Avg episode reward: [(0, '4569.380')] [2023-03-12 01:55:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000019736_10104832.pth... [2023-03-12 01:55:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000019096_9777152.pth [2023-03-12 01:55:07,068][124793] Updated weights for policy 0, policy_version 19760 (0.0004) [2023-03-12 01:55:10,846][124793] Updated weights for policy 0, policy_version 19840 (0.0004) [2023-03-12 01:55:11,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10922.7, 300 sec: 10649.6). Total num frames: 10158080. Throughput: 0: 10881.5. Samples: 10154964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:55:11,005][124505] Avg episode reward: [(0, '4571.210')] [2023-03-12 01:55:14,652][124793] Updated weights for policy 0, policy_version 19920 (0.0004) [2023-03-12 01:55:16,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10922.7, 300 sec: 10663.5). Total num frames: 10211328. Throughput: 0: 10881.1. Samples: 10187244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:55:16,005][124505] Avg episode reward: [(0, '4554.906')] [2023-03-12 01:55:18,458][124793] Updated weights for policy 0, policy_version 20000 (0.0005) [2023-03-12 01:55:21,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10854.4, 300 sec: 10663.5). Total num frames: 10264576. Throughput: 0: 10848.2. Samples: 10252352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:55:21,005][124505] Avg episode reward: [(0, '4514.096')] [2023-03-12 01:55:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000020048_10264576.pth... [2023-03-12 01:55:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000019416_9940992.pth [2023-03-12 01:55:22,191][124793] Updated weights for policy 0, policy_version 20080 (0.0004) [2023-03-12 01:55:25,968][124793] Updated weights for policy 0, policy_version 20160 (0.0004) [2023-03-12 01:55:26,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 10691.3). Total num frames: 10321920. Throughput: 0: 10847.2. Samples: 10317888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:55:26,016][124505] Avg episode reward: [(0, '4585.494')] [2023-03-12 01:55:29,761][124793] Updated weights for policy 0, policy_version 20240 (0.0004) [2023-03-12 01:55:31,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10786.1, 300 sec: 10677.4). Total num frames: 10371072. Throughput: 0: 10856.0. Samples: 10350364. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:55:31,016][124505] Avg episode reward: [(0, '4497.151')] [2023-03-12 01:55:33,921][124793] Updated weights for policy 0, policy_version 20320 (0.0005) [2023-03-12 01:55:36,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10786.1, 300 sec: 10677.4). Total num frames: 10424320. Throughput: 0: 10760.5. Samples: 10411268. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:55:36,007][124505] Avg episode reward: [(0, '4487.500')] [2023-03-12 01:55:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000020360_10424320.pth... [2023-03-12 01:55:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000019736_10104832.pth [2023-03-12 01:55:37,689][124793] Updated weights for policy 0, policy_version 20400 (0.0004) [2023-03-12 01:55:41,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10786.1, 300 sec: 10691.3). Total num frames: 10477568. Throughput: 0: 10742.4. Samples: 10476192. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:55:41,016][124505] Avg episode reward: [(0, '4511.495')] [2023-03-12 01:55:41,460][124793] Updated weights for policy 0, policy_version 20480 (0.0004) [2023-03-12 01:55:45,251][124793] Updated weights for policy 0, policy_version 20560 (0.0003) [2023-03-12 01:55:46,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10717.9, 300 sec: 10691.3). Total num frames: 10530816. Throughput: 0: 10745.4. Samples: 10509336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:55:46,005][124505] Avg episode reward: [(0, '4513.185')] [2023-03-12 01:55:49,340][124793] Updated weights for policy 0, policy_version 20640 (0.0005) [2023-03-12 01:55:51,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10649.6, 300 sec: 10677.4). Total num frames: 10579968. Throughput: 0: 10670.4. Samples: 10570572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:55:51,006][124505] Avg episode reward: [(0, '4487.319')] [2023-03-12 01:55:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000020672_10584064.pth... [2023-03-12 01:55:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000020048_10264576.pth [2023-03-12 01:55:53,364][124793] Updated weights for policy 0, policy_version 20720 (0.0005) [2023-03-12 01:55:56,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10649.6, 300 sec: 10691.3). Total num frames: 10633216. Throughput: 0: 10582.5. Samples: 10631176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:55:56,006][124505] Avg episode reward: [(0, '4583.587')] [2023-03-12 01:55:57,336][124793] Updated weights for policy 0, policy_version 20800 (0.0005) [2023-03-12 01:56:01,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10581.3, 300 sec: 10691.3). Total num frames: 10686464. Throughput: 0: 10549.3. Samples: 10661960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:56:01,005][124505] Avg episode reward: [(0, '4543.039')] [2023-03-12 01:56:01,317][124793] Updated weights for policy 0, policy_version 20880 (0.0004) [2023-03-12 01:56:05,301][124793] Updated weights for policy 0, policy_version 20960 (0.0005) [2023-03-12 01:56:06,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10513.1, 300 sec: 10691.3). Total num frames: 10735616. Throughput: 0: 10489.9. Samples: 10724396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:56:06,005][124505] Avg episode reward: [(0, '4587.854')] [2023-03-12 01:56:06,067][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000020976_10739712.pth... [2023-03-12 01:56:06,069][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000020360_10424320.pth [2023-03-12 01:56:09,203][124793] Updated weights for policy 0, policy_version 21040 (0.0005) [2023-03-12 01:56:11,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10513.1, 300 sec: 10691.3). Total num frames: 10788864. Throughput: 0: 10417.3. Samples: 10786668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:56:11,005][124505] Avg episode reward: [(0, '4589.944')] [2023-03-12 01:56:13,127][124793] Updated weights for policy 0, policy_version 21120 (0.0005) [2023-03-12 01:56:16,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10513.1, 300 sec: 10691.3). Total num frames: 10842112. Throughput: 0: 10388.3. Samples: 10817840. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:56:16,005][124505] Avg episode reward: [(0, '4581.683')] [2023-03-12 01:56:17,065][124793] Updated weights for policy 0, policy_version 21200 (0.0003) [2023-03-12 01:56:20,984][124793] Updated weights for policy 0, policy_version 21280 (0.0005) [2023-03-12 01:56:21,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10513.1, 300 sec: 10705.1). Total num frames: 10895360. Throughput: 0: 10441.2. Samples: 10881124. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:56:21,006][124505] Avg episode reward: [(0, '4590.343')] [2023-03-12 01:56:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000021280_10895360.pth... [2023-03-12 01:56:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000020672_10584064.pth [2023-03-12 01:56:24,975][124793] Updated weights for policy 0, policy_version 21360 (0.0004) [2023-03-12 01:56:26,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10376.5, 300 sec: 10691.3). Total num frames: 10944512. Throughput: 0: 10370.6. Samples: 10942868. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:56:26,005][124505] Avg episode reward: [(0, '4552.172')] [2023-03-12 01:56:28,832][124793] Updated weights for policy 0, policy_version 21440 (0.0005) [2023-03-12 01:56:31,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10444.8, 300 sec: 10691.3). Total num frames: 10997760. Throughput: 0: 10345.7. Samples: 10974892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:56:31,005][124505] Avg episode reward: [(0, '4575.833')] [2023-03-12 01:56:32,777][124793] Updated weights for policy 0, policy_version 21520 (0.0005) [2023-03-12 01:56:36,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10376.5, 300 sec: 10691.2). Total num frames: 11046912. Throughput: 0: 10353.2. Samples: 11036468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:56:36,006][124505] Avg episode reward: [(0, '4216.272')] [2023-03-12 01:56:36,051][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000021584_11051008.pth... [2023-03-12 01:56:36,053][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000020976_10739712.pth [2023-03-12 01:56:36,860][124793] Updated weights for policy 0, policy_version 21600 (0.0005) [2023-03-12 01:56:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10308.3, 300 sec: 10677.4). Total num frames: 11096064. Throughput: 0: 10330.9. Samples: 11096064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:56:41,005][124505] Avg episode reward: [(0, '3194.740')] [2023-03-12 01:56:41,071][124793] Updated weights for policy 0, policy_version 21680 (0.0005) [2023-03-12 01:56:45,157][124793] Updated weights for policy 0, policy_version 21760 (0.0004) [2023-03-12 01:56:46,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10308.3, 300 sec: 10691.3). Total num frames: 11149312. Throughput: 0: 10297.2. Samples: 11125336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:56:46,005][124505] Avg episode reward: [(0, '4100.846')] [2023-03-12 01:56:49,193][124793] Updated weights for policy 0, policy_version 21840 (0.0005) [2023-03-12 01:56:51,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10308.3, 300 sec: 10677.4). Total num frames: 11198464. Throughput: 0: 10261.9. Samples: 11186184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:56:51,005][124505] Avg episode reward: [(0, '4246.100')] [2023-03-12 01:56:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000021872_11198464.pth... [2023-03-12 01:56:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000021280_10895360.pth [2023-03-12 01:56:53,255][124793] Updated weights for policy 0, policy_version 21920 (0.0005) [2023-03-12 01:56:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10240.0, 300 sec: 10663.5). Total num frames: 11247616. Throughput: 0: 10236.6. Samples: 11247316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:56:56,005][124505] Avg episode reward: [(0, '4320.795')] [2023-03-12 01:56:57,303][124793] Updated weights for policy 0, policy_version 22000 (0.0005) [2023-03-12 01:57:01,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10240.0, 300 sec: 10677.4). Total num frames: 11300864. Throughput: 0: 10201.0. Samples: 11276884. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:57:01,005][124505] Avg episode reward: [(0, '4195.672')] [2023-03-12 01:57:01,279][124793] Updated weights for policy 0, policy_version 22080 (0.0005) [2023-03-12 01:57:05,120][124793] Updated weights for policy 0, policy_version 22160 (0.0005) [2023-03-12 01:57:06,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10308.2, 300 sec: 10691.2). Total num frames: 11354112. Throughput: 0: 10204.4. Samples: 11340324. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:57:06,005][124505] Avg episode reward: [(0, '4571.252')] [2023-03-12 01:57:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000022176_11354112.pth... [2023-03-12 01:57:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000021584_11051008.pth [2023-03-12 01:57:08,957][124793] Updated weights for policy 0, policy_version 22240 (0.0005) [2023-03-12 01:57:11,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10308.3, 300 sec: 10691.3). Total num frames: 11407360. Throughput: 0: 10248.7. Samples: 11404060. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:57:11,005][124505] Avg episode reward: [(0, '4577.376')] [2023-03-12 01:57:12,832][124793] Updated weights for policy 0, policy_version 22320 (0.0005) [2023-03-12 01:57:16,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10308.3, 300 sec: 10677.4). Total num frames: 11460608. Throughput: 0: 10247.6. Samples: 11436032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:57:16,005][124505] Avg episode reward: [(0, '4582.300')] [2023-03-12 01:57:16,681][124793] Updated weights for policy 0, policy_version 22400 (0.0005) [2023-03-12 01:57:20,509][124793] Updated weights for policy 0, policy_version 22480 (0.0005) [2023-03-12 01:57:21,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10308.3, 300 sec: 10677.4). Total num frames: 11513856. Throughput: 0: 10291.3. Samples: 11499576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:57:21,006][124505] Avg episode reward: [(0, '4580.514')] [2023-03-12 01:57:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000022488_11513856.pth... [2023-03-12 01:57:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000021872_11198464.pth [2023-03-12 01:57:24,460][124793] Updated weights for policy 0, policy_version 22560 (0.0005) [2023-03-12 01:57:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10308.3, 300 sec: 10663.5). Total num frames: 11563008. Throughput: 0: 10369.7. Samples: 11562700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:57:26,006][124505] Avg episode reward: [(0, '4586.729')] [2023-03-12 01:57:28,408][124793] Updated weights for policy 0, policy_version 22640 (0.0004) [2023-03-12 01:57:31,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10308.3, 300 sec: 10677.4). Total num frames: 11616256. Throughput: 0: 10410.2. Samples: 11593792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:57:31,005][124505] Avg episode reward: [(0, '4586.789')] [2023-03-12 01:57:32,192][124793] Updated weights for policy 0, policy_version 22720 (0.0004) [2023-03-12 01:57:35,795][124793] Updated weights for policy 0, policy_version 22800 (0.0004) [2023-03-12 01:57:36,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10444.8, 300 sec: 10691.3). Total num frames: 11673600. Throughput: 0: 10530.5. Samples: 11660056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:57:36,005][124505] Avg episode reward: [(0, '4575.701')] [2023-03-12 01:57:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000022800_11673600.pth... [2023-03-12 01:57:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000022176_11354112.pth [2023-03-12 01:57:39,314][124793] Updated weights for policy 0, policy_version 22880 (0.0003) [2023-03-12 01:57:41,005][124505] Fps is (10 sec: 11468.7, 60 sec: 10581.3, 300 sec: 10691.3). Total num frames: 11730944. Throughput: 0: 10704.7. Samples: 11729028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:57:41,005][124505] Avg episode reward: [(0, '4589.772')] [2023-03-12 01:57:42,892][124793] Updated weights for policy 0, policy_version 22960 (0.0004) [2023-03-12 01:57:46,005][124505] Fps is (10 sec: 11468.9, 60 sec: 10649.6, 300 sec: 10691.3). Total num frames: 11788288. Throughput: 0: 10818.7. Samples: 11763724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:57:46,005][124505] Avg episode reward: [(0, '4589.260')] [2023-03-12 01:57:46,679][124793] Updated weights for policy 0, policy_version 23040 (0.0005) [2023-03-12 01:57:50,541][124793] Updated weights for policy 0, policy_version 23120 (0.0005) [2023-03-12 01:57:51,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10717.9, 300 sec: 10691.3). Total num frames: 11841536. Throughput: 0: 10823.8. Samples: 11827396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:57:51,005][124505] Avg episode reward: [(0, '4590.507')] [2023-03-12 01:57:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000023128_11841536.pth... [2023-03-12 01:57:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000022488_11513856.pth [2023-03-12 01:57:54,167][124793] Updated weights for policy 0, policy_version 23200 (0.0004) [2023-03-12 01:57:56,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10854.4, 300 sec: 10691.3). Total num frames: 11898880. Throughput: 0: 10902.2. Samples: 11894660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:57:56,005][124505] Avg episode reward: [(0, '4569.954')] [2023-03-12 01:57:57,804][124793] Updated weights for policy 0, policy_version 23280 (0.0004) [2023-03-12 01:58:01,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10854.4, 300 sec: 10677.4). Total num frames: 11952128. Throughput: 0: 10931.0. Samples: 11927928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:58:01,005][124505] Avg episode reward: [(0, '4591.958')] [2023-03-12 01:58:01,406][124793] Updated weights for policy 0, policy_version 23360 (0.0004) [2023-03-12 01:58:05,002][124793] Updated weights for policy 0, policy_version 23440 (0.0004) [2023-03-12 01:58:06,005][124505] Fps is (10 sec: 11059.1, 60 sec: 10922.7, 300 sec: 10691.3). Total num frames: 12009472. Throughput: 0: 11046.9. Samples: 11996688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:58:06,005][124505] Avg episode reward: [(0, '4577.349')] [2023-03-12 01:58:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000023456_12009472.pth... [2023-03-12 01:58:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000022800_11673600.pth [2023-03-12 01:58:08,626][124793] Updated weights for policy 0, policy_version 23520 (0.0005) [2023-03-12 01:58:11,005][124505] Fps is (10 sec: 11468.8, 60 sec: 10990.9, 300 sec: 10691.3). Total num frames: 12066816. Throughput: 0: 11136.0. Samples: 12063820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:58:11,005][124505] Avg episode reward: [(0, '4579.118')] [2023-03-12 01:58:12,277][124793] Updated weights for policy 0, policy_version 23600 (0.0004) [2023-03-12 01:58:15,881][124793] Updated weights for policy 0, policy_version 23680 (0.0005) [2023-03-12 01:58:16,005][124505] Fps is (10 sec: 11468.9, 60 sec: 11059.2, 300 sec: 10705.1). Total num frames: 12124160. Throughput: 0: 11206.0. Samples: 12098064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:58:16,005][124505] Avg episode reward: [(0, '4581.135')] [2023-03-12 01:58:19,553][124793] Updated weights for policy 0, policy_version 23760 (0.0005) [2023-03-12 01:58:21,005][124505] Fps is (10 sec: 11059.1, 60 sec: 11059.2, 300 sec: 10705.1). Total num frames: 12177408. Throughput: 0: 11225.3. Samples: 12165196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:58:21,005][124505] Avg episode reward: [(0, '4587.775')] [2023-03-12 01:58:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000023784_12177408.pth... [2023-03-12 01:58:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000023128_11841536.pth [2023-03-12 01:58:23,441][124793] Updated weights for policy 0, policy_version 23840 (0.0005) [2023-03-12 01:58:26,005][124505] Fps is (10 sec: 10649.5, 60 sec: 11127.5, 300 sec: 10719.0). Total num frames: 12230656. Throughput: 0: 11129.4. Samples: 12229852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:58:26,005][124505] Avg episode reward: [(0, '4559.795')] [2023-03-12 01:58:27,131][124793] Updated weights for policy 0, policy_version 23920 (0.0004) [2023-03-12 01:58:30,959][124793] Updated weights for policy 0, policy_version 24000 (0.0005) [2023-03-12 01:58:31,005][124505] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 10732.9). Total num frames: 12288000. Throughput: 0: 11104.4. Samples: 12263424. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:58:31,005][124505] Avg episode reward: [(0, '4541.200')] [2023-03-12 01:58:34,813][124793] Updated weights for policy 0, policy_version 24080 (0.0005) [2023-03-12 01:58:36,005][124505] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 10732.9). Total num frames: 12341248. Throughput: 0: 11098.3. Samples: 12326820. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:58:36,005][124505] Avg episode reward: [(0, '4579.412')] [2023-03-12 01:58:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000024104_12341248.pth... [2023-03-12 01:58:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000023456_12009472.pth [2023-03-12 01:58:38,606][124793] Updated weights for policy 0, policy_version 24160 (0.0005) [2023-03-12 01:58:41,005][124505] Fps is (10 sec: 10649.6, 60 sec: 11059.2, 300 sec: 10732.9). Total num frames: 12394496. Throughput: 0: 11017.9. Samples: 12390464. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:58:41,005][124505] Avg episode reward: [(0, '4588.243')] [2023-03-12 01:58:42,497][124793] Updated weights for policy 0, policy_version 24240 (0.0005) [2023-03-12 01:58:46,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10990.9, 300 sec: 10719.0). Total num frames: 12447744. Throughput: 0: 10999.8. Samples: 12422920. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:58:46,005][124505] Avg episode reward: [(0, '4517.320')] [2023-03-12 01:58:46,378][124793] Updated weights for policy 0, policy_version 24320 (0.0004) [2023-03-12 01:58:49,966][124793] Updated weights for policy 0, policy_version 24400 (0.0004) [2023-03-12 01:58:51,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10991.0, 300 sec: 10719.0). Total num frames: 12500992. Throughput: 0: 10932.9. Samples: 12488668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:58:51,005][124505] Avg episode reward: [(0, '4588.433')] [2023-03-12 01:58:51,031][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000024424_12505088.pth... [2023-03-12 01:58:51,032][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000023784_12177408.pth [2023-03-12 01:58:53,517][124793] Updated weights for policy 0, policy_version 24480 (0.0004) [2023-03-12 01:58:56,005][124505] Fps is (10 sec: 11059.3, 60 sec: 10990.9, 300 sec: 10732.9). Total num frames: 12558336. Throughput: 0: 10960.7. Samples: 12557052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:58:56,005][124505] Avg episode reward: [(0, '4588.086')] [2023-03-12 01:58:57,145][124793] Updated weights for policy 0, policy_version 24560 (0.0004) [2023-03-12 01:59:00,797][124793] Updated weights for policy 0, policy_version 24640 (0.0004) [2023-03-12 01:59:01,005][124505] Fps is (10 sec: 11468.8, 60 sec: 11059.2, 300 sec: 10732.9). Total num frames: 12615680. Throughput: 0: 10950.8. Samples: 12590852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:59:01,005][124505] Avg episode reward: [(0, '4588.899')] [2023-03-12 01:59:04,309][124793] Updated weights for policy 0, policy_version 24720 (0.0004) [2023-03-12 01:59:06,005][124505] Fps is (10 sec: 11468.7, 60 sec: 11059.2, 300 sec: 10746.8). Total num frames: 12673024. Throughput: 0: 10992.3. Samples: 12659848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:59:06,005][124505] Avg episode reward: [(0, '4597.108')] [2023-03-12 01:59:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000024752_12673024.pth... [2023-03-12 01:59:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000024104_12341248.pth [2023-03-12 01:59:07,868][124793] Updated weights for policy 0, policy_version 24800 (0.0004) [2023-03-12 01:59:11,005][124505] Fps is (10 sec: 11468.8, 60 sec: 11059.2, 300 sec: 10760.7). Total num frames: 12730368. Throughput: 0: 11063.5. Samples: 12727708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:59:11,005][124505] Avg episode reward: [(0, '4583.363')] [2023-03-12 01:59:11,625][124793] Updated weights for policy 0, policy_version 24880 (0.0004) [2023-03-12 01:59:15,550][124793] Updated weights for policy 0, policy_version 24960 (0.0005) [2023-03-12 01:59:16,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 10746.8). Total num frames: 12783616. Throughput: 0: 11013.9. Samples: 12759048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:59:16,005][124505] Avg episode reward: [(0, '4598.010')] [2023-03-12 01:59:19,303][124793] Updated weights for policy 0, policy_version 25040 (0.0005) [2023-03-12 01:59:21,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10990.9, 300 sec: 10746.8). Total num frames: 12836864. Throughput: 0: 11044.7. Samples: 12823832. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:59:21,005][124505] Avg episode reward: [(0, '4598.978')] [2023-03-12 01:59:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000025072_12836864.pth... [2023-03-12 01:59:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000024424_12505088.pth [2023-03-12 01:59:23,071][124793] Updated weights for policy 0, policy_version 25120 (0.0005) [2023-03-12 01:59:26,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10990.9, 300 sec: 10732.9). Total num frames: 12890112. Throughput: 0: 11062.9. Samples: 12888296. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:59:26,005][124505] Avg episode reward: [(0, '4591.083')] [2023-03-12 01:59:26,920][124793] Updated weights for policy 0, policy_version 25200 (0.0005) [2023-03-12 01:59:30,831][124793] Updated weights for policy 0, policy_version 25280 (0.0005) [2023-03-12 01:59:31,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10922.7, 300 sec: 10732.9). Total num frames: 12943360. Throughput: 0: 11031.2. Samples: 12919324. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:59:31,005][124505] Avg episode reward: [(0, '4592.484')] [2023-03-12 01:59:34,824][124793] Updated weights for policy 0, policy_version 25360 (0.0005) [2023-03-12 01:59:36,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10854.4, 300 sec: 10719.0). Total num frames: 12992512. Throughput: 0: 10959.9. Samples: 12981864. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:59:36,005][124505] Avg episode reward: [(0, '4586.396')] [2023-03-12 01:59:36,036][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000025384_12996608.pth... [2023-03-12 01:59:36,037][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000024752_12673024.pth [2023-03-12 01:59:38,857][124793] Updated weights for policy 0, policy_version 25440 (0.0005) [2023-03-12 01:59:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10854.4, 300 sec: 10705.1). Total num frames: 13045760. Throughput: 0: 10796.2. Samples: 13042880. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:59:41,005][124505] Avg episode reward: [(0, '4584.594')] [2023-03-12 01:59:42,816][124793] Updated weights for policy 0, policy_version 25520 (0.0005) [2023-03-12 01:59:46,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10854.4, 300 sec: 10705.1). Total num frames: 13099008. Throughput: 0: 10746.4. Samples: 13074440. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:59:46,005][124505] Avg episode reward: [(0, '4576.676')] [2023-03-12 01:59:46,716][124793] Updated weights for policy 0, policy_version 25600 (0.0005) [2023-03-12 01:59:50,732][124793] Updated weights for policy 0, policy_version 25680 (0.0005) [2023-03-12 01:59:51,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10786.1, 300 sec: 10691.3). Total num frames: 13148160. Throughput: 0: 10593.1. Samples: 13136536. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:59:51,005][124505] Avg episode reward: [(0, '4581.632')] [2023-03-12 01:59:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000025680_13148160.pth... [2023-03-12 01:59:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000025072_12836864.pth [2023-03-12 01:59:54,640][124793] Updated weights for policy 0, policy_version 25760 (0.0005) [2023-03-12 01:59:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10717.9, 300 sec: 10677.4). Total num frames: 13201408. Throughput: 0: 10487.9. Samples: 13199664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:59:56,005][124505] Avg episode reward: [(0, '4587.489')] [2023-03-12 01:59:58,463][124793] Updated weights for policy 0, policy_version 25840 (0.0004) [2023-03-12 02:00:01,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10649.6, 300 sec: 10677.4). Total num frames: 13254656. Throughput: 0: 10495.1. Samples: 13231328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:00:01,005][124505] Avg episode reward: [(0, '4587.298')] [2023-03-12 02:00:02,452][124793] Updated weights for policy 0, policy_version 25920 (0.0005) [2023-03-12 02:00:06,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10513.1, 300 sec: 10663.5). Total num frames: 13303808. Throughput: 0: 10410.8. Samples: 13292316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:00:06,005][124505] Avg episode reward: [(0, '4578.073')] [2023-03-12 02:00:06,055][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000025992_13307904.pth... [2023-03-12 02:00:06,058][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000025384_12996608.pth [2023-03-12 02:00:06,443][124793] Updated weights for policy 0, policy_version 26000 (0.0005) [2023-03-12 02:00:10,413][124793] Updated weights for policy 0, policy_version 26080 (0.0005) [2023-03-12 02:00:11,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10444.8, 300 sec: 10663.5). Total num frames: 13357056. Throughput: 0: 10368.8. Samples: 13354892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:00:11,005][124505] Avg episode reward: [(0, '4581.340')] [2023-03-12 02:00:14,367][124793] Updated weights for policy 0, policy_version 26160 (0.0005) [2023-03-12 02:00:16,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10444.8, 300 sec: 10663.5). Total num frames: 13410304. Throughput: 0: 10366.0. Samples: 13385792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:00:16,005][124505] Avg episode reward: [(0, '4567.097')] [2023-03-12 02:00:18,403][124793] Updated weights for policy 0, policy_version 26240 (0.0005) [2023-03-12 02:00:21,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10376.5, 300 sec: 10635.7). Total num frames: 13459456. Throughput: 0: 10341.5. Samples: 13447232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:00:21,005][124505] Avg episode reward: [(0, '4571.085')] [2023-03-12 02:00:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000026288_13459456.pth... [2023-03-12 02:00:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000025680_13148160.pth [2023-03-12 02:00:22,384][124793] Updated weights for policy 0, policy_version 26320 (0.0005) [2023-03-12 02:00:26,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10376.5, 300 sec: 10649.6). Total num frames: 13512704. Throughput: 0: 10351.1. Samples: 13508680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:00:26,005][124505] Avg episode reward: [(0, '4585.062')] [2023-03-12 02:00:26,303][124793] Updated weights for policy 0, policy_version 26400 (0.0005) [2023-03-12 02:00:30,180][124793] Updated weights for policy 0, policy_version 26480 (0.0005) [2023-03-12 02:00:31,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10376.5, 300 sec: 10649.6). Total num frames: 13565952. Throughput: 0: 10376.0. Samples: 13541360. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:00:31,005][124505] Avg episode reward: [(0, '4570.566')] [2023-03-12 02:00:34,139][124793] Updated weights for policy 0, policy_version 26560 (0.0004) [2023-03-12 02:00:36,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10376.5, 300 sec: 10635.7). Total num frames: 13615104. Throughput: 0: 10370.9. Samples: 13603228. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:00:36,005][124505] Avg episode reward: [(0, '4598.640')] [2023-03-12 02:00:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000026592_13615104.pth... [2023-03-12 02:00:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000025992_13307904.pth [2023-03-12 02:00:38,107][124793] Updated weights for policy 0, policy_version 26640 (0.0004) [2023-03-12 02:00:41,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10376.5, 300 sec: 10635.7). Total num frames: 13668352. Throughput: 0: 10325.9. Samples: 13664328. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:00:41,005][124505] Avg episode reward: [(0, '4593.004')] [2023-03-12 02:00:42,253][124793] Updated weights for policy 0, policy_version 26720 (0.0005) [2023-03-12 02:00:46,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10308.3, 300 sec: 10635.7). Total num frames: 13717504. Throughput: 0: 10271.4. Samples: 13693540. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:00:46,005][124505] Avg episode reward: [(0, '4584.324')] [2023-03-12 02:00:46,351][124793] Updated weights for policy 0, policy_version 26800 (0.0005) [2023-03-12 02:00:50,489][124793] Updated weights for policy 0, policy_version 26880 (0.0005) [2023-03-12 02:00:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10308.3, 300 sec: 10621.8). Total num frames: 13766656. Throughput: 0: 10265.4. Samples: 13754260. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:00:51,005][124505] Avg episode reward: [(0, '4598.665')] [2023-03-12 02:00:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000026888_13766656.pth... [2023-03-12 02:00:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000026288_13459456.pth [2023-03-12 02:00:54,701][124793] Updated weights for policy 0, policy_version 26960 (0.0005) [2023-03-12 02:00:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10240.0, 300 sec: 10607.9). Total num frames: 13815808. Throughput: 0: 10153.4. Samples: 13811796. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:00:56,005][124505] Avg episode reward: [(0, '4593.109')] [2023-03-12 02:00:58,974][124793] Updated weights for policy 0, policy_version 27040 (0.0005) [2023-03-12 02:01:01,005][124505] Fps is (10 sec: 9420.7, 60 sec: 10103.4, 300 sec: 10594.1). Total num frames: 13860864. Throughput: 0: 10109.7. Samples: 13840732. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:01:01,006][124505] Avg episode reward: [(0, '4587.682')] [2023-03-12 02:01:03,060][124793] Updated weights for policy 0, policy_version 27120 (0.0005) [2023-03-12 02:01:06,005][124505] Fps is (10 sec: 9420.6, 60 sec: 10103.4, 300 sec: 10580.2). Total num frames: 13910016. Throughput: 0: 10071.0. Samples: 13900428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:01:06,006][124505] Avg episode reward: [(0, '4580.423')] [2023-03-12 02:01:06,049][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000027176_13914112.pth... [2023-03-12 02:01:06,050][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000026592_13615104.pth [2023-03-12 02:01:07,344][124793] Updated weights for policy 0, policy_version 27200 (0.0005) [2023-03-12 02:01:11,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 10566.3). Total num frames: 13959168. Throughput: 0: 9990.1. Samples: 13958232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:01:11,005][124505] Avg episode reward: [(0, '4551.888')] [2023-03-12 02:01:11,564][124793] Updated weights for policy 0, policy_version 27280 (0.0005) [2023-03-12 02:01:15,816][124793] Updated weights for policy 0, policy_version 27360 (0.0005) [2023-03-12 02:01:16,005][124505] Fps is (10 sec: 9830.6, 60 sec: 9966.9, 300 sec: 10552.4). Total num frames: 14008320. Throughput: 0: 9912.6. Samples: 13987428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:01:16,005][124505] Avg episode reward: [(0, '4557.027')] [2023-03-12 02:01:20,065][124793] Updated weights for policy 0, policy_version 27440 (0.0005) [2023-03-12 02:01:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10552.4). Total num frames: 14057472. Throughput: 0: 9821.3. Samples: 14045184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:01:21,005][124505] Avg episode reward: [(0, '4544.361')] [2023-03-12 02:01:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000027456_14057472.pth... [2023-03-12 02:01:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000026888_13766656.pth [2023-03-12 02:01:24,246][124793] Updated weights for policy 0, policy_version 27520 (0.0005) [2023-03-12 02:01:26,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 10538.5). Total num frames: 14106624. Throughput: 0: 9750.8. Samples: 14103116. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:01:26,005][124505] Avg episode reward: [(0, '4567.003')] [2023-03-12 02:01:28,425][124793] Updated weights for policy 0, policy_version 27600 (0.0005) [2023-03-12 02:01:31,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 10538.5). Total num frames: 14155776. Throughput: 0: 9756.6. Samples: 14132588. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:01:31,005][124505] Avg episode reward: [(0, '4568.489')] [2023-03-12 02:01:32,551][124793] Updated weights for policy 0, policy_version 27680 (0.0004) [2023-03-12 02:01:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 10538.5). Total num frames: 14204928. Throughput: 0: 9742.0. Samples: 14192652. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:01:36,005][124505] Avg episode reward: [(0, '4556.666')] [2023-03-12 02:01:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000027744_14204928.pth... [2023-03-12 02:01:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000027176_13914112.pth [2023-03-12 02:01:36,702][124793] Updated weights for policy 0, policy_version 27760 (0.0005) [2023-03-12 02:01:40,819][124793] Updated weights for policy 0, policy_version 27840 (0.0005) [2023-03-12 02:01:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 10524.6). Total num frames: 14254080. Throughput: 0: 9773.0. Samples: 14251580. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:01:41,005][124505] Avg episode reward: [(0, '4572.989')] [2023-03-12 02:01:44,986][124793] Updated weights for policy 0, policy_version 27920 (0.0005) [2023-03-12 02:01:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 10524.6). Total num frames: 14303232. Throughput: 0: 9794.5. Samples: 14281484. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:01:46,016][124505] Avg episode reward: [(0, '4560.517')] [2023-03-12 02:01:49,069][124793] Updated weights for policy 0, policy_version 28000 (0.0005) [2023-03-12 02:01:51,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 10538.5). Total num frames: 14356480. Throughput: 0: 9803.0. Samples: 14341564. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:01:51,016][124505] Avg episode reward: [(0, '4563.037')] [2023-03-12 02:01:51,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000028040_14356480.pth... [2023-03-12 02:01:51,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000027456_14057472.pth [2023-03-12 02:01:52,865][124793] Updated weights for policy 0, policy_version 28080 (0.0004) [2023-03-12 02:01:56,005][124505] Fps is (10 sec: 10649.6, 60 sec: 9898.7, 300 sec: 10538.5). Total num frames: 14409728. Throughput: 0: 9945.5. Samples: 14405780. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:01:56,005][124505] Avg episode reward: [(0, '4584.376')] [2023-03-12 02:01:56,651][124793] Updated weights for policy 0, policy_version 28160 (0.0004) [2023-03-12 02:02:00,431][124793] Updated weights for policy 0, policy_version 28240 (0.0004) [2023-03-12 02:02:01,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10035.2, 300 sec: 10538.5). Total num frames: 14462976. Throughput: 0: 10025.1. Samples: 14438560. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:02:01,005][124505] Avg episode reward: [(0, '4585.569')] [2023-03-12 02:02:04,501][124793] Updated weights for policy 0, policy_version 28320 (0.0005) [2023-03-12 02:02:06,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 10524.6). Total num frames: 14512128. Throughput: 0: 10119.0. Samples: 14500540. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:02:06,005][124505] Avg episode reward: [(0, '4580.518')] [2023-03-12 02:02:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000028344_14512128.pth... [2023-03-12 02:02:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000027744_14204928.pth [2023-03-12 02:02:08,667][124793] Updated weights for policy 0, policy_version 28400 (0.0005) [2023-03-12 02:02:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10510.8). Total num frames: 14561280. Throughput: 0: 10155.4. Samples: 14560108. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:02:11,005][124505] Avg episode reward: [(0, '4592.368')] [2023-03-12 02:02:12,731][124793] Updated weights for policy 0, policy_version 28480 (0.0005) [2023-03-12 02:02:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10496.9). Total num frames: 14610432. Throughput: 0: 10169.9. Samples: 14590236. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:02:16,006][124505] Avg episode reward: [(0, '4581.171')] [2023-03-12 02:02:16,863][124793] Updated weights for policy 0, policy_version 28560 (0.0005) [2023-03-12 02:02:20,887][124793] Updated weights for policy 0, policy_version 28640 (0.0005) [2023-03-12 02:02:21,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10510.8). Total num frames: 14663680. Throughput: 0: 10185.2. Samples: 14650988. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:02:21,005][124505] Avg episode reward: [(0, '4592.721')] [2023-03-12 02:02:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000028640_14663680.pth... [2023-03-12 02:02:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000028040_14356480.pth [2023-03-12 02:02:24,995][124793] Updated weights for policy 0, policy_version 28720 (0.0005) [2023-03-12 02:02:26,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 10496.9). Total num frames: 14712832. Throughput: 0: 10202.1. Samples: 14710676. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:02:26,005][124505] Avg episode reward: [(0, '4583.273')] [2023-03-12 02:02:29,067][124793] Updated weights for policy 0, policy_version 28800 (0.0005) [2023-03-12 02:02:31,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10171.7, 300 sec: 10483.0). Total num frames: 14766080. Throughput: 0: 10219.0. Samples: 14741336. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:02:31,005][124505] Avg episode reward: [(0, '4540.760')] [2023-03-12 02:02:32,979][124793] Updated weights for policy 0, policy_version 28880 (0.0005) [2023-03-12 02:02:36,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10171.7, 300 sec: 10455.2). Total num frames: 14815232. Throughput: 0: 10254.5. Samples: 14803016. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:02:36,005][124505] Avg episode reward: [(0, '4544.658')] [2023-03-12 02:02:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000028936_14815232.pth... [2023-03-12 02:02:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000028344_14512128.pth [2023-03-12 02:02:37,012][124793] Updated weights for policy 0, policy_version 28960 (0.0005) [2023-03-12 02:02:41,005][124505] Fps is (10 sec: 9830.3, 60 sec: 10171.7, 300 sec: 10427.4). Total num frames: 14864384. Throughput: 0: 10191.5. Samples: 14864396. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:02:41,005][124505] Avg episode reward: [(0, '4520.406')] [2023-03-12 02:02:41,015][124793] Updated weights for policy 0, policy_version 29040 (0.0005) [2023-03-12 02:02:45,110][124793] Updated weights for policy 0, policy_version 29120 (0.0005) [2023-03-12 02:02:46,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10240.0, 300 sec: 10427.4). Total num frames: 14917632. Throughput: 0: 10121.1. Samples: 14894008. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:02:46,005][124505] Avg episode reward: [(0, '4530.694')] [2023-03-12 02:02:49,225][124793] Updated weights for policy 0, policy_version 29200 (0.0005) [2023-03-12 02:02:51,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10171.7, 300 sec: 10399.7). Total num frames: 14966784. Throughput: 0: 10087.9. Samples: 14954496. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:02:51,006][124505] Avg episode reward: [(0, '4519.482')] [2023-03-12 02:02:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000029232_14966784.pth... [2023-03-12 02:02:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000028640_14663680.pth [2023-03-12 02:02:53,516][124793] Updated weights for policy 0, policy_version 29280 (0.0005) [2023-03-12 02:02:56,005][124505] Fps is (10 sec: 9420.7, 60 sec: 10035.2, 300 sec: 10371.9). Total num frames: 15011840. Throughput: 0: 10038.5. Samples: 15011840. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:02:56,005][124505] Avg episode reward: [(0, '4523.745')] [2023-03-12 02:02:57,520][124793] Updated weights for policy 0, policy_version 29360 (0.0005) [2023-03-12 02:03:01,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 10358.0). Total num frames: 15065088. Throughput: 0: 10070.0. Samples: 15043384. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:03:01,005][124505] Avg episode reward: [(0, '4513.383')] [2023-03-12 02:03:01,520][124793] Updated weights for policy 0, policy_version 29440 (0.0005) [2023-03-12 02:03:05,412][124793] Updated weights for policy 0, policy_version 29520 (0.0005) [2023-03-12 02:03:06,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10103.5, 300 sec: 10344.1). Total num frames: 15118336. Throughput: 0: 10112.6. Samples: 15106056. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:03:06,005][124505] Avg episode reward: [(0, '4565.074')] [2023-03-12 02:03:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000029528_15118336.pth... [2023-03-12 02:03:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000028936_14815232.pth [2023-03-12 02:03:09,392][124793] Updated weights for policy 0, policy_version 29600 (0.0005) [2023-03-12 02:03:11,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 10316.4). Total num frames: 15167488. Throughput: 0: 10152.8. Samples: 15167552. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:03:11,006][124505] Avg episode reward: [(0, '4583.511')] [2023-03-12 02:03:13,447][124793] Updated weights for policy 0, policy_version 29680 (0.0005) [2023-03-12 02:03:16,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10171.7, 300 sec: 10316.4). Total num frames: 15220736. Throughput: 0: 10139.5. Samples: 15197612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:03:16,005][124505] Avg episode reward: [(0, '4558.580')] [2023-03-12 02:03:17,539][124793] Updated weights for policy 0, policy_version 29760 (0.0005) [2023-03-12 02:03:21,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 10302.5). Total num frames: 15269888. Throughput: 0: 10103.3. Samples: 15257664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:03:21,005][124505] Avg episode reward: [(0, '4549.030')] [2023-03-12 02:03:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000029824_15269888.pth... [2023-03-12 02:03:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000029232_14966784.pth [2023-03-12 02:03:21,611][124793] Updated weights for policy 0, policy_version 29840 (0.0005) [2023-03-12 02:03:25,671][124793] Updated weights for policy 0, policy_version 29920 (0.0005) [2023-03-12 02:03:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 10274.7). Total num frames: 15319040. Throughput: 0: 10084.4. Samples: 15318196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:03:26,005][124505] Avg episode reward: [(0, '4562.691')] [2023-03-12 02:03:29,656][124793] Updated weights for policy 0, policy_version 30000 (0.0005) [2023-03-12 02:03:31,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10274.7). Total num frames: 15372288. Throughput: 0: 10103.0. Samples: 15348644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:03:31,005][124505] Avg episode reward: [(0, '4554.443')] [2023-03-12 02:03:33,616][124793] Updated weights for policy 0, policy_version 30080 (0.0005) [2023-03-12 02:03:36,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10171.7, 300 sec: 10274.7). Total num frames: 15425536. Throughput: 0: 10159.6. Samples: 15411676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:03:36,006][124505] Avg episode reward: [(0, '4556.223')] [2023-03-12 02:03:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000030128_15425536.pth... [2023-03-12 02:03:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000029528_15118336.pth [2023-03-12 02:03:37,487][124793] Updated weights for policy 0, policy_version 30160 (0.0005) [2023-03-12 02:03:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 10260.8). Total num frames: 15474688. Throughput: 0: 10273.4. Samples: 15474144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:03:41,005][124505] Avg episode reward: [(0, '4568.408')] [2023-03-12 02:03:41,506][124793] Updated weights for policy 0, policy_version 30240 (0.0005) [2023-03-12 02:03:45,577][124793] Updated weights for policy 0, policy_version 30320 (0.0005) [2023-03-12 02:03:46,005][124505] Fps is (10 sec: 10240.2, 60 sec: 10171.7, 300 sec: 10260.8). Total num frames: 15527936. Throughput: 0: 10225.3. Samples: 15503520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:03:46,005][124505] Avg episode reward: [(0, '4560.009')] [2023-03-12 02:03:49,723][124793] Updated weights for policy 0, policy_version 30400 (0.0005) [2023-03-12 02:03:51,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10171.8, 300 sec: 10233.1). Total num frames: 15577088. Throughput: 0: 10164.8. Samples: 15563472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:03:51,005][124505] Avg episode reward: [(0, '4533.058')] [2023-03-12 02:03:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000030424_15577088.pth... [2023-03-12 02:03:51,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000029824_15269888.pth [2023-03-12 02:03:53,703][124793] Updated weights for policy 0, policy_version 30480 (0.0005) [2023-03-12 02:03:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10240.0, 300 sec: 10205.3). Total num frames: 15626240. Throughput: 0: 10164.5. Samples: 15624952. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:03:56,005][124505] Avg episode reward: [(0, '4551.031')] [2023-03-12 02:03:57,689][124793] Updated weights for policy 0, policy_version 30560 (0.0005) [2023-03-12 02:04:01,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10240.0, 300 sec: 10191.4). Total num frames: 15679488. Throughput: 0: 10174.3. Samples: 15655456. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:04:01,005][124505] Avg episode reward: [(0, '4572.244')] [2023-03-12 02:04:01,703][124793] Updated weights for policy 0, policy_version 30640 (0.0005) [2023-03-12 02:04:05,837][124793] Updated weights for policy 0, policy_version 30720 (0.0005) [2023-03-12 02:04:06,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10171.7, 300 sec: 10163.6). Total num frames: 15728640. Throughput: 0: 10194.5. Samples: 15716416. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:04:06,005][124505] Avg episode reward: [(0, '4565.662')] [2023-03-12 02:04:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000030720_15728640.pth... [2023-03-12 02:04:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000030128_15425536.pth [2023-03-12 02:04:09,889][124793] Updated weights for policy 0, policy_version 30800 (0.0005) [2023-03-12 02:04:11,005][124505] Fps is (10 sec: 9830.3, 60 sec: 10171.7, 300 sec: 10149.7). Total num frames: 15777792. Throughput: 0: 10199.8. Samples: 15777188. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:04:11,005][124505] Avg episode reward: [(0, '4564.920')] [2023-03-12 02:04:13,893][124793] Updated weights for policy 0, policy_version 30880 (0.0005) [2023-03-12 02:04:16,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10171.7, 300 sec: 10149.7). Total num frames: 15831040. Throughput: 0: 10188.0. Samples: 15807104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:04:16,005][124505] Avg episode reward: [(0, '4551.012')] [2023-03-12 02:04:17,889][124793] Updated weights for policy 0, policy_version 30960 (0.0005) [2023-03-12 02:04:21,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10240.0, 300 sec: 10149.7). Total num frames: 15884288. Throughput: 0: 10182.0. Samples: 15869864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:04:21,005][124505] Avg episode reward: [(0, '4538.696')] [2023-03-12 02:04:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000031024_15884288.pth... [2023-03-12 02:04:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000030424_15577088.pth [2023-03-12 02:04:21,744][124793] Updated weights for policy 0, policy_version 31040 (0.0005) [2023-03-12 02:04:25,667][124793] Updated weights for policy 0, policy_version 31120 (0.0005) [2023-03-12 02:04:26,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10240.0, 300 sec: 10135.9). Total num frames: 15933440. Throughput: 0: 10193.6. Samples: 15932856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:04:26,005][124505] Avg episode reward: [(0, '4550.547')] [2023-03-12 02:04:29,617][124793] Updated weights for policy 0, policy_version 31200 (0.0005) [2023-03-12 02:04:31,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10240.0, 300 sec: 10149.7). Total num frames: 15986688. Throughput: 0: 10216.6. Samples: 15963268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:04:31,010][124505] Avg episode reward: [(0, '4526.389')] [2023-03-12 02:04:33,471][124793] Updated weights for policy 0, policy_version 31280 (0.0005) [2023-03-12 02:04:36,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10240.0, 300 sec: 10149.7). Total num frames: 16039936. Throughput: 0: 10308.7. Samples: 16027364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:04:36,011][124505] Avg episode reward: [(0, '4582.433')] [2023-03-12 02:04:36,014][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000031328_16039936.pth... [2023-03-12 02:04:36,017][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000030720_15728640.pth [2023-03-12 02:04:37,405][124793] Updated weights for policy 0, policy_version 31360 (0.0005) [2023-03-12 02:04:41,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10308.3, 300 sec: 10149.8). Total num frames: 16093184. Throughput: 0: 10318.0. Samples: 16089260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:04:41,016][124505] Avg episode reward: [(0, '4568.807')] [2023-03-12 02:04:41,347][124793] Updated weights for policy 0, policy_version 31440 (0.0005) [2023-03-12 02:04:45,278][124793] Updated weights for policy 0, policy_version 31520 (0.0005) [2023-03-12 02:04:46,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10240.0, 300 sec: 10149.8). Total num frames: 16142336. Throughput: 0: 10346.6. Samples: 16121052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:04:46,016][124505] Avg episode reward: [(0, '4563.071')] [2023-03-12 02:04:48,998][124793] Updated weights for policy 0, policy_version 31600 (0.0004) [2023-03-12 02:04:51,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10376.5, 300 sec: 10163.6). Total num frames: 16199680. Throughput: 0: 10431.1. Samples: 16185816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:04:51,016][124505] Avg episode reward: [(0, '4562.552')] [2023-03-12 02:04:51,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000031640_16199680.pth... [2023-03-12 02:04:51,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000031024_15884288.pth [2023-03-12 02:04:52,807][124793] Updated weights for policy 0, policy_version 31680 (0.0004) [2023-03-12 02:04:56,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10444.8, 300 sec: 10163.6). Total num frames: 16252928. Throughput: 0: 10489.7. Samples: 16249224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:04:56,005][124505] Avg episode reward: [(0, '4563.063')] [2023-03-12 02:04:56,667][124793] Updated weights for policy 0, policy_version 31760 (0.0005) [2023-03-12 02:05:00,442][124793] Updated weights for policy 0, policy_version 31840 (0.0005) [2023-03-12 02:05:01,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10444.8, 300 sec: 10177.5). Total num frames: 16306176. Throughput: 0: 10544.4. Samples: 16281600. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:05:01,005][124505] Avg episode reward: [(0, '4571.759')] [2023-03-12 02:05:04,016][124793] Updated weights for policy 0, policy_version 31920 (0.0003) [2023-03-12 02:05:06,005][124505] Fps is (10 sec: 11059.1, 60 sec: 10581.3, 300 sec: 10191.4). Total num frames: 16363520. Throughput: 0: 10649.9. Samples: 16349112. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:05:06,005][124505] Avg episode reward: [(0, '4542.467')] [2023-03-12 02:05:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000031960_16363520.pth... [2023-03-12 02:05:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000031328_16039936.pth [2023-03-12 02:05:07,660][124793] Updated weights for policy 0, policy_version 32000 (0.0005) [2023-03-12 02:05:11,005][124505] Fps is (10 sec: 11468.9, 60 sec: 10717.9, 300 sec: 10205.3). Total num frames: 16420864. Throughput: 0: 10753.9. Samples: 16416780. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:05:11,005][124505] Avg episode reward: [(0, '4568.712')] [2023-03-12 02:05:11,318][124793] Updated weights for policy 0, policy_version 32080 (0.0004) [2023-03-12 02:05:15,050][124793] Updated weights for policy 0, policy_version 32160 (0.0004) [2023-03-12 02:05:16,005][124505] Fps is (10 sec: 11059.3, 60 sec: 10717.9, 300 sec: 10219.2). Total num frames: 16474112. Throughput: 0: 10816.5. Samples: 16450012. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:05:16,005][124505] Avg episode reward: [(0, '4587.534')] [2023-03-12 02:05:18,823][124793] Updated weights for policy 0, policy_version 32240 (0.0004) [2023-03-12 02:05:21,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10717.9, 300 sec: 10219.2). Total num frames: 16527360. Throughput: 0: 10838.2. Samples: 16515084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:05:21,005][124505] Avg episode reward: [(0, '4587.517')] [2023-03-12 02:05:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000032280_16527360.pth... [2023-03-12 02:05:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000031640_16199680.pth [2023-03-12 02:05:22,770][124793] Updated weights for policy 0, policy_version 32320 (0.0005) [2023-03-12 02:05:26,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10786.1, 300 sec: 10219.2). Total num frames: 16580608. Throughput: 0: 10854.7. Samples: 16577720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:05:26,005][124505] Avg episode reward: [(0, '4571.346')] [2023-03-12 02:05:26,687][124793] Updated weights for policy 0, policy_version 32400 (0.0005) [2023-03-12 02:05:30,912][124793] Updated weights for policy 0, policy_version 32480 (0.0005) [2023-03-12 02:05:31,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10717.9, 300 sec: 10219.2). Total num frames: 16629760. Throughput: 0: 10817.1. Samples: 16607824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:05:31,005][124505] Avg episode reward: [(0, '4558.724')] [2023-03-12 02:05:35,114][124793] Updated weights for policy 0, policy_version 32560 (0.0005) [2023-03-12 02:05:36,005][124505] Fps is (10 sec: 9830.3, 60 sec: 10649.6, 300 sec: 10205.3). Total num frames: 16678912. Throughput: 0: 10668.7. Samples: 16665908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:05:36,006][124505] Avg episode reward: [(0, '4513.220')] [2023-03-12 02:05:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000032576_16678912.pth... [2023-03-12 02:05:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000031960_16363520.pth [2023-03-12 02:05:39,440][124793] Updated weights for policy 0, policy_version 32640 (0.0005) [2023-03-12 02:05:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 10513.1, 300 sec: 10191.4). Total num frames: 16723968. Throughput: 0: 10534.7. Samples: 16723288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:05:41,005][124505] Avg episode reward: [(0, '4394.607')] [2023-03-12 02:05:43,692][124793] Updated weights for policy 0, policy_version 32720 (0.0005) [2023-03-12 02:05:46,005][124505] Fps is (10 sec: 9420.9, 60 sec: 10513.1, 300 sec: 10191.4). Total num frames: 16773120. Throughput: 0: 10454.9. Samples: 16752072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:05:46,005][124505] Avg episode reward: [(0, '4391.605')] [2023-03-12 02:05:47,660][124793] Updated weights for policy 0, policy_version 32800 (0.0004) [2023-03-12 02:05:51,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10444.8, 300 sec: 10205.3). Total num frames: 16826368. Throughput: 0: 10314.3. Samples: 16813256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:05:51,005][124505] Avg episode reward: [(0, '4420.585')] [2023-03-12 02:05:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000032864_16826368.pth... [2023-03-12 02:05:51,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000032280_16527360.pth [2023-03-12 02:05:51,831][124793] Updated weights for policy 0, policy_version 32880 (0.0005) [2023-03-12 02:05:56,005][124505] Fps is (10 sec: 9830.3, 60 sec: 10308.3, 300 sec: 10205.3). Total num frames: 16871424. Throughput: 0: 10103.2. Samples: 16871424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:05:56,005][124505] Avg episode reward: [(0, '4438.479')] [2023-03-12 02:05:56,017][124793] Updated weights for policy 0, policy_version 32960 (0.0005) [2023-03-12 02:06:00,201][124793] Updated weights for policy 0, policy_version 33040 (0.0005) [2023-03-12 02:06:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 10240.0, 300 sec: 10205.3). Total num frames: 16920576. Throughput: 0: 10016.0. Samples: 16900732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:06:01,005][124505] Avg episode reward: [(0, '4520.898')] [2023-03-12 02:06:04,439][124793] Updated weights for policy 0, policy_version 33120 (0.0005) [2023-03-12 02:06:06,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10103.5, 300 sec: 10205.3). Total num frames: 16969728. Throughput: 0: 9863.9. Samples: 16958960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:06:06,005][124505] Avg episode reward: [(0, '4557.440')] [2023-03-12 02:06:06,071][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000033152_16973824.pth... [2023-03-12 02:06:06,073][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000032576_16678912.pth [2023-03-12 02:06:08,655][124793] Updated weights for policy 0, policy_version 33200 (0.0005) [2023-03-12 02:06:11,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 10205.3). Total num frames: 17018880. Throughput: 0: 9778.2. Samples: 17017740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:06:11,005][124505] Avg episode reward: [(0, '4552.507')] [2023-03-12 02:06:12,881][124793] Updated weights for policy 0, policy_version 33280 (0.0005) [2023-03-12 02:06:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 10205.3). Total num frames: 17068032. Throughput: 0: 9739.8. Samples: 17046116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:06:16,005][124505] Avg episode reward: [(0, '4571.024')] [2023-03-12 02:06:17,263][124793] Updated weights for policy 0, policy_version 33360 (0.0005) [2023-03-12 02:06:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 10191.4). Total num frames: 17113088. Throughput: 0: 9704.5. Samples: 17102612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:06:21,005][124505] Avg episode reward: [(0, '4567.678')] [2023-03-12 02:06:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000033424_17113088.pth... [2023-03-12 02:06:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000032864_16826368.pth [2023-03-12 02:06:21,597][124793] Updated weights for policy 0, policy_version 33440 (0.0005) [2023-03-12 02:06:25,856][124793] Updated weights for policy 0, policy_version 33520 (0.0005) [2023-03-12 02:06:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 10191.4). Total num frames: 17162240. Throughput: 0: 9695.4. Samples: 17159580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:06:26,005][124505] Avg episode reward: [(0, '4566.791')] [2023-03-12 02:06:30,209][124793] Updated weights for policy 0, policy_version 33600 (0.0005) [2023-03-12 02:06:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 10177.5). Total num frames: 17207296. Throughput: 0: 9680.8. Samples: 17187708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:06:31,005][124505] Avg episode reward: [(0, '4551.689')] [2023-03-12 02:06:34,599][124793] Updated weights for policy 0, policy_version 33680 (0.0005) [2023-03-12 02:06:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 10177.5). Total num frames: 17256448. Throughput: 0: 9575.8. Samples: 17244168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:06:36,005][124505] Avg episode reward: [(0, '4576.271')] [2023-03-12 02:06:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000033704_17256448.pth... [2023-03-12 02:06:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000033152_16973824.pth [2023-03-12 02:06:38,832][124793] Updated weights for policy 0, policy_version 33760 (0.0005) [2023-03-12 02:06:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 10163.6). Total num frames: 17301504. Throughput: 0: 9557.5. Samples: 17301512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:06:41,005][124505] Avg episode reward: [(0, '4559.992')] [2023-03-12 02:06:43,224][124793] Updated weights for policy 0, policy_version 33840 (0.0005) [2023-03-12 02:06:46,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 10149.8). Total num frames: 17350656. Throughput: 0: 9540.2. Samples: 17330040. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:06:46,005][124505] Avg episode reward: [(0, '4567.940')] [2023-03-12 02:06:47,655][124793] Updated weights for policy 0, policy_version 33920 (0.0005) [2023-03-12 02:06:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 10122.0). Total num frames: 17395712. Throughput: 0: 9482.8. Samples: 17385684. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:06:51,005][124505] Avg episode reward: [(0, '4569.607')] [2023-03-12 02:06:51,064][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000033984_17399808.pth... [2023-03-12 02:06:51,066][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000033424_17113088.pth [2023-03-12 02:06:51,893][124793] Updated weights for policy 0, policy_version 34000 (0.0005) [2023-03-12 02:06:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 10108.1). Total num frames: 17444864. Throughput: 0: 9475.7. Samples: 17444148. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:06:56,005][124505] Avg episode reward: [(0, '4572.845')] [2023-03-12 02:06:56,160][124793] Updated weights for policy 0, policy_version 34080 (0.0005) [2023-03-12 02:07:00,563][124793] Updated weights for policy 0, policy_version 34160 (0.0004) [2023-03-12 02:07:01,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 10094.2). Total num frames: 17489920. Throughput: 0: 9462.5. Samples: 17471928. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:07:01,005][124505] Avg episode reward: [(0, '4573.409')] [2023-03-12 02:07:04,976][124793] Updated weights for policy 0, policy_version 34240 (0.0005) [2023-03-12 02:07:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 10094.2). Total num frames: 17539072. Throughput: 0: 9431.5. Samples: 17527028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:07:06,005][124505] Avg episode reward: [(0, '4549.162')] [2023-03-12 02:07:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000034256_17539072.pth... [2023-03-12 02:07:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000033704_17256448.pth [2023-03-12 02:07:09,432][124793] Updated weights for policy 0, policy_version 34320 (0.0004) [2023-03-12 02:07:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 10080.3). Total num frames: 17584128. Throughput: 0: 9418.0. Samples: 17583392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:07:11,005][124505] Avg episode reward: [(0, '4549.248')] [2023-03-12 02:07:13,701][124793] Updated weights for policy 0, policy_version 34400 (0.0005) [2023-03-12 02:07:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 10066.4). Total num frames: 17633280. Throughput: 0: 9433.0. Samples: 17612192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:07:16,005][124505] Avg episode reward: [(0, '4572.250')] [2023-03-12 02:07:17,908][124793] Updated weights for policy 0, policy_version 34480 (0.0005) [2023-03-12 02:07:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 10066.4). Total num frames: 17682432. Throughput: 0: 9467.6. Samples: 17670208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:07:21,005][124505] Avg episode reward: [(0, '4585.563')] [2023-03-12 02:07:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000034536_17682432.pth... [2023-03-12 02:07:21,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000033984_17399808.pth [2023-03-12 02:07:22,229][124793] Updated weights for policy 0, policy_version 34560 (0.0005) [2023-03-12 02:07:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 10038.7). Total num frames: 17727488. Throughput: 0: 9464.5. Samples: 17727416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:07:26,005][124505] Avg episode reward: [(0, '4574.905')] [2023-03-12 02:07:26,536][124793] Updated weights for policy 0, policy_version 34640 (0.0005) [2023-03-12 02:07:30,833][124793] Updated weights for policy 0, policy_version 34720 (0.0005) [2023-03-12 02:07:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 10038.7). Total num frames: 17776640. Throughput: 0: 9464.2. Samples: 17755928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:07:31,005][124505] Avg episode reward: [(0, '4593.654')] [2023-03-12 02:07:35,168][124793] Updated weights for policy 0, policy_version 34800 (0.0005) [2023-03-12 02:07:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 10024.8). Total num frames: 17821696. Throughput: 0: 9480.0. Samples: 17812284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:07:36,005][124505] Avg episode reward: [(0, '4590.069')] [2023-03-12 02:07:36,036][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000034816_17825792.pth... [2023-03-12 02:07:36,038][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000034256_17539072.pth [2023-03-12 02:07:39,514][124793] Updated weights for policy 0, policy_version 34880 (0.0005) [2023-03-12 02:07:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 10010.9). Total num frames: 17870848. Throughput: 0: 9443.4. Samples: 17869100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:07:41,005][124505] Avg episode reward: [(0, '4586.257')] [2023-03-12 02:07:43,803][124793] Updated weights for policy 0, policy_version 34960 (0.0005) [2023-03-12 02:07:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 10010.9). Total num frames: 17920000. Throughput: 0: 9462.1. Samples: 17897724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:07:46,005][124505] Avg episode reward: [(0, '4586.633')] [2023-03-12 02:07:47,807][124793] Updated weights for policy 0, policy_version 35040 (0.0005) [2023-03-12 02:07:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 10024.8). Total num frames: 17969152. Throughput: 0: 9589.8. Samples: 17958568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:07:51,005][124505] Avg episode reward: [(0, '4596.865')] [2023-03-12 02:07:51,029][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000035104_17973248.pth... [2023-03-12 02:07:51,031][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000034536_17682432.pth [2023-03-12 02:07:51,812][124793] Updated weights for policy 0, policy_version 35120 (0.0004) [2023-03-12 02:07:55,945][124793] Updated weights for policy 0, policy_version 35200 (0.0004) [2023-03-12 02:07:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9625.6, 300 sec: 10024.8). Total num frames: 18022400. Throughput: 0: 9670.8. Samples: 18018576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:07:56,005][124505] Avg episode reward: [(0, '4581.268')] [2023-03-12 02:08:00,204][124793] Updated weights for policy 0, policy_version 35280 (0.0005) [2023-03-12 02:08:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9997.0). Total num frames: 18067456. Throughput: 0: 9675.0. Samples: 18047568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:08:01,005][124505] Avg episode reward: [(0, '4584.530')] [2023-03-12 02:08:04,506][124793] Updated weights for policy 0, policy_version 35360 (0.0005) [2023-03-12 02:08:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9997.0). Total num frames: 18116608. Throughput: 0: 9660.3. Samples: 18104920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:08:06,005][124505] Avg episode reward: [(0, '4590.920')] [2023-03-12 02:08:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000035384_18116608.pth... [2023-03-12 02:08:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000034816_17825792.pth [2023-03-12 02:08:08,796][124793] Updated weights for policy 0, policy_version 35440 (0.0005) [2023-03-12 02:08:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9983.1). Total num frames: 18165760. Throughput: 0: 9664.9. Samples: 18162336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:08:11,005][124505] Avg episode reward: [(0, '4582.291')] [2023-03-12 02:08:13,075][124793] Updated weights for policy 0, policy_version 35520 (0.0005) [2023-03-12 02:08:16,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9969.2). Total num frames: 18210816. Throughput: 0: 9665.3. Samples: 18190864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:08:16,005][124505] Avg episode reward: [(0, '4583.029')] [2023-03-12 02:08:17,320][124793] Updated weights for policy 0, policy_version 35600 (0.0005) [2023-03-12 02:08:21,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9969.2). Total num frames: 18259968. Throughput: 0: 9699.7. Samples: 18248772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:08:21,005][124505] Avg episode reward: [(0, '4575.893')] [2023-03-12 02:08:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000035664_18259968.pth... [2023-03-12 02:08:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000035104_17973248.pth [2023-03-12 02:08:21,625][124793] Updated weights for policy 0, policy_version 35680 (0.0005) [2023-03-12 02:08:25,924][124793] Updated weights for policy 0, policy_version 35760 (0.0005) [2023-03-12 02:08:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9955.4). Total num frames: 18309120. Throughput: 0: 9701.5. Samples: 18305668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:08:26,005][124505] Avg episode reward: [(0, '4565.416')] [2023-03-12 02:08:30,228][124793] Updated weights for policy 0, policy_version 35840 (0.0005) [2023-03-12 02:08:31,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9927.6). Total num frames: 18354176. Throughput: 0: 9696.3. Samples: 18334056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:08:31,005][124505] Avg episode reward: [(0, '4576.264')] [2023-03-12 02:08:34,529][124793] Updated weights for policy 0, policy_version 35920 (0.0005) [2023-03-12 02:08:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9927.6). Total num frames: 18403328. Throughput: 0: 9617.1. Samples: 18391336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:08:36,005][124505] Avg episode reward: [(0, '4583.465')] [2023-03-12 02:08:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000035944_18403328.pth... [2023-03-12 02:08:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000035384_18116608.pth [2023-03-12 02:08:38,788][124793] Updated weights for policy 0, policy_version 36000 (0.0005) [2023-03-12 02:08:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9913.7). Total num frames: 18452480. Throughput: 0: 9598.7. Samples: 18450516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:08:41,005][124505] Avg episode reward: [(0, '4569.978')] [2023-03-12 02:08:42,801][124793] Updated weights for policy 0, policy_version 36080 (0.0004) [2023-03-12 02:08:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9913.7). Total num frames: 18501632. Throughput: 0: 9632.2. Samples: 18481016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:08:46,005][124505] Avg episode reward: [(0, '4577.826')] [2023-03-12 02:08:46,918][124793] Updated weights for policy 0, policy_version 36160 (0.0004) [2023-03-12 02:08:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9913.7). Total num frames: 18550784. Throughput: 0: 9679.2. Samples: 18540484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:08:51,005][124505] Avg episode reward: [(0, '4578.128')] [2023-03-12 02:08:51,007][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000036240_18554880.pth... [2023-03-12 02:08:51,008][124793] Updated weights for policy 0, policy_version 36240 (0.0004) [2023-03-12 02:08:51,009][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000035664_18259968.pth [2023-03-12 02:08:55,260][124793] Updated weights for policy 0, policy_version 36320 (0.0005) [2023-03-12 02:08:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9899.8). Total num frames: 18599936. Throughput: 0: 9714.3. Samples: 18599480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:08:56,005][124505] Avg episode reward: [(0, '4575.268')] [2023-03-12 02:08:59,465][124793] Updated weights for policy 0, policy_version 36400 (0.0005) [2023-03-12 02:09:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9899.8). Total num frames: 18649088. Throughput: 0: 9729.1. Samples: 18628672. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:09:01,005][124505] Avg episode reward: [(0, '4566.273')] [2023-03-12 02:09:03,485][124793] Updated weights for policy 0, policy_version 36480 (0.0004) [2023-03-12 02:09:06,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9762.1, 300 sec: 9913.7). Total num frames: 18702336. Throughput: 0: 9787.7. Samples: 18689220. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:09:06,005][124505] Avg episode reward: [(0, '4574.368')] [2023-03-12 02:09:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000036528_18702336.pth... [2023-03-12 02:09:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000035944_18403328.pth [2023-03-12 02:09:07,467][124793] Updated weights for policy 0, policy_version 36560 (0.0004) [2023-03-12 02:09:11,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9899.8). Total num frames: 18751488. Throughput: 0: 9894.1. Samples: 18750904. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:09:11,005][124505] Avg episode reward: [(0, '4537.418')] [2023-03-12 02:09:11,517][124793] Updated weights for policy 0, policy_version 36640 (0.0005) [2023-03-12 02:09:15,566][124793] Updated weights for policy 0, policy_version 36720 (0.0004) [2023-03-12 02:09:16,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 18804736. Throughput: 0: 9915.6. Samples: 18780256. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:09:16,005][124505] Avg episode reward: [(0, '4513.087')] [2023-03-12 02:09:19,674][124793] Updated weights for policy 0, policy_version 36800 (0.0004) [2023-03-12 02:09:21,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 18853888. Throughput: 0: 9992.9. Samples: 18841016. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:09:21,005][124505] Avg episode reward: [(0, '4570.139')] [2023-03-12 02:09:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000036824_18853888.pth... [2023-03-12 02:09:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000036240_18554880.pth [2023-03-12 02:09:23,797][124793] Updated weights for policy 0, policy_version 36880 (0.0005) [2023-03-12 02:09:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 18903040. Throughput: 0: 9982.9. Samples: 18899748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:09:26,005][124505] Avg episode reward: [(0, '4577.477')] [2023-03-12 02:09:28,024][124793] Updated weights for policy 0, policy_version 36960 (0.0005) [2023-03-12 02:09:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 18952192. Throughput: 0: 9951.7. Samples: 18928844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:09:31,005][124505] Avg episode reward: [(0, '4572.287')] [2023-03-12 02:09:32,242][124793] Updated weights for policy 0, policy_version 37040 (0.0005) [2023-03-12 02:09:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9858.2). Total num frames: 19001344. Throughput: 0: 9961.3. Samples: 18988744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:09:36,005][124505] Avg episode reward: [(0, '4588.246')] [2023-03-12 02:09:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000037112_19001344.pth... [2023-03-12 02:09:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000036528_18702336.pth [2023-03-12 02:09:36,344][124793] Updated weights for policy 0, policy_version 37120 (0.0005) [2023-03-12 02:09:40,399][124793] Updated weights for policy 0, policy_version 37200 (0.0004) [2023-03-12 02:09:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9858.2). Total num frames: 19050496. Throughput: 0: 9970.3. Samples: 19048144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:09:41,005][124505] Avg episode reward: [(0, '4598.877')] [2023-03-12 02:09:44,323][124793] Updated weights for policy 0, policy_version 37280 (0.0004) [2023-03-12 02:09:46,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9844.3). Total num frames: 19103744. Throughput: 0: 10012.6. Samples: 19079240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:09:46,005][124505] Avg episode reward: [(0, '4585.371')] [2023-03-12 02:09:48,279][124793] Updated weights for policy 0, policy_version 37360 (0.0005) [2023-03-12 02:09:51,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9830.4). Total num frames: 19152896. Throughput: 0: 10049.2. Samples: 19141436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:09:51,005][124505] Avg episode reward: [(0, '4560.043')] [2023-03-12 02:09:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000037408_19152896.pth... [2023-03-12 02:09:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000036824_18853888.pth [2023-03-12 02:09:52,262][124793] Updated weights for policy 0, policy_version 37440 (0.0005) [2023-03-12 02:09:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9830.4). Total num frames: 19206144. Throughput: 0: 10038.0. Samples: 19202612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:09:56,005][124505] Avg episode reward: [(0, '4539.200')] [2023-03-12 02:09:56,304][124793] Updated weights for policy 0, policy_version 37520 (0.0005) [2023-03-12 02:10:00,292][124793] Updated weights for policy 0, policy_version 37600 (0.0005) [2023-03-12 02:10:01,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 9802.6). Total num frames: 19255296. Throughput: 0: 10074.1. Samples: 19233592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:10:01,005][124505] Avg episode reward: [(0, '4540.947')] [2023-03-12 02:10:04,287][124793] Updated weights for policy 0, policy_version 37680 (0.0005) [2023-03-12 02:10:06,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 9788.7). Total num frames: 19308544. Throughput: 0: 10103.9. Samples: 19295692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:10:06,005][124505] Avg episode reward: [(0, '4551.827')] [2023-03-12 02:10:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000037712_19308544.pth... [2023-03-12 02:10:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000037112_19001344.pth [2023-03-12 02:10:08,351][124793] Updated weights for policy 0, policy_version 37760 (0.0005) [2023-03-12 02:10:11,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9774.9). Total num frames: 19357696. Throughput: 0: 10116.2. Samples: 19354976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:10:11,005][124505] Avg episode reward: [(0, '4551.544')] [2023-03-12 02:10:12,553][124793] Updated weights for policy 0, policy_version 37840 (0.0005) [2023-03-12 02:10:16,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 9761.0). Total num frames: 19406848. Throughput: 0: 10131.5. Samples: 19384760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:10:16,005][124505] Avg episode reward: [(0, '4551.534')] [2023-03-12 02:10:16,646][124793] Updated weights for policy 0, policy_version 37920 (0.0006) [2023-03-12 02:10:20,476][124793] Updated weights for policy 0, policy_version 38000 (0.0005) [2023-03-12 02:10:21,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9761.0). Total num frames: 19460096. Throughput: 0: 10167.3. Samples: 19446272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:10:21,005][124505] Avg episode reward: [(0, '4572.316')] [2023-03-12 02:10:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000038008_19460096.pth... [2023-03-12 02:10:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000037408_19152896.pth [2023-03-12 02:10:24,390][124793] Updated weights for policy 0, policy_version 38080 (0.0005) [2023-03-12 02:10:26,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10171.7, 300 sec: 9774.9). Total num frames: 19513344. Throughput: 0: 10254.6. Samples: 19509600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:10:26,005][124505] Avg episode reward: [(0, '4587.081')] [2023-03-12 02:10:28,276][124793] Updated weights for policy 0, policy_version 38160 (0.0005) [2023-03-12 02:10:31,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9774.9). Total num frames: 19562496. Throughput: 0: 10268.4. Samples: 19541320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:10:31,005][124505] Avg episode reward: [(0, '4583.229')] [2023-03-12 02:10:32,182][124793] Updated weights for policy 0, policy_version 38240 (0.0004) [2023-03-12 02:10:36,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10240.0, 300 sec: 9802.6). Total num frames: 19615744. Throughput: 0: 10271.4. Samples: 19603648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:10:36,005][124505] Avg episode reward: [(0, '4591.468')] [2023-03-12 02:10:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000038312_19615744.pth... [2023-03-12 02:10:36,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000037712_19308544.pth [2023-03-12 02:10:36,047][124793] Updated weights for policy 0, policy_version 38320 (0.0004) [2023-03-12 02:10:40,160][124793] Updated weights for policy 0, policy_version 38400 (0.0005) [2023-03-12 02:10:41,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10308.3, 300 sec: 9816.5). Total num frames: 19668992. Throughput: 0: 10274.6. Samples: 19664968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:10:41,005][124505] Avg episode reward: [(0, '4590.968')] [2023-03-12 02:10:44,382][124793] Updated weights for policy 0, policy_version 38480 (0.0006) [2023-03-12 02:10:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 9788.7). Total num frames: 19714048. Throughput: 0: 10227.7. Samples: 19693840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:10:46,005][124505] Avg episode reward: [(0, '4593.604')] [2023-03-12 02:10:48,597][124793] Updated weights for policy 0, policy_version 38560 (0.0005) [2023-03-12 02:10:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 10171.7, 300 sec: 9802.6). Total num frames: 19763200. Throughput: 0: 10130.6. Samples: 19751568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:10:51,005][124505] Avg episode reward: [(0, '4581.265')] [2023-03-12 02:10:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000038600_19763200.pth... [2023-03-12 02:10:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000038008_19460096.pth [2023-03-12 02:10:52,861][124793] Updated weights for policy 0, policy_version 38640 (0.0005) [2023-03-12 02:10:56,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10103.5, 300 sec: 9802.6). Total num frames: 19812352. Throughput: 0: 10155.6. Samples: 19811976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:10:56,005][124505] Avg episode reward: [(0, '4589.509')] [2023-03-12 02:10:56,855][124793] Updated weights for policy 0, policy_version 38720 (0.0005) [2023-03-12 02:11:00,783][124793] Updated weights for policy 0, policy_version 38800 (0.0004) [2023-03-12 02:11:01,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9816.5). Total num frames: 19865600. Throughput: 0: 10186.5. Samples: 19843152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:11:01,005][124505] Avg episode reward: [(0, '4593.293')] [2023-03-12 02:11:04,657][124793] Updated weights for policy 0, policy_version 38880 (0.0004) [2023-03-12 02:11:06,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10171.7, 300 sec: 9830.4). Total num frames: 19918848. Throughput: 0: 10219.1. Samples: 19906132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:11:06,005][124505] Avg episode reward: [(0, '4593.129')] [2023-03-12 02:11:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000038904_19918848.pth... [2023-03-12 02:11:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000038312_19615744.pth [2023-03-12 02:11:08,616][124793] Updated weights for policy 0, policy_version 38960 (0.0005) [2023-03-12 02:11:11,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10171.7, 300 sec: 9830.4). Total num frames: 19968000. Throughput: 0: 10184.7. Samples: 19967912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:11:11,005][124505] Avg episode reward: [(0, '4588.318')] [2023-03-12 02:11:12,747][124793] Updated weights for policy 0, policy_version 39040 (0.0005) [2023-03-12 02:11:16,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10171.7, 300 sec: 9844.3). Total num frames: 20017152. Throughput: 0: 10120.4. Samples: 19996736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:11:16,005][124505] Avg episode reward: [(0, '4572.276')] [2023-03-12 02:11:16,879][124793] Updated weights for policy 0, policy_version 39120 (0.0005) [2023-03-12 02:11:20,859][124793] Updated weights for policy 0, policy_version 39200 (0.0004) [2023-03-12 02:11:21,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10171.7, 300 sec: 9858.2). Total num frames: 20070400. Throughput: 0: 10063.0. Samples: 20056484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:11:21,005][124505] Avg episode reward: [(0, '4588.614')] [2023-03-12 02:11:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000039200_20070400.pth... [2023-03-12 02:11:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000038600_19763200.pth [2023-03-12 02:11:24,994][124793] Updated weights for policy 0, policy_version 39280 (0.0005) [2023-03-12 02:11:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9872.1). Total num frames: 20119552. Throughput: 0: 10045.2. Samples: 20117004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:11:26,005][124505] Avg episode reward: [(0, '4560.359')] [2023-03-12 02:11:29,133][124793] Updated weights for policy 0, policy_version 39360 (0.0006) [2023-03-12 02:11:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10103.5, 300 sec: 9872.1). Total num frames: 20168704. Throughput: 0: 10084.3. Samples: 20147632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:11:31,005][124505] Avg episode reward: [(0, '4563.436')] [2023-03-12 02:11:33,296][124793] Updated weights for policy 0, policy_version 39440 (0.0005) [2023-03-12 02:11:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9885.9). Total num frames: 20217856. Throughput: 0: 10092.6. Samples: 20205736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:11:36,005][124505] Avg episode reward: [(0, '4580.177')] [2023-03-12 02:11:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000039488_20217856.pth... [2023-03-12 02:11:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000038904_19918848.pth [2023-03-12 02:11:37,436][124793] Updated weights for policy 0, policy_version 39520 (0.0005) [2023-03-12 02:11:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 20267008. Throughput: 0: 10090.2. Samples: 20266036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:11:41,005][124505] Avg episode reward: [(0, '4590.231')] [2023-03-12 02:11:41,559][124793] Updated weights for policy 0, policy_version 39600 (0.0005) [2023-03-12 02:11:45,760][124793] Updated weights for policy 0, policy_version 39680 (0.0005) [2023-03-12 02:11:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9899.8). Total num frames: 20316160. Throughput: 0: 10052.0. Samples: 20295492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:11:46,005][124505] Avg episode reward: [(0, '4576.718')] [2023-03-12 02:11:49,949][124793] Updated weights for policy 0, policy_version 39760 (0.0005) [2023-03-12 02:11:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9899.8). Total num frames: 20365312. Throughput: 0: 9934.7. Samples: 20353192. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:11:51,005][124505] Avg episode reward: [(0, '4577.471')] [2023-03-12 02:11:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000039776_20365312.pth... [2023-03-12 02:11:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000039200_20070400.pth [2023-03-12 02:11:53,954][124793] Updated weights for policy 0, policy_version 39840 (0.0004) [2023-03-12 02:11:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9927.6). Total num frames: 20418560. Throughput: 0: 9925.0. Samples: 20414536. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:11:56,005][124505] Avg episode reward: [(0, '4585.040')] [2023-03-12 02:11:58,076][124793] Updated weights for policy 0, policy_version 39920 (0.0005) [2023-03-12 02:12:01,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 20467712. Throughput: 0: 9931.9. Samples: 20443672. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:12:01,005][124505] Avg episode reward: [(0, '4558.623')] [2023-03-12 02:12:02,045][124793] Updated weights for policy 0, policy_version 40000 (0.0004) [2023-03-12 02:12:05,927][124793] Updated weights for policy 0, policy_version 40080 (0.0003) [2023-03-12 02:12:06,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9955.4). Total num frames: 20520960. Throughput: 0: 10022.7. Samples: 20507504. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:12:06,005][124505] Avg episode reward: [(0, '4552.403')] [2023-03-12 02:12:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000040080_20520960.pth... [2023-03-12 02:12:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000039488_20217856.pth [2023-03-12 02:12:09,715][124793] Updated weights for policy 0, policy_version 40160 (0.0003) [2023-03-12 02:12:11,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10103.5, 300 sec: 9969.2). Total num frames: 20574208. Throughput: 0: 10085.9. Samples: 20570868. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:12:11,005][124505] Avg episode reward: [(0, '4568.850')] [2023-03-12 02:12:13,536][124793] Updated weights for policy 0, policy_version 40240 (0.0003) [2023-03-12 02:12:16,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10171.7, 300 sec: 9983.1). Total num frames: 20627456. Throughput: 0: 10121.5. Samples: 20603100. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:12:16,005][124505] Avg episode reward: [(0, '4569.392')] [2023-03-12 02:12:17,355][124793] Updated weights for policy 0, policy_version 40320 (0.0003) [2023-03-12 02:12:21,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10171.7, 300 sec: 10010.9). Total num frames: 20680704. Throughput: 0: 10256.2. Samples: 20667268. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:12:21,006][124505] Avg episode reward: [(0, '4554.419')] [2023-03-12 02:12:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000040392_20680704.pth... [2023-03-12 02:12:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000039776_20365312.pth [2023-03-12 02:12:21,401][124793] Updated weights for policy 0, policy_version 40400 (0.0005) [2023-03-12 02:12:25,488][124793] Updated weights for policy 0, policy_version 40480 (0.0005) [2023-03-12 02:12:26,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10171.7, 300 sec: 10010.9). Total num frames: 20729856. Throughput: 0: 10235.2. Samples: 20726620. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:12:26,006][124505] Avg episode reward: [(0, '4577.023')] [2023-03-12 02:12:29,656][124793] Updated weights for policy 0, policy_version 40560 (0.0005) [2023-03-12 02:12:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 10024.8). Total num frames: 20779008. Throughput: 0: 10238.1. Samples: 20756208. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:12:31,006][124505] Avg episode reward: [(0, '4587.510')] [2023-03-12 02:12:33,740][124793] Updated weights for policy 0, policy_version 40640 (0.0005) [2023-03-12 02:12:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 10024.8). Total num frames: 20828160. Throughput: 0: 10283.2. Samples: 20815936. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:12:36,006][124505] Avg episode reward: [(0, '4562.822')] [2023-03-12 02:12:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000040680_20828160.pth... [2023-03-12 02:12:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000040080_20520960.pth [2023-03-12 02:12:37,924][124793] Updated weights for policy 0, policy_version 40720 (0.0005) [2023-03-12 02:12:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 10024.8). Total num frames: 20877312. Throughput: 0: 10236.3. Samples: 20875168. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:12:41,005][124505] Avg episode reward: [(0, '4579.206')] [2023-03-12 02:12:42,107][124793] Updated weights for policy 0, policy_version 40800 (0.0005) [2023-03-12 02:12:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10171.7, 300 sec: 10024.8). Total num frames: 20926464. Throughput: 0: 10244.4. Samples: 20904672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:12:46,005][124505] Avg episode reward: [(0, '4529.329')] [2023-03-12 02:12:46,273][124793] Updated weights for policy 0, policy_version 40880 (0.0005) [2023-03-12 02:12:50,360][124793] Updated weights for policy 0, policy_version 40960 (0.0005) [2023-03-12 02:12:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 10010.9). Total num frames: 20975616. Throughput: 0: 10131.2. Samples: 20963408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:12:51,005][124505] Avg episode reward: [(0, '4541.784')] [2023-03-12 02:12:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000040968_20975616.pth... [2023-03-12 02:12:51,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000040392_20680704.pth [2023-03-12 02:12:54,272][124793] Updated weights for policy 0, policy_version 41040 (0.0005) [2023-03-12 02:12:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 10038.7). Total num frames: 21028864. Throughput: 0: 10111.5. Samples: 21025884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:12:56,005][124505] Avg episode reward: [(0, '4574.502')] [2023-03-12 02:12:58,296][124793] Updated weights for policy 0, policy_version 41120 (0.0005) [2023-03-12 02:13:01,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10171.7, 300 sec: 10038.7). Total num frames: 21078016. Throughput: 0: 10080.5. Samples: 21056724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:13:01,005][124505] Avg episode reward: [(0, '4577.194')] [2023-03-12 02:13:02,260][124793] Updated weights for policy 0, policy_version 41200 (0.0004) [2023-03-12 02:13:06,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10171.7, 300 sec: 10052.6). Total num frames: 21131264. Throughput: 0: 10021.7. Samples: 21118244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:13:06,006][124505] Avg episode reward: [(0, '4498.689')] [2023-03-12 02:13:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000041272_21131264.pth... [2023-03-12 02:13:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000040680_20828160.pth [2023-03-12 02:13:06,308][124793] Updated weights for policy 0, policy_version 41280 (0.0004) [2023-03-12 02:13:10,345][124793] Updated weights for policy 0, policy_version 41360 (0.0005) [2023-03-12 02:13:11,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10066.4). Total num frames: 21180416. Throughput: 0: 10056.6. Samples: 21179164. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:13:11,005][124505] Avg episode reward: [(0, '4583.001')] [2023-03-12 02:13:14,385][124793] Updated weights for policy 0, policy_version 41440 (0.0005) [2023-03-12 02:13:16,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 10066.4). Total num frames: 21229568. Throughput: 0: 10065.4. Samples: 21209152. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:13:16,005][124505] Avg episode reward: [(0, '4562.259')] [2023-03-12 02:13:18,432][124793] Updated weights for policy 0, policy_version 41520 (0.0005) [2023-03-12 02:13:21,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 10080.3). Total num frames: 21282816. Throughput: 0: 10090.1. Samples: 21269988. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:13:21,005][124505] Avg episode reward: [(0, '4552.677')] [2023-03-12 02:13:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000041568_21282816.pth... [2023-03-12 02:13:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000040968_20975616.pth [2023-03-12 02:13:22,511][124793] Updated weights for policy 0, policy_version 41600 (0.0005) [2023-03-12 02:13:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10094.2). Total num frames: 21331968. Throughput: 0: 10103.8. Samples: 21329840. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:13:26,005][124505] Avg episode reward: [(0, '4580.521')] [2023-03-12 02:13:26,685][124793] Updated weights for policy 0, policy_version 41680 (0.0005) [2023-03-12 02:13:30,992][124793] Updated weights for policy 0, policy_version 41760 (0.0005) [2023-03-12 02:13:31,005][124505] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 10094.2). Total num frames: 21381120. Throughput: 0: 10078.7. Samples: 21358216. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:13:31,006][124505] Avg episode reward: [(0, '4583.936')] [2023-03-12 02:13:35,296][124793] Updated weights for policy 0, policy_version 41840 (0.0005) [2023-03-12 02:13:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9966.9, 300 sec: 10080.3). Total num frames: 21426176. Throughput: 0: 10033.2. Samples: 21414904. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:13:36,005][124505] Avg episode reward: [(0, '4593.647')] [2023-03-12 02:13:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000041848_21426176.pth... [2023-03-12 02:13:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000041272_21131264.pth [2023-03-12 02:13:39,620][124793] Updated weights for policy 0, policy_version 41920 (0.0005) [2023-03-12 02:13:41,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9966.9, 300 sec: 10080.3). Total num frames: 21475328. Throughput: 0: 9914.4. Samples: 21472032. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:13:41,005][124505] Avg episode reward: [(0, '4566.293')] [2023-03-12 02:13:43,871][124793] Updated weights for policy 0, policy_version 42000 (0.0005) [2023-03-12 02:13:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 10080.3). Total num frames: 21524480. Throughput: 0: 9877.1. Samples: 21501192. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:13:46,005][124505] Avg episode reward: [(0, '4326.324')] [2023-03-12 02:13:48,031][124793] Updated weights for policy 0, policy_version 42080 (0.0005) [2023-03-12 02:13:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10080.3). Total num frames: 21573632. Throughput: 0: 9848.1. Samples: 21561408. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:13:51,005][124505] Avg episode reward: [(0, '4171.945')] [2023-03-12 02:13:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000042136_21573632.pth... [2023-03-12 02:13:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000041568_21282816.pth [2023-03-12 02:13:51,950][124793] Updated weights for policy 0, policy_version 42160 (0.0004) [2023-03-12 02:13:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 10080.3). Total num frames: 21622784. Throughput: 0: 9858.4. Samples: 21622792. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:13:56,005][124505] Avg episode reward: [(0, '4435.223')] [2023-03-12 02:13:56,012][124793] Updated weights for policy 0, policy_version 42240 (0.0004) [2023-03-12 02:13:59,992][124793] Updated weights for policy 0, policy_version 42320 (0.0003) [2023-03-12 02:14:01,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 10080.3). Total num frames: 21676032. Throughput: 0: 9877.7. Samples: 21653648. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:14:01,005][124505] Avg episode reward: [(0, '4519.991')] [2023-03-12 02:14:04,001][124793] Updated weights for policy 0, policy_version 42400 (0.0004) [2023-03-12 02:14:06,005][124505] Fps is (10 sec: 10649.6, 60 sec: 9966.9, 300 sec: 10094.2). Total num frames: 21729280. Throughput: 0: 9888.5. Samples: 21714972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:14:06,005][124505] Avg episode reward: [(0, '4592.647')] [2023-03-12 02:14:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000042440_21729280.pth... [2023-03-12 02:14:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000041848_21426176.pth [2023-03-12 02:14:07,999][124793] Updated weights for policy 0, policy_version 42480 (0.0004) [2023-03-12 02:14:11,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 10080.3). Total num frames: 21778432. Throughput: 0: 9902.6. Samples: 21775456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:14:11,005][124505] Avg episode reward: [(0, '4581.999')] [2023-03-12 02:14:12,125][124793] Updated weights for policy 0, policy_version 42560 (0.0005) [2023-03-12 02:14:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10080.3). Total num frames: 21827584. Throughput: 0: 9932.2. Samples: 21805164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:14:16,005][124505] Avg episode reward: [(0, '4549.673')] [2023-03-12 02:14:16,235][124793] Updated weights for policy 0, policy_version 42640 (0.0004) [2023-03-12 02:14:20,365][124793] Updated weights for policy 0, policy_version 42720 (0.0005) [2023-03-12 02:14:21,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 10080.3). Total num frames: 21876736. Throughput: 0: 9991.3. Samples: 21864512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:14:21,005][124505] Avg episode reward: [(0, '4555.557')] [2023-03-12 02:14:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000042728_21876736.pth... [2023-03-12 02:14:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000042136_21573632.pth [2023-03-12 02:14:24,377][124793] Updated weights for policy 0, policy_version 42800 (0.0004) [2023-03-12 02:14:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 10094.2). Total num frames: 21929984. Throughput: 0: 10087.3. Samples: 21925960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:14:26,005][124505] Avg episode reward: [(0, '4562.360')] [2023-03-12 02:14:28,360][124793] Updated weights for policy 0, policy_version 42880 (0.0004) [2023-03-12 02:14:31,005][124505] Fps is (10 sec: 10240.1, 60 sec: 9967.0, 300 sec: 10094.2). Total num frames: 21979136. Throughput: 0: 10123.7. Samples: 21956760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:14:31,005][124505] Avg episode reward: [(0, '4564.815')] [2023-03-12 02:14:32,340][124793] Updated weights for policy 0, policy_version 42960 (0.0004) [2023-03-12 02:14:36,005][124505] Fps is (10 sec: 10239.7, 60 sec: 10103.4, 300 sec: 10108.1). Total num frames: 22032384. Throughput: 0: 10162.4. Samples: 22018720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:14:36,006][124505] Avg episode reward: [(0, '4562.636')] [2023-03-12 02:14:36,010][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000043032_22032384.pth... [2023-03-12 02:14:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000042440_21729280.pth [2023-03-12 02:14:36,396][124793] Updated weights for policy 0, policy_version 43040 (0.0005) [2023-03-12 02:14:40,431][124793] Updated weights for policy 0, policy_version 43120 (0.0004) [2023-03-12 02:14:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10094.2). Total num frames: 22081536. Throughput: 0: 10136.8. Samples: 22078948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:14:41,005][124505] Avg episode reward: [(0, '4559.645')] [2023-03-12 02:14:44,843][124793] Updated weights for policy 0, policy_version 43200 (0.0005) [2023-03-12 02:14:46,005][124505] Fps is (10 sec: 9421.0, 60 sec: 10035.2, 300 sec: 10080.3). Total num frames: 22126592. Throughput: 0: 10056.4. Samples: 22106184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:14:46,005][124505] Avg episode reward: [(0, '4567.411')] [2023-03-12 02:14:49,264][124793] Updated weights for policy 0, policy_version 43280 (0.0005) [2023-03-12 02:14:51,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9966.9, 300 sec: 10052.6). Total num frames: 22171648. Throughput: 0: 9949.9. Samples: 22162716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:14:51,005][124505] Avg episode reward: [(0, '4574.051')] [2023-03-12 02:14:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000043312_22175744.pth... [2023-03-12 02:14:51,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000042728_21876736.pth [2023-03-12 02:14:53,552][124793] Updated weights for policy 0, policy_version 43360 (0.0005) [2023-03-12 02:14:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9966.9, 300 sec: 10052.6). Total num frames: 22220800. Throughput: 0: 9868.0. Samples: 22219516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:14:56,005][124505] Avg episode reward: [(0, '4553.519')] [2023-03-12 02:14:58,020][124793] Updated weights for policy 0, policy_version 43440 (0.0005) [2023-03-12 02:15:01,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9830.4, 300 sec: 10024.8). Total num frames: 22265856. Throughput: 0: 9809.8. Samples: 22246604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:15:01,005][124505] Avg episode reward: [(0, '4514.479')] [2023-03-12 02:15:02,431][124793] Updated weights for policy 0, policy_version 43520 (0.0005) [2023-03-12 02:15:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 10024.8). Total num frames: 22315008. Throughput: 0: 9736.1. Samples: 22302636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:15:06,005][124505] Avg episode reward: [(0, '4274.593')] [2023-03-12 02:15:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000043584_22315008.pth... [2023-03-12 02:15:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000043032_22032384.pth [2023-03-12 02:15:06,837][124793] Updated weights for policy 0, policy_version 43600 (0.0005) [2023-03-12 02:15:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 10010.9). Total num frames: 22360064. Throughput: 0: 9589.6. Samples: 22357492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:15:11,005][124505] Avg episode reward: [(0, '4290.803')] [2023-03-12 02:15:11,343][124793] Updated weights for policy 0, policy_version 43680 (0.0005) [2023-03-12 02:15:15,825][124793] Updated weights for policy 0, policy_version 43760 (0.0005) [2023-03-12 02:15:16,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9625.6, 300 sec: 9983.1). Total num frames: 22405120. Throughput: 0: 9508.8. Samples: 22384656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:15:16,005][124505] Avg episode reward: [(0, '4273.788')] [2023-03-12 02:15:20,211][124793] Updated weights for policy 0, policy_version 43840 (0.0005) [2023-03-12 02:15:21,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9955.4). Total num frames: 22450176. Throughput: 0: 9366.5. Samples: 22440212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:15:21,005][124505] Avg episode reward: [(0, '4351.661')] [2023-03-12 02:15:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000043848_22450176.pth... [2023-03-12 02:15:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000043312_22175744.pth [2023-03-12 02:15:24,707][124793] Updated weights for policy 0, policy_version 43920 (0.0005) [2023-03-12 02:15:26,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9941.5). Total num frames: 22495232. Throughput: 0: 9252.2. Samples: 22495296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:15:26,005][124505] Avg episode reward: [(0, '4368.840')] [2023-03-12 02:15:29,111][124793] Updated weights for policy 0, policy_version 44000 (0.0005) [2023-03-12 02:15:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9927.6). Total num frames: 22544384. Throughput: 0: 9280.8. Samples: 22523820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:15:31,005][124505] Avg episode reward: [(0, '4367.678')] [2023-03-12 02:15:33,639][124793] Updated weights for policy 0, policy_version 44080 (0.0005) [2023-03-12 02:15:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9899.8). Total num frames: 22589440. Throughput: 0: 9211.3. Samples: 22577224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:15:36,005][124505] Avg episode reward: [(0, '4500.352')] [2023-03-12 02:15:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000044120_22589440.pth... [2023-03-12 02:15:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000043584_22315008.pth [2023-03-12 02:15:37,980][124793] Updated weights for policy 0, policy_version 44160 (0.0005) [2023-03-12 02:15:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9913.7). Total num frames: 22638592. Throughput: 0: 9223.4. Samples: 22634568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:15:41,005][124505] Avg episode reward: [(0, '4545.159')] [2023-03-12 02:15:42,343][124793] Updated weights for policy 0, policy_version 44240 (0.0005) [2023-03-12 02:15:46,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9899.8). Total num frames: 22683648. Throughput: 0: 9253.6. Samples: 22663016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:15:46,005][124505] Avg episode reward: [(0, '4556.600')] [2023-03-12 02:15:46,734][124793] Updated weights for policy 0, policy_version 44320 (0.0005) [2023-03-12 02:15:51,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9885.9). Total num frames: 22728704. Throughput: 0: 9250.3. Samples: 22718900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:15:51,005][124505] Avg episode reward: [(0, '4517.192')] [2023-03-12 02:15:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000044392_22728704.pth... [2023-03-12 02:15:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000043848_22450176.pth [2023-03-12 02:15:51,123][124793] Updated weights for policy 0, policy_version 44400 (0.0005) [2023-03-12 02:15:55,520][124793] Updated weights for policy 0, policy_version 44480 (0.0005) [2023-03-12 02:15:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9872.1). Total num frames: 22777856. Throughput: 0: 9258.9. Samples: 22774144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:15:56,005][124505] Avg episode reward: [(0, '4461.200')] [2023-03-12 02:15:59,911][124793] Updated weights for policy 0, policy_version 44560 (0.0005) [2023-03-12 02:16:01,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9844.3). Total num frames: 22822912. Throughput: 0: 9284.1. Samples: 22802440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:16:01,005][124505] Avg episode reward: [(0, '4392.581')] [2023-03-12 02:16:04,247][124793] Updated weights for policy 0, policy_version 44640 (0.0005) [2023-03-12 02:16:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9844.3). Total num frames: 22872064. Throughput: 0: 9318.6. Samples: 22859548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:16:06,005][124505] Avg episode reward: [(0, '4348.457')] [2023-03-12 02:16:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000044672_22872064.pth... [2023-03-12 02:16:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000044120_22589440.pth [2023-03-12 02:16:08,447][124793] Updated weights for policy 0, policy_version 44720 (0.0005) [2023-03-12 02:16:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9844.3). Total num frames: 22921216. Throughput: 0: 9375.5. Samples: 22917192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:16:11,005][124505] Avg episode reward: [(0, '4431.309')] [2023-03-12 02:16:12,739][124793] Updated weights for policy 0, policy_version 44800 (0.0005) [2023-03-12 02:16:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9816.5). Total num frames: 22966272. Throughput: 0: 9378.6. Samples: 22945856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:16:16,005][124505] Avg episode reward: [(0, '4498.889')] [2023-03-12 02:16:17,043][124793] Updated weights for policy 0, policy_version 44880 (0.0005) [2023-03-12 02:16:21,005][124505] Fps is (10 sec: 9420.6, 60 sec: 9420.8, 300 sec: 9816.5). Total num frames: 23015424. Throughput: 0: 9464.9. Samples: 23003144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:16:21,006][124505] Avg episode reward: [(0, '4524.761')] [2023-03-12 02:16:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000044952_23015424.pth... [2023-03-12 02:16:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000044392_22728704.pth [2023-03-12 02:16:21,363][124793] Updated weights for policy 0, policy_version 44960 (0.0005) [2023-03-12 02:16:25,705][124793] Updated weights for policy 0, policy_version 45040 (0.0005) [2023-03-12 02:16:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9802.6). Total num frames: 23060480. Throughput: 0: 9448.6. Samples: 23059756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:16:26,005][124505] Avg episode reward: [(0, '4542.964')] [2023-03-12 02:16:30,142][124793] Updated weights for policy 0, policy_version 45120 (0.0005) [2023-03-12 02:16:31,005][124505] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9788.7). Total num frames: 23105536. Throughput: 0: 9429.4. Samples: 23087340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:16:31,005][124505] Avg episode reward: [(0, '4514.206')] [2023-03-12 02:16:34,526][124793] Updated weights for policy 0, policy_version 45200 (0.0005) [2023-03-12 02:16:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9788.7). Total num frames: 23154688. Throughput: 0: 9418.3. Samples: 23142724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:16:36,005][124505] Avg episode reward: [(0, '4558.907')] [2023-03-12 02:16:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000045224_23154688.pth... [2023-03-12 02:16:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000044672_22872064.pth [2023-03-12 02:16:38,724][124793] Updated weights for policy 0, policy_version 45280 (0.0005) [2023-03-12 02:16:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9788.7). Total num frames: 23203840. Throughput: 0: 9492.3. Samples: 23201300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:16:41,005][124505] Avg episode reward: [(0, '4527.136')] [2023-03-12 02:16:43,030][124793] Updated weights for policy 0, policy_version 45360 (0.0005) [2023-03-12 02:16:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9774.9). Total num frames: 23248896. Throughput: 0: 9486.0. Samples: 23229312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:16:46,005][124505] Avg episode reward: [(0, '4552.275')] [2023-03-12 02:16:47,356][124793] Updated weights for policy 0, policy_version 45440 (0.0005) [2023-03-12 02:16:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9761.0). Total num frames: 23298048. Throughput: 0: 9487.3. Samples: 23286476. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:16:51,005][124505] Avg episode reward: [(0, '4541.096')] [2023-03-12 02:16:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000045504_23298048.pth... [2023-03-12 02:16:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000044952_23015424.pth [2023-03-12 02:16:51,659][124793] Updated weights for policy 0, policy_version 45520 (0.0005) [2023-03-12 02:16:55,987][124793] Updated weights for policy 0, policy_version 45600 (0.0005) [2023-03-12 02:16:56,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9761.0). Total num frames: 23347200. Throughput: 0: 9466.3. Samples: 23343176. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:16:56,005][124505] Avg episode reward: [(0, '4541.485')] [2023-03-12 02:17:00,411][124793] Updated weights for policy 0, policy_version 45680 (0.0005) [2023-03-12 02:17:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9733.2). Total num frames: 23392256. Throughput: 0: 9455.8. Samples: 23371368. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:17:01,005][124505] Avg episode reward: [(0, '4554.489')] [2023-03-12 02:17:04,759][124793] Updated weights for policy 0, policy_version 45760 (0.0005) [2023-03-12 02:17:06,005][124505] Fps is (10 sec: 9011.1, 60 sec: 9420.8, 300 sec: 9705.4). Total num frames: 23437312. Throughput: 0: 9437.4. Samples: 23427828. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:17:06,005][124505] Avg episode reward: [(0, '4568.000')] [2023-03-12 02:17:06,042][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000045784_23441408.pth... [2023-03-12 02:17:06,044][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000045224_23154688.pth [2023-03-12 02:17:09,047][124793] Updated weights for policy 0, policy_version 45840 (0.0005) [2023-03-12 02:17:11,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9691.6). Total num frames: 23486464. Throughput: 0: 9446.2. Samples: 23484836. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:17:11,005][124505] Avg episode reward: [(0, '4565.221')] [2023-03-12 02:17:13,181][124793] Updated weights for policy 0, policy_version 45920 (0.0005) [2023-03-12 02:17:16,005][124505] Fps is (10 sec: 10240.1, 60 sec: 9557.3, 300 sec: 9691.6). Total num frames: 23539712. Throughput: 0: 9506.9. Samples: 23515152. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:17:16,005][124505] Avg episode reward: [(0, '4540.155')] [2023-03-12 02:17:17,141][124793] Updated weights for policy 0, policy_version 46000 (0.0005) [2023-03-12 02:17:21,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9557.3, 300 sec: 9691.6). Total num frames: 23588864. Throughput: 0: 9642.6. Samples: 23576640. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:17:21,005][124505] Avg episode reward: [(0, '4577.226')] [2023-03-12 02:17:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000046072_23588864.pth... [2023-03-12 02:17:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000045504_23298048.pth [2023-03-12 02:17:21,271][124793] Updated weights for policy 0, policy_version 46080 (0.0004) [2023-03-12 02:17:25,528][124793] Updated weights for policy 0, policy_version 46160 (0.0005) [2023-03-12 02:17:26,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9691.6). Total num frames: 23638016. Throughput: 0: 9621.1. Samples: 23634248. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:17:26,005][124505] Avg episode reward: [(0, '4563.596')] [2023-03-12 02:17:29,766][124793] Updated weights for policy 0, policy_version 46240 (0.0005) [2023-03-12 02:17:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9677.7). Total num frames: 23683072. Throughput: 0: 9647.0. Samples: 23663428. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:17:31,005][124505] Avg episode reward: [(0, '4576.996')] [2023-03-12 02:17:34,092][124793] Updated weights for policy 0, policy_version 46320 (0.0005) [2023-03-12 02:17:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9677.7). Total num frames: 23732224. Throughput: 0: 9639.5. Samples: 23720252. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:17:36,005][124505] Avg episode reward: [(0, '4593.228')] [2023-03-12 02:17:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000046352_23732224.pth... [2023-03-12 02:17:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000045784_23441408.pth [2023-03-12 02:17:38,296][124793] Updated weights for policy 0, policy_version 46400 (0.0004) [2023-03-12 02:17:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9677.7). Total num frames: 23781376. Throughput: 0: 9695.4. Samples: 23779468. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:17:41,005][124505] Avg episode reward: [(0, '4604.950')] [2023-03-12 02:17:41,006][124749] Saving new best policy, reward=4604.950! [2023-03-12 02:17:42,459][124793] Updated weights for policy 0, policy_version 46480 (0.0003) [2023-03-12 02:17:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9677.7). Total num frames: 23830528. Throughput: 0: 9728.4. Samples: 23809148. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:17:46,005][124505] Avg episode reward: [(0, '4595.846')] [2023-03-12 02:17:46,623][124793] Updated weights for policy 0, policy_version 46560 (0.0005) [2023-03-12 02:17:50,834][124793] Updated weights for policy 0, policy_version 46640 (0.0005) [2023-03-12 02:17:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9663.8). Total num frames: 23879680. Throughput: 0: 9771.9. Samples: 23867564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:17:51,005][124505] Avg episode reward: [(0, '4570.590')] [2023-03-12 02:17:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000046640_23879680.pth... [2023-03-12 02:17:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000046072_23588864.pth [2023-03-12 02:17:55,163][124793] Updated weights for policy 0, policy_version 46720 (0.0005) [2023-03-12 02:17:56,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9649.9). Total num frames: 23924736. Throughput: 0: 9775.8. Samples: 23924744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:17:56,005][124505] Avg episode reward: [(0, '4562.589')] [2023-03-12 02:17:59,475][124793] Updated weights for policy 0, policy_version 46800 (0.0005) [2023-03-12 02:18:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9636.0). Total num frames: 23973888. Throughput: 0: 9738.7. Samples: 23953392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:18:01,005][124505] Avg episode reward: [(0, '4526.557')] [2023-03-12 02:18:03,770][124793] Updated weights for policy 0, policy_version 46880 (0.0005) [2023-03-12 02:18:06,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9636.0). Total num frames: 24023040. Throughput: 0: 9644.9. Samples: 24010660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:18:06,005][124505] Avg episode reward: [(0, '4531.147')] [2023-03-12 02:18:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000046920_24023040.pth... [2023-03-12 02:18:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000046352_23732224.pth [2023-03-12 02:18:08,104][124793] Updated weights for policy 0, policy_version 46960 (0.0005) [2023-03-12 02:18:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9622.1). Total num frames: 24068096. Throughput: 0: 9641.1. Samples: 24068096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:18:11,005][124505] Avg episode reward: [(0, '4549.422')] [2023-03-12 02:18:12,351][124793] Updated weights for policy 0, policy_version 47040 (0.0005) [2023-03-12 02:18:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9608.2). Total num frames: 24117248. Throughput: 0: 9629.8. Samples: 24096768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:18:16,005][124505] Avg episode reward: [(0, '4558.247')] [2023-03-12 02:18:16,626][124793] Updated weights for policy 0, policy_version 47120 (0.0005) [2023-03-12 02:18:20,959][124793] Updated weights for policy 0, policy_version 47200 (0.0005) [2023-03-12 02:18:21,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9608.2). Total num frames: 24166400. Throughput: 0: 9641.3. Samples: 24154112. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:18:21,005][124505] Avg episode reward: [(0, '4500.035')] [2023-03-12 02:18:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000047200_24166400.pth... [2023-03-12 02:18:21,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000046640_23879680.pth [2023-03-12 02:18:25,171][124793] Updated weights for policy 0, policy_version 47280 (0.0005) [2023-03-12 02:18:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9594.4). Total num frames: 24211456. Throughput: 0: 9600.1. Samples: 24211472. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:18:26,005][124505] Avg episode reward: [(0, '4393.453')] [2023-03-12 02:18:29,438][124793] Updated weights for policy 0, policy_version 47360 (0.0005) [2023-03-12 02:18:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9608.2). Total num frames: 24260608. Throughput: 0: 9578.8. Samples: 24240192. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:18:31,005][124505] Avg episode reward: [(0, '4175.327')] [2023-03-12 02:18:33,644][124793] Updated weights for policy 0, policy_version 47440 (0.0005) [2023-03-12 02:18:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9608.2). Total num frames: 24309760. Throughput: 0: 9577.2. Samples: 24298540. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:18:36,005][124505] Avg episode reward: [(0, '4163.722')] [2023-03-12 02:18:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000047480_24309760.pth... [2023-03-12 02:18:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000046920_24023040.pth [2023-03-12 02:18:37,839][124793] Updated weights for policy 0, policy_version 47520 (0.0005) [2023-03-12 02:18:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9608.2). Total num frames: 24358912. Throughput: 0: 9587.2. Samples: 24356168. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:18:41,005][124505] Avg episode reward: [(0, '4304.177')] [2023-03-12 02:18:42,116][124793] Updated weights for policy 0, policy_version 47600 (0.0005) [2023-03-12 02:18:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9608.2). Total num frames: 24408064. Throughput: 0: 9598.6. Samples: 24385328. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:18:46,005][124505] Avg episode reward: [(0, '4435.087')] [2023-03-12 02:18:46,306][124793] Updated weights for policy 0, policy_version 47680 (0.0005) [2023-03-12 02:18:50,484][124793] Updated weights for policy 0, policy_version 47760 (0.0005) [2023-03-12 02:18:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9608.2). Total num frames: 24457216. Throughput: 0: 9650.4. Samples: 24444928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:18:51,005][124505] Avg episode reward: [(0, '4311.763')] [2023-03-12 02:18:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000047768_24457216.pth... [2023-03-12 02:18:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000047200_24166400.pth [2023-03-12 02:18:54,607][124793] Updated weights for policy 0, policy_version 47840 (0.0005) [2023-03-12 02:18:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9594.4). Total num frames: 24506368. Throughput: 0: 9682.9. Samples: 24503828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:18:56,005][124505] Avg episode reward: [(0, '4290.653')] [2023-03-12 02:18:58,636][124793] Updated weights for policy 0, policy_version 47920 (0.0004) [2023-03-12 02:19:01,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9594.4). Total num frames: 24559616. Throughput: 0: 9730.0. Samples: 24534616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:19:01,005][124505] Avg episode reward: [(0, '4418.828')] [2023-03-12 02:19:02,543][124793] Updated weights for policy 0, policy_version 48000 (0.0005) [2023-03-12 02:19:06,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9594.4). Total num frames: 24608768. Throughput: 0: 9842.3. Samples: 24597016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:19:06,006][124505] Avg episode reward: [(0, '4261.991')] [2023-03-12 02:19:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000048064_24608768.pth... [2023-03-12 02:19:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000047480_24309760.pth [2023-03-12 02:19:06,425][124793] Updated weights for policy 0, policy_version 48080 (0.0004) [2023-03-12 02:19:10,289][124793] Updated weights for policy 0, policy_version 48160 (0.0004) [2023-03-12 02:19:11,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9608.2). Total num frames: 24662016. Throughput: 0: 9990.9. Samples: 24661064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:19:11,005][124505] Avg episode reward: [(0, '4221.784')] [2023-03-12 02:19:14,199][124793] Updated weights for policy 0, policy_version 48240 (0.0004) [2023-03-12 02:19:16,005][124505] Fps is (10 sec: 10649.6, 60 sec: 9966.9, 300 sec: 9622.1). Total num frames: 24715264. Throughput: 0: 10045.1. Samples: 24692224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:19:16,005][124505] Avg episode reward: [(0, '4223.600')] [2023-03-12 02:19:18,179][124793] Updated weights for policy 0, policy_version 48320 (0.0004) [2023-03-12 02:19:21,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9608.2). Total num frames: 24764416. Throughput: 0: 10123.1. Samples: 24754080. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:19:21,006][124505] Avg episode reward: [(0, '4263.769')] [2023-03-12 02:19:21,015][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000048376_24768512.pth... [2023-03-12 02:19:21,017][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000047768_24457216.pth [2023-03-12 02:19:22,238][124793] Updated weights for policy 0, policy_version 48400 (0.0005) [2023-03-12 02:19:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9622.1). Total num frames: 24817664. Throughput: 0: 10187.4. Samples: 24814600. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:19:26,005][124505] Avg episode reward: [(0, '4451.808')] [2023-03-12 02:19:26,258][124793] Updated weights for policy 0, policy_version 48480 (0.0005) [2023-03-12 02:19:30,288][124793] Updated weights for policy 0, policy_version 48560 (0.0005) [2023-03-12 02:19:31,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 9608.3). Total num frames: 24866816. Throughput: 0: 10231.6. Samples: 24845748. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:19:31,005][124505] Avg episode reward: [(0, '4482.783')] [2023-03-12 02:19:34,459][124793] Updated weights for policy 0, policy_version 48640 (0.0003) [2023-03-12 02:19:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 9608.2). Total num frames: 24915968. Throughput: 0: 10220.4. Samples: 24904848. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:19:36,005][124505] Avg episode reward: [(0, '4536.615')] [2023-03-12 02:19:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000048664_24915968.pth... [2023-03-12 02:19:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000048064_24608768.pth [2023-03-12 02:19:38,611][124793] Updated weights for policy 0, policy_version 48720 (0.0003) [2023-03-12 02:19:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9636.0). Total num frames: 24969216. Throughput: 0: 10247.7. Samples: 24964972. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:19:41,016][124505] Avg episode reward: [(0, '4561.198')] [2023-03-12 02:19:42,621][124793] Updated weights for policy 0, policy_version 48800 (0.0003) [2023-03-12 02:19:46,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10171.7, 300 sec: 9649.9). Total num frames: 25018368. Throughput: 0: 10243.9. Samples: 24995592. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:19:46,016][124505] Avg episode reward: [(0, '4575.488')] [2023-03-12 02:19:46,554][124793] Updated weights for policy 0, policy_version 48880 (0.0003) [2023-03-12 02:19:50,652][124793] Updated weights for policy 0, policy_version 48960 (0.0004) [2023-03-12 02:19:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 9649.9). Total num frames: 25067520. Throughput: 0: 10242.4. Samples: 25057924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:19:51,016][124505] Avg episode reward: [(0, '4577.545')] [2023-03-12 02:19:51,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000048960_25067520.pth... [2023-03-12 02:19:51,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000048376_24768512.pth [2023-03-12 02:19:54,792][124793] Updated weights for policy 0, policy_version 49040 (0.0005) [2023-03-12 02:19:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 9663.8). Total num frames: 25116672. Throughput: 0: 10124.9. Samples: 25116684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:19:56,005][124505] Avg episode reward: [(0, '4573.442')] [2023-03-12 02:19:58,784][124793] Updated weights for policy 0, policy_version 49120 (0.0005) [2023-03-12 02:20:01,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9677.7). Total num frames: 25169920. Throughput: 0: 10118.4. Samples: 25147552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:20:01,005][124505] Avg episode reward: [(0, '4539.122')] [2023-03-12 02:20:02,840][124793] Updated weights for policy 0, policy_version 49200 (0.0005) [2023-03-12 02:20:06,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9691.6). Total num frames: 25219072. Throughput: 0: 10060.6. Samples: 25206804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:20:06,005][124505] Avg episode reward: [(0, '4418.502')] [2023-03-12 02:20:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000049256_25219072.pth... [2023-03-12 02:20:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000048664_24915968.pth [2023-03-12 02:20:07,259][124793] Updated weights for policy 0, policy_version 49280 (0.0006) [2023-03-12 02:20:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 10035.2, 300 sec: 9691.6). Total num frames: 25264128. Throughput: 0: 9932.0. Samples: 25261540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:20:11,005][124505] Avg episode reward: [(0, '4396.885')] [2023-03-12 02:20:11,648][124793] Updated weights for policy 0, policy_version 49360 (0.0005) [2023-03-12 02:20:15,789][124793] Updated weights for policy 0, policy_version 49440 (0.0005) [2023-03-12 02:20:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9966.9, 300 sec: 9705.4). Total num frames: 25313280. Throughput: 0: 9905.4. Samples: 25291492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:20:16,005][124505] Avg episode reward: [(0, '4404.076')] [2023-03-12 02:20:20,035][124793] Updated weights for policy 0, policy_version 49520 (0.0004) [2023-03-12 02:20:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9719.3). Total num frames: 25362432. Throughput: 0: 9890.0. Samples: 25349896. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:20:21,005][124505] Avg episode reward: [(0, '4579.971')] [2023-03-12 02:20:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000049536_25362432.pth... [2023-03-12 02:20:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000048960_25067520.pth [2023-03-12 02:20:24,277][124793] Updated weights for policy 0, policy_version 49600 (0.0004) [2023-03-12 02:20:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9719.3). Total num frames: 25411584. Throughput: 0: 9845.8. Samples: 25408032. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:20:26,005][124505] Avg episode reward: [(0, '4585.011')] [2023-03-12 02:20:28,472][124793] Updated weights for policy 0, policy_version 49680 (0.0003) [2023-03-12 02:20:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9733.2). Total num frames: 25460736. Throughput: 0: 9813.7. Samples: 25437208. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:20:31,005][124505] Avg episode reward: [(0, '4581.508')] [2023-03-12 02:20:32,463][124793] Updated weights for policy 0, policy_version 49760 (0.0003) [2023-03-12 02:20:36,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9733.2). Total num frames: 25509888. Throughput: 0: 9792.0. Samples: 25498564. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:20:36,005][124505] Avg episode reward: [(0, '4570.008')] [2023-03-12 02:20:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000049824_25509888.pth... [2023-03-12 02:20:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000049256_25219072.pth [2023-03-12 02:20:36,566][124793] Updated weights for policy 0, policy_version 49840 (0.0004) [2023-03-12 02:20:40,902][124793] Updated weights for policy 0, policy_version 49920 (0.0006) [2023-03-12 02:20:41,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9747.1). Total num frames: 25559040. Throughput: 0: 9756.6. Samples: 25555732. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:20:41,006][124505] Avg episode reward: [(0, '4584.488')] [2023-03-12 02:20:45,136][124793] Updated weights for policy 0, policy_version 50000 (0.0004) [2023-03-12 02:20:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9761.0). Total num frames: 25608192. Throughput: 0: 9702.0. Samples: 25584140. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:20:46,005][124505] Avg episode reward: [(0, '4583.294')] [2023-03-12 02:20:49,193][124793] Updated weights for policy 0, policy_version 50080 (0.0004) [2023-03-12 02:20:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9761.0). Total num frames: 25657344. Throughput: 0: 9738.9. Samples: 25645056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:20:51,016][124505] Avg episode reward: [(0, '4585.807')] [2023-03-12 02:20:51,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000050112_25657344.pth... [2023-03-12 02:20:51,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000049536_25362432.pth [2023-03-12 02:20:53,117][124793] Updated weights for policy 0, policy_version 50160 (0.0004) [2023-03-12 02:20:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9788.7). Total num frames: 25710592. Throughput: 0: 9880.8. Samples: 25706176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:20:56,016][124505] Avg episode reward: [(0, '4564.554')] [2023-03-12 02:20:57,196][124793] Updated weights for policy 0, policy_version 50240 (0.0004) [2023-03-12 02:21:01,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9788.7). Total num frames: 25759744. Throughput: 0: 9903.5. Samples: 25737148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:21:01,016][124505] Avg episode reward: [(0, '4570.835')] [2023-03-12 02:21:01,254][124793] Updated weights for policy 0, policy_version 50320 (0.0003) [2023-03-12 02:21:05,096][124793] Updated weights for policy 0, policy_version 50400 (0.0003) [2023-03-12 02:21:06,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9802.6). Total num frames: 25812992. Throughput: 0: 9989.8. Samples: 25799436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:21:06,016][124505] Avg episode reward: [(0, '4594.300')] [2023-03-12 02:21:06,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000050416_25812992.pth... [2023-03-12 02:21:06,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000049824_25509888.pth [2023-03-12 02:21:09,026][124793] Updated weights for policy 0, policy_version 50480 (0.0003) [2023-03-12 02:21:11,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10035.2, 300 sec: 9830.4). Total num frames: 25866240. Throughput: 0: 10092.8. Samples: 25862208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:21:11,016][124505] Avg episode reward: [(0, '4605.243')] [2023-03-12 02:21:11,016][124749] Saving new best policy, reward=4605.243! [2023-03-12 02:21:13,042][124793] Updated weights for policy 0, policy_version 50560 (0.0005) [2023-03-12 02:21:16,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9830.4). Total num frames: 25915392. Throughput: 0: 10104.7. Samples: 25891920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:21:16,016][124505] Avg episode reward: [(0, '4590.429')] [2023-03-12 02:21:17,196][124793] Updated weights for policy 0, policy_version 50640 (0.0005) [2023-03-12 02:21:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9844.3). Total num frames: 25964544. Throughput: 0: 10081.3. Samples: 25952220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:21:21,016][124505] Avg episode reward: [(0, '4595.677')] [2023-03-12 02:21:21,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000050712_25964544.pth... [2023-03-12 02:21:21,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000050112_25657344.pth [2023-03-12 02:21:21,231][124793] Updated weights for policy 0, policy_version 50720 (0.0006) [2023-03-12 02:21:25,109][124793] Updated weights for policy 0, policy_version 50800 (0.0005) [2023-03-12 02:21:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9872.1). Total num frames: 26017792. Throughput: 0: 10198.2. Samples: 26014648. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:21:26,016][124505] Avg episode reward: [(0, '4593.910')] [2023-03-12 02:21:28,776][124793] Updated weights for policy 0, policy_version 50880 (0.0004) [2023-03-12 02:21:31,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10240.0, 300 sec: 9899.8). Total num frames: 26075136. Throughput: 0: 10314.9. Samples: 26048312. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:21:31,016][124505] Avg episode reward: [(0, '4592.663')] [2023-03-12 02:21:32,476][124793] Updated weights for policy 0, policy_version 50960 (0.0005) [2023-03-12 02:21:36,005][124505] Fps is (10 sec: 11059.1, 60 sec: 10308.3, 300 sec: 9913.7). Total num frames: 26128384. Throughput: 0: 10445.3. Samples: 26115096. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:21:36,016][124505] Avg episode reward: [(0, '4593.796')] [2023-03-12 02:21:36,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000051032_26128384.pth... [2023-03-12 02:21:36,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000050416_25812992.pth [2023-03-12 02:21:36,246][124793] Updated weights for policy 0, policy_version 51040 (0.0005) [2023-03-12 02:21:40,257][124793] Updated weights for policy 0, policy_version 51120 (0.0006) [2023-03-12 02:21:41,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10308.3, 300 sec: 9927.6). Total num frames: 26177536. Throughput: 0: 10468.9. Samples: 26177276. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:21:41,016][124505] Avg episode reward: [(0, '4601.238')] [2023-03-12 02:21:44,122][124793] Updated weights for policy 0, policy_version 51200 (0.0005) [2023-03-12 02:21:46,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10444.8, 300 sec: 9955.4). Total num frames: 26234880. Throughput: 0: 10472.2. Samples: 26208396. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:21:46,016][124505] Avg episode reward: [(0, '4604.801')] [2023-03-12 02:21:47,851][124793] Updated weights for policy 0, policy_version 51280 (0.0004) [2023-03-12 02:21:51,005][124505] Fps is (10 sec: 11059.1, 60 sec: 10513.1, 300 sec: 9969.2). Total num frames: 26288128. Throughput: 0: 10545.1. Samples: 26273964. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:21:51,005][124505] Avg episode reward: [(0, '4597.591')] [2023-03-12 02:21:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000051344_26288128.pth... [2023-03-12 02:21:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000050712_25964544.pth [2023-03-12 02:21:51,711][124793] Updated weights for policy 0, policy_version 51360 (0.0005) [2023-03-12 02:21:55,610][124793] Updated weights for policy 0, policy_version 51440 (0.0004) [2023-03-12 02:21:56,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10444.8, 300 sec: 9983.1). Total num frames: 26337280. Throughput: 0: 10554.6. Samples: 26337164. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:21:56,005][124505] Avg episode reward: [(0, '4603.665')] [2023-03-12 02:21:59,490][124793] Updated weights for policy 0, policy_version 51520 (0.0005) [2023-03-12 02:22:01,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10513.1, 300 sec: 10010.9). Total num frames: 26390528. Throughput: 0: 10595.7. Samples: 26368728. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:22:01,005][124505] Avg episode reward: [(0, '4590.486')] [2023-03-12 02:22:03,524][124793] Updated weights for policy 0, policy_version 51600 (0.0006) [2023-03-12 02:22:06,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10444.8, 300 sec: 10010.9). Total num frames: 26439680. Throughput: 0: 10603.0. Samples: 26429356. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:22:06,005][124505] Avg episode reward: [(0, '4573.600')] [2023-03-12 02:22:06,070][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000051648_26443776.pth... [2023-03-12 02:22:06,072][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000051032_26128384.pth [2023-03-12 02:22:07,692][124793] Updated weights for policy 0, policy_version 51680 (0.0005) [2023-03-12 02:22:11,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10376.5, 300 sec: 9997.0). Total num frames: 26488832. Throughput: 0: 10537.8. Samples: 26488848. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:22:11,005][124505] Avg episode reward: [(0, '4572.914')] [2023-03-12 02:22:11,836][124793] Updated weights for policy 0, policy_version 51760 (0.0006) [2023-03-12 02:22:15,915][124793] Updated weights for policy 0, policy_version 51840 (0.0006) [2023-03-12 02:22:16,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10444.8, 300 sec: 10010.9). Total num frames: 26542080. Throughput: 0: 10452.5. Samples: 26518676. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:22:16,005][124505] Avg episode reward: [(0, '4589.232')] [2023-03-12 02:22:20,041][124793] Updated weights for policy 0, policy_version 51920 (0.0006) [2023-03-12 02:22:21,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10444.8, 300 sec: 10010.9). Total num frames: 26591232. Throughput: 0: 10307.7. Samples: 26578944. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:22:21,005][124505] Avg episode reward: [(0, '4573.465')] [2023-03-12 02:22:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000051936_26591232.pth... [2023-03-12 02:22:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000051344_26288128.pth [2023-03-12 02:22:24,135][124793] Updated weights for policy 0, policy_version 52000 (0.0006) [2023-03-12 02:22:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10376.5, 300 sec: 10024.8). Total num frames: 26640384. Throughput: 0: 10258.1. Samples: 26638892. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:22:26,005][124505] Avg episode reward: [(0, '4564.777')] [2023-03-12 02:22:28,240][124793] Updated weights for policy 0, policy_version 52080 (0.0006) [2023-03-12 02:22:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10240.0, 300 sec: 10024.8). Total num frames: 26689536. Throughput: 0: 10231.6. Samples: 26668816. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:22:31,005][124505] Avg episode reward: [(0, '4576.504')] [2023-03-12 02:22:32,416][124793] Updated weights for policy 0, policy_version 52160 (0.0005) [2023-03-12 02:22:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 10024.8). Total num frames: 26738688. Throughput: 0: 10068.6. Samples: 26727052. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:22:36,005][124505] Avg episode reward: [(0, '4582.425')] [2023-03-12 02:22:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000052224_26738688.pth... [2023-03-12 02:22:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000051648_26443776.pth [2023-03-12 02:22:36,541][124793] Updated weights for policy 0, policy_version 52240 (0.0005) [2023-03-12 02:22:40,778][124793] Updated weights for policy 0, policy_version 52320 (0.0005) [2023-03-12 02:22:41,005][124505] Fps is (10 sec: 9830.3, 60 sec: 10171.7, 300 sec: 10024.8). Total num frames: 26787840. Throughput: 0: 9984.3. Samples: 26786460. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:22:41,005][124505] Avg episode reward: [(0, '4577.950')] [2023-03-12 02:22:44,875][124793] Updated weights for policy 0, policy_version 52400 (0.0005) [2023-03-12 02:22:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10024.8). Total num frames: 26836992. Throughput: 0: 9939.9. Samples: 26816024. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:22:46,005][124505] Avg episode reward: [(0, '4588.858')] [2023-03-12 02:22:48,862][124793] Updated weights for policy 0, policy_version 52480 (0.0005) [2023-03-12 02:22:51,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10052.6). Total num frames: 26890240. Throughput: 0: 9964.1. Samples: 26877740. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:22:51,005][124505] Avg episode reward: [(0, '4592.863')] [2023-03-12 02:22:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000052520_26890240.pth... [2023-03-12 02:22:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000051936_26591232.pth [2023-03-12 02:22:52,807][124793] Updated weights for policy 0, policy_version 52560 (0.0005) [2023-03-12 02:22:56,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 10052.6). Total num frames: 26939392. Throughput: 0: 10003.0. Samples: 26938984. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:22:56,005][124505] Avg episode reward: [(0, '4605.251')] [2023-03-12 02:22:56,006][124749] Saving new best policy, reward=4605.251! [2023-03-12 02:22:56,905][124793] Updated weights for policy 0, policy_version 52640 (0.0005) [2023-03-12 02:23:00,928][124793] Updated weights for policy 0, policy_version 52720 (0.0005) [2023-03-12 02:23:01,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 10066.4). Total num frames: 26992640. Throughput: 0: 9988.9. Samples: 26968176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:23:01,005][124505] Avg episode reward: [(0, '4602.649')] [2023-03-12 02:23:04,877][124793] Updated weights for policy 0, policy_version 52800 (0.0005) [2023-03-12 02:23:06,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 10080.3). Total num frames: 27041792. Throughput: 0: 10038.0. Samples: 27030656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:23:06,005][124505] Avg episode reward: [(0, '4595.285')] [2023-03-12 02:23:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000052816_27041792.pth... [2023-03-12 02:23:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000052224_26738688.pth [2023-03-12 02:23:08,990][124793] Updated weights for policy 0, policy_version 52880 (0.0005) [2023-03-12 02:23:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10080.3). Total num frames: 27090944. Throughput: 0: 10045.9. Samples: 27090956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:23:11,005][124505] Avg episode reward: [(0, '4585.943')] [2023-03-12 02:23:12,935][124793] Updated weights for policy 0, policy_version 52960 (0.0005) [2023-03-12 02:23:16,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10094.2). Total num frames: 27144192. Throughput: 0: 10080.3. Samples: 27122432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:23:16,005][124505] Avg episode reward: [(0, '4585.656')] [2023-03-12 02:23:16,946][124793] Updated weights for policy 0, policy_version 53040 (0.0005) [2023-03-12 02:23:21,004][124793] Updated weights for policy 0, policy_version 53120 (0.0004) [2023-03-12 02:23:21,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10103.5, 300 sec: 10122.0). Total num frames: 27197440. Throughput: 0: 10141.3. Samples: 27183412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:23:21,005][124505] Avg episode reward: [(0, '4581.002')] [2023-03-12 02:23:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000053120_27197440.pth... [2023-03-12 02:23:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000052520_26890240.pth [2023-03-12 02:23:24,857][124793] Updated weights for policy 0, policy_version 53200 (0.0005) [2023-03-12 02:23:26,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 10122.0). Total num frames: 27246592. Throughput: 0: 10219.2. Samples: 27246324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:23:26,016][124505] Avg episode reward: [(0, '4586.999')] [2023-03-12 02:23:28,965][124793] Updated weights for policy 0, policy_version 53280 (0.0005) [2023-03-12 02:23:31,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10171.7, 300 sec: 10135.9). Total num frames: 27299840. Throughput: 0: 10210.2. Samples: 27275480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:23:31,016][124505] Avg episode reward: [(0, '4591.305')] [2023-03-12 02:23:32,992][124793] Updated weights for policy 0, policy_version 53360 (0.0005) [2023-03-12 02:23:36,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10171.7, 300 sec: 10135.9). Total num frames: 27348992. Throughput: 0: 10199.2. Samples: 27336704. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:23:36,016][124505] Avg episode reward: [(0, '4589.765')] [2023-03-12 02:23:36,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000053416_27348992.pth... [2023-03-12 02:23:36,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000052816_27041792.pth [2023-03-12 02:23:36,892][124793] Updated weights for policy 0, policy_version 53440 (0.0005) [2023-03-12 02:23:40,992][124793] Updated weights for policy 0, policy_version 53520 (0.0005) [2023-03-12 02:23:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10240.0, 300 sec: 10149.7). Total num frames: 27402240. Throughput: 0: 10205.0. Samples: 27398208. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:23:41,016][124505] Avg episode reward: [(0, '4592.214')] [2023-03-12 02:23:44,786][124793] Updated weights for policy 0, policy_version 53600 (0.0004) [2023-03-12 02:23:46,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10308.3, 300 sec: 10163.6). Total num frames: 27455488. Throughput: 0: 10252.1. Samples: 27429520. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:23:46,016][124505] Avg episode reward: [(0, '4591.316')] [2023-03-12 02:23:48,601][124793] Updated weights for policy 0, policy_version 53680 (0.0004) [2023-03-12 02:23:51,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10308.3, 300 sec: 10177.5). Total num frames: 27508736. Throughput: 0: 10312.4. Samples: 27494716. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:23:51,016][124505] Avg episode reward: [(0, '4591.661')] [2023-03-12 02:23:51,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000053728_27508736.pth... [2023-03-12 02:23:51,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000053120_27197440.pth [2023-03-12 02:23:52,393][124793] Updated weights for policy 0, policy_version 53760 (0.0004) [2023-03-12 02:23:56,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10376.5, 300 sec: 10177.5). Total num frames: 27561984. Throughput: 0: 10411.5. Samples: 27559476. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:23:56,016][124505] Avg episode reward: [(0, '4594.435')] [2023-03-12 02:23:56,195][124793] Updated weights for policy 0, policy_version 53840 (0.0004) [2023-03-12 02:24:00,024][124793] Updated weights for policy 0, policy_version 53920 (0.0004) [2023-03-12 02:24:01,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10376.5, 300 sec: 10191.4). Total num frames: 27615232. Throughput: 0: 10425.6. Samples: 27591584. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:24:01,005][124505] Avg episode reward: [(0, '4592.254')] [2023-03-12 02:24:03,899][124793] Updated weights for policy 0, policy_version 54000 (0.0005) [2023-03-12 02:24:06,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10444.8, 300 sec: 10191.4). Total num frames: 27668480. Throughput: 0: 10492.8. Samples: 27655588. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:24:06,016][124505] Avg episode reward: [(0, '4589.631')] [2023-03-12 02:24:06,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000054040_27668480.pth... [2023-03-12 02:24:06,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000053416_27348992.pth [2023-03-12 02:24:07,647][124793] Updated weights for policy 0, policy_version 54080 (0.0004) [2023-03-12 02:24:11,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10513.1, 300 sec: 10191.4). Total num frames: 27721728. Throughput: 0: 10547.8. Samples: 27720976. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:24:11,005][124505] Avg episode reward: [(0, '4591.043')] [2023-03-12 02:24:11,430][124793] Updated weights for policy 0, policy_version 54160 (0.0004) [2023-03-12 02:24:15,273][124793] Updated weights for policy 0, policy_version 54240 (0.0004) [2023-03-12 02:24:16,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10513.1, 300 sec: 10205.3). Total num frames: 27774976. Throughput: 0: 10617.1. Samples: 27753252. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:24:16,005][124505] Avg episode reward: [(0, '4592.319')] [2023-03-12 02:24:19,026][124793] Updated weights for policy 0, policy_version 54320 (0.0004) [2023-03-12 02:24:21,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10581.3, 300 sec: 10219.2). Total num frames: 27832320. Throughput: 0: 10690.8. Samples: 27817792. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:24:21,005][124505] Avg episode reward: [(0, '4592.744')] [2023-03-12 02:24:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000054360_27832320.pth... [2023-03-12 02:24:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000053728_27508736.pth [2023-03-12 02:24:22,952][124793] Updated weights for policy 0, policy_version 54400 (0.0005) [2023-03-12 02:24:26,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10581.3, 300 sec: 10219.2). Total num frames: 27881472. Throughput: 0: 10684.2. Samples: 27879000. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:24:26,006][124505] Avg episode reward: [(0, '4593.900')] [2023-03-12 02:24:27,099][124793] Updated weights for policy 0, policy_version 54480 (0.0005) [2023-03-12 02:24:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10513.0, 300 sec: 10219.2). Total num frames: 27930624. Throughput: 0: 10647.4. Samples: 27908652. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:24:31,005][124505] Avg episode reward: [(0, '4601.384')] [2023-03-12 02:24:31,224][124793] Updated weights for policy 0, policy_version 54560 (0.0005) [2023-03-12 02:24:35,173][124793] Updated weights for policy 0, policy_version 54640 (0.0005) [2023-03-12 02:24:36,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10581.3, 300 sec: 10219.2). Total num frames: 27983872. Throughput: 0: 10548.0. Samples: 27969376. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:24:36,005][124505] Avg episode reward: [(0, '4597.399')] [2023-03-12 02:24:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000054656_27983872.pth... [2023-03-12 02:24:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000054040_27668480.pth [2023-03-12 02:24:39,348][124793] Updated weights for policy 0, policy_version 54720 (0.0005) [2023-03-12 02:24:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10444.8, 300 sec: 10205.3). Total num frames: 28028928. Throughput: 0: 10432.3. Samples: 28028928. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:24:41,005][124505] Avg episode reward: [(0, '4599.750')] [2023-03-12 02:24:43,609][124793] Updated weights for policy 0, policy_version 54800 (0.0004) [2023-03-12 02:24:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 10376.5, 300 sec: 10205.3). Total num frames: 28078080. Throughput: 0: 10356.1. Samples: 28057608. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:24:46,005][124505] Avg episode reward: [(0, '4596.500')] [2023-03-12 02:24:47,752][124793] Updated weights for policy 0, policy_version 54880 (0.0004) [2023-03-12 02:24:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10308.3, 300 sec: 10205.3). Total num frames: 28127232. Throughput: 0: 10231.6. Samples: 28116008. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:24:51,005][124505] Avg episode reward: [(0, '4598.943')] [2023-03-12 02:24:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000054936_28127232.pth... [2023-03-12 02:24:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000054360_27832320.pth [2023-03-12 02:24:51,996][124793] Updated weights for policy 0, policy_version 54960 (0.0005) [2023-03-12 02:24:56,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10240.0, 300 sec: 10191.4). Total num frames: 28176384. Throughput: 0: 10104.0. Samples: 28175656. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:24:56,005][124505] Avg episode reward: [(0, '4593.163')] [2023-03-12 02:24:56,111][124793] Updated weights for policy 0, policy_version 55040 (0.0005) [2023-03-12 02:25:00,283][124793] Updated weights for policy 0, policy_version 55120 (0.0005) [2023-03-12 02:25:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 10191.4). Total num frames: 28225536. Throughput: 0: 10040.1. Samples: 28205056. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:25:01,005][124505] Avg episode reward: [(0, '4597.817')] [2023-03-12 02:25:04,367][124793] Updated weights for policy 0, policy_version 55200 (0.0005) [2023-03-12 02:25:06,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10171.8, 300 sec: 10219.2). Total num frames: 28278784. Throughput: 0: 9928.4. Samples: 28264568. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:25:06,005][124505] Avg episode reward: [(0, '4597.271')] [2023-03-12 02:25:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000055232_28278784.pth... [2023-03-12 02:25:06,009][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000054656_27983872.pth [2023-03-12 02:25:08,509][124793] Updated weights for policy 0, policy_version 55280 (0.0005) [2023-03-12 02:25:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10205.3). Total num frames: 28323840. Throughput: 0: 9886.8. Samples: 28323904. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:25:11,005][124505] Avg episode reward: [(0, '4596.513')] [2023-03-12 02:25:12,716][124793] Updated weights for policy 0, policy_version 55360 (0.0005) [2023-03-12 02:25:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9967.0, 300 sec: 10205.3). Total num frames: 28372992. Throughput: 0: 9865.2. Samples: 28352584. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:25:16,005][124505] Avg episode reward: [(0, '4596.072')] [2023-03-12 02:25:16,865][124793] Updated weights for policy 0, policy_version 55440 (0.0005) [2023-03-12 02:25:20,973][124793] Updated weights for policy 0, policy_version 55520 (0.0005) [2023-03-12 02:25:21,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 10219.2). Total num frames: 28426240. Throughput: 0: 9850.1. Samples: 28412628. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:25:21,005][124505] Avg episode reward: [(0, '4594.324')] [2023-03-12 02:25:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000055520_28426240.pth... [2023-03-12 02:25:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000054936_28127232.pth [2023-03-12 02:25:25,073][124793] Updated weights for policy 0, policy_version 55600 (0.0005) [2023-03-12 02:25:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 10219.2). Total num frames: 28475392. Throughput: 0: 9846.1. Samples: 28472000. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:25:26,005][124505] Avg episode reward: [(0, '4583.455')] [2023-03-12 02:25:29,235][124793] Updated weights for policy 0, policy_version 55680 (0.0005) [2023-03-12 02:25:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 10219.2). Total num frames: 28524544. Throughput: 0: 9879.0. Samples: 28502164. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:25:31,005][124505] Avg episode reward: [(0, '4595.377')] [2023-03-12 02:25:33,473][124793] Updated weights for policy 0, policy_version 55760 (0.0005) [2023-03-12 02:25:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 10219.2). Total num frames: 28573696. Throughput: 0: 9871.7. Samples: 28560232. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:25:36,005][124505] Avg episode reward: [(0, '4596.417')] [2023-03-12 02:25:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000055808_28573696.pth... [2023-03-12 02:25:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000055232_28278784.pth [2023-03-12 02:25:37,677][124793] Updated weights for policy 0, policy_version 55840 (0.0005) [2023-03-12 02:25:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 10219.2). Total num frames: 28622848. Throughput: 0: 9848.2. Samples: 28618824. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:25:41,005][124505] Avg episode reward: [(0, '4561.421')] [2023-03-12 02:25:41,801][124793] Updated weights for policy 0, policy_version 55920 (0.0005) [2023-03-12 02:25:46,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9830.4, 300 sec: 10205.3). Total num frames: 28667904. Throughput: 0: 9835.5. Samples: 28647652. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:25:46,005][124505] Avg episode reward: [(0, '4579.388')] [2023-03-12 02:25:46,061][124793] Updated weights for policy 0, policy_version 56000 (0.0005) [2023-03-12 02:25:50,289][124793] Updated weights for policy 0, policy_version 56080 (0.0005) [2023-03-12 02:25:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 10191.4). Total num frames: 28717056. Throughput: 0: 9810.6. Samples: 28706044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:25:51,005][124505] Avg episode reward: [(0, '4586.953')] [2023-03-12 02:25:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000056088_28717056.pth... [2023-03-12 02:25:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000055520_28426240.pth [2023-03-12 02:25:54,516][124793] Updated weights for policy 0, policy_version 56160 (0.0004) [2023-03-12 02:25:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 10191.4). Total num frames: 28766208. Throughput: 0: 9787.0. Samples: 28764320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:25:56,005][124505] Avg episode reward: [(0, '4576.959')] [2023-03-12 02:25:58,679][124793] Updated weights for policy 0, policy_version 56240 (0.0005) [2023-03-12 02:26:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 10177.5). Total num frames: 28815360. Throughput: 0: 9820.3. Samples: 28794500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:26:01,005][124505] Avg episode reward: [(0, '4583.785')] [2023-03-12 02:26:02,857][124793] Updated weights for policy 0, policy_version 56320 (0.0005) [2023-03-12 02:26:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 10163.6). Total num frames: 28864512. Throughput: 0: 9773.9. Samples: 28852452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:26:06,005][124505] Avg episode reward: [(0, '4579.684')] [2023-03-12 02:26:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000056376_28864512.pth... [2023-03-12 02:26:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000055808_28573696.pth [2023-03-12 02:26:07,045][124793] Updated weights for policy 0, policy_version 56400 (0.0005) [2023-03-12 02:26:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 10163.6). Total num frames: 28913664. Throughput: 0: 9763.7. Samples: 28911368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:26:11,005][124505] Avg episode reward: [(0, '4577.926')] [2023-03-12 02:26:11,257][124793] Updated weights for policy 0, policy_version 56480 (0.0005) [2023-03-12 02:26:15,527][124793] Updated weights for policy 0, policy_version 56560 (0.0005) [2023-03-12 02:26:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 10163.6). Total num frames: 28962816. Throughput: 0: 9738.4. Samples: 28940392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:26:16,005][124505] Avg episode reward: [(0, '4585.432')] [2023-03-12 02:26:19,761][124793] Updated weights for policy 0, policy_version 56640 (0.0005) [2023-03-12 02:26:21,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 10135.9). Total num frames: 29007872. Throughput: 0: 9743.1. Samples: 28998672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:26:21,006][124505] Avg episode reward: [(0, '4584.371')] [2023-03-12 02:26:21,071][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000056664_29011968.pth... [2023-03-12 02:26:21,073][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000056088_28717056.pth [2023-03-12 02:26:24,026][124793] Updated weights for policy 0, policy_version 56720 (0.0005) [2023-03-12 02:26:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 10108.1). Total num frames: 29057024. Throughput: 0: 9697.9. Samples: 29055232. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:26:26,005][124505] Avg episode reward: [(0, '4582.690')] [2023-03-12 02:26:28,273][124793] Updated weights for policy 0, policy_version 56800 (0.0005) [2023-03-12 02:26:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 10094.2). Total num frames: 29106176. Throughput: 0: 9718.2. Samples: 29084972. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:26:31,005][124505] Avg episode reward: [(0, '4583.233')] [2023-03-12 02:26:32,548][124793] Updated weights for policy 0, policy_version 56880 (0.0005) [2023-03-12 02:26:36,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 10094.2). Total num frames: 29155328. Throughput: 0: 9709.4. Samples: 29142968. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:26:36,005][124505] Avg episode reward: [(0, '4587.456')] [2023-03-12 02:26:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000056944_29155328.pth... [2023-03-12 02:26:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000056376_28864512.pth [2023-03-12 02:26:36,770][124793] Updated weights for policy 0, policy_version 56960 (0.0005) [2023-03-12 02:26:40,586][124793] Updated weights for policy 0, policy_version 57040 (0.0005) [2023-03-12 02:26:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 10080.3). Total num frames: 29208576. Throughput: 0: 9782.8. Samples: 29204544. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:26:41,005][124505] Avg episode reward: [(0, '4588.681')] [2023-03-12 02:26:44,395][124793] Updated weights for policy 0, policy_version 57120 (0.0004) [2023-03-12 02:26:46,005][124505] Fps is (10 sec: 10649.7, 60 sec: 9898.6, 300 sec: 10080.3). Total num frames: 29261824. Throughput: 0: 9836.2. Samples: 29237128. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:26:46,005][124505] Avg episode reward: [(0, '4590.398')] [2023-03-12 02:26:48,259][124793] Updated weights for policy 0, policy_version 57200 (0.0004) [2023-03-12 02:26:51,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 10080.3). Total num frames: 29310976. Throughput: 0: 9939.5. Samples: 29299732. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:26:51,006][124505] Avg episode reward: [(0, '4592.382')] [2023-03-12 02:26:51,010][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000057248_29310976.pth... [2023-03-12 02:26:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000056664_29011968.pth [2023-03-12 02:26:52,300][124793] Updated weights for policy 0, policy_version 57280 (0.0005) [2023-03-12 02:26:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 10080.3). Total num frames: 29364224. Throughput: 0: 9979.6. Samples: 29360452. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:26:56,005][124505] Avg episode reward: [(0, '4593.419')] [2023-03-12 02:26:56,357][124793] Updated weights for policy 0, policy_version 57360 (0.0005) [2023-03-12 02:27:00,599][124793] Updated weights for policy 0, policy_version 57440 (0.0005) [2023-03-12 02:27:01,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 10066.4). Total num frames: 29409280. Throughput: 0: 9999.2. Samples: 29390356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:27:01,005][124505] Avg episode reward: [(0, '4588.245')] [2023-03-12 02:27:04,756][124793] Updated weights for policy 0, policy_version 57520 (0.0005) [2023-03-12 02:27:06,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 10080.3). Total num frames: 29462528. Throughput: 0: 9996.8. Samples: 29448528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:27:06,005][124505] Avg episode reward: [(0, '4595.134')] [2023-03-12 02:27:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000057544_29462528.pth... [2023-03-12 02:27:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000056944_29155328.pth [2023-03-12 02:27:08,879][124793] Updated weights for policy 0, policy_version 57600 (0.0005) [2023-03-12 02:27:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 10052.6). Total num frames: 29507584. Throughput: 0: 10052.5. Samples: 29507592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:27:11,005][124505] Avg episode reward: [(0, '4599.069')] [2023-03-12 02:27:13,139][124793] Updated weights for policy 0, policy_version 57680 (0.0004) [2023-03-12 02:27:16,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9898.7, 300 sec: 10052.6). Total num frames: 29556736. Throughput: 0: 10030.1. Samples: 29536328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:27:16,005][124505] Avg episode reward: [(0, '4604.241')] [2023-03-12 02:27:17,248][124793] Updated weights for policy 0, policy_version 57760 (0.0005) [2023-03-12 02:27:21,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 10066.4). Total num frames: 29609984. Throughput: 0: 10089.5. Samples: 29596996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:27:21,005][124505] Avg episode reward: [(0, '4592.778')] [2023-03-12 02:27:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000057832_29609984.pth... [2023-03-12 02:27:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000057248_29310976.pth [2023-03-12 02:27:21,192][124793] Updated weights for policy 0, policy_version 57840 (0.0005) [2023-03-12 02:27:25,208][124793] Updated weights for policy 0, policy_version 57920 (0.0005) [2023-03-12 02:27:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10066.4). Total num frames: 29659136. Throughput: 0: 10102.2. Samples: 29659144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:27:26,005][124505] Avg episode reward: [(0, '4605.326')] [2023-03-12 02:27:26,026][124749] Saving new best policy, reward=4605.326! [2023-03-12 02:27:29,330][124793] Updated weights for policy 0, policy_version 58000 (0.0005) [2023-03-12 02:27:31,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 10080.3). Total num frames: 29712384. Throughput: 0: 10022.6. Samples: 29688144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:27:31,005][124505] Avg episode reward: [(0, '4601.954')] [2023-03-12 02:27:33,355][124793] Updated weights for policy 0, policy_version 58080 (0.0005) [2023-03-12 02:27:36,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 10080.3). Total num frames: 29761536. Throughput: 0: 9990.7. Samples: 29749312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:27:36,005][124505] Avg episode reward: [(0, '4604.998')] [2023-03-12 02:27:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000058128_29761536.pth... [2023-03-12 02:27:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000057544_29462528.pth [2023-03-12 02:27:37,575][124793] Updated weights for policy 0, policy_version 58160 (0.0005) [2023-03-12 02:27:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10080.3). Total num frames: 29810688. Throughput: 0: 9918.0. Samples: 29806764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:27:41,005][124505] Avg episode reward: [(0, '4598.578')] [2023-03-12 02:27:41,777][124793] Updated weights for policy 0, policy_version 58240 (0.0005) [2023-03-12 02:27:46,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9898.7, 300 sec: 10052.6). Total num frames: 29855744. Throughput: 0: 9908.3. Samples: 29836228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:27:46,005][124505] Avg episode reward: [(0, '4588.581')] [2023-03-12 02:27:46,005][124793] Updated weights for policy 0, policy_version 58320 (0.0005) [2023-03-12 02:27:50,175][124793] Updated weights for policy 0, policy_version 58400 (0.0005) [2023-03-12 02:27:51,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 10066.4). Total num frames: 29908992. Throughput: 0: 9920.6. Samples: 29894956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:27:51,005][124505] Avg episode reward: [(0, '4594.976')] [2023-03-12 02:27:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000058416_29908992.pth... [2023-03-12 02:27:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000057832_29609984.pth [2023-03-12 02:27:54,362][124793] Updated weights for policy 0, policy_version 58480 (0.0005) [2023-03-12 02:27:56,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 10038.7). Total num frames: 29954048. Throughput: 0: 9921.2. Samples: 29954048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:27:56,006][124505] Avg episode reward: [(0, '4574.748')] [2023-03-12 02:27:58,623][124793] Updated weights for policy 0, policy_version 58560 (0.0005) [2023-03-12 02:28:01,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9898.7, 300 sec: 10038.7). Total num frames: 30003200. Throughput: 0: 9919.8. Samples: 29982720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:28:01,005][124505] Avg episode reward: [(0, '4542.563')] [2023-03-12 02:28:02,812][124793] Updated weights for policy 0, policy_version 58640 (0.0005) [2023-03-12 02:28:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 10038.7). Total num frames: 30052352. Throughput: 0: 9870.9. Samples: 30041188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:28:06,005][124505] Avg episode reward: [(0, '4530.202')] [2023-03-12 02:28:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000058696_30052352.pth... [2023-03-12 02:28:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000058128_29761536.pth [2023-03-12 02:28:06,912][124793] Updated weights for policy 0, policy_version 58720 (0.0005) [2023-03-12 02:28:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 10024.8). Total num frames: 30101504. Throughput: 0: 9823.6. Samples: 30101208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:28:11,005][124505] Avg episode reward: [(0, '4490.415')] [2023-03-12 02:28:11,095][124793] Updated weights for policy 0, policy_version 58800 (0.0005) [2023-03-12 02:28:15,252][124793] Updated weights for policy 0, policy_version 58880 (0.0005) [2023-03-12 02:28:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 10010.9). Total num frames: 30150656. Throughput: 0: 9821.2. Samples: 30130100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:28:16,005][124505] Avg episode reward: [(0, '4307.253')] [2023-03-12 02:28:19,441][124793] Updated weights for policy 0, policy_version 58960 (0.0005) [2023-03-12 02:28:21,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 10010.9). Total num frames: 30199808. Throughput: 0: 9771.1. Samples: 30189012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:28:21,005][124505] Avg episode reward: [(0, '4375.951')] [2023-03-12 02:28:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000058984_30199808.pth... [2023-03-12 02:28:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000058416_29908992.pth [2023-03-12 02:28:23,576][124793] Updated weights for policy 0, policy_version 59040 (0.0005) [2023-03-12 02:28:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9997.0). Total num frames: 30248960. Throughput: 0: 9815.3. Samples: 30248452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:28:26,005][124505] Avg episode reward: [(0, '4335.376')] [2023-03-12 02:28:27,880][124793] Updated weights for policy 0, policy_version 59120 (0.0005) [2023-03-12 02:28:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9997.0). Total num frames: 30298112. Throughput: 0: 9777.2. Samples: 30276204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:28:31,005][124505] Avg episode reward: [(0, '4417.557')] [2023-03-12 02:28:32,257][124793] Updated weights for policy 0, policy_version 59200 (0.0005) [2023-03-12 02:28:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9969.2). Total num frames: 30343168. Throughput: 0: 9717.9. Samples: 30332260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:28:36,005][124505] Avg episode reward: [(0, '4325.576')] [2023-03-12 02:28:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000059264_30343168.pth... [2023-03-12 02:28:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000058696_30052352.pth [2023-03-12 02:28:36,592][124793] Updated weights for policy 0, policy_version 59280 (0.0005) [2023-03-12 02:28:40,961][124793] Updated weights for policy 0, policy_version 59360 (0.0005) [2023-03-12 02:28:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9955.4). Total num frames: 30392320. Throughput: 0: 9650.6. Samples: 30388324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:28:41,016][124505] Avg episode reward: [(0, '4363.077')] [2023-03-12 02:28:45,191][124793] Updated weights for policy 0, policy_version 59440 (0.0005) [2023-03-12 02:28:46,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9927.6). Total num frames: 30437376. Throughput: 0: 9680.1. Samples: 30418324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:28:46,016][124505] Avg episode reward: [(0, '4461.494')] [2023-03-12 02:28:49,339][124793] Updated weights for policy 0, policy_version 59520 (0.0005) [2023-03-12 02:28:51,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9927.6). Total num frames: 30490624. Throughput: 0: 9679.5. Samples: 30476764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:28:51,005][124505] Avg episode reward: [(0, '4465.638')] [2023-03-12 02:28:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000059552_30490624.pth... [2023-03-12 02:28:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000058984_30199808.pth [2023-03-12 02:28:53,335][124793] Updated weights for policy 0, policy_version 59600 (0.0005) [2023-03-12 02:28:56,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9762.1, 300 sec: 9913.7). Total num frames: 30539776. Throughput: 0: 9695.4. Samples: 30537500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:28:56,016][124505] Avg episode reward: [(0, '4211.029')] [2023-03-12 02:28:57,402][124793] Updated weights for policy 0, policy_version 59680 (0.0005) [2023-03-12 02:29:01,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 30593024. Throughput: 0: 9739.2. Samples: 30568364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:29:01,016][124505] Avg episode reward: [(0, '4365.282')] [2023-03-12 02:29:01,359][124793] Updated weights for policy 0, policy_version 59760 (0.0005) [2023-03-12 02:29:05,393][124793] Updated weights for policy 0, policy_version 59840 (0.0005) [2023-03-12 02:29:06,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9899.8). Total num frames: 30642176. Throughput: 0: 9798.7. Samples: 30629952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:29:06,016][124505] Avg episode reward: [(0, '4468.188')] [2023-03-12 02:29:06,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000059848_30642176.pth... [2023-03-12 02:29:06,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000059264_30343168.pth [2023-03-12 02:29:09,336][124793] Updated weights for policy 0, policy_version 59920 (0.0005) [2023-03-12 02:29:11,005][124505] Fps is (10 sec: 10239.8, 60 sec: 9898.6, 300 sec: 9899.8). Total num frames: 30695424. Throughput: 0: 9843.9. Samples: 30691428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:29:11,016][124505] Avg episode reward: [(0, '4428.363')] [2023-03-12 02:29:13,303][124793] Updated weights for policy 0, policy_version 60000 (0.0005) [2023-03-12 02:29:16,005][124505] Fps is (10 sec: 10240.1, 60 sec: 9898.7, 300 sec: 9872.1). Total num frames: 30744576. Throughput: 0: 9934.8. Samples: 30723268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:29:16,005][124505] Avg episode reward: [(0, '4497.514')] [2023-03-12 02:29:17,412][124793] Updated weights for policy 0, policy_version 60080 (0.0005) [2023-03-12 02:29:21,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9872.1). Total num frames: 30793728. Throughput: 0: 9991.6. Samples: 30781880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:29:21,016][124505] Avg episode reward: [(0, '4534.768')] [2023-03-12 02:29:21,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000060144_30793728.pth... [2023-03-12 02:29:21,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000059552_30490624.pth [2023-03-12 02:29:21,623][124793] Updated weights for policy 0, policy_version 60160 (0.0005) [2023-03-12 02:29:25,843][124793] Updated weights for policy 0, policy_version 60240 (0.0005) [2023-03-12 02:29:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9872.1). Total num frames: 30842880. Throughput: 0: 10040.5. Samples: 30840144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:29:26,016][124505] Avg episode reward: [(0, '4571.545')] [2023-03-12 02:29:30,102][124793] Updated weights for policy 0, policy_version 60320 (0.0005) [2023-03-12 02:29:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9858.2). Total num frames: 30892032. Throughput: 0: 10017.6. Samples: 30869116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:29:31,016][124505] Avg episode reward: [(0, '4554.962')] [2023-03-12 02:29:34,311][124793] Updated weights for policy 0, policy_version 60400 (0.0005) [2023-03-12 02:29:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9898.7, 300 sec: 9858.2). Total num frames: 30937088. Throughput: 0: 10020.3. Samples: 30927680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:29:36,016][124505] Avg episode reward: [(0, '4551.131')] [2023-03-12 02:29:36,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000060424_30937088.pth... [2023-03-12 02:29:36,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000059848_30642176.pth [2023-03-12 02:29:38,720][124793] Updated weights for policy 0, policy_version 60480 (0.0005) [2023-03-12 02:29:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9858.2). Total num frames: 30986240. Throughput: 0: 9926.0. Samples: 30984172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:29:41,016][124505] Avg episode reward: [(0, '4531.157')] [2023-03-12 02:29:42,788][124793] Updated weights for policy 0, policy_version 60560 (0.0004) [2023-03-12 02:29:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9858.2). Total num frames: 31035392. Throughput: 0: 9923.5. Samples: 31014920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:29:46,016][124505] Avg episode reward: [(0, '4497.822')] [2023-03-12 02:29:46,947][124793] Updated weights for policy 0, policy_version 60640 (0.0005) [2023-03-12 02:29:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9858.2). Total num frames: 31084544. Throughput: 0: 9838.3. Samples: 31072676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:29:51,016][124505] Avg episode reward: [(0, '4474.582')] [2023-03-12 02:29:51,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000060712_31084544.pth... [2023-03-12 02:29:51,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000060144_30793728.pth [2023-03-12 02:29:51,217][124793] Updated weights for policy 0, policy_version 60720 (0.0005) [2023-03-12 02:29:55,628][124793] Updated weights for policy 0, policy_version 60800 (0.0005) [2023-03-12 02:29:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9844.3). Total num frames: 31129600. Throughput: 0: 9737.2. Samples: 31129600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:29:56,005][124505] Avg episode reward: [(0, '4393.220')] [2023-03-12 02:30:00,026][124793] Updated weights for policy 0, policy_version 60880 (0.0005) [2023-03-12 02:30:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9830.4). Total num frames: 31178752. Throughput: 0: 9653.3. Samples: 31157668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:30:01,005][124505] Avg episode reward: [(0, '4346.676')] [2023-03-12 02:30:04,468][124793] Updated weights for policy 0, policy_version 60960 (0.0005) [2023-03-12 02:30:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9830.4). Total num frames: 31223808. Throughput: 0: 9571.2. Samples: 31212584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:30:06,005][124505] Avg episode reward: [(0, '4188.457')] [2023-03-12 02:30:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000060984_31223808.pth... [2023-03-12 02:30:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000060424_30937088.pth [2023-03-12 02:30:08,877][124793] Updated weights for policy 0, policy_version 61040 (0.0005) [2023-03-12 02:30:11,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9816.5). Total num frames: 31268864. Throughput: 0: 9527.1. Samples: 31268864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:30:11,005][124505] Avg episode reward: [(0, '4051.094')] [2023-03-12 02:30:13,285][124793] Updated weights for policy 0, policy_version 61120 (0.0005) [2023-03-12 02:30:16,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9788.7). Total num frames: 31313920. Throughput: 0: 9496.9. Samples: 31296476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:30:16,005][124505] Avg episode reward: [(0, '4271.271')] [2023-03-12 02:30:17,809][124793] Updated weights for policy 0, policy_version 61200 (0.0005) [2023-03-12 02:30:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9788.7). Total num frames: 31363072. Throughput: 0: 9411.6. Samples: 31351200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:30:21,005][124505] Avg episode reward: [(0, '4315.867')] [2023-03-12 02:30:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000061256_31363072.pth... [2023-03-12 02:30:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000060712_31084544.pth [2023-03-12 02:30:22,163][124793] Updated weights for policy 0, policy_version 61280 (0.0005) [2023-03-12 02:30:26,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9774.9). Total num frames: 31408128. Throughput: 0: 9422.7. Samples: 31408192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:30:26,005][124505] Avg episode reward: [(0, '4533.406')] [2023-03-12 02:30:26,484][124793] Updated weights for policy 0, policy_version 61360 (0.0005) [2023-03-12 02:30:30,873][124793] Updated weights for policy 0, policy_version 61440 (0.0004) [2023-03-12 02:30:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9774.9). Total num frames: 31457280. Throughput: 0: 9375.1. Samples: 31436800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:30:31,005][124505] Avg episode reward: [(0, '4431.374')] [2023-03-12 02:30:35,374][124793] Updated weights for policy 0, policy_version 61520 (0.0005) [2023-03-12 02:30:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9761.0). Total num frames: 31502336. Throughput: 0: 9293.7. Samples: 31490892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:30:36,005][124505] Avg episode reward: [(0, '4426.427')] [2023-03-12 02:30:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000061528_31502336.pth... [2023-03-12 02:30:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000060984_31223808.pth [2023-03-12 02:30:39,767][124793] Updated weights for policy 0, policy_version 61600 (0.0005) [2023-03-12 02:30:41,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9761.0). Total num frames: 31547392. Throughput: 0: 9284.3. Samples: 31547392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:30:41,005][124505] Avg episode reward: [(0, '4554.386')] [2023-03-12 02:30:44,061][124793] Updated weights for policy 0, policy_version 61680 (0.0005) [2023-03-12 02:30:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9761.0). Total num frames: 31596544. Throughput: 0: 9298.0. Samples: 31576076. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:30:46,005][124505] Avg episode reward: [(0, '4556.925')] [2023-03-12 02:30:48,480][124793] Updated weights for policy 0, policy_version 61760 (0.0005) [2023-03-12 02:30:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9747.1). Total num frames: 31641600. Throughput: 0: 9312.4. Samples: 31631640. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:30:51,005][124505] Avg episode reward: [(0, '4543.352')] [2023-03-12 02:30:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000061800_31641600.pth... [2023-03-12 02:30:51,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000061256_31363072.pth [2023-03-12 02:30:52,822][124793] Updated weights for policy 0, policy_version 61840 (0.0005) [2023-03-12 02:30:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9747.1). Total num frames: 31690752. Throughput: 0: 9316.6. Samples: 31688112. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:30:56,005][124505] Avg episode reward: [(0, '4506.176')] [2023-03-12 02:30:57,081][124793] Updated weights for policy 0, policy_version 61920 (0.0005) [2023-03-12 02:31:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9747.1). Total num frames: 31739904. Throughput: 0: 9373.8. Samples: 31718296. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:31:01,005][124505] Avg episode reward: [(0, '4571.372')] [2023-03-12 02:31:01,111][124793] Updated weights for policy 0, policy_version 62000 (0.0005) [2023-03-12 02:31:05,119][124793] Updated weights for policy 0, policy_version 62080 (0.0004) [2023-03-12 02:31:06,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9489.1, 300 sec: 9761.0). Total num frames: 31793152. Throughput: 0: 9515.2. Samples: 31779384. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:31:06,006][124505] Avg episode reward: [(0, '4465.075')] [2023-03-12 02:31:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000062096_31793152.pth... [2023-03-12 02:31:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000061528_31502336.pth [2023-03-12 02:31:09,408][124793] Updated weights for policy 0, policy_version 62160 (0.0005) [2023-03-12 02:31:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9747.1). Total num frames: 31838208. Throughput: 0: 9535.7. Samples: 31837300. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:31:11,005][124505] Avg episode reward: [(0, '4475.377')] [2023-03-12 02:31:13,764][124793] Updated weights for policy 0, policy_version 62240 (0.0005) [2023-03-12 02:31:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9761.0). Total num frames: 31887360. Throughput: 0: 9524.9. Samples: 31865420. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:31:16,005][124505] Avg episode reward: [(0, '4559.368')] [2023-03-12 02:31:18,043][124793] Updated weights for policy 0, policy_version 62320 (0.0005) [2023-03-12 02:31:21,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9747.1). Total num frames: 31932416. Throughput: 0: 9605.9. Samples: 31923160. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:31:21,005][124505] Avg episode reward: [(0, '4570.687')] [2023-03-12 02:31:21,022][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000062376_31936512.pth... [2023-03-12 02:31:21,023][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000061800_31641600.pth [2023-03-12 02:31:22,299][124793] Updated weights for policy 0, policy_version 62400 (0.0005) [2023-03-12 02:31:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9747.1). Total num frames: 31981568. Throughput: 0: 9606.2. Samples: 31979672. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:31:26,005][124505] Avg episode reward: [(0, '4568.456')] [2023-03-12 02:31:26,632][124793] Updated weights for policy 0, policy_version 62480 (0.0005) [2023-03-12 02:31:30,934][124793] Updated weights for policy 0, policy_version 62560 (0.0005) [2023-03-12 02:31:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9557.3, 300 sec: 9747.1). Total num frames: 32030720. Throughput: 0: 9604.2. Samples: 32008264. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:31:31,005][124505] Avg episode reward: [(0, '4576.602')] [2023-03-12 02:31:35,220][124793] Updated weights for policy 0, policy_version 62640 (0.0005) [2023-03-12 02:31:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9719.3). Total num frames: 32075776. Throughput: 0: 9648.8. Samples: 32065836. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:31:36,006][124505] Avg episode reward: [(0, '4524.764')] [2023-03-12 02:31:36,061][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000062656_32079872.pth... [2023-03-12 02:31:36,064][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000062096_31793152.pth [2023-03-12 02:31:39,461][124793] Updated weights for policy 0, policy_version 62720 (0.0005) [2023-03-12 02:31:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9705.4). Total num frames: 32124928. Throughput: 0: 9680.1. Samples: 32123716. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:31:41,005][124505] Avg episode reward: [(0, '4571.333')] [2023-03-12 02:31:43,747][124793] Updated weights for policy 0, policy_version 62800 (0.0005) [2023-03-12 02:31:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9705.4). Total num frames: 32174080. Throughput: 0: 9644.4. Samples: 32152292. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:31:46,005][124505] Avg episode reward: [(0, '4578.782')] [2023-03-12 02:31:48,000][124793] Updated weights for policy 0, policy_version 62880 (0.0005) [2023-03-12 02:31:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9691.6). Total num frames: 32223232. Throughput: 0: 9585.4. Samples: 32210724. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:31:51,005][124505] Avg episode reward: [(0, '4570.577')] [2023-03-12 02:31:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000062936_32223232.pth... [2023-03-12 02:31:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000062376_31936512.pth [2023-03-12 02:31:52,171][124793] Updated weights for policy 0, policy_version 62960 (0.0005) [2023-03-12 02:31:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9705.4). Total num frames: 32272384. Throughput: 0: 9581.4. Samples: 32268464. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:31:56,005][124505] Avg episode reward: [(0, '4514.699')] [2023-03-12 02:31:56,389][124793] Updated weights for policy 0, policy_version 63040 (0.0005) [2023-03-12 02:32:00,656][124793] Updated weights for policy 0, policy_version 63120 (0.0005) [2023-03-12 02:32:01,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9677.7). Total num frames: 32317440. Throughput: 0: 9606.2. Samples: 32297700. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:32:01,005][124505] Avg episode reward: [(0, '4377.453')] [2023-03-12 02:32:04,856][124793] Updated weights for policy 0, policy_version 63200 (0.0005) [2023-03-12 02:32:06,005][124505] Fps is (10 sec: 9420.6, 60 sec: 9557.3, 300 sec: 9691.5). Total num frames: 32366592. Throughput: 0: 9612.7. Samples: 32355732. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:32:06,006][124505] Avg episode reward: [(0, '4584.260')] [2023-03-12 02:32:06,068][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000063224_32370688.pth... [2023-03-12 02:32:06,070][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000062656_32079872.pth [2023-03-12 02:32:09,012][124793] Updated weights for policy 0, policy_version 63280 (0.0005) [2023-03-12 02:32:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9691.6). Total num frames: 32415744. Throughput: 0: 9674.8. Samples: 32415036. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:32:11,006][124505] Avg episode reward: [(0, '4523.296')] [2023-03-12 02:32:13,338][124793] Updated weights for policy 0, policy_version 63360 (0.0005) [2023-03-12 02:32:16,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9677.7). Total num frames: 32464896. Throughput: 0: 9663.7. Samples: 32443132. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:32:16,005][124505] Avg episode reward: [(0, '4425.749')] [2023-03-12 02:32:17,594][124793] Updated weights for policy 0, policy_version 63440 (0.0005) [2023-03-12 02:32:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9663.8). Total num frames: 32509952. Throughput: 0: 9645.8. Samples: 32499896. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:32:21,005][124505] Avg episode reward: [(0, '4423.583')] [2023-03-12 02:32:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000063496_32509952.pth... [2023-03-12 02:32:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000062936_32223232.pth [2023-03-12 02:32:21,949][124793] Updated weights for policy 0, policy_version 63520 (0.0005) [2023-03-12 02:32:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9649.9). Total num frames: 32559104. Throughput: 0: 9642.0. Samples: 32557608. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:32:26,005][124505] Avg episode reward: [(0, '4379.690')] [2023-03-12 02:32:26,195][124793] Updated weights for policy 0, policy_version 63600 (0.0005) [2023-03-12 02:32:30,573][124793] Updated weights for policy 0, policy_version 63680 (0.0005) [2023-03-12 02:32:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9649.9). Total num frames: 32608256. Throughput: 0: 9628.3. Samples: 32585568. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:32:31,005][124505] Avg episode reward: [(0, '4361.884')] [2023-03-12 02:32:34,519][124793] Updated weights for policy 0, policy_version 63760 (0.0004) [2023-03-12 02:32:36,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9649.9). Total num frames: 32657408. Throughput: 0: 9662.8. Samples: 32645552. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:32:36,006][124505] Avg episode reward: [(0, '4466.262')] [2023-03-12 02:32:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000063784_32657408.pth... [2023-03-12 02:32:36,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000063224_32370688.pth [2023-03-12 02:32:38,545][124793] Updated weights for policy 0, policy_version 63840 (0.0005) [2023-03-12 02:32:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9663.8). Total num frames: 32706560. Throughput: 0: 9733.6. Samples: 32706476. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:32:41,005][124505] Avg episode reward: [(0, '4437.522')] [2023-03-12 02:32:42,733][124793] Updated weights for policy 0, policy_version 63920 (0.0005) [2023-03-12 02:32:46,005][124505] Fps is (10 sec: 10240.1, 60 sec: 9762.1, 300 sec: 9663.8). Total num frames: 32759808. Throughput: 0: 9728.0. Samples: 32735460. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:32:46,005][124505] Avg episode reward: [(0, '3926.476')] [2023-03-12 02:32:46,667][124793] Updated weights for policy 0, policy_version 64000 (0.0005) [2023-03-12 02:32:50,663][124793] Updated weights for policy 0, policy_version 64080 (0.0005) [2023-03-12 02:32:51,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9677.7). Total num frames: 32808960. Throughput: 0: 9817.6. Samples: 32797524. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:32:51,005][124505] Avg episode reward: [(0, '4467.292')] [2023-03-12 02:32:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000064080_32808960.pth... [2023-03-12 02:32:51,009][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000063496_32509952.pth [2023-03-12 02:32:54,715][124793] Updated weights for policy 0, policy_version 64160 (0.0005) [2023-03-12 02:32:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9691.6). Total num frames: 32862208. Throughput: 0: 9870.0. Samples: 32859184. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:32:56,005][124505] Avg episode reward: [(0, '4273.204')] [2023-03-12 02:32:58,685][124793] Updated weights for policy 0, policy_version 64240 (0.0005) [2023-03-12 02:33:01,005][124505] Fps is (10 sec: 10240.1, 60 sec: 9898.7, 300 sec: 9691.6). Total num frames: 32911360. Throughput: 0: 9933.2. Samples: 32890124. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:33:01,005][124505] Avg episode reward: [(0, '4561.596')] [2023-03-12 02:33:02,780][124793] Updated weights for policy 0, policy_version 64320 (0.0005) [2023-03-12 02:33:06,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9691.6). Total num frames: 32960512. Throughput: 0: 10004.5. Samples: 32950096. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:33:06,005][124505] Avg episode reward: [(0, '4578.422')] [2023-03-12 02:33:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000064376_32960512.pth... [2023-03-12 02:33:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000063784_32657408.pth [2023-03-12 02:33:06,909][124793] Updated weights for policy 0, policy_version 64400 (0.0006) [2023-03-12 02:33:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9691.6). Total num frames: 33009664. Throughput: 0: 10027.6. Samples: 33008848. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:33:11,005][124505] Avg episode reward: [(0, '4573.418')] [2023-03-12 02:33:11,135][124793] Updated weights for policy 0, policy_version 64480 (0.0005) [2023-03-12 02:33:15,234][124793] Updated weights for policy 0, policy_version 64560 (0.0005) [2023-03-12 02:33:16,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9691.6). Total num frames: 33058816. Throughput: 0: 10061.7. Samples: 33038344. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:33:16,005][124505] Avg episode reward: [(0, '4590.117')] [2023-03-12 02:33:19,237][124793] Updated weights for policy 0, policy_version 64640 (0.0005) [2023-03-12 02:33:21,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9705.4). Total num frames: 33112064. Throughput: 0: 10091.5. Samples: 33099668. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:33:21,005][124505] Avg episode reward: [(0, '4577.128')] [2023-03-12 02:33:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000064672_33112064.pth... [2023-03-12 02:33:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000064080_32808960.pth [2023-03-12 02:33:23,075][124793] Updated weights for policy 0, policy_version 64720 (0.0005) [2023-03-12 02:33:26,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10103.5, 300 sec: 9719.3). Total num frames: 33165312. Throughput: 0: 10174.3. Samples: 33164320. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:33:26,005][124505] Avg episode reward: [(0, '4565.700')] [2023-03-12 02:33:26,872][124793] Updated weights for policy 0, policy_version 64800 (0.0004) [2023-03-12 02:33:30,701][124793] Updated weights for policy 0, policy_version 64880 (0.0004) [2023-03-12 02:33:31,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10171.7, 300 sec: 9747.1). Total num frames: 33218560. Throughput: 0: 10230.3. Samples: 33195824. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:33:31,005][124505] Avg episode reward: [(0, '4552.876')] [2023-03-12 02:33:34,662][124793] Updated weights for policy 0, policy_version 64960 (0.0005) [2023-03-12 02:33:36,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10240.0, 300 sec: 9761.0). Total num frames: 33271808. Throughput: 0: 10260.0. Samples: 33259224. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:33:36,005][124505] Avg episode reward: [(0, '4507.077')] [2023-03-12 02:33:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000064984_33271808.pth... [2023-03-12 02:33:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000064376_32960512.pth [2023-03-12 02:33:38,383][124793] Updated weights for policy 0, policy_version 65040 (0.0005) [2023-03-12 02:33:41,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10308.3, 300 sec: 9788.7). Total num frames: 33325056. Throughput: 0: 10342.1. Samples: 33324580. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:33:41,005][124505] Avg episode reward: [(0, '4577.720')] [2023-03-12 02:33:42,138][124793] Updated weights for policy 0, policy_version 65120 (0.0004) [2023-03-12 02:33:45,861][124793] Updated weights for policy 0, policy_version 65200 (0.0004) [2023-03-12 02:33:46,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10376.5, 300 sec: 9802.6). Total num frames: 33382400. Throughput: 0: 10393.3. Samples: 33357824. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:33:46,005][124505] Avg episode reward: [(0, '4581.189')] [2023-03-12 02:33:49,720][124793] Updated weights for policy 0, policy_version 65280 (0.0005) [2023-03-12 02:33:51,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10444.8, 300 sec: 9816.5). Total num frames: 33435648. Throughput: 0: 10488.6. Samples: 33422084. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:33:51,005][124505] Avg episode reward: [(0, '4569.141')] [2023-03-12 02:33:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000065304_33435648.pth... [2023-03-12 02:33:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000064672_33112064.pth [2023-03-12 02:33:53,546][124793] Updated weights for policy 0, policy_version 65360 (0.0004) [2023-03-12 02:33:56,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10444.8, 300 sec: 9816.5). Total num frames: 33488896. Throughput: 0: 10590.1. Samples: 33485404. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:33:56,005][124505] Avg episode reward: [(0, '4587.551')] [2023-03-12 02:33:57,429][124793] Updated weights for policy 0, policy_version 65440 (0.0005) [2023-03-12 02:34:01,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10513.1, 300 sec: 9830.4). Total num frames: 33542144. Throughput: 0: 10649.6. Samples: 33517576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:34:01,005][124505] Avg episode reward: [(0, '4587.833')] [2023-03-12 02:34:01,381][124793] Updated weights for policy 0, policy_version 65520 (0.0005) [2023-03-12 02:34:05,404][124793] Updated weights for policy 0, policy_version 65600 (0.0005) [2023-03-12 02:34:06,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10513.1, 300 sec: 9816.5). Total num frames: 33591296. Throughput: 0: 10653.6. Samples: 33579080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:34:06,005][124505] Avg episode reward: [(0, '4583.684')] [2023-03-12 02:34:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000065608_33591296.pth... [2023-03-12 02:34:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000064984_33271808.pth [2023-03-12 02:34:09,566][124793] Updated weights for policy 0, policy_version 65680 (0.0005) [2023-03-12 02:34:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10513.1, 300 sec: 9816.5). Total num frames: 33640448. Throughput: 0: 10528.6. Samples: 33638108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:34:11,005][124505] Avg episode reward: [(0, '4581.949')] [2023-03-12 02:34:13,795][124793] Updated weights for policy 0, policy_version 65760 (0.0005) [2023-03-12 02:34:16,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10513.1, 300 sec: 9816.5). Total num frames: 33689600. Throughput: 0: 10479.1. Samples: 33667384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:34:16,005][124505] Avg episode reward: [(0, '4595.229')] [2023-03-12 02:34:17,930][124793] Updated weights for policy 0, policy_version 65840 (0.0005) [2023-03-12 02:34:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10444.8, 300 sec: 9816.5). Total num frames: 33738752. Throughput: 0: 10399.4. Samples: 33727196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:34:21,005][124505] Avg episode reward: [(0, '4588.914')] [2023-03-12 02:34:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000065896_33738752.pth... [2023-03-12 02:34:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000065304_33435648.pth [2023-03-12 02:34:21,970][124793] Updated weights for policy 0, policy_version 65920 (0.0005) [2023-03-12 02:34:26,005][124505] Fps is (10 sec: 9830.3, 60 sec: 10376.5, 300 sec: 9816.5). Total num frames: 33787904. Throughput: 0: 10270.0. Samples: 33786728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:34:26,005][124505] Avg episode reward: [(0, '4566.464')] [2023-03-12 02:34:26,145][124793] Updated weights for policy 0, policy_version 66000 (0.0005) [2023-03-12 02:34:30,335][124793] Updated weights for policy 0, policy_version 66080 (0.0005) [2023-03-12 02:34:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10308.3, 300 sec: 9830.4). Total num frames: 33837056. Throughput: 0: 10189.4. Samples: 33816348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:34:31,005][124505] Avg episode reward: [(0, '4595.905')] [2023-03-12 02:34:34,456][124793] Updated weights for policy 0, policy_version 66160 (0.0005) [2023-03-12 02:34:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10240.0, 300 sec: 9830.4). Total num frames: 33886208. Throughput: 0: 10069.2. Samples: 33875200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:34:36,005][124505] Avg episode reward: [(0, '4597.118')] [2023-03-12 02:34:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000066184_33886208.pth... [2023-03-12 02:34:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000065608_33591296.pth [2023-03-12 02:34:38,599][124793] Updated weights for policy 0, policy_version 66240 (0.0005) [2023-03-12 02:34:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 9830.4). Total num frames: 33935360. Throughput: 0: 9999.0. Samples: 33935360. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:34:41,005][124505] Avg episode reward: [(0, '4559.317')] [2023-03-12 02:34:42,732][124793] Updated weights for policy 0, policy_version 66320 (0.0005) [2023-03-12 02:34:46,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9844.3). Total num frames: 33988608. Throughput: 0: 9929.1. Samples: 33964384. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:34:46,005][124505] Avg episode reward: [(0, '4582.943')] [2023-03-12 02:34:46,740][124793] Updated weights for policy 0, policy_version 66400 (0.0005) [2023-03-12 02:34:50,728][124793] Updated weights for policy 0, policy_version 66480 (0.0005) [2023-03-12 02:34:51,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9858.2). Total num frames: 34037760. Throughput: 0: 9937.0. Samples: 34026244. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:34:51,005][124505] Avg episode reward: [(0, '4539.236')] [2023-03-12 02:34:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000066480_34037760.pth... [2023-03-12 02:34:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000065896_33738752.pth [2023-03-12 02:34:54,647][124793] Updated weights for policy 0, policy_version 66560 (0.0005) [2023-03-12 02:34:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9872.1). Total num frames: 34091008. Throughput: 0: 10002.4. Samples: 34088216. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:34:56,005][124505] Avg episode reward: [(0, '4586.651')] [2023-03-12 02:34:58,545][124793] Updated weights for policy 0, policy_version 66640 (0.0003) [2023-03-12 02:35:01,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10035.2, 300 sec: 9899.8). Total num frames: 34144256. Throughput: 0: 10053.1. Samples: 34119776. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:35:01,005][124505] Avg episode reward: [(0, '4538.087')] [2023-03-12 02:35:02,551][124793] Updated weights for policy 0, policy_version 66720 (0.0004) [2023-03-12 02:35:06,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9913.7). Total num frames: 34193408. Throughput: 0: 10087.2. Samples: 34181120. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:35:06,005][124505] Avg episode reward: [(0, '4582.431')] [2023-03-12 02:35:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000066784_34193408.pth... [2023-03-12 02:35:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000066184_33886208.pth [2023-03-12 02:35:06,795][124793] Updated weights for policy 0, policy_version 66800 (0.0005) [2023-03-12 02:35:11,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9967.0, 300 sec: 9913.7). Total num frames: 34238464. Throughput: 0: 10038.2. Samples: 34238448. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:35:11,005][124505] Avg episode reward: [(0, '4601.514')] [2023-03-12 02:35:11,068][124793] Updated weights for policy 0, policy_version 66880 (0.0005) [2023-03-12 02:35:15,171][124793] Updated weights for policy 0, policy_version 66960 (0.0005) [2023-03-12 02:35:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 34291712. Throughput: 0: 10035.1. Samples: 34267928. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:35:16,005][124505] Avg episode reward: [(0, '4556.280')] [2023-03-12 02:35:19,152][124793] Updated weights for policy 0, policy_version 67040 (0.0005) [2023-03-12 02:35:21,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 34340864. Throughput: 0: 10077.3. Samples: 34328680. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:35:21,005][124505] Avg episode reward: [(0, '4598.214')] [2023-03-12 02:35:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000067072_34340864.pth... [2023-03-12 02:35:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000066480_34037760.pth [2023-03-12 02:35:23,200][124793] Updated weights for policy 0, policy_version 67120 (0.0004) [2023-03-12 02:35:26,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 9955.4). Total num frames: 34394112. Throughput: 0: 10114.6. Samples: 34390516. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:35:26,016][124505] Avg episode reward: [(0, '4607.261')] [2023-03-12 02:35:26,017][124749] Saving new best policy, reward=4607.261! [2023-03-12 02:35:27,123][124793] Updated weights for policy 0, policy_version 67200 (0.0004) [2023-03-12 02:35:31,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 9969.3). Total num frames: 34443264. Throughput: 0: 10146.3. Samples: 34420968. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:35:31,016][124505] Avg episode reward: [(0, '4579.794')] [2023-03-12 02:35:31,128][124793] Updated weights for policy 0, policy_version 67280 (0.0005) [2023-03-12 02:35:35,092][124793] Updated weights for policy 0, policy_version 67360 (0.0005) [2023-03-12 02:35:36,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10171.7, 300 sec: 9997.0). Total num frames: 34496512. Throughput: 0: 10166.4. Samples: 34483732. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:35:36,007][124505] Avg episode reward: [(0, '4590.541')] [2023-03-12 02:35:36,010][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000067376_34496512.pth... [2023-03-12 02:35:36,013][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000066784_34193408.pth [2023-03-12 02:35:38,991][124793] Updated weights for policy 0, policy_version 67440 (0.0004) [2023-03-12 02:35:41,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10240.0, 300 sec: 10010.9). Total num frames: 34549760. Throughput: 0: 10167.1. Samples: 34545736. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:35:41,016][124505] Avg episode reward: [(0, '4595.648')] [2023-03-12 02:35:42,922][124793] Updated weights for policy 0, policy_version 67520 (0.0004) [2023-03-12 02:35:46,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 10024.8). Total num frames: 34598912. Throughput: 0: 10169.1. Samples: 34577388. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:35:46,005][124505] Avg episode reward: [(0, '4536.731')] [2023-03-12 02:35:46,937][124793] Updated weights for policy 0, policy_version 67600 (0.0005) [2023-03-12 02:35:50,973][124793] Updated weights for policy 0, policy_version 67680 (0.0005) [2023-03-12 02:35:51,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10240.0, 300 sec: 10038.7). Total num frames: 34652160. Throughput: 0: 10161.3. Samples: 34638380. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:35:51,006][124505] Avg episode reward: [(0, '4597.017')] [2023-03-12 02:35:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000067680_34652160.pth... [2023-03-12 02:35:51,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000067072_34340864.pth [2023-03-12 02:35:54,826][124793] Updated weights for policy 0, policy_version 67760 (0.0004) [2023-03-12 02:35:56,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10240.0, 300 sec: 10052.6). Total num frames: 34705408. Throughput: 0: 10287.3. Samples: 34701376. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:35:56,005][124505] Avg episode reward: [(0, '4513.838')] [2023-03-12 02:35:58,558][124793] Updated weights for policy 0, policy_version 67840 (0.0003) [2023-03-12 02:36:01,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10240.0, 300 sec: 10052.6). Total num frames: 34758656. Throughput: 0: 10360.5. Samples: 34734152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:36:01,005][124505] Avg episode reward: [(0, '4527.346')] [2023-03-12 02:36:02,274][124793] Updated weights for policy 0, policy_version 67920 (0.0004) [2023-03-12 02:36:06,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10308.3, 300 sec: 10080.3). Total num frames: 34811904. Throughput: 0: 10465.2. Samples: 34799616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:36:06,005][124505] Avg episode reward: [(0, '4592.242')] [2023-03-12 02:36:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000067992_34811904.pth... [2023-03-12 02:36:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000067376_34496512.pth [2023-03-12 02:36:06,141][124793] Updated weights for policy 0, policy_version 68000 (0.0004) [2023-03-12 02:36:09,916][124793] Updated weights for policy 0, policy_version 68080 (0.0004) [2023-03-12 02:36:11,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10444.8, 300 sec: 10094.2). Total num frames: 34865152. Throughput: 0: 10524.4. Samples: 34864112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:36:11,005][124505] Avg episode reward: [(0, '4592.893')] [2023-03-12 02:36:13,784][124793] Updated weights for policy 0, policy_version 68160 (0.0004) [2023-03-12 02:36:16,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10444.8, 300 sec: 10122.0). Total num frames: 34918400. Throughput: 0: 10551.5. Samples: 34895788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:36:16,005][124505] Avg episode reward: [(0, '4601.637')] [2023-03-12 02:36:17,707][124793] Updated weights for policy 0, policy_version 68240 (0.0003) [2023-03-12 02:36:21,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10513.1, 300 sec: 10135.9). Total num frames: 34971648. Throughput: 0: 10551.5. Samples: 34958548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:36:21,006][124505] Avg episode reward: [(0, '4588.775')] [2023-03-12 02:36:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000068304_34971648.pth... [2023-03-12 02:36:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000067680_34652160.pth [2023-03-12 02:36:21,757][124793] Updated weights for policy 0, policy_version 68320 (0.0003) [2023-03-12 02:36:25,608][124793] Updated weights for policy 0, policy_version 68400 (0.0003) [2023-03-12 02:36:26,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10513.1, 300 sec: 10149.7). Total num frames: 35024896. Throughput: 0: 10557.3. Samples: 35020816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:36:26,005][124505] Avg episode reward: [(0, '4566.079')] [2023-03-12 02:36:29,501][124793] Updated weights for policy 0, policy_version 68480 (0.0003) [2023-03-12 02:36:31,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10513.1, 300 sec: 10163.6). Total num frames: 35074048. Throughput: 0: 10549.7. Samples: 35052124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:36:31,005][124505] Avg episode reward: [(0, '4540.658')] [2023-03-12 02:36:33,349][124793] Updated weights for policy 0, policy_version 68560 (0.0003) [2023-03-12 02:36:36,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10581.3, 300 sec: 10191.4). Total num frames: 35131392. Throughput: 0: 10612.6. Samples: 35115948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:36:36,005][124505] Avg episode reward: [(0, '4593.453')] [2023-03-12 02:36:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000068616_35131392.pth... [2023-03-12 02:36:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000067992_34811904.pth [2023-03-12 02:36:37,198][124793] Updated weights for policy 0, policy_version 68640 (0.0004) [2023-03-12 02:36:41,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10513.1, 300 sec: 10191.4). Total num frames: 35180544. Throughput: 0: 10634.0. Samples: 35179904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:36:41,005][124505] Avg episode reward: [(0, '4599.173')] [2023-03-12 02:36:41,048][124793] Updated weights for policy 0, policy_version 68720 (0.0003) [2023-03-12 02:36:44,772][124793] Updated weights for policy 0, policy_version 68800 (0.0004) [2023-03-12 02:36:46,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10649.6, 300 sec: 10219.2). Total num frames: 35237888. Throughput: 0: 10635.5. Samples: 35212748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:36:46,005][124505] Avg episode reward: [(0, '4597.252')] [2023-03-12 02:36:48,758][124793] Updated weights for policy 0, policy_version 68880 (0.0005) [2023-03-12 02:36:51,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10581.3, 300 sec: 10219.2). Total num frames: 35287040. Throughput: 0: 10573.9. Samples: 35275440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:36:51,006][124505] Avg episode reward: [(0, '4561.595')] [2023-03-12 02:36:51,035][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000068928_35291136.pth... [2023-03-12 02:36:51,037][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000068304_34971648.pth [2023-03-12 02:36:52,601][124793] Updated weights for policy 0, policy_version 68960 (0.0006) [2023-03-12 02:36:56,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10581.3, 300 sec: 10246.9). Total num frames: 35340288. Throughput: 0: 10557.3. Samples: 35339192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:36:56,005][124505] Avg episode reward: [(0, '4603.132')] [2023-03-12 02:36:56,536][124793] Updated weights for policy 0, policy_version 69040 (0.0005) [2023-03-12 02:37:00,278][124793] Updated weights for policy 0, policy_version 69120 (0.0004) [2023-03-12 02:37:01,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10581.3, 300 sec: 10260.8). Total num frames: 35393536. Throughput: 0: 10562.2. Samples: 35371088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:37:01,005][124505] Avg episode reward: [(0, '4598.781')] [2023-03-12 02:37:04,060][124793] Updated weights for policy 0, policy_version 69200 (0.0005) [2023-03-12 02:37:06,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10649.6, 300 sec: 10288.6). Total num frames: 35450880. Throughput: 0: 10602.1. Samples: 35435644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:37:06,005][124505] Avg episode reward: [(0, '4566.761')] [2023-03-12 02:37:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000069240_35450880.pth... [2023-03-12 02:37:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000068616_35131392.pth [2023-03-12 02:37:07,908][124793] Updated weights for policy 0, policy_version 69280 (0.0005) [2023-03-12 02:37:11,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10649.6, 300 sec: 10302.5). Total num frames: 35504128. Throughput: 0: 10650.8. Samples: 35500104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:37:11,005][124505] Avg episode reward: [(0, '4566.815')] [2023-03-12 02:37:11,704][124793] Updated weights for policy 0, policy_version 69360 (0.0005) [2023-03-12 02:37:15,718][124793] Updated weights for policy 0, policy_version 69440 (0.0005) [2023-03-12 02:37:16,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10581.3, 300 sec: 10316.4). Total num frames: 35553280. Throughput: 0: 10665.8. Samples: 35532084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:37:16,005][124505] Avg episode reward: [(0, '4599.859')] [2023-03-12 02:37:19,765][124793] Updated weights for policy 0, policy_version 69520 (0.0005) [2023-03-12 02:37:21,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10581.3, 300 sec: 10330.2). Total num frames: 35606528. Throughput: 0: 10585.6. Samples: 35592300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:37:21,005][124505] Avg episode reward: [(0, '4609.979')] [2023-03-12 02:37:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000069544_35606528.pth... [2023-03-12 02:37:21,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000068928_35291136.pth [2023-03-12 02:37:21,010][124749] Saving new best policy, reward=4609.979! [2023-03-12 02:37:23,761][124793] Updated weights for policy 0, policy_version 69600 (0.0005) [2023-03-12 02:37:26,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10513.1, 300 sec: 10330.3). Total num frames: 35655680. Throughput: 0: 10524.5. Samples: 35653504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:37:26,005][124505] Avg episode reward: [(0, '4607.712')] [2023-03-12 02:37:27,793][124793] Updated weights for policy 0, policy_version 69680 (0.0005) [2023-03-12 02:37:31,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10581.3, 300 sec: 10344.1). Total num frames: 35708928. Throughput: 0: 10480.4. Samples: 35684364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:37:31,005][124505] Avg episode reward: [(0, '4598.900')] [2023-03-12 02:37:31,788][124793] Updated weights for policy 0, policy_version 69760 (0.0006) [2023-03-12 02:37:35,756][124793] Updated weights for policy 0, policy_version 69840 (0.0005) [2023-03-12 02:37:36,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10444.8, 300 sec: 10344.1). Total num frames: 35758080. Throughput: 0: 10453.9. Samples: 35745864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:37:36,005][124505] Avg episode reward: [(0, '4593.493')] [2023-03-12 02:37:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000069840_35758080.pth... [2023-03-12 02:37:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000069240_35450880.pth [2023-03-12 02:37:39,782][124793] Updated weights for policy 0, policy_version 69920 (0.0005) [2023-03-12 02:37:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10444.8, 300 sec: 10330.3). Total num frames: 35807232. Throughput: 0: 10401.1. Samples: 35807240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:37:41,005][124505] Avg episode reward: [(0, '4596.147')] [2023-03-12 02:37:43,867][124793] Updated weights for policy 0, policy_version 70000 (0.0005) [2023-03-12 02:37:46,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10376.5, 300 sec: 10344.1). Total num frames: 35860480. Throughput: 0: 10353.8. Samples: 35837008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:37:46,005][124505] Avg episode reward: [(0, '4598.232')] [2023-03-12 02:37:48,002][124793] Updated weights for policy 0, policy_version 70080 (0.0005) [2023-03-12 02:37:51,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10376.5, 300 sec: 10330.2). Total num frames: 35909632. Throughput: 0: 10251.5. Samples: 35896960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:37:51,005][124505] Avg episode reward: [(0, '4602.722')] [2023-03-12 02:37:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000070136_35909632.pth... [2023-03-12 02:37:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000069544_35606528.pth [2023-03-12 02:37:52,097][124793] Updated weights for policy 0, policy_version 70160 (0.0005) [2023-03-12 02:37:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10308.3, 300 sec: 10330.2). Total num frames: 35958784. Throughput: 0: 10156.8. Samples: 35957160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:37:56,005][124505] Avg episode reward: [(0, '4596.514')] [2023-03-12 02:37:56,177][124793] Updated weights for policy 0, policy_version 70240 (0.0005) [2023-03-12 02:38:00,273][124793] Updated weights for policy 0, policy_version 70320 (0.0005) [2023-03-12 02:38:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10240.0, 300 sec: 10330.3). Total num frames: 36007936. Throughput: 0: 10116.9. Samples: 35987344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:38:01,005][124505] Avg episode reward: [(0, '4606.982')] [2023-03-12 02:38:04,337][124793] Updated weights for policy 0, policy_version 70400 (0.0005) [2023-03-12 02:38:06,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 10344.1). Total num frames: 36061184. Throughput: 0: 10119.0. Samples: 36047656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:38:06,005][124505] Avg episode reward: [(0, '4604.977')] [2023-03-12 02:38:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000070432_36061184.pth... [2023-03-12 02:38:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000069840_35758080.pth [2023-03-12 02:38:08,392][124793] Updated weights for policy 0, policy_version 70480 (0.0005) [2023-03-12 02:38:11,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10344.1). Total num frames: 36110336. Throughput: 0: 10088.3. Samples: 36107476. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:38:11,005][124505] Avg episode reward: [(0, '4603.046')] [2023-03-12 02:38:12,454][124793] Updated weights for policy 0, policy_version 70560 (0.0005) [2023-03-12 02:38:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 10330.3). Total num frames: 36159488. Throughput: 0: 10097.1. Samples: 36138736. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:38:16,007][124505] Avg episode reward: [(0, '4599.988')] [2023-03-12 02:38:16,500][124793] Updated weights for policy 0, policy_version 70640 (0.0005) [2023-03-12 02:38:20,685][124793] Updated weights for policy 0, policy_version 70720 (0.0005) [2023-03-12 02:38:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10316.4). Total num frames: 36208640. Throughput: 0: 10050.6. Samples: 36198140. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:38:21,005][124505] Avg episode reward: [(0, '4608.780')] [2023-03-12 02:38:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000070720_36208640.pth... [2023-03-12 02:38:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000070136_35909632.pth [2023-03-12 02:38:24,696][124793] Updated weights for policy 0, policy_version 70800 (0.0005) [2023-03-12 02:38:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10316.4). Total num frames: 36261888. Throughput: 0: 10023.1. Samples: 36258280. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:38:26,005][124505] Avg episode reward: [(0, '4602.020')] [2023-03-12 02:38:28,830][124793] Updated weights for policy 0, policy_version 70880 (0.0005) [2023-03-12 02:38:31,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10302.5). Total num frames: 36311040. Throughput: 0: 10026.5. Samples: 36288200. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:38:31,005][124505] Avg episode reward: [(0, '4606.466')] [2023-03-12 02:38:33,000][124793] Updated weights for policy 0, policy_version 70960 (0.0005) [2023-03-12 02:38:36,005][124505] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 10288.6). Total num frames: 36360192. Throughput: 0: 10021.2. Samples: 36347912. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:38:36,005][124505] Avg episode reward: [(0, '4606.213')] [2023-03-12 02:38:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000071016_36360192.pth... [2023-03-12 02:38:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000070432_36061184.pth [2023-03-12 02:38:37,067][124793] Updated weights for policy 0, policy_version 71040 (0.0005) [2023-03-12 02:38:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10260.8). Total num frames: 36409344. Throughput: 0: 10047.4. Samples: 36409292. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:38:41,005][124505] Avg episode reward: [(0, '4606.814')] [2023-03-12 02:38:41,045][124793] Updated weights for policy 0, policy_version 71120 (0.0005) [2023-03-12 02:38:45,055][124793] Updated weights for policy 0, policy_version 71200 (0.0005) [2023-03-12 02:38:46,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 10260.8). Total num frames: 36462592. Throughput: 0: 10042.0. Samples: 36439232. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:38:46,005][124505] Avg episode reward: [(0, '4600.120')] [2023-03-12 02:38:49,039][124793] Updated weights for policy 0, policy_version 71280 (0.0005) [2023-03-12 02:38:51,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10246.9). Total num frames: 36511744. Throughput: 0: 10063.3. Samples: 36500504. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:38:51,005][124505] Avg episode reward: [(0, '4601.869')] [2023-03-12 02:38:51,072][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000071320_36515840.pth... [2023-03-12 02:38:51,073][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000070720_36208640.pth [2023-03-12 02:38:53,088][124793] Updated weights for policy 0, policy_version 71360 (0.0005) [2023-03-12 02:38:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10246.9). Total num frames: 36564992. Throughput: 0: 10107.7. Samples: 36562324. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:38:56,005][124505] Avg episode reward: [(0, '4595.649')] [2023-03-12 02:38:57,054][124793] Updated weights for policy 0, policy_version 71440 (0.0005) [2023-03-12 02:39:01,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10246.9). Total num frames: 36614144. Throughput: 0: 10091.6. Samples: 36592856. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:39:01,005][124505] Avg episode reward: [(0, '4554.138')] [2023-03-12 02:39:01,132][124793] Updated weights for policy 0, policy_version 71520 (0.0005) [2023-03-12 02:39:05,184][124793] Updated weights for policy 0, policy_version 71600 (0.0005) [2023-03-12 02:39:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10246.9). Total num frames: 36663296. Throughput: 0: 10103.2. Samples: 36652784. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:39:06,005][124505] Avg episode reward: [(0, '4457.949')] [2023-03-12 02:39:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000071616_36667392.pth... [2023-03-12 02:39:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000071016_36360192.pth [2023-03-12 02:39:09,175][124793] Updated weights for policy 0, policy_version 71680 (0.0005) [2023-03-12 02:39:11,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10260.8). Total num frames: 36716544. Throughput: 0: 10149.8. Samples: 36715020. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:39:11,005][124505] Avg episode reward: [(0, '4599.631')] [2023-03-12 02:39:13,133][124793] Updated weights for policy 0, policy_version 71760 (0.0005) [2023-03-12 02:39:16,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 10260.8). Total num frames: 36765696. Throughput: 0: 10157.5. Samples: 36745288. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:39:16,005][124505] Avg episode reward: [(0, '4596.033')] [2023-03-12 02:39:17,324][124793] Updated weights for policy 0, policy_version 71840 (0.0005) [2023-03-12 02:39:21,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10103.5, 300 sec: 10260.8). Total num frames: 36814848. Throughput: 0: 10154.3. Samples: 36804856. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:39:21,005][124505] Avg episode reward: [(0, '4590.968')] [2023-03-12 02:39:21,036][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000071912_36818944.pth... [2023-03-12 02:39:21,038][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000071320_36515840.pth [2023-03-12 02:39:21,465][124793] Updated weights for policy 0, policy_version 71920 (0.0005) [2023-03-12 02:39:25,461][124793] Updated weights for policy 0, policy_version 72000 (0.0005) [2023-03-12 02:39:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10274.7). Total num frames: 36868096. Throughput: 0: 10132.9. Samples: 36865272. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:39:26,005][124505] Avg episode reward: [(0, '4600.384')] [2023-03-12 02:39:29,407][124793] Updated weights for policy 0, policy_version 72080 (0.0005) [2023-03-12 02:39:31,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 10274.7). Total num frames: 36917248. Throughput: 0: 10167.8. Samples: 36896784. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:39:31,005][124505] Avg episode reward: [(0, '4602.848')] [2023-03-12 02:39:33,460][124793] Updated weights for policy 0, policy_version 72160 (0.0005) [2023-03-12 02:39:36,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 10288.6). Total num frames: 36970496. Throughput: 0: 10159.5. Samples: 36957680. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:39:36,005][124505] Avg episode reward: [(0, '4608.114')] [2023-03-12 02:39:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000072208_36970496.pth... [2023-03-12 02:39:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000071616_36667392.pth [2023-03-12 02:39:37,388][124793] Updated weights for policy 0, policy_version 72240 (0.0005) [2023-03-12 02:39:41,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10240.0, 300 sec: 10288.6). Total num frames: 37023744. Throughput: 0: 10164.4. Samples: 37019720. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:39:41,005][124505] Avg episode reward: [(0, '4598.911')] [2023-03-12 02:39:41,373][124793] Updated weights for policy 0, policy_version 72320 (0.0005) [2023-03-12 02:39:45,353][124793] Updated weights for policy 0, policy_version 72400 (0.0005) [2023-03-12 02:39:46,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 10288.6). Total num frames: 37072896. Throughput: 0: 10190.7. Samples: 37051436. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:39:46,005][124505] Avg episode reward: [(0, '4602.356')] [2023-03-12 02:39:49,289][124793] Updated weights for policy 0, policy_version 72480 (0.0005) [2023-03-12 02:39:51,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10240.0, 300 sec: 10288.6). Total num frames: 37126144. Throughput: 0: 10231.9. Samples: 37113220. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:39:51,005][124505] Avg episode reward: [(0, '4597.065')] [2023-03-12 02:39:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000072512_37126144.pth... [2023-03-12 02:39:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000071912_36818944.pth [2023-03-12 02:39:53,219][124793] Updated weights for policy 0, policy_version 72560 (0.0005) [2023-03-12 02:39:56,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10240.0, 300 sec: 10288.6). Total num frames: 37179392. Throughput: 0: 10230.0. Samples: 37175368. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:39:56,005][124505] Avg episode reward: [(0, '4600.492')] [2023-03-12 02:39:57,234][124793] Updated weights for policy 0, policy_version 72640 (0.0005) [2023-03-12 02:40:01,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10240.0, 300 sec: 10288.6). Total num frames: 37228544. Throughput: 0: 10225.7. Samples: 37205444. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:40:01,005][124505] Avg episode reward: [(0, '4549.470')] [2023-03-12 02:40:01,288][124793] Updated weights for policy 0, policy_version 72720 (0.0005) [2023-03-12 02:40:05,278][124793] Updated weights for policy 0, policy_version 72800 (0.0005) [2023-03-12 02:40:06,005][124505] Fps is (10 sec: 9830.3, 60 sec: 10240.0, 300 sec: 10302.5). Total num frames: 37277696. Throughput: 0: 10255.8. Samples: 37266368. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:40:06,005][124505] Avg episode reward: [(0, '4534.506')] [2023-03-12 02:40:06,044][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000072816_37281792.pth... [2023-03-12 02:40:06,046][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000072208_36970496.pth [2023-03-12 02:40:09,180][124793] Updated weights for policy 0, policy_version 72880 (0.0005) [2023-03-12 02:40:11,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10240.0, 300 sec: 10302.5). Total num frames: 37330944. Throughput: 0: 10327.0. Samples: 37329988. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:40:11,005][124505] Avg episode reward: [(0, '4577.843')] [2023-03-12 02:40:13,139][124793] Updated weights for policy 0, policy_version 72960 (0.0005) [2023-03-12 02:40:16,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10308.3, 300 sec: 10316.4). Total num frames: 37384192. Throughput: 0: 10288.4. Samples: 37359760. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:40:16,005][124505] Avg episode reward: [(0, '4563.866')] [2023-03-12 02:40:17,124][124793] Updated weights for policy 0, policy_version 73040 (0.0005) [2023-03-12 02:40:21,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10308.3, 300 sec: 10302.5). Total num frames: 37433344. Throughput: 0: 10328.0. Samples: 37422440. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:40:21,006][124505] Avg episode reward: [(0, '4464.533')] [2023-03-12 02:40:21,011][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000073120_37437440.pth... [2023-03-12 02:40:21,011][124793] Updated weights for policy 0, policy_version 73120 (0.0005) [2023-03-12 02:40:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000072512_37126144.pth [2023-03-12 02:40:24,912][124793] Updated weights for policy 0, policy_version 73200 (0.0005) [2023-03-12 02:40:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10308.3, 300 sec: 10316.4). Total num frames: 37486592. Throughput: 0: 10347.9. Samples: 37485376. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:40:26,005][124505] Avg episode reward: [(0, '4528.451')] [2023-03-12 02:40:28,956][124793] Updated weights for policy 0, policy_version 73280 (0.0005) [2023-03-12 02:40:31,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10376.6, 300 sec: 10316.4). Total num frames: 37539840. Throughput: 0: 10308.9. Samples: 37515336. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:40:31,005][124505] Avg episode reward: [(0, '4538.911')] [2023-03-12 02:40:33,087][124793] Updated weights for policy 0, policy_version 73360 (0.0005) [2023-03-12 02:40:36,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10308.3, 300 sec: 10302.5). Total num frames: 37588992. Throughput: 0: 10282.0. Samples: 37575912. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:40:36,005][124505] Avg episode reward: [(0, '4393.315')] [2023-03-12 02:40:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000073416_37588992.pth... [2023-03-12 02:40:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000072816_37281792.pth [2023-03-12 02:40:37,054][124793] Updated weights for policy 0, policy_version 73440 (0.0005) [2023-03-12 02:40:41,005][124505] Fps is (10 sec: 9830.3, 60 sec: 10240.0, 300 sec: 10302.5). Total num frames: 37638144. Throughput: 0: 10271.6. Samples: 37637592. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:40:41,005][124505] Avg episode reward: [(0, '4410.889')] [2023-03-12 02:40:41,072][124793] Updated weights for policy 0, policy_version 73520 (0.0005) [2023-03-12 02:40:45,072][124793] Updated weights for policy 0, policy_version 73600 (0.0005) [2023-03-12 02:40:46,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10308.3, 300 sec: 10302.5). Total num frames: 37691392. Throughput: 0: 10265.3. Samples: 37667380. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:40:46,005][124505] Avg episode reward: [(0, '4416.895')] [2023-03-12 02:40:49,027][124793] Updated weights for policy 0, policy_version 73680 (0.0005) [2023-03-12 02:40:51,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10308.3, 300 sec: 10302.5). Total num frames: 37744640. Throughput: 0: 10311.3. Samples: 37730376. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:40:51,005][124505] Avg episode reward: [(0, '4447.492')] [2023-03-12 02:40:51,007][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000073720_37744640.pth... [2023-03-12 02:40:51,009][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000073120_37437440.pth [2023-03-12 02:40:53,008][124793] Updated weights for policy 0, policy_version 73760 (0.0005) [2023-03-12 02:40:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10240.0, 300 sec: 10288.6). Total num frames: 37793792. Throughput: 0: 10267.0. Samples: 37792004. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:40:56,005][124505] Avg episode reward: [(0, '4443.571')] [2023-03-12 02:40:57,027][124793] Updated weights for policy 0, policy_version 73840 (0.0005) [2023-03-12 02:41:01,005][124505] Fps is (10 sec: 9830.3, 60 sec: 10240.0, 300 sec: 10274.7). Total num frames: 37842944. Throughput: 0: 10260.6. Samples: 37821488. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:41:01,005][124505] Avg episode reward: [(0, '4363.178')] [2023-03-12 02:41:01,041][124793] Updated weights for policy 0, policy_version 73920 (0.0004) [2023-03-12 02:41:04,768][124793] Updated weights for policy 0, policy_version 74000 (0.0005) [2023-03-12 02:41:06,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10376.5, 300 sec: 10288.6). Total num frames: 37900288. Throughput: 0: 10308.5. Samples: 37886324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:41:06,005][124505] Avg episode reward: [(0, '4492.402')] [2023-03-12 02:41:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000074024_37900288.pth... [2023-03-12 02:41:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000073416_37588992.pth [2023-03-12 02:41:08,440][124793] Updated weights for policy 0, policy_version 74080 (0.0004) [2023-03-12 02:41:11,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10376.5, 300 sec: 10288.6). Total num frames: 37953536. Throughput: 0: 10345.2. Samples: 37950912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:41:11,005][124505] Avg episode reward: [(0, '4518.695')] [2023-03-12 02:41:12,245][124793] Updated weights for policy 0, policy_version 74160 (0.0004) [2023-03-12 02:41:16,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10376.5, 300 sec: 10288.6). Total num frames: 38006784. Throughput: 0: 10398.4. Samples: 37983264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:41:16,005][124505] Avg episode reward: [(0, '4475.163')] [2023-03-12 02:41:16,219][124793] Updated weights for policy 0, policy_version 74240 (0.0005) [2023-03-12 02:41:20,168][124793] Updated weights for policy 0, policy_version 74320 (0.0005) [2023-03-12 02:41:21,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10444.8, 300 sec: 10288.6). Total num frames: 38060032. Throughput: 0: 10445.3. Samples: 38045952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:41:21,005][124505] Avg episode reward: [(0, '4563.717')] [2023-03-12 02:41:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000074336_38060032.pth... [2023-03-12 02:41:21,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000073720_37744640.pth [2023-03-12 02:41:23,925][124793] Updated weights for policy 0, policy_version 74400 (0.0004) [2023-03-12 02:41:26,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10444.8, 300 sec: 10302.5). Total num frames: 38113280. Throughput: 0: 10521.1. Samples: 38111040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:41:26,005][124505] Avg episode reward: [(0, '4573.949')] [2023-03-12 02:41:27,779][124793] Updated weights for policy 0, policy_version 74480 (0.0005) [2023-03-12 02:41:31,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10444.8, 300 sec: 10288.6). Total num frames: 38166528. Throughput: 0: 10552.6. Samples: 38142248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:41:31,005][124505] Avg episode reward: [(0, '4564.585')] [2023-03-12 02:41:31,653][124793] Updated weights for policy 0, policy_version 74560 (0.0005) [2023-03-12 02:41:35,526][124793] Updated weights for policy 0, policy_version 74640 (0.0005) [2023-03-12 02:41:36,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10513.1, 300 sec: 10302.5). Total num frames: 38219776. Throughput: 0: 10567.8. Samples: 38205928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:41:36,005][124505] Avg episode reward: [(0, '4589.987')] [2023-03-12 02:41:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000074648_38219776.pth... [2023-03-12 02:41:36,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000074024_37900288.pth [2023-03-12 02:41:39,456][124793] Updated weights for policy 0, policy_version 74720 (0.0005) [2023-03-12 02:41:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10513.1, 300 sec: 10274.7). Total num frames: 38268928. Throughput: 0: 10589.7. Samples: 38268540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:41:41,005][124505] Avg episode reward: [(0, '4584.205')] [2023-03-12 02:41:43,316][124793] Updated weights for policy 0, policy_version 74800 (0.0005) [2023-03-12 02:41:46,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10581.3, 300 sec: 10302.5). Total num frames: 38326272. Throughput: 0: 10647.8. Samples: 38300640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:41:46,005][124505] Avg episode reward: [(0, '4579.161')] [2023-03-12 02:41:46,979][124793] Updated weights for policy 0, policy_version 74880 (0.0003) [2023-03-12 02:41:50,681][124793] Updated weights for policy 0, policy_version 74960 (0.0003) [2023-03-12 02:41:51,005][124505] Fps is (10 sec: 11059.1, 60 sec: 10581.3, 300 sec: 10302.5). Total num frames: 38379520. Throughput: 0: 10689.0. Samples: 38367328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:41:51,006][124505] Avg episode reward: [(0, '4591.390')] [2023-03-12 02:41:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000074960_38379520.pth... [2023-03-12 02:41:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000074336_38060032.pth [2023-03-12 02:41:54,468][124793] Updated weights for policy 0, policy_version 75040 (0.0003) [2023-03-12 02:41:56,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10717.9, 300 sec: 10316.4). Total num frames: 38436864. Throughput: 0: 10706.7. Samples: 38432716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:41:56,005][124505] Avg episode reward: [(0, '4598.880')] [2023-03-12 02:41:58,260][124793] Updated weights for policy 0, policy_version 75120 (0.0003) [2023-03-12 02:42:01,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10786.1, 300 sec: 10302.5). Total num frames: 38490112. Throughput: 0: 10712.0. Samples: 38465304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:42:01,005][124505] Avg episode reward: [(0, '4583.367')] [2023-03-12 02:42:01,941][124793] Updated weights for policy 0, policy_version 75200 (0.0003) [2023-03-12 02:42:05,752][124793] Updated weights for policy 0, policy_version 75280 (0.0004) [2023-03-12 02:42:06,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10717.9, 300 sec: 10302.5). Total num frames: 38543360. Throughput: 0: 10780.7. Samples: 38531084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:42:06,005][124505] Avg episode reward: [(0, '4576.767')] [2023-03-12 02:42:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000075280_38543360.pth... [2023-03-12 02:42:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000074648_38219776.pth [2023-03-12 02:42:09,491][124793] Updated weights for policy 0, policy_version 75360 (0.0004) [2023-03-12 02:42:11,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10717.9, 300 sec: 10316.4). Total num frames: 38596608. Throughput: 0: 10770.0. Samples: 38595692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:42:11,005][124505] Avg episode reward: [(0, '4558.500')] [2023-03-12 02:42:13,447][124793] Updated weights for policy 0, policy_version 75440 (0.0006) [2023-03-12 02:42:16,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10717.9, 300 sec: 10316.4). Total num frames: 38649856. Throughput: 0: 10767.5. Samples: 38626788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:42:16,005][124505] Avg episode reward: [(0, '4574.769')] [2023-03-12 02:42:17,379][124793] Updated weights for policy 0, policy_version 75520 (0.0006) [2023-03-12 02:42:21,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10717.9, 300 sec: 10330.2). Total num frames: 38703104. Throughput: 0: 10743.4. Samples: 38689380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:42:21,005][124505] Avg episode reward: [(0, '4479.293')] [2023-03-12 02:42:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000075592_38703104.pth... [2023-03-12 02:42:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000074960_38379520.pth [2023-03-12 02:42:21,217][124793] Updated weights for policy 0, policy_version 75600 (0.0005) [2023-03-12 02:42:24,900][124793] Updated weights for policy 0, policy_version 75680 (0.0004) [2023-03-12 02:42:26,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10717.9, 300 sec: 10330.3). Total num frames: 38756352. Throughput: 0: 10824.5. Samples: 38755644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:42:26,005][124505] Avg episode reward: [(0, '4567.769')] [2023-03-12 02:42:28,744][124793] Updated weights for policy 0, policy_version 75760 (0.0003) [2023-03-12 02:42:31,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10717.9, 300 sec: 10344.1). Total num frames: 38809600. Throughput: 0: 10816.5. Samples: 38787380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:42:31,005][124505] Avg episode reward: [(0, '4319.876')] [2023-03-12 02:42:32,720][124793] Updated weights for policy 0, policy_version 75840 (0.0004) [2023-03-12 02:42:36,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10649.6, 300 sec: 10344.1). Total num frames: 38858752. Throughput: 0: 10682.3. Samples: 38848032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:42:36,005][124505] Avg episode reward: [(0, '4195.308')] [2023-03-12 02:42:36,048][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000075904_38862848.pth... [2023-03-12 02:42:36,049][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000075280_38543360.pth [2023-03-12 02:42:36,852][124793] Updated weights for policy 0, policy_version 75920 (0.0006) [2023-03-12 02:42:40,889][124793] Updated weights for policy 0, policy_version 76000 (0.0005) [2023-03-12 02:42:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10717.9, 300 sec: 10344.1). Total num frames: 38912000. Throughput: 0: 10572.8. Samples: 38908492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:42:41,005][124505] Avg episode reward: [(0, '4318.000')] [2023-03-12 02:42:44,799][124793] Updated weights for policy 0, policy_version 76080 (0.0005) [2023-03-12 02:42:46,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10649.6, 300 sec: 10358.0). Total num frames: 38965248. Throughput: 0: 10563.7. Samples: 38940672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:42:46,005][124505] Avg episode reward: [(0, '4558.326')] [2023-03-12 02:42:48,839][124793] Updated weights for policy 0, policy_version 76160 (0.0005) [2023-03-12 02:42:51,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10581.3, 300 sec: 10358.0). Total num frames: 39014400. Throughput: 0: 10460.1. Samples: 39001788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:42:51,005][124505] Avg episode reward: [(0, '4211.460')] [2023-03-12 02:42:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000076200_39014400.pth... [2023-03-12 02:42:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000075592_38703104.pth [2023-03-12 02:42:52,767][124793] Updated weights for policy 0, policy_version 76240 (0.0005) [2023-03-12 02:42:56,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10444.8, 300 sec: 10358.0). Total num frames: 39063552. Throughput: 0: 10397.1. Samples: 39063560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:42:56,005][124505] Avg episode reward: [(0, '4268.513')] [2023-03-12 02:42:56,819][124793] Updated weights for policy 0, policy_version 76320 (0.0004) [2023-03-12 02:43:00,659][124793] Updated weights for policy 0, policy_version 76400 (0.0005) [2023-03-12 02:43:01,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10444.8, 300 sec: 10358.0). Total num frames: 39116800. Throughput: 0: 10380.5. Samples: 39093912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:43:01,005][124505] Avg episode reward: [(0, '4462.766')] [2023-03-12 02:43:04,286][124793] Updated weights for policy 0, policy_version 76480 (0.0004) [2023-03-12 02:43:06,005][124505] Fps is (10 sec: 11059.1, 60 sec: 10513.1, 300 sec: 10385.8). Total num frames: 39174144. Throughput: 0: 10486.5. Samples: 39161272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:43:06,005][124505] Avg episode reward: [(0, '4573.554')] [2023-03-12 02:43:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000076512_39174144.pth... [2023-03-12 02:43:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000075904_38862848.pth [2023-03-12 02:43:07,937][124793] Updated weights for policy 0, policy_version 76560 (0.0004) [2023-03-12 02:43:11,005][124505] Fps is (10 sec: 11468.8, 60 sec: 10581.3, 300 sec: 10413.6). Total num frames: 39231488. Throughput: 0: 10487.8. Samples: 39227596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:43:11,005][124505] Avg episode reward: [(0, '4590.330')] [2023-03-12 02:43:11,658][124793] Updated weights for policy 0, policy_version 76640 (0.0004) [2023-03-12 02:43:15,293][124793] Updated weights for policy 0, policy_version 76720 (0.0004) [2023-03-12 02:43:16,005][124505] Fps is (10 sec: 11059.2, 60 sec: 10581.3, 300 sec: 10427.4). Total num frames: 39284736. Throughput: 0: 10541.0. Samples: 39261724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:43:16,005][124505] Avg episode reward: [(0, '4595.236')] [2023-03-12 02:43:18,948][124793] Updated weights for policy 0, policy_version 76800 (0.0004) [2023-03-12 02:43:21,005][124505] Fps is (10 sec: 11059.1, 60 sec: 10649.6, 300 sec: 10441.3). Total num frames: 39342080. Throughput: 0: 10680.0. Samples: 39328632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:43:21,005][124505] Avg episode reward: [(0, '4592.921')] [2023-03-12 02:43:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000076840_39342080.pth... [2023-03-12 02:43:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000076200_39014400.pth [2023-03-12 02:43:22,596][124793] Updated weights for policy 0, policy_version 76880 (0.0004) [2023-03-12 02:43:26,005][124505] Fps is (10 sec: 11468.8, 60 sec: 10717.9, 300 sec: 10469.1). Total num frames: 39399424. Throughput: 0: 10820.0. Samples: 39395392. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:43:26,005][124505] Avg episode reward: [(0, '4595.701')] [2023-03-12 02:43:26,332][124793] Updated weights for policy 0, policy_version 76960 (0.0004) [2023-03-12 02:43:30,035][124793] Updated weights for policy 0, policy_version 77040 (0.0005) [2023-03-12 02:43:31,005][124505] Fps is (10 sec: 11059.3, 60 sec: 10717.9, 300 sec: 10483.0). Total num frames: 39452672. Throughput: 0: 10848.7. Samples: 39428864. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:43:31,005][124505] Avg episode reward: [(0, '4574.860')] [2023-03-12 02:43:34,025][124793] Updated weights for policy 0, policy_version 77120 (0.0005) [2023-03-12 02:43:36,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10717.9, 300 sec: 10483.0). Total num frames: 39501824. Throughput: 0: 10870.5. Samples: 39490960. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:43:36,005][124505] Avg episode reward: [(0, '4418.993')] [2023-03-12 02:43:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000077152_39501824.pth... [2023-03-12 02:43:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000076512_39174144.pth [2023-03-12 02:43:38,115][124793] Updated weights for policy 0, policy_version 77200 (0.0005) [2023-03-12 02:43:41,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10649.6, 300 sec: 10469.1). Total num frames: 39550976. Throughput: 0: 10831.5. Samples: 39550976. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:43:41,005][124505] Avg episode reward: [(0, '4154.123')] [2023-03-12 02:43:42,303][124793] Updated weights for policy 0, policy_version 77280 (0.0005) [2023-03-12 02:43:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10581.3, 300 sec: 10469.1). Total num frames: 39600128. Throughput: 0: 10795.8. Samples: 39579720. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:43:46,005][124505] Avg episode reward: [(0, '4142.544')] [2023-03-12 02:43:46,520][124793] Updated weights for policy 0, policy_version 77360 (0.0005) [2023-03-12 02:43:50,704][124793] Updated weights for policy 0, policy_version 77440 (0.0005) [2023-03-12 02:43:51,005][124505] Fps is (10 sec: 9830.3, 60 sec: 10581.3, 300 sec: 10455.2). Total num frames: 39649280. Throughput: 0: 10605.5. Samples: 39638520. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:43:51,005][124505] Avg episode reward: [(0, '3950.793')] [2023-03-12 02:43:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000077440_39649280.pth... [2023-03-12 02:43:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000076840_39342080.pth [2023-03-12 02:43:54,899][124793] Updated weights for policy 0, policy_version 77520 (0.0005) [2023-03-12 02:43:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10581.3, 300 sec: 10455.2). Total num frames: 39698432. Throughput: 0: 10438.2. Samples: 39697316. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:43:56,005][124505] Avg episode reward: [(0, '4256.033')] [2023-03-12 02:43:59,134][124793] Updated weights for policy 0, policy_version 77600 (0.0005) [2023-03-12 02:44:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10513.1, 300 sec: 10455.2). Total num frames: 39747584. Throughput: 0: 10322.5. Samples: 39726236. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:44:01,005][124505] Avg episode reward: [(0, '4273.509')] [2023-03-12 02:44:03,313][124793] Updated weights for policy 0, policy_version 77680 (0.0005) [2023-03-12 02:44:06,005][124505] Fps is (10 sec: 9830.3, 60 sec: 10376.5, 300 sec: 10441.3). Total num frames: 39796736. Throughput: 0: 10154.9. Samples: 39785604. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:44:06,005][124505] Avg episode reward: [(0, '4360.398')] [2023-03-12 02:44:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000077728_39796736.pth... [2023-03-12 02:44:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000077152_39501824.pth [2023-03-12 02:44:07,242][124793] Updated weights for policy 0, policy_version 77760 (0.0005) [2023-03-12 02:44:11,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10308.3, 300 sec: 10455.2). Total num frames: 39849984. Throughput: 0: 10055.8. Samples: 39847904. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 02:44:11,005][124505] Avg episode reward: [(0, '4450.305')] [2023-03-12 02:44:11,156][124793] Updated weights for policy 0, policy_version 77840 (0.0004) [2023-03-12 02:44:14,940][124793] Updated weights for policy 0, policy_version 77920 (0.0004) [2023-03-12 02:44:16,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10308.3, 300 sec: 10469.1). Total num frames: 39903232. Throughput: 0: 10025.7. Samples: 39880020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:44:16,005][124505] Avg episode reward: [(0, '4552.640')] [2023-03-12 02:44:18,796][124793] Updated weights for policy 0, policy_version 78000 (0.0005) [2023-03-12 02:44:21,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10240.0, 300 sec: 10469.1). Total num frames: 39956480. Throughput: 0: 10072.0. Samples: 39944200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:44:21,005][124505] Avg episode reward: [(0, '4549.502')] [2023-03-12 02:44:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000078040_39956480.pth... [2023-03-12 02:44:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000077440_39649280.pth [2023-03-12 02:44:22,685][124793] Updated weights for policy 0, policy_version 78080 (0.0005) [2023-03-12 02:44:26,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10171.7, 300 sec: 10483.0). Total num frames: 40009728. Throughput: 0: 10154.2. Samples: 40007916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:44:26,005][124505] Avg episode reward: [(0, '4527.280')] [2023-03-12 02:44:26,561][124793] Updated weights for policy 0, policy_version 78160 (0.0004) [2023-03-12 02:44:30,340][124793] Updated weights for policy 0, policy_version 78240 (0.0004) [2023-03-12 02:44:31,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10171.7, 300 sec: 10483.0). Total num frames: 40062976. Throughput: 0: 10216.8. Samples: 40039476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:44:31,005][124505] Avg episode reward: [(0, '4579.716')] [2023-03-12 02:44:34,228][124793] Updated weights for policy 0, policy_version 78320 (0.0004) [2023-03-12 02:44:36,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10240.0, 300 sec: 10483.0). Total num frames: 40116224. Throughput: 0: 10341.2. Samples: 40103872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:44:36,005][124505] Avg episode reward: [(0, '4582.018')] [2023-03-12 02:44:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000078352_40116224.pth... [2023-03-12 02:44:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000077728_39796736.pth [2023-03-12 02:44:38,062][124793] Updated weights for policy 0, policy_version 78400 (0.0005) [2023-03-12 02:44:41,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10308.3, 300 sec: 10496.9). Total num frames: 40169472. Throughput: 0: 10447.5. Samples: 40167452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:44:41,005][124505] Avg episode reward: [(0, '4530.619')] [2023-03-12 02:44:41,954][124793] Updated weights for policy 0, policy_version 78480 (0.0005) [2023-03-12 02:44:45,842][124793] Updated weights for policy 0, policy_version 78560 (0.0004) [2023-03-12 02:44:46,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10376.5, 300 sec: 10496.9). Total num frames: 40222720. Throughput: 0: 10504.1. Samples: 40198920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:44:46,005][124505] Avg episode reward: [(0, '4579.580')] [2023-03-12 02:44:49,734][124793] Updated weights for policy 0, policy_version 78640 (0.0004) [2023-03-12 02:44:51,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10444.8, 300 sec: 10496.9). Total num frames: 40275968. Throughput: 0: 10597.5. Samples: 40262492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:44:51,005][124505] Avg episode reward: [(0, '4576.974')] [2023-03-12 02:44:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000078664_40275968.pth... [2023-03-12 02:44:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000078040_39956480.pth [2023-03-12 02:44:53,684][124793] Updated weights for policy 0, policy_version 78720 (0.0004) [2023-03-12 02:44:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10444.8, 300 sec: 10496.9). Total num frames: 40325120. Throughput: 0: 10566.6. Samples: 40323400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:44:56,005][124505] Avg episode reward: [(0, '4582.010')] [2023-03-12 02:44:57,845][124793] Updated weights for policy 0, policy_version 78800 (0.0005) [2023-03-12 02:45:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10444.8, 300 sec: 10496.9). Total num frames: 40374272. Throughput: 0: 10516.5. Samples: 40353260. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:45:01,005][124505] Avg episode reward: [(0, '4586.339')] [2023-03-12 02:45:01,898][124793] Updated weights for policy 0, policy_version 78880 (0.0005) [2023-03-12 02:45:05,962][124793] Updated weights for policy 0, policy_version 78960 (0.0005) [2023-03-12 02:45:06,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10513.1, 300 sec: 10496.9). Total num frames: 40427520. Throughput: 0: 10438.4. Samples: 40413928. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:45:06,005][124505] Avg episode reward: [(0, '4583.959')] [2023-03-12 02:45:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000078960_40427520.pth... [2023-03-12 02:45:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000078352_40116224.pth [2023-03-12 02:45:10,076][124793] Updated weights for policy 0, policy_version 79040 (0.0005) [2023-03-12 02:45:11,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10444.8, 300 sec: 10483.0). Total num frames: 40476672. Throughput: 0: 10345.8. Samples: 40473476. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:45:11,005][124505] Avg episode reward: [(0, '4583.814')] [2023-03-12 02:45:14,140][124793] Updated weights for policy 0, policy_version 79120 (0.0005) [2023-03-12 02:45:16,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10376.5, 300 sec: 10483.0). Total num frames: 40525824. Throughput: 0: 10322.7. Samples: 40503996. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:45:16,005][124505] Avg episode reward: [(0, '4584.254')] [2023-03-12 02:45:18,161][124793] Updated weights for policy 0, policy_version 79200 (0.0005) [2023-03-12 02:45:21,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10308.3, 300 sec: 10469.1). Total num frames: 40574976. Throughput: 0: 10241.8. Samples: 40564752. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:45:21,005][124505] Avg episode reward: [(0, '4591.431')] [2023-03-12 02:45:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000079256_40579072.pth... [2023-03-12 02:45:21,009][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000078664_40275968.pth [2023-03-12 02:45:22,269][124793] Updated weights for policy 0, policy_version 79280 (0.0005) [2023-03-12 02:45:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10308.3, 300 sec: 10469.1). Total num frames: 40628224. Throughput: 0: 10162.9. Samples: 40624784. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:45:26,016][124505] Avg episode reward: [(0, '4591.394')] [2023-03-12 02:45:26,311][124793] Updated weights for policy 0, policy_version 79360 (0.0005) [2023-03-12 02:45:30,364][124793] Updated weights for policy 0, policy_version 79440 (0.0005) [2023-03-12 02:45:31,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10240.0, 300 sec: 10469.1). Total num frames: 40677376. Throughput: 0: 10150.2. Samples: 40655680. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:45:31,016][124505] Avg episode reward: [(0, '4597.892')] [2023-03-12 02:45:34,305][124793] Updated weights for policy 0, policy_version 79520 (0.0005) [2023-03-12 02:45:36,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10240.0, 300 sec: 10483.0). Total num frames: 40730624. Throughput: 0: 10109.2. Samples: 40717408. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:45:36,016][124505] Avg episode reward: [(0, '4576.869')] [2023-03-12 02:45:36,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000079552_40730624.pth... [2023-03-12 02:45:36,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000078960_40427520.pth [2023-03-12 02:45:38,340][124793] Updated weights for policy 0, policy_version 79600 (0.0005) [2023-03-12 02:45:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 10469.1). Total num frames: 40779776. Throughput: 0: 10088.5. Samples: 40777384. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:45:41,016][124505] Avg episode reward: [(0, '4591.918')] [2023-03-12 02:45:42,479][124793] Updated weights for policy 0, policy_version 79680 (0.0005) [2023-03-12 02:45:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 10455.2). Total num frames: 40828928. Throughput: 0: 10093.8. Samples: 40807480. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:45:46,005][124505] Avg episode reward: [(0, '4581.774')] [2023-03-12 02:45:46,606][124793] Updated weights for policy 0, policy_version 79760 (0.0005) [2023-03-12 02:45:50,755][124793] Updated weights for policy 0, policy_version 79840 (0.0005) [2023-03-12 02:45:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10455.2). Total num frames: 40878080. Throughput: 0: 10046.6. Samples: 40866024. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:45:51,005][124505] Avg episode reward: [(0, '4536.901')] [2023-03-12 02:45:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000079840_40878080.pth... [2023-03-12 02:45:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000079256_40579072.pth [2023-03-12 02:45:54,812][124793] Updated weights for policy 0, policy_version 79920 (0.0005) [2023-03-12 02:45:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10455.2). Total num frames: 40927232. Throughput: 0: 10083.5. Samples: 40927232. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:45:56,005][124505] Avg episode reward: [(0, '4587.625')] [2023-03-12 02:45:58,870][124793] Updated weights for policy 0, policy_version 80000 (0.0005) [2023-03-12 02:46:01,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10103.5, 300 sec: 10441.3). Total num frames: 40980480. Throughput: 0: 10067.6. Samples: 40957040. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:46:01,005][124505] Avg episode reward: [(0, '4601.116')] [2023-03-12 02:46:02,908][124793] Updated weights for policy 0, policy_version 80080 (0.0005) [2023-03-12 02:46:06,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10427.4). Total num frames: 41029632. Throughput: 0: 10059.2. Samples: 41017416. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:46:06,005][124505] Avg episode reward: [(0, '4572.520')] [2023-03-12 02:46:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000080136_41029632.pth... [2023-03-12 02:46:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000079552_40730624.pth [2023-03-12 02:46:06,988][124793] Updated weights for policy 0, policy_version 80160 (0.0005) [2023-03-12 02:46:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10413.6). Total num frames: 41078784. Throughput: 0: 10088.9. Samples: 41078784. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:46:11,005][124505] Avg episode reward: [(0, '4599.266')] [2023-03-12 02:46:11,045][124793] Updated weights for policy 0, policy_version 80240 (0.0005) [2023-03-12 02:46:15,010][124793] Updated weights for policy 0, policy_version 80320 (0.0005) [2023-03-12 02:46:16,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10413.6). Total num frames: 41132032. Throughput: 0: 10087.9. Samples: 41109636. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:46:16,005][124505] Avg episode reward: [(0, '4595.010')] [2023-03-12 02:46:18,997][124793] Updated weights for policy 0, policy_version 80400 (0.0005) [2023-03-12 02:46:21,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10171.7, 300 sec: 10413.6). Total num frames: 41185280. Throughput: 0: 10085.4. Samples: 41171252. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:46:21,005][124505] Avg episode reward: [(0, '4606.339')] [2023-03-12 02:46:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000080440_41185280.pth... [2023-03-12 02:46:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000079840_40878080.pth [2023-03-12 02:46:22,957][124793] Updated weights for policy 0, policy_version 80480 (0.0005) [2023-03-12 02:46:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10399.7). Total num frames: 41234432. Throughput: 0: 10124.8. Samples: 41233000. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:46:26,005][124505] Avg episode reward: [(0, '4602.382')] [2023-03-12 02:46:26,908][124793] Updated weights for policy 0, policy_version 80560 (0.0005) [2023-03-12 02:46:30,884][124793] Updated weights for policy 0, policy_version 80640 (0.0005) [2023-03-12 02:46:31,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 10399.7). Total num frames: 41287680. Throughput: 0: 10137.7. Samples: 41263676. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:46:31,005][124505] Avg episode reward: [(0, '4609.150')] [2023-03-12 02:46:34,803][124793] Updated weights for policy 0, policy_version 80720 (0.0005) [2023-03-12 02:46:36,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10399.7). Total num frames: 41336832. Throughput: 0: 10232.3. Samples: 41326476. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 02:46:36,006][124505] Avg episode reward: [(0, '4603.360')] [2023-03-12 02:46:36,011][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000080744_41340928.pth... [2023-03-12 02:46:36,014][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000080136_41029632.pth [2023-03-12 02:46:38,941][124793] Updated weights for policy 0, policy_version 80800 (0.0005) [2023-03-12 02:46:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 10385.8). Total num frames: 41390080. Throughput: 0: 10195.9. Samples: 41386048. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:46:41,005][124505] Avg episode reward: [(0, '4598.090')] [2023-03-12 02:46:42,980][124793] Updated weights for policy 0, policy_version 80880 (0.0006) [2023-03-12 02:46:46,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 10371.9). Total num frames: 41439232. Throughput: 0: 10209.0. Samples: 41416444. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:46:46,005][124505] Avg episode reward: [(0, '4569.241')] [2023-03-12 02:46:47,013][124793] Updated weights for policy 0, policy_version 80960 (0.0005) [2023-03-12 02:46:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 10344.1). Total num frames: 41488384. Throughput: 0: 10238.1. Samples: 41478132. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:46:51,005][124505] Avg episode reward: [(0, '4591.672')] [2023-03-12 02:46:51,055][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000081040_41492480.pth... [2023-03-12 02:46:51,056][124793] Updated weights for policy 0, policy_version 81040 (0.0005) [2023-03-12 02:46:51,057][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000080440_41185280.pth [2023-03-12 02:46:55,070][124793] Updated weights for policy 0, policy_version 81120 (0.0005) [2023-03-12 02:46:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10240.0, 300 sec: 10344.1). Total num frames: 41541632. Throughput: 0: 10229.2. Samples: 41539096. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:46:56,005][124505] Avg episode reward: [(0, '4599.603')] [2023-03-12 02:46:58,814][124793] Updated weights for policy 0, policy_version 81200 (0.0005) [2023-03-12 02:47:01,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10240.0, 300 sec: 10344.1). Total num frames: 41594880. Throughput: 0: 10261.9. Samples: 41571420. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:47:01,005][124505] Avg episode reward: [(0, '4599.683')] [2023-03-12 02:47:02,723][124793] Updated weights for policy 0, policy_version 81280 (0.0005) [2023-03-12 02:47:06,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10308.3, 300 sec: 10344.1). Total num frames: 41648128. Throughput: 0: 10314.5. Samples: 41635404. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:47:06,005][124505] Avg episode reward: [(0, '4599.256')] [2023-03-12 02:47:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000081344_41648128.pth... [2023-03-12 02:47:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000080744_41340928.pth [2023-03-12 02:47:06,770][124793] Updated weights for policy 0, policy_version 81360 (0.0005) [2023-03-12 02:47:10,865][124793] Updated weights for policy 0, policy_version 81440 (0.0005) [2023-03-12 02:47:11,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10308.3, 300 sec: 10330.3). Total num frames: 41697280. Throughput: 0: 10253.2. Samples: 41694392. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:47:11,005][124505] Avg episode reward: [(0, '4608.972')] [2023-03-12 02:47:14,976][124793] Updated weights for policy 0, policy_version 81520 (0.0005) [2023-03-12 02:47:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10240.0, 300 sec: 10316.4). Total num frames: 41746432. Throughput: 0: 10238.4. Samples: 41724404. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:47:16,005][124505] Avg episode reward: [(0, '4602.639')] [2023-03-12 02:47:19,007][124793] Updated weights for policy 0, policy_version 81600 (0.0005) [2023-03-12 02:47:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 10302.5). Total num frames: 41795584. Throughput: 0: 10190.1. Samples: 41785032. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:47:21,006][124505] Avg episode reward: [(0, '4607.551')] [2023-03-12 02:47:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000081632_41795584.pth... [2023-03-12 02:47:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000081040_41492480.pth [2023-03-12 02:47:23,112][124793] Updated weights for policy 0, policy_version 81680 (0.0005) [2023-03-12 02:47:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10240.0, 300 sec: 10302.5). Total num frames: 41848832. Throughput: 0: 10194.5. Samples: 41844800. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 02:47:26,005][124505] Avg episode reward: [(0, '4598.090')] [2023-03-12 02:47:27,148][124793] Updated weights for policy 0, policy_version 81760 (0.0006) [2023-03-12 02:47:31,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 10302.5). Total num frames: 41897984. Throughput: 0: 10206.4. Samples: 41875732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:47:31,005][124505] Avg episode reward: [(0, '4603.727')] [2023-03-12 02:47:31,073][124793] Updated weights for policy 0, policy_version 81840 (0.0004) [2023-03-12 02:47:34,960][124793] Updated weights for policy 0, policy_version 81920 (0.0003) [2023-03-12 02:47:36,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10240.0, 300 sec: 10302.5). Total num frames: 41951232. Throughput: 0: 10241.9. Samples: 41939016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:47:36,005][124505] Avg episode reward: [(0, '4588.854')] [2023-03-12 02:47:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000081936_41951232.pth... [2023-03-12 02:47:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000081344_41648128.pth [2023-03-12 02:47:38,921][124793] Updated weights for policy 0, policy_version 82000 (0.0003) [2023-03-12 02:47:41,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10240.0, 300 sec: 10302.5). Total num frames: 42004480. Throughput: 0: 10252.3. Samples: 42000448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:47:41,005][124505] Avg episode reward: [(0, '4595.044')] [2023-03-12 02:47:42,960][124793] Updated weights for policy 0, policy_version 82080 (0.0003) [2023-03-12 02:47:46,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10240.0, 300 sec: 10302.5). Total num frames: 42053632. Throughput: 0: 10222.2. Samples: 42031420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:47:46,005][124505] Avg episode reward: [(0, '4585.199')] [2023-03-12 02:47:47,015][124793] Updated weights for policy 0, policy_version 82160 (0.0003) [2023-03-12 02:47:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10240.0, 300 sec: 10302.5). Total num frames: 42102784. Throughput: 0: 10141.6. Samples: 42091776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:47:51,005][124505] Avg episode reward: [(0, '4588.192')] [2023-03-12 02:47:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000082232_42102784.pth... [2023-03-12 02:47:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000081632_41795584.pth [2023-03-12 02:47:51,096][124793] Updated weights for policy 0, policy_version 82240 (0.0004) [2023-03-12 02:47:55,348][124793] Updated weights for policy 0, policy_version 82320 (0.0005) [2023-03-12 02:47:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 10288.6). Total num frames: 42151936. Throughput: 0: 10135.3. Samples: 42150480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:47:56,005][124505] Avg episode reward: [(0, '4581.130')] [2023-03-12 02:47:59,594][124793] Updated weights for policy 0, policy_version 82400 (0.0006) [2023-03-12 02:48:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 10260.8). Total num frames: 42201088. Throughput: 0: 10110.3. Samples: 42179368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:48:01,005][124505] Avg episode reward: [(0, '4598.017')] [2023-03-12 02:48:03,855][124793] Updated weights for policy 0, policy_version 82480 (0.0005) [2023-03-12 02:48:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9966.9, 300 sec: 10219.2). Total num frames: 42246144. Throughput: 0: 10042.5. Samples: 42236944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:48:06,006][124505] Avg episode reward: [(0, '4586.965')] [2023-03-12 02:48:06,054][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000082520_42250240.pth... [2023-03-12 02:48:06,057][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000081936_41951232.pth [2023-03-12 02:48:08,199][124793] Updated weights for policy 0, policy_version 82560 (0.0005) [2023-03-12 02:48:11,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9966.9, 300 sec: 10205.3). Total num frames: 42295296. Throughput: 0: 9969.9. Samples: 42293444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:48:11,005][124505] Avg episode reward: [(0, '4563.745')] [2023-03-12 02:48:12,469][124793] Updated weights for policy 0, policy_version 82640 (0.0005) [2023-03-12 02:48:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10177.5). Total num frames: 42344448. Throughput: 0: 9954.1. Samples: 42323664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:48:16,005][124505] Avg episode reward: [(0, '4435.944')] [2023-03-12 02:48:16,495][124793] Updated weights for policy 0, policy_version 82720 (0.0005) [2023-03-12 02:48:20,537][124793] Updated weights for policy 0, policy_version 82800 (0.0005) [2023-03-12 02:48:21,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 10163.6). Total num frames: 42397696. Throughput: 0: 9887.8. Samples: 42383968. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:48:21,006][124505] Avg episode reward: [(0, '4526.678')] [2023-03-12 02:48:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000082808_42397696.pth... [2023-03-12 02:48:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000082232_42102784.pth [2023-03-12 02:48:24,408][124793] Updated weights for policy 0, policy_version 82880 (0.0004) [2023-03-12 02:48:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 10149.7). Total num frames: 42446848. Throughput: 0: 9920.2. Samples: 42446856. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:48:26,005][124505] Avg episode reward: [(0, '4553.970')] [2023-03-12 02:48:28,560][124793] Updated weights for policy 0, policy_version 82960 (0.0005) [2023-03-12 02:48:31,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10163.6). Total num frames: 42500096. Throughput: 0: 9870.5. Samples: 42475592. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:48:31,005][124505] Avg episode reward: [(0, '4568.729')] [2023-03-12 02:48:32,671][124793] Updated weights for policy 0, policy_version 83040 (0.0005) [2023-03-12 02:48:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 10149.7). Total num frames: 42545152. Throughput: 0: 9842.6. Samples: 42534692. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:48:36,005][124505] Avg episode reward: [(0, '4575.939')] [2023-03-12 02:48:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000083096_42545152.pth... [2023-03-12 02:48:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000082520_42250240.pth [2023-03-12 02:48:36,973][124793] Updated weights for policy 0, policy_version 83120 (0.0005) [2023-03-12 02:48:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 10149.7). Total num frames: 42594304. Throughput: 0: 9825.5. Samples: 42592628. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:48:41,005][124505] Avg episode reward: [(0, '4579.573')] [2023-03-12 02:48:41,191][124793] Updated weights for policy 0, policy_version 83200 (0.0005) [2023-03-12 02:48:45,416][124793] Updated weights for policy 0, policy_version 83280 (0.0005) [2023-03-12 02:48:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 10149.7). Total num frames: 42643456. Throughput: 0: 9837.1. Samples: 42622036. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:48:46,005][124505] Avg episode reward: [(0, '4572.512')] [2023-03-12 02:48:49,679][124793] Updated weights for policy 0, policy_version 83360 (0.0005) [2023-03-12 02:48:51,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 10149.7). Total num frames: 42692608. Throughput: 0: 9844.1. Samples: 42679928. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:48:51,005][124505] Avg episode reward: [(0, '4588.033')] [2023-03-12 02:48:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000083384_42692608.pth... [2023-03-12 02:48:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000082808_42397696.pth [2023-03-12 02:48:53,661][124793] Updated weights for policy 0, policy_version 83440 (0.0005) [2023-03-12 02:48:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 10149.7). Total num frames: 42741760. Throughput: 0: 9952.3. Samples: 42741300. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:48:56,005][124505] Avg episode reward: [(0, '4595.281')] [2023-03-12 02:48:57,655][124793] Updated weights for policy 0, policy_version 83520 (0.0005) [2023-03-12 02:49:01,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 10163.6). Total num frames: 42795008. Throughput: 0: 9957.1. Samples: 42771732. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:49:01,005][124505] Avg episode reward: [(0, '4594.515')] [2023-03-12 02:49:01,597][124793] Updated weights for policy 0, policy_version 83600 (0.0005) [2023-03-12 02:49:05,526][124793] Updated weights for policy 0, policy_version 83680 (0.0005) [2023-03-12 02:49:06,005][124505] Fps is (10 sec: 10649.7, 60 sec: 10035.2, 300 sec: 10163.6). Total num frames: 42848256. Throughput: 0: 10014.3. Samples: 42834612. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 02:49:06,005][124505] Avg episode reward: [(0, '4597.285')] [2023-03-12 02:49:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000083688_42848256.pth... [2023-03-12 02:49:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000083096_42545152.pth [2023-03-12 02:49:09,526][124793] Updated weights for policy 0, policy_version 83760 (0.0005) [2023-03-12 02:49:11,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10149.7). Total num frames: 42897408. Throughput: 0: 9981.7. Samples: 42896032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:49:11,005][124505] Avg episode reward: [(0, '4596.289')] [2023-03-12 02:49:13,527][124793] Updated weights for policy 0, policy_version 83840 (0.0004) [2023-03-12 02:49:16,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 10149.8). Total num frames: 42950656. Throughput: 0: 10018.0. Samples: 42926404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:49:16,005][124505] Avg episode reward: [(0, '4593.816')] [2023-03-12 02:49:17,601][124793] Updated weights for policy 0, policy_version 83920 (0.0004) [2023-03-12 02:49:21,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 10135.9). Total num frames: 42999808. Throughput: 0: 10056.3. Samples: 42987224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:49:21,005][124505] Avg episode reward: [(0, '4591.807')] [2023-03-12 02:49:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000083984_42999808.pth... [2023-03-12 02:49:21,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000083384_42692608.pth [2023-03-12 02:49:21,672][124793] Updated weights for policy 0, policy_version 84000 (0.0005) [2023-03-12 02:49:25,673][124793] Updated weights for policy 0, policy_version 84080 (0.0004) [2023-03-12 02:49:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10122.0). Total num frames: 43048960. Throughput: 0: 10120.7. Samples: 43048060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:49:26,005][124505] Avg episode reward: [(0, '4590.585')] [2023-03-12 02:49:29,789][124793] Updated weights for policy 0, policy_version 84160 (0.0005) [2023-03-12 02:49:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 10108.1). Total num frames: 43098112. Throughput: 0: 10146.2. Samples: 43078616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:49:31,005][124505] Avg episode reward: [(0, '4597.428')] [2023-03-12 02:49:34,004][124793] Updated weights for policy 0, policy_version 84240 (0.0006) [2023-03-12 02:49:36,005][124505] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 10094.2). Total num frames: 43147264. Throughput: 0: 10137.4. Samples: 43136112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:49:36,005][124505] Avg episode reward: [(0, '4594.792')] [2023-03-12 02:49:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000084272_43147264.pth... [2023-03-12 02:49:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000083688_42848256.pth [2023-03-12 02:49:38,344][124793] Updated weights for policy 0, policy_version 84320 (0.0005) [2023-03-12 02:49:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10080.3). Total num frames: 43196416. Throughput: 0: 10041.6. Samples: 43193172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:49:41,005][124505] Avg episode reward: [(0, '4599.289')] [2023-03-12 02:49:42,608][124793] Updated weights for policy 0, policy_version 84400 (0.0005) [2023-03-12 02:49:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 10066.4). Total num frames: 43245568. Throughput: 0: 10010.9. Samples: 43222224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:49:46,005][124505] Avg episode reward: [(0, '4595.210')] [2023-03-12 02:49:46,873][124793] Updated weights for policy 0, policy_version 84480 (0.0006) [2023-03-12 02:49:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9966.9, 300 sec: 10052.6). Total num frames: 43290624. Throughput: 0: 9897.0. Samples: 43279976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:49:51,006][124505] Avg episode reward: [(0, '4580.511')] [2023-03-12 02:49:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000084552_43290624.pth... [2023-03-12 02:49:51,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000083984_42999808.pth [2023-03-12 02:49:51,053][124793] Updated weights for policy 0, policy_version 84560 (0.0005) [2023-03-12 02:49:55,164][124793] Updated weights for policy 0, policy_version 84640 (0.0004) [2023-03-12 02:49:56,005][124505] Fps is (10 sec: 9830.5, 60 sec: 10035.2, 300 sec: 10066.4). Total num frames: 43343872. Throughput: 0: 9862.4. Samples: 43339840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:49:56,005][124505] Avg episode reward: [(0, '4592.749')] [2023-03-12 02:49:59,224][124793] Updated weights for policy 0, policy_version 84720 (0.0005) [2023-03-12 02:50:01,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 10052.6). Total num frames: 43393024. Throughput: 0: 9862.4. Samples: 43370212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:50:01,005][124505] Avg episode reward: [(0, '4599.156')] [2023-03-12 02:50:03,299][124793] Updated weights for policy 0, policy_version 84800 (0.0005) [2023-03-12 02:50:06,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 10052.6). Total num frames: 43442176. Throughput: 0: 9839.1. Samples: 43429984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:50:06,006][124505] Avg episode reward: [(0, '4603.272')] [2023-03-12 02:50:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000084848_43442176.pth... [2023-03-12 02:50:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000084272_43147264.pth [2023-03-12 02:50:07,479][124793] Updated weights for policy 0, policy_version 84880 (0.0005) [2023-03-12 02:50:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 10052.6). Total num frames: 43491328. Throughput: 0: 9799.9. Samples: 43489056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:50:11,005][124505] Avg episode reward: [(0, '4606.011')] [2023-03-12 02:50:11,617][124793] Updated weights for policy 0, policy_version 84960 (0.0005) [2023-03-12 02:50:15,857][124793] Updated weights for policy 0, policy_version 85040 (0.0005) [2023-03-12 02:50:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 10052.6). Total num frames: 43540480. Throughput: 0: 9800.5. Samples: 43519640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:50:16,005][124505] Avg episode reward: [(0, '4588.877')] [2023-03-12 02:50:20,271][124793] Updated weights for policy 0, policy_version 85120 (0.0005) [2023-03-12 02:50:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 10024.8). Total num frames: 43585536. Throughput: 0: 9762.6. Samples: 43575428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:50:21,005][124505] Avg episode reward: [(0, '4600.751')] [2023-03-12 02:50:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000085128_43585536.pth... [2023-03-12 02:50:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000084552_43290624.pth [2023-03-12 02:50:24,418][124793] Updated weights for policy 0, policy_version 85200 (0.0005) [2023-03-12 02:50:26,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 10038.7). Total num frames: 43638784. Throughput: 0: 9808.4. Samples: 43634548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:50:26,005][124505] Avg episode reward: [(0, '4585.942')] [2023-03-12 02:50:28,447][124793] Updated weights for policy 0, policy_version 85280 (0.0005) [2023-03-12 02:50:31,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 10024.8). Total num frames: 43687936. Throughput: 0: 9827.4. Samples: 43664456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:50:31,005][124505] Avg episode reward: [(0, '4568.418')] [2023-03-12 02:50:32,403][124793] Updated weights for policy 0, policy_version 85360 (0.0004) [2023-03-12 02:50:36,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 10038.7). Total num frames: 43741184. Throughput: 0: 9933.1. Samples: 43726964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:50:36,005][124505] Avg episode reward: [(0, '4591.494')] [2023-03-12 02:50:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000085432_43741184.pth... [2023-03-12 02:50:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000084848_43442176.pth [2023-03-12 02:50:36,404][124793] Updated weights for policy 0, policy_version 85440 (0.0004) [2023-03-12 02:50:40,788][124793] Updated weights for policy 0, policy_version 85520 (0.0004) [2023-03-12 02:50:41,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 10024.8). Total num frames: 43786240. Throughput: 0: 9882.2. Samples: 43784540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:50:41,005][124505] Avg episode reward: [(0, '4595.846')] [2023-03-12 02:50:45,208][124793] Updated weights for policy 0, policy_version 85600 (0.0005) [2023-03-12 02:50:46,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9762.1, 300 sec: 10010.9). Total num frames: 43831296. Throughput: 0: 9813.7. Samples: 43811828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:50:46,005][124505] Avg episode reward: [(0, '4599.955')] [2023-03-12 02:50:49,608][124793] Updated weights for policy 0, policy_version 85680 (0.0005) [2023-03-12 02:50:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 10010.9). Total num frames: 43880448. Throughput: 0: 9737.4. Samples: 43868168. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:50:51,005][124505] Avg episode reward: [(0, '4587.484')] [2023-03-12 02:50:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000085704_43880448.pth... [2023-03-12 02:50:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000085128_43585536.pth [2023-03-12 02:50:54,033][124793] Updated weights for policy 0, policy_version 85760 (0.0005) [2023-03-12 02:50:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9983.1). Total num frames: 43925504. Throughput: 0: 9651.8. Samples: 43923388. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:50:56,005][124505] Avg episode reward: [(0, '4591.955')] [2023-03-12 02:50:58,367][124793] Updated weights for policy 0, policy_version 85840 (0.0005) [2023-03-12 02:51:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9983.1). Total num frames: 43974656. Throughput: 0: 9609.8. Samples: 43952080. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:51:01,005][124505] Avg episode reward: [(0, '4536.083')] [2023-03-12 02:51:02,549][124793] Updated weights for policy 0, policy_version 85920 (0.0004) [2023-03-12 02:51:06,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9983.1). Total num frames: 44023808. Throughput: 0: 9685.1. Samples: 44011256. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:51:06,005][124505] Avg episode reward: [(0, '4505.226')] [2023-03-12 02:51:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000085984_44023808.pth... [2023-03-12 02:51:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000085432_43741184.pth [2023-03-12 02:51:06,739][124793] Updated weights for policy 0, policy_version 86000 (0.0005) [2023-03-12 02:51:10,855][124793] Updated weights for policy 0, policy_version 86080 (0.0004) [2023-03-12 02:51:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9969.2). Total num frames: 44072960. Throughput: 0: 9679.0. Samples: 44070104. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:51:11,005][124505] Avg episode reward: [(0, '4542.193')] [2023-03-12 02:51:14,902][124793] Updated weights for policy 0, policy_version 86160 (0.0004) [2023-03-12 02:51:16,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9955.4). Total num frames: 44122112. Throughput: 0: 9693.8. Samples: 44100676. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:51:16,005][124505] Avg episode reward: [(0, '4571.775')] [2023-03-12 02:51:19,009][124793] Updated weights for policy 0, policy_version 86240 (0.0004) [2023-03-12 02:51:21,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9955.4). Total num frames: 44171264. Throughput: 0: 9626.9. Samples: 44160172. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:51:21,005][124505] Avg episode reward: [(0, '4535.633')] [2023-03-12 02:51:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000086272_44171264.pth... [2023-03-12 02:51:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000085704_43880448.pth [2023-03-12 02:51:23,322][124793] Updated weights for policy 0, policy_version 86320 (0.0005) [2023-03-12 02:51:26,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9927.6). Total num frames: 44216320. Throughput: 0: 9596.7. Samples: 44216392. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:51:26,005][124505] Avg episode reward: [(0, '4596.605')] [2023-03-12 02:51:27,774][124793] Updated weights for policy 0, policy_version 86400 (0.0005) [2023-03-12 02:51:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9927.6). Total num frames: 44265472. Throughput: 0: 9621.6. Samples: 44244800. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:51:31,005][124505] Avg episode reward: [(0, '4580.861')] [2023-03-12 02:51:32,008][124793] Updated weights for policy 0, policy_version 86480 (0.0004) [2023-03-12 02:51:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9913.7). Total num frames: 44314624. Throughput: 0: 9671.6. Samples: 44303392. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:51:36,005][124505] Avg episode reward: [(0, '4587.827')] [2023-03-12 02:51:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000086552_44314624.pth... [2023-03-12 02:51:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000085984_44023808.pth [2023-03-12 02:51:36,156][124793] Updated weights for policy 0, policy_version 86560 (0.0004) [2023-03-12 02:51:40,373][124793] Updated weights for policy 0, policy_version 86640 (0.0004) [2023-03-12 02:51:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9913.7). Total num frames: 44363776. Throughput: 0: 9743.4. Samples: 44361840. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 02:51:41,016][124505] Avg episode reward: [(0, '4560.135')] [2023-03-12 02:51:44,552][124793] Updated weights for policy 0, policy_version 86720 (0.0004) [2023-03-12 02:51:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9913.7). Total num frames: 44412928. Throughput: 0: 9763.6. Samples: 44391444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:51:46,016][124505] Avg episode reward: [(0, '4499.109')] [2023-03-12 02:51:48,787][124793] Updated weights for policy 0, policy_version 86800 (0.0004) [2023-03-12 02:51:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.8, 300 sec: 9899.8). Total num frames: 44462080. Throughput: 0: 9745.2. Samples: 44449792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:51:51,016][124505] Avg episode reward: [(0, '4587.825')] [2023-03-12 02:51:51,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000086840_44462080.pth... [2023-03-12 02:51:51,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000086272_44171264.pth [2023-03-12 02:51:52,912][124793] Updated weights for policy 0, policy_version 86880 (0.0004) [2023-03-12 02:51:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9885.9). Total num frames: 44511232. Throughput: 0: 9729.7. Samples: 44507940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:51:56,016][124505] Avg episode reward: [(0, '4593.411')] [2023-03-12 02:51:57,228][124793] Updated weights for policy 0, policy_version 86960 (0.0004) [2023-03-12 02:52:01,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9858.2). Total num frames: 44556288. Throughput: 0: 9674.0. Samples: 44536008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:52:01,016][124505] Avg episode reward: [(0, '4520.430')] [2023-03-12 02:52:01,650][124793] Updated weights for policy 0, policy_version 87040 (0.0005) [2023-03-12 02:52:06,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9625.6, 300 sec: 9844.3). Total num frames: 44601344. Throughput: 0: 9602.9. Samples: 44592304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:52:06,016][124505] Avg episode reward: [(0, '4393.188')] [2023-03-12 02:52:06,078][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000087120_44605440.pth... [2023-03-12 02:52:06,079][124793] Updated weights for policy 0, policy_version 87120 (0.0005) [2023-03-12 02:52:06,080][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000086552_44314624.pth [2023-03-12 02:52:10,643][124793] Updated weights for policy 0, policy_version 87200 (0.0005) [2023-03-12 02:52:11,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9830.4). Total num frames: 44646400. Throughput: 0: 9555.7. Samples: 44646400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:52:11,016][124505] Avg episode reward: [(0, '4436.121')] [2023-03-12 02:52:15,089][124793] Updated weights for policy 0, policy_version 87280 (0.0005) [2023-03-12 02:52:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9830.4). Total num frames: 44695552. Throughput: 0: 9533.5. Samples: 44673808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:52:16,016][124505] Avg episode reward: [(0, '4590.209')] [2023-03-12 02:52:19,584][124793] Updated weights for policy 0, policy_version 87360 (0.0005) [2023-03-12 02:52:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9802.6). Total num frames: 44740608. Throughput: 0: 9444.3. Samples: 44728384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:52:21,015][124505] Avg episode reward: [(0, '4582.479')] [2023-03-12 02:52:21,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000087384_44740608.pth... [2023-03-12 02:52:21,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000086840_44462080.pth [2023-03-12 02:52:24,145][124793] Updated weights for policy 0, policy_version 87440 (0.0005) [2023-03-12 02:52:26,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9788.7). Total num frames: 44785664. Throughput: 0: 9357.3. Samples: 44782916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:52:26,005][124505] Avg episode reward: [(0, '4579.091')] [2023-03-12 02:52:28,485][124793] Updated weights for policy 0, policy_version 87520 (0.0004) [2023-03-12 02:52:31,005][124505] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9761.0). Total num frames: 44830720. Throughput: 0: 9324.5. Samples: 44811048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:52:31,016][124505] Avg episode reward: [(0, '4584.732')] [2023-03-12 02:52:32,836][124793] Updated weights for policy 0, policy_version 87600 (0.0004) [2023-03-12 02:52:36,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9733.2). Total num frames: 44875776. Throughput: 0: 9279.2. Samples: 44867356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:52:36,016][124505] Avg episode reward: [(0, '4583.395')] [2023-03-12 02:52:36,020][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000087648_44875776.pth... [2023-03-12 02:52:36,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000087120_44605440.pth [2023-03-12 02:52:37,350][124793] Updated weights for policy 0, policy_version 87680 (0.0004) [2023-03-12 02:52:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9733.2). Total num frames: 44924928. Throughput: 0: 9198.5. Samples: 44921872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:52:41,005][124505] Avg episode reward: [(0, '4581.668')] [2023-03-12 02:52:41,847][124793] Updated weights for policy 0, policy_version 87760 (0.0005) [2023-03-12 02:52:46,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9705.4). Total num frames: 44965888. Throughput: 0: 9163.6. Samples: 44948372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:52:46,005][124505] Avg episode reward: [(0, '4586.920')] [2023-03-12 02:52:46,552][124793] Updated weights for policy 0, policy_version 87840 (0.0005) [2023-03-12 02:52:51,005][124505] Fps is (10 sec: 8601.6, 60 sec: 9147.7, 300 sec: 9691.6). Total num frames: 45010944. Throughput: 0: 9067.3. Samples: 45000332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:52:51,005][124505] Avg episode reward: [(0, '4572.819')] [2023-03-12 02:52:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000087912_45010944.pth... [2023-03-12 02:52:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000087384_44740608.pth [2023-03-12 02:52:51,245][124793] Updated weights for policy 0, policy_version 87920 (0.0005) [2023-03-12 02:52:55,728][124793] Updated weights for policy 0, policy_version 88000 (0.0005) [2023-03-12 02:52:56,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9677.7). Total num frames: 45056000. Throughput: 0: 9081.1. Samples: 45055048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:52:56,005][124505] Avg episode reward: [(0, '4561.127')] [2023-03-12 02:53:00,161][124793] Updated weights for policy 0, policy_version 88080 (0.0003) [2023-03-12 02:53:01,005][124505] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9677.7). Total num frames: 45101056. Throughput: 0: 9076.0. Samples: 45082228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:53:01,005][124505] Avg episode reward: [(0, '4581.404')] [2023-03-12 02:53:04,673][124793] Updated weights for policy 0, policy_version 88160 (0.0004) [2023-03-12 02:53:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9677.7). Total num frames: 45150208. Throughput: 0: 9085.2. Samples: 45137220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:53:06,006][124505] Avg episode reward: [(0, '4532.641')] [2023-03-12 02:53:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000088184_45150208.pth... [2023-03-12 02:53:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000087648_44875776.pth [2023-03-12 02:53:09,025][124793] Updated weights for policy 0, policy_version 88240 (0.0004) [2023-03-12 02:53:11,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9663.8). Total num frames: 45195264. Throughput: 0: 9140.5. Samples: 45194240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:53:11,005][124505] Avg episode reward: [(0, '4520.557')] [2023-03-12 02:53:13,324][124793] Updated weights for policy 0, policy_version 88320 (0.0004) [2023-03-12 02:53:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9649.9). Total num frames: 45244416. Throughput: 0: 9146.9. Samples: 45222660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:53:16,006][124505] Avg episode reward: [(0, '4511.896')] [2023-03-12 02:53:17,621][124793] Updated weights for policy 0, policy_version 88400 (0.0005) [2023-03-12 02:53:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9636.0). Total num frames: 45289472. Throughput: 0: 9142.0. Samples: 45278748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:53:21,005][124505] Avg episode reward: [(0, '4567.283')] [2023-03-12 02:53:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000088456_45289472.pth... [2023-03-12 02:53:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000087912_45010944.pth [2023-03-12 02:53:22,087][124793] Updated weights for policy 0, policy_version 88480 (0.0006) [2023-03-12 02:53:26,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9608.2). Total num frames: 45334528. Throughput: 0: 9150.1. Samples: 45333628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:53:26,005][124505] Avg episode reward: [(0, '4576.531')] [2023-03-12 02:53:26,614][124793] Updated weights for policy 0, policy_version 88560 (0.0005) [2023-03-12 02:53:31,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9608.2). Total num frames: 45379584. Throughput: 0: 9171.6. Samples: 45361092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:53:31,005][124505] Avg episode reward: [(0, '4576.509')] [2023-03-12 02:53:31,043][124793] Updated weights for policy 0, policy_version 88640 (0.0005) [2023-03-12 02:53:35,485][124793] Updated weights for policy 0, policy_version 88720 (0.0005) [2023-03-12 02:53:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9608.2). Total num frames: 45428736. Throughput: 0: 9248.6. Samples: 45416520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:53:36,005][124505] Avg episode reward: [(0, '4580.075')] [2023-03-12 02:53:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000088728_45428736.pth... [2023-03-12 02:53:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000088184_45150208.pth [2023-03-12 02:53:40,056][124793] Updated weights for policy 0, policy_version 88800 (0.0005) [2023-03-12 02:53:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9594.4). Total num frames: 45473792. Throughput: 0: 9223.0. Samples: 45470084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:53:41,005][124505] Avg episode reward: [(0, '4583.939')] [2023-03-12 02:53:44,505][124793] Updated weights for policy 0, policy_version 88880 (0.0005) [2023-03-12 02:53:46,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9580.5). Total num frames: 45518848. Throughput: 0: 9231.8. Samples: 45497660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:53:46,005][124505] Avg episode reward: [(0, '4587.336')] [2023-03-12 02:53:48,926][124793] Updated weights for policy 0, policy_version 88960 (0.0005) [2023-03-12 02:53:51,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9566.6). Total num frames: 45563904. Throughput: 0: 9258.0. Samples: 45553828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:53:51,005][124505] Avg episode reward: [(0, '4590.592')] [2023-03-12 02:53:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000088992_45563904.pth... [2023-03-12 02:53:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000088456_45289472.pth [2023-03-12 02:53:53,169][124793] Updated weights for policy 0, policy_version 89040 (0.0004) [2023-03-12 02:53:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9552.7). Total num frames: 45613056. Throughput: 0: 9247.0. Samples: 45610356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:53:56,016][124505] Avg episode reward: [(0, '4592.872')] [2023-03-12 02:53:57,637][124793] Updated weights for policy 0, policy_version 89120 (0.0004) [2023-03-12 02:54:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9524.9). Total num frames: 45658112. Throughput: 0: 9230.2. Samples: 45638020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:54:01,016][124505] Avg episode reward: [(0, '4589.822')] [2023-03-12 02:54:01,874][124793] Updated weights for policy 0, policy_version 89200 (0.0005) [2023-03-12 02:54:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9524.9). Total num frames: 45707264. Throughput: 0: 9289.0. Samples: 45696752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:54:06,016][124505] Avg episode reward: [(0, '4591.885')] [2023-03-12 02:54:06,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000089272_45707264.pth... [2023-03-12 02:54:06,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000088728_45428736.pth [2023-03-12 02:54:06,081][124793] Updated weights for policy 0, policy_version 89280 (0.0004) [2023-03-12 02:54:10,452][124793] Updated weights for policy 0, policy_version 89360 (0.0004) [2023-03-12 02:54:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9511.1). Total num frames: 45756416. Throughput: 0: 9332.2. Samples: 45753576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:54:11,016][124505] Avg episode reward: [(0, '4571.817')] [2023-03-12 02:54:14,895][124793] Updated weights for policy 0, policy_version 89440 (0.0004) [2023-03-12 02:54:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9497.2). Total num frames: 45801472. Throughput: 0: 9332.7. Samples: 45781064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:54:16,016][124505] Avg episode reward: [(0, '4585.607')] [2023-03-12 02:54:19,343][124793] Updated weights for policy 0, policy_version 89520 (0.0005) [2023-03-12 02:54:21,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9483.3). Total num frames: 45846528. Throughput: 0: 9333.9. Samples: 45836544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:54:21,016][124505] Avg episode reward: [(0, '4592.275')] [2023-03-12 02:54:21,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000089544_45846528.pth... [2023-03-12 02:54:21,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000088992_45563904.pth [2023-03-12 02:54:23,766][124793] Updated weights for policy 0, policy_version 89600 (0.0005) [2023-03-12 02:54:26,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 45895680. Throughput: 0: 9377.0. Samples: 45892048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:54:26,016][124505] Avg episode reward: [(0, '4587.647')] [2023-03-12 02:54:28,168][124793] Updated weights for policy 0, policy_version 89680 (0.0005) [2023-03-12 02:54:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9469.4). Total num frames: 45940736. Throughput: 0: 9391.2. Samples: 45920264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:54:31,016][124505] Avg episode reward: [(0, '4594.645')] [2023-03-12 02:54:32,361][124793] Updated weights for policy 0, policy_version 89760 (0.0004) [2023-03-12 02:54:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9469.4). Total num frames: 45989888. Throughput: 0: 9444.8. Samples: 45978844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:54:36,016][124505] Avg episode reward: [(0, '4592.403')] [2023-03-12 02:54:36,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000089824_45989888.pth... [2023-03-12 02:54:36,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000089272_45707264.pth [2023-03-12 02:54:36,584][124793] Updated weights for policy 0, policy_version 89840 (0.0005) [2023-03-12 02:54:40,940][124793] Updated weights for policy 0, policy_version 89920 (0.0005) [2023-03-12 02:54:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 46039040. Throughput: 0: 9446.2. Samples: 46035436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:54:41,016][124505] Avg episode reward: [(0, '4595.168')] [2023-03-12 02:54:45,244][124793] Updated weights for policy 0, policy_version 90000 (0.0005) [2023-03-12 02:54:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 46084096. Throughput: 0: 9459.1. Samples: 46063680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:54:46,016][124505] Avg episode reward: [(0, '4594.966')] [2023-03-12 02:54:49,638][124793] Updated weights for policy 0, policy_version 90080 (0.0006) [2023-03-12 02:54:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9455.5). Total num frames: 46133248. Throughput: 0: 9422.1. Samples: 46120748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:54:51,016][124505] Avg episode reward: [(0, '4598.212')] [2023-03-12 02:54:51,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000090104_46133248.pth... [2023-03-12 02:54:51,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000089544_45846528.pth [2023-03-12 02:54:53,641][124793] Updated weights for policy 0, policy_version 90160 (0.0005) [2023-03-12 02:54:56,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9455.5). Total num frames: 46182400. Throughput: 0: 9508.4. Samples: 46181452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:54:56,005][124505] Avg episode reward: [(0, '4607.408')] [2023-03-12 02:54:57,729][124793] Updated weights for policy 0, policy_version 90240 (0.0005) [2023-03-12 02:55:01,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9557.3, 300 sec: 9455.5). Total num frames: 46231552. Throughput: 0: 9557.2. Samples: 46211136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:55:01,005][124505] Avg episode reward: [(0, '4599.594')] [2023-03-12 02:55:02,096][124793] Updated weights for policy 0, policy_version 90320 (0.0005) [2023-03-12 02:55:06,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 46276608. Throughput: 0: 9572.5. Samples: 46267308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:55:06,005][124505] Avg episode reward: [(0, '4537.597')] [2023-03-12 02:55:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000090384_46276608.pth... [2023-03-12 02:55:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000089824_45989888.pth [2023-03-12 02:55:06,549][124793] Updated weights for policy 0, policy_version 90400 (0.0005) [2023-03-12 02:55:10,898][124793] Updated weights for policy 0, policy_version 90480 (0.0005) [2023-03-12 02:55:11,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 46325760. Throughput: 0: 9574.9. Samples: 46322920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:55:11,016][124505] Avg episode reward: [(0, '4599.219')] [2023-03-12 02:55:15,171][124793] Updated weights for policy 0, policy_version 90560 (0.0004) [2023-03-12 02:55:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 46370816. Throughput: 0: 9586.5. Samples: 46351656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:55:16,016][124505] Avg episode reward: [(0, '4560.175')] [2023-03-12 02:55:19,491][124793] Updated weights for policy 0, policy_version 90640 (0.0005) [2023-03-12 02:55:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9427.7). Total num frames: 46419968. Throughput: 0: 9547.5. Samples: 46408480. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:55:21,016][124505] Avg episode reward: [(0, '4488.413')] [2023-03-12 02:55:21,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000090664_46419968.pth... [2023-03-12 02:55:21,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000090104_46133248.pth [2023-03-12 02:55:23,802][124793] Updated weights for policy 0, policy_version 90720 (0.0005) [2023-03-12 02:55:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9427.7). Total num frames: 46469120. Throughput: 0: 9563.1. Samples: 46465776. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:55:26,016][124505] Avg episode reward: [(0, '4596.158')] [2023-03-12 02:55:28,033][124793] Updated weights for policy 0, policy_version 90800 (0.0005) [2023-03-12 02:55:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9413.9). Total num frames: 46518272. Throughput: 0: 9578.9. Samples: 46494732. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:55:31,019][124505] Avg episode reward: [(0, '4606.171')] [2023-03-12 02:55:32,257][124793] Updated weights for policy 0, policy_version 90880 (0.0005) [2023-03-12 02:55:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9413.9). Total num frames: 46563328. Throughput: 0: 9615.7. Samples: 46553456. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:55:36,016][124505] Avg episode reward: [(0, '4604.465')] [2023-03-12 02:55:36,071][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000090952_46567424.pth... [2023-03-12 02:55:36,072][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000090384_46276608.pth [2023-03-12 02:55:36,521][124793] Updated weights for policy 0, policy_version 90960 (0.0005) [2023-03-12 02:55:40,772][124793] Updated weights for policy 0, policy_version 91040 (0.0005) [2023-03-12 02:55:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9427.7). Total num frames: 46612480. Throughput: 0: 9550.0. Samples: 46611200. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:55:41,016][124505] Avg episode reward: [(0, '4602.240')] [2023-03-12 02:55:45,068][124793] Updated weights for policy 0, policy_version 91120 (0.0005) [2023-03-12 02:55:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9427.7). Total num frames: 46661632. Throughput: 0: 9522.7. Samples: 46639656. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:55:46,005][124505] Avg episode reward: [(0, '4538.854')] [2023-03-12 02:55:49,299][124793] Updated weights for policy 0, policy_version 91200 (0.0005) [2023-03-12 02:55:51,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9441.6). Total num frames: 46710784. Throughput: 0: 9557.5. Samples: 46697396. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:55:51,005][124505] Avg episode reward: [(0, '4576.758')] [2023-03-12 02:55:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000091232_46710784.pth... [2023-03-12 02:55:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000090664_46419968.pth [2023-03-12 02:55:53,577][124793] Updated weights for policy 0, policy_version 91280 (0.0005) [2023-03-12 02:55:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9427.7). Total num frames: 46755840. Throughput: 0: 9592.5. Samples: 46754584. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:55:56,005][124505] Avg episode reward: [(0, '4578.173')] [2023-03-12 02:55:57,880][124793] Updated weights for policy 0, policy_version 91360 (0.0005) [2023-03-12 02:56:01,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9427.7). Total num frames: 46804992. Throughput: 0: 9590.7. Samples: 46783236. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:56:01,005][124505] Avg episode reward: [(0, '4591.466')] [2023-03-12 02:56:02,234][124793] Updated weights for policy 0, policy_version 91440 (0.0005) [2023-03-12 02:56:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9413.9). Total num frames: 46850048. Throughput: 0: 9585.6. Samples: 46839832. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:56:06,005][124505] Avg episode reward: [(0, '4587.967')] [2023-03-12 02:56:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000091504_46850048.pth... [2023-03-12 02:56:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000090952_46567424.pth [2023-03-12 02:56:06,532][124793] Updated weights for policy 0, policy_version 91520 (0.0005) [2023-03-12 02:56:10,872][124793] Updated weights for policy 0, policy_version 91600 (0.0005) [2023-03-12 02:56:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9413.9). Total num frames: 46899200. Throughput: 0: 9561.1. Samples: 46896024. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 02:56:11,005][124505] Avg episode reward: [(0, '4567.228')] [2023-03-12 02:56:15,183][124793] Updated weights for policy 0, policy_version 91680 (0.0005) [2023-03-12 02:56:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 46944256. Throughput: 0: 9561.7. Samples: 46925008. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:56:16,005][124505] Avg episode reward: [(0, '4525.090')] [2023-03-12 02:56:19,592][124793] Updated weights for policy 0, policy_version 91760 (0.0005) [2023-03-12 02:56:21,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9413.9). Total num frames: 46993408. Throughput: 0: 9503.8. Samples: 46981128. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:56:21,005][124505] Avg episode reward: [(0, '4526.528')] [2023-03-12 02:56:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000091784_46993408.pth... [2023-03-12 02:56:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000091232_46710784.pth [2023-03-12 02:56:23,905][124793] Updated weights for policy 0, policy_version 91840 (0.0005) [2023-03-12 02:56:26,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9489.0, 300 sec: 9400.0). Total num frames: 47038464. Throughput: 0: 9494.9. Samples: 47038472. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:56:26,006][124505] Avg episode reward: [(0, '4467.745')] [2023-03-12 02:56:28,192][124793] Updated weights for policy 0, policy_version 91920 (0.0005) [2023-03-12 02:56:31,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 47087616. Throughput: 0: 9499.7. Samples: 47067144. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:56:31,005][124505] Avg episode reward: [(0, '4513.505')] [2023-03-12 02:56:32,454][124793] Updated weights for policy 0, policy_version 92000 (0.0005) [2023-03-12 02:56:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 47136768. Throughput: 0: 9492.2. Samples: 47124544. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:56:36,006][124505] Avg episode reward: [(0, '4466.433')] [2023-03-12 02:56:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000092064_47136768.pth... [2023-03-12 02:56:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000091504_46850048.pth [2023-03-12 02:56:36,775][124793] Updated weights for policy 0, policy_version 92080 (0.0005) [2023-03-12 02:56:41,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 47181824. Throughput: 0: 9470.9. Samples: 47180776. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:56:41,005][124505] Avg episode reward: [(0, '4516.851')] [2023-03-12 02:56:41,214][124793] Updated weights for policy 0, policy_version 92160 (0.0005) [2023-03-12 02:56:45,662][124793] Updated weights for policy 0, policy_version 92240 (0.0005) [2023-03-12 02:56:46,005][124505] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 47226880. Throughput: 0: 9427.5. Samples: 47207476. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:56:46,005][124505] Avg episode reward: [(0, '4534.903')] [2023-03-12 02:56:49,988][124793] Updated weights for policy 0, policy_version 92320 (0.0005) [2023-03-12 02:56:51,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 47276032. Throughput: 0: 9426.7. Samples: 47264036. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:56:51,006][124505] Avg episode reward: [(0, '4570.914')] [2023-03-12 02:56:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000092336_47276032.pth... [2023-03-12 02:56:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000091784_46993408.pth [2023-03-12 02:56:54,290][124793] Updated weights for policy 0, policy_version 92400 (0.0005) [2023-03-12 02:56:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 47321088. Throughput: 0: 9447.3. Samples: 47321152. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:56:56,005][124505] Avg episode reward: [(0, '4586.321')] [2023-03-12 02:56:58,544][124793] Updated weights for policy 0, policy_version 92480 (0.0005) [2023-03-12 02:57:01,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 47370240. Throughput: 0: 9441.3. Samples: 47349864. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:57:01,005][124505] Avg episode reward: [(0, '4550.618')] [2023-03-12 02:57:02,744][124793] Updated weights for policy 0, policy_version 92560 (0.0005) [2023-03-12 02:57:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 47419392. Throughput: 0: 9491.6. Samples: 47408248. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:57:06,005][124505] Avg episode reward: [(0, '4582.892')] [2023-03-12 02:57:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000092616_47419392.pth... [2023-03-12 02:57:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000092064_47136768.pth [2023-03-12 02:57:07,024][124793] Updated weights for policy 0, policy_version 92640 (0.0005) [2023-03-12 02:57:11,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 47468544. Throughput: 0: 9514.5. Samples: 47466624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:57:11,005][124505] Avg episode reward: [(0, '4594.336')] [2023-03-12 02:57:11,268][124793] Updated weights for policy 0, policy_version 92720 (0.0005) [2023-03-12 02:57:15,611][124793] Updated weights for policy 0, policy_version 92800 (0.0005) [2023-03-12 02:57:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 47513600. Throughput: 0: 9496.2. Samples: 47494476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:57:16,005][124505] Avg episode reward: [(0, '4572.015')] [2023-03-12 02:57:19,968][124793] Updated weights for policy 0, policy_version 92880 (0.0005) [2023-03-12 02:57:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 47562752. Throughput: 0: 9473.8. Samples: 47550864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:57:21,006][124505] Avg episode reward: [(0, '4536.859')] [2023-03-12 02:57:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000092896_47562752.pth... [2023-03-12 02:57:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000092336_47276032.pth [2023-03-12 02:57:24,437][124793] Updated weights for policy 0, policy_version 92960 (0.0005) [2023-03-12 02:57:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 47607808. Throughput: 0: 9468.3. Samples: 47606848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:57:26,005][124505] Avg episode reward: [(0, '4573.784')] [2023-03-12 02:57:28,744][124793] Updated weights for policy 0, policy_version 93040 (0.0005) [2023-03-12 02:57:31,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 47656960. Throughput: 0: 9507.4. Samples: 47635308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:57:31,005][124505] Avg episode reward: [(0, '4573.313')] [2023-03-12 02:57:33,064][124793] Updated weights for policy 0, policy_version 93120 (0.0005) [2023-03-12 02:57:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 47702016. Throughput: 0: 9499.9. Samples: 47691532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:57:36,005][124505] Avg episode reward: [(0, '4569.496')] [2023-03-12 02:57:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000093168_47702016.pth... [2023-03-12 02:57:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000092616_47419392.pth [2023-03-12 02:57:37,535][124793] Updated weights for policy 0, policy_version 93200 (0.0005) [2023-03-12 02:57:41,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 47747072. Throughput: 0: 9466.3. Samples: 47747136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:57:41,005][124505] Avg episode reward: [(0, '4591.831')] [2023-03-12 02:57:41,915][124793] Updated weights for policy 0, policy_version 93280 (0.0005) [2023-03-12 02:57:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 47796224. Throughput: 0: 9455.1. Samples: 47775344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:57:46,005][124505] Avg episode reward: [(0, '4586.216')] [2023-03-12 02:57:46,353][124793] Updated weights for policy 0, policy_version 93360 (0.0005) [2023-03-12 02:57:50,657][124793] Updated weights for policy 0, policy_version 93440 (0.0005) [2023-03-12 02:57:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 47841280. Throughput: 0: 9391.8. Samples: 47830880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:57:51,005][124505] Avg episode reward: [(0, '4570.731')] [2023-03-12 02:57:51,071][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000093448_47845376.pth... [2023-03-12 02:57:51,073][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000092896_47562752.pth [2023-03-12 02:57:55,007][124793] Updated weights for policy 0, policy_version 93520 (0.0005) [2023-03-12 02:57:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9455.5). Total num frames: 47890432. Throughput: 0: 9356.5. Samples: 47887664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:57:56,005][124505] Avg episode reward: [(0, '4577.475')] [2023-03-12 02:57:59,350][124793] Updated weights for policy 0, policy_version 93600 (0.0005) [2023-03-12 02:58:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 47935488. Throughput: 0: 9364.6. Samples: 47915884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:58:01,005][124505] Avg episode reward: [(0, '4590.367')] [2023-03-12 02:58:03,715][124793] Updated weights for policy 0, policy_version 93680 (0.0005) [2023-03-12 02:58:06,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 47984640. Throughput: 0: 9367.8. Samples: 47972416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:58:06,005][124505] Avg episode reward: [(0, '4576.616')] [2023-03-12 02:58:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000093720_47984640.pth... [2023-03-12 02:58:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000093168_47702016.pth [2023-03-12 02:58:07,961][124793] Updated weights for policy 0, policy_version 93760 (0.0005) [2023-03-12 02:58:11,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 48033792. Throughput: 0: 9407.1. Samples: 48030168. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:58:11,005][124505] Avg episode reward: [(0, '4582.373')] [2023-03-12 02:58:12,196][124793] Updated weights for policy 0, policy_version 93840 (0.0005) [2023-03-12 02:58:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 48078848. Throughput: 0: 9432.4. Samples: 48059768. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:58:16,005][124505] Avg episode reward: [(0, '4586.542')] [2023-03-12 02:58:16,455][124793] Updated weights for policy 0, policy_version 93920 (0.0005) [2023-03-12 02:58:20,740][124793] Updated weights for policy 0, policy_version 94000 (0.0005) [2023-03-12 02:58:21,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 48128000. Throughput: 0: 9435.3. Samples: 48116120. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:58:21,006][124505] Avg episode reward: [(0, '4400.764')] [2023-03-12 02:58:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000094000_48128000.pth... [2023-03-12 02:58:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000093448_47845376.pth [2023-03-12 02:58:24,927][124793] Updated weights for policy 0, policy_version 94080 (0.0005) [2023-03-12 02:58:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9483.3). Total num frames: 48177152. Throughput: 0: 9523.6. Samples: 48175696. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:58:26,005][124505] Avg episode reward: [(0, '4577.190')] [2023-03-12 02:58:29,118][124793] Updated weights for policy 0, policy_version 94160 (0.0005) [2023-03-12 02:58:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9483.3). Total num frames: 48226304. Throughput: 0: 9548.4. Samples: 48205024. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:58:31,005][124505] Avg episode reward: [(0, '4580.330')] [2023-03-12 02:58:33,332][124793] Updated weights for policy 0, policy_version 94240 (0.0005) [2023-03-12 02:58:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9497.2). Total num frames: 48275456. Throughput: 0: 9608.0. Samples: 48263240. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:58:36,005][124505] Avg episode reward: [(0, '4580.241')] [2023-03-12 02:58:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000094288_48275456.pth... [2023-03-12 02:58:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000093720_47984640.pth [2023-03-12 02:58:37,511][124793] Updated weights for policy 0, policy_version 94320 (0.0005) [2023-03-12 02:58:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9511.1). Total num frames: 48324608. Throughput: 0: 9655.6. Samples: 48322168. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:58:41,005][124505] Avg episode reward: [(0, '4598.545')] [2023-03-12 02:58:41,707][124793] Updated weights for policy 0, policy_version 94400 (0.0005) [2023-03-12 02:58:45,874][124793] Updated weights for policy 0, policy_version 94480 (0.0005) [2023-03-12 02:58:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9524.9). Total num frames: 48373760. Throughput: 0: 9684.6. Samples: 48351692. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:58:46,005][124505] Avg episode reward: [(0, '4604.339')] [2023-03-12 02:58:50,128][124793] Updated weights for policy 0, policy_version 94560 (0.0005) [2023-03-12 02:58:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9524.9). Total num frames: 48422912. Throughput: 0: 9720.6. Samples: 48409844. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:58:51,005][124505] Avg episode reward: [(0, '4603.594')] [2023-03-12 02:58:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000094576_48422912.pth... [2023-03-12 02:58:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000094000_48128000.pth [2023-03-12 02:58:54,379][124793] Updated weights for policy 0, policy_version 94640 (0.0005) [2023-03-12 02:58:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9524.9). Total num frames: 48467968. Throughput: 0: 9726.4. Samples: 48467856. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:58:56,005][124505] Avg episode reward: [(0, '4603.673')] [2023-03-12 02:58:58,532][124793] Updated weights for policy 0, policy_version 94720 (0.0005) [2023-03-12 02:59:01,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9524.9). Total num frames: 48517120. Throughput: 0: 9713.9. Samples: 48496892. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 02:59:01,005][124505] Avg episode reward: [(0, '4600.708')] [2023-03-12 02:59:02,763][124793] Updated weights for policy 0, policy_version 94800 (0.0005) [2023-03-12 02:59:06,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9524.9). Total num frames: 48566272. Throughput: 0: 9763.1. Samples: 48555460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:59:06,005][124505] Avg episode reward: [(0, '4603.187')] [2023-03-12 02:59:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000094856_48566272.pth... [2023-03-12 02:59:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000094288_48275456.pth [2023-03-12 02:59:07,050][124793] Updated weights for policy 0, policy_version 94880 (0.0005) [2023-03-12 02:59:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9538.8). Total num frames: 48615424. Throughput: 0: 9707.6. Samples: 48612536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:59:11,005][124505] Avg episode reward: [(0, '4608.490')] [2023-03-12 02:59:11,360][124793] Updated weights for policy 0, policy_version 94960 (0.0005) [2023-03-12 02:59:15,693][124793] Updated weights for policy 0, policy_version 95040 (0.0005) [2023-03-12 02:59:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9538.8). Total num frames: 48660480. Throughput: 0: 9681.8. Samples: 48640704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:59:16,005][124505] Avg episode reward: [(0, '4591.606')] [2023-03-12 02:59:20,023][124793] Updated weights for policy 0, policy_version 95120 (0.0005) [2023-03-12 02:59:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9538.8). Total num frames: 48709632. Throughput: 0: 9648.2. Samples: 48697408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:59:21,005][124505] Avg episode reward: [(0, '4597.592')] [2023-03-12 02:59:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000095136_48709632.pth... [2023-03-12 02:59:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000094576_48422912.pth [2023-03-12 02:59:24,279][124793] Updated weights for policy 0, policy_version 95200 (0.0005) [2023-03-12 02:59:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9552.7). Total num frames: 48758784. Throughput: 0: 9613.0. Samples: 48754752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:59:26,005][124505] Avg episode reward: [(0, '4576.314')] [2023-03-12 02:59:28,511][124793] Updated weights for policy 0, policy_version 95280 (0.0005) [2023-03-12 02:59:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9538.8). Total num frames: 48803840. Throughput: 0: 9599.8. Samples: 48783684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:59:31,005][124505] Avg episode reward: [(0, '4567.679')] [2023-03-12 02:59:32,808][124793] Updated weights for policy 0, policy_version 95360 (0.0005) [2023-03-12 02:59:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9538.8). Total num frames: 48852992. Throughput: 0: 9579.2. Samples: 48840908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:59:36,006][124505] Avg episode reward: [(0, '4597.509')] [2023-03-12 02:59:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000095416_48852992.pth... [2023-03-12 02:59:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000094856_48566272.pth [2023-03-12 02:59:37,140][124793] Updated weights for policy 0, policy_version 95440 (0.0005) [2023-03-12 02:59:41,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9538.8). Total num frames: 48898048. Throughput: 0: 9560.0. Samples: 48898056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:59:41,005][124505] Avg episode reward: [(0, '4599.336')] [2023-03-12 02:59:41,448][124793] Updated weights for policy 0, policy_version 95520 (0.0005) [2023-03-12 02:59:45,756][124793] Updated weights for policy 0, policy_version 95600 (0.0005) [2023-03-12 02:59:46,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9538.8). Total num frames: 48947200. Throughput: 0: 9553.1. Samples: 48926784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:59:46,005][124505] Avg episode reward: [(0, '4608.506')] [2023-03-12 02:59:49,917][124793] Updated weights for policy 0, policy_version 95680 (0.0005) [2023-03-12 02:59:51,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9538.8). Total num frames: 48996352. Throughput: 0: 9537.6. Samples: 48984652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:59:51,005][124505] Avg episode reward: [(0, '4605.389')] [2023-03-12 02:59:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000095696_48996352.pth... [2023-03-12 02:59:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000095136_48709632.pth [2023-03-12 02:59:54,157][124793] Updated weights for policy 0, policy_version 95760 (0.0005) [2023-03-12 02:59:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9538.8). Total num frames: 49045504. Throughput: 0: 9560.5. Samples: 49042760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 02:59:56,005][124505] Avg episode reward: [(0, '4593.532')] [2023-03-12 02:59:58,426][124793] Updated weights for policy 0, policy_version 95840 (0.0005) [2023-03-12 03:00:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9538.8). Total num frames: 49090560. Throughput: 0: 9576.7. Samples: 49071656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:00:01,005][124505] Avg episode reward: [(0, '4599.939')] [2023-03-12 03:00:02,756][124793] Updated weights for policy 0, policy_version 95920 (0.0005) [2023-03-12 03:00:06,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9538.8). Total num frames: 49139712. Throughput: 0: 9573.9. Samples: 49128232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:00:06,005][124505] Avg episode reward: [(0, '4597.312')] [2023-03-12 03:00:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000095976_49139712.pth... [2023-03-12 03:00:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000095416_48852992.pth [2023-03-12 03:00:07,068][124793] Updated weights for policy 0, policy_version 96000 (0.0005) [2023-03-12 03:00:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9552.7). Total num frames: 49188864. Throughput: 0: 9586.6. Samples: 49186148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:00:11,005][124505] Avg episode reward: [(0, '4598.007')] [2023-03-12 03:00:11,286][124793] Updated weights for policy 0, policy_version 96080 (0.0005) [2023-03-12 03:00:15,618][124793] Updated weights for policy 0, policy_version 96160 (0.0005) [2023-03-12 03:00:16,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9538.8). Total num frames: 49233920. Throughput: 0: 9570.1. Samples: 49214336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:00:16,005][124505] Avg episode reward: [(0, '4606.573')] [2023-03-12 03:00:19,855][124793] Updated weights for policy 0, policy_version 96240 (0.0005) [2023-03-12 03:00:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9538.8). Total num frames: 49283072. Throughput: 0: 9579.1. Samples: 49271968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:00:21,005][124505] Avg episode reward: [(0, '4605.615')] [2023-03-12 03:00:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000096256_49283072.pth... [2023-03-12 03:00:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000095696_48996352.pth [2023-03-12 03:00:24,213][124793] Updated weights for policy 0, policy_version 96320 (0.0005) [2023-03-12 03:00:26,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9538.8). Total num frames: 49332224. Throughput: 0: 9579.5. Samples: 49329136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:00:26,005][124505] Avg episode reward: [(0, '4592.023')] [2023-03-12 03:00:28,510][124793] Updated weights for policy 0, policy_version 96400 (0.0005) [2023-03-12 03:00:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9538.8). Total num frames: 49377280. Throughput: 0: 9567.5. Samples: 49357324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:00:31,005][124505] Avg episode reward: [(0, '4569.815')] [2023-03-12 03:00:32,738][124793] Updated weights for policy 0, policy_version 96480 (0.0005) [2023-03-12 03:00:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9552.7). Total num frames: 49430528. Throughput: 0: 9605.1. Samples: 49416880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:00:36,005][124505] Avg episode reward: [(0, '4567.194')] [2023-03-12 03:00:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000096544_49430528.pth... [2023-03-12 03:00:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000095976_49139712.pth [2023-03-12 03:00:36,754][124793] Updated weights for policy 0, policy_version 96560 (0.0004) [2023-03-12 03:00:40,815][124793] Updated weights for policy 0, policy_version 96640 (0.0004) [2023-03-12 03:00:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9693.9, 300 sec: 9552.7). Total num frames: 49479680. Throughput: 0: 9661.7. Samples: 49477536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:00:41,005][124505] Avg episode reward: [(0, '4574.972')] [2023-03-12 03:00:44,788][124793] Updated weights for policy 0, policy_version 96720 (0.0004) [2023-03-12 03:00:46,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9566.6). Total num frames: 49532928. Throughput: 0: 9704.5. Samples: 49508360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:00:46,005][124505] Avg episode reward: [(0, '4590.166')] [2023-03-12 03:00:48,806][124793] Updated weights for policy 0, policy_version 96800 (0.0004) [2023-03-12 03:00:51,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9580.5). Total num frames: 49582080. Throughput: 0: 9812.7. Samples: 49569804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:00:51,005][124505] Avg episode reward: [(0, '4595.458')] [2023-03-12 03:00:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000096840_49582080.pth... [2023-03-12 03:00:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000096256_49283072.pth [2023-03-12 03:00:52,840][124793] Updated weights for policy 0, policy_version 96880 (0.0004) [2023-03-12 03:00:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9580.5). Total num frames: 49631232. Throughput: 0: 9875.3. Samples: 49630536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:00:56,005][124505] Avg episode reward: [(0, '4561.387')] [2023-03-12 03:00:56,889][124793] Updated weights for policy 0, policy_version 96960 (0.0004) [2023-03-12 03:01:00,847][124793] Updated weights for policy 0, policy_version 97040 (0.0005) [2023-03-12 03:01:01,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9608.2). Total num frames: 49684480. Throughput: 0: 9933.3. Samples: 49661336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:01:01,005][124505] Avg episode reward: [(0, '4599.313')] [2023-03-12 03:01:04,874][124793] Updated weights for policy 0, policy_version 97120 (0.0005) [2023-03-12 03:01:06,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9608.2). Total num frames: 49733632. Throughput: 0: 10007.5. Samples: 49722304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:01:06,005][124505] Avg episode reward: [(0, '4599.040')] [2023-03-12 03:01:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000097136_49733632.pth... [2023-03-12 03:01:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000096544_49430528.pth [2023-03-12 03:01:08,989][124793] Updated weights for policy 0, policy_version 97200 (0.0005) [2023-03-12 03:01:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9622.1). Total num frames: 49782784. Throughput: 0: 10050.1. Samples: 49781392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:01:11,005][124505] Avg episode reward: [(0, '4592.017')] [2023-03-12 03:01:13,323][124793] Updated weights for policy 0, policy_version 97280 (0.0005) [2023-03-12 03:01:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9622.1). Total num frames: 49831936. Throughput: 0: 10059.0. Samples: 49809980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:01:16,005][124505] Avg episode reward: [(0, '4590.286')] [2023-03-12 03:01:17,678][124793] Updated weights for policy 0, policy_version 97360 (0.0005) [2023-03-12 03:01:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9622.1). Total num frames: 49876992. Throughput: 0: 9997.7. Samples: 49866776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:01:21,005][124505] Avg episode reward: [(0, '4593.789')] [2023-03-12 03:01:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000097416_49876992.pth... [2023-03-12 03:01:21,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000096840_49582080.pth [2023-03-12 03:01:21,878][124793] Updated weights for policy 0, policy_version 97440 (0.0004) [2023-03-12 03:01:25,979][124793] Updated weights for policy 0, policy_version 97520 (0.0004) [2023-03-12 03:01:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9636.0). Total num frames: 49930240. Throughput: 0: 9970.5. Samples: 49926208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:01:26,006][124505] Avg episode reward: [(0, '4593.958')] [2023-03-12 03:01:30,149][124793] Updated weights for policy 0, policy_version 97600 (0.0005) [2023-03-12 03:01:31,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9636.0). Total num frames: 49979392. Throughput: 0: 9934.1. Samples: 49955396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:01:31,005][124505] Avg episode reward: [(0, '4599.867')] [2023-03-12 03:01:34,199][124793] Updated weights for policy 0, policy_version 97680 (0.0005) [2023-03-12 03:01:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9649.9). Total num frames: 50028544. Throughput: 0: 9921.4. Samples: 50016268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:01:36,005][124505] Avg episode reward: [(0, '4594.350')] [2023-03-12 03:01:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000097712_50028544.pth... [2023-03-12 03:01:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000097136_49733632.pth [2023-03-12 03:01:38,223][124793] Updated weights for policy 0, policy_version 97760 (0.0004) [2023-03-12 03:01:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9663.8). Total num frames: 50077696. Throughput: 0: 9914.8. Samples: 50076700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:01:41,005][124505] Avg episode reward: [(0, '4574.070')] [2023-03-12 03:01:42,437][124793] Updated weights for policy 0, policy_version 97840 (0.0004) [2023-03-12 03:01:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9663.8). Total num frames: 50126848. Throughput: 0: 9862.2. Samples: 50105136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:01:46,005][124505] Avg episode reward: [(0, '4570.611')] [2023-03-12 03:01:46,807][124793] Updated weights for policy 0, policy_version 97920 (0.0004) [2023-03-12 03:01:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9663.8). Total num frames: 50171904. Throughput: 0: 9738.8. Samples: 50160548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:01:51,005][124505] Avg episode reward: [(0, '4595.555')] [2023-03-12 03:01:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000097992_50171904.pth... [2023-03-12 03:01:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000097416_49876992.pth [2023-03-12 03:01:51,170][124793] Updated weights for policy 0, policy_version 98000 (0.0005) [2023-03-12 03:01:55,479][124793] Updated weights for policy 0, policy_version 98080 (0.0005) [2023-03-12 03:01:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9663.8). Total num frames: 50221056. Throughput: 0: 9699.7. Samples: 50217880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:01:56,005][124505] Avg episode reward: [(0, '4604.710')] [2023-03-12 03:01:59,765][124793] Updated weights for policy 0, policy_version 98160 (0.0005) [2023-03-12 03:02:01,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9649.9). Total num frames: 50266112. Throughput: 0: 9699.4. Samples: 50246452. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:02:01,005][124505] Avg episode reward: [(0, '4597.604')] [2023-03-12 03:02:04,157][124793] Updated weights for policy 0, policy_version 98240 (0.0005) [2023-03-12 03:02:06,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9649.9). Total num frames: 50315264. Throughput: 0: 9694.7. Samples: 50303040. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:02:06,005][124505] Avg episode reward: [(0, '4575.390')] [2023-03-12 03:02:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000098272_50315264.pth... [2023-03-12 03:02:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000097712_50028544.pth [2023-03-12 03:02:08,471][124793] Updated weights for policy 0, policy_version 98320 (0.0005) [2023-03-12 03:02:11,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9649.9). Total num frames: 50360320. Throughput: 0: 9646.9. Samples: 50360320. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:02:11,005][124505] Avg episode reward: [(0, '4605.550')] [2023-03-12 03:02:12,783][124793] Updated weights for policy 0, policy_version 98400 (0.0005) [2023-03-12 03:02:16,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9649.9). Total num frames: 50409472. Throughput: 0: 9635.1. Samples: 50388976. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:02:16,005][124505] Avg episode reward: [(0, '4600.014')] [2023-03-12 03:02:17,083][124793] Updated weights for policy 0, policy_version 98480 (0.0005) [2023-03-12 03:02:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9663.8). Total num frames: 50458624. Throughput: 0: 9550.8. Samples: 50446056. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:02:21,005][124505] Avg episode reward: [(0, '4593.431')] [2023-03-12 03:02:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000098552_50458624.pth... [2023-03-12 03:02:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000097992_50171904.pth [2023-03-12 03:02:21,426][124793] Updated weights for policy 0, policy_version 98560 (0.0005) [2023-03-12 03:02:25,752][124793] Updated weights for policy 0, policy_version 98640 (0.0005) [2023-03-12 03:02:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9649.9). Total num frames: 50503680. Throughput: 0: 9465.5. Samples: 50502648. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:02:26,005][124505] Avg episode reward: [(0, '4595.994')] [2023-03-12 03:02:29,893][124793] Updated weights for policy 0, policy_version 98720 (0.0004) [2023-03-12 03:02:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9663.8). Total num frames: 50552832. Throughput: 0: 9463.1. Samples: 50530976. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:02:31,005][124505] Avg episode reward: [(0, '4595.021')] [2023-03-12 03:02:34,126][124793] Updated weights for policy 0, policy_version 98800 (0.0005) [2023-03-12 03:02:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9677.7). Total num frames: 50601984. Throughput: 0: 9538.0. Samples: 50589760. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:02:36,005][124505] Avg episode reward: [(0, '4581.431')] [2023-03-12 03:02:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000098832_50601984.pth... [2023-03-12 03:02:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000098272_50315264.pth [2023-03-12 03:02:38,421][124793] Updated weights for policy 0, policy_version 98880 (0.0005) [2023-03-12 03:02:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9677.7). Total num frames: 50651136. Throughput: 0: 9540.3. Samples: 50647192. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:02:41,005][124505] Avg episode reward: [(0, '4579.014')] [2023-03-12 03:02:42,713][124793] Updated weights for policy 0, policy_version 98960 (0.0005) [2023-03-12 03:02:46,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9677.7). Total num frames: 50696192. Throughput: 0: 9540.7. Samples: 50675784. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:02:46,005][124505] Avg episode reward: [(0, '4597.684')] [2023-03-12 03:02:46,877][124793] Updated weights for policy 0, policy_version 99040 (0.0004) [2023-03-12 03:02:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9677.7). Total num frames: 50745344. Throughput: 0: 9603.0. Samples: 50735176. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:02:51,005][124505] Avg episode reward: [(0, '4599.511')] [2023-03-12 03:02:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000099112_50745344.pth... [2023-03-12 03:02:51,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000098552_50458624.pth [2023-03-12 03:02:51,074][124793] Updated weights for policy 0, policy_version 99120 (0.0004) [2023-03-12 03:02:55,445][124793] Updated weights for policy 0, policy_version 99200 (0.0005) [2023-03-12 03:02:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9691.6). Total num frames: 50794496. Throughput: 0: 9581.3. Samples: 50791480. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:02:56,005][124505] Avg episode reward: [(0, '4598.419')] [2023-03-12 03:02:59,741][124793] Updated weights for policy 0, policy_version 99280 (0.0005) [2023-03-12 03:03:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9691.6). Total num frames: 50843648. Throughput: 0: 9574.9. Samples: 50819848. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:03:01,005][124505] Avg episode reward: [(0, '4596.992')] [2023-03-12 03:03:03,948][124793] Updated weights for policy 0, policy_version 99360 (0.0005) [2023-03-12 03:03:06,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9677.7). Total num frames: 50888704. Throughput: 0: 9615.5. Samples: 50878752. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:03:06,005][124505] Avg episode reward: [(0, '4544.892')] [2023-03-12 03:03:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000099392_50888704.pth... [2023-03-12 03:03:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000098832_50601984.pth [2023-03-12 03:03:08,307][124793] Updated weights for policy 0, policy_version 99440 (0.0005) [2023-03-12 03:03:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9691.6). Total num frames: 50937856. Throughput: 0: 9600.1. Samples: 50934652. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:03:11,005][124505] Avg episode reward: [(0, '4290.463')] [2023-03-12 03:03:12,466][124793] Updated weights for policy 0, policy_version 99520 (0.0004) [2023-03-12 03:03:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9691.6). Total num frames: 50987008. Throughput: 0: 9645.3. Samples: 50965016. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:03:16,005][124505] Avg episode reward: [(0, '4389.772')] [2023-03-12 03:03:16,701][124793] Updated weights for policy 0, policy_version 99600 (0.0003) [2023-03-12 03:03:20,937][124793] Updated weights for policy 0, policy_version 99680 (0.0004) [2023-03-12 03:03:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9691.6). Total num frames: 51036160. Throughput: 0: 9639.5. Samples: 51023536. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:03:21,005][124505] Avg episode reward: [(0, '4494.084')] [2023-03-12 03:03:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000099680_51036160.pth... [2023-03-12 03:03:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000099112_50745344.pth [2023-03-12 03:03:24,888][124793] Updated weights for policy 0, policy_version 99760 (0.0004) [2023-03-12 03:03:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9691.6). Total num frames: 51085312. Throughput: 0: 9718.7. Samples: 51084532. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:03:26,005][124505] Avg episode reward: [(0, '4488.026')] [2023-03-12 03:03:28,972][124793] Updated weights for policy 0, policy_version 99840 (0.0003) [2023-03-12 03:03:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9691.6). Total num frames: 51134464. Throughput: 0: 9740.3. Samples: 51114096. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:03:31,011][124505] Avg episode reward: [(0, '4569.774')] [2023-03-12 03:03:33,078][124793] Updated weights for policy 0, policy_version 99920 (0.0003) [2023-03-12 03:03:36,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9705.4). Total num frames: 51187712. Throughput: 0: 9755.9. Samples: 51174192. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:03:36,005][124505] Avg episode reward: [(0, '4579.340')] [2023-03-12 03:03:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000099976_51187712.pth... [2023-03-12 03:03:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000099392_50888704.pth [2023-03-12 03:03:37,198][124793] Updated weights for policy 0, policy_version 100000 (0.0004) [2023-03-12 03:03:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9705.4). Total num frames: 51236864. Throughput: 0: 9825.1. Samples: 51233608. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:03:41,005][124505] Avg episode reward: [(0, '4593.606')] [2023-03-12 03:03:41,317][124793] Updated weights for policy 0, policy_version 100080 (0.0003) [2023-03-12 03:03:45,329][124793] Updated weights for policy 0, policy_version 100160 (0.0003) [2023-03-12 03:03:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9705.4). Total num frames: 51286016. Throughput: 0: 9872.2. Samples: 51264096. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:03:46,005][124505] Avg episode reward: [(0, '4599.405')] [2023-03-12 03:03:49,429][124793] Updated weights for policy 0, policy_version 100240 (0.0003) [2023-03-12 03:03:51,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9719.3). Total num frames: 51335168. Throughput: 0: 9897.9. Samples: 51324160. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:03:51,005][124505] Avg episode reward: [(0, '4591.588')] [2023-03-12 03:03:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000100264_51335168.pth... [2023-03-12 03:03:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000099680_51036160.pth [2023-03-12 03:03:53,597][124793] Updated weights for policy 0, policy_version 100320 (0.0004) [2023-03-12 03:03:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9719.3). Total num frames: 51384320. Throughput: 0: 9953.9. Samples: 51382576. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:03:56,005][124505] Avg episode reward: [(0, '4590.628')] [2023-03-12 03:03:57,971][124793] Updated weights for policy 0, policy_version 100400 (0.0005) [2023-03-12 03:04:01,007][124505] Fps is (10 sec: 9828.5, 60 sec: 9830.1, 300 sec: 9719.3). Total num frames: 51433472. Throughput: 0: 9902.0. Samples: 51410628. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:04:01,008][124505] Avg episode reward: [(0, '4599.219')] [2023-03-12 03:04:02,293][124793] Updated weights for policy 0, policy_version 100480 (0.0005) [2023-03-12 03:04:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9705.4). Total num frames: 51478528. Throughput: 0: 9855.7. Samples: 51467044. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:04:06,005][124505] Avg episode reward: [(0, '4600.186')] [2023-03-12 03:04:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000100544_51478528.pth... [2023-03-12 03:04:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000099976_51187712.pth [2023-03-12 03:04:06,648][124793] Updated weights for policy 0, policy_version 100560 (0.0005) [2023-03-12 03:04:10,975][124793] Updated weights for policy 0, policy_version 100640 (0.0005) [2023-03-12 03:04:11,005][124505] Fps is (10 sec: 9422.7, 60 sec: 9830.4, 300 sec: 9719.3). Total num frames: 51527680. Throughput: 0: 9762.7. Samples: 51523852. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:04:11,005][124505] Avg episode reward: [(0, '4601.552')] [2023-03-12 03:04:15,200][124793] Updated weights for policy 0, policy_version 100720 (0.0005) [2023-03-12 03:04:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9705.4). Total num frames: 51572736. Throughput: 0: 9763.5. Samples: 51553452. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:04:16,005][124505] Avg episode reward: [(0, '4586.763')] [2023-03-12 03:04:19,512][124793] Updated weights for policy 0, policy_version 100800 (0.0005) [2023-03-12 03:04:21,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9762.1, 300 sec: 9705.4). Total num frames: 51621888. Throughput: 0: 9687.1. Samples: 51610112. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:04:21,005][124505] Avg episode reward: [(0, '4587.543')] [2023-03-12 03:04:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000100824_51621888.pth... [2023-03-12 03:04:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000100264_51335168.pth [2023-03-12 03:04:23,864][124793] Updated weights for policy 0, policy_version 100880 (0.0005) [2023-03-12 03:04:26,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9705.4). Total num frames: 51666944. Throughput: 0: 9629.7. Samples: 51666944. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:04:26,005][124505] Avg episode reward: [(0, '4588.440')] [2023-03-12 03:04:28,176][124793] Updated weights for policy 0, policy_version 100960 (0.0005) [2023-03-12 03:04:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9705.4). Total num frames: 51716096. Throughput: 0: 9589.3. Samples: 51695616. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:04:31,005][124505] Avg episode reward: [(0, '4584.923')] [2023-03-12 03:04:32,508][124793] Updated weights for policy 0, policy_version 101040 (0.0005) [2023-03-12 03:04:36,005][124505] Fps is (10 sec: 9830.2, 60 sec: 9625.6, 300 sec: 9719.3). Total num frames: 51765248. Throughput: 0: 9517.9. Samples: 51752464. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:04:36,006][124505] Avg episode reward: [(0, '4571.464')] [2023-03-12 03:04:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000101104_51765248.pth... [2023-03-12 03:04:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000100544_51478528.pth [2023-03-12 03:04:36,817][124793] Updated weights for policy 0, policy_version 101120 (0.0005) [2023-03-12 03:04:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9705.4). Total num frames: 51810304. Throughput: 0: 9491.9. Samples: 51809712. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:04:41,005][124505] Avg episode reward: [(0, '4562.021')] [2023-03-12 03:04:41,121][124793] Updated weights for policy 0, policy_version 101200 (0.0005) [2023-03-12 03:04:45,379][124793] Updated weights for policy 0, policy_version 101280 (0.0005) [2023-03-12 03:04:46,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9705.4). Total num frames: 51859456. Throughput: 0: 9510.4. Samples: 51838576. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:04:46,005][124505] Avg episode reward: [(0, '4587.281')] [2023-03-12 03:04:49,691][124793] Updated weights for policy 0, policy_version 101360 (0.0005) [2023-03-12 03:04:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9705.4). Total num frames: 51908608. Throughput: 0: 9528.0. Samples: 51895804. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:04:51,005][124505] Avg episode reward: [(0, '4591.474')] [2023-03-12 03:04:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000101384_51908608.pth... [2023-03-12 03:04:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000100824_51621888.pth [2023-03-12 03:04:54,004][124793] Updated weights for policy 0, policy_version 101440 (0.0005) [2023-03-12 03:04:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9705.4). Total num frames: 51953664. Throughput: 0: 9523.8. Samples: 51952424. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:04:56,005][124505] Avg episode reward: [(0, '4582.624')] [2023-03-12 03:04:58,320][124793] Updated weights for policy 0, policy_version 101520 (0.0005) [2023-03-12 03:05:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.4, 300 sec: 9705.4). Total num frames: 52002816. Throughput: 0: 9499.7. Samples: 51980940. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:05:01,005][124505] Avg episode reward: [(0, '4605.983')] [2023-03-12 03:05:02,595][124793] Updated weights for policy 0, policy_version 101600 (0.0005) [2023-03-12 03:05:06,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9691.6). Total num frames: 52047872. Throughput: 0: 9513.5. Samples: 52038220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:05:06,005][124505] Avg episode reward: [(0, '4595.163')] [2023-03-12 03:05:06,067][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000101664_52051968.pth... [2023-03-12 03:05:06,068][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000101104_51765248.pth [2023-03-12 03:05:06,905][124793] Updated weights for policy 0, policy_version 101680 (0.0005) [2023-03-12 03:05:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9705.4). Total num frames: 52097024. Throughput: 0: 9536.3. Samples: 52096076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:05:11,016][124505] Avg episode reward: [(0, '4597.807')] [2023-03-12 03:05:11,140][124793] Updated weights for policy 0, policy_version 101760 (0.0005) [2023-03-12 03:05:15,393][124793] Updated weights for policy 0, policy_version 101840 (0.0005) [2023-03-12 03:05:16,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9557.3, 300 sec: 9705.4). Total num frames: 52146176. Throughput: 0: 9547.6. Samples: 52125256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:05:16,005][124505] Avg episode reward: [(0, '4598.343')] [2023-03-12 03:05:19,644][124793] Updated weights for policy 0, policy_version 101920 (0.0005) [2023-03-12 03:05:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9705.4). Total num frames: 52195328. Throughput: 0: 9563.1. Samples: 52182804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:05:21,016][124505] Avg episode reward: [(0, '4599.596')] [2023-03-12 03:05:21,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000101944_52195328.pth... [2023-03-12 03:05:21,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000101384_51908608.pth [2023-03-12 03:05:23,959][124793] Updated weights for policy 0, policy_version 102000 (0.0005) [2023-03-12 03:05:26,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9705.4). Total num frames: 52240384. Throughput: 0: 9554.6. Samples: 52239668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:05:26,016][124505] Avg episode reward: [(0, '4600.125')] [2023-03-12 03:05:28,361][124793] Updated weights for policy 0, policy_version 102080 (0.0005) [2023-03-12 03:05:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9691.6). Total num frames: 52289536. Throughput: 0: 9528.4. Samples: 52267352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:05:31,016][124505] Avg episode reward: [(0, '4583.272')] [2023-03-12 03:05:32,687][124793] Updated weights for policy 0, policy_version 102160 (0.0005) [2023-03-12 03:05:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9677.7). Total num frames: 52334592. Throughput: 0: 9512.9. Samples: 52323884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:05:36,016][124505] Avg episode reward: [(0, '4471.459')] [2023-03-12 03:05:36,033][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000102224_52338688.pth... [2023-03-12 03:05:36,035][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000101664_52051968.pth [2023-03-12 03:05:36,906][124793] Updated weights for policy 0, policy_version 102240 (0.0004) [2023-03-12 03:05:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9663.8). Total num frames: 52383744. Throughput: 0: 9564.4. Samples: 52382824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:05:41,016][124505] Avg episode reward: [(0, '4532.681')] [2023-03-12 03:05:41,148][124793] Updated weights for policy 0, policy_version 102320 (0.0005) [2023-03-12 03:05:45,355][124793] Updated weights for policy 0, policy_version 102400 (0.0004) [2023-03-12 03:05:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9663.8). Total num frames: 52432896. Throughput: 0: 9588.4. Samples: 52412416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:05:46,005][124505] Avg episode reward: [(0, '4574.473')] [2023-03-12 03:05:49,717][124793] Updated weights for policy 0, policy_version 102480 (0.0005) [2023-03-12 03:05:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9663.8). Total num frames: 52482048. Throughput: 0: 9563.0. Samples: 52468556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:05:51,005][124505] Avg episode reward: [(0, '4514.778')] [2023-03-12 03:05:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000102504_52482048.pth... [2023-03-12 03:05:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000101944_52195328.pth [2023-03-12 03:05:54,045][124793] Updated weights for policy 0, policy_version 102560 (0.0005) [2023-03-12 03:05:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9636.0). Total num frames: 52527104. Throughput: 0: 9555.0. Samples: 52526052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:05:56,005][124505] Avg episode reward: [(0, '4587.319')] [2023-03-12 03:05:58,205][124793] Updated weights for policy 0, policy_version 102640 (0.0005) [2023-03-12 03:06:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9636.0). Total num frames: 52576256. Throughput: 0: 9566.1. Samples: 52555732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:06:01,005][124505] Avg episode reward: [(0, '4582.845')] [2023-03-12 03:06:02,471][124793] Updated weights for policy 0, policy_version 102720 (0.0005) [2023-03-12 03:06:06,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9636.0). Total num frames: 52625408. Throughput: 0: 9564.3. Samples: 52613196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:06:06,005][124505] Avg episode reward: [(0, '4586.135')] [2023-03-12 03:06:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000102784_52625408.pth... [2023-03-12 03:06:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000102224_52338688.pth [2023-03-12 03:06:06,568][124793] Updated weights for policy 0, policy_version 102800 (0.0005) [2023-03-12 03:06:10,645][124793] Updated weights for policy 0, policy_version 102880 (0.0005) [2023-03-12 03:06:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9636.0). Total num frames: 52674560. Throughput: 0: 9651.3. Samples: 52673976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:06:11,016][124505] Avg episode reward: [(0, '4583.095')] [2023-03-12 03:06:14,841][124793] Updated weights for policy 0, policy_version 102960 (0.0005) [2023-03-12 03:06:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9649.9). Total num frames: 52723712. Throughput: 0: 9687.8. Samples: 52703304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:06:16,016][124505] Avg episode reward: [(0, '4424.614')] [2023-03-12 03:06:18,895][124793] Updated weights for policy 0, policy_version 103040 (0.0005) [2023-03-12 03:06:21,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9693.9, 300 sec: 9649.9). Total num frames: 52776960. Throughput: 0: 9776.3. Samples: 52763816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:06:21,016][124505] Avg episode reward: [(0, '4429.588')] [2023-03-12 03:06:21,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000103080_52776960.pth... [2023-03-12 03:06:21,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000102504_52482048.pth [2023-03-12 03:06:22,997][124793] Updated weights for policy 0, policy_version 103120 (0.0005) [2023-03-12 03:06:26,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9762.1, 300 sec: 9649.9). Total num frames: 52826112. Throughput: 0: 9787.9. Samples: 52823280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:06:26,016][124505] Avg episode reward: [(0, '4511.441')] [2023-03-12 03:06:27,067][124793] Updated weights for policy 0, policy_version 103200 (0.0005) [2023-03-12 03:06:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9649.9). Total num frames: 52875264. Throughput: 0: 9789.9. Samples: 52852964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:06:31,016][124505] Avg episode reward: [(0, '4580.639')] [2023-03-12 03:06:31,394][124793] Updated weights for policy 0, policy_version 103280 (0.0005) [2023-03-12 03:06:35,610][124793] Updated weights for policy 0, policy_version 103360 (0.0005) [2023-03-12 03:06:36,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9649.9). Total num frames: 52924416. Throughput: 0: 9808.8. Samples: 52909952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:06:36,016][124505] Avg episode reward: [(0, '4561.378')] [2023-03-12 03:06:36,020][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000103368_52924416.pth... [2023-03-12 03:06:36,023][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000102784_52625408.pth [2023-03-12 03:06:39,782][124793] Updated weights for policy 0, policy_version 103440 (0.0005) [2023-03-12 03:06:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9636.0). Total num frames: 52969472. Throughput: 0: 9847.1. Samples: 52969172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:06:41,005][124505] Avg episode reward: [(0, '4539.935')] [2023-03-12 03:06:44,174][124793] Updated weights for policy 0, policy_version 103520 (0.0005) [2023-03-12 03:06:46,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9762.1, 300 sec: 9649.9). Total num frames: 53018624. Throughput: 0: 9809.6. Samples: 52997164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:06:46,016][124505] Avg episode reward: [(0, '4548.708')] [2023-03-12 03:06:48,506][124793] Updated weights for policy 0, policy_version 103600 (0.0006) [2023-03-12 03:06:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9636.0). Total num frames: 53063680. Throughput: 0: 9790.3. Samples: 53053760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:06:51,016][124505] Avg episode reward: [(0, '4580.367')] [2023-03-12 03:06:51,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000103640_53063680.pth... [2023-03-12 03:06:51,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000103080_52776960.pth [2023-03-12 03:06:52,731][124793] Updated weights for policy 0, policy_version 103680 (0.0005) [2023-03-12 03:06:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9663.8). Total num frames: 53116928. Throughput: 0: 9756.4. Samples: 53113016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:06:56,016][124505] Avg episode reward: [(0, '4596.267')] [2023-03-12 03:06:56,729][124793] Updated weights for policy 0, policy_version 103760 (0.0005) [2023-03-12 03:07:00,796][124793] Updated weights for policy 0, policy_version 103840 (0.0005) [2023-03-12 03:07:01,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9663.8). Total num frames: 53166080. Throughput: 0: 9789.5. Samples: 53143832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:07:01,016][124505] Avg episode reward: [(0, '4593.045')] [2023-03-12 03:07:04,923][124793] Updated weights for policy 0, policy_version 103920 (0.0005) [2023-03-12 03:07:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9677.7). Total num frames: 53215232. Throughput: 0: 9764.1. Samples: 53203200. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:07:06,016][124505] Avg episode reward: [(0, '4565.504')] [2023-03-12 03:07:06,020][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000103936_53215232.pth... [2023-03-12 03:07:06,023][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000103368_52924416.pth [2023-03-12 03:07:09,157][124793] Updated weights for policy 0, policy_version 104000 (0.0003) [2023-03-12 03:07:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9677.7). Total num frames: 53264384. Throughput: 0: 9759.6. Samples: 53262460. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:07:11,005][124505] Avg episode reward: [(0, '4534.934')] [2023-03-12 03:07:13,248][124793] Updated weights for policy 0, policy_version 104080 (0.0003) [2023-03-12 03:07:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9677.7). Total num frames: 53313536. Throughput: 0: 9768.1. Samples: 53292528. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:07:16,005][124505] Avg episode reward: [(0, '4558.557')] [2023-03-12 03:07:17,323][124793] Updated weights for policy 0, policy_version 104160 (0.0003) [2023-03-12 03:07:21,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9705.4). Total num frames: 53366784. Throughput: 0: 9833.2. Samples: 53352444. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:07:21,005][124505] Avg episode reward: [(0, '4515.404')] [2023-03-12 03:07:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000104232_53366784.pth... [2023-03-12 03:07:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000103640_53063680.pth [2023-03-12 03:07:21,401][124793] Updated weights for policy 0, policy_version 104240 (0.0003) [2023-03-12 03:07:25,623][124793] Updated weights for policy 0, policy_version 104320 (0.0003) [2023-03-12 03:07:26,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9691.6). Total num frames: 53411840. Throughput: 0: 9837.1. Samples: 53411840. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:07:26,005][124505] Avg episode reward: [(0, '4376.175')] [2023-03-12 03:07:29,734][124793] Updated weights for policy 0, policy_version 104400 (0.0005) [2023-03-12 03:07:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9705.4). Total num frames: 53465088. Throughput: 0: 9863.1. Samples: 53441004. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:07:31,005][124505] Avg episode reward: [(0, '4475.867')] [2023-03-12 03:07:33,744][124793] Updated weights for policy 0, policy_version 104480 (0.0005) [2023-03-12 03:07:36,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9705.4). Total num frames: 53514240. Throughput: 0: 9961.4. Samples: 53502024. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:07:36,005][124505] Avg episode reward: [(0, '4413.561')] [2023-03-12 03:07:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000104520_53514240.pth... [2023-03-12 03:07:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000103936_53215232.pth [2023-03-12 03:07:37,837][124793] Updated weights for policy 0, policy_version 104560 (0.0005) [2023-03-12 03:07:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9719.3). Total num frames: 53563392. Throughput: 0: 9980.1. Samples: 53562120. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:07:41,005][124505] Avg episode reward: [(0, '4472.683')] [2023-03-12 03:07:41,962][124793] Updated weights for policy 0, policy_version 104640 (0.0005) [2023-03-12 03:07:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9719.3). Total num frames: 53612544. Throughput: 0: 9961.1. Samples: 53592080. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:07:46,005][124505] Avg episode reward: [(0, '4532.819')] [2023-03-12 03:07:46,072][124793] Updated weights for policy 0, policy_version 104720 (0.0005) [2023-03-12 03:07:50,456][124793] Updated weights for policy 0, policy_version 104800 (0.0005) [2023-03-12 03:07:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9719.3). Total num frames: 53661696. Throughput: 0: 9917.2. Samples: 53649472. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:07:51,005][124505] Avg episode reward: [(0, '4511.776')] [2023-03-12 03:07:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000104808_53661696.pth... [2023-03-12 03:07:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000104232_53366784.pth [2023-03-12 03:07:54,506][124793] Updated weights for policy 0, policy_version 104880 (0.0004) [2023-03-12 03:07:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9719.3). Total num frames: 53710848. Throughput: 0: 9930.0. Samples: 53709312. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:07:56,005][124505] Avg episode reward: [(0, '4551.657')] [2023-03-12 03:07:58,573][124793] Updated weights for policy 0, policy_version 104960 (0.0005) [2023-03-12 03:08:01,005][124505] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9747.1). Total num frames: 53764096. Throughput: 0: 9934.6. Samples: 53739584. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:08:01,005][124505] Avg episode reward: [(0, '4541.525')] [2023-03-12 03:08:02,585][124793] Updated weights for policy 0, policy_version 105040 (0.0005) [2023-03-12 03:08:06,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9747.1). Total num frames: 53813248. Throughput: 0: 9934.0. Samples: 53799476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:08:06,005][124505] Avg episode reward: [(0, '4541.622')] [2023-03-12 03:08:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000105104_53813248.pth... [2023-03-12 03:08:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000104520_53514240.pth [2023-03-12 03:08:06,768][124793] Updated weights for policy 0, policy_version 105120 (0.0005) [2023-03-12 03:08:10,880][124793] Updated weights for policy 0, policy_version 105200 (0.0005) [2023-03-12 03:08:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9747.1). Total num frames: 53862400. Throughput: 0: 9940.3. Samples: 53859152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:08:11,005][124505] Avg episode reward: [(0, '4457.525')] [2023-03-12 03:08:15,000][124793] Updated weights for policy 0, policy_version 105280 (0.0005) [2023-03-12 03:08:16,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9747.1). Total num frames: 53911552. Throughput: 0: 9966.9. Samples: 53889512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:08:16,005][124505] Avg episode reward: [(0, '4440.327')] [2023-03-12 03:08:19,124][124793] Updated weights for policy 0, policy_version 105360 (0.0005) [2023-03-12 03:08:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9747.1). Total num frames: 53960704. Throughput: 0: 9921.4. Samples: 53948488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:08:21,005][124505] Avg episode reward: [(0, '4513.175')] [2023-03-12 03:08:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000105392_53960704.pth... [2023-03-12 03:08:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000104808_53661696.pth [2023-03-12 03:08:23,407][124793] Updated weights for policy 0, policy_version 105440 (0.0005) [2023-03-12 03:08:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9733.2). Total num frames: 54005760. Throughput: 0: 9858.5. Samples: 54005752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:08:26,005][124505] Avg episode reward: [(0, '4478.652')] [2023-03-12 03:08:27,810][124793] Updated weights for policy 0, policy_version 105520 (0.0005) [2023-03-12 03:08:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9719.3). Total num frames: 54054912. Throughput: 0: 9814.0. Samples: 54033712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:08:31,005][124505] Avg episode reward: [(0, '4464.829')] [2023-03-12 03:08:32,193][124793] Updated weights for policy 0, policy_version 105600 (0.0005) [2023-03-12 03:08:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9762.1, 300 sec: 9705.4). Total num frames: 54099968. Throughput: 0: 9780.0. Samples: 54089572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:08:36,005][124505] Avg episode reward: [(0, '4404.553')] [2023-03-12 03:08:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000105664_54099968.pth... [2023-03-12 03:08:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000105104_53813248.pth [2023-03-12 03:08:36,567][124793] Updated weights for policy 0, policy_version 105680 (0.0005) [2023-03-12 03:08:40,955][124793] Updated weights for policy 0, policy_version 105760 (0.0005) [2023-03-12 03:08:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9705.4). Total num frames: 54149120. Throughput: 0: 9689.5. Samples: 54145340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:08:41,005][124505] Avg episode reward: [(0, '4557.875')] [2023-03-12 03:08:45,380][124793] Updated weights for policy 0, policy_version 105840 (0.0005) [2023-03-12 03:08:46,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9691.6). Total num frames: 54194176. Throughput: 0: 9647.4. Samples: 54173716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:08:46,005][124505] Avg episode reward: [(0, '4562.206')] [2023-03-12 03:08:49,799][124793] Updated weights for policy 0, policy_version 105920 (0.0005) [2023-03-12 03:08:51,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9625.6, 300 sec: 9677.7). Total num frames: 54239232. Throughput: 0: 9550.9. Samples: 54229268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:08:51,005][124505] Avg episode reward: [(0, '4528.461')] [2023-03-12 03:08:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000105936_54239232.pth... [2023-03-12 03:08:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000105392_53960704.pth [2023-03-12 03:08:54,224][124793] Updated weights for policy 0, policy_version 106000 (0.0005) [2023-03-12 03:08:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9677.7). Total num frames: 54288384. Throughput: 0: 9468.8. Samples: 54285248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:08:56,005][124505] Avg episode reward: [(0, '4546.845')] [2023-03-12 03:08:58,368][124793] Updated weights for policy 0, policy_version 106080 (0.0005) [2023-03-12 03:09:01,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9557.3, 300 sec: 9691.6). Total num frames: 54337536. Throughput: 0: 9458.6. Samples: 54315148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:09:01,005][124505] Avg episode reward: [(0, '4528.870')] [2023-03-12 03:09:02,483][124793] Updated weights for policy 0, policy_version 106160 (0.0005) [2023-03-12 03:09:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9691.6). Total num frames: 54386688. Throughput: 0: 9466.3. Samples: 54374472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:09:06,005][124505] Avg episode reward: [(0, '4574.377')] [2023-03-12 03:09:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000106224_54386688.pth... [2023-03-12 03:09:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000105664_54099968.pth [2023-03-12 03:09:06,657][124793] Updated weights for policy 0, policy_version 106240 (0.0005) [2023-03-12 03:09:10,726][124793] Updated weights for policy 0, policy_version 106320 (0.0005) [2023-03-12 03:09:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9705.4). Total num frames: 54435840. Throughput: 0: 9528.4. Samples: 54434532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:09:11,005][124505] Avg episode reward: [(0, '4563.916')] [2023-03-12 03:09:14,809][124793] Updated weights for policy 0, policy_version 106400 (0.0005) [2023-03-12 03:09:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9705.4). Total num frames: 54484992. Throughput: 0: 9574.7. Samples: 54464576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:09:16,005][124505] Avg episode reward: [(0, '4550.664')] [2023-03-12 03:09:18,961][124793] Updated weights for policy 0, policy_version 106480 (0.0005) [2023-03-12 03:09:21,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9719.3). Total num frames: 54534144. Throughput: 0: 9651.2. Samples: 54523876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:09:21,005][124505] Avg episode reward: [(0, '4487.762')] [2023-03-12 03:09:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000106512_54534144.pth... [2023-03-12 03:09:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000105936_54239232.pth [2023-03-12 03:09:23,057][124793] Updated weights for policy 0, policy_version 106560 (0.0005) [2023-03-12 03:09:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9693.9, 300 sec: 9733.2). Total num frames: 54587392. Throughput: 0: 9734.5. Samples: 54583392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:09:26,005][124505] Avg episode reward: [(0, '4490.582')] [2023-03-12 03:09:27,237][124793] Updated weights for policy 0, policy_version 106640 (0.0005) [2023-03-12 03:09:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9719.3). Total num frames: 54632448. Throughput: 0: 9756.0. Samples: 54612736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:09:31,005][124505] Avg episode reward: [(0, '4509.503')] [2023-03-12 03:09:31,420][124793] Updated weights for policy 0, policy_version 106720 (0.0005) [2023-03-12 03:09:35,486][124793] Updated weights for policy 0, policy_version 106800 (0.0005) [2023-03-12 03:09:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9747.1). Total num frames: 54685696. Throughput: 0: 9857.3. Samples: 54672848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:09:36,005][124505] Avg episode reward: [(0, '4539.395')] [2023-03-12 03:09:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000106808_54685696.pth... [2023-03-12 03:09:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000106224_54386688.pth [2023-03-12 03:09:39,593][124793] Updated weights for policy 0, policy_version 106880 (0.0005) [2023-03-12 03:09:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9747.1). Total num frames: 54734848. Throughput: 0: 9933.4. Samples: 54732252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:09:41,005][124505] Avg episode reward: [(0, '4576.255')] [2023-03-12 03:09:43,647][124793] Updated weights for policy 0, policy_version 106960 (0.0005) [2023-03-12 03:09:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9747.1). Total num frames: 54784000. Throughput: 0: 9955.5. Samples: 54763144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:09:46,005][124505] Avg episode reward: [(0, '4543.450')] [2023-03-12 03:09:47,749][124793] Updated weights for policy 0, policy_version 107040 (0.0005) [2023-03-12 03:09:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9761.0). Total num frames: 54833152. Throughput: 0: 9954.7. Samples: 54822436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:09:51,005][124505] Avg episode reward: [(0, '4572.355')] [2023-03-12 03:09:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000107096_54833152.pth... [2023-03-12 03:09:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000106512_54534144.pth [2023-03-12 03:09:51,878][124793] Updated weights for policy 0, policy_version 107120 (0.0005) [2023-03-12 03:09:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9761.0). Total num frames: 54882304. Throughput: 0: 9948.5. Samples: 54882216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:09:56,005][124505] Avg episode reward: [(0, '4567.875')] [2023-03-12 03:09:56,025][124793] Updated weights for policy 0, policy_version 107200 (0.0005) [2023-03-12 03:10:00,138][124793] Updated weights for policy 0, policy_version 107280 (0.0005) [2023-03-12 03:10:01,005][124505] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9788.7). Total num frames: 54935552. Throughput: 0: 9932.8. Samples: 54911552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:10:01,005][124505] Avg episode reward: [(0, '4547.447')] [2023-03-12 03:10:04,410][124793] Updated weights for policy 0, policy_version 107360 (0.0005) [2023-03-12 03:10:06,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9774.9). Total num frames: 54980608. Throughput: 0: 9916.2. Samples: 54970104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:10:06,005][124505] Avg episode reward: [(0, '4569.052')] [2023-03-12 03:10:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000107384_54980608.pth... [2023-03-12 03:10:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000106808_54685696.pth [2023-03-12 03:10:08,736][124793] Updated weights for policy 0, policy_version 107440 (0.0005) [2023-03-12 03:10:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9774.9). Total num frames: 55029760. Throughput: 0: 9842.4. Samples: 55026300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:10:11,005][124505] Avg episode reward: [(0, '4478.995')] [2023-03-12 03:10:12,970][124793] Updated weights for policy 0, policy_version 107520 (0.0005) [2023-03-12 03:10:16,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9830.4, 300 sec: 9761.0). Total num frames: 55074816. Throughput: 0: 9843.5. Samples: 55055692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:10:16,005][124505] Avg episode reward: [(0, '4578.048')] [2023-03-12 03:10:17,321][124793] Updated weights for policy 0, policy_version 107600 (0.0005) [2023-03-12 03:10:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9774.9). Total num frames: 55123968. Throughput: 0: 9769.7. Samples: 55112484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:10:21,005][124505] Avg episode reward: [(0, '4584.084')] [2023-03-12 03:10:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000107664_55123968.pth... [2023-03-12 03:10:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000107096_54833152.pth [2023-03-12 03:10:21,720][124793] Updated weights for policy 0, policy_version 107680 (0.0004) [2023-03-12 03:10:25,996][124793] Updated weights for policy 0, policy_version 107760 (0.0004) [2023-03-12 03:10:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9774.9). Total num frames: 55173120. Throughput: 0: 9707.7. Samples: 55169096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:10:26,005][124505] Avg episode reward: [(0, '4591.390')] [2023-03-12 03:10:30,193][124793] Updated weights for policy 0, policy_version 107840 (0.0004) [2023-03-12 03:10:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9788.7). Total num frames: 55222272. Throughput: 0: 9658.3. Samples: 55197768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:10:31,005][124505] Avg episode reward: [(0, '4585.692')] [2023-03-12 03:10:34,321][124793] Updated weights for policy 0, policy_version 107920 (0.0003) [2023-03-12 03:10:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9774.9). Total num frames: 55267328. Throughput: 0: 9670.5. Samples: 55257608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:10:36,005][124505] Avg episode reward: [(0, '4570.068')] [2023-03-12 03:10:36,067][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000107952_55271424.pth... [2023-03-12 03:10:36,069][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000107384_54980608.pth [2023-03-12 03:10:38,624][124793] Updated weights for policy 0, policy_version 108000 (0.0004) [2023-03-12 03:10:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9774.9). Total num frames: 55316480. Throughput: 0: 9606.2. Samples: 55314496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:10:41,005][124505] Avg episode reward: [(0, '4573.795')] [2023-03-12 03:10:43,048][124793] Updated weights for policy 0, policy_version 108080 (0.0006) [2023-03-12 03:10:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9761.0). Total num frames: 55361536. Throughput: 0: 9558.9. Samples: 55341704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:10:46,005][124505] Avg episode reward: [(0, '4587.115')] [2023-03-12 03:10:47,455][124793] Updated weights for policy 0, policy_version 108160 (0.0005) [2023-03-12 03:10:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9774.9). Total num frames: 55410688. Throughput: 0: 9518.0. Samples: 55398412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:10:51,005][124505] Avg episode reward: [(0, '4586.850')] [2023-03-12 03:10:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000108224_55410688.pth... [2023-03-12 03:10:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000107664_55123968.pth [2023-03-12 03:10:51,685][124793] Updated weights for policy 0, policy_version 108240 (0.0005) [2023-03-12 03:10:55,835][124793] Updated weights for policy 0, policy_version 108320 (0.0005) [2023-03-12 03:10:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9774.9). Total num frames: 55459840. Throughput: 0: 9589.3. Samples: 55457820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:10:56,005][124505] Avg episode reward: [(0, '4582.829')] [2023-03-12 03:10:59,988][124793] Updated weights for policy 0, policy_version 108400 (0.0005) [2023-03-12 03:11:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9774.9). Total num frames: 55508992. Throughput: 0: 9594.1. Samples: 55487428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:11:01,005][124505] Avg episode reward: [(0, '4586.636')] [2023-03-12 03:11:04,103][124793] Updated weights for policy 0, policy_version 108480 (0.0005) [2023-03-12 03:11:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9774.9). Total num frames: 55558144. Throughput: 0: 9639.5. Samples: 55546264. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:11:06,005][124505] Avg episode reward: [(0, '4565.241')] [2023-03-12 03:11:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000108512_55558144.pth... [2023-03-12 03:11:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000107952_55271424.pth [2023-03-12 03:11:08,256][124793] Updated weights for policy 0, policy_version 108560 (0.0005) [2023-03-12 03:11:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9774.9). Total num frames: 55607296. Throughput: 0: 9667.3. Samples: 55604124. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:11:11,005][124505] Avg episode reward: [(0, '4575.050')] [2023-03-12 03:11:12,536][124793] Updated weights for policy 0, policy_version 108640 (0.0005) [2023-03-12 03:11:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9761.0). Total num frames: 55656448. Throughput: 0: 9698.7. Samples: 55634212. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:11:16,005][124505] Avg episode reward: [(0, '4486.920')] [2023-03-12 03:11:16,665][124793] Updated weights for policy 0, policy_version 108720 (0.0005) [2023-03-12 03:11:20,830][124793] Updated weights for policy 0, policy_version 108800 (0.0005) [2023-03-12 03:11:21,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9761.0). Total num frames: 55705600. Throughput: 0: 9682.3. Samples: 55693312. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:11:21,005][124505] Avg episode reward: [(0, '4491.425')] [2023-03-12 03:11:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000108800_55705600.pth... [2023-03-12 03:11:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000108224_55410688.pth [2023-03-12 03:11:24,896][124793] Updated weights for policy 0, policy_version 108880 (0.0005) [2023-03-12 03:11:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9761.0). Total num frames: 55754752. Throughput: 0: 9754.6. Samples: 55753452. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:11:26,005][124505] Avg episode reward: [(0, '4517.897')] [2023-03-12 03:11:29,138][124793] Updated weights for policy 0, policy_version 108960 (0.0005) [2023-03-12 03:11:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9761.0). Total num frames: 55803904. Throughput: 0: 9796.4. Samples: 55782540. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:11:31,005][124505] Avg episode reward: [(0, '4284.015')] [2023-03-12 03:11:33,427][124793] Updated weights for policy 0, policy_version 109040 (0.0005) [2023-03-12 03:11:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9774.9). Total num frames: 55853056. Throughput: 0: 9813.9. Samples: 55840036. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:11:36,005][124505] Avg episode reward: [(0, '4382.655')] [2023-03-12 03:11:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000109088_55853056.pth... [2023-03-12 03:11:36,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000108512_55558144.pth [2023-03-12 03:11:37,744][124793] Updated weights for policy 0, policy_version 109120 (0.0005) [2023-03-12 03:11:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9761.0). Total num frames: 55898112. Throughput: 0: 9765.4. Samples: 55897264. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:11:41,005][124505] Avg episode reward: [(0, '4426.792')] [2023-03-12 03:11:41,963][124793] Updated weights for policy 0, policy_version 109200 (0.0005) [2023-03-12 03:11:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9774.9). Total num frames: 55947264. Throughput: 0: 9744.6. Samples: 55925936. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:11:46,005][124505] Avg episode reward: [(0, '4541.172')] [2023-03-12 03:11:46,302][124793] Updated weights for policy 0, policy_version 109280 (0.0004) [2023-03-12 03:11:50,613][124793] Updated weights for policy 0, policy_version 109360 (0.0005) [2023-03-12 03:11:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9747.1). Total num frames: 55992320. Throughput: 0: 9701.2. Samples: 55982816. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:11:51,005][124505] Avg episode reward: [(0, '4473.541')] [2023-03-12 03:11:51,059][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000109368_55996416.pth... [2023-03-12 03:11:51,060][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000108800_55705600.pth [2023-03-12 03:11:54,923][124793] Updated weights for policy 0, policy_version 109440 (0.0005) [2023-03-12 03:11:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9747.1). Total num frames: 56041472. Throughput: 0: 9674.5. Samples: 56039476. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:11:56,005][124505] Avg episode reward: [(0, '4518.207')] [2023-03-12 03:11:59,276][124793] Updated weights for policy 0, policy_version 109520 (0.0005) [2023-03-12 03:12:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9733.2). Total num frames: 56086528. Throughput: 0: 9633.8. Samples: 56067732. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:12:01,005][124505] Avg episode reward: [(0, '4549.415')] [2023-03-12 03:12:03,687][124793] Updated weights for policy 0, policy_version 109600 (0.0005) [2023-03-12 03:12:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9733.2). Total num frames: 56135680. Throughput: 0: 9558.8. Samples: 56123456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:12:06,005][124505] Avg episode reward: [(0, '4472.570')] [2023-03-12 03:12:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000109640_56135680.pth... [2023-03-12 03:12:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000109088_55853056.pth [2023-03-12 03:12:08,072][124793] Updated weights for policy 0, policy_version 109680 (0.0005) [2023-03-12 03:12:11,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9719.3). Total num frames: 56180736. Throughput: 0: 9489.7. Samples: 56180488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:12:11,005][124505] Avg episode reward: [(0, '4572.922')] [2023-03-12 03:12:12,286][124793] Updated weights for policy 0, policy_version 109760 (0.0004) [2023-03-12 03:12:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9705.4). Total num frames: 56229888. Throughput: 0: 9491.7. Samples: 56209664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:12:16,005][124505] Avg episode reward: [(0, '4580.329')] [2023-03-12 03:12:16,583][124793] Updated weights for policy 0, policy_version 109840 (0.0005) [2023-03-12 03:12:20,959][124793] Updated weights for policy 0, policy_version 109920 (0.0005) [2023-03-12 03:12:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9719.3). Total num frames: 56279040. Throughput: 0: 9482.6. Samples: 56266752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:12:21,005][124505] Avg episode reward: [(0, '4580.036')] [2023-03-12 03:12:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000109920_56279040.pth... [2023-03-12 03:12:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000109368_55996416.pth [2023-03-12 03:12:25,275][124793] Updated weights for policy 0, policy_version 110000 (0.0005) [2023-03-12 03:12:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9691.6). Total num frames: 56324096. Throughput: 0: 9469.3. Samples: 56323384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:12:26,005][124505] Avg episode reward: [(0, '4592.447')] [2023-03-12 03:12:29,653][124793] Updated weights for policy 0, policy_version 110080 (0.0005) [2023-03-12 03:12:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9691.6). Total num frames: 56373248. Throughput: 0: 9452.5. Samples: 56351300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:12:31,005][124505] Avg episode reward: [(0, '4580.754')] [2023-03-12 03:12:33,925][124793] Updated weights for policy 0, policy_version 110160 (0.0005) [2023-03-12 03:12:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9677.7). Total num frames: 56418304. Throughput: 0: 9456.7. Samples: 56408368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:12:36,006][124505] Avg episode reward: [(0, '4579.863')] [2023-03-12 03:12:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000110192_56418304.pth... [2023-03-12 03:12:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000109640_56135680.pth [2023-03-12 03:12:38,321][124793] Updated weights for policy 0, policy_version 110240 (0.0005) [2023-03-12 03:12:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9677.7). Total num frames: 56467456. Throughput: 0: 9431.9. Samples: 56463912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:12:41,005][124505] Avg episode reward: [(0, '4576.849')] [2023-03-12 03:12:42,680][124793] Updated weights for policy 0, policy_version 110320 (0.0004) [2023-03-12 03:12:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9663.8). Total num frames: 56512512. Throughput: 0: 9430.3. Samples: 56492096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:12:46,005][124505] Avg episode reward: [(0, '4593.180')] [2023-03-12 03:12:47,079][124793] Updated weights for policy 0, policy_version 110400 (0.0005) [2023-03-12 03:12:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9663.8). Total num frames: 56561664. Throughput: 0: 9442.7. Samples: 56548380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:12:51,005][124505] Avg episode reward: [(0, '4589.356')] [2023-03-12 03:12:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000110472_56561664.pth... [2023-03-12 03:12:51,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000109920_56279040.pth [2023-03-12 03:12:51,361][124793] Updated weights for policy 0, policy_version 110480 (0.0005) [2023-03-12 03:12:55,639][124793] Updated weights for policy 0, policy_version 110560 (0.0005) [2023-03-12 03:12:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9636.0). Total num frames: 56606720. Throughput: 0: 9468.1. Samples: 56606552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:12:56,005][124505] Avg episode reward: [(0, '4589.643')] [2023-03-12 03:13:00,003][124793] Updated weights for policy 0, policy_version 110640 (0.0005) [2023-03-12 03:13:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9636.0). Total num frames: 56655872. Throughput: 0: 9447.9. Samples: 56634820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:13:01,005][124505] Avg episode reward: [(0, '4551.731')] [2023-03-12 03:13:04,367][124793] Updated weights for policy 0, policy_version 110720 (0.0005) [2023-03-12 03:13:06,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9622.1). Total num frames: 56700928. Throughput: 0: 9426.6. Samples: 56690948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:13:06,005][124505] Avg episode reward: [(0, '4589.331')] [2023-03-12 03:13:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000110744_56700928.pth... [2023-03-12 03:13:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000110192_56418304.pth [2023-03-12 03:13:08,747][124793] Updated weights for policy 0, policy_version 110800 (0.0005) [2023-03-12 03:13:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9622.1). Total num frames: 56750080. Throughput: 0: 9408.8. Samples: 56746780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:13:11,005][124505] Avg episode reward: [(0, '4581.212')] [2023-03-12 03:13:13,111][124793] Updated weights for policy 0, policy_version 110880 (0.0005) [2023-03-12 03:13:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9608.2). Total num frames: 56795136. Throughput: 0: 9412.2. Samples: 56774848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:13:16,005][124505] Avg episode reward: [(0, '4573.921')] [2023-03-12 03:13:17,512][124793] Updated weights for policy 0, policy_version 110960 (0.0005) [2023-03-12 03:13:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9622.1). Total num frames: 56844288. Throughput: 0: 9414.0. Samples: 56832000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:13:21,005][124505] Avg episode reward: [(0, '4588.114')] [2023-03-12 03:13:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000111024_56844288.pth... [2023-03-12 03:13:21,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000110472_56561664.pth [2023-03-12 03:13:21,867][124793] Updated weights for policy 0, policy_version 111040 (0.0005) [2023-03-12 03:13:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9608.2). Total num frames: 56889344. Throughput: 0: 9411.7. Samples: 56887440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:13:26,005][124505] Avg episode reward: [(0, '4590.226')] [2023-03-12 03:13:26,208][124793] Updated weights for policy 0, policy_version 111120 (0.0005) [2023-03-12 03:13:30,579][124793] Updated weights for policy 0, policy_version 111200 (0.0005) [2023-03-12 03:13:31,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9622.1). Total num frames: 56938496. Throughput: 0: 9409.1. Samples: 56915504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:13:31,005][124505] Avg episode reward: [(0, '4587.068')] [2023-03-12 03:13:34,948][124793] Updated weights for policy 0, policy_version 111280 (0.0005) [2023-03-12 03:13:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9608.2). Total num frames: 56983552. Throughput: 0: 9411.6. Samples: 56971904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:13:36,005][124505] Avg episode reward: [(0, '4561.008')] [2023-03-12 03:13:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000111296_56983552.pth... [2023-03-12 03:13:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000110744_56700928.pth [2023-03-12 03:13:39,283][124793] Updated weights for policy 0, policy_version 111360 (0.0005) [2023-03-12 03:13:41,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9622.1). Total num frames: 57032704. Throughput: 0: 9380.6. Samples: 57028680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:13:41,005][124505] Avg episode reward: [(0, '4512.386')] [2023-03-12 03:13:43,661][124793] Updated weights for policy 0, policy_version 111440 (0.0005) [2023-03-12 03:13:46,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9622.1). Total num frames: 57077760. Throughput: 0: 9385.1. Samples: 57057148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:13:46,005][124505] Avg episode reward: [(0, '4511.103')] [2023-03-12 03:13:47,996][124793] Updated weights for policy 0, policy_version 111520 (0.0005) [2023-03-12 03:13:51,005][124505] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9608.2). Total num frames: 57122816. Throughput: 0: 9390.7. Samples: 57113528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:13:51,005][124505] Avg episode reward: [(0, '4447.215')] [2023-03-12 03:13:51,064][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000111576_57126912.pth... [2023-03-12 03:13:51,065][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000111024_56844288.pth [2023-03-12 03:13:52,377][124793] Updated weights for policy 0, policy_version 111600 (0.0005) [2023-03-12 03:13:56,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9608.2). Total num frames: 57171968. Throughput: 0: 9394.9. Samples: 57169552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:13:56,005][124505] Avg episode reward: [(0, '4280.066')] [2023-03-12 03:13:56,712][124793] Updated weights for policy 0, policy_version 111680 (0.0005) [2023-03-12 03:14:01,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9594.4). Total num frames: 57217024. Throughput: 0: 9390.0. Samples: 57197396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:14:01,005][124505] Avg episode reward: [(0, '4564.992')] [2023-03-12 03:14:01,131][124793] Updated weights for policy 0, policy_version 111760 (0.0005) [2023-03-12 03:14:05,495][124793] Updated weights for policy 0, policy_version 111840 (0.0005) [2023-03-12 03:14:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9594.4). Total num frames: 57266176. Throughput: 0: 9375.7. Samples: 57253904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:14:06,005][124505] Avg episode reward: [(0, '4511.551')] [2023-03-12 03:14:06,007][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000111848_57266176.pth... [2023-03-12 03:14:06,009][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000111296_56983552.pth [2023-03-12 03:14:09,821][124793] Updated weights for policy 0, policy_version 111920 (0.0005) [2023-03-12 03:14:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9580.5). Total num frames: 57311232. Throughput: 0: 9408.7. Samples: 57310832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:14:11,005][124505] Avg episode reward: [(0, '4566.755')] [2023-03-12 03:14:14,052][124793] Updated weights for policy 0, policy_version 112000 (0.0005) [2023-03-12 03:14:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9580.5). Total num frames: 57360384. Throughput: 0: 9431.1. Samples: 57339904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:14:16,005][124505] Avg episode reward: [(0, '4323.862')] [2023-03-12 03:14:18,310][124793] Updated weights for policy 0, policy_version 112080 (0.0004) [2023-03-12 03:14:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9566.6). Total num frames: 57409536. Throughput: 0: 9452.3. Samples: 57397256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:14:21,005][124505] Avg episode reward: [(0, '4430.973')] [2023-03-12 03:14:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000112128_57409536.pth... [2023-03-12 03:14:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000111576_57126912.pth [2023-03-12 03:14:22,628][124793] Updated weights for policy 0, policy_version 112160 (0.0005) [2023-03-12 03:14:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9566.6). Total num frames: 57454592. Throughput: 0: 9454.0. Samples: 57454108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:14:26,005][124505] Avg episode reward: [(0, '4508.068')] [2023-03-12 03:14:26,927][124793] Updated weights for policy 0, policy_version 112240 (0.0005) [2023-03-12 03:14:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9552.7). Total num frames: 57503744. Throughput: 0: 9469.2. Samples: 57483264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:14:31,005][124505] Avg episode reward: [(0, '4522.128')] [2023-03-12 03:14:31,157][124793] Updated weights for policy 0, policy_version 112320 (0.0005) [2023-03-12 03:14:35,119][124793] Updated weights for policy 0, policy_version 112400 (0.0004) [2023-03-12 03:14:36,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9557.3, 300 sec: 9566.6). Total num frames: 57556992. Throughput: 0: 9547.6. Samples: 57543172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:14:36,005][124505] Avg episode reward: [(0, '4478.986')] [2023-03-12 03:14:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000112416_57556992.pth... [2023-03-12 03:14:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000111848_57266176.pth [2023-03-12 03:14:39,193][124793] Updated weights for policy 0, policy_version 112480 (0.0005) [2023-03-12 03:14:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9557.3, 300 sec: 9566.6). Total num frames: 57606144. Throughput: 0: 9644.4. Samples: 57603552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:14:41,005][124505] Avg episode reward: [(0, '4558.229')] [2023-03-12 03:14:43,210][124793] Updated weights for policy 0, policy_version 112560 (0.0004) [2023-03-12 03:14:46,005][124505] Fps is (10 sec: 10240.1, 60 sec: 9693.9, 300 sec: 9580.5). Total num frames: 57659392. Throughput: 0: 9719.5. Samples: 57634772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:14:46,005][124505] Avg episode reward: [(0, '4572.204')] [2023-03-12 03:14:47,210][124793] Updated weights for policy 0, policy_version 112640 (0.0004) [2023-03-12 03:14:51,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9762.1, 300 sec: 9580.5). Total num frames: 57708544. Throughput: 0: 9825.0. Samples: 57696028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:14:51,006][124505] Avg episode reward: [(0, '4527.159')] [2023-03-12 03:14:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000112712_57708544.pth... [2023-03-12 03:14:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000112128_57409536.pth [2023-03-12 03:14:51,273][124793] Updated weights for policy 0, policy_version 112720 (0.0005) [2023-03-12 03:14:54,088][124749] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000006 [2023-03-12 03:14:55,304][124793] Updated weights for policy 0, policy_version 112800 (0.0004) [2023-03-12 03:14:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9566.6). Total num frames: 57757696. Throughput: 0: 9901.9. Samples: 57756420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:14:56,005][124505] Avg episode reward: [(0, '4574.524')] [2023-03-12 03:14:59,422][124793] Updated weights for policy 0, policy_version 112880 (0.0004) [2023-03-12 03:15:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9580.5). Total num frames: 57806848. Throughput: 0: 9922.8. Samples: 57786432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:15:01,005][124505] Avg episode reward: [(0, '4536.438')] [2023-03-12 03:15:03,460][124793] Updated weights for policy 0, policy_version 112960 (0.0004) [2023-03-12 03:15:06,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9594.4). Total num frames: 57860096. Throughput: 0: 10000.6. Samples: 57847284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:15:06,005][124505] Avg episode reward: [(0, '4533.246')] [2023-03-12 03:15:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000113008_57860096.pth... [2023-03-12 03:15:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000112416_57556992.pth [2023-03-12 03:15:07,400][124793] Updated weights for policy 0, policy_version 113040 (0.0005) [2023-03-12 03:15:11,005][124505] Fps is (10 sec: 10649.6, 60 sec: 10035.2, 300 sec: 9622.1). Total num frames: 57913344. Throughput: 0: 10125.5. Samples: 57909756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:15:11,005][124505] Avg episode reward: [(0, '4544.567')] [2023-03-12 03:15:11,322][124793] Updated weights for policy 0, policy_version 113120 (0.0004) [2023-03-12 03:15:15,402][124793] Updated weights for policy 0, policy_version 113200 (0.0004) [2023-03-12 03:15:16,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9622.1). Total num frames: 57962496. Throughput: 0: 10137.2. Samples: 57939436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:15:16,005][124505] Avg episode reward: [(0, '4531.176')] [2023-03-12 03:15:19,573][124793] Updated weights for policy 0, policy_version 113280 (0.0005) [2023-03-12 03:15:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9622.1). Total num frames: 58011648. Throughput: 0: 10138.9. Samples: 57999424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:15:21,005][124505] Avg episode reward: [(0, '4558.550')] [2023-03-12 03:15:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000113304_58011648.pth... [2023-03-12 03:15:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000112712_57708544.pth [2023-03-12 03:15:23,868][124793] Updated weights for policy 0, policy_version 113360 (0.0005) [2023-03-12 03:15:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 9622.1). Total num frames: 58060800. Throughput: 0: 10085.4. Samples: 58057396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:15:26,005][124505] Avg episode reward: [(0, '4548.439')] [2023-03-12 03:15:27,952][124793] Updated weights for policy 0, policy_version 113440 (0.0005) [2023-03-12 03:15:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 9636.0). Total num frames: 58109952. Throughput: 0: 10065.8. Samples: 58087732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:15:31,005][124505] Avg episode reward: [(0, '4518.743')] [2023-03-12 03:15:31,999][124793] Updated weights for policy 0, policy_version 113520 (0.0004) [2023-03-12 03:15:36,005][124505] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9636.0). Total num frames: 58159104. Throughput: 0: 10046.5. Samples: 58148120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:15:36,006][124505] Avg episode reward: [(0, '4443.043')] [2023-03-12 03:15:36,021][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000113600_58163200.pth... [2023-03-12 03:15:36,021][124793] Updated weights for policy 0, policy_version 113600 (0.0004) [2023-03-12 03:15:36,023][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000113008_57860096.pth [2023-03-12 03:15:40,170][124793] Updated weights for policy 0, policy_version 113680 (0.0005) [2023-03-12 03:15:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10103.5, 300 sec: 9663.8). Total num frames: 58212352. Throughput: 0: 10042.2. Samples: 58208320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:15:41,005][124505] Avg episode reward: [(0, '4531.870')] [2023-03-12 03:15:44,348][124793] Updated weights for policy 0, policy_version 113760 (0.0005) [2023-03-12 03:15:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9649.9). Total num frames: 58257408. Throughput: 0: 10022.0. Samples: 58237420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:15:46,005][124505] Avg episode reward: [(0, '4523.268')] [2023-03-12 03:15:48,735][124793] Updated weights for policy 0, policy_version 113840 (0.0005) [2023-03-12 03:15:51,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9966.9, 300 sec: 9649.9). Total num frames: 58306560. Throughput: 0: 9934.5. Samples: 58294336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:15:51,005][124505] Avg episode reward: [(0, '4510.161')] [2023-03-12 03:15:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000113880_58306560.pth... [2023-03-12 03:15:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000113304_58011648.pth [2023-03-12 03:15:53,051][124793] Updated weights for policy 0, policy_version 113920 (0.0005) [2023-03-12 03:15:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9636.0). Total num frames: 58351616. Throughput: 0: 9819.1. Samples: 58351616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:15:56,005][124505] Avg episode reward: [(0, '4492.289')] [2023-03-12 03:15:57,325][124793] Updated weights for policy 0, policy_version 114000 (0.0005) [2023-03-12 03:16:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9636.0). Total num frames: 58400768. Throughput: 0: 9797.0. Samples: 58380300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:16:01,005][124505] Avg episode reward: [(0, '4559.980')] [2023-03-12 03:16:01,608][124793] Updated weights for policy 0, policy_version 114080 (0.0005) [2023-03-12 03:16:05,883][124793] Updated weights for policy 0, policy_version 114160 (0.0005) [2023-03-12 03:16:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9636.0). Total num frames: 58449920. Throughput: 0: 9738.2. Samples: 58437644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:16:06,005][124505] Avg episode reward: [(0, '4530.186')] [2023-03-12 03:16:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000114160_58449920.pth... [2023-03-12 03:16:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000113600_58163200.pth [2023-03-12 03:16:10,153][124793] Updated weights for policy 0, policy_version 114240 (0.0005) [2023-03-12 03:16:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9622.1). Total num frames: 58494976. Throughput: 0: 9724.2. Samples: 58494984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:16:11,005][124505] Avg episode reward: [(0, '4518.513')] [2023-03-12 03:16:14,335][124793] Updated weights for policy 0, policy_version 114320 (0.0004) [2023-03-12 03:16:16,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9636.0). Total num frames: 58548224. Throughput: 0: 9694.4. Samples: 58523980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:16:16,005][124505] Avg episode reward: [(0, '4576.528')] [2023-03-12 03:16:18,375][124793] Updated weights for policy 0, policy_version 114400 (0.0005) [2023-03-12 03:16:21,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9636.0). Total num frames: 58597376. Throughput: 0: 9716.3. Samples: 58585352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:16:21,005][124505] Avg episode reward: [(0, '4589.817')] [2023-03-12 03:16:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000114448_58597376.pth... [2023-03-12 03:16:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000113880_58306560.pth [2023-03-12 03:16:22,334][124793] Updated weights for policy 0, policy_version 114480 (0.0004) [2023-03-12 03:16:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9649.9). Total num frames: 58650624. Throughput: 0: 9752.8. Samples: 58647196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:16:26,005][124505] Avg episode reward: [(0, '4540.752')] [2023-03-12 03:16:26,313][124793] Updated weights for policy 0, policy_version 114560 (0.0004) [2023-03-12 03:16:30,224][124793] Updated weights for policy 0, policy_version 114640 (0.0004) [2023-03-12 03:16:31,005][124505] Fps is (10 sec: 10240.1, 60 sec: 9830.4, 300 sec: 9649.9). Total num frames: 58699776. Throughput: 0: 9808.7. Samples: 58678812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:16:31,005][124505] Avg episode reward: [(0, '4543.344')] [2023-03-12 03:16:34,220][124793] Updated weights for policy 0, policy_version 114720 (0.0005) [2023-03-12 03:16:36,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9677.7). Total num frames: 58753024. Throughput: 0: 9916.8. Samples: 58740592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:16:36,006][124505] Avg episode reward: [(0, '4560.976')] [2023-03-12 03:16:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000114752_58753024.pth... [2023-03-12 03:16:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000114160_58449920.pth [2023-03-12 03:16:38,549][124793] Updated weights for policy 0, policy_version 114800 (0.0005) [2023-03-12 03:16:41,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9663.8). Total num frames: 58798080. Throughput: 0: 9913.9. Samples: 58797740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:16:41,005][124505] Avg episode reward: [(0, '4576.896')] [2023-03-12 03:16:42,768][124793] Updated weights for policy 0, policy_version 114880 (0.0005) [2023-03-12 03:16:46,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9830.4, 300 sec: 9677.7). Total num frames: 58847232. Throughput: 0: 9921.2. Samples: 58826752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:16:46,005][124505] Avg episode reward: [(0, '4572.318')] [2023-03-12 03:16:47,060][124793] Updated weights for policy 0, policy_version 114960 (0.0005) [2023-03-12 03:16:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9677.7). Total num frames: 58896384. Throughput: 0: 9922.6. Samples: 58884160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:16:51,005][124505] Avg episode reward: [(0, '4583.739')] [2023-03-12 03:16:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000115032_58896384.pth... [2023-03-12 03:16:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000114448_58597376.pth [2023-03-12 03:16:51,271][124793] Updated weights for policy 0, policy_version 115040 (0.0005) [2023-03-12 03:16:55,422][124793] Updated weights for policy 0, policy_version 115120 (0.0005) [2023-03-12 03:16:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9691.6). Total num frames: 58945536. Throughput: 0: 9957.7. Samples: 58943080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:16:56,005][124505] Avg episode reward: [(0, '4592.244')] [2023-03-12 03:16:59,452][124793] Updated weights for policy 0, policy_version 115200 (0.0005) [2023-03-12 03:17:01,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9691.6). Total num frames: 58994688. Throughput: 0: 9997.7. Samples: 58973876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:17:01,005][124505] Avg episode reward: [(0, '4546.225')] [2023-03-12 03:17:03,518][124793] Updated weights for policy 0, policy_version 115280 (0.0005) [2023-03-12 03:17:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9705.4). Total num frames: 59043840. Throughput: 0: 9965.7. Samples: 59033808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:17:06,005][124505] Avg episode reward: [(0, '4492.133')] [2023-03-12 03:17:06,041][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000115328_59047936.pth... [2023-03-12 03:17:06,043][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000114752_58753024.pth [2023-03-12 03:17:07,671][124793] Updated weights for policy 0, policy_version 115360 (0.0005) [2023-03-12 03:17:11,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9719.3). Total num frames: 59097088. Throughput: 0: 9937.7. Samples: 59094392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:17:11,005][124505] Avg episode reward: [(0, '4496.379')] [2023-03-12 03:17:11,646][124793] Updated weights for policy 0, policy_version 115440 (0.0005) [2023-03-12 03:17:15,576][124793] Updated weights for policy 0, policy_version 115520 (0.0004) [2023-03-12 03:17:16,005][124505] Fps is (10 sec: 10649.5, 60 sec: 10035.2, 300 sec: 9733.2). Total num frames: 59150336. Throughput: 0: 9933.6. Samples: 59125824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:17:16,006][124505] Avg episode reward: [(0, '4571.719')] [2023-03-12 03:17:19,741][124793] Updated weights for policy 0, policy_version 115600 (0.0005) [2023-03-12 03:17:21,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9747.1). Total num frames: 59199488. Throughput: 0: 9887.7. Samples: 59185540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:17:21,005][124505] Avg episode reward: [(0, '4571.218')] [2023-03-12 03:17:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000115624_59199488.pth... [2023-03-12 03:17:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000115032_58896384.pth [2023-03-12 03:17:23,719][124793] Updated weights for policy 0, policy_version 115680 (0.0005) [2023-03-12 03:17:26,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9747.1). Total num frames: 59248640. Throughput: 0: 9997.2. Samples: 59247612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:17:26,005][124505] Avg episode reward: [(0, '4577.597')] [2023-03-12 03:17:27,878][124793] Updated weights for policy 0, policy_version 115760 (0.0005) [2023-03-12 03:17:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9761.0). Total num frames: 59297792. Throughput: 0: 9980.6. Samples: 59275880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:17:31,005][124505] Avg episode reward: [(0, '4561.793')] [2023-03-12 03:17:32,232][124793] Updated weights for policy 0, policy_version 115840 (0.0005) [2023-03-12 03:17:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9830.4, 300 sec: 9747.1). Total num frames: 59342848. Throughput: 0: 9980.3. Samples: 59333276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:17:36,006][124505] Avg episode reward: [(0, '4587.175')] [2023-03-12 03:17:36,035][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000115912_59346944.pth... [2023-03-12 03:17:36,036][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000115328_59047936.pth [2023-03-12 03:17:36,489][124793] Updated weights for policy 0, policy_version 115920 (0.0005) [2023-03-12 03:17:40,466][124793] Updated weights for policy 0, policy_version 116000 (0.0005) [2023-03-12 03:17:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9774.9). Total num frames: 59396096. Throughput: 0: 10000.9. Samples: 59393120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:17:41,005][124505] Avg episode reward: [(0, '4554.322')] [2023-03-12 03:17:44,535][124793] Updated weights for policy 0, policy_version 116080 (0.0004) [2023-03-12 03:17:46,005][124505] Fps is (10 sec: 10240.1, 60 sec: 9966.9, 300 sec: 9774.9). Total num frames: 59445248. Throughput: 0: 10008.4. Samples: 59424252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:17:46,005][124505] Avg episode reward: [(0, '4590.677')] [2023-03-12 03:17:48,616][124793] Updated weights for policy 0, policy_version 116160 (0.0005) [2023-03-12 03:17:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9788.7). Total num frames: 59494400. Throughput: 0: 9985.4. Samples: 59483152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:17:51,005][124505] Avg episode reward: [(0, '4545.153')] [2023-03-12 03:17:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000116200_59494400.pth... [2023-03-12 03:17:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000115624_59199488.pth [2023-03-12 03:17:52,805][124793] Updated weights for policy 0, policy_version 116240 (0.0005) [2023-03-12 03:17:56,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9788.7). Total num frames: 59543552. Throughput: 0: 9981.3. Samples: 59543552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:17:56,016][124505] Avg episode reward: [(0, '4553.947')] [2023-03-12 03:17:57,024][124793] Updated weights for policy 0, policy_version 116320 (0.0004) [2023-03-12 03:18:01,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9802.6). Total num frames: 59592704. Throughput: 0: 9886.4. Samples: 59570712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:18:01,016][124505] Avg episode reward: [(0, '4576.963')] [2023-03-12 03:18:01,372][124793] Updated weights for policy 0, policy_version 116400 (0.0005) [2023-03-12 03:18:05,676][124793] Updated weights for policy 0, policy_version 116480 (0.0005) [2023-03-12 03:18:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9788.7). Total num frames: 59637760. Throughput: 0: 9823.0. Samples: 59627576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:18:06,016][124505] Avg episode reward: [(0, '4560.867')] [2023-03-12 03:18:06,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000116480_59637760.pth... [2023-03-12 03:18:06,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000115912_59346944.pth [2023-03-12 03:18:09,878][124793] Updated weights for policy 0, policy_version 116560 (0.0005) [2023-03-12 03:18:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9802.6). Total num frames: 59686912. Throughput: 0: 9733.2. Samples: 59685604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:18:11,005][124505] Avg episode reward: [(0, '4594.068')] [2023-03-12 03:18:14,221][124793] Updated weights for policy 0, policy_version 116640 (0.0005) [2023-03-12 03:18:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.2, 300 sec: 9802.6). Total num frames: 59736064. Throughput: 0: 9742.0. Samples: 59714268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:18:16,005][124505] Avg episode reward: [(0, '4585.914')] [2023-03-12 03:18:18,431][124793] Updated weights for policy 0, policy_version 116720 (0.0005) [2023-03-12 03:18:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9802.6). Total num frames: 59781120. Throughput: 0: 9747.9. Samples: 59771932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:18:21,005][124505] Avg episode reward: [(0, '4597.891')] [2023-03-12 03:18:21,039][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000116768_59785216.pth... [2023-03-12 03:18:21,041][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000116200_59494400.pth [2023-03-12 03:18:22,806][124793] Updated weights for policy 0, policy_version 116800 (0.0005) [2023-03-12 03:18:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9802.6). Total num frames: 59830272. Throughput: 0: 9701.8. Samples: 59829700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:18:26,005][124505] Avg episode reward: [(0, '4587.731')] [2023-03-12 03:18:26,858][124793] Updated weights for policy 0, policy_version 116880 (0.0004) [2023-03-12 03:18:30,930][124793] Updated weights for policy 0, policy_version 116960 (0.0004) [2023-03-12 03:18:31,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9830.4). Total num frames: 59883520. Throughput: 0: 9688.4. Samples: 59860228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:18:31,005][124505] Avg episode reward: [(0, '4591.540')] [2023-03-12 03:18:34,881][124793] Updated weights for policy 0, policy_version 117040 (0.0005) [2023-03-12 03:18:36,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9830.4). Total num frames: 59932672. Throughput: 0: 9734.0. Samples: 59921180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:18:36,005][124505] Avg episode reward: [(0, '4598.082')] [2023-03-12 03:18:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000117056_59932672.pth... [2023-03-12 03:18:36,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000116480_59637760.pth [2023-03-12 03:18:38,793][124793] Updated weights for policy 0, policy_version 117120 (0.0004) [2023-03-12 03:18:41,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9858.2). Total num frames: 59985920. Throughput: 0: 9789.2. Samples: 59984068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:18:41,005][124505] Avg episode reward: [(0, '4584.777')] [2023-03-12 03:18:42,730][124793] Updated weights for policy 0, policy_version 117200 (0.0004) [2023-03-12 03:18:46,005][124505] Fps is (10 sec: 10649.7, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 60039168. Throughput: 0: 9878.1. Samples: 60015228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:18:46,005][124505] Avg episode reward: [(0, '4592.249')] [2023-03-12 03:18:46,621][124793] Updated weights for policy 0, policy_version 117280 (0.0004) [2023-03-12 03:18:50,590][124793] Updated weights for policy 0, policy_version 117360 (0.0004) [2023-03-12 03:18:51,005][124505] Fps is (10 sec: 10649.5, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 60092416. Throughput: 0: 10003.4. Samples: 60077728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:18:51,005][124505] Avg episode reward: [(0, '4596.652')] [2023-03-12 03:18:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000117368_60092416.pth... [2023-03-12 03:18:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000116768_59785216.pth [2023-03-12 03:18:54,583][124793] Updated weights for policy 0, policy_version 117440 (0.0005) [2023-03-12 03:18:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9913.7). Total num frames: 60141568. Throughput: 0: 10088.8. Samples: 60139600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:18:56,005][124505] Avg episode reward: [(0, '4597.937')] [2023-03-12 03:18:58,529][124793] Updated weights for policy 0, policy_version 117520 (0.0004) [2023-03-12 03:19:01,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9927.6). Total num frames: 60194816. Throughput: 0: 10139.2. Samples: 60170532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:19:01,006][124505] Avg episode reward: [(0, '4595.802')] [2023-03-12 03:19:02,451][124793] Updated weights for policy 0, policy_version 117600 (0.0004) [2023-03-12 03:19:06,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10103.5, 300 sec: 9941.5). Total num frames: 60243968. Throughput: 0: 10248.7. Samples: 60233124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:19:06,005][124505] Avg episode reward: [(0, '4598.860')] [2023-03-12 03:19:06,010][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000117672_60248064.pth... [2023-03-12 03:19:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000117056_59932672.pth [2023-03-12 03:19:06,424][124793] Updated weights for policy 0, policy_version 117680 (0.0004) [2023-03-12 03:19:10,391][124793] Updated weights for policy 0, policy_version 117760 (0.0005) [2023-03-12 03:19:11,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10171.7, 300 sec: 9955.4). Total num frames: 60297216. Throughput: 0: 10343.8. Samples: 60295172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:19:11,005][124505] Avg episode reward: [(0, '4596.101')] [2023-03-12 03:19:14,398][124793] Updated weights for policy 0, policy_version 117840 (0.0004) [2023-03-12 03:19:16,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10171.7, 300 sec: 9955.4). Total num frames: 60346368. Throughput: 0: 10349.4. Samples: 60325952. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:19:16,005][124505] Avg episode reward: [(0, '4594.978')] [2023-03-12 03:19:18,509][124793] Updated weights for policy 0, policy_version 117920 (0.0005) [2023-03-12 03:19:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10240.0, 300 sec: 9969.2). Total num frames: 60395520. Throughput: 0: 10321.5. Samples: 60385648. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:19:21,005][124505] Avg episode reward: [(0, '4600.012')] [2023-03-12 03:19:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000117960_60395520.pth... [2023-03-12 03:19:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000117368_60092416.pth [2023-03-12 03:19:22,720][124793] Updated weights for policy 0, policy_version 118000 (0.0005) [2023-03-12 03:19:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10240.0, 300 sec: 9969.2). Total num frames: 60444672. Throughput: 0: 10219.1. Samples: 60443928. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:19:26,005][124505] Avg episode reward: [(0, '4576.093')] [2023-03-12 03:19:26,884][124793] Updated weights for policy 0, policy_version 118080 (0.0005) [2023-03-12 03:19:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 9955.4). Total num frames: 60493824. Throughput: 0: 10181.8. Samples: 60473408. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:19:31,005][124505] Avg episode reward: [(0, '4585.752')] [2023-03-12 03:19:31,051][124793] Updated weights for policy 0, policy_version 118160 (0.0004) [2023-03-12 03:19:35,315][124793] Updated weights for policy 0, policy_version 118240 (0.0005) [2023-03-12 03:19:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10171.7, 300 sec: 9955.4). Total num frames: 60542976. Throughput: 0: 10093.2. Samples: 60531924. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:19:36,005][124505] Avg episode reward: [(0, '4594.697')] [2023-03-12 03:19:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000118248_60542976.pth... [2023-03-12 03:19:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000117672_60248064.pth [2023-03-12 03:19:39,513][124793] Updated weights for policy 0, policy_version 118320 (0.0005) [2023-03-12 03:19:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10103.5, 300 sec: 9941.5). Total num frames: 60592128. Throughput: 0: 10016.9. Samples: 60590360. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:19:41,005][124505] Avg episode reward: [(0, '4566.436')] [2023-03-12 03:19:43,756][124793] Updated weights for policy 0, policy_version 118400 (0.0005) [2023-03-12 03:19:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9941.5). Total num frames: 60641280. Throughput: 0: 9974.7. Samples: 60619396. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:19:46,005][124505] Avg episode reward: [(0, '4583.293')] [2023-03-12 03:19:48,044][124793] Updated weights for policy 0, policy_version 118480 (0.0005) [2023-03-12 03:19:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 60686336. Throughput: 0: 9865.0. Samples: 60677048. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:19:51,005][124505] Avg episode reward: [(0, '4574.332')] [2023-03-12 03:19:51,020][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000118536_60690432.pth... [2023-03-12 03:19:51,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000117960_60395520.pth [2023-03-12 03:19:52,348][124793] Updated weights for policy 0, policy_version 118560 (0.0005) [2023-03-12 03:19:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9927.6). Total num frames: 60735488. Throughput: 0: 9757.1. Samples: 60734240. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:19:56,005][124505] Avg episode reward: [(0, '4597.091')] [2023-03-12 03:19:56,652][124793] Updated weights for policy 0, policy_version 118640 (0.0005) [2023-03-12 03:20:00,878][124793] Updated weights for policy 0, policy_version 118720 (0.0005) [2023-03-12 03:20:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9913.7). Total num frames: 60784640. Throughput: 0: 9706.9. Samples: 60762764. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:20:01,005][124505] Avg episode reward: [(0, '4590.070')] [2023-03-12 03:20:05,171][124793] Updated weights for policy 0, policy_version 118800 (0.0005) [2023-03-12 03:20:06,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9762.1, 300 sec: 9885.9). Total num frames: 60829696. Throughput: 0: 9655.9. Samples: 60820164. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:20:06,005][124505] Avg episode reward: [(0, '4579.501')] [2023-03-12 03:20:06,017][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000118816_60833792.pth... [2023-03-12 03:20:06,018][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000118248_60542976.pth [2023-03-12 03:20:09,439][124793] Updated weights for policy 0, policy_version 118880 (0.0005) [2023-03-12 03:20:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9885.9). Total num frames: 60878848. Throughput: 0: 9643.5. Samples: 60877884. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:20:11,005][124505] Avg episode reward: [(0, '4562.944')] [2023-03-12 03:20:13,679][124793] Updated weights for policy 0, policy_version 118960 (0.0005) [2023-03-12 03:20:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9885.9). Total num frames: 60928000. Throughput: 0: 9644.4. Samples: 60907404. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:20:16,005][124505] Avg episode reward: [(0, '4559.708')] [2023-03-12 03:20:17,908][124793] Updated weights for policy 0, policy_version 119040 (0.0004) [2023-03-12 03:20:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9885.9). Total num frames: 60977152. Throughput: 0: 9621.3. Samples: 60964880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:20:21,005][124505] Avg episode reward: [(0, '4598.598')] [2023-03-12 03:20:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000119096_60977152.pth... [2023-03-12 03:20:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000118536_60690432.pth [2023-03-12 03:20:22,132][124793] Updated weights for policy 0, policy_version 119120 (0.0005) [2023-03-12 03:20:26,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9885.9). Total num frames: 61026304. Throughput: 0: 9613.5. Samples: 61022968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:20:26,006][124505] Avg episode reward: [(0, '4587.760')] [2023-03-12 03:20:26,351][124793] Updated weights for policy 0, policy_version 119200 (0.0005) [2023-03-12 03:20:30,645][124793] Updated weights for policy 0, policy_version 119280 (0.0005) [2023-03-12 03:20:31,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9872.1). Total num frames: 61071360. Throughput: 0: 9597.8. Samples: 61051296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:20:31,005][124505] Avg episode reward: [(0, '4530.873')] [2023-03-12 03:20:34,909][124793] Updated weights for policy 0, policy_version 119360 (0.0005) [2023-03-12 03:20:36,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9858.2). Total num frames: 61120512. Throughput: 0: 9605.4. Samples: 61109292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:20:36,005][124505] Avg episode reward: [(0, '4588.904')] [2023-03-12 03:20:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000119376_61120512.pth... [2023-03-12 03:20:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000118816_60833792.pth [2023-03-12 03:20:39,213][124793] Updated weights for policy 0, policy_version 119440 (0.0005) [2023-03-12 03:20:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9872.1). Total num frames: 61169664. Throughput: 0: 9597.3. Samples: 61166120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:20:41,005][124505] Avg episode reward: [(0, '4543.876')] [2023-03-12 03:20:43,499][124793] Updated weights for policy 0, policy_version 119520 (0.0005) [2023-03-12 03:20:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9858.2). Total num frames: 61214720. Throughput: 0: 9603.4. Samples: 61194916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:20:46,005][124505] Avg episode reward: [(0, '4597.327')] [2023-03-12 03:20:47,802][124793] Updated weights for policy 0, policy_version 119600 (0.0005) [2023-03-12 03:20:51,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9872.1). Total num frames: 61263872. Throughput: 0: 9593.9. Samples: 61251888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:20:51,005][124505] Avg episode reward: [(0, '4596.326')] [2023-03-12 03:20:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000119656_61263872.pth... [2023-03-12 03:20:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000119096_60977152.pth [2023-03-12 03:20:52,073][124793] Updated weights for policy 0, policy_version 119680 (0.0005) [2023-03-12 03:20:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9872.1). Total num frames: 61313024. Throughput: 0: 9601.0. Samples: 61309928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:20:56,005][124505] Avg episode reward: [(0, '4567.148')] [2023-03-12 03:20:56,299][124793] Updated weights for policy 0, policy_version 119760 (0.0005) [2023-03-12 03:21:00,561][124793] Updated weights for policy 0, policy_version 119840 (0.0005) [2023-03-12 03:21:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9872.1). Total num frames: 61362176. Throughput: 0: 9590.7. Samples: 61338988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:21:01,006][124505] Avg episode reward: [(0, '4588.903')] [2023-03-12 03:21:04,828][124793] Updated weights for policy 0, policy_version 119920 (0.0005) [2023-03-12 03:21:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9872.1). Total num frames: 61407232. Throughput: 0: 9590.2. Samples: 61396440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:21:06,005][124505] Avg episode reward: [(0, '4567.966')] [2023-03-12 03:21:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000119936_61407232.pth... [2023-03-12 03:21:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000119376_61120512.pth [2023-03-12 03:21:09,093][124793] Updated weights for policy 0, policy_version 120000 (0.0005) [2023-03-12 03:21:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9858.2). Total num frames: 61456384. Throughput: 0: 9594.6. Samples: 61454724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:21:11,005][124505] Avg episode reward: [(0, '4589.734')] [2023-03-12 03:21:13,385][124793] Updated weights for policy 0, policy_version 120080 (0.0005) [2023-03-12 03:21:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9858.2). Total num frames: 61505536. Throughput: 0: 9595.4. Samples: 61483088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:21:16,005][124505] Avg episode reward: [(0, '4582.037')] [2023-03-12 03:21:17,697][124793] Updated weights for policy 0, policy_version 120160 (0.0005) [2023-03-12 03:21:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9830.4). Total num frames: 61550592. Throughput: 0: 9557.5. Samples: 61539380. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:21:21,005][124505] Avg episode reward: [(0, '4599.060')] [2023-03-12 03:21:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000120216_61550592.pth... [2023-03-12 03:21:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000119656_61263872.pth [2023-03-12 03:21:22,041][124793] Updated weights for policy 0, policy_version 120240 (0.0005) [2023-03-12 03:21:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9830.4). Total num frames: 61599744. Throughput: 0: 9605.9. Samples: 61598384. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:21:26,005][124505] Avg episode reward: [(0, '4601.932')] [2023-03-12 03:21:26,170][124793] Updated weights for policy 0, policy_version 120320 (0.0004) [2023-03-12 03:21:30,420][124793] Updated weights for policy 0, policy_version 120400 (0.0005) [2023-03-12 03:21:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9816.5). Total num frames: 61648896. Throughput: 0: 9612.6. Samples: 61627484. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:21:31,005][124505] Avg episode reward: [(0, '4593.352')] [2023-03-12 03:21:34,386][124793] Updated weights for policy 0, policy_version 120480 (0.0003) [2023-03-12 03:21:36,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9693.9, 300 sec: 9844.3). Total num frames: 61702144. Throughput: 0: 9687.6. Samples: 61687832. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:21:36,005][124505] Avg episode reward: [(0, '4582.935')] [2023-03-12 03:21:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000120512_61702144.pth... [2023-03-12 03:21:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000119936_61407232.pth [2023-03-12 03:21:38,342][124793] Updated weights for policy 0, policy_version 120560 (0.0004) [2023-03-12 03:21:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9693.9, 300 sec: 9844.3). Total num frames: 61751296. Throughput: 0: 9772.5. Samples: 61749692. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:21:41,005][124505] Avg episode reward: [(0, '4585.229')] [2023-03-12 03:21:42,380][124793] Updated weights for policy 0, policy_version 120640 (0.0004) [2023-03-12 03:21:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9844.3). Total num frames: 61800448. Throughput: 0: 9794.3. Samples: 61779732. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:21:46,005][124505] Avg episode reward: [(0, '4595.379')] [2023-03-12 03:21:46,704][124793] Updated weights for policy 0, policy_version 120720 (0.0005) [2023-03-12 03:21:50,989][124793] Updated weights for policy 0, policy_version 120800 (0.0005) [2023-03-12 03:21:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9844.3). Total num frames: 61849600. Throughput: 0: 9773.3. Samples: 61836236. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:21:51,005][124505] Avg episode reward: [(0, '4586.654')] [2023-03-12 03:21:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000120800_61849600.pth... [2023-03-12 03:21:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000120216_61550592.pth [2023-03-12 03:21:55,252][124793] Updated weights for policy 0, policy_version 120880 (0.0005) [2023-03-12 03:21:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9830.4). Total num frames: 61894656. Throughput: 0: 9764.5. Samples: 61894128. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:21:56,005][124505] Avg episode reward: [(0, '4595.300')] [2023-03-12 03:21:59,496][124793] Updated weights for policy 0, policy_version 120960 (0.0005) [2023-03-12 03:22:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9830.4). Total num frames: 61943808. Throughput: 0: 9783.1. Samples: 61923328. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:22:01,005][124505] Avg episode reward: [(0, '4597.105')] [2023-03-12 03:22:03,713][124793] Updated weights for policy 0, policy_version 121040 (0.0005) [2023-03-12 03:22:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9816.5). Total num frames: 61992960. Throughput: 0: 9807.9. Samples: 61980736. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:22:06,016][124505] Avg episode reward: [(0, '4591.782')] [2023-03-12 03:22:06,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000121080_61992960.pth... [2023-03-12 03:22:06,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000120512_61702144.pth [2023-03-12 03:22:08,059][124793] Updated weights for policy 0, policy_version 121120 (0.0005) [2023-03-12 03:22:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9788.7). Total num frames: 62038016. Throughput: 0: 9769.8. Samples: 62038024. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:22:11,016][124505] Avg episode reward: [(0, '4586.818')] [2023-03-12 03:22:12,317][124793] Updated weights for policy 0, policy_version 121200 (0.0005) [2023-03-12 03:22:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9788.7). Total num frames: 62087168. Throughput: 0: 9761.5. Samples: 62066752. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:22:16,016][124505] Avg episode reward: [(0, '4589.680')] [2023-03-12 03:22:16,600][124793] Updated weights for policy 0, policy_version 121280 (0.0005) [2023-03-12 03:22:20,891][124793] Updated weights for policy 0, policy_version 121360 (0.0005) [2023-03-12 03:22:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9788.7). Total num frames: 62136320. Throughput: 0: 9694.8. Samples: 62124096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:22:21,016][124505] Avg episode reward: [(0, '4594.857')] [2023-03-12 03:22:21,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000121360_62136320.pth... [2023-03-12 03:22:21,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000120800_61849600.pth [2023-03-12 03:22:25,220][124793] Updated weights for policy 0, policy_version 121440 (0.0005) [2023-03-12 03:22:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9774.9). Total num frames: 62181376. Throughput: 0: 9589.4. Samples: 62181216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:22:26,016][124505] Avg episode reward: [(0, '4599.734')] [2023-03-12 03:22:29,360][124793] Updated weights for policy 0, policy_version 121520 (0.0004) [2023-03-12 03:22:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9788.7). Total num frames: 62230528. Throughput: 0: 9576.1. Samples: 62210656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:22:31,016][124505] Avg episode reward: [(0, '4589.722')] [2023-03-12 03:22:33,626][124793] Updated weights for policy 0, policy_version 121600 (0.0005) [2023-03-12 03:22:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9774.9). Total num frames: 62279680. Throughput: 0: 9593.3. Samples: 62267936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:22:36,016][124505] Avg episode reward: [(0, '4592.668')] [2023-03-12 03:22:36,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000121640_62279680.pth... [2023-03-12 03:22:36,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000121080_61992960.pth [2023-03-12 03:22:37,987][124793] Updated weights for policy 0, policy_version 121680 (0.0005) [2023-03-12 03:22:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9761.0). Total num frames: 62324736. Throughput: 0: 9569.4. Samples: 62324752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:22:41,016][124505] Avg episode reward: [(0, '4597.554')] [2023-03-12 03:22:42,313][124793] Updated weights for policy 0, policy_version 121760 (0.0005) [2023-03-12 03:22:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9774.9). Total num frames: 62377984. Throughput: 0: 9559.8. Samples: 62353516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:22:46,016][124505] Avg episode reward: [(0, '4605.097')] [2023-03-12 03:22:46,420][124793] Updated weights for policy 0, policy_version 121840 (0.0005) [2023-03-12 03:22:50,662][124793] Updated weights for policy 0, policy_version 121920 (0.0005) [2023-03-12 03:22:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9761.0). Total num frames: 62423040. Throughput: 0: 9599.6. Samples: 62412716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:22:51,005][124505] Avg episode reward: [(0, '4602.270')] [2023-03-12 03:22:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000121920_62423040.pth... [2023-03-12 03:22:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000121360_62136320.pth [2023-03-12 03:22:54,643][124793] Updated weights for policy 0, policy_version 122000 (0.0005) [2023-03-12 03:22:56,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9774.9). Total num frames: 62476288. Throughput: 0: 9684.8. Samples: 62473840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:22:56,005][124505] Avg episode reward: [(0, '4605.132')] [2023-03-12 03:22:58,803][124793] Updated weights for policy 0, policy_version 122080 (0.0005) [2023-03-12 03:23:01,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9693.9, 300 sec: 9788.7). Total num frames: 62525440. Throughput: 0: 9701.2. Samples: 62503304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:23:01,005][124505] Avg episode reward: [(0, '4607.221')] [2023-03-12 03:23:03,168][124793] Updated weights for policy 0, policy_version 122160 (0.0005) [2023-03-12 03:23:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9774.9). Total num frames: 62570496. Throughput: 0: 9685.4. Samples: 62559940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:23:06,005][124505] Avg episode reward: [(0, '4604.329')] [2023-03-12 03:23:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000122208_62570496.pth... [2023-03-12 03:23:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000121640_62279680.pth [2023-03-12 03:23:07,353][124793] Updated weights for policy 0, policy_version 122240 (0.0005) [2023-03-12 03:23:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9774.9). Total num frames: 62619648. Throughput: 0: 9690.9. Samples: 62617308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:23:11,005][124505] Avg episode reward: [(0, '4607.826')] [2023-03-12 03:23:11,713][124793] Updated weights for policy 0, policy_version 122320 (0.0005) [2023-03-12 03:23:15,949][124793] Updated weights for policy 0, policy_version 122400 (0.0005) [2023-03-12 03:23:16,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9788.7). Total num frames: 62668800. Throughput: 0: 9689.8. Samples: 62646696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:23:16,005][124505] Avg episode reward: [(0, '4601.524')] [2023-03-12 03:23:20,202][124793] Updated weights for policy 0, policy_version 122480 (0.0005) [2023-03-12 03:23:21,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9774.9). Total num frames: 62713856. Throughput: 0: 9696.3. Samples: 62704272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:23:21,005][124505] Avg episode reward: [(0, '4613.253')] [2023-03-12 03:23:21,017][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000122496_62717952.pth... [2023-03-12 03:23:21,018][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000121920_62423040.pth [2023-03-12 03:23:21,018][124749] Saving new best policy, reward=4613.253! [2023-03-12 03:23:24,559][124793] Updated weights for policy 0, policy_version 122560 (0.0005) [2023-03-12 03:23:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9761.0). Total num frames: 62763008. Throughput: 0: 9673.6. Samples: 62760064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:23:26,005][124505] Avg episode reward: [(0, '4596.290')] [2023-03-12 03:23:28,863][124793] Updated weights for policy 0, policy_version 122640 (0.0005) [2023-03-12 03:23:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9747.1). Total num frames: 62808064. Throughput: 0: 9683.3. Samples: 62789264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:23:31,005][124505] Avg episode reward: [(0, '4597.006')] [2023-03-12 03:23:33,177][124793] Updated weights for policy 0, policy_version 122720 (0.0005) [2023-03-12 03:23:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9733.2). Total num frames: 62857216. Throughput: 0: 9632.0. Samples: 62846156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:23:36,005][124505] Avg episode reward: [(0, '4603.071')] [2023-03-12 03:23:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000122768_62857216.pth... [2023-03-12 03:23:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000122208_62570496.pth [2023-03-12 03:23:37,488][124793] Updated weights for policy 0, policy_version 122800 (0.0005) [2023-03-12 03:23:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9719.3). Total num frames: 62906368. Throughput: 0: 9534.4. Samples: 62902888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:23:41,005][124505] Avg episode reward: [(0, '4598.782')] [2023-03-12 03:23:41,812][124793] Updated weights for policy 0, policy_version 122880 (0.0005) [2023-03-12 03:23:46,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9691.6). Total num frames: 62951424. Throughput: 0: 9504.7. Samples: 62931016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:23:46,005][124505] Avg episode reward: [(0, '4523.764')] [2023-03-12 03:23:46,236][124793] Updated weights for policy 0, policy_version 122960 (0.0005) [2023-03-12 03:23:50,517][124793] Updated weights for policy 0, policy_version 123040 (0.0005) [2023-03-12 03:23:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9691.5). Total num frames: 63000576. Throughput: 0: 9510.0. Samples: 62987892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:23:51,005][124505] Avg episode reward: [(0, '4333.517')] [2023-03-12 03:23:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000123048_63000576.pth... [2023-03-12 03:23:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000122496_62717952.pth [2023-03-12 03:23:54,978][124793] Updated weights for policy 0, policy_version 123120 (0.0005) [2023-03-12 03:23:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9663.8). Total num frames: 63045632. Throughput: 0: 9462.2. Samples: 63043108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:23:56,005][124505] Avg episode reward: [(0, '4505.983')] [2023-03-12 03:23:59,368][124793] Updated weights for policy 0, policy_version 123200 (0.0005) [2023-03-12 03:24:01,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9649.9). Total num frames: 63090688. Throughput: 0: 9434.2. Samples: 63071236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:24:01,005][124505] Avg episode reward: [(0, '4500.697')] [2023-03-12 03:24:03,777][124793] Updated weights for policy 0, policy_version 123280 (0.0005) [2023-03-12 03:24:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9636.0). Total num frames: 63139840. Throughput: 0: 9404.1. Samples: 63127456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:24:06,005][124505] Avg episode reward: [(0, '4479.030')] [2023-03-12 03:24:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000123320_63139840.pth... [2023-03-12 03:24:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000122768_62857216.pth [2023-03-12 03:24:08,148][124793] Updated weights for policy 0, policy_version 123360 (0.0005) [2023-03-12 03:24:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9622.1). Total num frames: 63184896. Throughput: 0: 9406.4. Samples: 63183352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:24:11,005][124505] Avg episode reward: [(0, '4417.524')] [2023-03-12 03:24:12,588][124793] Updated weights for policy 0, policy_version 123440 (0.0005) [2023-03-12 03:24:16,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9608.2). Total num frames: 63229952. Throughput: 0: 9350.4. Samples: 63210032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:24:16,005][124505] Avg episode reward: [(0, '4511.864')] [2023-03-12 03:24:16,956][124793] Updated weights for policy 0, policy_version 123520 (0.0005) [2023-03-12 03:24:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9608.2). Total num frames: 63279104. Throughput: 0: 9359.2. Samples: 63267320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:24:21,006][124505] Avg episode reward: [(0, '4596.645')] [2023-03-12 03:24:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000123592_63279104.pth... [2023-03-12 03:24:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000123048_63000576.pth [2023-03-12 03:24:21,300][124793] Updated weights for policy 0, policy_version 123600 (0.0005) [2023-03-12 03:24:25,605][124793] Updated weights for policy 0, policy_version 123680 (0.0005) [2023-03-12 03:24:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9594.4). Total num frames: 63324160. Throughput: 0: 9362.0. Samples: 63324176. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:24:26,005][124505] Avg episode reward: [(0, '4596.670')] [2023-03-12 03:24:29,951][124793] Updated weights for policy 0, policy_version 123760 (0.0004) [2023-03-12 03:24:31,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9594.4). Total num frames: 63373312. Throughput: 0: 9373.4. Samples: 63352820. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:24:31,005][124505] Avg episode reward: [(0, '4601.796')] [2023-03-12 03:24:34,296][124793] Updated weights for policy 0, policy_version 123840 (0.0005) [2023-03-12 03:24:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9580.5). Total num frames: 63418368. Throughput: 0: 9357.8. Samples: 63408992. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:24:36,006][124505] Avg episode reward: [(0, '4598.065')] [2023-03-12 03:24:36,041][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000123872_63422464.pth... [2023-03-12 03:24:36,043][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000123320_63139840.pth [2023-03-12 03:24:38,593][124793] Updated weights for policy 0, policy_version 123920 (0.0005) [2023-03-12 03:24:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9580.5). Total num frames: 63467520. Throughput: 0: 9400.9. Samples: 63466148. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:24:41,005][124505] Avg episode reward: [(0, '4593.380')] [2023-03-12 03:24:42,912][124793] Updated weights for policy 0, policy_version 124000 (0.0005) [2023-03-12 03:24:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9594.4). Total num frames: 63516672. Throughput: 0: 9412.1. Samples: 63494780. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:24:46,005][124505] Avg episode reward: [(0, '4607.521')] [2023-03-12 03:24:47,237][124793] Updated weights for policy 0, policy_version 124080 (0.0005) [2023-03-12 03:24:51,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9580.5). Total num frames: 63561728. Throughput: 0: 9428.5. Samples: 63551740. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:24:51,005][124505] Avg episode reward: [(0, '4603.331')] [2023-03-12 03:24:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000124144_63561728.pth... [2023-03-12 03:24:51,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000123592_63279104.pth [2023-03-12 03:24:51,542][124793] Updated weights for policy 0, policy_version 124160 (0.0004) [2023-03-12 03:24:55,607][124793] Updated weights for policy 0, policy_version 124240 (0.0004) [2023-03-12 03:24:56,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9580.5). Total num frames: 63610880. Throughput: 0: 9497.8. Samples: 63610752. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:24:56,005][124505] Avg episode reward: [(0, '4606.833')] [2023-03-12 03:24:59,800][124793] Updated weights for policy 0, policy_version 124320 (0.0003) [2023-03-12 03:25:01,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9594.4). Total num frames: 63660032. Throughput: 0: 9551.3. Samples: 63639840. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:25:01,005][124505] Avg episode reward: [(0, '4604.483')] [2023-03-12 03:25:04,108][124793] Updated weights for policy 0, policy_version 124400 (0.0006) [2023-03-12 03:25:06,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9594.4). Total num frames: 63709184. Throughput: 0: 9547.7. Samples: 63696968. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:25:06,005][124505] Avg episode reward: [(0, '4607.773')] [2023-03-12 03:25:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000124432_63709184.pth... [2023-03-12 03:25:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000123872_63422464.pth [2023-03-12 03:25:08,442][124793] Updated weights for policy 0, policy_version 124480 (0.0006) [2023-03-12 03:25:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9580.5). Total num frames: 63754240. Throughput: 0: 9557.0. Samples: 63754240. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:25:11,005][124505] Avg episode reward: [(0, '4585.213')] [2023-03-12 03:25:12,746][124793] Updated weights for policy 0, policy_version 124560 (0.0005) [2023-03-12 03:25:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9580.5). Total num frames: 63803392. Throughput: 0: 9559.0. Samples: 63782976. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:25:16,005][124505] Avg episode reward: [(0, '4599.590')] [2023-03-12 03:25:16,944][124793] Updated weights for policy 0, policy_version 124640 (0.0004) [2023-03-12 03:25:21,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9580.5). Total num frames: 63852544. Throughput: 0: 9588.6. Samples: 63840480. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:25:21,005][124505] Avg episode reward: [(0, '4606.276')] [2023-03-12 03:25:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000124712_63852544.pth... [2023-03-12 03:25:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000124144_63561728.pth [2023-03-12 03:25:21,279][124793] Updated weights for policy 0, policy_version 124720 (0.0005) [2023-03-12 03:25:25,560][124793] Updated weights for policy 0, policy_version 124800 (0.0005) [2023-03-12 03:25:26,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9594.4). Total num frames: 63901696. Throughput: 0: 9589.5. Samples: 63897676. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:25:26,005][124505] Avg episode reward: [(0, '4605.372')] [2023-03-12 03:25:29,823][124793] Updated weights for policy 0, policy_version 124880 (0.0005) [2023-03-12 03:25:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9580.5). Total num frames: 63946752. Throughput: 0: 9590.3. Samples: 63926344. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:25:31,005][124505] Avg episode reward: [(0, '4602.300')] [2023-03-12 03:25:34,075][124793] Updated weights for policy 0, policy_version 124960 (0.0005) [2023-03-12 03:25:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9580.5). Total num frames: 63995904. Throughput: 0: 9614.2. Samples: 63984380. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:25:36,005][124505] Avg episode reward: [(0, '4598.919')] [2023-03-12 03:25:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000124992_63995904.pth... [2023-03-12 03:25:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000124432_63709184.pth [2023-03-12 03:25:38,279][124793] Updated weights for policy 0, policy_version 125040 (0.0005) [2023-03-12 03:25:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9594.4). Total num frames: 64045056. Throughput: 0: 9592.8. Samples: 64042428. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:25:41,005][124505] Avg episode reward: [(0, '4603.948')] [2023-03-12 03:25:42,458][124793] Updated weights for policy 0, policy_version 125120 (0.0004) [2023-03-12 03:25:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9594.4). Total num frames: 64094208. Throughput: 0: 9619.2. Samples: 64072704. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:25:46,005][124505] Avg episode reward: [(0, '4601.672')] [2023-03-12 03:25:46,688][124793] Updated weights for policy 0, policy_version 125200 (0.0005) [2023-03-12 03:25:50,939][124793] Updated weights for policy 0, policy_version 125280 (0.0005) [2023-03-12 03:25:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9594.4). Total num frames: 64143360. Throughput: 0: 9645.9. Samples: 64131032. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:25:51,005][124505] Avg episode reward: [(0, '4603.465')] [2023-03-12 03:25:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000125280_64143360.pth... [2023-03-12 03:25:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000124712_63852544.pth [2023-03-12 03:25:55,216][124793] Updated weights for policy 0, policy_version 125360 (0.0005) [2023-03-12 03:25:56,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9580.5). Total num frames: 64188416. Throughput: 0: 9645.1. Samples: 64188272. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:25:56,005][124505] Avg episode reward: [(0, '4594.916')] [2023-03-12 03:25:59,251][124793] Updated weights for policy 0, policy_version 125440 (0.0004) [2023-03-12 03:26:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9608.2). Total num frames: 64241664. Throughput: 0: 9684.4. Samples: 64218772. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:26:01,005][124505] Avg episode reward: [(0, '4603.215')] [2023-03-12 03:26:03,354][124793] Updated weights for policy 0, policy_version 125520 (0.0005) [2023-03-12 03:26:06,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9693.9, 300 sec: 9608.2). Total num frames: 64290816. Throughput: 0: 9737.6. Samples: 64278672. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:26:06,005][124505] Avg episode reward: [(0, '4602.610')] [2023-03-12 03:26:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000125568_64290816.pth... [2023-03-12 03:26:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000124992_63995904.pth [2023-03-12 03:26:07,403][124793] Updated weights for policy 0, policy_version 125600 (0.0004) [2023-03-12 03:26:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9608.2). Total num frames: 64339968. Throughput: 0: 9810.9. Samples: 64339168. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:26:11,005][124505] Avg episode reward: [(0, '4604.501')] [2023-03-12 03:26:11,499][124793] Updated weights for policy 0, policy_version 125680 (0.0005) [2023-03-12 03:26:15,545][124793] Updated weights for policy 0, policy_version 125760 (0.0004) [2023-03-12 03:26:16,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9636.0). Total num frames: 64393216. Throughput: 0: 9836.7. Samples: 64368996. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:26:16,005][124505] Avg episode reward: [(0, '4602.734')] [2023-03-12 03:26:19,707][124793] Updated weights for policy 0, policy_version 125840 (0.0005) [2023-03-12 03:26:21,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9636.0). Total num frames: 64442368. Throughput: 0: 9880.1. Samples: 64428984. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:26:21,005][124505] Avg episode reward: [(0, '4604.408')] [2023-03-12 03:26:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000125864_64442368.pth... [2023-03-12 03:26:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000125280_64143360.pth [2023-03-12 03:26:23,823][124793] Updated weights for policy 0, policy_version 125920 (0.0004) [2023-03-12 03:26:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9636.0). Total num frames: 64491520. Throughput: 0: 9903.9. Samples: 64488104. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:26:26,005][124505] Avg episode reward: [(0, '4602.872')] [2023-03-12 03:26:27,959][124793] Updated weights for policy 0, policy_version 126000 (0.0005) [2023-03-12 03:26:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9622.1). Total num frames: 64540672. Throughput: 0: 9900.2. Samples: 64518212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:26:31,005][124505] Avg episode reward: [(0, '4594.765')] [2023-03-12 03:26:32,022][124793] Updated weights for policy 0, policy_version 126080 (0.0004) [2023-03-12 03:26:36,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9622.1). Total num frames: 64589824. Throughput: 0: 9950.0. Samples: 64578784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:26:36,005][124505] Avg episode reward: [(0, '4611.500')] [2023-03-12 03:26:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000126152_64589824.pth... [2023-03-12 03:26:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000125568_64290816.pth [2023-03-12 03:26:36,091][124793] Updated weights for policy 0, policy_version 126160 (0.0004) [2023-03-12 03:26:40,156][124793] Updated weights for policy 0, policy_version 126240 (0.0004) [2023-03-12 03:26:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9622.1). Total num frames: 64638976. Throughput: 0: 10017.1. Samples: 64639040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:26:41,005][124505] Avg episode reward: [(0, '4577.859')] [2023-03-12 03:26:44,422][124793] Updated weights for policy 0, policy_version 126320 (0.0004) [2023-03-12 03:26:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9622.1). Total num frames: 64688128. Throughput: 0: 9975.0. Samples: 64667648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:26:46,005][124505] Avg episode reward: [(0, '4598.280')] [2023-03-12 03:26:48,495][124793] Updated weights for policy 0, policy_version 126400 (0.0005) [2023-03-12 03:26:51,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9649.9). Total num frames: 64741376. Throughput: 0: 9982.6. Samples: 64727888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:26:51,005][124505] Avg episode reward: [(0, '4605.404')] [2023-03-12 03:26:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000126448_64741376.pth... [2023-03-12 03:26:51,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000125864_64442368.pth [2023-03-12 03:26:52,587][124793] Updated weights for policy 0, policy_version 126480 (0.0005) [2023-03-12 03:26:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9649.9). Total num frames: 64790528. Throughput: 0: 9968.3. Samples: 64787740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:26:56,005][124505] Avg episode reward: [(0, '4597.555')] [2023-03-12 03:26:56,653][124793] Updated weights for policy 0, policy_version 126560 (0.0004) [2023-03-12 03:27:00,873][124793] Updated weights for policy 0, policy_version 126640 (0.0005) [2023-03-12 03:27:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9649.9). Total num frames: 64839680. Throughput: 0: 9975.4. Samples: 64817888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:27:01,005][124505] Avg episode reward: [(0, '4602.536')] [2023-03-12 03:27:04,934][124793] Updated weights for policy 0, policy_version 126720 (0.0005) [2023-03-12 03:27:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9663.8). Total num frames: 64888832. Throughput: 0: 9954.9. Samples: 64876956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:27:06,005][124505] Avg episode reward: [(0, '4601.933')] [2023-03-12 03:27:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000126736_64888832.pth... [2023-03-12 03:27:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000126152_64589824.pth [2023-03-12 03:27:08,944][124793] Updated weights for policy 0, policy_version 126800 (0.0004) [2023-03-12 03:27:11,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9677.7). Total num frames: 64942080. Throughput: 0: 9998.8. Samples: 64938048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:27:11,005][124505] Avg episode reward: [(0, '4602.340')] [2023-03-12 03:27:13,029][124793] Updated weights for policy 0, policy_version 126880 (0.0004) [2023-03-12 03:27:16,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9677.7). Total num frames: 64991232. Throughput: 0: 9995.4. Samples: 64968004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:27:16,005][124505] Avg episode reward: [(0, '4603.940')] [2023-03-12 03:27:17,034][124793] Updated weights for policy 0, policy_version 126960 (0.0004) [2023-03-12 03:27:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9691.6). Total num frames: 65040384. Throughput: 0: 10006.6. Samples: 65029080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:27:21,005][124505] Avg episode reward: [(0, '4601.796')] [2023-03-12 03:27:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000127032_65040384.pth... [2023-03-12 03:27:21,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000126448_64741376.pth [2023-03-12 03:27:21,153][124793] Updated weights for policy 0, policy_version 127040 (0.0005) [2023-03-12 03:27:25,231][124793] Updated weights for policy 0, policy_version 127120 (0.0004) [2023-03-12 03:27:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9691.6). Total num frames: 65089536. Throughput: 0: 10002.2. Samples: 65089140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:27:26,005][124505] Avg episode reward: [(0, '4603.594')] [2023-03-12 03:27:29,276][124793] Updated weights for policy 0, policy_version 127200 (0.0004) [2023-03-12 03:27:31,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9705.4). Total num frames: 65142784. Throughput: 0: 10031.9. Samples: 65119084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:27:31,005][124505] Avg episode reward: [(0, '4605.733')] [2023-03-12 03:27:33,378][124793] Updated weights for policy 0, policy_version 127280 (0.0004) [2023-03-12 03:27:36,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9719.3). Total num frames: 65191936. Throughput: 0: 10040.5. Samples: 65179712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:27:36,005][124505] Avg episode reward: [(0, '4606.728')] [2023-03-12 03:27:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000127328_65191936.pth... [2023-03-12 03:27:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000126736_64888832.pth [2023-03-12 03:27:37,483][124793] Updated weights for policy 0, policy_version 127360 (0.0005) [2023-03-12 03:27:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9705.4). Total num frames: 65241088. Throughput: 0: 10034.9. Samples: 65239312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:27:41,005][124505] Avg episode reward: [(0, '4604.458')] [2023-03-12 03:27:41,683][124793] Updated weights for policy 0, policy_version 127440 (0.0004) [2023-03-12 03:27:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9966.9, 300 sec: 9705.4). Total num frames: 65286144. Throughput: 0: 9973.1. Samples: 65266676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:27:46,005][124505] Avg episode reward: [(0, '4605.792')] [2023-03-12 03:27:46,123][124793] Updated weights for policy 0, policy_version 127520 (0.0005) [2023-03-12 03:27:50,567][124793] Updated weights for policy 0, policy_version 127600 (0.0005) [2023-03-12 03:27:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9691.6). Total num frames: 65335296. Throughput: 0: 9896.9. Samples: 65322316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:27:51,005][124505] Avg episode reward: [(0, '4604.438')] [2023-03-12 03:27:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000127608_65335296.pth... [2023-03-12 03:27:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000127032_65040384.pth [2023-03-12 03:27:54,982][124793] Updated weights for policy 0, policy_version 127680 (0.0005) [2023-03-12 03:27:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9677.7). Total num frames: 65380352. Throughput: 0: 9776.9. Samples: 65378008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:27:56,005][124505] Avg episode reward: [(0, '4601.283')] [2023-03-12 03:27:59,174][124793] Updated weights for policy 0, policy_version 127760 (0.0005) [2023-03-12 03:28:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9691.6). Total num frames: 65429504. Throughput: 0: 9778.1. Samples: 65408020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:28:01,005][124505] Avg episode reward: [(0, '4600.893')] [2023-03-12 03:28:03,553][124793] Updated weights for policy 0, policy_version 127840 (0.0005) [2023-03-12 03:28:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9677.7). Total num frames: 65474560. Throughput: 0: 9661.2. Samples: 65463832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:28:06,005][124505] Avg episode reward: [(0, '4606.554')] [2023-03-12 03:28:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000127880_65474560.pth... [2023-03-12 03:28:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000127328_65191936.pth [2023-03-12 03:28:07,937][124793] Updated weights for policy 0, policy_version 127920 (0.0005) [2023-03-12 03:28:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9677.7). Total num frames: 65523712. Throughput: 0: 9567.6. Samples: 65519680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:28:11,005][124505] Avg episode reward: [(0, '4597.407')] [2023-03-12 03:28:12,281][124793] Updated weights for policy 0, policy_version 128000 (0.0005) [2023-03-12 03:28:16,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9677.7). Total num frames: 65568768. Throughput: 0: 9538.1. Samples: 65548300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:28:16,005][124505] Avg episode reward: [(0, '4576.115')] [2023-03-12 03:28:16,638][124793] Updated weights for policy 0, policy_version 128080 (0.0005) [2023-03-12 03:28:20,975][124793] Updated weights for policy 0, policy_version 128160 (0.0005) [2023-03-12 03:28:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9677.7). Total num frames: 65617920. Throughput: 0: 9459.3. Samples: 65605380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:28:21,005][124505] Avg episode reward: [(0, '4607.752')] [2023-03-12 03:28:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000128160_65617920.pth... [2023-03-12 03:28:21,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000127608_65335296.pth [2023-03-12 03:28:25,339][124793] Updated weights for policy 0, policy_version 128240 (0.0005) [2023-03-12 03:28:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9677.7). Total num frames: 65662976. Throughput: 0: 9376.0. Samples: 65661232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:28:26,005][124505] Avg episode reward: [(0, '4596.287')] [2023-03-12 03:28:29,503][124793] Updated weights for policy 0, policy_version 128320 (0.0005) [2023-03-12 03:28:31,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9677.7). Total num frames: 65712128. Throughput: 0: 9435.7. Samples: 65691280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:28:31,005][124505] Avg episode reward: [(0, '4602.684')] [2023-03-12 03:28:33,604][124793] Updated weights for policy 0, policy_version 128400 (0.0005) [2023-03-12 03:28:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9677.7). Total num frames: 65761280. Throughput: 0: 9511.5. Samples: 65750332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:28:36,005][124505] Avg episode reward: [(0, '4597.720')] [2023-03-12 03:28:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000128440_65761280.pth... [2023-03-12 03:28:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000127880_65474560.pth [2023-03-12 03:28:37,733][124793] Updated weights for policy 0, policy_version 128480 (0.0005) [2023-03-12 03:28:41,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9557.3, 300 sec: 9705.4). Total num frames: 65814528. Throughput: 0: 9610.8. Samples: 65810496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:28:41,005][124505] Avg episode reward: [(0, '4576.827')] [2023-03-12 03:28:41,865][124793] Updated weights for policy 0, policy_version 128560 (0.0004) [2023-03-12 03:28:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9691.6). Total num frames: 65859584. Throughput: 0: 9581.1. Samples: 65839168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:28:46,005][124505] Avg episode reward: [(0, '4506.784')] [2023-03-12 03:28:46,110][124793] Updated weights for policy 0, policy_version 128640 (0.0003) [2023-03-12 03:28:50,306][124793] Updated weights for policy 0, policy_version 128720 (0.0004) [2023-03-12 03:28:51,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9705.4). Total num frames: 65908736. Throughput: 0: 9649.0. Samples: 65898036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:28:51,005][124505] Avg episode reward: [(0, '4599.675')] [2023-03-12 03:28:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000128728_65908736.pth... [2023-03-12 03:28:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000128160_65617920.pth [2023-03-12 03:28:54,606][124793] Updated weights for policy 0, policy_version 128800 (0.0005) [2023-03-12 03:28:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9719.3). Total num frames: 65957888. Throughput: 0: 9671.3. Samples: 65954888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:28:56,005][124505] Avg episode reward: [(0, '4592.151')] [2023-03-12 03:28:58,792][124793] Updated weights for policy 0, policy_version 128880 (0.0005) [2023-03-12 03:29:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9719.3). Total num frames: 66007040. Throughput: 0: 9692.9. Samples: 65984480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:29:01,016][124505] Avg episode reward: [(0, '4572.490')] [2023-03-12 03:29:03,260][124793] Updated weights for policy 0, policy_version 128960 (0.0005) [2023-03-12 03:29:06,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9719.3). Total num frames: 66052096. Throughput: 0: 9655.5. Samples: 66039880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:29:06,016][124505] Avg episode reward: [(0, '4578.014')] [2023-03-12 03:29:06,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000129008_66052096.pth... [2023-03-12 03:29:06,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000128440_65761280.pth [2023-03-12 03:29:07,504][124793] Updated weights for policy 0, policy_version 129040 (0.0004) [2023-03-12 03:29:11,005][124505] Fps is (10 sec: 9011.3, 60 sec: 9557.3, 300 sec: 9719.3). Total num frames: 66097152. Throughput: 0: 9688.7. Samples: 66097224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:29:11,005][124505] Avg episode reward: [(0, '4598.839')] [2023-03-12 03:29:11,912][124793] Updated weights for policy 0, policy_version 129120 (0.0005) [2023-03-12 03:29:16,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9719.3). Total num frames: 66146304. Throughput: 0: 9652.9. Samples: 66125660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:29:16,005][124505] Avg episode reward: [(0, '4601.127')] [2023-03-12 03:29:16,295][124793] Updated weights for policy 0, policy_version 129200 (0.0005) [2023-03-12 03:29:20,780][124793] Updated weights for policy 0, policy_version 129280 (0.0005) [2023-03-12 03:29:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9719.3). Total num frames: 66191360. Throughput: 0: 9557.5. Samples: 66180420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:29:21,005][124505] Avg episode reward: [(0, '4566.460')] [2023-03-12 03:29:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000129280_66191360.pth... [2023-03-12 03:29:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000128728_65908736.pth [2023-03-12 03:29:25,151][124793] Updated weights for policy 0, policy_version 129360 (0.0005) [2023-03-12 03:29:26,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9705.4). Total num frames: 66236416. Throughput: 0: 9465.1. Samples: 66236424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:29:26,005][124505] Avg episode reward: [(0, '4601.279')] [2023-03-12 03:29:29,616][124793] Updated weights for policy 0, policy_version 129440 (0.0005) [2023-03-12 03:29:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9719.3). Total num frames: 66285568. Throughput: 0: 9444.2. Samples: 66264156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:29:31,005][124505] Avg episode reward: [(0, '4597.944')] [2023-03-12 03:29:34,047][124793] Updated weights for policy 0, policy_version 129520 (0.0005) [2023-03-12 03:29:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9705.4). Total num frames: 66330624. Throughput: 0: 9353.4. Samples: 66318940. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:29:36,005][124505] Avg episode reward: [(0, '4561.249')] [2023-03-12 03:29:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000129552_66330624.pth... [2023-03-12 03:29:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000129008_66052096.pth [2023-03-12 03:29:38,376][124793] Updated weights for policy 0, policy_version 129600 (0.0006) [2023-03-12 03:29:41,005][124505] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9691.6). Total num frames: 66375680. Throughput: 0: 9352.4. Samples: 66375744. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:29:41,005][124505] Avg episode reward: [(0, '4590.177')] [2023-03-12 03:29:42,808][124793] Updated weights for policy 0, policy_version 129680 (0.0005) [2023-03-12 03:29:46,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9705.4). Total num frames: 66424832. Throughput: 0: 9314.2. Samples: 66403620. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:29:46,005][124505] Avg episode reward: [(0, '4567.769')] [2023-03-12 03:29:47,227][124793] Updated weights for policy 0, policy_version 129760 (0.0005) [2023-03-12 03:29:51,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9691.6). Total num frames: 66469888. Throughput: 0: 9296.5. Samples: 66458220. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:29:51,005][124505] Avg episode reward: [(0, '4572.761')] [2023-03-12 03:29:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000129824_66469888.pth... [2023-03-12 03:29:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000129280_66191360.pth [2023-03-12 03:29:51,718][124793] Updated weights for policy 0, policy_version 129840 (0.0005) [2023-03-12 03:29:56,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9677.7). Total num frames: 66514944. Throughput: 0: 9276.4. Samples: 66514664. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:29:56,005][124505] Avg episode reward: [(0, '4565.100')] [2023-03-12 03:29:56,105][124793] Updated weights for policy 0, policy_version 129920 (0.0005) [2023-03-12 03:30:00,387][124793] Updated weights for policy 0, policy_version 130000 (0.0006) [2023-03-12 03:30:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9677.7). Total num frames: 66564096. Throughput: 0: 9254.8. Samples: 66542124. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:30:01,005][124505] Avg episode reward: [(0, '4530.695')] [2023-03-12 03:30:04,813][124793] Updated weights for policy 0, policy_version 130080 (0.0004) [2023-03-12 03:30:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9677.7). Total num frames: 66609152. Throughput: 0: 9295.0. Samples: 66598696. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:30:06,005][124505] Avg episode reward: [(0, '4561.437')] [2023-03-12 03:30:06,032][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000130104_66613248.pth... [2023-03-12 03:30:06,034][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000129552_66330624.pth [2023-03-12 03:30:09,094][124793] Updated weights for policy 0, policy_version 130160 (0.0004) [2023-03-12 03:30:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9677.7). Total num frames: 66658304. Throughput: 0: 9324.0. Samples: 66656004. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:30:11,005][124505] Avg episode reward: [(0, '4565.154')] [2023-03-12 03:30:13,503][124793] Updated weights for policy 0, policy_version 130240 (0.0005) [2023-03-12 03:30:16,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9663.8). Total num frames: 66703360. Throughput: 0: 9318.3. Samples: 66683480. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:30:16,005][124505] Avg episode reward: [(0, '4531.073')] [2023-03-12 03:30:17,971][124793] Updated weights for policy 0, policy_version 130320 (0.0005) [2023-03-12 03:30:21,005][124505] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9649.9). Total num frames: 66748416. Throughput: 0: 9328.4. Samples: 66738716. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:30:21,006][124505] Avg episode reward: [(0, '4569.267')] [2023-03-12 03:30:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000130368_66748416.pth... [2023-03-12 03:30:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000129824_66469888.pth [2023-03-12 03:30:22,485][124793] Updated weights for policy 0, policy_version 130400 (0.0005) [2023-03-12 03:30:26,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9649.9). Total num frames: 66793472. Throughput: 0: 9283.0. Samples: 66793480. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:30:26,005][124505] Avg episode reward: [(0, '4561.728')] [2023-03-12 03:30:26,966][124793] Updated weights for policy 0, policy_version 130480 (0.0005) [2023-03-12 03:30:31,005][124505] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9636.0). Total num frames: 66838528. Throughput: 0: 9266.0. Samples: 66820588. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:30:31,005][124505] Avg episode reward: [(0, '4597.493')] [2023-03-12 03:30:31,508][124793] Updated weights for policy 0, policy_version 130560 (0.0005) [2023-03-12 03:30:36,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9622.1). Total num frames: 66883584. Throughput: 0: 9270.5. Samples: 66875392. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:30:36,005][124505] Avg episode reward: [(0, '4594.916')] [2023-03-12 03:30:36,024][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000130640_66887680.pth... [2023-03-12 03:30:36,025][124793] Updated weights for policy 0, policy_version 130640 (0.0005) [2023-03-12 03:30:36,026][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000130104_66613248.pth [2023-03-12 03:30:40,596][124793] Updated weights for policy 0, policy_version 130720 (0.0005) [2023-03-12 03:30:41,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9608.2). Total num frames: 66928640. Throughput: 0: 9199.7. Samples: 66928648. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:30:41,005][124505] Avg episode reward: [(0, '4589.522')] [2023-03-12 03:30:44,880][124793] Updated weights for policy 0, policy_version 130800 (0.0004) [2023-03-12 03:30:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9608.2). Total num frames: 66977792. Throughput: 0: 9223.1. Samples: 66957164. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:30:46,005][124505] Avg episode reward: [(0, '4587.408')] [2023-03-12 03:30:49,115][124793] Updated weights for policy 0, policy_version 130880 (0.0005) [2023-03-12 03:30:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9622.1). Total num frames: 67026944. Throughput: 0: 9245.2. Samples: 67014728. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:30:51,005][124505] Avg episode reward: [(0, '4590.932')] [2023-03-12 03:30:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000130912_67026944.pth... [2023-03-12 03:30:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000130368_66748416.pth [2023-03-12 03:30:53,350][124793] Updated weights for policy 0, policy_version 130960 (0.0004) [2023-03-12 03:30:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9608.2). Total num frames: 67076096. Throughput: 0: 9269.2. Samples: 67073120. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:30:56,005][124505] Avg episode reward: [(0, '4560.853')] [2023-03-12 03:30:57,607][124793] Updated weights for policy 0, policy_version 131040 (0.0005) [2023-03-12 03:31:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9594.4). Total num frames: 67121152. Throughput: 0: 9276.7. Samples: 67100932. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:31:01,005][124505] Avg episode reward: [(0, '4545.096')] [2023-03-12 03:31:02,143][124793] Updated weights for policy 0, policy_version 131120 (0.0005) [2023-03-12 03:31:06,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9580.5). Total num frames: 67166208. Throughput: 0: 9278.2. Samples: 67156236. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:31:06,005][124505] Avg episode reward: [(0, '4590.916')] [2023-03-12 03:31:06,027][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000131192_67170304.pth... [2023-03-12 03:31:06,029][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000130640_66887680.pth [2023-03-12 03:31:06,429][124793] Updated weights for policy 0, policy_version 131200 (0.0005) [2023-03-12 03:31:10,820][124793] Updated weights for policy 0, policy_version 131280 (0.0005) [2023-03-12 03:31:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9566.6). Total num frames: 67215360. Throughput: 0: 9329.2. Samples: 67213296. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:31:11,005][124505] Avg episode reward: [(0, '4583.914')] [2023-03-12 03:31:15,272][124793] Updated weights for policy 0, policy_version 131360 (0.0005) [2023-03-12 03:31:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9552.7). Total num frames: 67260416. Throughput: 0: 9331.2. Samples: 67240492. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:31:16,005][124505] Avg episode reward: [(0, '4569.180')] [2023-03-12 03:31:19,770][124793] Updated weights for policy 0, policy_version 131440 (0.0005) [2023-03-12 03:31:21,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9538.8). Total num frames: 67305472. Throughput: 0: 9347.4. Samples: 67296024. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:31:21,005][124505] Avg episode reward: [(0, '4592.771')] [2023-03-12 03:31:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000131456_67305472.pth... [2023-03-12 03:31:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000130912_67026944.pth [2023-03-12 03:31:24,069][124793] Updated weights for policy 0, policy_version 131520 (0.0005) [2023-03-12 03:31:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9538.8). Total num frames: 67354624. Throughput: 0: 9407.5. Samples: 67351984. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:31:26,005][124505] Avg episode reward: [(0, '4590.965')] [2023-03-12 03:31:28,465][124793] Updated weights for policy 0, policy_version 131600 (0.0005) [2023-03-12 03:31:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9538.8). Total num frames: 67403776. Throughput: 0: 9395.6. Samples: 67379968. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:31:31,005][124505] Avg episode reward: [(0, '4588.984')] [2023-03-12 03:31:32,587][124793] Updated weights for policy 0, policy_version 131680 (0.0005) [2023-03-12 03:31:36,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9538.8). Total num frames: 67452928. Throughput: 0: 9450.5. Samples: 67440000. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 03:31:36,005][124505] Avg episode reward: [(0, '4585.984')] [2023-03-12 03:31:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000131744_67452928.pth... [2023-03-12 03:31:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000131192_67170304.pth [2023-03-12 03:31:36,682][124793] Updated weights for policy 0, policy_version 131760 (0.0004) [2023-03-12 03:31:40,894][124793] Updated weights for policy 0, policy_version 131840 (0.0005) [2023-03-12 03:31:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9538.8). Total num frames: 67502080. Throughput: 0: 9465.0. Samples: 67499044. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:31:41,005][124505] Avg episode reward: [(0, '4558.359')] [2023-03-12 03:31:45,046][124793] Updated weights for policy 0, policy_version 131920 (0.0004) [2023-03-12 03:31:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9557.3, 300 sec: 9524.9). Total num frames: 67551232. Throughput: 0: 9499.7. Samples: 67528420. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:31:46,005][124505] Avg episode reward: [(0, '4581.769')] [2023-03-12 03:31:49,208][124793] Updated weights for policy 0, policy_version 132000 (0.0005) [2023-03-12 03:31:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9524.9). Total num frames: 67600384. Throughput: 0: 9593.7. Samples: 67587952. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:31:51,005][124505] Avg episode reward: [(0, '4560.006')] [2023-03-12 03:31:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000132032_67600384.pth... [2023-03-12 03:31:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000131456_67305472.pth [2023-03-12 03:31:53,394][124793] Updated weights for policy 0, policy_version 132080 (0.0005) [2023-03-12 03:31:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9524.9). Total num frames: 67649536. Throughput: 0: 9608.3. Samples: 67645668. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:31:56,005][124505] Avg episode reward: [(0, '4593.674')] [2023-03-12 03:31:57,735][124793] Updated weights for policy 0, policy_version 132160 (0.0005) [2023-03-12 03:32:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9511.1). Total num frames: 67694592. Throughput: 0: 9632.8. Samples: 67673968. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:32:01,005][124505] Avg episode reward: [(0, '4579.148')] [2023-03-12 03:32:02,108][124793] Updated weights for policy 0, policy_version 132240 (0.0004) [2023-03-12 03:32:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9497.2). Total num frames: 67743744. Throughput: 0: 9670.4. Samples: 67731192. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:32:06,005][124505] Avg episode reward: [(0, '4565.654')] [2023-03-12 03:32:06,007][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000132312_67743744.pth... [2023-03-12 03:32:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000131744_67452928.pth [2023-03-12 03:32:06,464][124793] Updated weights for policy 0, policy_version 132320 (0.0005) [2023-03-12 03:32:10,959][124793] Updated weights for policy 0, policy_version 132400 (0.0005) [2023-03-12 03:32:11,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9483.3). Total num frames: 67788800. Throughput: 0: 9624.8. Samples: 67785100. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:32:11,005][124505] Avg episode reward: [(0, '4570.410')] [2023-03-12 03:32:15,477][124793] Updated weights for policy 0, policy_version 132480 (0.0005) [2023-03-12 03:32:16,005][124505] Fps is (10 sec: 9011.1, 60 sec: 9557.3, 300 sec: 9469.4). Total num frames: 67833856. Throughput: 0: 9619.0. Samples: 67812824. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:32:16,005][124505] Avg episode reward: [(0, '4582.411')] [2023-03-12 03:32:19,761][124793] Updated weights for policy 0, policy_version 132560 (0.0003) [2023-03-12 03:32:21,005][124505] Fps is (10 sec: 9011.1, 60 sec: 9557.3, 300 sec: 9455.5). Total num frames: 67878912. Throughput: 0: 9529.8. Samples: 67868840. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:32:21,005][124505] Avg episode reward: [(0, '4588.001')] [2023-03-12 03:32:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000132576_67878912.pth... [2023-03-12 03:32:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000132032_67600384.pth [2023-03-12 03:32:24,023][124793] Updated weights for policy 0, policy_version 132640 (0.0004) [2023-03-12 03:32:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9441.6). Total num frames: 67928064. Throughput: 0: 9487.0. Samples: 67925960. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:32:26,005][124505] Avg episode reward: [(0, '4590.563')] [2023-03-12 03:32:28,545][124793] Updated weights for policy 0, policy_version 132720 (0.0005) [2023-03-12 03:32:31,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 67973120. Throughput: 0: 9429.2. Samples: 67952736. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:32:31,005][124505] Avg episode reward: [(0, '4567.453')] [2023-03-12 03:32:32,893][124793] Updated weights for policy 0, policy_version 132800 (0.0004) [2023-03-12 03:32:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 68022272. Throughput: 0: 9379.9. Samples: 68010048. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:32:36,005][124505] Avg episode reward: [(0, '4580.766')] [2023-03-12 03:32:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000132856_68022272.pth... [2023-03-12 03:32:36,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000132312_67743744.pth [2023-03-12 03:32:37,155][124793] Updated weights for policy 0, policy_version 132880 (0.0005) [2023-03-12 03:32:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 68067328. Throughput: 0: 9331.1. Samples: 68065568. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 03:32:41,005][124505] Avg episode reward: [(0, '4559.356')] [2023-03-12 03:32:41,732][124793] Updated weights for policy 0, policy_version 132960 (0.0006) [2023-03-12 03:32:46,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 68112384. Throughput: 0: 9297.0. Samples: 68092332. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:32:46,005][124505] Avg episode reward: [(0, '4591.965')] [2023-03-12 03:32:46,219][124793] Updated weights for policy 0, policy_version 133040 (0.0006) [2023-03-12 03:32:50,464][124793] Updated weights for policy 0, policy_version 133120 (0.0003) [2023-03-12 03:32:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 68161536. Throughput: 0: 9284.7. Samples: 68149004. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:32:51,005][124505] Avg episode reward: [(0, '4589.889')] [2023-03-12 03:32:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000133128_68161536.pth... [2023-03-12 03:32:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000132576_67878912.pth [2023-03-12 03:32:54,692][124793] Updated weights for policy 0, policy_version 133200 (0.0004) [2023-03-12 03:32:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 68206592. Throughput: 0: 9367.9. Samples: 68206656. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:32:56,005][124505] Avg episode reward: [(0, '4589.429')] [2023-03-12 03:32:58,953][124793] Updated weights for policy 0, policy_version 133280 (0.0005) [2023-03-12 03:33:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 68255744. Throughput: 0: 9389.2. Samples: 68235340. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:33:01,005][124505] Avg episode reward: [(0, '4589.356')] [2023-03-12 03:33:03,304][124793] Updated weights for policy 0, policy_version 133360 (0.0003) [2023-03-12 03:33:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9427.7). Total num frames: 68304896. Throughput: 0: 9418.5. Samples: 68292672. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:33:06,005][124505] Avg episode reward: [(0, '4592.675')] [2023-03-12 03:33:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000133408_68304896.pth... [2023-03-12 03:33:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000132856_68022272.pth [2023-03-12 03:33:07,460][124793] Updated weights for policy 0, policy_version 133440 (0.0004) [2023-03-12 03:33:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 68354048. Throughput: 0: 9441.3. Samples: 68350820. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:33:11,005][124505] Avg episode reward: [(0, '4585.752')] [2023-03-12 03:33:11,836][124793] Updated weights for policy 0, policy_version 133520 (0.0004) [2023-03-12 03:33:15,996][124793] Updated weights for policy 0, policy_version 133600 (0.0003) [2023-03-12 03:33:16,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 68403200. Throughput: 0: 9477.6. Samples: 68379228. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:33:16,005][124505] Avg episode reward: [(0, '4574.604')] [2023-03-12 03:33:20,210][124793] Updated weights for policy 0, policy_version 133680 (0.0004) [2023-03-12 03:33:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 68448256. Throughput: 0: 9519.1. Samples: 68438408. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:33:21,005][124505] Avg episode reward: [(0, '4592.263')] [2023-03-12 03:33:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000133696_68452352.pth... [2023-03-12 03:33:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000133128_68161536.pth [2023-03-12 03:33:24,439][124793] Updated weights for policy 0, policy_version 133760 (0.0004) [2023-03-12 03:33:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 68497408. Throughput: 0: 9577.5. Samples: 68496556. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:33:26,005][124505] Avg episode reward: [(0, '4592.135')] [2023-03-12 03:33:28,573][124793] Updated weights for policy 0, policy_version 133840 (0.0005) [2023-03-12 03:33:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9557.3, 300 sec: 9441.6). Total num frames: 68546560. Throughput: 0: 9640.3. Samples: 68526144. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:33:31,005][124505] Avg episode reward: [(0, '4585.799')] [2023-03-12 03:33:32,921][124793] Updated weights for policy 0, policy_version 133920 (0.0005) [2023-03-12 03:33:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 68591616. Throughput: 0: 9644.3. Samples: 68583000. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:33:36,006][124505] Avg episode reward: [(0, '4584.298')] [2023-03-12 03:33:36,011][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000133976_68595712.pth... [2023-03-12 03:33:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000133408_68304896.pth [2023-03-12 03:33:37,296][124793] Updated weights for policy 0, policy_version 134000 (0.0005) [2023-03-12 03:33:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9427.7). Total num frames: 68640768. Throughput: 0: 9630.4. Samples: 68640024. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 03:33:41,005][124505] Avg episode reward: [(0, '4590.147')] [2023-03-12 03:33:41,528][124793] Updated weights for policy 0, policy_version 134080 (0.0004) [2023-03-12 03:33:45,614][124793] Updated weights for policy 0, policy_version 134160 (0.0004) [2023-03-12 03:33:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9427.7). Total num frames: 68689920. Throughput: 0: 9648.1. Samples: 68669504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:33:46,005][124505] Avg episode reward: [(0, '4586.662')] [2023-03-12 03:33:49,744][124793] Updated weights for policy 0, policy_version 134240 (0.0004) [2023-03-12 03:33:51,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9693.9, 300 sec: 9441.6). Total num frames: 68743168. Throughput: 0: 9697.5. Samples: 68729060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:33:51,005][124505] Avg episode reward: [(0, '4588.392')] [2023-03-12 03:33:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000134264_68743168.pth... [2023-03-12 03:33:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000133696_68452352.pth [2023-03-12 03:33:53,475][124749] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000003 [2023-03-12 03:33:53,926][124793] Updated weights for policy 0, policy_version 134320 (0.0004) [2023-03-12 03:33:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9427.7). Total num frames: 68788224. Throughput: 0: 9721.5. Samples: 68788288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:33:56,005][124505] Avg episode reward: [(0, '4583.210')] [2023-03-12 03:33:58,076][124793] Updated weights for policy 0, policy_version 134400 (0.0005) [2023-03-12 03:34:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9441.6). Total num frames: 68837376. Throughput: 0: 9740.9. Samples: 68817568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:34:01,005][124505] Avg episode reward: [(0, '4596.499')] [2023-03-12 03:34:02,299][124793] Updated weights for policy 0, policy_version 134480 (0.0005) [2023-03-12 03:34:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9455.5). Total num frames: 68886528. Throughput: 0: 9733.3. Samples: 68876408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:34:06,006][124505] Avg episode reward: [(0, '4585.553')] [2023-03-12 03:34:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000134552_68890624.pth... [2023-03-12 03:34:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000133976_68595712.pth [2023-03-12 03:34:06,432][124793] Updated weights for policy 0, policy_version 134560 (0.0004) [2023-03-12 03:34:10,565][124793] Updated weights for policy 0, policy_version 134640 (0.0004) [2023-03-12 03:34:11,005][124505] Fps is (10 sec: 10240.1, 60 sec: 9762.1, 300 sec: 9469.4). Total num frames: 68939776. Throughput: 0: 9759.9. Samples: 68935752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:34:11,005][124505] Avg episode reward: [(0, '4585.573')] [2023-03-12 03:34:14,642][124793] Updated weights for policy 0, policy_version 134720 (0.0004) [2023-03-12 03:34:16,005][124505] Fps is (10 sec: 10240.1, 60 sec: 9762.1, 300 sec: 9483.3). Total num frames: 68988928. Throughput: 0: 9782.3. Samples: 68966348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:34:16,005][124505] Avg episode reward: [(0, '4579.324')] [2023-03-12 03:34:19,079][124793] Updated weights for policy 0, policy_version 134800 (0.0005) [2023-03-12 03:34:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9483.3). Total num frames: 69033984. Throughput: 0: 9753.4. Samples: 69021904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:34:21,005][124505] Avg episode reward: [(0, '4570.609')] [2023-03-12 03:34:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000134832_69033984.pth... [2023-03-12 03:34:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000134264_68743168.pth [2023-03-12 03:34:23,461][124793] Updated weights for policy 0, policy_version 134880 (0.0005) [2023-03-12 03:34:26,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9693.9, 300 sec: 9469.4). Total num frames: 69079040. Throughput: 0: 9738.8. Samples: 69078268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:34:26,005][124505] Avg episode reward: [(0, '4569.051')] [2023-03-12 03:34:27,920][124793] Updated weights for policy 0, policy_version 134960 (0.0005) [2023-03-12 03:34:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9483.3). Total num frames: 69128192. Throughput: 0: 9702.2. Samples: 69106104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:34:31,005][124505] Avg episode reward: [(0, '4599.621')] [2023-03-12 03:34:32,224][124793] Updated weights for policy 0, policy_version 135040 (0.0005) [2023-03-12 03:34:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9483.3). Total num frames: 69173248. Throughput: 0: 9640.6. Samples: 69162888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:34:36,005][124505] Avg episode reward: [(0, '4589.661')] [2023-03-12 03:34:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000135104_69173248.pth... [2023-03-12 03:34:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000134552_68890624.pth [2023-03-12 03:34:36,581][124793] Updated weights for policy 0, policy_version 135120 (0.0005) [2023-03-12 03:34:40,915][124793] Updated weights for policy 0, policy_version 135200 (0.0005) [2023-03-12 03:34:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9483.3). Total num frames: 69222400. Throughput: 0: 9580.0. Samples: 69219388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:34:41,005][124505] Avg episode reward: [(0, '4593.715')] [2023-03-12 03:34:45,328][124793] Updated weights for policy 0, policy_version 135280 (0.0005) [2023-03-12 03:34:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9483.3). Total num frames: 69267456. Throughput: 0: 9543.8. Samples: 69247040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:34:46,005][124505] Avg episode reward: [(0, '4585.231')] [2023-03-12 03:34:49,791][124793] Updated weights for policy 0, policy_version 135360 (0.0005) [2023-03-12 03:34:51,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9483.3). Total num frames: 69312512. Throughput: 0: 9470.5. Samples: 69302580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:34:51,005][124505] Avg episode reward: [(0, '4594.554')] [2023-03-12 03:34:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000135376_69312512.pth... [2023-03-12 03:34:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000134832_69033984.pth [2023-03-12 03:34:53,942][124793] Updated weights for policy 0, policy_version 135440 (0.0004) [2023-03-12 03:34:56,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9557.4, 300 sec: 9483.3). Total num frames: 69361664. Throughput: 0: 9465.0. Samples: 69361676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:34:56,005][124505] Avg episode reward: [(0, '4588.649')] [2023-03-12 03:34:58,031][124793] Updated weights for policy 0, policy_version 135520 (0.0004) [2023-03-12 03:35:01,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9625.6, 300 sec: 9511.1). Total num frames: 69414912. Throughput: 0: 9447.5. Samples: 69391484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:35:01,005][124505] Avg episode reward: [(0, '4596.616')] [2023-03-12 03:35:02,191][124793] Updated weights for policy 0, policy_version 135600 (0.0004) [2023-03-12 03:35:06,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9625.6, 300 sec: 9511.0). Total num frames: 69464064. Throughput: 0: 9548.2. Samples: 69451572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:35:06,005][124505] Avg episode reward: [(0, '4604.675')] [2023-03-12 03:35:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000135672_69464064.pth... [2023-03-12 03:35:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000135104_69173248.pth [2023-03-12 03:35:06,319][124793] Updated weights for policy 0, policy_version 135680 (0.0004) [2023-03-12 03:35:10,432][124793] Updated weights for policy 0, policy_version 135760 (0.0004) [2023-03-12 03:35:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9524.9). Total num frames: 69513216. Throughput: 0: 9606.8. Samples: 69510576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:35:11,005][124505] Avg episode reward: [(0, '4529.671')] [2023-03-12 03:35:14,640][124793] Updated weights for policy 0, policy_version 135840 (0.0005) [2023-03-12 03:35:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9538.8). Total num frames: 69562368. Throughput: 0: 9633.0. Samples: 69539588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:35:16,005][124505] Avg episode reward: [(0, '4584.839')] [2023-03-12 03:35:18,942][124793] Updated weights for policy 0, policy_version 135920 (0.0005) [2023-03-12 03:35:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9552.7). Total num frames: 69611520. Throughput: 0: 9650.3. Samples: 69597152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:35:21,005][124505] Avg episode reward: [(0, '4538.654')] [2023-03-12 03:35:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000135960_69611520.pth... [2023-03-12 03:35:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000135376_69312512.pth [2023-03-12 03:35:23,020][124793] Updated weights for policy 0, policy_version 136000 (0.0005) [2023-03-12 03:35:26,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9566.6). Total num frames: 69660672. Throughput: 0: 9729.3. Samples: 69657208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:35:26,005][124505] Avg episode reward: [(0, '4570.581')] [2023-03-12 03:35:27,148][124793] Updated weights for policy 0, policy_version 136080 (0.0005) [2023-03-12 03:35:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9580.5). Total num frames: 69709824. Throughput: 0: 9785.5. Samples: 69687388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:35:31,005][124505] Avg episode reward: [(0, '4589.286')] [2023-03-12 03:35:31,283][124793] Updated weights for policy 0, policy_version 136160 (0.0005) [2023-03-12 03:35:35,548][124793] Updated weights for policy 0, policy_version 136240 (0.0005) [2023-03-12 03:35:36,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9594.4). Total num frames: 69758976. Throughput: 0: 9860.6. Samples: 69746308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:35:36,005][124505] Avg episode reward: [(0, '4559.971')] [2023-03-12 03:35:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000136248_69758976.pth... [2023-03-12 03:35:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000135672_69464064.pth [2023-03-12 03:35:40,022][124793] Updated weights for policy 0, policy_version 136320 (0.0005) [2023-03-12 03:35:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9580.5). Total num frames: 69804032. Throughput: 0: 9761.7. Samples: 69800952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:35:41,005][124505] Avg episode reward: [(0, '4590.826')] [2023-03-12 03:35:44,312][124793] Updated weights for policy 0, policy_version 136400 (0.0005) [2023-03-12 03:35:46,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9693.9, 300 sec: 9566.6). Total num frames: 69849088. Throughput: 0: 9737.7. Samples: 69829680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:35:46,005][124505] Avg episode reward: [(0, '4594.052')] [2023-03-12 03:35:48,691][124793] Updated weights for policy 0, policy_version 136480 (0.0005) [2023-03-12 03:35:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9566.6). Total num frames: 69898240. Throughput: 0: 9654.5. Samples: 69886024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:35:51,005][124505] Avg episode reward: [(0, '4601.315')] [2023-03-12 03:35:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000136520_69898240.pth... [2023-03-12 03:35:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000135960_69611520.pth [2023-03-12 03:35:52,814][124793] Updated weights for policy 0, policy_version 136560 (0.0005) [2023-03-12 03:35:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9580.5). Total num frames: 69947392. Throughput: 0: 9688.1. Samples: 69946540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:35:56,005][124505] Avg episode reward: [(0, '4559.612')] [2023-03-12 03:35:56,942][124793] Updated weights for policy 0, policy_version 136640 (0.0005) [2023-03-12 03:36:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9594.4). Total num frames: 69996544. Throughput: 0: 9700.9. Samples: 69976128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:36:01,005][124505] Avg episode reward: [(0, '4597.815')] [2023-03-12 03:36:01,017][124793] Updated weights for policy 0, policy_version 136720 (0.0005) [2023-03-12 03:36:05,175][124793] Updated weights for policy 0, policy_version 136800 (0.0005) [2023-03-12 03:36:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9594.4). Total num frames: 70045696. Throughput: 0: 9747.6. Samples: 70035796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:36:06,005][124505] Avg episode reward: [(0, '4598.073')] [2023-03-12 03:36:06,018][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000136816_70049792.pth... [2023-03-12 03:36:06,020][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000136248_69758976.pth [2023-03-12 03:36:09,362][124793] Updated weights for policy 0, policy_version 136880 (0.0005) [2023-03-12 03:36:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9608.2). Total num frames: 70094848. Throughput: 0: 9723.7. Samples: 70094776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:36:11,005][124505] Avg episode reward: [(0, '4560.296')] [2023-03-12 03:36:13,544][124793] Updated weights for policy 0, policy_version 136960 (0.0005) [2023-03-12 03:36:16,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9636.0). Total num frames: 70148096. Throughput: 0: 9694.0. Samples: 70123616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:36:16,005][124505] Avg episode reward: [(0, '4564.325')] [2023-03-12 03:36:17,595][124793] Updated weights for policy 0, policy_version 137040 (0.0005) [2023-03-12 03:36:21,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9762.1, 300 sec: 9636.0). Total num frames: 70197248. Throughput: 0: 9728.1. Samples: 70184072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:36:21,005][124505] Avg episode reward: [(0, '4596.979')] [2023-03-12 03:36:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000137104_70197248.pth... [2023-03-12 03:36:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000136520_69898240.pth [2023-03-12 03:36:21,755][124793] Updated weights for policy 0, policy_version 137120 (0.0005) [2023-03-12 03:36:25,830][124793] Updated weights for policy 0, policy_version 137200 (0.0004) [2023-03-12 03:36:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9636.0). Total num frames: 70246400. Throughput: 0: 9840.4. Samples: 70243768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:36:26,005][124505] Avg episode reward: [(0, '4593.342')] [2023-03-12 03:36:29,910][124793] Updated weights for policy 0, policy_version 137280 (0.0004) [2023-03-12 03:36:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9636.0). Total num frames: 70295552. Throughput: 0: 9879.6. Samples: 70274264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:36:31,005][124505] Avg episode reward: [(0, '4597.021')] [2023-03-12 03:36:34,048][124793] Updated weights for policy 0, policy_version 137360 (0.0004) [2023-03-12 03:36:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9636.0). Total num frames: 70344704. Throughput: 0: 9951.4. Samples: 70333836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:36:36,005][124505] Avg episode reward: [(0, '4599.237')] [2023-03-12 03:36:36,007][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000137392_70344704.pth... [2023-03-12 03:36:36,009][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000136816_70049792.pth [2023-03-12 03:36:38,074][124793] Updated weights for policy 0, policy_version 137440 (0.0004) [2023-03-12 03:36:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9649.9). Total num frames: 70397952. Throughput: 0: 9954.8. Samples: 70394504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:36:41,005][124505] Avg episode reward: [(0, '4600.634')] [2023-03-12 03:36:42,085][124793] Updated weights for policy 0, policy_version 137520 (0.0004) [2023-03-12 03:36:46,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9649.9). Total num frames: 70447104. Throughput: 0: 9994.4. Samples: 70425876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:36:46,005][124505] Avg episode reward: [(0, '4604.105')] [2023-03-12 03:36:46,092][124793] Updated weights for policy 0, policy_version 137600 (0.0004) [2023-03-12 03:36:50,214][124793] Updated weights for policy 0, policy_version 137680 (0.0005) [2023-03-12 03:36:51,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9663.8). Total num frames: 70500352. Throughput: 0: 10000.0. Samples: 70485796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:36:51,005][124505] Avg episode reward: [(0, '4596.119')] [2023-03-12 03:36:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000137696_70500352.pth... [2023-03-12 03:36:51,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000137104_70197248.pth [2023-03-12 03:36:54,262][124793] Updated weights for policy 0, policy_version 137760 (0.0005) [2023-03-12 03:36:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9677.7). Total num frames: 70549504. Throughput: 0: 10017.6. Samples: 70545568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:36:56,005][124505] Avg episode reward: [(0, '4599.257')] [2023-03-12 03:36:58,343][124793] Updated weights for policy 0, policy_version 137840 (0.0004) [2023-03-12 03:37:01,005][124505] Fps is (10 sec: 9830.3, 60 sec: 10035.2, 300 sec: 9677.7). Total num frames: 70598656. Throughput: 0: 10061.6. Samples: 70576388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:37:01,005][124505] Avg episode reward: [(0, '4599.954')] [2023-03-12 03:37:02,415][124793] Updated weights for policy 0, policy_version 137920 (0.0003) [2023-03-12 03:37:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9691.6). Total num frames: 70647808. Throughput: 0: 10048.8. Samples: 70636268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:37:06,005][124505] Avg episode reward: [(0, '4598.949')] [2023-03-12 03:37:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000137984_70647808.pth... [2023-03-12 03:37:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000137392_70344704.pth [2023-03-12 03:37:06,471][124793] Updated weights for policy 0, policy_version 138000 (0.0005) [2023-03-12 03:37:10,605][124793] Updated weights for policy 0, policy_version 138080 (0.0004) [2023-03-12 03:37:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9705.4). Total num frames: 70696960. Throughput: 0: 10067.2. Samples: 70696792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:37:11,005][124505] Avg episode reward: [(0, '4607.291')] [2023-03-12 03:37:14,729][124793] Updated weights for policy 0, policy_version 138160 (0.0005) [2023-03-12 03:37:16,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9733.2). Total num frames: 70750208. Throughput: 0: 10043.0. Samples: 70726200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:37:16,005][124505] Avg episode reward: [(0, '4600.633')] [2023-03-12 03:37:18,862][124793] Updated weights for policy 0, policy_version 138240 (0.0005) [2023-03-12 03:37:21,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9733.2). Total num frames: 70799360. Throughput: 0: 10049.0. Samples: 70786040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:37:21,005][124505] Avg episode reward: [(0, '4584.615')] [2023-03-12 03:37:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000138280_70799360.pth... [2023-03-12 03:37:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000137696_70500352.pth [2023-03-12 03:37:22,960][124793] Updated weights for policy 0, policy_version 138320 (0.0004) [2023-03-12 03:37:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9747.1). Total num frames: 70848512. Throughput: 0: 10042.9. Samples: 70846436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:37:26,005][124505] Avg episode reward: [(0, '4594.558')] [2023-03-12 03:37:27,020][124793] Updated weights for policy 0, policy_version 138400 (0.0005) [2023-03-12 03:37:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9747.1). Total num frames: 70897664. Throughput: 0: 10008.8. Samples: 70876272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:37:31,005][124505] Avg episode reward: [(0, '4603.051')] [2023-03-12 03:37:31,171][124793] Updated weights for policy 0, policy_version 138480 (0.0004) [2023-03-12 03:37:35,243][124793] Updated weights for policy 0, policy_version 138560 (0.0004) [2023-03-12 03:37:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 10035.2, 300 sec: 9761.0). Total num frames: 70946816. Throughput: 0: 10000.9. Samples: 70935836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:37:36,005][124505] Avg episode reward: [(0, '4598.530')] [2023-03-12 03:37:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000138568_70946816.pth... [2023-03-12 03:37:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000137984_70647808.pth [2023-03-12 03:37:39,448][124793] Updated weights for policy 0, policy_version 138640 (0.0004) [2023-03-12 03:37:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9774.9). Total num frames: 70995968. Throughput: 0: 9992.4. Samples: 70995224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:37:41,005][124505] Avg episode reward: [(0, '4599.434')] [2023-03-12 03:37:43,620][124793] Updated weights for policy 0, policy_version 138720 (0.0005) [2023-03-12 03:37:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9774.9). Total num frames: 71045120. Throughput: 0: 9954.9. Samples: 71024360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:37:46,005][124505] Avg episode reward: [(0, '4598.959')] [2023-03-12 03:37:47,716][124793] Updated weights for policy 0, policy_version 138800 (0.0004) [2023-03-12 03:37:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9788.7). Total num frames: 71094272. Throughput: 0: 9940.3. Samples: 71083584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:37:51,005][124505] Avg episode reward: [(0, '4599.947')] [2023-03-12 03:37:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000138856_71094272.pth... [2023-03-12 03:37:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000138280_70799360.pth [2023-03-12 03:37:51,894][124793] Updated weights for policy 0, policy_version 138880 (0.0005) [2023-03-12 03:37:56,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9788.7). Total num frames: 71143424. Throughput: 0: 9923.1. Samples: 71143332. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:37:56,005][124505] Avg episode reward: [(0, '4567.761')] [2023-03-12 03:37:56,047][124793] Updated weights for policy 0, policy_version 138960 (0.0005) [2023-03-12 03:38:00,087][124793] Updated weights for policy 0, policy_version 139040 (0.0005) [2023-03-12 03:38:01,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9802.6). Total num frames: 71196672. Throughput: 0: 9933.7. Samples: 71173216. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:38:01,005][124505] Avg episode reward: [(0, '4596.570')] [2023-03-12 03:38:04,282][124793] Updated weights for policy 0, policy_version 139120 (0.0005) [2023-03-12 03:38:06,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9966.9, 300 sec: 9802.6). Total num frames: 71245824. Throughput: 0: 9920.8. Samples: 71232476. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:38:06,005][124505] Avg episode reward: [(0, '4594.461')] [2023-03-12 03:38:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000139152_71245824.pth... [2023-03-12 03:38:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000138568_70946816.pth [2023-03-12 03:38:08,442][124793] Updated weights for policy 0, policy_version 139200 (0.0005) [2023-03-12 03:38:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9802.6). Total num frames: 71294976. Throughput: 0: 9894.1. Samples: 71291672. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:38:11,005][124505] Avg episode reward: [(0, '4602.372')] [2023-03-12 03:38:12,539][124793] Updated weights for policy 0, policy_version 139280 (0.0004) [2023-03-12 03:38:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9816.5). Total num frames: 71344128. Throughput: 0: 9890.3. Samples: 71321336. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:38:16,005][124505] Avg episode reward: [(0, '4602.851')] [2023-03-12 03:38:16,702][124793] Updated weights for policy 0, policy_version 139360 (0.0005) [2023-03-12 03:38:20,837][124793] Updated weights for policy 0, policy_version 139440 (0.0005) [2023-03-12 03:38:21,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9816.5). Total num frames: 71393280. Throughput: 0: 9892.3. Samples: 71380988. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:38:21,005][124505] Avg episode reward: [(0, '4603.137')] [2023-03-12 03:38:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000139440_71393280.pth... [2023-03-12 03:38:21,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000138856_71094272.pth [2023-03-12 03:38:24,934][124793] Updated weights for policy 0, policy_version 139520 (0.0004) [2023-03-12 03:38:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9816.5). Total num frames: 71442432. Throughput: 0: 9895.4. Samples: 71440516. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:38:26,005][124505] Avg episode reward: [(0, '4600.505')] [2023-03-12 03:38:29,074][124793] Updated weights for policy 0, policy_version 139600 (0.0004) [2023-03-12 03:38:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9830.4). Total num frames: 71491584. Throughput: 0: 9912.0. Samples: 71470400. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:38:31,005][124505] Avg episode reward: [(0, '4591.851')] [2023-03-12 03:38:33,186][124793] Updated weights for policy 0, policy_version 139680 (0.0004) [2023-03-12 03:38:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9830.4). Total num frames: 71540736. Throughput: 0: 9925.9. Samples: 71530248. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:38:36,005][124505] Avg episode reward: [(0, '4599.680')] [2023-03-12 03:38:36,007][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000139728_71540736.pth... [2023-03-12 03:38:36,009][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000139152_71245824.pth [2023-03-12 03:38:37,287][124793] Updated weights for policy 0, policy_version 139760 (0.0005) [2023-03-12 03:38:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9844.3). Total num frames: 71593984. Throughput: 0: 9923.7. Samples: 71589900. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:38:41,005][124505] Avg episode reward: [(0, '4603.200')] [2023-03-12 03:38:41,395][124793] Updated weights for policy 0, policy_version 139840 (0.0004) [2023-03-12 03:38:45,501][124793] Updated weights for policy 0, policy_version 139920 (0.0004) [2023-03-12 03:38:46,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9830.4). Total num frames: 71643136. Throughput: 0: 9928.3. Samples: 71619988. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:38:46,005][124505] Avg episode reward: [(0, '4604.819')] [2023-03-12 03:38:49,647][124793] Updated weights for policy 0, policy_version 140000 (0.0005) [2023-03-12 03:38:51,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9844.3). Total num frames: 71692288. Throughput: 0: 9937.2. Samples: 71679648. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:38:51,005][124505] Avg episode reward: [(0, '4601.981')] [2023-03-12 03:38:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000140024_71692288.pth... [2023-03-12 03:38:51,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000139440_71393280.pth [2023-03-12 03:38:53,735][124793] Updated weights for policy 0, policy_version 140080 (0.0004) [2023-03-12 03:38:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9844.3). Total num frames: 71741440. Throughput: 0: 9954.8. Samples: 71739636. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:38:56,005][124505] Avg episode reward: [(0, '4597.840')] [2023-03-12 03:38:57,867][124793] Updated weights for policy 0, policy_version 140160 (0.0005) [2023-03-12 03:39:01,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9844.3). Total num frames: 71790592. Throughput: 0: 9951.4. Samples: 71769148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:39:01,005][124505] Avg episode reward: [(0, '4595.266')] [2023-03-12 03:39:02,049][124793] Updated weights for policy 0, policy_version 140240 (0.0005) [2023-03-12 03:39:06,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9898.7, 300 sec: 9830.4). Total num frames: 71839744. Throughput: 0: 9930.2. Samples: 71827848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:39:06,005][124505] Avg episode reward: [(0, '4597.212')] [2023-03-12 03:39:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000140312_71839744.pth... [2023-03-12 03:39:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000139728_71540736.pth [2023-03-12 03:39:06,224][124793] Updated weights for policy 0, policy_version 140320 (0.0005) [2023-03-12 03:39:10,369][124793] Updated weights for policy 0, policy_version 140400 (0.0005) [2023-03-12 03:39:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9830.4). Total num frames: 71888896. Throughput: 0: 9922.6. Samples: 71887032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:39:11,005][124505] Avg episode reward: [(0, '4599.117')] [2023-03-12 03:39:14,389][124793] Updated weights for policy 0, policy_version 140480 (0.0004) [2023-03-12 03:39:16,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9844.3). Total num frames: 71938048. Throughput: 0: 9934.7. Samples: 71917460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:39:16,005][124505] Avg episode reward: [(0, '4597.354')] [2023-03-12 03:39:18,445][124793] Updated weights for policy 0, policy_version 140560 (0.0004) [2023-03-12 03:39:21,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9872.1). Total num frames: 71991296. Throughput: 0: 9949.9. Samples: 71977996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:39:21,005][124505] Avg episode reward: [(0, '4603.480')] [2023-03-12 03:39:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000140608_71991296.pth... [2023-03-12 03:39:21,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000140024_71692288.pth [2023-03-12 03:39:22,713][124793] Updated weights for policy 0, policy_version 140640 (0.0005) [2023-03-12 03:39:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9858.2). Total num frames: 72036352. Throughput: 0: 9898.8. Samples: 72035348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:39:26,005][124505] Avg episode reward: [(0, '4603.683')] [2023-03-12 03:39:27,008][124793] Updated weights for policy 0, policy_version 140720 (0.0005) [2023-03-12 03:39:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9898.7, 300 sec: 9872.1). Total num frames: 72085504. Throughput: 0: 9866.5. Samples: 72063980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:39:31,006][124505] Avg episode reward: [(0, '4596.512')] [2023-03-12 03:39:31,364][124793] Updated weights for policy 0, policy_version 140800 (0.0005) [2023-03-12 03:39:35,679][124793] Updated weights for policy 0, policy_version 140880 (0.0005) [2023-03-12 03:39:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9830.4, 300 sec: 9858.2). Total num frames: 72130560. Throughput: 0: 9783.1. Samples: 72119888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:39:36,005][124505] Avg episode reward: [(0, '4590.304')] [2023-03-12 03:39:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000140880_72130560.pth... [2023-03-12 03:39:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000140312_71839744.pth [2023-03-12 03:39:40,024][124793] Updated weights for policy 0, policy_version 140960 (0.0005) [2023-03-12 03:39:41,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9762.1, 300 sec: 9872.1). Total num frames: 72179712. Throughput: 0: 9718.8. Samples: 72176980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:39:41,005][124505] Avg episode reward: [(0, '4597.038')] [2023-03-12 03:39:44,284][124793] Updated weights for policy 0, policy_version 141040 (0.0005) [2023-03-12 03:39:46,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9872.1). Total num frames: 72224768. Throughput: 0: 9705.3. Samples: 72205888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:39:46,005][124505] Avg episode reward: [(0, '4605.286')] [2023-03-12 03:39:48,627][124793] Updated weights for policy 0, policy_version 141120 (0.0005) [2023-03-12 03:39:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9872.1). Total num frames: 72273920. Throughput: 0: 9661.8. Samples: 72262628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:39:51,005][124505] Avg episode reward: [(0, '4542.541')] [2023-03-12 03:39:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000141160_72273920.pth... [2023-03-12 03:39:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000140608_71991296.pth [2023-03-12 03:39:52,954][124793] Updated weights for policy 0, policy_version 141200 (0.0004) [2023-03-12 03:39:56,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9858.2). Total num frames: 72323072. Throughput: 0: 9601.1. Samples: 72319084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:39:56,005][124505] Avg episode reward: [(0, '4538.931')] [2023-03-12 03:39:57,304][124793] Updated weights for policy 0, policy_version 141280 (0.0005) [2023-03-12 03:40:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9844.3). Total num frames: 72368128. Throughput: 0: 9559.7. Samples: 72347648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:40:01,005][124505] Avg episode reward: [(0, '4599.491')] [2023-03-12 03:40:01,499][124793] Updated weights for policy 0, policy_version 141360 (0.0005) [2023-03-12 03:40:05,588][124793] Updated weights for policy 0, policy_version 141440 (0.0005) [2023-03-12 03:40:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9844.3). Total num frames: 72417280. Throughput: 0: 9541.3. Samples: 72407356. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:40:06,005][124505] Avg episode reward: [(0, '4593.890')] [2023-03-12 03:40:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000141448_72421376.pth... [2023-03-12 03:40:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000140880_72130560.pth [2023-03-12 03:40:09,892][124793] Updated weights for policy 0, policy_version 141520 (0.0005) [2023-03-12 03:40:11,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9844.3). Total num frames: 72466432. Throughput: 0: 9558.4. Samples: 72465476. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:40:11,005][124505] Avg episode reward: [(0, '4603.897')] [2023-03-12 03:40:13,938][124793] Updated weights for policy 0, policy_version 141600 (0.0004) [2023-03-12 03:40:16,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9693.9, 300 sec: 9858.2). Total num frames: 72519680. Throughput: 0: 9588.5. Samples: 72495464. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:40:16,005][124505] Avg episode reward: [(0, '4599.435')] [2023-03-12 03:40:18,053][124793] Updated weights for policy 0, policy_version 141680 (0.0005) [2023-03-12 03:40:21,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9625.6, 300 sec: 9858.2). Total num frames: 72568832. Throughput: 0: 9683.1. Samples: 72555628. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:40:21,005][124505] Avg episode reward: [(0, '4600.045')] [2023-03-12 03:40:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000141736_72568832.pth... [2023-03-12 03:40:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000141160_72273920.pth [2023-03-12 03:40:22,106][124793] Updated weights for policy 0, policy_version 141760 (0.0004) [2023-03-12 03:40:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9858.2). Total num frames: 72617984. Throughput: 0: 9759.1. Samples: 72616140. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:40:26,005][124505] Avg episode reward: [(0, '4593.302')] [2023-03-12 03:40:26,166][124793] Updated weights for policy 0, policy_version 141840 (0.0004) [2023-03-12 03:40:30,223][124793] Updated weights for policy 0, policy_version 141920 (0.0004) [2023-03-12 03:40:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9858.2). Total num frames: 72667136. Throughput: 0: 9796.3. Samples: 72646720. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:40:31,005][124505] Avg episode reward: [(0, '4598.625')] [2023-03-12 03:40:34,308][124793] Updated weights for policy 0, policy_version 142000 (0.0005) [2023-03-12 03:40:36,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9885.9). Total num frames: 72720384. Throughput: 0: 9874.9. Samples: 72707000. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:40:36,006][124505] Avg episode reward: [(0, '4595.524')] [2023-03-12 03:40:36,010][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000142032_72720384.pth... [2023-03-12 03:40:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000141448_72421376.pth [2023-03-12 03:40:38,441][124793] Updated weights for policy 0, policy_version 142080 (0.0004) [2023-03-12 03:40:41,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9830.4, 300 sec: 9899.8). Total num frames: 72769536. Throughput: 0: 9943.9. Samples: 72766560. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:40:41,005][124505] Avg episode reward: [(0, '4605.286')] [2023-03-12 03:40:42,548][124793] Updated weights for policy 0, policy_version 142160 (0.0004) [2023-03-12 03:40:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 72818688. Throughput: 0: 9964.8. Samples: 72796064. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:40:46,005][124505] Avg episode reward: [(0, '4593.113')] [2023-03-12 03:40:46,653][124793] Updated weights for policy 0, policy_version 142240 (0.0004) [2023-03-12 03:40:50,801][124793] Updated weights for policy 0, policy_version 142320 (0.0004) [2023-03-12 03:40:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 72867840. Throughput: 0: 9966.1. Samples: 72855832. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:40:51,005][124505] Avg episode reward: [(0, '4591.000')] [2023-03-12 03:40:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000142320_72867840.pth... [2023-03-12 03:40:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000141736_72568832.pth [2023-03-12 03:40:54,935][124793] Updated weights for policy 0, policy_version 142400 (0.0004) [2023-03-12 03:40:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9899.8). Total num frames: 72916992. Throughput: 0: 10003.1. Samples: 72915616. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:40:56,005][124505] Avg episode reward: [(0, '4592.672')] [2023-03-12 03:40:59,029][124793] Updated weights for policy 0, policy_version 142480 (0.0004) [2023-03-12 03:41:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 72966144. Throughput: 0: 10002.5. Samples: 72945576. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:41:01,005][124505] Avg episode reward: [(0, '4594.708')] [2023-03-12 03:41:03,082][124793] Updated weights for policy 0, policy_version 142560 (0.0004) [2023-03-12 03:41:06,005][124505] Fps is (10 sec: 10239.9, 60 sec: 10035.2, 300 sec: 9913.7). Total num frames: 73019392. Throughput: 0: 9999.0. Samples: 73005584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:41:06,005][124505] Avg episode reward: [(0, '4602.872')] [2023-03-12 03:41:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000142616_73019392.pth... [2023-03-12 03:41:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000142032_72720384.pth [2023-03-12 03:41:07,216][124793] Updated weights for policy 0, policy_version 142640 (0.0005) [2023-03-12 03:41:11,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9899.8). Total num frames: 73068544. Throughput: 0: 9994.7. Samples: 73065900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:41:11,005][124505] Avg episode reward: [(0, '4593.391')] [2023-03-12 03:41:11,287][124793] Updated weights for policy 0, policy_version 142720 (0.0005) [2023-03-12 03:41:15,348][124793] Updated weights for policy 0, policy_version 142800 (0.0004) [2023-03-12 03:41:16,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 73117696. Throughput: 0: 9991.4. Samples: 73096332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:41:16,005][124505] Avg episode reward: [(0, '4606.609')] [2023-03-12 03:41:19,399][124793] Updated weights for policy 0, policy_version 142880 (0.0005) [2023-03-12 03:41:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9967.0, 300 sec: 9899.8). Total num frames: 73166848. Throughput: 0: 9981.8. Samples: 73156180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:41:21,005][124505] Avg episode reward: [(0, '4603.055')] [2023-03-12 03:41:21,036][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000142912_73170944.pth... [2023-03-12 03:41:21,037][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000142320_72867840.pth [2023-03-12 03:41:23,557][124793] Updated weights for policy 0, policy_version 142960 (0.0005) [2023-03-12 03:41:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 73216000. Throughput: 0: 9987.8. Samples: 73216012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:41:26,005][124505] Avg episode reward: [(0, '4596.281')] [2023-03-12 03:41:27,653][124793] Updated weights for policy 0, policy_version 143040 (0.0003) [2023-03-12 03:41:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 73265152. Throughput: 0: 9976.9. Samples: 73245024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:41:31,005][124505] Avg episode reward: [(0, '4600.746')] [2023-03-12 03:41:31,876][124793] Updated weights for policy 0, policy_version 143120 (0.0003) [2023-03-12 03:41:33,560][124749] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000005 [2023-03-12 03:41:35,988][124793] Updated weights for policy 0, policy_version 143200 (0.0004) [2023-03-12 03:41:36,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9967.0, 300 sec: 9899.8). Total num frames: 73318400. Throughput: 0: 9956.5. Samples: 73303876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:41:36,005][124505] Avg episode reward: [(0, '4600.370')] [2023-03-12 03:41:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000143200_73318400.pth... [2023-03-12 03:41:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000142616_73019392.pth [2023-03-12 03:41:40,081][124793] Updated weights for policy 0, policy_version 143280 (0.0005) [2023-03-12 03:41:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9899.8). Total num frames: 73367552. Throughput: 0: 9966.3. Samples: 73364100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:41:41,005][124505] Avg episode reward: [(0, '4600.385')] [2023-03-12 03:41:44,272][124793] Updated weights for policy 0, policy_version 143360 (0.0005) [2023-03-12 03:41:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 73416704. Throughput: 0: 9958.1. Samples: 73393692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:41:46,005][124505] Avg episode reward: [(0, '4595.468')] [2023-03-12 03:41:48,375][124793] Updated weights for policy 0, policy_version 143440 (0.0005) [2023-03-12 03:41:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 73465856. Throughput: 0: 9955.4. Samples: 73453576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:41:51,005][124505] Avg episode reward: [(0, '4598.395')] [2023-03-12 03:41:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000143488_73465856.pth... [2023-03-12 03:41:51,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000142912_73170944.pth [2023-03-12 03:41:52,503][124793] Updated weights for policy 0, policy_version 143520 (0.0005) [2023-03-12 03:41:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 73515008. Throughput: 0: 9913.9. Samples: 73512024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:41:56,005][124505] Avg episode reward: [(0, '4603.679')] [2023-03-12 03:41:56,646][124793] Updated weights for policy 0, policy_version 143600 (0.0005) [2023-03-12 03:42:00,804][124793] Updated weights for policy 0, policy_version 143680 (0.0005) [2023-03-12 03:42:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9885.9). Total num frames: 73564160. Throughput: 0: 9913.9. Samples: 73542456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:42:01,005][124505] Avg episode reward: [(0, '4602.783')] [2023-03-12 03:42:04,910][124793] Updated weights for policy 0, policy_version 143760 (0.0005) [2023-03-12 03:42:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9885.9). Total num frames: 73613312. Throughput: 0: 9902.2. Samples: 73601780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:42:06,005][124505] Avg episode reward: [(0, '4608.357')] [2023-03-12 03:42:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000143776_73613312.pth... [2023-03-12 03:42:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000143200_73318400.pth [2023-03-12 03:42:08,994][124793] Updated weights for policy 0, policy_version 143840 (0.0005) [2023-03-12 03:42:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9872.1). Total num frames: 73662464. Throughput: 0: 9903.7. Samples: 73661680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:42:11,005][124505] Avg episode reward: [(0, '4602.984')] [2023-03-12 03:42:13,153][124793] Updated weights for policy 0, policy_version 143920 (0.0004) [2023-03-12 03:42:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9872.1). Total num frames: 73711616. Throughput: 0: 9915.0. Samples: 73691200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:42:16,005][124505] Avg episode reward: [(0, '4592.756')] [2023-03-12 03:42:17,453][124793] Updated weights for policy 0, policy_version 144000 (0.0005) [2023-03-12 03:42:21,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9830.4, 300 sec: 9858.2). Total num frames: 73756672. Throughput: 0: 9864.1. Samples: 73747760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:42:21,005][124505] Avg episode reward: [(0, '4586.472')] [2023-03-12 03:42:21,043][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000144064_73760768.pth... [2023-03-12 03:42:21,044][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000143488_73465856.pth [2023-03-12 03:42:21,908][124793] Updated weights for policy 0, policy_version 144080 (0.0006) [2023-03-12 03:42:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9858.2). Total num frames: 73805824. Throughput: 0: 9760.1. Samples: 73803304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:42:26,005][124505] Avg episode reward: [(0, '4596.015')] [2023-03-12 03:42:26,281][124793] Updated weights for policy 0, policy_version 144160 (0.0005) [2023-03-12 03:42:30,667][124793] Updated weights for policy 0, policy_version 144240 (0.0005) [2023-03-12 03:42:31,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9762.1, 300 sec: 9844.3). Total num frames: 73850880. Throughput: 0: 9728.3. Samples: 73831464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:42:31,005][124505] Avg episode reward: [(0, '4596.264')] [2023-03-12 03:42:35,127][124793] Updated weights for policy 0, policy_version 144320 (0.0005) [2023-03-12 03:42:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9844.3). Total num frames: 73900032. Throughput: 0: 9644.4. Samples: 73887576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:42:36,005][124505] Avg episode reward: [(0, '4591.755')] [2023-03-12 03:42:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000144336_73900032.pth... [2023-03-12 03:42:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000143776_73613312.pth [2023-03-12 03:42:39,504][124793] Updated weights for policy 0, policy_version 144400 (0.0006) [2023-03-12 03:42:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9830.4). Total num frames: 73945088. Throughput: 0: 9574.1. Samples: 73942860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:42:41,005][124505] Avg episode reward: [(0, '4592.970')] [2023-03-12 03:42:43,911][124793] Updated weights for policy 0, policy_version 144480 (0.0006) [2023-03-12 03:42:46,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9816.5). Total num frames: 73990144. Throughput: 0: 9518.4. Samples: 73970784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:42:46,005][124505] Avg episode reward: [(0, '4595.284')] [2023-03-12 03:42:48,263][124793] Updated weights for policy 0, policy_version 144560 (0.0005) [2023-03-12 03:42:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9816.5). Total num frames: 74039296. Throughput: 0: 9449.5. Samples: 74027008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:42:51,005][124505] Avg episode reward: [(0, '4591.477')] [2023-03-12 03:42:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000144608_74039296.pth... [2023-03-12 03:42:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000144064_73760768.pth [2023-03-12 03:42:52,699][124793] Updated weights for policy 0, policy_version 144640 (0.0005) [2023-03-12 03:42:56,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9788.7). Total num frames: 74084352. Throughput: 0: 9359.2. Samples: 74082844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:42:56,005][124505] Avg episode reward: [(0, '4590.324')] [2023-03-12 03:42:57,069][124793] Updated weights for policy 0, policy_version 144720 (0.0005) [2023-03-12 03:43:01,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9788.7). Total num frames: 74133504. Throughput: 0: 9338.5. Samples: 74111432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:43:01,005][124505] Avg episode reward: [(0, '4589.304')] [2023-03-12 03:43:01,441][124793] Updated weights for policy 0, policy_version 144800 (0.0006) [2023-03-12 03:43:05,800][124793] Updated weights for policy 0, policy_version 144880 (0.0006) [2023-03-12 03:43:06,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9774.9). Total num frames: 74178560. Throughput: 0: 9309.4. Samples: 74166684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:43:06,005][124505] Avg episode reward: [(0, '4594.136')] [2023-03-12 03:43:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000144880_74178560.pth... [2023-03-12 03:43:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000144336_73900032.pth [2023-03-12 03:43:10,102][124793] Updated weights for policy 0, policy_version 144960 (0.0005) [2023-03-12 03:43:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9774.9). Total num frames: 74227712. Throughput: 0: 9341.9. Samples: 74223688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:43:11,005][124505] Avg episode reward: [(0, '4591.664')] [2023-03-12 03:43:14,426][124793] Updated weights for policy 0, policy_version 145040 (0.0006) [2023-03-12 03:43:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9761.0). Total num frames: 74272768. Throughput: 0: 9353.2. Samples: 74252360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:43:16,005][124505] Avg episode reward: [(0, '4596.746')] [2023-03-12 03:43:18,824][124793] Updated weights for policy 0, policy_version 145120 (0.0006) [2023-03-12 03:43:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9761.0). Total num frames: 74321920. Throughput: 0: 9367.8. Samples: 74309128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:43:21,005][124505] Avg episode reward: [(0, '4601.234')] [2023-03-12 03:43:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000145160_74321920.pth... [2023-03-12 03:43:21,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000144608_74039296.pth [2023-03-12 03:43:23,187][124793] Updated weights for policy 0, policy_version 145200 (0.0006) [2023-03-12 03:43:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9747.1). Total num frames: 74366976. Throughput: 0: 9370.2. Samples: 74364520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:43:26,005][124505] Avg episode reward: [(0, '4589.877')] [2023-03-12 03:43:27,508][124793] Updated weights for policy 0, policy_version 145280 (0.0006) [2023-03-12 03:43:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9747.1). Total num frames: 74416128. Throughput: 0: 9387.0. Samples: 74393200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:43:31,005][124505] Avg episode reward: [(0, '4603.275')] [2023-03-12 03:43:31,855][124793] Updated weights for policy 0, policy_version 145360 (0.0005) [2023-03-12 03:43:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9719.3). Total num frames: 74461184. Throughput: 0: 9389.8. Samples: 74449548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:43:36,005][124505] Avg episode reward: [(0, '4601.033')] [2023-03-12 03:43:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000145432_74461184.pth... [2023-03-12 03:43:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000144880_74178560.pth [2023-03-12 03:43:36,211][124793] Updated weights for policy 0, policy_version 145440 (0.0005) [2023-03-12 03:43:40,555][124793] Updated weights for policy 0, policy_version 145520 (0.0005) [2023-03-12 03:43:41,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9719.3). Total num frames: 74510336. Throughput: 0: 9410.4. Samples: 74506312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:43:41,005][124505] Avg episode reward: [(0, '4602.924')] [2023-03-12 03:43:44,899][124793] Updated weights for policy 0, policy_version 145600 (0.0004) [2023-03-12 03:43:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9705.4). Total num frames: 74555392. Throughput: 0: 9412.1. Samples: 74534976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:43:46,005][124505] Avg episode reward: [(0, '4601.125')] [2023-03-12 03:43:49,245][124793] Updated weights for policy 0, policy_version 145680 (0.0005) [2023-03-12 03:43:51,005][124505] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9691.5). Total num frames: 74600448. Throughput: 0: 9451.1. Samples: 74591984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:43:51,005][124505] Avg episode reward: [(0, '4595.428')] [2023-03-12 03:43:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000145712_74604544.pth... [2023-03-12 03:43:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000145160_74321920.pth [2023-03-12 03:43:53,667][124793] Updated weights for policy 0, policy_version 145760 (0.0004) [2023-03-12 03:43:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9691.6). Total num frames: 74649600. Throughput: 0: 9422.4. Samples: 74647696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:43:56,005][124505] Avg episode reward: [(0, '4593.889')] [2023-03-12 03:43:57,980][124793] Updated weights for policy 0, policy_version 145840 (0.0005) [2023-03-12 03:44:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9677.7). Total num frames: 74694656. Throughput: 0: 9408.8. Samples: 74675756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:44:01,005][124505] Avg episode reward: [(0, '4600.745')] [2023-03-12 03:44:02,284][124793] Updated weights for policy 0, policy_version 145920 (0.0005) [2023-03-12 03:44:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9677.7). Total num frames: 74743808. Throughput: 0: 9416.8. Samples: 74732884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:44:06,005][124505] Avg episode reward: [(0, '4595.254')] [2023-03-12 03:44:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000145984_74743808.pth... [2023-03-12 03:44:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000145432_74461184.pth [2023-03-12 03:44:06,557][124793] Updated weights for policy 0, policy_version 146000 (0.0005) [2023-03-12 03:44:10,840][124793] Updated weights for policy 0, policy_version 146080 (0.0005) [2023-03-12 03:44:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9677.7). Total num frames: 74792960. Throughput: 0: 9467.6. Samples: 74790564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:44:11,005][124505] Avg episode reward: [(0, '4596.975')] [2023-03-12 03:44:15,219][124793] Updated weights for policy 0, policy_version 146160 (0.0005) [2023-03-12 03:44:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9649.9). Total num frames: 74838016. Throughput: 0: 9455.1. Samples: 74818680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:44:16,005][124505] Avg episode reward: [(0, '4600.210')] [2023-03-12 03:44:19,578][124793] Updated weights for policy 0, policy_version 146240 (0.0005) [2023-03-12 03:44:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9663.8). Total num frames: 74887168. Throughput: 0: 9453.2. Samples: 74874944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:44:21,005][124505] Avg episode reward: [(0, '4591.635')] [2023-03-12 03:44:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000146264_74887168.pth... [2023-03-12 03:44:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000145712_74604544.pth [2023-03-12 03:44:23,954][124793] Updated weights for policy 0, policy_version 146320 (0.0005) [2023-03-12 03:44:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9649.9). Total num frames: 74932224. Throughput: 0: 9460.5. Samples: 74932036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:44:26,005][124505] Avg episode reward: [(0, '4605.192')] [2023-03-12 03:44:28,247][124793] Updated weights for policy 0, policy_version 146400 (0.0005) [2023-03-12 03:44:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9663.8). Total num frames: 74981376. Throughput: 0: 9452.8. Samples: 74960352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:44:31,005][124505] Avg episode reward: [(0, '4598.687')] [2023-03-12 03:44:32,635][124793] Updated weights for policy 0, policy_version 146480 (0.0005) [2023-03-12 03:44:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9649.9). Total num frames: 75026432. Throughput: 0: 9425.7. Samples: 75016140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:44:36,005][124505] Avg episode reward: [(0, '4600.163')] [2023-03-12 03:44:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000146536_75026432.pth... [2023-03-12 03:44:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000145984_74743808.pth [2023-03-12 03:44:36,949][124793] Updated weights for policy 0, policy_version 146560 (0.0005) [2023-03-12 03:44:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9663.8). Total num frames: 75075584. Throughput: 0: 9435.6. Samples: 75072300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:44:41,005][124505] Avg episode reward: [(0, '4593.104')] [2023-03-12 03:44:41,354][124793] Updated weights for policy 0, policy_version 146640 (0.0006) [2023-03-12 03:44:45,698][124793] Updated weights for policy 0, policy_version 146720 (0.0005) [2023-03-12 03:44:46,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9649.9). Total num frames: 75120640. Throughput: 0: 9441.6. Samples: 75100628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:44:46,005][124505] Avg episode reward: [(0, '4594.878')] [2023-03-12 03:44:50,044][124793] Updated weights for policy 0, policy_version 146800 (0.0006) [2023-03-12 03:44:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9649.9). Total num frames: 75169792. Throughput: 0: 9436.0. Samples: 75157504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:44:51,005][124505] Avg episode reward: [(0, '4551.005')] [2023-03-12 03:44:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000146816_75169792.pth... [2023-03-12 03:44:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000146264_74887168.pth [2023-03-12 03:44:54,451][124793] Updated weights for policy 0, policy_version 146880 (0.0006) [2023-03-12 03:44:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9649.9). Total num frames: 75214848. Throughput: 0: 9395.0. Samples: 75213340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:44:56,005][124505] Avg episode reward: [(0, '4558.030')] [2023-03-12 03:44:58,808][124793] Updated weights for policy 0, policy_version 146960 (0.0005) [2023-03-12 03:45:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9649.9). Total num frames: 75264000. Throughput: 0: 9397.7. Samples: 75241576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:45:01,005][124505] Avg episode reward: [(0, '4573.097')] [2023-03-12 03:45:03,119][124793] Updated weights for policy 0, policy_version 147040 (0.0006) [2023-03-12 03:45:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9636.0). Total num frames: 75309056. Throughput: 0: 9406.8. Samples: 75298248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:45:06,005][124505] Avg episode reward: [(0, '4575.580')] [2023-03-12 03:45:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000147088_75309056.pth... [2023-03-12 03:45:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000146536_75026432.pth [2023-03-12 03:45:07,527][124793] Updated weights for policy 0, policy_version 147120 (0.0006) [2023-03-12 03:45:11,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9608.2). Total num frames: 75354112. Throughput: 0: 9378.7. Samples: 75354076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:45:11,016][124505] Avg episode reward: [(0, '4598.292')] [2023-03-12 03:45:11,954][124793] Updated weights for policy 0, policy_version 147200 (0.0006) [2023-03-12 03:45:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9608.2). Total num frames: 75403264. Throughput: 0: 9375.4. Samples: 75382244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:45:16,005][124505] Avg episode reward: [(0, '4598.707')] [2023-03-12 03:45:16,275][124793] Updated weights for policy 0, policy_version 147280 (0.0006) [2023-03-12 03:45:20,677][124793] Updated weights for policy 0, policy_version 147360 (0.0006) [2023-03-12 03:45:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9594.4). Total num frames: 75448320. Throughput: 0: 9381.6. Samples: 75438312. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 03:45:21,016][124505] Avg episode reward: [(0, '4586.651')] [2023-03-12 03:45:21,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000147360_75448320.pth... [2023-03-12 03:45:21,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000146816_75169792.pth [2023-03-12 03:45:25,051][124793] Updated weights for policy 0, policy_version 147440 (0.0006) [2023-03-12 03:45:26,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9594.4). Total num frames: 75497472. Throughput: 0: 9370.2. Samples: 75493956. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 03:45:26,016][124505] Avg episode reward: [(0, '4579.626')] [2023-03-12 03:45:29,453][124793] Updated weights for policy 0, policy_version 147520 (0.0006) [2023-03-12 03:45:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9566.6). Total num frames: 75542528. Throughput: 0: 9366.3. Samples: 75522112. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 03:45:31,005][124505] Avg episode reward: [(0, '4583.575')] [2023-03-12 03:45:33,772][124793] Updated weights for policy 0, policy_version 147600 (0.0005) [2023-03-12 03:45:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9566.6). Total num frames: 75591680. Throughput: 0: 9375.3. Samples: 75579392. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 03:45:36,016][124505] Avg episode reward: [(0, '4563.256')] [2023-03-12 03:45:36,018][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000147640_75591680.pth... [2023-03-12 03:45:36,020][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000147088_75309056.pth [2023-03-12 03:45:38,172][124793] Updated weights for policy 0, policy_version 147680 (0.0006) [2023-03-12 03:45:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9552.7). Total num frames: 75636736. Throughput: 0: 9384.8. Samples: 75635656. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 03:45:41,016][124505] Avg episode reward: [(0, '4541.779')] [2023-03-12 03:45:42,519][124793] Updated weights for policy 0, policy_version 147760 (0.0006) [2023-03-12 03:45:46,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9538.8). Total num frames: 75681792. Throughput: 0: 9375.5. Samples: 75663472. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 03:45:46,005][124505] Avg episode reward: [(0, '4482.801')] [2023-03-12 03:45:46,907][124793] Updated weights for policy 0, policy_version 147840 (0.0006) [2023-03-12 03:45:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9538.8). Total num frames: 75730944. Throughput: 0: 9343.8. Samples: 75718720. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 03:45:51,005][124505] Avg episode reward: [(0, '4511.294')] [2023-03-12 03:45:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000147912_75730944.pth... [2023-03-12 03:45:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000147360_75448320.pth [2023-03-12 03:45:51,376][124793] Updated weights for policy 0, policy_version 147920 (0.0006) [2023-03-12 03:45:55,740][124793] Updated weights for policy 0, policy_version 148000 (0.0006) [2023-03-12 03:45:56,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9524.9). Total num frames: 75776000. Throughput: 0: 9352.8. Samples: 75774952. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 03:45:56,005][124505] Avg episode reward: [(0, '4353.137')] [2023-03-12 03:46:00,115][124793] Updated weights for policy 0, policy_version 148080 (0.0006) [2023-03-12 03:46:01,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9511.0). Total num frames: 75825152. Throughput: 0: 9340.6. Samples: 75802572. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 03:46:01,006][124505] Avg episode reward: [(0, '4416.963')] [2023-03-12 03:46:04,451][124793] Updated weights for policy 0, policy_version 148160 (0.0005) [2023-03-12 03:46:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9497.2). Total num frames: 75870208. Throughput: 0: 9352.2. Samples: 75859160. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 03:46:06,005][124505] Avg episode reward: [(0, '4446.019')] [2023-03-12 03:46:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000148184_75870208.pth... [2023-03-12 03:46:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000147640_75591680.pth [2023-03-12 03:46:08,883][124793] Updated weights for policy 0, policy_version 148240 (0.0005) [2023-03-12 03:46:11,005][124505] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 75915264. Throughput: 0: 9347.9. Samples: 75914612. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 03:46:11,005][124505] Avg episode reward: [(0, '4464.905')] [2023-03-12 03:46:13,259][124793] Updated weights for policy 0, policy_version 148320 (0.0005) [2023-03-12 03:46:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 75964416. Throughput: 0: 9362.5. Samples: 75943424. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 03:46:16,005][124505] Avg episode reward: [(0, '4420.686')] [2023-03-12 03:46:17,355][124793] Updated weights for policy 0, policy_version 148400 (0.0005) [2023-03-12 03:46:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9483.3). Total num frames: 76013568. Throughput: 0: 9422.1. Samples: 76003388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:46:21,005][124505] Avg episode reward: [(0, '4492.349')] [2023-03-12 03:46:21,021][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000148472_76017664.pth... [2023-03-12 03:46:21,023][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000147912_75730944.pth [2023-03-12 03:46:21,440][124793] Updated weights for policy 0, policy_version 148480 (0.0004) [2023-03-12 03:46:25,467][124793] Updated weights for policy 0, policy_version 148560 (0.0004) [2023-03-12 03:46:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9489.1, 300 sec: 9497.2). Total num frames: 76066816. Throughput: 0: 9513.3. Samples: 76063756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:46:26,005][124505] Avg episode reward: [(0, '4454.689')] [2023-03-12 03:46:29,580][124793] Updated weights for policy 0, policy_version 148640 (0.0005) [2023-03-12 03:46:31,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9557.3, 300 sec: 9483.3). Total num frames: 76115968. Throughput: 0: 9558.9. Samples: 76093624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:46:31,005][124505] Avg episode reward: [(0, '4517.058')] [2023-03-12 03:46:33,956][124793] Updated weights for policy 0, policy_version 148720 (0.0005) [2023-03-12 03:46:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9469.4). Total num frames: 76161024. Throughput: 0: 9600.0. Samples: 76150720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:46:36,005][124505] Avg episode reward: [(0, '4548.633')] [2023-03-12 03:46:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000148752_76161024.pth... [2023-03-12 03:46:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000148184_75870208.pth [2023-03-12 03:46:38,368][124793] Updated weights for policy 0, policy_version 148800 (0.0006) [2023-03-12 03:46:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9469.4). Total num frames: 76210176. Throughput: 0: 9582.0. Samples: 76206144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:46:41,005][124505] Avg episode reward: [(0, '4542.488')] [2023-03-12 03:46:42,623][124793] Updated weights for policy 0, policy_version 148880 (0.0005) [2023-03-12 03:46:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9469.4). Total num frames: 76259328. Throughput: 0: 9624.2. Samples: 76235660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:46:46,005][124505] Avg episode reward: [(0, '4548.793')] [2023-03-12 03:46:46,761][124793] Updated weights for policy 0, policy_version 148960 (0.0004) [2023-03-12 03:46:50,786][124793] Updated weights for policy 0, policy_version 149040 (0.0005) [2023-03-12 03:46:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9469.4). Total num frames: 76308480. Throughput: 0: 9713.2. Samples: 76296256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:46:51,005][124505] Avg episode reward: [(0, '4554.835')] [2023-03-12 03:46:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000149040_76308480.pth... [2023-03-12 03:46:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000148472_76017664.pth [2023-03-12 03:46:54,968][124793] Updated weights for policy 0, policy_version 149120 (0.0005) [2023-03-12 03:46:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9469.4). Total num frames: 76357632. Throughput: 0: 9799.9. Samples: 76355608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:46:56,005][124505] Avg episode reward: [(0, '4589.772')] [2023-03-12 03:46:59,356][124793] Updated weights for policy 0, policy_version 149200 (0.0005) [2023-03-12 03:47:01,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9455.5). Total num frames: 76402688. Throughput: 0: 9775.0. Samples: 76383300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:47:01,005][124505] Avg episode reward: [(0, '4563.485')] [2023-03-12 03:47:03,700][124793] Updated weights for policy 0, policy_version 149280 (0.0005) [2023-03-12 03:47:06,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9455.5). Total num frames: 76451840. Throughput: 0: 9698.9. Samples: 76439840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:47:06,005][124505] Avg episode reward: [(0, '4588.089')] [2023-03-12 03:47:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000149320_76451840.pth... [2023-03-12 03:47:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000148752_76161024.pth [2023-03-12 03:47:07,944][124793] Updated weights for policy 0, policy_version 149360 (0.0005) [2023-03-12 03:47:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9455.5). Total num frames: 76500992. Throughput: 0: 9665.1. Samples: 76498684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:47:11,005][124505] Avg episode reward: [(0, '4583.597')] [2023-03-12 03:47:12,079][124793] Updated weights for policy 0, policy_version 149440 (0.0004) [2023-03-12 03:47:16,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9469.4). Total num frames: 76550144. Throughput: 0: 9652.6. Samples: 76527992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:47:16,005][124505] Avg episode reward: [(0, '4586.962')] [2023-03-12 03:47:16,228][124793] Updated weights for policy 0, policy_version 149520 (0.0004) [2023-03-12 03:47:20,342][124793] Updated weights for policy 0, policy_version 149600 (0.0004) [2023-03-12 03:47:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9469.4). Total num frames: 76599296. Throughput: 0: 9704.7. Samples: 76587432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:47:21,005][124505] Avg episode reward: [(0, '4586.767')] [2023-03-12 03:47:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000149608_76599296.pth... [2023-03-12 03:47:21,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000149040_76308480.pth [2023-03-12 03:47:24,570][124793] Updated weights for policy 0, policy_version 149680 (0.0005) [2023-03-12 03:47:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9483.3). Total num frames: 76648448. Throughput: 0: 9784.8. Samples: 76646460. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:47:26,005][124505] Avg episode reward: [(0, '4589.985')] [2023-03-12 03:47:28,678][124793] Updated weights for policy 0, policy_version 149760 (0.0004) [2023-03-12 03:47:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9483.3). Total num frames: 76697600. Throughput: 0: 9786.9. Samples: 76676072. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:47:31,005][124505] Avg episode reward: [(0, '4589.485')] [2023-03-12 03:47:32,941][124793] Updated weights for policy 0, policy_version 149840 (0.0004) [2023-03-12 03:47:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9483.3). Total num frames: 76742656. Throughput: 0: 9724.3. Samples: 76733848. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:47:36,005][124505] Avg episode reward: [(0, '4588.810')] [2023-03-12 03:47:36,011][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000149896_76746752.pth... [2023-03-12 03:47:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000149320_76451840.pth [2023-03-12 03:47:37,330][124793] Updated weights for policy 0, policy_version 149920 (0.0005) [2023-03-12 03:47:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9497.2). Total num frames: 76791808. Throughput: 0: 9670.3. Samples: 76790772. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:47:41,005][124505] Avg episode reward: [(0, '4582.514')] [2023-03-12 03:47:41,507][124793] Updated weights for policy 0, policy_version 150000 (0.0005) [2023-03-12 03:47:45,573][124793] Updated weights for policy 0, policy_version 150080 (0.0004) [2023-03-12 03:47:46,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9762.1, 300 sec: 9511.1). Total num frames: 76845056. Throughput: 0: 9723.8. Samples: 76820872. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:47:46,005][124505] Avg episode reward: [(0, '4558.464')] [2023-03-12 03:47:49,687][124793] Updated weights for policy 0, policy_version 150160 (0.0004) [2023-03-12 03:47:51,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9762.1, 300 sec: 9524.9). Total num frames: 76894208. Throughput: 0: 9805.8. Samples: 76881100. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:47:51,005][124505] Avg episode reward: [(0, '4495.217')] [2023-03-12 03:47:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000150184_76894208.pth... [2023-03-12 03:47:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000149608_76599296.pth [2023-03-12 03:47:53,749][124793] Updated weights for policy 0, policy_version 150240 (0.0004) [2023-03-12 03:47:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9524.9). Total num frames: 76943360. Throughput: 0: 9829.4. Samples: 76941008. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:47:56,005][124505] Avg episode reward: [(0, '4548.932')] [2023-03-12 03:47:57,891][124793] Updated weights for policy 0, policy_version 150320 (0.0005) [2023-03-12 03:48:01,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9538.8). Total num frames: 76992512. Throughput: 0: 9840.4. Samples: 76970812. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:48:01,005][124505] Avg episode reward: [(0, '4543.636')] [2023-03-12 03:48:02,004][124793] Updated weights for policy 0, policy_version 150400 (0.0005) [2023-03-12 03:48:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9538.8). Total num frames: 77041664. Throughput: 0: 9849.2. Samples: 77030644. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:48:06,005][124505] Avg episode reward: [(0, '4550.808')] [2023-03-12 03:48:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000150472_77041664.pth... [2023-03-12 03:48:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000149896_76746752.pth [2023-03-12 03:48:06,063][124793] Updated weights for policy 0, policy_version 150480 (0.0004) [2023-03-12 03:48:10,103][124793] Updated weights for policy 0, policy_version 150560 (0.0004) [2023-03-12 03:48:11,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9566.6). Total num frames: 77094912. Throughput: 0: 9887.1. Samples: 77091380. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:48:11,005][124505] Avg episode reward: [(0, '4574.195')] [2023-03-12 03:48:14,422][124793] Updated weights for policy 0, policy_version 150640 (0.0005) [2023-03-12 03:48:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9552.7). Total num frames: 77139968. Throughput: 0: 9862.0. Samples: 77119864. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:48:16,005][124505] Avg episode reward: [(0, '4579.489')] [2023-03-12 03:48:18,868][124793] Updated weights for policy 0, policy_version 150720 (0.0005) [2023-03-12 03:48:21,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9762.1, 300 sec: 9552.7). Total num frames: 77185024. Throughput: 0: 9821.1. Samples: 77175796. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:48:21,005][124505] Avg episode reward: [(0, '4555.067')] [2023-03-12 03:48:21,047][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000150760_77189120.pth... [2023-03-12 03:48:21,049][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000150184_76894208.pth [2023-03-12 03:48:23,261][124793] Updated weights for policy 0, policy_version 150800 (0.0005) [2023-03-12 03:48:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9552.7). Total num frames: 77234176. Throughput: 0: 9789.9. Samples: 77231320. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 03:48:26,005][124505] Avg episode reward: [(0, '4569.163')] [2023-03-12 03:48:27,600][124793] Updated weights for policy 0, policy_version 150880 (0.0005) [2023-03-12 03:48:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9552.7). Total num frames: 77279232. Throughput: 0: 9752.4. Samples: 77259732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:48:31,005][124505] Avg episode reward: [(0, '4584.768')] [2023-03-12 03:48:31,979][124793] Updated weights for policy 0, policy_version 150960 (0.0005) [2023-03-12 03:48:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9552.7). Total num frames: 77328384. Throughput: 0: 9668.0. Samples: 77316160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:48:36,005][124505] Avg episode reward: [(0, '4572.710')] [2023-03-12 03:48:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000151032_77328384.pth... [2023-03-12 03:48:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000150472_77041664.pth [2023-03-12 03:48:36,353][124793] Updated weights for policy 0, policy_version 151040 (0.0005) [2023-03-12 03:48:40,750][124793] Updated weights for policy 0, policy_version 151120 (0.0005) [2023-03-12 03:48:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9552.7). Total num frames: 77373440. Throughput: 0: 9582.6. Samples: 77372224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:48:41,005][124505] Avg episode reward: [(0, '4582.862')] [2023-03-12 03:48:45,154][124793] Updated weights for policy 0, policy_version 151200 (0.0005) [2023-03-12 03:48:46,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9552.7). Total num frames: 77418496. Throughput: 0: 9533.9. Samples: 77399840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:48:46,005][124505] Avg episode reward: [(0, '4600.994')] [2023-03-12 03:48:49,509][124793] Updated weights for policy 0, policy_version 151280 (0.0005) [2023-03-12 03:48:51,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9552.7). Total num frames: 77467648. Throughput: 0: 9445.3. Samples: 77455684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:48:51,005][124505] Avg episode reward: [(0, '4585.034')] [2023-03-12 03:48:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000151304_77467648.pth... [2023-03-12 03:48:51,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000150760_77189120.pth [2023-03-12 03:48:53,640][124793] Updated weights for policy 0, policy_version 151360 (0.0005) [2023-03-12 03:48:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9566.6). Total num frames: 77516800. Throughput: 0: 9426.5. Samples: 77515572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:48:56,005][124505] Avg episode reward: [(0, '4589.666')] [2023-03-12 03:48:57,728][124793] Updated weights for policy 0, policy_version 151440 (0.0005) [2023-03-12 03:49:01,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9557.3, 300 sec: 9566.6). Total num frames: 77565952. Throughput: 0: 9465.1. Samples: 77545792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:49:01,005][124505] Avg episode reward: [(0, '4590.044')] [2023-03-12 03:49:01,834][124793] Updated weights for policy 0, policy_version 151520 (0.0005) [2023-03-12 03:49:05,942][124793] Updated weights for policy 0, policy_version 151600 (0.0004) [2023-03-12 03:49:06,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9625.6, 300 sec: 9580.5). Total num frames: 77619200. Throughput: 0: 9539.1. Samples: 77605056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:49:06,005][124505] Avg episode reward: [(0, '4581.780')] [2023-03-12 03:49:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000151600_77619200.pth... [2023-03-12 03:49:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000151032_77328384.pth [2023-03-12 03:49:10,100][124793] Updated weights for policy 0, policy_version 151680 (0.0005) [2023-03-12 03:49:11,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9557.3, 300 sec: 9594.4). Total num frames: 77668352. Throughput: 0: 9629.2. Samples: 77664632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:49:11,005][124505] Avg episode reward: [(0, '4580.429')] [2023-03-12 03:49:14,231][124793] Updated weights for policy 0, policy_version 151760 (0.0005) [2023-03-12 03:49:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9594.4). Total num frames: 77717504. Throughput: 0: 9672.0. Samples: 77694972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:49:16,005][124505] Avg episode reward: [(0, '4509.243')] [2023-03-12 03:49:18,369][124793] Updated weights for policy 0, policy_version 151840 (0.0005) [2023-03-12 03:49:21,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9608.2). Total num frames: 77766656. Throughput: 0: 9737.9. Samples: 77754368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:49:21,005][124505] Avg episode reward: [(0, '4555.503')] [2023-03-12 03:49:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000151888_77766656.pth... [2023-03-12 03:49:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000151304_77467648.pth [2023-03-12 03:49:22,460][124793] Updated weights for policy 0, policy_version 151920 (0.0004) [2023-03-12 03:49:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9608.2). Total num frames: 77815808. Throughput: 0: 9816.8. Samples: 77813980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:49:26,005][124505] Avg episode reward: [(0, '4563.431')] [2023-03-12 03:49:26,569][124793] Updated weights for policy 0, policy_version 152000 (0.0005) [2023-03-12 03:49:30,715][124793] Updated weights for policy 0, policy_version 152080 (0.0005) [2023-03-12 03:49:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9622.1). Total num frames: 77864960. Throughput: 0: 9865.9. Samples: 77843804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:49:31,005][124505] Avg episode reward: [(0, '4591.208')] [2023-03-12 03:49:34,737][124793] Updated weights for policy 0, policy_version 152160 (0.0005) [2023-03-12 03:49:36,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9636.0). Total num frames: 77918208. Throughput: 0: 9971.8. Samples: 77904416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:49:36,005][124505] Avg episode reward: [(0, '4594.789')] [2023-03-12 03:49:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000152184_77918208.pth... [2023-03-12 03:49:36,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000151600_77619200.pth [2023-03-12 03:49:39,031][124793] Updated weights for policy 0, policy_version 152240 (0.0005) [2023-03-12 03:49:41,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9636.0). Total num frames: 77963264. Throughput: 0: 9907.2. Samples: 77961396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:49:41,005][124505] Avg episode reward: [(0, '4564.076')] [2023-03-12 03:49:43,388][124793] Updated weights for policy 0, policy_version 152320 (0.0006) [2023-03-12 03:49:46,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9830.4, 300 sec: 9622.1). Total num frames: 78008320. Throughput: 0: 9869.0. Samples: 77989896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:49:46,005][124505] Avg episode reward: [(0, '4582.329')] [2023-03-12 03:49:47,783][124793] Updated weights for policy 0, policy_version 152400 (0.0006) [2023-03-12 03:49:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9636.0). Total num frames: 78057472. Throughput: 0: 9782.2. Samples: 78045256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:49:51,005][124505] Avg episode reward: [(0, '4595.981')] [2023-03-12 03:49:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000152456_78057472.pth... [2023-03-12 03:49:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000151888_77766656.pth [2023-03-12 03:49:52,034][124793] Updated weights for policy 0, policy_version 152480 (0.0005) [2023-03-12 03:49:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9636.0). Total num frames: 78106624. Throughput: 0: 9794.1. Samples: 78105368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:49:56,005][124505] Avg episode reward: [(0, '4592.999')] [2023-03-12 03:49:56,140][124793] Updated weights for policy 0, policy_version 152560 (0.0003) [2023-03-12 03:50:00,300][124793] Updated weights for policy 0, policy_version 152640 (0.0003) [2023-03-12 03:50:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9649.9). Total num frames: 78155776. Throughput: 0: 9786.4. Samples: 78135360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:50:01,005][124505] Avg episode reward: [(0, '4593.401')] [2023-03-12 03:50:04,661][124793] Updated weights for policy 0, policy_version 152720 (0.0004) [2023-03-12 03:50:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9663.8). Total num frames: 78204928. Throughput: 0: 9736.6. Samples: 78192516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:50:06,005][124505] Avg episode reward: [(0, '4599.123')] [2023-03-12 03:50:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000152744_78204928.pth... [2023-03-12 03:50:06,009][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000152184_77918208.pth [2023-03-12 03:50:08,987][124793] Updated weights for policy 0, policy_version 152800 (0.0006) [2023-03-12 03:50:11,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9663.8). Total num frames: 78254080. Throughput: 0: 9690.4. Samples: 78250048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:50:11,005][124505] Avg episode reward: [(0, '4595.637')] [2023-03-12 03:50:13,007][124793] Updated weights for policy 0, policy_version 152880 (0.0004) [2023-03-12 03:50:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9677.7). Total num frames: 78303232. Throughput: 0: 9698.7. Samples: 78280244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:50:16,005][124505] Avg episode reward: [(0, '4604.533')] [2023-03-12 03:50:17,239][124793] Updated weights for policy 0, policy_version 152960 (0.0005) [2023-03-12 03:50:21,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9677.7). Total num frames: 78352384. Throughput: 0: 9658.8. Samples: 78339060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:50:21,005][124505] Avg episode reward: [(0, '4601.168')] [2023-03-12 03:50:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000153032_78352384.pth... [2023-03-12 03:50:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000152456_78057472.pth [2023-03-12 03:50:21,391][124793] Updated weights for policy 0, policy_version 153040 (0.0003) [2023-03-12 03:50:25,637][124793] Updated weights for policy 0, policy_version 153120 (0.0005) [2023-03-12 03:50:26,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9677.7). Total num frames: 78397440. Throughput: 0: 9689.9. Samples: 78397440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:50:26,005][124505] Avg episode reward: [(0, '4605.774')] [2023-03-12 03:50:29,914][124793] Updated weights for policy 0, policy_version 153200 (0.0005) [2023-03-12 03:50:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9677.7). Total num frames: 78446592. Throughput: 0: 9679.3. Samples: 78425464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:50:31,005][124505] Avg episode reward: [(0, '4602.209')] [2023-03-12 03:50:34,222][124793] Updated weights for policy 0, policy_version 153280 (0.0005) [2023-03-12 03:50:36,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9691.5). Total num frames: 78495744. Throughput: 0: 9731.8. Samples: 78483188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:50:36,005][124505] Avg episode reward: [(0, '4600.211')] [2023-03-12 03:50:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000153312_78495744.pth... [2023-03-12 03:50:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000152744_78204928.pth [2023-03-12 03:50:38,583][124793] Updated weights for policy 0, policy_version 153360 (0.0005) [2023-03-12 03:50:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9691.6). Total num frames: 78540800. Throughput: 0: 9646.0. Samples: 78539436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:50:41,005][124505] Avg episode reward: [(0, '4603.828')] [2023-03-12 03:50:42,976][124793] Updated weights for policy 0, policy_version 153440 (0.0005) [2023-03-12 03:50:46,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9625.6, 300 sec: 9677.7). Total num frames: 78585856. Throughput: 0: 9597.1. Samples: 78567228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:50:46,005][124505] Avg episode reward: [(0, '4607.350')] [2023-03-12 03:50:47,351][124793] Updated weights for policy 0, policy_version 153520 (0.0005) [2023-03-12 03:50:51,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9691.6). Total num frames: 78635008. Throughput: 0: 9567.3. Samples: 78623044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:50:51,006][124505] Avg episode reward: [(0, '4600.516')] [2023-03-12 03:50:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000153584_78635008.pth... [2023-03-12 03:50:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000153032_78352384.pth [2023-03-12 03:50:51,687][124793] Updated weights for policy 0, policy_version 153600 (0.0005) [2023-03-12 03:50:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9677.7). Total num frames: 78680064. Throughput: 0: 9546.9. Samples: 78679660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:50:56,005][124505] Avg episode reward: [(0, '4605.622')] [2023-03-12 03:50:56,101][124793] Updated weights for policy 0, policy_version 153680 (0.0005) [2023-03-12 03:51:00,304][124793] Updated weights for policy 0, policy_version 153760 (0.0005) [2023-03-12 03:51:01,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9691.6). Total num frames: 78729216. Throughput: 0: 9499.8. Samples: 78707736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:51:01,005][124505] Avg episode reward: [(0, '4606.419')] [2023-03-12 03:51:04,447][124793] Updated weights for policy 0, policy_version 153840 (0.0005) [2023-03-12 03:51:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9705.4). Total num frames: 78778368. Throughput: 0: 9518.1. Samples: 78767376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:51:06,005][124505] Avg episode reward: [(0, '4594.464')] [2023-03-12 03:51:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000153864_78778368.pth... [2023-03-12 03:51:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000153312_78495744.pth [2023-03-12 03:51:08,509][124793] Updated weights for policy 0, policy_version 153920 (0.0005) [2023-03-12 03:51:11,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9625.6, 300 sec: 9719.3). Total num frames: 78831616. Throughput: 0: 9558.7. Samples: 78827584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:51:11,005][124505] Avg episode reward: [(0, '4600.877')] [2023-03-12 03:51:12,540][124793] Updated weights for policy 0, policy_version 154000 (0.0006) [2023-03-12 03:51:16,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9625.6, 300 sec: 9719.3). Total num frames: 78880768. Throughput: 0: 9633.9. Samples: 78858988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:51:16,005][124505] Avg episode reward: [(0, '4595.478')] [2023-03-12 03:51:16,761][124793] Updated weights for policy 0, policy_version 154080 (0.0005) [2023-03-12 03:51:21,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9691.6). Total num frames: 78925824. Throughput: 0: 9598.1. Samples: 78915104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:51:21,005][124505] Avg episode reward: [(0, '4608.474')] [2023-03-12 03:51:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000154152_78925824.pth... [2023-03-12 03:51:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000153584_78635008.pth [2023-03-12 03:51:21,215][124793] Updated weights for policy 0, policy_version 154160 (0.0005) [2023-03-12 03:51:25,612][124793] Updated weights for policy 0, policy_version 154240 (0.0005) [2023-03-12 03:51:26,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9677.7). Total num frames: 78970880. Throughput: 0: 9587.8. Samples: 78970888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:51:26,005][124505] Avg episode reward: [(0, '4605.379')] [2023-03-12 03:51:29,822][124793] Updated weights for policy 0, policy_version 154320 (0.0005) [2023-03-12 03:51:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9691.6). Total num frames: 79020032. Throughput: 0: 9621.1. Samples: 79000176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:51:31,005][124505] Avg episode reward: [(0, '4560.108')] [2023-03-12 03:51:34,192][124793] Updated weights for policy 0, policy_version 154400 (0.0006) [2023-03-12 03:51:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9691.6). Total num frames: 79069184. Throughput: 0: 9641.5. Samples: 79056912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:51:36,005][124505] Avg episode reward: [(0, '4597.447')] [2023-03-12 03:51:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000154432_79069184.pth... [2023-03-12 03:51:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000153864_78778368.pth [2023-03-12 03:51:38,484][124793] Updated weights for policy 0, policy_version 154480 (0.0005) [2023-03-12 03:51:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9677.7). Total num frames: 79114240. Throughput: 0: 9650.7. Samples: 79113940. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:51:41,005][124505] Avg episode reward: [(0, '4600.797')] [2023-03-12 03:51:42,837][124793] Updated weights for policy 0, policy_version 154560 (0.0005) [2023-03-12 03:51:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9677.7). Total num frames: 79163392. Throughput: 0: 9655.1. Samples: 79142216. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:51:46,005][124505] Avg episode reward: [(0, '4596.541')] [2023-03-12 03:51:47,099][124793] Updated weights for policy 0, policy_version 154640 (0.0005) [2023-03-12 03:51:51,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9677.7). Total num frames: 79212544. Throughput: 0: 9618.1. Samples: 79200188. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:51:51,005][124505] Avg episode reward: [(0, '4598.983')] [2023-03-12 03:51:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000154712_79212544.pth... [2023-03-12 03:51:51,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000154152_78925824.pth [2023-03-12 03:51:51,359][124793] Updated weights for policy 0, policy_version 154720 (0.0005) [2023-03-12 03:51:55,720][124793] Updated weights for policy 0, policy_version 154800 (0.0005) [2023-03-12 03:51:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9677.7). Total num frames: 79257600. Throughput: 0: 9530.8. Samples: 79256472. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:51:56,005][124505] Avg episode reward: [(0, '4602.126')] [2023-03-12 03:51:59,868][124793] Updated weights for policy 0, policy_version 154880 (0.0004) [2023-03-12 03:52:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9677.7). Total num frames: 79306752. Throughput: 0: 9493.1. Samples: 79286176. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:52:01,005][124505] Avg episode reward: [(0, '4595.817')] [2023-03-12 03:52:04,316][124793] Updated weights for policy 0, policy_version 154960 (0.0005) [2023-03-12 03:52:06,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9663.8). Total num frames: 79351808. Throughput: 0: 9496.7. Samples: 79342456. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:52:06,006][124505] Avg episode reward: [(0, '4600.247')] [2023-03-12 03:52:06,044][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000154992_79355904.pth... [2023-03-12 03:52:06,046][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000154432_79069184.pth [2023-03-12 03:52:08,569][124793] Updated weights for policy 0, policy_version 155040 (0.0004) [2023-03-12 03:52:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9663.8). Total num frames: 79400960. Throughput: 0: 9530.0. Samples: 79399740. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:52:11,005][124505] Avg episode reward: [(0, '4599.139')] [2023-03-12 03:52:12,797][124793] Updated weights for policy 0, policy_version 155120 (0.0003) [2023-03-12 03:52:16,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9663.8). Total num frames: 79450112. Throughput: 0: 9541.3. Samples: 79429536. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:52:16,005][124505] Avg episode reward: [(0, '4578.522')] [2023-03-12 03:52:17,004][124793] Updated weights for policy 0, policy_version 155200 (0.0004) [2023-03-12 03:52:21,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9663.8). Total num frames: 79499264. Throughput: 0: 9554.8. Samples: 79486880. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:52:21,006][124505] Avg episode reward: [(0, '4601.266')] [2023-03-12 03:52:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000155272_79499264.pth... [2023-03-12 03:52:21,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000154712_79212544.pth [2023-03-12 03:52:21,436][124793] Updated weights for policy 0, policy_version 155280 (0.0005) [2023-03-12 03:52:25,823][124793] Updated weights for policy 0, policy_version 155360 (0.0005) [2023-03-12 03:52:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9649.9). Total num frames: 79544320. Throughput: 0: 9515.7. Samples: 79542148. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:52:26,005][124505] Avg episode reward: [(0, '4565.388')] [2023-03-12 03:52:30,165][124793] Updated weights for policy 0, policy_version 155440 (0.0005) [2023-03-12 03:52:31,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9663.8). Total num frames: 79593472. Throughput: 0: 9503.5. Samples: 79569872. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:52:31,005][124505] Avg episode reward: [(0, '4546.559')] [2023-03-12 03:52:34,403][124793] Updated weights for policy 0, policy_version 155520 (0.0004) [2023-03-12 03:52:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9649.9). Total num frames: 79638528. Throughput: 0: 9502.4. Samples: 79627796. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:52:36,005][124505] Avg episode reward: [(0, '4605.653')] [2023-03-12 03:52:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000155544_79638528.pth... [2023-03-12 03:52:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000154992_79355904.pth [2023-03-12 03:52:38,808][124793] Updated weights for policy 0, policy_version 155600 (0.0005) [2023-03-12 03:52:41,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9622.1). Total num frames: 79683584. Throughput: 0: 9491.7. Samples: 79683600. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:52:41,005][124505] Avg episode reward: [(0, '4603.113')] [2023-03-12 03:52:43,241][124793] Updated weights for policy 0, policy_version 155680 (0.0005) [2023-03-12 03:52:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9622.1). Total num frames: 79732736. Throughput: 0: 9462.9. Samples: 79712008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:52:46,005][124505] Avg episode reward: [(0, '4604.738')] [2023-03-12 03:52:47,581][124793] Updated weights for policy 0, policy_version 155760 (0.0006) [2023-03-12 03:52:51,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9608.2). Total num frames: 79777792. Throughput: 0: 9455.3. Samples: 79767944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:52:51,005][124505] Avg episode reward: [(0, '4555.018')] [2023-03-12 03:52:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000155816_79777792.pth... [2023-03-12 03:52:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000155272_79499264.pth [2023-03-12 03:52:51,945][124793] Updated weights for policy 0, policy_version 155840 (0.0005) [2023-03-12 03:52:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9608.2). Total num frames: 79826944. Throughput: 0: 9488.3. Samples: 79826712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:52:56,005][124505] Avg episode reward: [(0, '4533.013')] [2023-03-12 03:52:56,060][124793] Updated weights for policy 0, policy_version 155920 (0.0005) [2023-03-12 03:53:00,472][124793] Updated weights for policy 0, policy_version 156000 (0.0006) [2023-03-12 03:53:01,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9608.2). Total num frames: 79876096. Throughput: 0: 9446.9. Samples: 79854644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:53:01,005][124505] Avg episode reward: [(0, '4571.856')] [2023-03-12 03:53:04,669][124793] Updated weights for policy 0, policy_version 156080 (0.0004) [2023-03-12 03:53:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.4, 300 sec: 9594.4). Total num frames: 79925248. Throughput: 0: 9461.7. Samples: 79912656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:53:06,005][124505] Avg episode reward: [(0, '4461.895')] [2023-03-12 03:53:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000156104_79925248.pth... [2023-03-12 03:53:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000155544_79638528.pth [2023-03-12 03:53:08,769][124793] Updated weights for policy 0, policy_version 156160 (0.0003) [2023-03-12 03:53:11,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9608.2). Total num frames: 79974400. Throughput: 0: 9543.5. Samples: 79971604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:53:11,005][124505] Avg episode reward: [(0, '4435.629')] [2023-03-12 03:53:12,837][124793] Updated weights for policy 0, policy_version 156240 (0.0003) [2023-03-12 03:53:16,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9557.3, 300 sec: 9622.1). Total num frames: 80023552. Throughput: 0: 9618.6. Samples: 80002708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:53:16,005][124505] Avg episode reward: [(0, '4467.853')] [2023-03-12 03:53:17,007][124793] Updated weights for policy 0, policy_version 156320 (0.0004) [2023-03-12 03:53:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9622.1). Total num frames: 80072704. Throughput: 0: 9625.4. Samples: 80060940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:53:21,005][124505] Avg episode reward: [(0, '4476.477')] [2023-03-12 03:53:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000156392_80072704.pth... [2023-03-12 03:53:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000155816_79777792.pth [2023-03-12 03:53:21,290][124793] Updated weights for policy 0, policy_version 156400 (0.0006) [2023-03-12 03:53:25,672][124793] Updated weights for policy 0, policy_version 156480 (0.0006) [2023-03-12 03:53:26,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9622.1). Total num frames: 80117760. Throughput: 0: 9634.5. Samples: 80117152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:53:26,005][124505] Avg episode reward: [(0, '4567.196')] [2023-03-12 03:53:30,075][124793] Updated weights for policy 0, policy_version 156560 (0.0005) [2023-03-12 03:53:31,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9622.1). Total num frames: 80166912. Throughput: 0: 9615.6. Samples: 80144708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:53:31,005][124505] Avg episode reward: [(0, '4568.562')] [2023-03-12 03:53:34,298][124793] Updated weights for policy 0, policy_version 156640 (0.0005) [2023-03-12 03:53:36,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9636.0). Total num frames: 80216064. Throughput: 0: 9664.4. Samples: 80202844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:53:36,006][124505] Avg episode reward: [(0, '4568.761')] [2023-03-12 03:53:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000156672_80216064.pth... [2023-03-12 03:53:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000156104_79925248.pth [2023-03-12 03:53:38,410][124793] Updated weights for policy 0, policy_version 156720 (0.0005) [2023-03-12 03:53:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9649.9). Total num frames: 80265216. Throughput: 0: 9686.0. Samples: 80262580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:53:41,005][124505] Avg episode reward: [(0, '4601.635')] [2023-03-12 03:53:42,462][124793] Updated weights for policy 0, policy_version 156800 (0.0005) [2023-03-12 03:53:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9649.9). Total num frames: 80314368. Throughput: 0: 9742.1. Samples: 80293040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:53:46,005][124505] Avg episode reward: [(0, '4595.798')] [2023-03-12 03:53:46,661][124793] Updated weights for policy 0, policy_version 156880 (0.0005) [2023-03-12 03:53:51,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9636.0). Total num frames: 80359424. Throughput: 0: 9727.4. Samples: 80350388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:53:51,005][124505] Avg episode reward: [(0, '4596.016')] [2023-03-12 03:53:51,026][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000156960_80363520.pth... [2023-03-12 03:53:51,026][124793] Updated weights for policy 0, policy_version 156960 (0.0005) [2023-03-12 03:53:51,028][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000156392_80072704.pth [2023-03-12 03:53:55,300][124793] Updated weights for policy 0, policy_version 157040 (0.0005) [2023-03-12 03:53:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9636.0). Total num frames: 80408576. Throughput: 0: 9688.9. Samples: 80407604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:53:56,005][124505] Avg episode reward: [(0, '4603.622')] [2023-03-12 03:53:59,720][124793] Updated weights for policy 0, policy_version 157120 (0.0005) [2023-03-12 03:54:01,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9693.8, 300 sec: 9622.1). Total num frames: 80457728. Throughput: 0: 9596.0. Samples: 80434528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:54:01,006][124505] Avg episode reward: [(0, '4601.738')] [2023-03-12 03:54:03,885][124793] Updated weights for policy 0, policy_version 157200 (0.0005) [2023-03-12 03:54:06,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9622.1). Total num frames: 80506880. Throughput: 0: 9606.7. Samples: 80493244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:54:06,006][124505] Avg episode reward: [(0, '4595.749')] [2023-03-12 03:54:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000157240_80506880.pth... [2023-03-12 03:54:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000156672_80216064.pth [2023-03-12 03:54:08,060][124793] Updated weights for policy 0, policy_version 157280 (0.0005) [2023-03-12 03:54:11,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9608.2). Total num frames: 80551936. Throughput: 0: 9636.2. Samples: 80550780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:54:11,005][124505] Avg episode reward: [(0, '4602.581')] [2023-03-12 03:54:12,473][124793] Updated weights for policy 0, policy_version 157360 (0.0005) [2023-03-12 03:54:16,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9608.2). Total num frames: 80601088. Throughput: 0: 9651.1. Samples: 80579008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:54:16,005][124505] Avg episode reward: [(0, '4592.769')] [2023-03-12 03:54:16,873][124793] Updated weights for policy 0, policy_version 157440 (0.0005) [2023-03-12 03:54:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9594.4). Total num frames: 80646144. Throughput: 0: 9589.9. Samples: 80634388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:54:21,005][124505] Avg episode reward: [(0, '4598.312')] [2023-03-12 03:54:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000157512_80646144.pth... [2023-03-12 03:54:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000156960_80363520.pth [2023-03-12 03:54:21,236][124793] Updated weights for policy 0, policy_version 157520 (0.0005) [2023-03-12 03:54:25,575][124793] Updated weights for policy 0, policy_version 157600 (0.0005) [2023-03-12 03:54:26,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9580.5). Total num frames: 80691200. Throughput: 0: 9526.3. Samples: 80691264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:54:26,005][124505] Avg episode reward: [(0, '4604.779')] [2023-03-12 03:54:30,060][124793] Updated weights for policy 0, policy_version 157680 (0.0005) [2023-03-12 03:54:31,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9566.6). Total num frames: 80740352. Throughput: 0: 9466.9. Samples: 80719052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:54:31,005][124505] Avg episode reward: [(0, '4600.567')] [2023-03-12 03:54:34,404][124793] Updated weights for policy 0, policy_version 157760 (0.0004) [2023-03-12 03:54:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9566.6). Total num frames: 80785408. Throughput: 0: 9434.7. Samples: 80774952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:54:36,005][124505] Avg episode reward: [(0, '4595.540')] [2023-03-12 03:54:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000157784_80785408.pth... [2023-03-12 03:54:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000157240_80506880.pth [2023-03-12 03:54:38,708][124793] Updated weights for policy 0, policy_version 157840 (0.0005) [2023-03-12 03:54:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9580.5). Total num frames: 80834560. Throughput: 0: 9426.1. Samples: 80831780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:54:41,005][124505] Avg episode reward: [(0, '4595.334')] [2023-03-12 03:54:43,079][124793] Updated weights for policy 0, policy_version 157920 (0.0005) [2023-03-12 03:54:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9580.5). Total num frames: 80883712. Throughput: 0: 9441.8. Samples: 80859408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:54:46,005][124505] Avg episode reward: [(0, '4594.050')] [2023-03-12 03:54:47,188][124793] Updated weights for policy 0, policy_version 158000 (0.0005) [2023-03-12 03:54:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9566.6). Total num frames: 80928768. Throughput: 0: 9463.5. Samples: 80919100. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:54:51,005][124505] Avg episode reward: [(0, '4593.907')] [2023-03-12 03:54:51,063][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000158072_80932864.pth... [2023-03-12 03:54:51,065][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000157512_80646144.pth [2023-03-12 03:54:51,493][124793] Updated weights for policy 0, policy_version 158080 (0.0005) [2023-03-12 03:54:55,799][124793] Updated weights for policy 0, policy_version 158160 (0.0005) [2023-03-12 03:54:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9566.6). Total num frames: 80977920. Throughput: 0: 9449.9. Samples: 80976024. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:54:56,005][124505] Avg episode reward: [(0, '4601.480')] [2023-03-12 03:55:00,268][124793] Updated weights for policy 0, policy_version 158240 (0.0005) [2023-03-12 03:55:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9552.7). Total num frames: 81022976. Throughput: 0: 9427.4. Samples: 81003240. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:55:01,005][124505] Avg episode reward: [(0, '4600.478')] [2023-03-12 03:55:04,675][124793] Updated weights for policy 0, policy_version 158320 (0.0005) [2023-03-12 03:55:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9552.7). Total num frames: 81072128. Throughput: 0: 9444.3. Samples: 81059380. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:55:06,005][124505] Avg episode reward: [(0, '4595.153')] [2023-03-12 03:55:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000158344_81072128.pth... [2023-03-12 03:55:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000157784_80785408.pth [2023-03-12 03:55:09,059][124793] Updated weights for policy 0, policy_version 158400 (0.0005) [2023-03-12 03:55:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9538.8). Total num frames: 81117184. Throughput: 0: 9417.9. Samples: 81115072. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:55:11,005][124505] Avg episode reward: [(0, '4601.157')] [2023-03-12 03:55:13,368][124793] Updated weights for policy 0, policy_version 158480 (0.0004) [2023-03-12 03:55:16,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9524.9). Total num frames: 81162240. Throughput: 0: 9439.5. Samples: 81143832. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:55:16,016][124505] Avg episode reward: [(0, '4592.981')] [2023-03-12 03:55:17,780][124793] Updated weights for policy 0, policy_version 158560 (0.0005) [2023-03-12 03:55:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9538.8). Total num frames: 81211392. Throughput: 0: 9435.3. Samples: 81199540. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:55:21,016][124505] Avg episode reward: [(0, '4596.907')] [2023-03-12 03:55:21,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000158616_81211392.pth... [2023-03-12 03:55:21,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000158072_80932864.pth [2023-03-12 03:55:22,203][124793] Updated weights for policy 0, policy_version 158640 (0.0005) [2023-03-12 03:55:26,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 81256448. Throughput: 0: 9417.9. Samples: 81255584. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:55:26,016][124505] Avg episode reward: [(0, '4599.820')] [2023-03-12 03:55:26,600][124793] Updated weights for policy 0, policy_version 158720 (0.0005) [2023-03-12 03:55:30,980][124793] Updated weights for policy 0, policy_version 158800 (0.0005) [2023-03-12 03:55:31,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 81305600. Throughput: 0: 9416.7. Samples: 81283160. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:55:31,016][124505] Avg episode reward: [(0, '4599.009')] [2023-03-12 03:55:35,419][124793] Updated weights for policy 0, policy_version 158880 (0.0005) [2023-03-12 03:55:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 81350656. Throughput: 0: 9325.3. Samples: 81338740. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:55:36,007][124505] Avg episode reward: [(0, '4589.479')] [2023-03-12 03:55:36,010][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000158888_81350656.pth... [2023-03-12 03:55:36,013][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000158344_81072128.pth [2023-03-12 03:55:39,858][124793] Updated weights for policy 0, policy_version 158960 (0.0005) [2023-03-12 03:55:41,005][124505] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9524.9). Total num frames: 81395712. Throughput: 0: 9308.1. Samples: 81394888. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:55:41,016][124505] Avg episode reward: [(0, '4606.629')] [2023-03-12 03:55:44,227][124793] Updated weights for policy 0, policy_version 159040 (0.0005) [2023-03-12 03:55:46,005][124505] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9511.1). Total num frames: 81440768. Throughput: 0: 9326.9. Samples: 81422948. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:55:46,005][124505] Avg episode reward: [(0, '4607.208')] [2023-03-12 03:55:48,699][124793] Updated weights for policy 0, policy_version 159120 (0.0005) [2023-03-12 03:55:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9524.9). Total num frames: 81489920. Throughput: 0: 9294.7. Samples: 81477640. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 03:55:51,005][124505] Avg episode reward: [(0, '4596.930')] [2023-03-12 03:55:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000159160_81489920.pth... [2023-03-12 03:55:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000158616_81211392.pth [2023-03-12 03:55:53,079][124793] Updated weights for policy 0, policy_version 159200 (0.0005) [2023-03-12 03:55:56,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9511.1). Total num frames: 81534976. Throughput: 0: 9297.5. Samples: 81533460. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:55:56,005][124505] Avg episode reward: [(0, '4601.591')] [2023-03-12 03:55:57,560][124793] Updated weights for policy 0, policy_version 159280 (0.0005) [2023-03-12 03:56:01,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9497.2). Total num frames: 81580032. Throughput: 0: 9265.2. Samples: 81560764. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:56:01,005][124505] Avg episode reward: [(0, '4591.603')] [2023-03-12 03:56:02,022][124793] Updated weights for policy 0, policy_version 159360 (0.0005) [2023-03-12 03:56:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9483.3). Total num frames: 81629184. Throughput: 0: 9262.1. Samples: 81616336. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:56:06,005][124505] Avg episode reward: [(0, '4595.547')] [2023-03-12 03:56:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000159432_81629184.pth... [2023-03-12 03:56:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000158888_81350656.pth [2023-03-12 03:56:06,434][124793] Updated weights for policy 0, policy_version 159440 (0.0005) [2023-03-12 03:56:10,762][124793] Updated weights for policy 0, policy_version 159520 (0.0005) [2023-03-12 03:56:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9469.4). Total num frames: 81674240. Throughput: 0: 9259.2. Samples: 81672248. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:56:11,005][124505] Avg episode reward: [(0, '4594.087')] [2023-03-12 03:56:14,913][124793] Updated weights for policy 0, policy_version 159600 (0.0004) [2023-03-12 03:56:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 81723392. Throughput: 0: 9310.5. Samples: 81702132. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:56:16,016][124505] Avg episode reward: [(0, '4591.149')] [2023-03-12 03:56:19,271][124793] Updated weights for policy 0, policy_version 159680 (0.0004) [2023-03-12 03:56:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9483.3). Total num frames: 81768448. Throughput: 0: 9353.1. Samples: 81759628. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:56:21,016][124505] Avg episode reward: [(0, '4594.043')] [2023-03-12 03:56:21,018][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000159712_81772544.pth... [2023-03-12 03:56:21,020][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000159160_81489920.pth [2023-03-12 03:56:23,589][124793] Updated weights for policy 0, policy_version 159760 (0.0005) [2023-03-12 03:56:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 81817600. Throughput: 0: 9365.6. Samples: 81816340. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:56:26,005][124505] Avg episode reward: [(0, '4596.532')] [2023-03-12 03:56:27,752][124793] Updated weights for policy 0, policy_version 159840 (0.0004) [2023-03-12 03:56:31,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9483.3). Total num frames: 81866752. Throughput: 0: 9407.4. Samples: 81846280. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:56:31,016][124505] Avg episode reward: [(0, '4586.088')] [2023-03-12 03:56:32,091][124793] Updated weights for policy 0, policy_version 159920 (0.0005) [2023-03-12 03:56:36,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9497.2). Total num frames: 81915904. Throughput: 0: 9449.9. Samples: 81902884. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:56:36,016][124505] Avg episode reward: [(0, '4574.213')] [2023-03-12 03:56:36,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000159992_81915904.pth... [2023-03-12 03:56:36,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000159432_81629184.pth [2023-03-12 03:56:36,329][124793] Updated weights for policy 0, policy_version 160000 (0.0005) [2023-03-12 03:56:40,559][124793] Updated weights for policy 0, policy_version 160080 (0.0005) [2023-03-12 03:56:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9497.2). Total num frames: 81965056. Throughput: 0: 9501.6. Samples: 81961032. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:56:41,016][124505] Avg episode reward: [(0, '4592.367')] [2023-03-12 03:56:44,766][124793] Updated weights for policy 0, policy_version 160160 (0.0005) [2023-03-12 03:56:46,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9483.3). Total num frames: 82010112. Throughput: 0: 9545.3. Samples: 81990304. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:56:46,016][124505] Avg episode reward: [(0, '4583.224')] [2023-03-12 03:56:48,890][124793] Updated weights for policy 0, policy_version 160240 (0.0004) [2023-03-12 03:56:51,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9497.2). Total num frames: 82059264. Throughput: 0: 9625.3. Samples: 82049472. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:56:51,016][124505] Avg episode reward: [(0, '4594.265')] [2023-03-12 03:56:51,034][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000160280_82063360.pth... [2023-03-12 03:56:51,035][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000159712_81772544.pth [2023-03-12 03:56:53,159][124793] Updated weights for policy 0, policy_version 160320 (0.0005) [2023-03-12 03:56:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9497.2). Total num frames: 82108416. Throughput: 0: 9676.6. Samples: 82107696. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 03:56:56,016][124505] Avg episode reward: [(0, '4593.484')] [2023-03-12 03:56:57,435][124793] Updated weights for policy 0, policy_version 160400 (0.0005) [2023-03-12 03:57:01,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9511.1). Total num frames: 82157568. Throughput: 0: 9637.7. Samples: 82135828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:57:01,016][124505] Avg episode reward: [(0, '4564.862')] [2023-03-12 03:57:01,610][124793] Updated weights for policy 0, policy_version 160480 (0.0004) [2023-03-12 03:57:05,775][124793] Updated weights for policy 0, policy_version 160560 (0.0004) [2023-03-12 03:57:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9511.0). Total num frames: 82206720. Throughput: 0: 9668.2. Samples: 82194696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:57:06,006][124505] Avg episode reward: [(0, '4537.652')] [2023-03-12 03:57:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000160560_82206720.pth... [2023-03-12 03:57:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000159992_81915904.pth [2023-03-12 03:57:10,061][124793] Updated weights for policy 0, policy_version 160640 (0.0004) [2023-03-12 03:57:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9511.1). Total num frames: 82255872. Throughput: 0: 9696.8. Samples: 82252696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:57:11,005][124505] Avg episode reward: [(0, '4501.838')] [2023-03-12 03:57:14,346][124793] Updated weights for policy 0, policy_version 160720 (0.0005) [2023-03-12 03:57:16,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9497.2). Total num frames: 82300928. Throughput: 0: 9665.4. Samples: 82281224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:57:16,005][124505] Avg episode reward: [(0, '4579.265')] [2023-03-12 03:57:18,564][124793] Updated weights for policy 0, policy_version 160800 (0.0004) [2023-03-12 03:57:21,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9511.0). Total num frames: 82350080. Throughput: 0: 9707.7. Samples: 82339732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:57:21,005][124505] Avg episode reward: [(0, '4434.899')] [2023-03-12 03:57:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000160840_82350080.pth... [2023-03-12 03:57:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000160280_82063360.pth [2023-03-12 03:57:22,757][124793] Updated weights for policy 0, policy_version 160880 (0.0005) [2023-03-12 03:57:26,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9511.1). Total num frames: 82399232. Throughput: 0: 9708.6. Samples: 82397920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:57:26,005][124505] Avg episode reward: [(0, '4545.340')] [2023-03-12 03:57:26,999][124793] Updated weights for policy 0, policy_version 160960 (0.0004) [2023-03-12 03:57:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9524.9). Total num frames: 82448384. Throughput: 0: 9721.9. Samples: 82427788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:57:31,005][124505] Avg episode reward: [(0, '4558.830')] [2023-03-12 03:57:31,117][124793] Updated weights for policy 0, policy_version 161040 (0.0005) [2023-03-12 03:57:35,322][124793] Updated weights for policy 0, policy_version 161120 (0.0005) [2023-03-12 03:57:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9538.8). Total num frames: 82497536. Throughput: 0: 9704.3. Samples: 82486168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:57:36,005][124505] Avg episode reward: [(0, '4555.428')] [2023-03-12 03:57:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000161128_82497536.pth... [2023-03-12 03:57:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000160560_82206720.pth [2023-03-12 03:57:39,525][124793] Updated weights for policy 0, policy_version 161200 (0.0005) [2023-03-12 03:57:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9538.8). Total num frames: 82546688. Throughput: 0: 9717.1. Samples: 82544964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:57:41,005][124505] Avg episode reward: [(0, '4588.704')] [2023-03-12 03:57:43,623][124793] Updated weights for policy 0, policy_version 161280 (0.0004) [2023-03-12 03:57:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9552.7). Total num frames: 82595840. Throughput: 0: 9765.5. Samples: 82575276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:57:46,005][124505] Avg episode reward: [(0, '4578.364')] [2023-03-12 03:57:47,826][124793] Updated weights for policy 0, policy_version 161360 (0.0004) [2023-03-12 03:57:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9552.7). Total num frames: 82644992. Throughput: 0: 9752.1. Samples: 82633540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:57:51,005][124505] Avg episode reward: [(0, '4584.974')] [2023-03-12 03:57:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000161416_82644992.pth... [2023-03-12 03:57:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000160840_82350080.pth [2023-03-12 03:57:52,061][124793] Updated weights for policy 0, policy_version 161440 (0.0004) [2023-03-12 03:57:56,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9552.7). Total num frames: 82694144. Throughput: 0: 9727.8. Samples: 82690448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:57:56,005][124505] Avg episode reward: [(0, '4568.874')] [2023-03-12 03:57:56,412][124793] Updated weights for policy 0, policy_version 161520 (0.0005) [2023-03-12 03:58:00,642][124793] Updated weights for policy 0, policy_version 161600 (0.0005) [2023-03-12 03:58:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9538.8). Total num frames: 82739200. Throughput: 0: 9725.6. Samples: 82718876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:58:01,005][124505] Avg episode reward: [(0, '4529.423')] [2023-03-12 03:58:04,841][124793] Updated weights for policy 0, policy_version 161680 (0.0005) [2023-03-12 03:58:06,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9693.9, 300 sec: 9538.8). Total num frames: 82788352. Throughput: 0: 9737.1. Samples: 82777904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:58:06,006][124505] Avg episode reward: [(0, '4547.554')] [2023-03-12 03:58:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000161696_82788352.pth... [2023-03-12 03:58:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000161128_82497536.pth [2023-03-12 03:58:09,222][124793] Updated weights for policy 0, policy_version 161760 (0.0005) [2023-03-12 03:58:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9538.8). Total num frames: 82837504. Throughput: 0: 9692.0. Samples: 82834060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:58:11,005][124505] Avg episode reward: [(0, '4579.998')] [2023-03-12 03:58:13,445][124793] Updated weights for policy 0, policy_version 161840 (0.0005) [2023-03-12 03:58:16,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9524.9). Total num frames: 82882560. Throughput: 0: 9679.1. Samples: 82863348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:58:16,005][124505] Avg episode reward: [(0, '4585.126')] [2023-03-12 03:58:17,732][124793] Updated weights for policy 0, policy_version 161920 (0.0005) [2023-03-12 03:58:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9538.8). Total num frames: 82931712. Throughput: 0: 9655.4. Samples: 82920660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:58:21,005][124505] Avg episode reward: [(0, '4582.442')] [2023-03-12 03:58:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000161976_82931712.pth... [2023-03-12 03:58:21,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000161416_82644992.pth [2023-03-12 03:58:21,958][124793] Updated weights for policy 0, policy_version 162000 (0.0005) [2023-03-12 03:58:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9538.8). Total num frames: 82980864. Throughput: 0: 9644.9. Samples: 82978984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:58:26,005][124505] Avg episode reward: [(0, '4588.518')] [2023-03-12 03:58:26,204][124793] Updated weights for policy 0, policy_version 162080 (0.0005) [2023-03-12 03:58:30,469][124793] Updated weights for policy 0, policy_version 162160 (0.0005) [2023-03-12 03:58:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9538.8). Total num frames: 83030016. Throughput: 0: 9616.5. Samples: 83008020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:58:31,005][124505] Avg episode reward: [(0, '4584.050')] [2023-03-12 03:58:34,862][124793] Updated weights for policy 0, policy_version 162240 (0.0005) [2023-03-12 03:58:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9524.9). Total num frames: 83075072. Throughput: 0: 9561.9. Samples: 83063828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:58:36,005][124505] Avg episode reward: [(0, '4570.608')] [2023-03-12 03:58:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000162256_83075072.pth... [2023-03-12 03:58:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000161696_82788352.pth [2023-03-12 03:58:39,135][124793] Updated weights for policy 0, policy_version 162320 (0.0005) [2023-03-12 03:58:41,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9524.9). Total num frames: 83124224. Throughput: 0: 9592.9. Samples: 83122128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:58:41,005][124505] Avg episode reward: [(0, '4565.852')] [2023-03-12 03:58:43,433][124793] Updated weights for policy 0, policy_version 162400 (0.0005) [2023-03-12 03:58:46,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9524.9). Total num frames: 83169280. Throughput: 0: 9585.7. Samples: 83150232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:58:46,005][124505] Avg episode reward: [(0, '4557.380')] [2023-03-12 03:58:47,879][124793] Updated weights for policy 0, policy_version 162480 (0.0005) [2023-03-12 03:58:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9524.9). Total num frames: 83218432. Throughput: 0: 9517.9. Samples: 83206208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:58:51,005][124505] Avg episode reward: [(0, '4579.326')] [2023-03-12 03:58:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000162536_83218432.pth... [2023-03-12 03:58:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000161976_82931712.pth [2023-03-12 03:58:52,058][124793] Updated weights for policy 0, policy_version 162560 (0.0005) [2023-03-12 03:58:56,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9524.9). Total num frames: 83267584. Throughput: 0: 9546.9. Samples: 83263672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:58:56,005][124505] Avg episode reward: [(0, '4583.695')] [2023-03-12 03:58:56,452][124793] Updated weights for policy 0, policy_version 162640 (0.0005) [2023-03-12 03:59:00,956][124793] Updated weights for policy 0, policy_version 162720 (0.0005) [2023-03-12 03:59:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9511.1). Total num frames: 83312640. Throughput: 0: 9523.4. Samples: 83291900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:59:01,005][124505] Avg episode reward: [(0, '4587.050')] [2023-03-12 03:59:05,408][124793] Updated weights for policy 0, policy_version 162800 (0.0005) [2023-03-12 03:59:06,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9511.0). Total num frames: 83357696. Throughput: 0: 9449.0. Samples: 83345864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:59:06,005][124505] Avg episode reward: [(0, '4580.312')] [2023-03-12 03:59:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000162808_83357696.pth... [2023-03-12 03:59:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000162256_83075072.pth [2023-03-12 03:59:09,869][124793] Updated weights for policy 0, policy_version 162880 (0.0005) [2023-03-12 03:59:11,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9497.2). Total num frames: 83402752. Throughput: 0: 9387.1. Samples: 83401404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:59:11,005][124505] Avg episode reward: [(0, '4584.595')] [2023-03-12 03:59:14,293][124793] Updated weights for policy 0, policy_version 162960 (0.0006) [2023-03-12 03:59:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9511.1). Total num frames: 83451904. Throughput: 0: 9354.6. Samples: 83428976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:59:16,005][124505] Avg episode reward: [(0, '4573.999')] [2023-03-12 03:59:18,472][124793] Updated weights for policy 0, policy_version 163040 (0.0005) [2023-03-12 03:59:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9524.9). Total num frames: 83501056. Throughput: 0: 9411.7. Samples: 83487356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:59:21,005][124505] Avg episode reward: [(0, '4584.104')] [2023-03-12 03:59:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000163088_83501056.pth... [2023-03-12 03:59:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000162536_83218432.pth [2023-03-12 03:59:22,652][124793] Updated weights for policy 0, policy_version 163120 (0.0005) [2023-03-12 03:59:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9524.9). Total num frames: 83550208. Throughput: 0: 9422.1. Samples: 83546124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:59:26,005][124505] Avg episode reward: [(0, '4577.407')] [2023-03-12 03:59:26,835][124793] Updated weights for policy 0, policy_version 163200 (0.0005) [2023-03-12 03:59:30,957][124793] Updated weights for policy 0, policy_version 163280 (0.0004) [2023-03-12 03:59:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9538.8). Total num frames: 83599360. Throughput: 0: 9453.9. Samples: 83575656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:59:31,005][124505] Avg episode reward: [(0, '4596.086')] [2023-03-12 03:59:35,142][124793] Updated weights for policy 0, policy_version 163360 (0.0005) [2023-03-12 03:59:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9524.9). Total num frames: 83644416. Throughput: 0: 9533.1. Samples: 83635196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:59:36,005][124505] Avg episode reward: [(0, '4582.176')] [2023-03-12 03:59:36,016][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000163376_83648512.pth... [2023-03-12 03:59:36,018][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000162808_83357696.pth [2023-03-12 03:59:39,375][124793] Updated weights for policy 0, policy_version 163440 (0.0005) [2023-03-12 03:59:41,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9524.9). Total num frames: 83693568. Throughput: 0: 9547.8. Samples: 83693324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:59:41,005][124505] Avg episode reward: [(0, '4590.465')] [2023-03-12 03:59:43,568][124793] Updated weights for policy 0, policy_version 163520 (0.0005) [2023-03-12 03:59:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9557.3, 300 sec: 9538.8). Total num frames: 83742720. Throughput: 0: 9564.5. Samples: 83722304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:59:46,005][124505] Avg episode reward: [(0, '4585.244')] [2023-03-12 03:59:47,724][124793] Updated weights for policy 0, policy_version 163600 (0.0004) [2023-03-12 03:59:51,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9538.8). Total num frames: 83791872. Throughput: 0: 9666.8. Samples: 83780868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:59:51,005][124505] Avg episode reward: [(0, '4595.000')] [2023-03-12 03:59:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000163656_83791872.pth... [2023-03-12 03:59:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000163088_83501056.pth [2023-03-12 03:59:52,024][124793] Updated weights for policy 0, policy_version 163680 (0.0005) [2023-03-12 03:59:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9538.8). Total num frames: 83836928. Throughput: 0: 9663.7. Samples: 83836272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 03:59:56,005][124505] Avg episode reward: [(0, '4597.715')] [2023-03-12 03:59:56,584][124793] Updated weights for policy 0, policy_version 163760 (0.0006) [2023-03-12 04:00:01,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9524.9). Total num frames: 83881984. Throughput: 0: 9648.4. Samples: 83863152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:00:01,005][124505] Avg episode reward: [(0, '4597.145')] [2023-03-12 04:00:01,113][124793] Updated weights for policy 0, policy_version 163840 (0.0005) [2023-03-12 04:00:05,347][124793] Updated weights for policy 0, policy_version 163920 (0.0005) [2023-03-12 04:00:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9538.8). Total num frames: 83931136. Throughput: 0: 9606.9. Samples: 83919668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:00:06,005][124505] Avg episode reward: [(0, '4591.645')] [2023-03-12 04:00:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000163928_83931136.pth... [2023-03-12 04:00:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000163376_83648512.pth [2023-03-12 04:00:09,564][124793] Updated weights for policy 0, policy_version 164000 (0.0005) [2023-03-12 04:00:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9552.7). Total num frames: 83980288. Throughput: 0: 9603.7. Samples: 83978292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:00:11,006][124505] Avg episode reward: [(0, '4582.701')] [2023-03-12 04:00:13,766][124793] Updated weights for policy 0, policy_version 164080 (0.0005) [2023-03-12 04:00:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9552.7). Total num frames: 84029440. Throughput: 0: 9590.2. Samples: 84007216. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:00:16,005][124505] Avg episode reward: [(0, '4584.070')] [2023-03-12 04:00:17,886][124793] Updated weights for policy 0, policy_version 164160 (0.0005) [2023-03-12 04:00:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9566.6). Total num frames: 84078592. Throughput: 0: 9583.4. Samples: 84066448. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:00:21,005][124505] Avg episode reward: [(0, '4583.318')] [2023-03-12 04:00:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000164216_84078592.pth... [2023-03-12 04:00:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000163656_83791872.pth [2023-03-12 04:00:22,030][124793] Updated weights for policy 0, policy_version 164240 (0.0005) [2023-03-12 04:00:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9566.6). Total num frames: 84127744. Throughput: 0: 9608.0. Samples: 84125684. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:00:26,016][124505] Avg episode reward: [(0, '4588.129')] [2023-03-12 04:00:26,193][124793] Updated weights for policy 0, policy_version 164320 (0.0005) [2023-03-12 04:00:30,344][124793] Updated weights for policy 0, policy_version 164400 (0.0005) [2023-03-12 04:00:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9580.5). Total num frames: 84176896. Throughput: 0: 9628.4. Samples: 84155584. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:00:31,005][124505] Avg episode reward: [(0, '4589.420')] [2023-03-12 04:00:34,720][124793] Updated weights for policy 0, policy_version 164480 (0.0005) [2023-03-12 04:00:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9594.4). Total num frames: 84226048. Throughput: 0: 9588.8. Samples: 84212364. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:00:36,005][124505] Avg episode reward: [(0, '4585.627')] [2023-03-12 04:00:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000164504_84226048.pth... [2023-03-12 04:00:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000163928_83931136.pth [2023-03-12 04:00:38,880][124793] Updated weights for policy 0, policy_version 164560 (0.0005) [2023-03-12 04:00:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9608.2). Total num frames: 84275200. Throughput: 0: 9664.4. Samples: 84271168. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:00:41,005][124505] Avg episode reward: [(0, '4599.622')] [2023-03-12 04:00:43,072][124793] Updated weights for policy 0, policy_version 164640 (0.0004) [2023-03-12 04:00:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9608.2). Total num frames: 84324352. Throughput: 0: 9722.7. Samples: 84300672. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:00:46,005][124505] Avg episode reward: [(0, '4588.988')] [2023-03-12 04:00:47,208][124793] Updated weights for policy 0, policy_version 164720 (0.0005) [2023-03-12 04:00:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9622.1). Total num frames: 84373504. Throughput: 0: 9790.0. Samples: 84360220. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:00:51,005][124505] Avg episode reward: [(0, '4583.486')] [2023-03-12 04:00:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000164792_84373504.pth... [2023-03-12 04:00:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000164216_84078592.pth [2023-03-12 04:00:51,323][124793] Updated weights for policy 0, policy_version 164800 (0.0004) [2023-03-12 04:00:55,553][124793] Updated weights for policy 0, policy_version 164880 (0.0005) [2023-03-12 04:00:56,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9636.0). Total num frames: 84422656. Throughput: 0: 9785.3. Samples: 84418632. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:00:56,006][124505] Avg episode reward: [(0, '4572.288')] [2023-03-12 04:00:59,708][124793] Updated weights for policy 0, policy_version 164960 (0.0005) [2023-03-12 04:01:01,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9636.0). Total num frames: 84471808. Throughput: 0: 9798.2. Samples: 84448136. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:01:01,005][124505] Avg episode reward: [(0, '4584.857')] [2023-03-12 04:01:03,862][124793] Updated weights for policy 0, policy_version 165040 (0.0005) [2023-03-12 04:01:06,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9649.9). Total num frames: 84520960. Throughput: 0: 9805.9. Samples: 84507712. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:01:06,005][124505] Avg episode reward: [(0, '4590.242')] [2023-03-12 04:01:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000165080_84520960.pth... [2023-03-12 04:01:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000164504_84226048.pth [2023-03-12 04:01:08,018][124793] Updated weights for policy 0, policy_version 165120 (0.0005) [2023-03-12 04:01:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9649.9). Total num frames: 84570112. Throughput: 0: 9796.5. Samples: 84566528. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:01:11,005][124505] Avg episode reward: [(0, '4579.783')] [2023-03-12 04:01:12,166][124793] Updated weights for policy 0, policy_version 165200 (0.0004) [2023-03-12 04:01:16,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9830.4, 300 sec: 9663.8). Total num frames: 84619264. Throughput: 0: 9790.1. Samples: 84596136. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:01:16,005][124505] Avg episode reward: [(0, '4595.287')] [2023-03-12 04:01:16,376][124793] Updated weights for policy 0, policy_version 165280 (0.0005) [2023-03-12 04:01:20,668][124793] Updated weights for policy 0, policy_version 165360 (0.0005) [2023-03-12 04:01:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9649.9). Total num frames: 84664320. Throughput: 0: 9828.6. Samples: 84654652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:01:21,005][124505] Avg episode reward: [(0, '4589.491')] [2023-03-12 04:01:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000165360_84664320.pth... [2023-03-12 04:01:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000164792_84373504.pth [2023-03-12 04:01:25,200][124793] Updated weights for policy 0, policy_version 165440 (0.0005) [2023-03-12 04:01:26,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9693.9, 300 sec: 9636.0). Total num frames: 84709376. Throughput: 0: 9736.6. Samples: 84709316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:01:26,005][124505] Avg episode reward: [(0, '4584.375')] [2023-03-12 04:01:29,316][124793] Updated weights for policy 0, policy_version 165520 (0.0004) [2023-03-12 04:01:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9636.0). Total num frames: 84758528. Throughput: 0: 9746.2. Samples: 84739252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:01:31,005][124505] Avg episode reward: [(0, '4592.264')] [2023-03-12 04:01:33,752][124793] Updated weights for policy 0, policy_version 165600 (0.0005) [2023-03-12 04:01:36,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9636.0). Total num frames: 84807680. Throughput: 0: 9670.5. Samples: 84795392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:01:36,005][124505] Avg episode reward: [(0, '4593.979')] [2023-03-12 04:01:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000165640_84807680.pth... [2023-03-12 04:01:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000165080_84520960.pth [2023-03-12 04:01:38,191][124793] Updated weights for policy 0, policy_version 165680 (0.0006) [2023-03-12 04:01:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9636.0). Total num frames: 84852736. Throughput: 0: 9600.2. Samples: 84850640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:01:41,005][124505] Avg episode reward: [(0, '4586.680')] [2023-03-12 04:01:42,612][124793] Updated weights for policy 0, policy_version 165760 (0.0005) [2023-03-12 04:01:46,005][124505] Fps is (10 sec: 9011.1, 60 sec: 9557.3, 300 sec: 9622.1). Total num frames: 84897792. Throughput: 0: 9547.9. Samples: 84877792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:01:46,005][124505] Avg episode reward: [(0, '4587.058')] [2023-03-12 04:01:47,084][124793] Updated weights for policy 0, policy_version 165840 (0.0005) [2023-03-12 04:01:51,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9608.2). Total num frames: 84942848. Throughput: 0: 9445.5. Samples: 84932760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:01:51,005][124505] Avg episode reward: [(0, '4592.526')] [2023-03-12 04:01:51,015][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000165912_84946944.pth... [2023-03-12 04:01:51,016][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000165360_84664320.pth [2023-03-12 04:01:51,418][124793] Updated weights for policy 0, policy_version 165920 (0.0005) [2023-03-12 04:01:55,561][124793] Updated weights for policy 0, policy_version 166000 (0.0006) [2023-03-12 04:01:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.4, 300 sec: 9622.1). Total num frames: 84996096. Throughput: 0: 9456.5. Samples: 84992072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:01:56,005][124505] Avg episode reward: [(0, '4594.032')] [2023-03-12 04:01:59,697][124793] Updated weights for policy 0, policy_version 166080 (0.0005) [2023-03-12 04:02:01,005][124505] Fps is (10 sec: 10240.1, 60 sec: 9557.3, 300 sec: 9622.1). Total num frames: 85045248. Throughput: 0: 9462.4. Samples: 85021944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:02:01,005][124505] Avg episode reward: [(0, '4592.786')] [2023-03-12 04:02:03,999][124793] Updated weights for policy 0, policy_version 166160 (0.0005) [2023-03-12 04:02:06,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9608.2). Total num frames: 85090304. Throughput: 0: 9431.9. Samples: 85079088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:02:06,005][124505] Avg episode reward: [(0, '4588.725')] [2023-03-12 04:02:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000166192_85090304.pth... [2023-03-12 04:02:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000165640_84807680.pth [2023-03-12 04:02:08,282][124793] Updated weights for policy 0, policy_version 166240 (0.0005) [2023-03-12 04:02:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9622.1). Total num frames: 85139456. Throughput: 0: 9512.1. Samples: 85137360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:02:11,005][124505] Avg episode reward: [(0, '4592.365')] [2023-03-12 04:02:12,448][124793] Updated weights for policy 0, policy_version 166320 (0.0004) [2023-03-12 04:02:16,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9622.1). Total num frames: 85188608. Throughput: 0: 9514.7. Samples: 85167412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:02:16,005][124505] Avg episode reward: [(0, '4589.031')] [2023-03-12 04:02:16,533][124793] Updated weights for policy 0, policy_version 166400 (0.0004) [2023-03-12 04:02:20,661][124793] Updated weights for policy 0, policy_version 166480 (0.0004) [2023-03-12 04:02:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9622.1). Total num frames: 85237760. Throughput: 0: 9588.4. Samples: 85226872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:02:21,005][124505] Avg episode reward: [(0, '4580.208')] [2023-03-12 04:02:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000166480_85237760.pth... [2023-03-12 04:02:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000165912_84946944.pth [2023-03-12 04:02:24,872][124793] Updated weights for policy 0, policy_version 166560 (0.0004) [2023-03-12 04:02:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9622.1). Total num frames: 85286912. Throughput: 0: 9660.2. Samples: 85285348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:02:26,005][124505] Avg episode reward: [(0, '4601.807')] [2023-03-12 04:02:29,303][124793] Updated weights for policy 0, policy_version 166640 (0.0005) [2023-03-12 04:02:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9608.2). Total num frames: 85331968. Throughput: 0: 9677.3. Samples: 85313272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:02:31,005][124505] Avg episode reward: [(0, '4591.043')] [2023-03-12 04:02:33,535][124793] Updated weights for policy 0, policy_version 166720 (0.0005) [2023-03-12 04:02:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9608.2). Total num frames: 85381120. Throughput: 0: 9741.9. Samples: 85371144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:02:36,006][124505] Avg episode reward: [(0, '4592.898')] [2023-03-12 04:02:36,041][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000166768_85385216.pth... [2023-03-12 04:02:36,043][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000166192_85090304.pth [2023-03-12 04:02:37,730][124793] Updated weights for policy 0, policy_version 166800 (0.0005) [2023-03-12 04:02:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9608.2). Total num frames: 85430272. Throughput: 0: 9724.1. Samples: 85429656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:02:41,005][124505] Avg episode reward: [(0, '4592.268')] [2023-03-12 04:02:41,903][124793] Updated weights for policy 0, policy_version 166880 (0.0005) [2023-03-12 04:02:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9608.2). Total num frames: 85479424. Throughput: 0: 9711.3. Samples: 85458952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:02:46,005][124505] Avg episode reward: [(0, '4585.682')] [2023-03-12 04:02:46,072][124793] Updated weights for policy 0, policy_version 166960 (0.0005) [2023-03-12 04:02:50,180][124793] Updated weights for policy 0, policy_version 167040 (0.0005) [2023-03-12 04:02:51,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9608.2). Total num frames: 85528576. Throughput: 0: 9765.9. Samples: 85518556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:02:51,005][124505] Avg episode reward: [(0, '4575.258')] [2023-03-12 04:02:51,021][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000167056_85532672.pth... [2023-03-12 04:02:51,023][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000166480_85237760.pth [2023-03-12 04:02:54,450][124793] Updated weights for policy 0, policy_version 167120 (0.0005) [2023-03-12 04:02:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9622.1). Total num frames: 85577728. Throughput: 0: 9738.0. Samples: 85575572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:02:56,005][124505] Avg episode reward: [(0, '4566.577')] [2023-03-12 04:02:59,003][124793] Updated weights for policy 0, policy_version 167200 (0.0005) [2023-03-12 04:03:01,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9608.2). Total num frames: 85622784. Throughput: 0: 9665.9. Samples: 85602376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:03:01,005][124505] Avg episode reward: [(0, '4562.657')] [2023-03-12 04:03:03,571][124793] Updated weights for policy 0, policy_version 167280 (0.0005) [2023-03-12 04:03:06,005][124505] Fps is (10 sec: 9011.0, 60 sec: 9625.6, 300 sec: 9594.4). Total num frames: 85667840. Throughput: 0: 9537.3. Samples: 85656052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:03:06,006][124505] Avg episode reward: [(0, '4555.730')] [2023-03-12 04:03:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000167320_85667840.pth... [2023-03-12 04:03:06,009][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000166768_85385216.pth [2023-03-12 04:03:08,114][124793] Updated weights for policy 0, policy_version 167360 (0.0005) [2023-03-12 04:03:11,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9594.4). Total num frames: 85712896. Throughput: 0: 9458.8. Samples: 85710996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:03:11,005][124505] Avg episode reward: [(0, '4550.656')] [2023-03-12 04:03:12,608][124793] Updated weights for policy 0, policy_version 167440 (0.0005) [2023-03-12 04:03:16,005][124505] Fps is (10 sec: 9011.4, 60 sec: 9489.1, 300 sec: 9580.5). Total num frames: 85757952. Throughput: 0: 9432.0. Samples: 85737712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:03:16,006][124505] Avg episode reward: [(0, '4548.248')] [2023-03-12 04:03:17,207][124793] Updated weights for policy 0, policy_version 167520 (0.0005) [2023-03-12 04:03:21,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9566.6). Total num frames: 85803008. Throughput: 0: 9349.5. Samples: 85791872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:03:21,006][124505] Avg episode reward: [(0, '4542.964')] [2023-03-12 04:03:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000167584_85803008.pth... [2023-03-12 04:03:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000167056_85532672.pth [2023-03-12 04:03:21,717][124793] Updated weights for policy 0, policy_version 167600 (0.0005) [2023-03-12 04:03:26,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9552.7). Total num frames: 85848064. Throughput: 0: 9272.4. Samples: 85846912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:03:26,006][124505] Avg episode reward: [(0, '4542.981')] [2023-03-12 04:03:26,203][124793] Updated weights for policy 0, policy_version 167680 (0.0005) [2023-03-12 04:03:30,617][124793] Updated weights for policy 0, policy_version 167760 (0.0005) [2023-03-12 04:03:31,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9552.7). Total num frames: 85893120. Throughput: 0: 9235.8. Samples: 85874564. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:03:31,005][124505] Avg episode reward: [(0, '4503.894')] [2023-03-12 04:03:35,151][124793] Updated weights for policy 0, policy_version 167840 (0.0005) [2023-03-12 04:03:36,005][124505] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9538.8). Total num frames: 85938176. Throughput: 0: 9128.4. Samples: 85929332. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:03:36,006][124505] Avg episode reward: [(0, '4533.098')] [2023-03-12 04:03:36,047][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000167856_85942272.pth... [2023-03-12 04:03:36,049][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000167320_85667840.pth [2023-03-12 04:03:39,516][124793] Updated weights for policy 0, policy_version 167920 (0.0004) [2023-03-12 04:03:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9552.7). Total num frames: 85987328. Throughput: 0: 9104.5. Samples: 85985276. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:03:41,006][124505] Avg episode reward: [(0, '4526.182')] [2023-03-12 04:03:43,857][124793] Updated weights for policy 0, policy_version 168000 (0.0004) [2023-03-12 04:03:46,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9538.8). Total num frames: 86032384. Throughput: 0: 9135.1. Samples: 86013456. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:03:46,005][124505] Avg episode reward: [(0, '4474.322')] [2023-03-12 04:03:48,306][124793] Updated weights for policy 0, policy_version 168080 (0.0003) [2023-03-12 04:03:51,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9538.8). Total num frames: 86081536. Throughput: 0: 9183.6. Samples: 86069312. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:03:51,005][124505] Avg episode reward: [(0, '4492.551')] [2023-03-12 04:03:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000168128_86081536.pth... [2023-03-12 04:03:51,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000167584_85803008.pth [2023-03-12 04:03:52,575][124793] Updated weights for policy 0, policy_version 168160 (0.0004) [2023-03-12 04:03:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9216.0, 300 sec: 9552.7). Total num frames: 86130688. Throughput: 0: 9253.6. Samples: 86127408. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:03:56,005][124505] Avg episode reward: [(0, '4510.435')] [2023-03-12 04:03:56,803][124793] Updated weights for policy 0, policy_version 168240 (0.0004) [2023-03-12 04:04:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9552.7). Total num frames: 86175744. Throughput: 0: 9298.0. Samples: 86156120. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:04:01,005][124505] Avg episode reward: [(0, '4527.999')] [2023-03-12 04:04:01,088][124793] Updated weights for policy 0, policy_version 168320 (0.0003) [2023-03-12 04:04:05,424][124793] Updated weights for policy 0, policy_version 168400 (0.0003) [2023-03-12 04:04:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9566.6). Total num frames: 86224896. Throughput: 0: 9350.0. Samples: 86212624. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:04:06,005][124505] Avg episode reward: [(0, '4544.936')] [2023-03-12 04:04:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000168408_86224896.pth... [2023-03-12 04:04:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000167856_85942272.pth [2023-03-12 04:04:09,703][124793] Updated weights for policy 0, policy_version 168480 (0.0005) [2023-03-12 04:04:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9566.6). Total num frames: 86274048. Throughput: 0: 9410.6. Samples: 86270388. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:04:11,005][124505] Avg episode reward: [(0, '4538.182')] [2023-03-12 04:04:14,096][124793] Updated weights for policy 0, policy_version 168560 (0.0005) [2023-03-12 04:04:16,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9552.7). Total num frames: 86319104. Throughput: 0: 9423.6. Samples: 86298624. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:04:16,005][124505] Avg episode reward: [(0, '4540.157')] [2023-03-12 04:04:18,640][124793] Updated weights for policy 0, policy_version 168640 (0.0005) [2023-03-12 04:04:21,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9538.8). Total num frames: 86364160. Throughput: 0: 9391.2. Samples: 86351936. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:04:21,005][124505] Avg episode reward: [(0, '4518.645')] [2023-03-12 04:04:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000168680_86364160.pth... [2023-03-12 04:04:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000168128_86081536.pth [2023-03-12 04:04:23,156][124793] Updated weights for policy 0, policy_version 168720 (0.0005) [2023-03-12 04:04:26,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9524.9). Total num frames: 86409216. Throughput: 0: 9386.7. Samples: 86407676. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:04:26,005][124505] Avg episode reward: [(0, '4567.013')] [2023-03-12 04:04:27,575][124793] Updated weights for policy 0, policy_version 168800 (0.0005) [2023-03-12 04:04:31,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9524.9). Total num frames: 86454272. Throughput: 0: 9365.8. Samples: 86434916. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:04:31,005][124505] Avg episode reward: [(0, '4572.114')] [2023-03-12 04:04:31,988][124793] Updated weights for policy 0, policy_version 168880 (0.0005) [2023-03-12 04:04:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 86503424. Throughput: 0: 9387.6. Samples: 86491756. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:04:36,005][124505] Avg episode reward: [(0, '4580.675')] [2023-03-12 04:04:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000168952_86503424.pth... [2023-03-12 04:04:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000168408_86224896.pth [2023-03-12 04:04:36,201][124793] Updated weights for policy 0, policy_version 168960 (0.0005) [2023-03-12 04:04:40,387][124793] Updated weights for policy 0, policy_version 169040 (0.0005) [2023-03-12 04:04:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 86552576. Throughput: 0: 9401.9. Samples: 86550492. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:04:41,005][124505] Avg episode reward: [(0, '4594.630')] [2023-03-12 04:04:44,657][124793] Updated weights for policy 0, policy_version 169120 (0.0005) [2023-03-12 04:04:46,005][124505] Fps is (10 sec: 9830.6, 60 sec: 9489.1, 300 sec: 9524.9). Total num frames: 86601728. Throughput: 0: 9413.4. Samples: 86579724. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:04:46,005][124505] Avg episode reward: [(0, '4579.192')] [2023-03-12 04:04:49,093][124793] Updated weights for policy 0, policy_version 169200 (0.0005) [2023-03-12 04:04:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 86646784. Throughput: 0: 9376.5. Samples: 86634568. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:04:51,005][124505] Avg episode reward: [(0, '4579.451')] [2023-03-12 04:04:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000169232_86646784.pth... [2023-03-12 04:04:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000168680_86364160.pth [2023-03-12 04:04:53,418][124793] Updated weights for policy 0, policy_version 169280 (0.0005) [2023-03-12 04:04:56,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9538.8). Total num frames: 86695936. Throughput: 0: 9377.6. Samples: 86692380. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:04:56,005][124505] Avg episode reward: [(0, '4569.697')] [2023-03-12 04:04:57,594][124793] Updated weights for policy 0, policy_version 169360 (0.0004) [2023-03-12 04:05:01,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9538.8). Total num frames: 86745088. Throughput: 0: 9411.3. Samples: 86722132. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:05:01,005][124505] Avg episode reward: [(0, '4573.557')] [2023-03-12 04:05:01,772][124793] Updated weights for policy 0, policy_version 169440 (0.0005) [2023-03-12 04:05:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 86790144. Throughput: 0: 9477.0. Samples: 86778400. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:05:06,005][124505] Avg episode reward: [(0, '4583.411')] [2023-03-12 04:05:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000169512_86790144.pth... [2023-03-12 04:05:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000168952_86503424.pth [2023-03-12 04:05:06,304][124793] Updated weights for policy 0, policy_version 169520 (0.0005) [2023-03-12 04:05:10,784][124793] Updated weights for policy 0, policy_version 169600 (0.0005) [2023-03-12 04:05:11,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9511.1). Total num frames: 86835200. Throughput: 0: 9465.9. Samples: 86833640. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:05:11,005][124505] Avg episode reward: [(0, '4562.644')] [2023-03-12 04:05:15,200][124793] Updated weights for policy 0, policy_version 169680 (0.0005) [2023-03-12 04:05:16,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9497.2). Total num frames: 86880256. Throughput: 0: 9466.6. Samples: 86860912. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:05:16,005][124505] Avg episode reward: [(0, '4567.805')] [2023-03-12 04:05:19,636][124793] Updated weights for policy 0, policy_version 169760 (0.0005) [2023-03-12 04:05:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9497.2). Total num frames: 86929408. Throughput: 0: 9452.5. Samples: 86917120. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:05:21,005][124505] Avg episode reward: [(0, '4585.949')] [2023-03-12 04:05:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000169784_86929408.pth... [2023-03-12 04:05:21,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000169232_86646784.pth [2023-03-12 04:05:24,012][124793] Updated weights for policy 0, policy_version 169840 (0.0005) [2023-03-12 04:05:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9483.3). Total num frames: 86974464. Throughput: 0: 9377.7. Samples: 86972488. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:05:26,005][124505] Avg episode reward: [(0, '4560.572')] [2023-03-12 04:05:28,289][124793] Updated weights for policy 0, policy_version 169920 (0.0005) [2023-03-12 04:05:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9483.3). Total num frames: 87023616. Throughput: 0: 9383.7. Samples: 87001992. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:05:31,005][124505] Avg episode reward: [(0, '4579.172')] [2023-03-12 04:05:32,487][124793] Updated weights for policy 0, policy_version 170000 (0.0005) [2023-03-12 04:05:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 87068672. Throughput: 0: 9447.8. Samples: 87059720. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 04:05:36,005][124505] Avg episode reward: [(0, '4585.604')] [2023-03-12 04:05:36,007][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000170056_87068672.pth... [2023-03-12 04:05:36,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000169512_86790144.pth [2023-03-12 04:05:36,944][124793] Updated weights for policy 0, policy_version 170080 (0.0005) [2023-03-12 04:05:41,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 87117824. Throughput: 0: 9404.4. Samples: 87115576. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:05:41,005][124505] Avg episode reward: [(0, '4575.137')] [2023-03-12 04:05:41,264][124793] Updated weights for policy 0, policy_version 170160 (0.0005) [2023-03-12 04:05:45,629][124793] Updated weights for policy 0, policy_version 170240 (0.0005) [2023-03-12 04:05:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 87162880. Throughput: 0: 9362.9. Samples: 87143464. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:05:46,005][124505] Avg episode reward: [(0, '4567.444')] [2023-03-12 04:05:50,125][124793] Updated weights for policy 0, policy_version 170320 (0.0005) [2023-03-12 04:05:51,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9352.6, 300 sec: 9441.6). Total num frames: 87207936. Throughput: 0: 9356.3. Samples: 87199432. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:05:51,005][124505] Avg episode reward: [(0, '4546.557')] [2023-03-12 04:05:51,042][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000170336_87212032.pth... [2023-03-12 04:05:51,044][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000169784_86929408.pth [2023-03-12 04:05:54,608][124793] Updated weights for policy 0, policy_version 170400 (0.0005) [2023-03-12 04:05:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9441.6). Total num frames: 87257088. Throughput: 0: 9336.6. Samples: 87253788. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:05:56,005][124505] Avg episode reward: [(0, '4590.425')] [2023-03-12 04:05:59,027][124793] Updated weights for policy 0, policy_version 170480 (0.0005) [2023-03-12 04:06:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9427.7). Total num frames: 87302144. Throughput: 0: 9351.5. Samples: 87281728. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:06:01,005][124505] Avg episode reward: [(0, '4528.460')] [2023-03-12 04:06:03,372][124793] Updated weights for policy 0, policy_version 170560 (0.0005) [2023-03-12 04:06:06,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9413.9). Total num frames: 87347200. Throughput: 0: 9355.2. Samples: 87338104. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:06:06,005][124505] Avg episode reward: [(0, '4569.943')] [2023-03-12 04:06:06,007][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000170600_87347200.pth... [2023-03-12 04:06:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000170056_87068672.pth [2023-03-12 04:06:07,929][124793] Updated weights for policy 0, policy_version 170640 (0.0005) [2023-03-12 04:06:11,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 87396352. Throughput: 0: 9354.6. Samples: 87393444. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:06:11,005][124505] Avg episode reward: [(0, '4576.517')] [2023-03-12 04:06:12,112][124793] Updated weights for policy 0, policy_version 170720 (0.0005) [2023-03-12 04:06:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 87445504. Throughput: 0: 9361.9. Samples: 87423276. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:06:16,005][124505] Avg episode reward: [(0, '4573.542')] [2023-03-12 04:06:16,293][124793] Updated weights for policy 0, policy_version 170800 (0.0004) [2023-03-12 04:06:20,468][124793] Updated weights for policy 0, policy_version 170880 (0.0005) [2023-03-12 04:06:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 87494656. Throughput: 0: 9383.8. Samples: 87481992. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:06:21,005][124505] Avg episode reward: [(0, '4575.279')] [2023-03-12 04:06:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000170888_87494656.pth... [2023-03-12 04:06:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000170336_87212032.pth [2023-03-12 04:06:24,656][124793] Updated weights for policy 0, policy_version 170960 (0.0005) [2023-03-12 04:06:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 87543808. Throughput: 0: 9450.1. Samples: 87540832. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:06:26,005][124505] Avg episode reward: [(0, '4579.240')] [2023-03-12 04:06:28,756][124793] Updated weights for policy 0, policy_version 171040 (0.0005) [2023-03-12 04:06:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 87592960. Throughput: 0: 9496.4. Samples: 87570804. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:06:31,005][124505] Avg episode reward: [(0, '4583.765')] [2023-03-12 04:06:32,853][124793] Updated weights for policy 0, policy_version 171120 (0.0004) [2023-03-12 04:06:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9455.5). Total num frames: 87642112. Throughput: 0: 9591.3. Samples: 87631040. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:06:36,005][124505] Avg episode reward: [(0, '4573.302')] [2023-03-12 04:06:36,007][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000171176_87642112.pth... [2023-03-12 04:06:36,009][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000170600_87347200.pth [2023-03-12 04:06:36,868][124793] Updated weights for policy 0, policy_version 171200 (0.0004) [2023-03-12 04:06:40,990][124793] Updated weights for policy 0, policy_version 171280 (0.0004) [2023-03-12 04:06:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9625.6, 300 sec: 9483.3). Total num frames: 87695360. Throughput: 0: 9723.1. Samples: 87691328. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:06:41,005][124505] Avg episode reward: [(0, '4571.590')] [2023-03-12 04:06:45,211][124793] Updated weights for policy 0, policy_version 171360 (0.0005) [2023-03-12 04:06:46,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9483.3). Total num frames: 87740416. Throughput: 0: 9745.1. Samples: 87720256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:06:46,005][124505] Avg episode reward: [(0, '4572.418')] [2023-03-12 04:06:49,698][124793] Updated weights for policy 0, policy_version 171440 (0.0005) [2023-03-12 04:06:51,005][124505] Fps is (10 sec: 9011.1, 60 sec: 9625.6, 300 sec: 9455.5). Total num frames: 87785472. Throughput: 0: 9742.4. Samples: 87776512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:06:51,005][124505] Avg episode reward: [(0, '4561.174')] [2023-03-12 04:06:51,059][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000171464_87789568.pth... [2023-03-12 04:06:51,061][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000170888_87494656.pth [2023-03-12 04:06:54,115][124793] Updated weights for policy 0, policy_version 171520 (0.0005) [2023-03-12 04:06:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9455.5). Total num frames: 87834624. Throughput: 0: 9745.9. Samples: 87832008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:06:56,016][124505] Avg episode reward: [(0, '4579.990')] [2023-03-12 04:06:58,310][124793] Updated weights for policy 0, policy_version 171600 (0.0004) [2023-03-12 04:07:01,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9469.4). Total num frames: 87883776. Throughput: 0: 9747.3. Samples: 87861904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:07:01,016][124505] Avg episode reward: [(0, '4567.589')] [2023-03-12 04:07:02,499][124793] Updated weights for policy 0, policy_version 171680 (0.0004) [2023-03-12 04:07:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9469.4). Total num frames: 87932928. Throughput: 0: 9749.3. Samples: 87920712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:07:06,005][124505] Avg episode reward: [(0, '4576.317')] [2023-03-12 04:07:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000171744_87932928.pth... [2023-03-12 04:07:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000171176_87642112.pth [2023-03-12 04:07:06,594][124793] Updated weights for policy 0, policy_version 171760 (0.0004) [2023-03-12 04:07:10,784][124793] Updated weights for policy 0, policy_version 171840 (0.0004) [2023-03-12 04:07:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9469.4). Total num frames: 87982080. Throughput: 0: 9761.3. Samples: 87980092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:07:11,005][124505] Avg episode reward: [(0, '4581.295')] [2023-03-12 04:07:15,038][124793] Updated weights for policy 0, policy_version 171920 (0.0005) [2023-03-12 04:07:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9469.4). Total num frames: 88031232. Throughput: 0: 9739.4. Samples: 88009076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:07:16,005][124505] Avg episode reward: [(0, '4590.279')] [2023-03-12 04:07:19,196][124793] Updated weights for policy 0, policy_version 172000 (0.0005) [2023-03-12 04:07:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9469.4). Total num frames: 88080384. Throughput: 0: 9711.3. Samples: 88068048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:07:21,005][124505] Avg episode reward: [(0, '4581.520')] [2023-03-12 04:07:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000172032_88080384.pth... [2023-03-12 04:07:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000171464_87789568.pth [2023-03-12 04:07:23,390][124793] Updated weights for policy 0, policy_version 172080 (0.0005) [2023-03-12 04:07:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9483.3). Total num frames: 88129536. Throughput: 0: 9683.3. Samples: 88127076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:07:26,005][124505] Avg episode reward: [(0, '4591.553')] [2023-03-12 04:07:27,488][124793] Updated weights for policy 0, policy_version 172160 (0.0004) [2023-03-12 04:07:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9762.1, 300 sec: 9483.3). Total num frames: 88178688. Throughput: 0: 9699.1. Samples: 88156716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:07:31,005][124505] Avg episode reward: [(0, '4585.196')] [2023-03-12 04:07:31,687][124793] Updated weights for policy 0, policy_version 172240 (0.0005) [2023-03-12 04:07:35,817][124793] Updated weights for policy 0, policy_version 172320 (0.0004) [2023-03-12 04:07:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9483.3). Total num frames: 88227840. Throughput: 0: 9757.9. Samples: 88215616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:07:36,005][124505] Avg episode reward: [(0, '4582.852')] [2023-03-12 04:07:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000172320_88227840.pth... [2023-03-12 04:07:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000171744_87932928.pth [2023-03-12 04:07:40,022][124793] Updated weights for policy 0, policy_version 172400 (0.0005) [2023-03-12 04:07:41,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9483.3). Total num frames: 88276992. Throughput: 0: 9825.6. Samples: 88274160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:07:41,016][124505] Avg episode reward: [(0, '4588.601')] [2023-03-12 04:07:44,170][124793] Updated weights for policy 0, policy_version 172480 (0.0004) [2023-03-12 04:07:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9483.3). Total num frames: 88326144. Throughput: 0: 9817.1. Samples: 88303676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:07:46,016][124505] Avg episode reward: [(0, '4586.448')] [2023-03-12 04:07:48,246][124793] Updated weights for policy 0, policy_version 172560 (0.0004) [2023-03-12 04:07:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9483.3). Total num frames: 88375296. Throughput: 0: 9845.2. Samples: 88363744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:07:51,016][124505] Avg episode reward: [(0, '4587.634')] [2023-03-12 04:07:51,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000172608_88375296.pth... [2023-03-12 04:07:51,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000172032_88080384.pth [2023-03-12 04:07:52,361][124793] Updated weights for policy 0, policy_version 172640 (0.0004) [2023-03-12 04:07:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9497.2). Total num frames: 88424448. Throughput: 0: 9853.0. Samples: 88423476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:07:56,016][124505] Avg episode reward: [(0, '4575.577')] [2023-03-12 04:07:56,548][124793] Updated weights for policy 0, policy_version 172720 (0.0005) [2023-03-12 04:08:00,707][124793] Updated weights for policy 0, policy_version 172800 (0.0004) [2023-03-12 04:08:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9511.1). Total num frames: 88473600. Throughput: 0: 9869.1. Samples: 88453184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:08:01,016][124505] Avg episode reward: [(0, '4586.899')] [2023-03-12 04:08:05,139][124793] Updated weights for policy 0, policy_version 172880 (0.0005) [2023-03-12 04:08:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9511.1). Total num frames: 88518656. Throughput: 0: 9822.9. Samples: 88510080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:08:06,016][124505] Avg episode reward: [(0, '4582.804')] [2023-03-12 04:08:06,018][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000172896_88522752.pth... [2023-03-12 04:08:06,020][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000172320_88227840.pth [2023-03-12 04:08:09,547][124793] Updated weights for policy 0, policy_version 172960 (0.0005) [2023-03-12 04:08:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9524.9). Total num frames: 88567808. Throughput: 0: 9742.0. Samples: 88565464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:08:11,016][124505] Avg episode reward: [(0, '4576.179')] [2023-03-12 04:08:13,868][124793] Updated weights for policy 0, policy_version 173040 (0.0005) [2023-03-12 04:08:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9524.9). Total num frames: 88612864. Throughput: 0: 9713.3. Samples: 88593816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:08:16,016][124505] Avg episode reward: [(0, '4588.991')] [2023-03-12 04:08:18,383][124793] Updated weights for policy 0, policy_version 173120 (0.0005) [2023-03-12 04:08:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9538.8). Total num frames: 88662016. Throughput: 0: 9637.4. Samples: 88649300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:08:21,005][124505] Avg episode reward: [(0, '4588.135')] [2023-03-12 04:08:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000173168_88662016.pth... [2023-03-12 04:08:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000172608_88375296.pth [2023-03-12 04:08:22,789][124793] Updated weights for policy 0, policy_version 173200 (0.0005) [2023-03-12 04:08:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9538.8). Total num frames: 88707072. Throughput: 0: 9552.1. Samples: 88704004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:08:26,005][124505] Avg episode reward: [(0, '4592.992')] [2023-03-12 04:08:27,225][124793] Updated weights for policy 0, policy_version 173280 (0.0005) [2023-03-12 04:08:31,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9538.8). Total num frames: 88752128. Throughput: 0: 9511.9. Samples: 88731712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:08:31,005][124505] Avg episode reward: [(0, '4589.381')] [2023-03-12 04:08:31,733][124793] Updated weights for policy 0, policy_version 173360 (0.0005) [2023-03-12 04:08:36,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9524.9). Total num frames: 88797184. Throughput: 0: 9407.4. Samples: 88787076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:08:36,005][124505] Avg episode reward: [(0, '4593.175')] [2023-03-12 04:08:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000173432_88797184.pth... [2023-03-12 04:08:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000172896_88522752.pth [2023-03-12 04:08:36,125][124793] Updated weights for policy 0, policy_version 173440 (0.0005) [2023-03-12 04:08:40,601][124793] Updated weights for policy 0, policy_version 173520 (0.0005) [2023-03-12 04:08:41,005][124505] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 88842240. Throughput: 0: 9306.1. Samples: 88842252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:08:41,005][124505] Avg episode reward: [(0, '4590.998')] [2023-03-12 04:08:44,986][124793] Updated weights for policy 0, policy_version 173600 (0.0005) [2023-03-12 04:08:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 88891392. Throughput: 0: 9268.9. Samples: 88870284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:08:46,005][124505] Avg episode reward: [(0, '4587.626')] [2023-03-12 04:08:49,427][124793] Updated weights for policy 0, policy_version 173680 (0.0005) [2023-03-12 04:08:51,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9511.0). Total num frames: 88936448. Throughput: 0: 9236.6. Samples: 88925728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:08:51,005][124505] Avg episode reward: [(0, '4582.909')] [2023-03-12 04:08:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000173704_88936448.pth... [2023-03-12 04:08:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000173168_88662016.pth [2023-03-12 04:08:53,913][124793] Updated weights for policy 0, policy_version 173760 (0.0005) [2023-03-12 04:08:56,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9511.1). Total num frames: 88981504. Throughput: 0: 9229.2. Samples: 88980780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:08:56,005][124505] Avg episode reward: [(0, '4585.187')] [2023-03-12 04:08:58,324][124793] Updated weights for policy 0, policy_version 173840 (0.0005) [2023-03-12 04:09:01,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9511.1). Total num frames: 89030656. Throughput: 0: 9217.4. Samples: 89008600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:09:01,005][124505] Avg episode reward: [(0, '4583.709')] [2023-03-12 04:09:02,552][124793] Updated weights for policy 0, policy_version 173920 (0.0004) [2023-03-12 04:09:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9511.0). Total num frames: 89079808. Throughput: 0: 9294.0. Samples: 89067532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:09:06,005][124505] Avg episode reward: [(0, '4588.269')] [2023-03-12 04:09:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000173984_89079808.pth... [2023-03-12 04:09:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000173432_88797184.pth [2023-03-12 04:09:06,736][124793] Updated weights for policy 0, policy_version 174000 (0.0004) [2023-03-12 04:09:10,991][124793] Updated weights for policy 0, policy_version 174080 (0.0004) [2023-03-12 04:09:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9524.9). Total num frames: 89128960. Throughput: 0: 9353.9. Samples: 89124928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:09:11,005][124505] Avg episode reward: [(0, '4588.497')] [2023-03-12 04:09:15,255][124793] Updated weights for policy 0, policy_version 174160 (0.0003) [2023-03-12 04:09:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9524.9). Total num frames: 89174016. Throughput: 0: 9385.7. Samples: 89154068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:09:16,005][124505] Avg episode reward: [(0, '4589.208')] [2023-03-12 04:09:19,509][124793] Updated weights for policy 0, policy_version 174240 (0.0004) [2023-03-12 04:09:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9538.8). Total num frames: 89223168. Throughput: 0: 9429.5. Samples: 89211404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:09:21,005][124505] Avg episode reward: [(0, '4589.045')] [2023-03-12 04:09:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000174264_89223168.pth... [2023-03-12 04:09:21,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000173704_88936448.pth [2023-03-12 04:09:23,724][124793] Updated weights for policy 0, policy_version 174320 (0.0004) [2023-03-12 04:09:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9552.7). Total num frames: 89272320. Throughput: 0: 9484.3. Samples: 89269044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:09:26,005][124505] Avg episode reward: [(0, '4585.995')] [2023-03-12 04:09:28,170][124793] Updated weights for policy 0, policy_version 174400 (0.0005) [2023-03-12 04:09:31,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9538.8). Total num frames: 89317376. Throughput: 0: 9480.3. Samples: 89296896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:09:31,005][124505] Avg episode reward: [(0, '4590.660')] [2023-03-12 04:09:32,545][124793] Updated weights for policy 0, policy_version 174480 (0.0005) [2023-03-12 04:09:36,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 89362432. Throughput: 0: 9498.1. Samples: 89353140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:09:36,005][124505] Avg episode reward: [(0, '4583.203')] [2023-03-12 04:09:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000174536_89362432.pth... [2023-03-12 04:09:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000173984_89079808.pth [2023-03-12 04:09:36,951][124793] Updated weights for policy 0, policy_version 174560 (0.0005) [2023-03-12 04:09:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9524.9). Total num frames: 89411584. Throughput: 0: 9494.7. Samples: 89408040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:09:41,005][124505] Avg episode reward: [(0, '4597.890')] [2023-03-12 04:09:41,385][124793] Updated weights for policy 0, policy_version 174640 (0.0005) [2023-03-12 04:09:45,713][124793] Updated weights for policy 0, policy_version 174720 (0.0005) [2023-03-12 04:09:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 89456640. Throughput: 0: 9502.8. Samples: 89436224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:09:46,005][124505] Avg episode reward: [(0, '4588.776')] [2023-03-12 04:09:50,129][124793] Updated weights for policy 0, policy_version 174800 (0.0005) [2023-03-12 04:09:51,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9511.1). Total num frames: 89501696. Throughput: 0: 9452.7. Samples: 89492904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:09:51,005][124505] Avg episode reward: [(0, '4577.378')] [2023-03-12 04:09:51,028][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000174816_89505792.pth... [2023-03-12 04:09:51,029][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000174264_89223168.pth [2023-03-12 04:09:54,508][124793] Updated weights for policy 0, policy_version 174880 (0.0005) [2023-03-12 04:09:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9511.1). Total num frames: 89550848. Throughput: 0: 9414.3. Samples: 89548572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:09:56,005][124505] Avg episode reward: [(0, '4587.132')] [2023-03-12 04:09:58,929][124793] Updated weights for policy 0, policy_version 174960 (0.0005) [2023-03-12 04:10:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9511.1). Total num frames: 89595904. Throughput: 0: 9383.5. Samples: 89576324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:10:01,005][124505] Avg episode reward: [(0, '4580.294')] [2023-03-12 04:10:03,335][124793] Updated weights for policy 0, policy_version 175040 (0.0005) [2023-03-12 04:10:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 89645056. Throughput: 0: 9355.5. Samples: 89632400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:10:06,005][124505] Avg episode reward: [(0, '4583.954')] [2023-03-12 04:10:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000175088_89645056.pth... [2023-03-12 04:10:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000174536_89362432.pth [2023-03-12 04:10:07,748][124793] Updated weights for policy 0, policy_version 175120 (0.0005) [2023-03-12 04:10:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9524.9). Total num frames: 89690112. Throughput: 0: 9315.0. Samples: 89688220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:10:11,005][124505] Avg episode reward: [(0, '4590.913')] [2023-03-12 04:10:12,104][124793] Updated weights for policy 0, policy_version 175200 (0.0005) [2023-03-12 04:10:16,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9511.1). Total num frames: 89735168. Throughput: 0: 9310.8. Samples: 89715880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:10:16,005][124505] Avg episode reward: [(0, '4592.145')] [2023-03-12 04:10:16,474][124793] Updated weights for policy 0, policy_version 175280 (0.0005) [2023-03-12 04:10:20,906][124793] Updated weights for policy 0, policy_version 175360 (0.0005) [2023-03-12 04:10:21,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9524.9). Total num frames: 89784320. Throughput: 0: 9309.0. Samples: 89772044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:10:21,005][124505] Avg episode reward: [(0, '4582.267')] [2023-03-12 04:10:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000175360_89784320.pth... [2023-03-12 04:10:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000174816_89505792.pth [2023-03-12 04:10:25,348][124793] Updated weights for policy 0, policy_version 175440 (0.0005) [2023-03-12 04:10:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9511.1). Total num frames: 89829376. Throughput: 0: 9322.3. Samples: 89827544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:10:26,005][124505] Avg episode reward: [(0, '4583.334')] [2023-03-12 04:10:29,743][124793] Updated weights for policy 0, policy_version 175520 (0.0005) [2023-03-12 04:10:31,005][124505] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9511.0). Total num frames: 89874432. Throughput: 0: 9308.2. Samples: 89855092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:10:31,006][124505] Avg episode reward: [(0, '4589.314')] [2023-03-12 04:10:34,152][124793] Updated weights for policy 0, policy_version 175600 (0.0005) [2023-03-12 04:10:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9511.0). Total num frames: 89923584. Throughput: 0: 9299.0. Samples: 89911360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:10:36,005][124505] Avg episode reward: [(0, '4586.835')] [2023-03-12 04:10:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000175632_89923584.pth... [2023-03-12 04:10:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000175088_89645056.pth [2023-03-12 04:10:38,548][124793] Updated weights for policy 0, policy_version 175680 (0.0005) [2023-03-12 04:10:41,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9511.0). Total num frames: 89968640. Throughput: 0: 9302.5. Samples: 89967184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:10:41,005][124505] Avg episode reward: [(0, '4592.148')] [2023-03-12 04:10:42,925][124793] Updated weights for policy 0, policy_version 175760 (0.0005) [2023-03-12 04:10:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9524.9). Total num frames: 90017792. Throughput: 0: 9320.4. Samples: 89995740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:10:46,005][124505] Avg episode reward: [(0, '4577.421')] [2023-03-12 04:10:47,223][124793] Updated weights for policy 0, policy_version 175840 (0.0005) [2023-03-12 04:10:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9511.0). Total num frames: 90062848. Throughput: 0: 9313.5. Samples: 90051508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:10:51,005][124505] Avg episode reward: [(0, '4582.585')] [2023-03-12 04:10:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000175904_90062848.pth... [2023-03-12 04:10:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000175360_89784320.pth [2023-03-12 04:10:51,584][124793] Updated weights for policy 0, policy_version 175920 (0.0005) [2023-03-12 04:10:55,963][124793] Updated weights for policy 0, policy_version 176000 (0.0005) [2023-03-12 04:10:56,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9524.9). Total num frames: 90112000. Throughput: 0: 9331.2. Samples: 90108124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:10:56,016][124505] Avg episode reward: [(0, '4583.516')] [2023-03-12 04:11:00,421][124793] Updated weights for policy 0, policy_version 176080 (0.0005) [2023-03-12 04:11:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9524.9). Total num frames: 90157056. Throughput: 0: 9349.1. Samples: 90136592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:11:01,007][124505] Avg episode reward: [(0, '4588.239')] [2023-03-12 04:11:04,768][124793] Updated weights for policy 0, policy_version 176160 (0.0004) [2023-03-12 04:11:06,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9511.1). Total num frames: 90202112. Throughput: 0: 9342.9. Samples: 90192476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:11:06,016][124505] Avg episode reward: [(0, '4566.547')] [2023-03-12 04:11:06,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000176176_90202112.pth... [2023-03-12 04:11:06,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000175632_89923584.pth [2023-03-12 04:11:09,248][124793] Updated weights for policy 0, policy_version 176240 (0.0005) [2023-03-12 04:11:11,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9497.2). Total num frames: 90247168. Throughput: 0: 9326.4. Samples: 90247232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:11:11,016][124505] Avg episode reward: [(0, '4575.299')] [2023-03-12 04:11:13,700][124793] Updated weights for policy 0, policy_version 176320 (0.0005) [2023-03-12 04:11:16,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9497.2). Total num frames: 90296320. Throughput: 0: 9338.1. Samples: 90275304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:11:16,005][124505] Avg episode reward: [(0, '4569.818')] [2023-03-12 04:11:18,164][124793] Updated weights for policy 0, policy_version 176400 (0.0005) [2023-03-12 04:11:21,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9483.3). Total num frames: 90341376. Throughput: 0: 9297.2. Samples: 90329736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:11:21,016][124505] Avg episode reward: [(0, '4567.165')] [2023-03-12 04:11:21,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000176448_90341376.pth... [2023-03-12 04:11:21,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000175904_90062848.pth [2023-03-12 04:11:22,601][124793] Updated weights for policy 0, policy_version 176480 (0.0005) [2023-03-12 04:11:26,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9469.4). Total num frames: 90386432. Throughput: 0: 9305.0. Samples: 90385908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:11:26,016][124505] Avg episode reward: [(0, '4580.116')] [2023-03-12 04:11:26,969][124793] Updated weights for policy 0, policy_version 176560 (0.0005) [2023-03-12 04:11:31,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9469.4). Total num frames: 90435584. Throughput: 0: 9295.2. Samples: 90414024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:11:31,015][124505] Avg episode reward: [(0, '4574.065')] [2023-03-12 04:11:31,268][124793] Updated weights for policy 0, policy_version 176640 (0.0005) [2023-03-12 04:11:35,473][124793] Updated weights for policy 0, policy_version 176720 (0.0005) [2023-03-12 04:11:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 90484736. Throughput: 0: 9344.2. Samples: 90471996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:11:36,016][124505] Avg episode reward: [(0, '4572.846')] [2023-03-12 04:11:36,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000176728_90484736.pth... [2023-03-12 04:11:36,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000176176_90202112.pth [2023-03-12 04:11:39,804][124793] Updated weights for policy 0, policy_version 176800 (0.0005) [2023-03-12 04:11:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 90529792. Throughput: 0: 9364.0. Samples: 90529504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:11:41,016][124505] Avg episode reward: [(0, '4578.384')] [2023-03-12 04:11:43,892][124793] Updated weights for policy 0, policy_version 176880 (0.0005) [2023-03-12 04:11:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9483.3). Total num frames: 90583040. Throughput: 0: 9391.2. Samples: 90559196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:11:46,016][124505] Avg episode reward: [(0, '4574.863')] [2023-03-12 04:11:48,088][124793] Updated weights for policy 0, policy_version 176960 (0.0005) [2023-03-12 04:11:51,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9489.1, 300 sec: 9483.3). Total num frames: 90632192. Throughput: 0: 9471.9. Samples: 90618712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:11:51,016][124505] Avg episode reward: [(0, '4568.059')] [2023-03-12 04:11:51,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000177016_90632192.pth... [2023-03-12 04:11:51,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000176448_90341376.pth [2023-03-12 04:11:52,317][124793] Updated weights for policy 0, policy_version 177040 (0.0005) [2023-03-12 04:11:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 90677248. Throughput: 0: 9512.1. Samples: 90675276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:11:56,016][124505] Avg episode reward: [(0, '4574.885')] [2023-03-12 04:11:56,689][124793] Updated weights for policy 0, policy_version 177120 (0.0005) [2023-03-12 04:12:01,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 90722304. Throughput: 0: 9502.4. Samples: 90702912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:12:01,005][124505] Avg episode reward: [(0, '4584.257')] [2023-03-12 04:12:01,176][124793] Updated weights for policy 0, policy_version 177200 (0.0005) [2023-03-12 04:12:05,641][124793] Updated weights for policy 0, policy_version 177280 (0.0005) [2023-03-12 04:12:06,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9441.6). Total num frames: 90767360. Throughput: 0: 9499.8. Samples: 90757228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:12:06,005][124505] Avg episode reward: [(0, '4546.556')] [2023-03-12 04:12:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000177280_90767360.pth... [2023-03-12 04:12:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000176728_90484736.pth [2023-03-12 04:12:09,879][124793] Updated weights for policy 0, policy_version 177360 (0.0005) [2023-03-12 04:12:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 90816512. Throughput: 0: 9550.8. Samples: 90815696. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:12:11,005][124505] Avg episode reward: [(0, '4506.233')] [2023-03-12 04:12:14,080][124793] Updated weights for policy 0, policy_version 177440 (0.0005) [2023-03-12 04:12:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9441.6). Total num frames: 90865664. Throughput: 0: 9574.2. Samples: 90844864. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:12:16,005][124505] Avg episode reward: [(0, '4486.146')] [2023-03-12 04:12:18,246][124793] Updated weights for policy 0, policy_version 177520 (0.0005) [2023-03-12 04:12:21,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9441.6). Total num frames: 90914816. Throughput: 0: 9579.3. Samples: 90903064. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:12:21,005][124505] Avg episode reward: [(0, '4550.485')] [2023-03-12 04:12:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000177568_90914816.pth... [2023-03-12 04:12:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000177016_90632192.pth [2023-03-12 04:12:22,564][124793] Updated weights for policy 0, policy_version 177600 (0.0005) [2023-03-12 04:12:26,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9427.7). Total num frames: 90959872. Throughput: 0: 9563.7. Samples: 90959872. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:12:26,005][124505] Avg episode reward: [(0, '4532.193')] [2023-03-12 04:12:26,974][124793] Updated weights for policy 0, policy_version 177680 (0.0005) [2023-03-12 04:12:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9427.7). Total num frames: 91009024. Throughput: 0: 9511.4. Samples: 90987208. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:12:31,005][124505] Avg episode reward: [(0, '4563.307')] [2023-03-12 04:12:31,399][124793] Updated weights for policy 0, policy_version 177760 (0.0005) [2023-03-12 04:12:35,745][124793] Updated weights for policy 0, policy_version 177840 (0.0005) [2023-03-12 04:12:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 91054080. Throughput: 0: 9432.6. Samples: 91043180. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:12:36,005][124505] Avg episode reward: [(0, '4579.972')] [2023-03-12 04:12:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000177840_91054080.pth... [2023-03-12 04:12:36,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000177280_90767360.pth [2023-03-12 04:12:40,179][124793] Updated weights for policy 0, policy_version 177920 (0.0005) [2023-03-12 04:12:41,005][124505] Fps is (10 sec: 9011.3, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 91099136. Throughput: 0: 9419.3. Samples: 91099144. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:12:41,005][124505] Avg episode reward: [(0, '4561.570')] [2023-03-12 04:12:44,544][124793] Updated weights for policy 0, policy_version 178000 (0.0005) [2023-03-12 04:12:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 91148288. Throughput: 0: 9433.5. Samples: 91127420. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:12:46,005][124505] Avg episode reward: [(0, '4563.946')] [2023-03-12 04:12:48,851][124793] Updated weights for policy 0, policy_version 178080 (0.0005) [2023-03-12 04:12:51,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 91197440. Throughput: 0: 9494.1. Samples: 91184464. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:12:51,015][124505] Avg episode reward: [(0, '4566.037')] [2023-03-12 04:12:51,018][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000178120_91197440.pth... [2023-03-12 04:12:51,020][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000177568_90914816.pth [2023-03-12 04:12:52,980][124793] Updated weights for policy 0, policy_version 178160 (0.0005) [2023-03-12 04:12:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 91246592. Throughput: 0: 9518.8. Samples: 91244044. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:12:56,005][124505] Avg episode reward: [(0, '4585.235')] [2023-03-12 04:12:57,094][124793] Updated weights for policy 0, policy_version 178240 (0.0005) [2023-03-12 04:13:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9413.9). Total num frames: 91295744. Throughput: 0: 9521.6. Samples: 91273336. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:13:01,005][124505] Avg episode reward: [(0, '4536.531')] [2023-03-12 04:13:01,337][124793] Updated weights for policy 0, policy_version 178320 (0.0005) [2023-03-12 04:13:05,779][124793] Updated weights for policy 0, policy_version 178400 (0.0005) [2023-03-12 04:13:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9400.0). Total num frames: 91340800. Throughput: 0: 9489.0. Samples: 91330068. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:13:06,005][124505] Avg episode reward: [(0, '4544.442')] [2023-03-12 04:13:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000178400_91340800.pth... [2023-03-12 04:13:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000177840_91054080.pth [2023-03-12 04:13:10,199][124793] Updated weights for policy 0, policy_version 178480 (0.0005) [2023-03-12 04:13:11,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 91385856. Throughput: 0: 9465.2. Samples: 91385808. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:13:11,005][124505] Avg episode reward: [(0, '4538.168')] [2023-03-12 04:13:14,513][124793] Updated weights for policy 0, policy_version 178560 (0.0005) [2023-03-12 04:13:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 91435008. Throughput: 0: 9478.0. Samples: 91413720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:13:16,005][124505] Avg episode reward: [(0, '4570.072')] [2023-03-12 04:13:18,627][124793] Updated weights for policy 0, policy_version 178640 (0.0005) [2023-03-12 04:13:21,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 91484160. Throughput: 0: 9551.7. Samples: 91473008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:13:21,005][124505] Avg episode reward: [(0, '4542.132')] [2023-03-12 04:13:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000178680_91484160.pth... [2023-03-12 04:13:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000178120_91197440.pth [2023-03-12 04:13:22,742][124793] Updated weights for policy 0, policy_version 178720 (0.0005) [2023-03-12 04:13:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9427.7). Total num frames: 91533312. Throughput: 0: 9635.1. Samples: 91532724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:13:26,005][124505] Avg episode reward: [(0, '4583.323')] [2023-03-12 04:13:26,915][124793] Updated weights for policy 0, policy_version 178800 (0.0005) [2023-03-12 04:13:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9557.3, 300 sec: 9441.6). Total num frames: 91582464. Throughput: 0: 9658.4. Samples: 91562048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:13:31,005][124505] Avg episode reward: [(0, '4572.393')] [2023-03-12 04:13:31,032][124793] Updated weights for policy 0, policy_version 178880 (0.0005) [2023-03-12 04:13:35,187][124793] Updated weights for policy 0, policy_version 178960 (0.0005) [2023-03-12 04:13:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9455.5). Total num frames: 91631616. Throughput: 0: 9719.1. Samples: 91621824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:13:36,005][124505] Avg episode reward: [(0, '4582.728')] [2023-03-12 04:13:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000178976_91635712.pth... [2023-03-12 04:13:36,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000178400_91340800.pth [2023-03-12 04:13:39,345][124793] Updated weights for policy 0, policy_version 179040 (0.0005) [2023-03-12 04:13:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9455.5). Total num frames: 91680768. Throughput: 0: 9706.4. Samples: 91680832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:13:41,005][124505] Avg episode reward: [(0, '4571.142')] [2023-03-12 04:13:43,578][124793] Updated weights for policy 0, policy_version 179120 (0.0003) [2023-03-12 04:13:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9469.4). Total num frames: 91729920. Throughput: 0: 9692.6. Samples: 91709504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:13:46,005][124505] Avg episode reward: [(0, '4572.623')] [2023-03-12 04:13:47,936][124793] Updated weights for policy 0, policy_version 179200 (0.0003) [2023-03-12 04:13:51,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9483.3). Total num frames: 91779072. Throughput: 0: 9704.7. Samples: 91766780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:13:51,005][124505] Avg episode reward: [(0, '4570.496')] [2023-03-12 04:13:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000179256_91779072.pth... [2023-03-12 04:13:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000178680_91484160.pth [2023-03-12 04:13:52,155][124793] Updated weights for policy 0, policy_version 179280 (0.0005) [2023-03-12 04:13:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9483.3). Total num frames: 91828224. Throughput: 0: 9740.9. Samples: 91824148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:13:56,005][124505] Avg episode reward: [(0, '4562.473')] [2023-03-12 04:13:56,432][124793] Updated weights for policy 0, policy_version 179360 (0.0005) [2023-03-12 04:14:00,558][124793] Updated weights for policy 0, policy_version 179440 (0.0005) [2023-03-12 04:14:01,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9483.3). Total num frames: 91877376. Throughput: 0: 9771.0. Samples: 91853416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:14:01,005][124505] Avg episode reward: [(0, '4576.663')] [2023-03-12 04:14:04,609][124793] Updated weights for policy 0, policy_version 179520 (0.0004) [2023-03-12 04:14:06,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9483.3). Total num frames: 91926528. Throughput: 0: 9801.8. Samples: 91914088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:14:06,006][124505] Avg episode reward: [(0, '4513.315')] [2023-03-12 04:14:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000179544_91926528.pth... [2023-03-12 04:14:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000178976_91635712.pth [2023-03-12 04:14:08,736][124793] Updated weights for policy 0, policy_version 179600 (0.0005) [2023-03-12 04:14:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9497.2). Total num frames: 91975680. Throughput: 0: 9783.1. Samples: 91972964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:14:11,005][124505] Avg episode reward: [(0, '4553.805')] [2023-03-12 04:14:12,959][124793] Updated weights for policy 0, policy_version 179680 (0.0005) [2023-03-12 04:14:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9497.2). Total num frames: 92024832. Throughput: 0: 9785.7. Samples: 92002404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:14:16,005][124505] Avg episode reward: [(0, '4567.400')] [2023-03-12 04:14:17,035][124793] Updated weights for policy 0, policy_version 179760 (0.0004) [2023-03-12 04:14:21,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9497.2). Total num frames: 92073984. Throughput: 0: 9794.2. Samples: 92062564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:14:21,006][124505] Avg episode reward: [(0, '4564.565')] [2023-03-12 04:14:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000179832_92073984.pth... [2023-03-12 04:14:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000179256_91779072.pth [2023-03-12 04:14:21,138][124793] Updated weights for policy 0, policy_version 179840 (0.0004) [2023-03-12 04:14:25,301][124793] Updated weights for policy 0, policy_version 179920 (0.0005) [2023-03-12 04:14:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9511.1). Total num frames: 92123136. Throughput: 0: 9800.4. Samples: 92121848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:14:26,005][124505] Avg episode reward: [(0, '4570.531')] [2023-03-12 04:14:29,460][124793] Updated weights for policy 0, policy_version 180000 (0.0005) [2023-03-12 04:14:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9524.9). Total num frames: 92172288. Throughput: 0: 9821.8. Samples: 92151488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:14:31,005][124505] Avg episode reward: [(0, '4583.105')] [2023-03-12 04:14:33,548][124793] Updated weights for policy 0, policy_version 180080 (0.0004) [2023-03-12 04:14:36,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9538.8). Total num frames: 92225536. Throughput: 0: 9887.9. Samples: 92211736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:14:36,006][124505] Avg episode reward: [(0, '4570.469')] [2023-03-12 04:14:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000180128_92225536.pth... [2023-03-12 04:14:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000179544_91926528.pth [2023-03-12 04:14:37,609][124793] Updated weights for policy 0, policy_version 180160 (0.0004) [2023-03-12 04:14:41,005][124505] Fps is (10 sec: 10240.1, 60 sec: 9898.7, 300 sec: 9552.7). Total num frames: 92274688. Throughput: 0: 9928.9. Samples: 92270948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:14:41,005][124505] Avg episode reward: [(0, '4567.177')] [2023-03-12 04:14:41,776][124793] Updated weights for policy 0, policy_version 180240 (0.0004) [2023-03-12 04:14:46,001][124793] Updated weights for policy 0, policy_version 180320 (0.0004) [2023-03-12 04:14:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9566.6). Total num frames: 92323840. Throughput: 0: 9935.1. Samples: 92300496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:14:46,005][124505] Avg episode reward: [(0, '4575.475')] [2023-03-12 04:14:50,113][124793] Updated weights for policy 0, policy_version 180400 (0.0005) [2023-03-12 04:14:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9898.7, 300 sec: 9566.6). Total num frames: 92372992. Throughput: 0: 9904.1. Samples: 92359772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:14:51,005][124505] Avg episode reward: [(0, '4583.716')] [2023-03-12 04:14:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000180416_92372992.pth... [2023-03-12 04:14:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000179832_92073984.pth [2023-03-12 04:14:54,220][124793] Updated weights for policy 0, policy_version 180480 (0.0004) [2023-03-12 04:14:56,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9580.5). Total num frames: 92422144. Throughput: 0: 9892.5. Samples: 92418124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:14:56,005][124505] Avg episode reward: [(0, '4578.678')] [2023-03-12 04:14:58,617][124793] Updated weights for policy 0, policy_version 180560 (0.0005) [2023-03-12 04:15:01,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9830.4, 300 sec: 9566.6). Total num frames: 92467200. Throughput: 0: 9873.7. Samples: 92446720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:15:01,005][124505] Avg episode reward: [(0, '4579.549')] [2023-03-12 04:15:03,035][124793] Updated weights for policy 0, policy_version 180640 (0.0005) [2023-03-12 04:15:06,005][124505] Fps is (10 sec: 9011.1, 60 sec: 9762.1, 300 sec: 9566.6). Total num frames: 92512256. Throughput: 0: 9783.2. Samples: 92502808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:15:06,005][124505] Avg episode reward: [(0, '4583.262')] [2023-03-12 04:15:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000180688_92512256.pth... [2023-03-12 04:15:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000180128_92225536.pth [2023-03-12 04:15:07,405][124793] Updated weights for policy 0, policy_version 180720 (0.0005) [2023-03-12 04:15:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9580.5). Total num frames: 92561408. Throughput: 0: 9689.3. Samples: 92557864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:15:11,005][124505] Avg episode reward: [(0, '4595.780')] [2023-03-12 04:15:11,831][124793] Updated weights for policy 0, policy_version 180800 (0.0005) [2023-03-12 04:15:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9566.6). Total num frames: 92606464. Throughput: 0: 9655.5. Samples: 92585984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:15:16,005][124505] Avg episode reward: [(0, '4572.763')] [2023-03-12 04:15:16,267][124793] Updated weights for policy 0, policy_version 180880 (0.0004) [2023-03-12 04:15:20,693][124793] Updated weights for policy 0, policy_version 180960 (0.0005) [2023-03-12 04:15:21,005][124505] Fps is (10 sec: 9011.1, 60 sec: 9625.6, 300 sec: 9566.6). Total num frames: 92651520. Throughput: 0: 9543.7. Samples: 92641200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:15:21,005][124505] Avg episode reward: [(0, '4564.274')] [2023-03-12 04:15:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000180960_92651520.pth... [2023-03-12 04:15:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000180416_92372992.pth [2023-03-12 04:15:24,765][124793] Updated weights for policy 0, policy_version 181040 (0.0005) [2023-03-12 04:15:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9580.5). Total num frames: 92700672. Throughput: 0: 9549.6. Samples: 92700680. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:15:26,005][124505] Avg episode reward: [(0, '4577.486')] [2023-03-12 04:15:28,973][124793] Updated weights for policy 0, policy_version 181120 (0.0005) [2023-03-12 04:15:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9580.5). Total num frames: 92749824. Throughput: 0: 9531.6. Samples: 92729416. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:15:31,005][124505] Avg episode reward: [(0, '4582.561')] [2023-03-12 04:15:33,109][124793] Updated weights for policy 0, policy_version 181200 (0.0005) [2023-03-12 04:15:36,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9625.6, 300 sec: 9608.2). Total num frames: 92803072. Throughput: 0: 9547.6. Samples: 92789412. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:15:36,005][124505] Avg episode reward: [(0, '4586.027')] [2023-03-12 04:15:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000181256_92803072.pth... [2023-03-12 04:15:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000180688_92512256.pth [2023-03-12 04:15:37,193][124793] Updated weights for policy 0, policy_version 181280 (0.0004) [2023-03-12 04:15:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9625.6, 300 sec: 9608.2). Total num frames: 92852224. Throughput: 0: 9578.8. Samples: 92849172. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:15:41,005][124505] Avg episode reward: [(0, '4586.651')] [2023-03-12 04:15:41,265][124793] Updated weights for policy 0, policy_version 181360 (0.0005) [2023-03-12 04:15:45,659][124793] Updated weights for policy 0, policy_version 181440 (0.0005) [2023-03-12 04:15:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9608.2). Total num frames: 92897280. Throughput: 0: 9594.8. Samples: 92878488. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:15:46,005][124505] Avg episode reward: [(0, '4580.032')] [2023-03-12 04:15:50,100][124793] Updated weights for policy 0, policy_version 181520 (0.0005) [2023-03-12 04:15:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9608.2). Total num frames: 92946432. Throughput: 0: 9582.9. Samples: 92934036. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:15:51,005][124505] Avg episode reward: [(0, '4581.942')] [2023-03-12 04:15:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000181536_92946432.pth... [2023-03-12 04:15:51,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000180960_92651520.pth [2023-03-12 04:15:54,443][124793] Updated weights for policy 0, policy_version 181600 (0.0005) [2023-03-12 04:15:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9608.2). Total num frames: 92991488. Throughput: 0: 9608.9. Samples: 92990264. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:15:56,005][124505] Avg episode reward: [(0, '4585.015')] [2023-03-12 04:15:58,860][124793] Updated weights for policy 0, policy_version 181680 (0.0005) [2023-03-12 04:16:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9622.1). Total num frames: 93040640. Throughput: 0: 9597.8. Samples: 93017884. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:16:01,005][124505] Avg episode reward: [(0, '4581.796')] [2023-03-12 04:16:02,985][124793] Updated weights for policy 0, policy_version 181760 (0.0005) [2023-03-12 04:16:06,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9625.6, 300 sec: 9636.0). Total num frames: 93089792. Throughput: 0: 9693.7. Samples: 93077416. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:16:06,005][124505] Avg episode reward: [(0, '4588.410')] [2023-03-12 04:16:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000181816_93089792.pth... [2023-03-12 04:16:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000181256_92803072.pth [2023-03-12 04:16:07,060][124793] Updated weights for policy 0, policy_version 181840 (0.0004) [2023-03-12 04:16:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9636.0). Total num frames: 93138944. Throughput: 0: 9689.2. Samples: 93136692. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:16:11,005][124505] Avg episode reward: [(0, '4585.425')] [2023-03-12 04:16:11,217][124793] Updated weights for policy 0, policy_version 181920 (0.0006) [2023-03-12 04:16:15,320][124793] Updated weights for policy 0, policy_version 182000 (0.0006) [2023-03-12 04:16:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9649.9). Total num frames: 93188096. Throughput: 0: 9714.9. Samples: 93166588. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:16:16,005][124505] Avg episode reward: [(0, '4587.107')] [2023-03-12 04:16:19,413][124793] Updated weights for policy 0, policy_version 182080 (0.0005) [2023-03-12 04:16:21,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9762.1, 300 sec: 9663.8). Total num frames: 93237248. Throughput: 0: 9717.2. Samples: 93226688. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:16:21,005][124505] Avg episode reward: [(0, '4581.466')] [2023-03-12 04:16:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000182104_93237248.pth... [2023-03-12 04:16:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000181536_92946432.pth [2023-03-12 04:16:23,543][124793] Updated weights for policy 0, policy_version 182160 (0.0005) [2023-03-12 04:16:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9663.8). Total num frames: 93286400. Throughput: 0: 9686.0. Samples: 93285044. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:16:26,005][124505] Avg episode reward: [(0, '4578.671')] [2023-03-12 04:16:27,970][124793] Updated weights for policy 0, policy_version 182240 (0.0005) [2023-03-12 04:16:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9762.1, 300 sec: 9663.8). Total num frames: 93335552. Throughput: 0: 9647.7. Samples: 93312636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:16:31,005][124505] Avg episode reward: [(0, '4581.338')] [2023-03-12 04:16:32,364][124793] Updated weights for policy 0, policy_version 182320 (0.0005) [2023-03-12 04:16:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9663.8). Total num frames: 93380608. Throughput: 0: 9656.7. Samples: 93368588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:16:36,005][124505] Avg episode reward: [(0, '4592.591')] [2023-03-12 04:16:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000182384_93380608.pth... [2023-03-12 04:16:36,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000181816_93089792.pth [2023-03-12 04:16:36,567][124793] Updated weights for policy 0, policy_version 182400 (0.0005) [2023-03-12 04:16:40,778][124793] Updated weights for policy 0, policy_version 182480 (0.0005) [2023-03-12 04:16:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9649.9). Total num frames: 93429760. Throughput: 0: 9724.4. Samples: 93427864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:16:41,005][124505] Avg episode reward: [(0, '4578.944')] [2023-03-12 04:16:44,898][124793] Updated weights for policy 0, policy_version 182560 (0.0005) [2023-03-12 04:16:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9649.9). Total num frames: 93478912. Throughput: 0: 9782.3. Samples: 93458088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:16:46,005][124505] Avg episode reward: [(0, '4595.085')] [2023-03-12 04:16:49,000][124793] Updated weights for policy 0, policy_version 182640 (0.0005) [2023-03-12 04:16:51,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9663.8). Total num frames: 93528064. Throughput: 0: 9783.3. Samples: 93517664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:16:51,005][124505] Avg episode reward: [(0, '4592.466')] [2023-03-12 04:16:51,044][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000182680_93532160.pth... [2023-03-12 04:16:51,045][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000182104_93237248.pth [2023-03-12 04:16:53,119][124793] Updated weights for policy 0, policy_version 182720 (0.0005) [2023-03-12 04:16:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9691.6). Total num frames: 93581312. Throughput: 0: 9791.0. Samples: 93577288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:16:56,005][124505] Avg episode reward: [(0, '4589.963')] [2023-03-12 04:16:57,210][124793] Updated weights for policy 0, policy_version 182800 (0.0005) [2023-03-12 04:17:01,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9705.4). Total num frames: 93630464. Throughput: 0: 9795.0. Samples: 93607364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:17:01,005][124505] Avg episode reward: [(0, '4589.767')] [2023-03-12 04:17:01,317][124793] Updated weights for policy 0, policy_version 182880 (0.0005) [2023-03-12 04:17:05,440][124793] Updated weights for policy 0, policy_version 182960 (0.0005) [2023-03-12 04:17:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9705.4). Total num frames: 93679616. Throughput: 0: 9792.3. Samples: 93667340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:17:06,005][124505] Avg episode reward: [(0, '4584.670')] [2023-03-12 04:17:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000182968_93679616.pth... [2023-03-12 04:17:06,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000182384_93380608.pth [2023-03-12 04:17:09,527][124793] Updated weights for policy 0, policy_version 183040 (0.0005) [2023-03-12 04:17:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9705.4). Total num frames: 93728768. Throughput: 0: 9818.8. Samples: 93726888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:17:11,005][124505] Avg episode reward: [(0, '4580.222')] [2023-03-12 04:17:13,614][124793] Updated weights for policy 0, policy_version 183120 (0.0005) [2023-03-12 04:17:16,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9705.4). Total num frames: 93777920. Throughput: 0: 9879.5. Samples: 93757212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:17:16,005][124505] Avg episode reward: [(0, '4592.186')] [2023-03-12 04:17:17,669][124793] Updated weights for policy 0, policy_version 183200 (0.0004) [2023-03-12 04:17:21,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9898.7, 300 sec: 9733.2). Total num frames: 93831168. Throughput: 0: 9962.7. Samples: 93816908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:17:21,005][124505] Avg episode reward: [(0, '4591.684')] [2023-03-12 04:17:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000183264_93831168.pth... [2023-03-12 04:17:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000182680_93532160.pth [2023-03-12 04:17:21,758][124793] Updated weights for policy 0, policy_version 183280 (0.0005) [2023-03-12 04:17:25,838][124793] Updated weights for policy 0, policy_version 183360 (0.0005) [2023-03-12 04:17:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9898.7, 300 sec: 9733.2). Total num frames: 93880320. Throughput: 0: 9996.3. Samples: 93877696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:17:26,005][124505] Avg episode reward: [(0, '4588.999')] [2023-03-12 04:17:29,962][124793] Updated weights for policy 0, policy_version 183440 (0.0005) [2023-03-12 04:17:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9898.7, 300 sec: 9747.1). Total num frames: 93929472. Throughput: 0: 9992.1. Samples: 93907732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:17:31,005][124505] Avg episode reward: [(0, '4584.472')] [2023-03-12 04:17:34,094][124793] Updated weights for policy 0, policy_version 183520 (0.0005) [2023-03-12 04:17:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9761.0). Total num frames: 93978624. Throughput: 0: 9980.4. Samples: 93966784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:17:36,005][124505] Avg episode reward: [(0, '4581.461')] [2023-03-12 04:17:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000183552_93978624.pth... [2023-03-12 04:17:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000182968_93679616.pth [2023-03-12 04:17:38,224][124793] Updated weights for policy 0, policy_version 183600 (0.0005) [2023-03-12 04:17:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9761.0). Total num frames: 94027776. Throughput: 0: 9987.1. Samples: 94026708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:17:41,005][124505] Avg episode reward: [(0, '4583.033')] [2023-03-12 04:17:42,350][124793] Updated weights for policy 0, policy_version 183680 (0.0005) [2023-03-12 04:17:46,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9761.0). Total num frames: 94076928. Throughput: 0: 9981.5. Samples: 94056532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:17:46,005][124505] Avg episode reward: [(0, '4588.890')] [2023-03-12 04:17:46,468][124793] Updated weights for policy 0, policy_version 183760 (0.0005) [2023-03-12 04:17:50,561][124793] Updated weights for policy 0, policy_version 183840 (0.0005) [2023-03-12 04:17:51,005][124505] Fps is (10 sec: 10240.0, 60 sec: 10035.2, 300 sec: 9774.9). Total num frames: 94130176. Throughput: 0: 9979.1. Samples: 94116400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:17:51,005][124505] Avg episode reward: [(0, '4582.325')] [2023-03-12 04:17:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000183848_94130176.pth... [2023-03-12 04:17:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000183264_93831168.pth [2023-03-12 04:17:54,639][124793] Updated weights for policy 0, policy_version 183920 (0.0005) [2023-03-12 04:17:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9774.9). Total num frames: 94179328. Throughput: 0: 9989.5. Samples: 94176416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:17:56,005][124505] Avg episode reward: [(0, '4582.252')] [2023-03-12 04:17:58,743][124793] Updated weights for policy 0, policy_version 184000 (0.0005) [2023-03-12 04:18:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9788.7). Total num frames: 94228480. Throughput: 0: 9984.2. Samples: 94206500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:18:01,005][124505] Avg episode reward: [(0, '4575.347')] [2023-03-12 04:18:02,833][124793] Updated weights for policy 0, policy_version 184080 (0.0005) [2023-03-12 04:18:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9802.6). Total num frames: 94277632. Throughput: 0: 9992.7. Samples: 94266580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:18:06,005][124505] Avg episode reward: [(0, '4585.405')] [2023-03-12 04:18:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000184136_94277632.pth... [2023-03-12 04:18:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000183552_93978624.pth [2023-03-12 04:18:06,954][124793] Updated weights for policy 0, policy_version 184160 (0.0005) [2023-03-12 04:18:11,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9802.6). Total num frames: 94326784. Throughput: 0: 9969.6. Samples: 94326328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:18:11,005][124505] Avg episode reward: [(0, '4578.271')] [2023-03-12 04:18:11,036][124793] Updated weights for policy 0, policy_version 184240 (0.0005) [2023-03-12 04:18:15,195][124793] Updated weights for policy 0, policy_version 184320 (0.0005) [2023-03-12 04:18:16,005][124505] Fps is (10 sec: 10240.1, 60 sec: 10035.2, 300 sec: 9816.5). Total num frames: 94380032. Throughput: 0: 9955.8. Samples: 94355744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:18:16,005][124505] Avg episode reward: [(0, '4587.251')] [2023-03-12 04:18:19,297][124793] Updated weights for policy 0, policy_version 184400 (0.0005) [2023-03-12 04:18:21,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9966.9, 300 sec: 9816.5). Total num frames: 94429184. Throughput: 0: 9975.6. Samples: 94415688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:18:21,006][124505] Avg episode reward: [(0, '4583.560')] [2023-03-12 04:18:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000184432_94429184.pth... [2023-03-12 04:18:21,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000183848_94130176.pth [2023-03-12 04:18:23,440][124793] Updated weights for policy 0, policy_version 184480 (0.0006) [2023-03-12 04:18:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9816.5). Total num frames: 94478336. Throughput: 0: 9950.0. Samples: 94474456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:18:26,005][124505] Avg episode reward: [(0, '4583.634')] [2023-03-12 04:18:27,588][124793] Updated weights for policy 0, policy_version 184560 (0.0005) [2023-03-12 04:18:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9966.9, 300 sec: 9816.5). Total num frames: 94527488. Throughput: 0: 9956.1. Samples: 94504556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:18:31,005][124505] Avg episode reward: [(0, '4584.338')] [2023-03-12 04:18:31,708][124793] Updated weights for policy 0, policy_version 184640 (0.0005) [2023-03-12 04:18:35,733][124793] Updated weights for policy 0, policy_version 184720 (0.0005) [2023-03-12 04:18:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9816.5). Total num frames: 94576640. Throughput: 0: 9963.0. Samples: 94564736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:18:36,005][124505] Avg episode reward: [(0, '4580.137')] [2023-03-12 04:18:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000184720_94576640.pth... [2023-03-12 04:18:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000184136_94277632.pth [2023-03-12 04:18:39,827][124793] Updated weights for policy 0, policy_version 184800 (0.0005) [2023-03-12 04:18:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9966.9, 300 sec: 9816.5). Total num frames: 94625792. Throughput: 0: 9972.8. Samples: 94625192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:18:41,005][124505] Avg episode reward: [(0, '4584.559')] [2023-03-12 04:18:44,119][124793] Updated weights for policy 0, policy_version 184880 (0.0005) [2023-03-12 04:18:46,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9966.9, 300 sec: 9816.5). Total num frames: 94674944. Throughput: 0: 9943.1. Samples: 94653940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:18:46,006][124505] Avg episode reward: [(0, '4582.310')] [2023-03-12 04:18:48,545][124793] Updated weights for policy 0, policy_version 184960 (0.0006) [2023-03-12 04:18:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9802.6). Total num frames: 94720000. Throughput: 0: 9847.9. Samples: 94709736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:18:51,005][124505] Avg episode reward: [(0, '4589.348')] [2023-03-12 04:18:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000185000_94720000.pth... [2023-03-12 04:18:51,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000184432_94429184.pth [2023-03-12 04:18:52,836][124793] Updated weights for policy 0, policy_version 185040 (0.0005) [2023-03-12 04:18:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9830.4, 300 sec: 9802.6). Total num frames: 94769152. Throughput: 0: 9762.3. Samples: 94765632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:18:56,005][124505] Avg episode reward: [(0, '4576.334')] [2023-03-12 04:18:57,138][124793] Updated weights for policy 0, policy_version 185120 (0.0005) [2023-03-12 04:19:01,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9762.1, 300 sec: 9788.7). Total num frames: 94814208. Throughput: 0: 9759.4. Samples: 94794916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:19:01,005][124505] Avg episode reward: [(0, '4575.762')] [2023-03-12 04:19:01,467][124793] Updated weights for policy 0, policy_version 185200 (0.0005) [2023-03-12 04:19:05,871][124793] Updated weights for policy 0, policy_version 185280 (0.0005) [2023-03-12 04:19:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9788.7). Total num frames: 94863360. Throughput: 0: 9676.8. Samples: 94851144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:19:06,005][124505] Avg episode reward: [(0, '4571.444')] [2023-03-12 04:19:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000185280_94863360.pth... [2023-03-12 04:19:06,012][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000184720_94576640.pth [2023-03-12 04:19:10,189][124793] Updated weights for policy 0, policy_version 185360 (0.0005) [2023-03-12 04:19:11,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9693.8, 300 sec: 9774.9). Total num frames: 94908416. Throughput: 0: 9643.7. Samples: 94908424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:19:11,006][124505] Avg episode reward: [(0, '4571.963')] [2023-03-12 04:19:14,566][124793] Updated weights for policy 0, policy_version 185440 (0.0005) [2023-03-12 04:19:16,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9625.6, 300 sec: 9774.9). Total num frames: 94957568. Throughput: 0: 9596.8. Samples: 94936412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:19:16,005][124505] Avg episode reward: [(0, '4587.642')] [2023-03-12 04:19:18,928][124793] Updated weights for policy 0, policy_version 185520 (0.0005) [2023-03-12 04:19:21,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9761.0). Total num frames: 95002624. Throughput: 0: 9507.5. Samples: 94992572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:19:21,005][124505] Avg episode reward: [(0, '4584.809')] [2023-03-12 04:19:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000185552_95002624.pth... [2023-03-12 04:19:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000185000_94720000.pth [2023-03-12 04:19:23,268][124793] Updated weights for policy 0, policy_version 185600 (0.0005) [2023-03-12 04:19:26,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9557.3, 300 sec: 9761.0). Total num frames: 95051776. Throughput: 0: 9436.9. Samples: 95049852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:19:26,005][124505] Avg episode reward: [(0, '4592.681')] [2023-03-12 04:19:27,563][124793] Updated weights for policy 0, policy_version 185680 (0.0005) [2023-03-12 04:19:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9733.2). Total num frames: 95096832. Throughput: 0: 9413.9. Samples: 95077564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:19:31,005][124505] Avg episode reward: [(0, '4589.882')] [2023-03-12 04:19:31,908][124793] Updated weights for policy 0, policy_version 185760 (0.0005) [2023-03-12 04:19:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9733.2). Total num frames: 95145984. Throughput: 0: 9426.0. Samples: 95133908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:19:36,005][124505] Avg episode reward: [(0, '4573.672')] [2023-03-12 04:19:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000185832_95145984.pth... [2023-03-12 04:19:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000185280_94863360.pth [2023-03-12 04:19:36,256][124793] Updated weights for policy 0, policy_version 185840 (0.0005) [2023-03-12 04:19:40,468][124793] Updated weights for policy 0, policy_version 185920 (0.0005) [2023-03-12 04:19:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9733.2). Total num frames: 95195136. Throughput: 0: 9471.1. Samples: 95191832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:19:41,005][124505] Avg episode reward: [(0, '4591.470')] [2023-03-12 04:19:44,531][124793] Updated weights for policy 0, policy_version 186000 (0.0005) [2023-03-12 04:19:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9733.2). Total num frames: 95244288. Throughput: 0: 9496.9. Samples: 95222276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:19:46,005][124505] Avg episode reward: [(0, '4588.159')] [2023-03-12 04:19:48,637][124793] Updated weights for policy 0, policy_version 186080 (0.0005) [2023-03-12 04:19:51,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9733.2). Total num frames: 95293440. Throughput: 0: 9577.0. Samples: 95282108. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:19:51,005][124505] Avg episode reward: [(0, '4595.864')] [2023-03-12 04:19:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000186120_95293440.pth... [2023-03-12 04:19:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000185552_95002624.pth [2023-03-12 04:19:52,748][124793] Updated weights for policy 0, policy_version 186160 (0.0005) [2023-03-12 04:19:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9625.6, 300 sec: 9761.0). Total num frames: 95346688. Throughput: 0: 9649.6. Samples: 95342656. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:19:56,005][124505] Avg episode reward: [(0, '4591.678')] [2023-03-12 04:19:56,848][124793] Updated weights for policy 0, policy_version 186240 (0.0004) [2023-03-12 04:20:01,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9761.0). Total num frames: 95391744. Throughput: 0: 9663.6. Samples: 95371276. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:20:01,005][124505] Avg episode reward: [(0, '4598.446')] [2023-03-12 04:20:01,063][124793] Updated weights for policy 0, policy_version 186320 (0.0005) [2023-03-12 04:20:05,163][124793] Updated weights for policy 0, policy_version 186400 (0.0005) [2023-03-12 04:20:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9693.9, 300 sec: 9774.9). Total num frames: 95444992. Throughput: 0: 9742.0. Samples: 95430960. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:20:06,005][124505] Avg episode reward: [(0, '4579.896')] [2023-03-12 04:20:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000186416_95444992.pth... [2023-03-12 04:20:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000185832_95145984.pth [2023-03-12 04:20:09,470][124793] Updated weights for policy 0, policy_version 186480 (0.0005) [2023-03-12 04:20:11,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9693.9, 300 sec: 9774.9). Total num frames: 95490048. Throughput: 0: 9762.8. Samples: 95489176. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:20:11,005][124505] Avg episode reward: [(0, '4593.229')] [2023-03-12 04:20:13,728][124793] Updated weights for policy 0, policy_version 186560 (0.0005) [2023-03-12 04:20:16,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9693.9, 300 sec: 9788.7). Total num frames: 95539200. Throughput: 0: 9775.1. Samples: 95517444. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:20:16,005][124505] Avg episode reward: [(0, '4593.343')] [2023-03-12 04:20:18,156][124793] Updated weights for policy 0, policy_version 186640 (0.0005) [2023-03-12 04:20:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9774.9). Total num frames: 95584256. Throughput: 0: 9754.0. Samples: 95572836. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:20:21,005][124505] Avg episode reward: [(0, '4589.265')] [2023-03-12 04:20:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000186688_95584256.pth... [2023-03-12 04:20:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000186120_95293440.pth [2023-03-12 04:20:22,609][124793] Updated weights for policy 0, policy_version 186720 (0.0005) [2023-03-12 04:20:26,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9625.6, 300 sec: 9761.0). Total num frames: 95629312. Throughput: 0: 9704.9. Samples: 95628552. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:20:26,005][124505] Avg episode reward: [(0, '4598.105')] [2023-03-12 04:20:27,040][124793] Updated weights for policy 0, policy_version 186800 (0.0005) [2023-03-12 04:20:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9747.1). Total num frames: 95678464. Throughput: 0: 9628.0. Samples: 95655536. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:20:31,005][124505] Avg episode reward: [(0, '4587.674')] [2023-03-12 04:20:31,417][124793] Updated weights for policy 0, policy_version 186880 (0.0005) [2023-03-12 04:20:35,885][124793] Updated weights for policy 0, policy_version 186960 (0.0005) [2023-03-12 04:20:36,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9733.2). Total num frames: 95723520. Throughput: 0: 9549.4. Samples: 95711832. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:20:36,005][124505] Avg episode reward: [(0, '4586.846')] [2023-03-12 04:20:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000186960_95723520.pth... [2023-03-12 04:20:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000186416_95444992.pth [2023-03-12 04:20:40,257][124793] Updated weights for policy 0, policy_version 187040 (0.0005) [2023-03-12 04:20:41,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9557.3, 300 sec: 9733.2). Total num frames: 95768576. Throughput: 0: 9448.6. Samples: 95767844. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:20:41,005][124505] Avg episode reward: [(0, '4598.051')] [2023-03-12 04:20:44,669][124793] Updated weights for policy 0, policy_version 187120 (0.0005) [2023-03-12 04:20:46,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9733.2). Total num frames: 95817728. Throughput: 0: 9432.3. Samples: 95795732. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:20:46,005][124505] Avg episode reward: [(0, '4588.759')] [2023-03-12 04:20:48,989][124793] Updated weights for policy 0, policy_version 187200 (0.0005) [2023-03-12 04:20:51,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9733.2). Total num frames: 95862784. Throughput: 0: 9347.5. Samples: 95851596. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 04:20:51,005][124505] Avg episode reward: [(0, '4575.490')] [2023-03-12 04:20:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000187232_95862784.pth... [2023-03-12 04:20:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000186688_95584256.pth [2023-03-12 04:20:53,423][124793] Updated weights for policy 0, policy_version 187280 (0.0005) [2023-03-12 04:20:56,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9719.3). Total num frames: 95907840. Throughput: 0: 9299.6. Samples: 95907660. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:20:56,005][124505] Avg episode reward: [(0, '4590.011')] [2023-03-12 04:20:57,851][124793] Updated weights for policy 0, policy_version 187360 (0.0005) [2023-03-12 04:21:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9719.3). Total num frames: 95956992. Throughput: 0: 9294.6. Samples: 95935704. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:21:01,006][124505] Avg episode reward: [(0, '4595.846')] [2023-03-12 04:21:02,223][124793] Updated weights for policy 0, policy_version 187440 (0.0005) [2023-03-12 04:21:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9705.4). Total num frames: 96002048. Throughput: 0: 9299.8. Samples: 95991328. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:21:06,006][124505] Avg episode reward: [(0, '4595.555')] [2023-03-12 04:21:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000187504_96002048.pth... [2023-03-12 04:21:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000186960_95723520.pth [2023-03-12 04:21:06,547][124793] Updated weights for policy 0, policy_version 187520 (0.0005) [2023-03-12 04:21:10,885][124793] Updated weights for policy 0, policy_version 187600 (0.0005) [2023-03-12 04:21:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9705.4). Total num frames: 96051200. Throughput: 0: 9329.0. Samples: 96048356. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:21:11,005][124505] Avg episode reward: [(0, '4588.628')] [2023-03-12 04:21:15,307][124793] Updated weights for policy 0, policy_version 187680 (0.0005) [2023-03-12 04:21:16,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9691.6). Total num frames: 96096256. Throughput: 0: 9348.7. Samples: 96076228. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:21:16,005][124505] Avg episode reward: [(0, '4588.261')] [2023-03-12 04:21:19,695][124793] Updated weights for policy 0, policy_version 187760 (0.0005) [2023-03-12 04:21:21,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9677.7). Total num frames: 96141312. Throughput: 0: 9345.8. Samples: 96132392. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:21:21,005][124505] Avg episode reward: [(0, '4586.364')] [2023-03-12 04:21:21,016][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000187784_96145408.pth... [2023-03-12 04:21:21,018][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000187232_95862784.pth [2023-03-12 04:21:24,074][124793] Updated weights for policy 0, policy_version 187840 (0.0005) [2023-03-12 04:21:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9677.7). Total num frames: 96190464. Throughput: 0: 9335.2. Samples: 96187928. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:21:26,005][124505] Avg episode reward: [(0, '4593.924')] [2023-03-12 04:21:28,536][124793] Updated weights for policy 0, policy_version 187920 (0.0005) [2023-03-12 04:21:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9677.7). Total num frames: 96235520. Throughput: 0: 9322.2. Samples: 96215232. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:21:31,005][124505] Avg episode reward: [(0, '4589.058')] [2023-03-12 04:21:32,901][124793] Updated weights for policy 0, policy_version 188000 (0.0005) [2023-03-12 04:21:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9677.7). Total num frames: 96284672. Throughput: 0: 9335.7. Samples: 96271704. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:21:36,006][124505] Avg episode reward: [(0, '4585.599')] [2023-03-12 04:21:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000188056_96284672.pth... [2023-03-12 04:21:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000187504_96002048.pth [2023-03-12 04:21:37,322][124793] Updated weights for policy 0, policy_version 188080 (0.0005) [2023-03-12 04:21:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9663.8). Total num frames: 96329728. Throughput: 0: 9334.8. Samples: 96327724. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:21:41,006][124505] Avg episode reward: [(0, '4589.957')] [2023-03-12 04:21:41,658][124793] Updated weights for policy 0, policy_version 188160 (0.0005) [2023-03-12 04:21:46,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9649.9). Total num frames: 96374784. Throughput: 0: 9326.2. Samples: 96355384. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:21:46,005][124505] Avg episode reward: [(0, '4591.700')] [2023-03-12 04:21:46,057][124793] Updated weights for policy 0, policy_version 188240 (0.0005) [2023-03-12 04:21:50,459][124793] Updated weights for policy 0, policy_version 188320 (0.0005) [2023-03-12 04:21:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9636.0). Total num frames: 96423936. Throughput: 0: 9341.9. Samples: 96411712. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:21:51,005][124505] Avg episode reward: [(0, '4592.172')] [2023-03-12 04:21:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000188328_96423936.pth... [2023-03-12 04:21:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000187784_96145408.pth [2023-03-12 04:21:54,821][124793] Updated weights for policy 0, policy_version 188400 (0.0005) [2023-03-12 04:21:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9622.1). Total num frames: 96468992. Throughput: 0: 9333.3. Samples: 96468356. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 04:21:56,005][124505] Avg episode reward: [(0, '4596.289')] [2023-03-12 04:21:59,128][124793] Updated weights for policy 0, policy_version 188480 (0.0005) [2023-03-12 04:22:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9622.1). Total num frames: 96518144. Throughput: 0: 9342.5. Samples: 96496640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:22:01,005][124505] Avg episode reward: [(0, '4591.666')] [2023-03-12 04:22:03,533][124793] Updated weights for policy 0, policy_version 188560 (0.0005) [2023-03-12 04:22:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9608.2). Total num frames: 96563200. Throughput: 0: 9331.6. Samples: 96552316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:22:06,005][124505] Avg episode reward: [(0, '4578.484')] [2023-03-12 04:22:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000188600_96563200.pth... [2023-03-12 04:22:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000188056_96284672.pth [2023-03-12 04:22:07,939][124793] Updated weights for policy 0, policy_version 188640 (0.0005) [2023-03-12 04:22:11,005][124505] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9594.4). Total num frames: 96608256. Throughput: 0: 9342.1. Samples: 96608320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:22:11,005][124505] Avg episode reward: [(0, '4574.836')] [2023-03-12 04:22:12,322][124793] Updated weights for policy 0, policy_version 188720 (0.0005) [2023-03-12 04:22:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9580.5). Total num frames: 96657408. Throughput: 0: 9362.1. Samples: 96636528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:22:16,005][124505] Avg episode reward: [(0, '4591.304')] [2023-03-12 04:22:16,690][124793] Updated weights for policy 0, policy_version 188800 (0.0005) [2023-03-12 04:22:21,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9566.6). Total num frames: 96702464. Throughput: 0: 9357.2. Samples: 96692780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:22:21,005][124505] Avg episode reward: [(0, '4590.636')] [2023-03-12 04:22:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000188872_96702464.pth... [2023-03-12 04:22:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000188328_96423936.pth [2023-03-12 04:22:21,078][124793] Updated weights for policy 0, policy_version 188880 (0.0005) [2023-03-12 04:22:25,460][124793] Updated weights for policy 0, policy_version 188960 (0.0005) [2023-03-12 04:22:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9566.6). Total num frames: 96751616. Throughput: 0: 9354.2. Samples: 96748664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:22:26,005][124505] Avg episode reward: [(0, '4590.527')] [2023-03-12 04:22:29,644][124793] Updated weights for policy 0, policy_version 189040 (0.0005) [2023-03-12 04:22:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9566.6). Total num frames: 96800768. Throughput: 0: 9396.4. Samples: 96778220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:22:31,005][124505] Avg episode reward: [(0, '4596.581')] [2023-03-12 04:22:33,756][124793] Updated weights for policy 0, policy_version 189120 (0.0005) [2023-03-12 04:22:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9566.6). Total num frames: 96849920. Throughput: 0: 9465.1. Samples: 96837640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:22:36,005][124505] Avg episode reward: [(0, '4592.822')] [2023-03-12 04:22:36,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000189160_96849920.pth... [2023-03-12 04:22:36,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000188600_96563200.pth [2023-03-12 04:22:37,949][124793] Updated weights for policy 0, policy_version 189200 (0.0005) [2023-03-12 04:22:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9566.6). Total num frames: 96899072. Throughput: 0: 9508.8. Samples: 96896252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:22:41,005][124505] Avg episode reward: [(0, '4589.700')] [2023-03-12 04:22:42,023][124793] Updated weights for policy 0, policy_version 189280 (0.0004) [2023-03-12 04:22:46,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9552.7). Total num frames: 96948224. Throughput: 0: 9579.5. Samples: 96927716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:22:46,005][124505] Avg episode reward: [(0, '4602.239')] [2023-03-12 04:22:46,101][124793] Updated weights for policy 0, policy_version 189360 (0.0004) [2023-03-12 04:22:50,143][124793] Updated weights for policy 0, policy_version 189440 (0.0004) [2023-03-12 04:22:51,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9625.6, 300 sec: 9566.6). Total num frames: 97001472. Throughput: 0: 9678.6. Samples: 96987852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:22:51,005][124505] Avg episode reward: [(0, '4587.172')] [2023-03-12 04:22:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000189456_97001472.pth... [2023-03-12 04:22:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000188872_96702464.pth [2023-03-12 04:22:54,223][124793] Updated weights for policy 0, policy_version 189520 (0.0004) [2023-03-12 04:22:56,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9693.9, 300 sec: 9566.6). Total num frames: 97050624. Throughput: 0: 9763.0. Samples: 97047656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:22:56,005][124505] Avg episode reward: [(0, '4592.090')] [2023-03-12 04:22:58,327][124793] Updated weights for policy 0, policy_version 189600 (0.0004) [2023-03-12 04:23:01,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9693.9, 300 sec: 9566.6). Total num frames: 97099776. Throughput: 0: 9804.5. Samples: 97077728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:23:01,005][124505] Avg episode reward: [(0, '4589.325')] [2023-03-12 04:23:02,677][124793] Updated weights for policy 0, policy_version 189680 (0.0005) [2023-03-12 04:23:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9552.7). Total num frames: 97144832. Throughput: 0: 9800.6. Samples: 97133808. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:23:06,005][124505] Avg episode reward: [(0, '4586.682')] [2023-03-12 04:23:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000189736_97144832.pth... [2023-03-12 04:23:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000189160_96849920.pth [2023-03-12 04:23:07,079][124793] Updated weights for policy 0, policy_version 189760 (0.0005) [2023-03-12 04:23:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9762.1, 300 sec: 9538.8). Total num frames: 97193984. Throughput: 0: 9806.6. Samples: 97189960. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:23:11,005][124505] Avg episode reward: [(0, '4595.223')] [2023-03-12 04:23:11,462][124793] Updated weights for policy 0, policy_version 189840 (0.0005) [2023-03-12 04:23:15,659][124793] Updated weights for policy 0, policy_version 189920 (0.0004) [2023-03-12 04:23:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9524.9). Total num frames: 97239040. Throughput: 0: 9779.8. Samples: 97218312. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:23:16,005][124505] Avg episode reward: [(0, '4582.517')] [2023-03-12 04:23:19,750][124793] Updated weights for policy 0, policy_version 190000 (0.0005) [2023-03-12 04:23:21,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9538.8). Total num frames: 97292288. Throughput: 0: 9794.5. Samples: 97278392. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:23:21,005][124505] Avg episode reward: [(0, '4581.545')] [2023-03-12 04:23:21,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000190024_97292288.pth... [2023-03-12 04:23:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000189456_97001472.pth [2023-03-12 04:23:23,883][124793] Updated weights for policy 0, policy_version 190080 (0.0004) [2023-03-12 04:23:26,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9830.4, 300 sec: 9538.8). Total num frames: 97341440. Throughput: 0: 9815.1. Samples: 97337932. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:23:26,005][124505] Avg episode reward: [(0, '4585.619')] [2023-03-12 04:23:27,976][124793] Updated weights for policy 0, policy_version 190160 (0.0004) [2023-03-12 04:23:31,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9538.8). Total num frames: 97390592. Throughput: 0: 9780.4. Samples: 97367832. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:23:31,005][124505] Avg episode reward: [(0, '4595.838')] [2023-03-12 04:23:32,127][124793] Updated weights for policy 0, policy_version 190240 (0.0005) [2023-03-12 04:23:36,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9830.4, 300 sec: 9538.8). Total num frames: 97439744. Throughput: 0: 9770.4. Samples: 97427520. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:23:36,005][124505] Avg episode reward: [(0, '4592.556')] [2023-03-12 04:23:36,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000190312_97439744.pth... [2023-03-12 04:23:36,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000189736_97144832.pth [2023-03-12 04:23:36,220][124793] Updated weights for policy 0, policy_version 190320 (0.0004) [2023-03-12 04:23:40,533][124793] Updated weights for policy 0, policy_version 190400 (0.0005) [2023-03-12 04:23:41,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9830.4, 300 sec: 9538.8). Total num frames: 97488896. Throughput: 0: 9719.6. Samples: 97485036. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:23:41,005][124505] Avg episode reward: [(0, '4593.278')] [2023-03-12 04:23:44,864][124793] Updated weights for policy 0, policy_version 190480 (0.0005) [2023-03-12 04:23:46,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9762.1, 300 sec: 9538.8). Total num frames: 97533952. Throughput: 0: 9684.6. Samples: 97513536. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:23:46,005][124505] Avg episode reward: [(0, '4593.019')] [2023-03-12 04:23:49,243][124793] Updated weights for policy 0, policy_version 190560 (0.0005) [2023-03-12 04:23:51,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9693.9, 300 sec: 9538.8). Total num frames: 97583104. Throughput: 0: 9699.3. Samples: 97570276. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:23:51,005][124505] Avg episode reward: [(0, '4587.764')] [2023-03-12 04:23:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000190592_97583104.pth... [2023-03-12 04:23:51,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000190024_97292288.pth [2023-03-12 04:23:53,594][124793] Updated weights for policy 0, policy_version 190640 (0.0005) [2023-03-12 04:23:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9538.8). Total num frames: 97628160. Throughput: 0: 9702.8. Samples: 97626588. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:23:56,005][124505] Avg episode reward: [(0, '4585.083')] [2023-03-12 04:23:57,983][124793] Updated weights for policy 0, policy_version 190720 (0.0005) [2023-03-12 04:24:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9538.8). Total num frames: 97677312. Throughput: 0: 9685.9. Samples: 97654176. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:24:01,005][124505] Avg episode reward: [(0, '4597.748')] [2023-03-12 04:24:02,274][124793] Updated weights for policy 0, policy_version 190800 (0.0004) [2023-03-12 04:24:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9538.8). Total num frames: 97722368. Throughput: 0: 9625.5. Samples: 97711540. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:24:06,016][124505] Avg episode reward: [(0, '4599.149')] [2023-03-12 04:24:06,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000190864_97722368.pth... [2023-03-12 04:24:06,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000190312_97439744.pth [2023-03-12 04:24:06,638][124793] Updated weights for policy 0, policy_version 190880 (0.0005) [2023-03-12 04:24:11,005][124505] Fps is (10 sec: 9011.3, 60 sec: 9557.3, 300 sec: 9524.9). Total num frames: 97767424. Throughput: 0: 9544.5. Samples: 97767436. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 04:24:11,016][124505] Avg episode reward: [(0, '4590.394')] [2023-03-12 04:24:11,063][124793] Updated weights for policy 0, policy_version 190960 (0.0005) [2023-03-12 04:24:15,424][124793] Updated weights for policy 0, policy_version 191040 (0.0005) [2023-03-12 04:24:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9538.8). Total num frames: 97816576. Throughput: 0: 9505.5. Samples: 97795580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:24:16,005][124505] Avg episode reward: [(0, '4602.480')] [2023-03-12 04:24:19,820][124793] Updated weights for policy 0, policy_version 191120 (0.0005) [2023-03-12 04:24:21,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9524.9). Total num frames: 97861632. Throughput: 0: 9418.5. Samples: 97851352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:24:21,005][124505] Avg episode reward: [(0, '4598.399')] [2023-03-12 04:24:21,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000191136_97861632.pth... [2023-03-12 04:24:21,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000190592_97583104.pth [2023-03-12 04:24:24,144][124793] Updated weights for policy 0, policy_version 191200 (0.0005) [2023-03-12 04:24:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9538.8). Total num frames: 97910784. Throughput: 0: 9393.3. Samples: 97907736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:24:26,016][124505] Avg episode reward: [(0, '4597.582')] [2023-03-12 04:24:28,571][124793] Updated weights for policy 0, policy_version 191280 (0.0005) [2023-03-12 04:24:31,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 97955840. Throughput: 0: 9375.3. Samples: 97935424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:24:31,016][124505] Avg episode reward: [(0, '4591.798')] [2023-03-12 04:24:32,674][124793] Updated weights for policy 0, policy_version 191360 (0.0004) [2023-03-12 04:24:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9538.8). Total num frames: 98009088. Throughput: 0: 9451.6. Samples: 97995600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:24:36,016][124505] Avg episode reward: [(0, '4597.139')] [2023-03-12 04:24:36,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000191424_98009088.pth... [2023-03-12 04:24:36,021][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000190864_97722368.pth [2023-03-12 04:24:36,785][124793] Updated weights for policy 0, policy_version 191440 (0.0004) [2023-03-12 04:24:40,906][124793] Updated weights for policy 0, policy_version 191520 (0.0005) [2023-03-12 04:24:41,005][124505] Fps is (10 sec: 10240.0, 60 sec: 9489.1, 300 sec: 9538.8). Total num frames: 98058240. Throughput: 0: 9522.0. Samples: 98055076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:24:41,016][124505] Avg episode reward: [(0, '4596.488')] [2023-03-12 04:24:45,259][124793] Updated weights for policy 0, policy_version 191600 (0.0005) [2023-03-12 04:24:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9524.9). Total num frames: 98103296. Throughput: 0: 9538.0. Samples: 98083388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:24:46,016][124505] Avg episode reward: [(0, '4596.899')] [2023-03-12 04:24:49,643][124793] Updated weights for policy 0, policy_version 191680 (0.0005) [2023-03-12 04:24:51,005][124505] Fps is (10 sec: 9420.6, 60 sec: 9489.0, 300 sec: 9511.0). Total num frames: 98152448. Throughput: 0: 9521.0. Samples: 98139988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:24:51,007][124505] Avg episode reward: [(0, '4601.819')] [2023-03-12 04:24:51,011][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000191704_98152448.pth... [2023-03-12 04:24:51,013][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000191136_97861632.pth [2023-03-12 04:24:53,963][124793] Updated weights for policy 0, policy_version 191760 (0.0005) [2023-03-12 04:24:56,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9511.0). Total num frames: 98197504. Throughput: 0: 9548.0. Samples: 98197096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:24:56,005][124505] Avg episode reward: [(0, '4590.362')] [2023-03-12 04:24:58,347][124793] Updated weights for policy 0, policy_version 191840 (0.0005) [2023-03-12 04:25:01,005][124505] Fps is (10 sec: 9421.0, 60 sec: 9489.1, 300 sec: 9497.2). Total num frames: 98246656. Throughput: 0: 9527.6. Samples: 98224324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:25:01,005][124505] Avg episode reward: [(0, '4598.477')] [2023-03-12 04:25:02,716][124793] Updated weights for policy 0, policy_version 191920 (0.0005) [2023-03-12 04:25:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9497.2). Total num frames: 98291712. Throughput: 0: 9520.8. Samples: 98279788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:25:06,006][124505] Avg episode reward: [(0, '4595.127')] [2023-03-12 04:25:06,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000191976_98291712.pth... [2023-03-12 04:25:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000191424_98009088.pth [2023-03-12 04:25:07,102][124793] Updated weights for policy 0, policy_version 192000 (0.0005) [2023-03-12 04:25:11,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9483.3). Total num frames: 98336768. Throughput: 0: 9534.2. Samples: 98336776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:25:11,005][124505] Avg episode reward: [(0, '4597.726')] [2023-03-12 04:25:11,535][124793] Updated weights for policy 0, policy_version 192080 (0.0005) [2023-03-12 04:25:15,658][124793] Updated weights for policy 0, policy_version 192160 (0.0004) [2023-03-12 04:25:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9497.2). Total num frames: 98385920. Throughput: 0: 9549.0. Samples: 98365128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:25:16,005][124505] Avg episode reward: [(0, '4591.884')] [2023-03-12 04:25:19,766][124793] Updated weights for policy 0, policy_version 192240 (0.0004) [2023-03-12 04:25:21,005][124505] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9511.0). Total num frames: 98435072. Throughput: 0: 9539.4. Samples: 98424872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:25:21,005][124505] Avg episode reward: [(0, '4592.167')] [2023-03-12 04:25:21,036][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000192264_98439168.pth... [2023-03-12 04:25:21,038][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000191704_98152448.pth [2023-03-12 04:25:23,976][124793] Updated weights for policy 0, policy_version 192320 (0.0005) [2023-03-12 04:25:26,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9511.0). Total num frames: 98484224. Throughput: 0: 9534.0. Samples: 98484108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:25:26,005][124505] Avg episode reward: [(0, '4596.447')] [2023-03-12 04:25:28,070][124793] Updated weights for policy 0, policy_version 192400 (0.0005) [2023-03-12 04:25:31,005][124505] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9524.9). Total num frames: 98533376. Throughput: 0: 9566.9. Samples: 98513896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:25:31,005][124505] Avg episode reward: [(0, '4593.873')] [2023-03-12 04:25:32,431][124793] Updated weights for policy 0, policy_version 192480 (0.0005) [2023-03-12 04:25:36,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9538.8). Total num frames: 98582528. Throughput: 0: 9558.2. Samples: 98570104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:25:36,016][124505] Avg episode reward: [(0, '4594.641')] [2023-03-12 04:25:36,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000192544_98582528.pth... [2023-03-12 04:25:36,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000191976_98291712.pth [2023-03-12 04:25:36,865][124793] Updated weights for policy 0, policy_version 192560 (0.0005) [2023-03-12 04:25:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9524.9). Total num frames: 98627584. Throughput: 0: 9502.8. Samples: 98624720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:25:41,016][124505] Avg episode reward: [(0, '4590.102')] [2023-03-12 04:25:41,341][124793] Updated weights for policy 0, policy_version 192640 (0.0005) [2023-03-12 04:25:45,839][124793] Updated weights for policy 0, policy_version 192720 (0.0005) [2023-03-12 04:25:46,005][124505] Fps is (10 sec: 9011.3, 60 sec: 9489.1, 300 sec: 9524.9). Total num frames: 98672640. Throughput: 0: 9507.7. Samples: 98652168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:25:46,016][124505] Avg episode reward: [(0, '4587.363')] [2023-03-12 04:25:50,353][124793] Updated weights for policy 0, policy_version 192800 (0.0005) [2023-03-12 04:25:51,005][124505] Fps is (10 sec: 9011.1, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 98717696. Throughput: 0: 9477.9. Samples: 98706292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:25:51,016][124505] Avg episode reward: [(0, '4586.896')] [2023-03-12 04:25:51,020][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000192808_98717696.pth... [2023-03-12 04:25:51,023][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000192264_98439168.pth [2023-03-12 04:25:54,927][124793] Updated weights for policy 0, policy_version 192880 (0.0005) [2023-03-12 04:25:56,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9511.1). Total num frames: 98762752. Throughput: 0: 9414.4. Samples: 98760424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:25:56,016][124505] Avg episode reward: [(0, '4595.449')] [2023-03-12 04:25:59,527][124793] Updated weights for policy 0, policy_version 192960 (0.0005) [2023-03-12 04:26:01,005][124505] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9511.1). Total num frames: 98807808. Throughput: 0: 9382.5. Samples: 98787340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:26:01,016][124505] Avg episode reward: [(0, '4589.573')] [2023-03-12 04:26:03,939][124793] Updated weights for policy 0, policy_version 193040 (0.0005) [2023-03-12 04:26:06,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9497.2). Total num frames: 98852864. Throughput: 0: 9285.4. Samples: 98842716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:26:06,016][124505] Avg episode reward: [(0, '4602.783')] [2023-03-12 04:26:06,020][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000193072_98852864.pth... [2023-03-12 04:26:06,023][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000192544_98582528.pth [2023-03-12 04:26:08,405][124793] Updated weights for policy 0, policy_version 193120 (0.0005) [2023-03-12 04:26:11,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9497.2). Total num frames: 98897920. Throughput: 0: 9182.9. Samples: 98897336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:26:11,016][124505] Avg episode reward: [(0, '4595.335')] [2023-03-12 04:26:12,933][124793] Updated weights for policy 0, policy_version 193200 (0.0005) [2023-03-12 04:26:16,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9497.2). Total num frames: 98942976. Throughput: 0: 9118.5. Samples: 98924228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:26:16,016][124505] Avg episode reward: [(0, '4592.069')] [2023-03-12 04:26:17,324][124793] Updated weights for policy 0, policy_version 193280 (0.0005) [2023-03-12 04:26:21,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9497.2). Total num frames: 98992128. Throughput: 0: 9106.8. Samples: 98979912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:26:21,016][124505] Avg episode reward: [(0, '4588.736')] [2023-03-12 04:26:21,019][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000193344_98992128.pth... [2023-03-12 04:26:21,022][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000192808_98717696.pth [2023-03-12 04:26:21,809][124793] Updated weights for policy 0, policy_version 193360 (0.0005) [2023-03-12 04:26:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9497.2). Total num frames: 99037184. Throughput: 0: 9131.9. Samples: 99035656. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:26:26,016][124505] Avg episode reward: [(0, '4589.686')] [2023-03-12 04:26:26,221][124793] Updated weights for policy 0, policy_version 193440 (0.0005) [2023-03-12 04:26:30,641][124793] Updated weights for policy 0, policy_version 193520 (0.0005) [2023-03-12 04:26:31,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9483.3). Total num frames: 99082240. Throughput: 0: 9139.8. Samples: 99063460. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:26:31,016][124505] Avg episode reward: [(0, '4589.570')] [2023-03-12 04:26:35,035][124793] Updated weights for policy 0, policy_version 193600 (0.0005) [2023-03-12 04:26:36,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9497.2). Total num frames: 99131392. Throughput: 0: 9174.0. Samples: 99119120. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:26:36,016][124505] Avg episode reward: [(0, '4588.474')] [2023-03-12 04:26:36,018][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000193616_99131392.pth... [2023-03-12 04:26:36,020][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000193072_98852864.pth [2023-03-12 04:26:39,463][124793] Updated weights for policy 0, policy_version 193680 (0.0005) [2023-03-12 04:26:41,005][124505] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9497.2). Total num frames: 99176448. Throughput: 0: 9223.5. Samples: 99175480. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:26:41,016][124505] Avg episode reward: [(0, '4591.352')] [2023-03-12 04:26:43,592][124793] Updated weights for policy 0, policy_version 193760 (0.0004) [2023-03-12 04:26:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9497.2). Total num frames: 99225600. Throughput: 0: 9284.2. Samples: 99205128. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:26:46,005][124505] Avg episode reward: [(0, '4602.469')] [2023-03-12 04:26:47,720][124793] Updated weights for policy 0, policy_version 193840 (0.0004) [2023-03-12 04:26:51,005][124505] Fps is (10 sec: 10239.9, 60 sec: 9352.5, 300 sec: 9524.9). Total num frames: 99278848. Throughput: 0: 9380.2. Samples: 99264824. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:26:51,005][124505] Avg episode reward: [(0, '4597.291')] [2023-03-12 04:26:51,009][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000193904_99278848.pth... [2023-03-12 04:26:51,010][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000193344_98992128.pth [2023-03-12 04:26:51,831][124793] Updated weights for policy 0, policy_version 193920 (0.0004) [2023-03-12 04:26:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9511.1). Total num frames: 99323904. Throughput: 0: 9436.2. Samples: 99321964. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:26:56,005][124505] Avg episode reward: [(0, '4603.831')] [2023-03-12 04:26:56,239][124793] Updated weights for policy 0, policy_version 194000 (0.0005) [2023-03-12 04:27:00,445][124793] Updated weights for policy 0, policy_version 194080 (0.0004) [2023-03-12 04:27:01,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 99373056. Throughput: 0: 9473.9. Samples: 99350552. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:27:01,005][124505] Avg episode reward: [(0, '4592.562')] [2023-03-12 04:27:04,716][124793] Updated weights for policy 0, policy_version 194160 (0.0005) [2023-03-12 04:27:06,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9524.9). Total num frames: 99418112. Throughput: 0: 9524.8. Samples: 99408528. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:27:06,005][124505] Avg episode reward: [(0, '4599.144')] [2023-03-12 04:27:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000194176_99418112.pth... [2023-03-12 04:27:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000193616_99131392.pth [2023-03-12 04:27:09,155][124793] Updated weights for policy 0, policy_version 194240 (0.0005) [2023-03-12 04:27:11,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9524.9). Total num frames: 99467264. Throughput: 0: 9531.8. Samples: 99464588. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:27:11,005][124505] Avg episode reward: [(0, '4596.345')] [2023-03-12 04:27:13,516][124793] Updated weights for policy 0, policy_version 194320 (0.0005) [2023-03-12 04:27:16,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9524.9). Total num frames: 99512320. Throughput: 0: 9529.5. Samples: 99492288. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:27:16,005][124505] Avg episode reward: [(0, '4585.558')] [2023-03-12 04:27:17,985][124793] Updated weights for policy 0, policy_version 194400 (0.0005) [2023-03-12 04:27:21,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9511.1). Total num frames: 99557376. Throughput: 0: 9535.5. Samples: 99548216. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:27:21,005][124505] Avg episode reward: [(0, '4593.333')] [2023-03-12 04:27:21,023][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000194456_99561472.pth... [2023-03-12 04:27:21,024][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000193904_99278848.pth [2023-03-12 04:27:22,384][124793] Updated weights for policy 0, policy_version 194480 (0.0005) [2023-03-12 04:27:26,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9511.1). Total num frames: 99606528. Throughput: 0: 9515.2. Samples: 99603664. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 04:27:26,005][124505] Avg episode reward: [(0, '4585.862')] [2023-03-12 04:27:26,794][124793] Updated weights for policy 0, policy_version 194560 (0.0005) [2023-03-12 04:27:31,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9497.2). Total num frames: 99651584. Throughput: 0: 9467.6. Samples: 99631168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:27:31,005][124505] Avg episode reward: [(0, '4606.376')] [2023-03-12 04:27:31,287][124793] Updated weights for policy 0, policy_version 194640 (0.0005) [2023-03-12 04:27:35,588][124793] Updated weights for policy 0, policy_version 194720 (0.0004) [2023-03-12 04:27:36,005][124505] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9483.3). Total num frames: 99696640. Throughput: 0: 9381.2. Samples: 99686976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:27:36,005][124505] Avg episode reward: [(0, '4592.653')] [2023-03-12 04:27:36,028][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000194728_99700736.pth... [2023-03-12 04:27:36,032][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000194176_99418112.pth [2023-03-12 04:27:39,979][124793] Updated weights for policy 0, policy_version 194800 (0.0005) [2023-03-12 04:27:41,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9483.3). Total num frames: 99745792. Throughput: 0: 9361.4. Samples: 99743228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:27:41,005][124505] Avg episode reward: [(0, '4591.813')] [2023-03-12 04:27:44,417][124793] Updated weights for policy 0, policy_version 194880 (0.0005) [2023-03-12 04:27:46,005][124505] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 99790848. Throughput: 0: 9331.4. Samples: 99770464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:27:46,005][124505] Avg episode reward: [(0, '4588.989')] [2023-03-12 04:27:48,650][124793] Updated weights for policy 0, policy_version 194960 (0.0005) [2023-03-12 04:27:51,005][124505] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9455.5). Total num frames: 99840000. Throughput: 0: 9325.6. Samples: 99828180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:27:51,005][124505] Avg episode reward: [(0, '4593.335')] [2023-03-12 04:27:51,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000195000_99840000.pth... [2023-03-12 04:27:51,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000194456_99561472.pth [2023-03-12 04:27:52,859][124793] Updated weights for policy 0, policy_version 195040 (0.0005) [2023-03-12 04:27:56,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9455.5). Total num frames: 99889152. Throughput: 0: 9375.6. Samples: 99886492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:27:56,005][124505] Avg episode reward: [(0, '4589.173')] [2023-03-12 04:27:57,142][124793] Updated weights for policy 0, policy_version 195120 (0.0006) [2023-03-12 04:28:01,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9469.4). Total num frames: 99938304. Throughput: 0: 9406.3. Samples: 99915572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:28:01,005][124505] Avg episode reward: [(0, '4603.615')] [2023-03-12 04:28:01,296][124793] Updated weights for policy 0, policy_version 195200 (0.0005) [2023-03-12 04:28:05,388][124793] Updated weights for policy 0, policy_version 195280 (0.0005) [2023-03-12 04:28:06,005][124505] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9469.4). Total num frames: 99987456. Throughput: 0: 9489.4. Samples: 99975240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 04:28:06,005][124505] Avg episode reward: [(0, '4592.449')] [2023-03-12 04:28:06,008][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000195288_99987456.pth... [2023-03-12 04:28:06,011][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000194728_99700736.pth [2023-03-12 04:28:07,482][124749] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000000 [2023-03-12 04:28:07,908][124749] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000000 [2023-03-12 04:28:07,908][124797] Stopping RolloutWorker_w4... [2023-03-12 04:28:07,908][124795] Stopping RolloutWorker_w1... [2023-03-12 04:28:07,908][124798] Stopping RolloutWorker_w5... [2023-03-12 04:28:07,908][124796] Stopping RolloutWorker_w2... [2023-03-12 04:28:07,908][124800] Stopping RolloutWorker_w6... [2023-03-12 04:28:07,909][124797] Loop rollout_proc4_evt_loop terminating... [2023-03-12 04:28:07,909][124795] Loop rollout_proc1_evt_loop terminating... [2023-03-12 04:28:07,909][124794] Stopping RolloutWorker_w0... [2023-03-12 04:28:07,909][124798] Loop rollout_proc5_evt_loop terminating... [2023-03-12 04:28:07,909][124799] Stopping RolloutWorker_w3... [2023-03-12 04:28:07,909][124796] Loop rollout_proc2_evt_loop terminating... [2023-03-12 04:28:07,909][124800] Loop rollout_proc6_evt_loop terminating... [2023-03-12 04:28:07,909][124832] Stopping RolloutWorker_w7... [2023-03-12 04:28:07,909][124794] Loop rollout_proc0_evt_loop terminating... [2023-03-12 04:28:07,909][124799] Loop rollout_proc3_evt_loop terminating... [2023-03-12 04:28:07,909][124832] Loop rollout_proc7_evt_loop terminating... [2023-03-12 04:28:07,909][124505] Component RolloutWorker_w4 stopped! [2023-03-12 04:28:07,909][124749] Stopping Batcher_0... [2023-03-12 04:28:07,909][124505] Component RolloutWorker_w1 stopped! [2023-03-12 04:28:07,909][124749] Loop batcher_evt_loop terminating... [2023-03-12 04:28:07,909][124505] Component RolloutWorker_w5 stopped! [2023-03-12 04:28:07,910][124505] Component RolloutWorker_w2 stopped! [2023-03-12 04:28:07,910][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000195328_100007936.pth... [2023-03-12 04:28:07,910][124505] Component RolloutWorker_w6 stopped! [2023-03-12 04:28:07,910][124505] Component RolloutWorker_w3 stopped! [2023-03-12 04:28:07,910][124505] Component RolloutWorker_w0 stopped! [2023-03-12 04:28:07,910][124505] Component RolloutWorker_w7 stopped! [2023-03-12 04:28:07,911][124505] Component Batcher_0 stopped! [2023-03-12 04:28:07,912][124749] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000195000_99840000.pth [2023-03-12 04:28:07,912][124749] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/window-close-v2/checkpoint_p0/checkpoint_000195328_100007936.pth... [2023-03-12 04:28:07,915][124749] Stopping LearnerWorker_p0... [2023-03-12 04:28:07,915][124749] Loop learner_proc0_evt_loop terminating... [2023-03-12 04:28:07,915][124505] Component LearnerWorker_p0 stopped! [2023-03-12 04:28:07,967][124793] Weights refcount: 2 0 [2023-03-12 04:28:07,968][124793] Stopping InferenceWorker_p0-w0... [2023-03-12 04:28:07,969][124793] Loop inference_proc0-0_evt_loop terminating... [2023-03-12 04:28:07,969][124505] Component InferenceWorker_p0-w0 stopped! [2023-03-12 04:28:07,969][124505] Waiting for process learner_proc0 to stop... [2023-03-12 04:28:08,353][124505] Waiting for process inference_proc0-0 to join... [2023-03-12 04:28:08,374][124505] Waiting for process rollout_proc0 to join... [2023-03-12 04:28:08,374][124505] Waiting for process rollout_proc1 to join... [2023-03-12 04:28:08,374][124505] Waiting for process rollout_proc2 to join... [2023-03-12 04:28:08,375][124505] Waiting for process rollout_proc3 to join... [2023-03-12 04:28:08,375][124505] Waiting for process rollout_proc4 to join... [2023-03-12 04:28:08,375][124505] Waiting for process rollout_proc5 to join... [2023-03-12 04:28:08,375][124505] Waiting for process rollout_proc6 to join... [2023-03-12 04:28:08,375][124505] Waiting for process rollout_proc7 to join... [2023-03-12 04:28:08,375][124505] Batcher 0 profile tree view: batching: 17.3625, releasing_batches: 14.5521 [2023-03-12 04:28:08,376][124505] InferenceWorker_p0-w0 profile tree view: wait_policy: 0.0051 wait_policy_total: 3960.8963 update_model: 106.5110 weight_update: 0.0005 one_step: 0.0006 handle_policy_step: 5421.5102 deserialize: 226.6502, stack: 57.3938, obs_to_device_normalize: 970.7997, forward: 2701.4406, send_messages: 380.9998 prepare_outputs: 609.5948 to_cpu: 97.0415 [2023-03-12 04:28:08,376][124505] Learner 0 profile tree view: misc: 0.0922, prepare_batch: 91.5288 train: 1183.5051 epoch_init: 0.3484, minibatch_init: 12.0109, losses_postprocess: 12.1076, kl_divergence: 4.4087, after_optimizer: 4.8578 calculate_losses: 487.2010 losses_init: 0.3070, forward_head: 241.5927, bptt_initial: 1.2498, bptt: 1.2451, tail: 114.2145, advantages_returns: 8.7950, losses: 105.7288 update: 646.7753 clip: 56.4294 [2023-03-12 04:28:08,376][124505] RolloutWorker_w0 profile tree view: wait_for_trajectories: 2.7561, enqueue_policy_requests: 125.1840, env_step: 7290.6809, overhead: 297.2556, complete_rollouts: 3.1421 save_policy_outputs: 324.4136 split_output_tensors: 160.6507 [2023-03-12 04:28:08,376][124505] RolloutWorker_w7 profile tree view: wait_for_trajectories: 2.7159, enqueue_policy_requests: 125.3256, env_step: 7302.7497, overhead: 301.6886, complete_rollouts: 3.1055 save_policy_outputs: 324.2220 split_output_tensors: 160.1439 [2023-03-12 04:28:08,376][124505] Loop Runner_EvtLoop terminating... [2023-03-12 04:28:08,377][124505] Runner profile tree view: main_loop: 10169.7890 [2023-03-12 04:28:08,377][124505] Collected {0: 100007936}, FPS: 9833.8