[2023-03-09 11:27:05,462][708628] Saving configuration to /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/config.json... [2023-03-09 11:27:05,479][708628] Rollout worker 0 uses device cpu [2023-03-09 11:27:05,479][708628] Rollout worker 1 uses device cpu [2023-03-09 11:27:05,479][708628] Rollout worker 2 uses device cpu [2023-03-09 11:27:05,479][708628] Rollout worker 3 uses device cpu [2023-03-09 11:27:05,480][708628] Rollout worker 4 uses device cpu [2023-03-09 11:27:05,480][708628] Rollout worker 5 uses device cpu [2023-03-09 11:27:05,480][708628] Rollout worker 6 uses device cpu [2023-03-09 11:27:05,480][708628] Rollout worker 7 uses device cpu [2023-03-09 11:27:05,480][708628] In synchronous mode, we only accumulate one batch. Setting num_batches_to_accumulate to 1 [2023-03-09 11:27:05,493][708628] InferenceWorker_p0-w0: min num requests: 2 [2023-03-09 11:27:05,512][708628] Starting all processes... [2023-03-09 11:27:05,512][708628] Starting process learner_proc0 [2023-03-09 11:27:05,562][708628] Starting all processes... [2023-03-09 11:27:05,608][708628] Starting process inference_proc0-0 [2023-03-09 11:27:05,608][708628] Starting process rollout_proc0 [2023-03-09 11:27:05,609][708628] Starting process rollout_proc1 [2023-03-09 11:27:05,609][708628] Starting process rollout_proc2 [2023-03-09 11:27:05,609][708628] Starting process rollout_proc3 [2023-03-09 11:27:05,609][708628] Starting process rollout_proc4 [2023-03-09 11:27:05,609][708628] Starting process rollout_proc5 [2023-03-09 11:27:05,609][708628] Starting process rollout_proc6 [2023-03-09 11:27:05,609][708628] Starting process rollout_proc7 [2023-03-09 11:27:07,183][708990] Starting seed is not provided [2023-03-09 11:27:07,184][708990] Initializing actor-critic model on device cpu [2023-03-09 11:27:07,184][708990] RunningMeanStd input shape: (39,) [2023-03-09 11:27:07,184][708990] RunningMeanStd input shape: (1,) [2023-03-09 11:27:07,274][708990] Created Actor Critic model with architecture: [2023-03-09 11:27:07,274][708990] ActorCriticSharedWeights( (obs_normalizer): ObservationNormalizer( (running_mean_std): RunningMeanStdDictInPlace( (running_mean_std): ModuleDict( (obs): RunningMeanStdInPlace() ) ) ) (returns_normalizer): RecursiveScriptModule(original_name=RunningMeanStdInPlace) (encoder): MultiInputEncoder( (encoders): ModuleDict( (obs): MlpEncoder( (mlp_head): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Linear) (1): RecursiveScriptModule(original_name=Tanh) (2): RecursiveScriptModule(original_name=Linear) (3): RecursiveScriptModule(original_name=Tanh) ) ) ) ) (core): ModelCoreIdentity() (decoder): MlpDecoder( (mlp): Identity() ) (critic_linear): Linear(in_features=64, out_features=1, bias=True) (action_parameterization): ActionParameterizationContinuousNonAdaptiveStddev( (distribution_linear): Linear(in_features=64, out_features=4, bias=True) ) ) [2023-03-09 11:27:07,367][709070] Worker 4 uses CPU cores [16, 17, 18, 19] [2023-03-09 11:27:07,400][709166] Worker 6 uses CPU cores [24, 25, 26, 27] [2023-03-09 11:27:07,573][709037] Worker 1 uses CPU cores [4, 5, 6, 7] [2023-03-09 11:27:07,592][709038] Worker 3 uses CPU cores [12, 13, 14, 15] [2023-03-09 11:27:07,649][709103] Worker 7 uses CPU cores [28, 29, 30, 31] [2023-03-09 11:27:07,651][708990] Using optimizer [2023-03-09 11:27:07,651][708990] No checkpoints found [2023-03-09 11:27:07,651][708990] Did not load from checkpoint, starting from scratch! [2023-03-09 11:27:07,651][708990] Initialized policy 0 weights for model version 0 [2023-03-09 11:27:07,652][708990] LearnerWorker_p0 finished initialization! [2023-03-09 11:27:07,653][709034] RunningMeanStd input shape: (39,) [2023-03-09 11:27:07,654][709034] RunningMeanStd input shape: (1,) [2023-03-09 11:27:07,711][708628] Inference worker 0-0 is ready! [2023-03-09 11:27:07,712][708628] All inference workers are ready! Signal rollout workers to start! [2023-03-09 11:27:07,761][709035] Worker 0 uses CPU cores [0, 1, 2, 3] [2023-03-09 11:27:07,825][709036] Worker 2 uses CPU cores [8, 9, 10, 11] [2023-03-09 11:27:07,857][708628] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 0. Throughput: 0: nan. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-09 11:27:07,991][709102] Worker 5 uses CPU cores [20, 21, 22, 23] [2023-03-09 11:27:12,538][709070] Decorrelating experience for 0 frames... [2023-03-09 11:27:12,557][709070] Decorrelating experience for 64 frames... [2023-03-09 11:27:12,603][709070] Decorrelating experience for 128 frames... [2023-03-09 11:27:12,677][709070] Decorrelating experience for 192 frames... [2023-03-09 11:27:12,691][709038] Decorrelating experience for 0 frames... [2023-03-09 11:27:12,712][709166] Decorrelating experience for 0 frames... [2023-03-09 11:27:12,714][709038] Decorrelating experience for 64 frames... [2023-03-09 11:27:12,728][709166] Decorrelating experience for 64 frames... [2023-03-09 11:27:12,735][709035] Decorrelating experience for 0 frames... [2023-03-09 11:27:12,737][709037] Decorrelating experience for 0 frames... [2023-03-09 11:27:12,751][709035] Decorrelating experience for 64 frames... [2023-03-09 11:27:12,752][709037] Decorrelating experience for 64 frames... [2023-03-09 11:27:12,759][709038] Decorrelating experience for 128 frames... [2023-03-09 11:27:12,777][709166] Decorrelating experience for 128 frames... [2023-03-09 11:27:12,795][709035] Decorrelating experience for 128 frames... [2023-03-09 11:27:12,798][709037] Decorrelating experience for 128 frames... [2023-03-09 11:27:12,839][709038] Decorrelating experience for 192 frames... [2023-03-09 11:27:12,850][709166] Decorrelating experience for 192 frames... [2023-03-09 11:27:12,857][708628] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-09 11:27:12,872][709037] Decorrelating experience for 192 frames... [2023-03-09 11:27:12,874][709035] Decorrelating experience for 192 frames... [2023-03-09 11:27:12,934][709036] Decorrelating experience for 0 frames... [2023-03-09 11:27:12,952][709036] Decorrelating experience for 64 frames... [2023-03-09 11:27:12,998][709036] Decorrelating experience for 128 frames... [2023-03-09 11:27:13,019][709102] Decorrelating experience for 0 frames... [2023-03-09 11:27:13,035][709102] Decorrelating experience for 64 frames... [2023-03-09 11:27:13,072][709036] Decorrelating experience for 192 frames... [2023-03-09 11:27:13,081][709102] Decorrelating experience for 128 frames... [2023-03-09 11:27:13,155][709102] Decorrelating experience for 192 frames... [2023-03-09 11:27:13,644][709103] Decorrelating experience for 0 frames... [2023-03-09 11:27:13,664][709103] Decorrelating experience for 64 frames... [2023-03-09 11:27:13,711][709103] Decorrelating experience for 128 frames... [2023-03-09 11:27:13,782][709103] Decorrelating experience for 192 frames... [2023-03-09 11:27:17,542][709070] Decorrelating experience for 256 frames... [2023-03-09 11:27:17,662][709166] Decorrelating experience for 256 frames... [2023-03-09 11:27:17,668][709070] Decorrelating experience for 320 frames... [2023-03-09 11:27:17,742][709037] Decorrelating experience for 256 frames... [2023-03-09 11:27:17,759][709035] Decorrelating experience for 256 frames... [2023-03-09 11:27:17,792][709166] Decorrelating experience for 320 frames... [2023-03-09 11:27:17,823][709070] Decorrelating experience for 384 frames... [2023-03-09 11:27:17,857][708628] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-09 11:27:17,859][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000000000_0.pth... [2023-03-09 11:27:17,880][709102] Decorrelating experience for 256 frames... [2023-03-09 11:27:17,883][709037] Decorrelating experience for 320 frames... [2023-03-09 11:27:17,887][709035] Decorrelating experience for 320 frames... [2023-03-09 11:27:17,952][709166] Decorrelating experience for 384 frames... [2023-03-09 11:27:17,967][709036] Decorrelating experience for 256 frames... [2023-03-09 11:27:18,005][709070] Decorrelating experience for 448 frames... [2023-03-09 11:27:18,011][709102] Decorrelating experience for 320 frames... [2023-03-09 11:27:18,043][709037] Decorrelating experience for 384 frames... [2023-03-09 11:27:18,044][709035] Decorrelating experience for 384 frames... [2023-03-09 11:27:18,111][709036] Decorrelating experience for 320 frames... [2023-03-09 11:27:18,170][709166] Decorrelating experience for 448 frames... [2023-03-09 11:27:18,176][709102] Decorrelating experience for 384 frames... [2023-03-09 11:27:18,226][709035] Decorrelating experience for 448 frames... [2023-03-09 11:27:18,247][709037] Decorrelating experience for 448 frames... [2023-03-09 11:27:18,267][709036] Decorrelating experience for 384 frames... [2023-03-09 11:27:18,360][709102] Decorrelating experience for 448 frames... [2023-03-09 11:27:18,433][709103] Decorrelating experience for 256 frames... [2023-03-09 11:27:18,453][709036] Decorrelating experience for 448 frames... [2023-03-09 11:27:18,525][709038] Decorrelating experience for 256 frames... [2023-03-09 11:27:18,560][709103] Decorrelating experience for 320 frames... [2023-03-09 11:27:18,654][709038] Decorrelating experience for 320 frames... [2023-03-09 11:27:18,715][709103] Decorrelating experience for 384 frames... [2023-03-09 11:27:18,809][709038] Decorrelating experience for 384 frames... [2023-03-09 11:27:18,921][709103] Decorrelating experience for 448 frames... [2023-03-09 11:27:18,994][709038] Decorrelating experience for 448 frames... [2023-03-09 11:27:22,857][708628] Fps is (10 sec: 2457.6, 60 sec: 1638.4, 300 sec: 1638.4). Total num frames: 24576. Throughput: 0: 1732.5. Samples: 25988. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:27:22,858][708628] Avg episode reward: [(0, '7.626')] [2023-03-09 11:27:24,574][709034] Updated weights for policy 0, policy_version 80 (0.0005) [2023-03-09 11:27:25,488][708628] Heartbeat connected on Batcher_0 [2023-03-09 11:27:25,490][708628] Heartbeat connected on LearnerWorker_p0 [2023-03-09 11:27:25,494][708628] Heartbeat connected on InferenceWorker_p0-w0 [2023-03-09 11:27:25,502][708628] Heartbeat connected on RolloutWorker_w1 [2023-03-09 11:27:25,503][708628] Heartbeat connected on RolloutWorker_w3 [2023-03-09 11:27:25,504][708628] Heartbeat connected on RolloutWorker_w0 [2023-03-09 11:27:25,505][708628] Heartbeat connected on RolloutWorker_w2 [2023-03-09 11:27:25,507][708628] Heartbeat connected on RolloutWorker_w5 [2023-03-09 11:27:25,510][708628] Heartbeat connected on RolloutWorker_w4 [2023-03-09 11:27:25,513][708628] Heartbeat connected on RolloutWorker_w6 [2023-03-09 11:27:25,518][708628] Heartbeat connected on RolloutWorker_w7 [2023-03-09 11:27:27,857][708628] Fps is (10 sec: 6144.0, 60 sec: 3072.0, 300 sec: 3072.0). Total num frames: 61440. Throughput: 0: 2481.6. Samples: 49632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:27:27,858][708628] Avg episode reward: [(0, '26.197')] [2023-03-09 11:27:30,069][709034] Updated weights for policy 0, policy_version 160 (0.0005) [2023-03-09 11:27:32,857][708628] Fps is (10 sec: 7782.4, 60 sec: 4096.0, 300 sec: 4096.0). Total num frames: 102400. Throughput: 0: 3851.8. Samples: 96296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:27:32,858][708628] Avg episode reward: [(0, '38.117')] [2023-03-09 11:27:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000000200_102400.pth... [2023-03-09 11:27:32,863][708990] Saving new best policy, reward=38.117! [2023-03-09 11:27:35,018][709034] Updated weights for policy 0, policy_version 240 (0.0005) [2023-03-09 11:27:37,857][708628] Fps is (10 sec: 8601.5, 60 sec: 4915.2, 300 sec: 4915.2). Total num frames: 147456. Throughput: 0: 4913.7. Samples: 147412. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:27:37,858][708628] Avg episode reward: [(0, '36.690')] [2023-03-09 11:27:39,664][709034] Updated weights for policy 0, policy_version 320 (0.0006) [2023-03-09 11:27:42,857][708628] Fps is (10 sec: 8601.7, 60 sec: 5383.3, 300 sec: 5383.3). Total num frames: 188416. Throughput: 0: 4959.7. Samples: 173588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:27:42,857][708628] Avg episode reward: [(0, '24.480')] [2023-03-09 11:27:44,523][709034] Updated weights for policy 0, policy_version 400 (0.0005) [2023-03-09 11:27:47,857][708628] Fps is (10 sec: 7782.5, 60 sec: 5632.0, 300 sec: 5632.0). Total num frames: 225280. Throughput: 0: 5525.7. Samples: 221028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:27:47,858][708628] Avg episode reward: [(0, '43.231')] [2023-03-09 11:27:47,876][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000000448_229376.pth... [2023-03-09 11:27:47,878][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000000000_0.pth [2023-03-09 11:27:47,878][708990] Saving new best policy, reward=43.231! [2023-03-09 11:27:49,864][709034] Updated weights for policy 0, policy_version 480 (0.0005) [2023-03-09 11:27:52,857][708628] Fps is (10 sec: 7782.4, 60 sec: 5916.5, 300 sec: 5916.5). Total num frames: 266240. Throughput: 0: 5984.5. Samples: 269300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:27:52,858][708628] Avg episode reward: [(0, '58.098')] [2023-03-09 11:27:52,858][708990] Saving new best policy, reward=58.098! [2023-03-09 11:27:55,218][709034] Updated weights for policy 0, policy_version 560 (0.0005) [2023-03-09 11:27:57,857][708628] Fps is (10 sec: 7782.4, 60 sec: 6062.1, 300 sec: 6062.1). Total num frames: 303104. Throughput: 0: 6462.8. Samples: 290828. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:27:57,858][708628] Avg episode reward: [(0, '59.051')] [2023-03-09 11:27:57,878][708990] Saving new best policy, reward=59.051! [2023-03-09 11:28:00,873][709034] Updated weights for policy 0, policy_version 640 (0.0005) [2023-03-09 11:28:02,857][708628] Fps is (10 sec: 7372.7, 60 sec: 6181.2, 300 sec: 6181.2). Total num frames: 339968. Throughput: 0: 7434.7. Samples: 334560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:28:02,858][708628] Avg episode reward: [(0, '61.786')] [2023-03-09 11:28:02,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000000664_339968.pth... [2023-03-09 11:28:02,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000000200_102400.pth [2023-03-09 11:28:02,866][708990] Saving new best policy, reward=61.786! [2023-03-09 11:28:06,790][709034] Updated weights for policy 0, policy_version 720 (0.0005) [2023-03-09 11:28:07,857][708628] Fps is (10 sec: 6963.2, 60 sec: 6212.3, 300 sec: 6212.3). Total num frames: 372736. Throughput: 0: 7777.6. Samples: 375980. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:28:07,858][708628] Avg episode reward: [(0, '79.645')] [2023-03-09 11:28:07,858][708990] Saving new best policy, reward=79.645! [2023-03-09 11:28:12,570][709034] Updated weights for policy 0, policy_version 800 (0.0006) [2023-03-09 11:28:12,857][708628] Fps is (10 sec: 6963.3, 60 sec: 6826.7, 300 sec: 6301.5). Total num frames: 409600. Throughput: 0: 7693.0. Samples: 395816. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 11:28:12,858][708628] Avg episode reward: [(0, '77.306')] [2023-03-09 11:28:17,647][709034] Updated weights for policy 0, policy_version 880 (0.0006) [2023-03-09 11:28:17,857][708628] Fps is (10 sec: 7782.4, 60 sec: 7509.3, 300 sec: 6436.6). Total num frames: 450560. Throughput: 0: 7699.9. Samples: 442792. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 11:28:17,858][708628] Avg episode reward: [(0, '71.252')] [2023-03-09 11:28:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000000880_450560.pth... [2023-03-09 11:28:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000000448_229376.pth [2023-03-09 11:28:22,199][709034] Updated weights for policy 0, policy_version 960 (0.0005) [2023-03-09 11:28:22,857][708628] Fps is (10 sec: 8601.6, 60 sec: 7850.7, 300 sec: 6608.2). Total num frames: 495616. Throughput: 0: 7739.8. Samples: 495704. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:28:22,858][708628] Avg episode reward: [(0, '72.907')] [2023-03-09 11:28:26,905][709034] Updated weights for policy 0, policy_version 1040 (0.0006) [2023-03-09 11:28:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 7987.2, 300 sec: 6758.4). Total num frames: 540672. Throughput: 0: 7787.5. Samples: 524028. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:28:27,858][708628] Avg episode reward: [(0, '87.136')] [2023-03-09 11:28:27,858][708990] Saving new best policy, reward=87.136! [2023-03-09 11:28:31,595][709034] Updated weights for policy 0, policy_version 1120 (0.0005) [2023-03-09 11:28:32,857][708628] Fps is (10 sec: 8601.6, 60 sec: 7987.2, 300 sec: 6842.7). Total num frames: 581632. Throughput: 0: 7863.9. Samples: 574904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:28:32,858][708628] Avg episode reward: [(0, '110.333')] [2023-03-09 11:28:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000001136_581632.pth... [2023-03-09 11:28:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000000664_339968.pth [2023-03-09 11:28:32,865][708990] Saving new best policy, reward=110.333! [2023-03-09 11:28:36,662][709034] Updated weights for policy 0, policy_version 1200 (0.0005) [2023-03-09 11:28:37,857][708628] Fps is (10 sec: 8191.9, 60 sec: 7918.9, 300 sec: 6917.7). Total num frames: 622592. Throughput: 0: 7883.4. Samples: 624052. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:28:37,858][708628] Avg episode reward: [(0, '110.955')] [2023-03-09 11:28:37,858][708990] Saving new best policy, reward=110.955! [2023-03-09 11:28:41,586][709034] Updated weights for policy 0, policy_version 1280 (0.0004) [2023-03-09 11:28:42,857][708628] Fps is (10 sec: 8192.0, 60 sec: 7918.9, 300 sec: 6984.8). Total num frames: 663552. Throughput: 0: 7957.6. Samples: 648920. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:28:42,858][708628] Avg episode reward: [(0, '121.596')] [2023-03-09 11:28:42,883][708990] Saving new best policy, reward=121.596! [2023-03-09 11:28:46,102][709034] Updated weights for policy 0, policy_version 1360 (0.0005) [2023-03-09 11:28:47,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8123.7, 300 sec: 7127.0). Total num frames: 712704. Throughput: 0: 8204.4. Samples: 703756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:28:47,858][708628] Avg episode reward: [(0, '119.706')] [2023-03-09 11:28:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000001392_712704.pth... [2023-03-09 11:28:47,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000000880_450560.pth [2023-03-09 11:28:50,672][709034] Updated weights for policy 0, policy_version 1440 (0.0005) [2023-03-09 11:28:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 8192.0, 300 sec: 7216.8). Total num frames: 757760. Throughput: 0: 8481.5. Samples: 757648. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:28:52,858][708628] Avg episode reward: [(0, '111.035')] [2023-03-09 11:28:54,997][709034] Updated weights for policy 0, policy_version 1520 (0.0005) [2023-03-09 11:28:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8328.5, 300 sec: 7298.3). Total num frames: 802816. Throughput: 0: 8662.1. Samples: 785608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:28:57,858][708628] Avg episode reward: [(0, '59.223')] [2023-03-09 11:28:59,687][709034] Updated weights for policy 0, policy_version 1600 (0.0005) [2023-03-09 11:29:02,857][708628] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 7337.2). Total num frames: 843776. Throughput: 0: 8736.4. Samples: 835932. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:29:02,858][708628] Avg episode reward: [(0, '77.697')] [2023-03-09 11:29:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000001648_843776.pth... [2023-03-09 11:29:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000001136_581632.pth [2023-03-09 11:29:04,489][709034] Updated weights for policy 0, policy_version 1680 (0.0005) [2023-03-09 11:29:07,857][708628] Fps is (10 sec: 8191.9, 60 sec: 8533.3, 300 sec: 7372.8). Total num frames: 884736. Throughput: 0: 8712.2. Samples: 887752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:29:07,858][708628] Avg episode reward: [(0, '103.650')] [2023-03-09 11:29:09,353][709034] Updated weights for policy 0, policy_version 1760 (0.0005) [2023-03-09 11:29:12,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 7438.3). Total num frames: 929792. Throughput: 0: 8651.6. Samples: 913352. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:29:12,858][708628] Avg episode reward: [(0, '103.229')] [2023-03-09 11:29:14,039][709034] Updated weights for policy 0, policy_version 1840 (0.0005) [2023-03-09 11:29:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 7498.8). Total num frames: 974848. Throughput: 0: 8704.9. Samples: 966624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:29:17,858][708628] Avg episode reward: [(0, '109.343')] [2023-03-09 11:29:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000001904_974848.pth... [2023-03-09 11:29:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000001392_712704.pth [2023-03-09 11:29:18,832][709034] Updated weights for policy 0, policy_version 1920 (0.0005) [2023-03-09 11:29:22,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 7524.5). Total num frames: 1015808. Throughput: 0: 8716.9. Samples: 1016312. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:29:22,858][708628] Avg episode reward: [(0, '104.427')] [2023-03-09 11:29:23,641][709034] Updated weights for policy 0, policy_version 2000 (0.0005) [2023-03-09 11:29:27,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 7577.6). Total num frames: 1060864. Throughput: 0: 8727.3. Samples: 1041648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:29:27,858][708628] Avg episode reward: [(0, '123.020')] [2023-03-09 11:29:27,858][708990] Saving new best policy, reward=123.020! [2023-03-09 11:29:28,250][709034] Updated weights for policy 0, policy_version 2080 (0.0005) [2023-03-09 11:29:32,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 7598.8). Total num frames: 1101824. Throughput: 0: 8693.8. Samples: 1094980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:29:32,858][708628] Avg episode reward: [(0, '103.180')] [2023-03-09 11:29:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000002152_1101824.pth... [2023-03-09 11:29:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000001648_843776.pth [2023-03-09 11:29:33,189][709034] Updated weights for policy 0, policy_version 2160 (0.0005) [2023-03-09 11:29:37,857][708628] Fps is (10 sec: 7782.4, 60 sec: 8601.6, 300 sec: 7591.3). Total num frames: 1138688. Throughput: 0: 8516.9. Samples: 1140908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:29:37,858][708628] Avg episode reward: [(0, '121.824')] [2023-03-09 11:29:38,621][709034] Updated weights for policy 0, policy_version 2240 (0.0005) [2023-03-09 11:29:42,857][708628] Fps is (10 sec: 7782.5, 60 sec: 8601.6, 300 sec: 7610.6). Total num frames: 1179648. Throughput: 0: 8392.3. Samples: 1163264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:29:42,858][708628] Avg episode reward: [(0, '123.898')] [2023-03-09 11:29:42,858][708990] Saving new best policy, reward=123.898! [2023-03-09 11:29:43,892][709034] Updated weights for policy 0, policy_version 2320 (0.0006) [2023-03-09 11:29:47,857][708628] Fps is (10 sec: 7782.4, 60 sec: 8396.8, 300 sec: 7603.2). Total num frames: 1216512. Throughput: 0: 8337.3. Samples: 1211112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:29:47,858][708628] Avg episode reward: [(0, '150.109')] [2023-03-09 11:29:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000002376_1216512.pth... [2023-03-09 11:29:47,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000001904_974848.pth [2023-03-09 11:29:47,862][708990] Saving new best policy, reward=150.109! [2023-03-09 11:29:48,999][709034] Updated weights for policy 0, policy_version 2400 (0.0005) [2023-03-09 11:29:52,857][708628] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 7645.9). Total num frames: 1261568. Throughput: 0: 8294.5. Samples: 1261004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:29:52,858][708628] Avg episode reward: [(0, '221.163')] [2023-03-09 11:29:52,858][708990] Saving new best policy, reward=221.163! [2023-03-09 11:29:53,716][709034] Updated weights for policy 0, policy_version 2480 (0.0005) [2023-03-09 11:29:57,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8328.5, 300 sec: 7661.9). Total num frames: 1302528. Throughput: 0: 8283.6. Samples: 1286112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:29:57,858][708628] Avg episode reward: [(0, '239.851')] [2023-03-09 11:29:57,858][708990] Saving new best policy, reward=239.851! [2023-03-09 11:29:58,723][709034] Updated weights for policy 0, policy_version 2560 (0.0004) [2023-03-09 11:30:02,857][708628] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 7677.1). Total num frames: 1343488. Throughput: 0: 8215.9. Samples: 1336340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:30:02,858][708628] Avg episode reward: [(0, '229.941')] [2023-03-09 11:30:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000002624_1343488.pth... [2023-03-09 11:30:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000002152_1101824.pth [2023-03-09 11:30:03,429][709034] Updated weights for policy 0, policy_version 2640 (0.0005) [2023-03-09 11:30:07,857][708628] Fps is (10 sec: 8192.0, 60 sec: 8328.5, 300 sec: 7691.4). Total num frames: 1384448. Throughput: 0: 8268.1. Samples: 1388376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:30:07,858][708628] Avg episode reward: [(0, '255.481')] [2023-03-09 11:30:07,872][708990] Saving new best policy, reward=255.481! [2023-03-09 11:30:08,403][709034] Updated weights for policy 0, policy_version 2720 (0.0006) [2023-03-09 11:30:12,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8328.5, 300 sec: 7727.0). Total num frames: 1429504. Throughput: 0: 8255.2. Samples: 1413132. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:30:12,858][708628] Avg episode reward: [(0, '308.733')] [2023-03-09 11:30:12,858][708990] Saving new best policy, reward=308.733! [2023-03-09 11:30:13,190][709034] Updated weights for policy 0, policy_version 2800 (0.0005) [2023-03-09 11:30:17,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8260.3, 300 sec: 7739.3). Total num frames: 1470464. Throughput: 0: 8191.7. Samples: 1463608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:30:17,858][708628] Avg episode reward: [(0, '358.154')] [2023-03-09 11:30:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000002872_1470464.pth... [2023-03-09 11:30:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000002376_1216512.pth [2023-03-09 11:30:17,864][708990] Saving new best policy, reward=358.154! [2023-03-09 11:30:18,031][709034] Updated weights for policy 0, policy_version 2880 (0.0006) [2023-03-09 11:30:22,387][709034] Updated weights for policy 0, policy_version 2960 (0.0005) [2023-03-09 11:30:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8396.8, 300 sec: 7792.9). Total num frames: 1519616. Throughput: 0: 8415.7. Samples: 1519616. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:30:22,858][708628] Avg episode reward: [(0, '455.765')] [2023-03-09 11:30:22,859][708990] Saving new best policy, reward=455.765! [2023-03-09 11:30:26,646][709034] Updated weights for policy 0, policy_version 3040 (0.0005) [2023-03-09 11:30:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 8396.8, 300 sec: 7823.4). Total num frames: 1564672. Throughput: 0: 8546.7. Samples: 1547864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:30:27,858][708628] Avg episode reward: [(0, '518.168')] [2023-03-09 11:30:27,858][708990] Saving new best policy, reward=518.168! [2023-03-09 11:30:31,082][709034] Updated weights for policy 0, policy_version 3120 (0.0005) [2023-03-09 11:30:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8465.1, 300 sec: 7852.3). Total num frames: 1609728. Throughput: 0: 8712.0. Samples: 1603152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:30:32,858][708628] Avg episode reward: [(0, '395.429')] [2023-03-09 11:30:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000003144_1609728.pth... [2023-03-09 11:30:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000002624_1343488.pth [2023-03-09 11:30:35,817][709034] Updated weights for policy 0, policy_version 3200 (0.0005) [2023-03-09 11:30:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 7879.9). Total num frames: 1654784. Throughput: 0: 8771.3. Samples: 1655712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:30:37,858][708628] Avg episode reward: [(0, '455.212')] [2023-03-09 11:30:40,574][709034] Updated weights for policy 0, policy_version 3280 (0.0005) [2023-03-09 11:30:42,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 7887.2). Total num frames: 1695744. Throughput: 0: 8772.4. Samples: 1680872. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:30:42,858][708628] Avg episode reward: [(0, '435.422')] [2023-03-09 11:30:45,164][709034] Updated weights for policy 0, policy_version 3360 (0.0005) [2023-03-09 11:30:47,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 7912.7). Total num frames: 1740800. Throughput: 0: 8829.3. Samples: 1733660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:30:47,858][708628] Avg episode reward: [(0, '440.766')] [2023-03-09 11:30:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000003400_1740800.pth... [2023-03-09 11:30:47,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000002872_1470464.pth [2023-03-09 11:30:49,882][709034] Updated weights for policy 0, policy_version 3440 (0.0005) [2023-03-09 11:30:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 7937.1). Total num frames: 1785856. Throughput: 0: 8844.8. Samples: 1786392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:30:52,858][708628] Avg episode reward: [(0, '603.177')] [2023-03-09 11:30:52,858][708990] Saving new best policy, reward=603.177! [2023-03-09 11:30:54,586][709034] Updated weights for policy 0, policy_version 3520 (0.0005) [2023-03-09 11:30:57,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8738.1, 300 sec: 7942.7). Total num frames: 1826816. Throughput: 0: 8865.7. Samples: 1812088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:30:57,858][708628] Avg episode reward: [(0, '576.151')] [2023-03-09 11:30:59,266][709034] Updated weights for policy 0, policy_version 3600 (0.0005) [2023-03-09 11:31:02,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 7965.4). Total num frames: 1871872. Throughput: 0: 8917.3. Samples: 1864888. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:31:02,858][708628] Avg episode reward: [(0, '548.996')] [2023-03-09 11:31:02,881][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000003664_1875968.pth... [2023-03-09 11:31:02,883][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000003144_1609728.pth [2023-03-09 11:31:03,813][709034] Updated weights for policy 0, policy_version 3680 (0.0005) [2023-03-09 11:31:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 7987.2). Total num frames: 1916928. Throughput: 0: 8861.0. Samples: 1918360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:31:07,858][708628] Avg episode reward: [(0, '542.680')] [2023-03-09 11:31:08,559][709034] Updated weights for policy 0, policy_version 3760 (0.0006) [2023-03-09 11:31:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8008.1). Total num frames: 1961984. Throughput: 0: 8807.3. Samples: 1944192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:31:12,858][708628] Avg episode reward: [(0, '571.204')] [2023-03-09 11:31:13,288][709034] Updated weights for policy 0, policy_version 3840 (0.0005) [2023-03-09 11:31:17,857][708628] Fps is (10 sec: 8601.5, 60 sec: 8874.7, 300 sec: 8011.8). Total num frames: 2002944. Throughput: 0: 8708.4. Samples: 1995028. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 11:31:17,858][708628] Avg episode reward: [(0, '625.944')] [2023-03-09 11:31:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000003912_2002944.pth... [2023-03-09 11:31:17,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000003400_1740800.pth [2023-03-09 11:31:17,863][708990] Saving new best policy, reward=625.944! [2023-03-09 11:31:17,968][709034] Updated weights for policy 0, policy_version 3920 (0.0005) [2023-03-09 11:31:22,501][709034] Updated weights for policy 0, policy_version 4000 (0.0005) [2023-03-09 11:31:22,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8031.4). Total num frames: 2048000. Throughput: 0: 8780.0. Samples: 2050812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:31:22,858][708628] Avg episode reward: [(0, '823.672')] [2023-03-09 11:31:22,858][708990] Saving new best policy, reward=823.672! [2023-03-09 11:31:26,854][709034] Updated weights for policy 0, policy_version 4080 (0.0005) [2023-03-09 11:31:27,857][708628] Fps is (10 sec: 9420.9, 60 sec: 8874.7, 300 sec: 8066.0). Total num frames: 2097152. Throughput: 0: 8848.1. Samples: 2079036. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:31:27,858][708628] Avg episode reward: [(0, '882.579')] [2023-03-09 11:31:27,858][708990] Saving new best policy, reward=882.579! [2023-03-09 11:31:31,323][709034] Updated weights for policy 0, policy_version 4160 (0.0005) [2023-03-09 11:31:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 8874.7, 300 sec: 8083.8). Total num frames: 2142208. Throughput: 0: 8897.0. Samples: 2134024. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:31:32,858][708628] Avg episode reward: [(0, '836.192')] [2023-03-09 11:31:32,863][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000004184_2142208.pth... [2023-03-09 11:31:32,867][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000003664_1875968.pth [2023-03-09 11:31:36,056][709034] Updated weights for policy 0, policy_version 4240 (0.0006) [2023-03-09 11:31:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8101.0). Total num frames: 2187264. Throughput: 0: 8909.7. Samples: 2187328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:31:37,858][708628] Avg episode reward: [(0, '762.672')] [2023-03-09 11:31:40,518][709034] Updated weights for policy 0, policy_version 4320 (0.0005) [2023-03-09 11:31:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8117.5). Total num frames: 2232320. Throughput: 0: 8935.3. Samples: 2214176. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:31:42,858][708628] Avg episode reward: [(0, '877.981')] [2023-03-09 11:31:44,992][709034] Updated weights for policy 0, policy_version 4400 (0.0005) [2023-03-09 11:31:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8133.5). Total num frames: 2277376. Throughput: 0: 8979.2. Samples: 2268952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:31:47,858][708628] Avg episode reward: [(0, '622.941')] [2023-03-09 11:31:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000004448_2277376.pth... [2023-03-09 11:31:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000003912_2002944.pth [2023-03-09 11:31:49,534][709034] Updated weights for policy 0, policy_version 4480 (0.0005) [2023-03-09 11:31:52,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 8148.9). Total num frames: 2322432. Throughput: 0: 9028.9. Samples: 2324660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:31:52,858][708628] Avg episode reward: [(0, '698.239')] [2023-03-09 11:31:53,820][709034] Updated weights for policy 0, policy_version 4560 (0.0005) [2023-03-09 11:31:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9011.2, 300 sec: 8163.8). Total num frames: 2367488. Throughput: 0: 9082.2. Samples: 2352888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:31:57,858][708628] Avg episode reward: [(0, '702.456')] [2023-03-09 11:31:58,254][709034] Updated weights for policy 0, policy_version 4640 (0.0005) [2023-03-09 11:32:02,632][709034] Updated weights for policy 0, policy_version 4720 (0.0006) [2023-03-09 11:32:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 8192.0). Total num frames: 2416640. Throughput: 0: 9177.9. Samples: 2408032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:32:02,858][708628] Avg episode reward: [(0, '601.859')] [2023-03-09 11:32:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000004720_2416640.pth... [2023-03-09 11:32:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000004184_2142208.pth [2023-03-09 11:32:07,450][709034] Updated weights for policy 0, policy_version 4800 (0.0005) [2023-03-09 11:32:07,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9011.2, 300 sec: 8330.8). Total num frames: 2457600. Throughput: 0: 9112.1. Samples: 2460856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:32:07,858][708628] Avg episode reward: [(0, '718.655')] [2023-03-09 11:32:11,609][709034] Updated weights for policy 0, policy_version 4880 (0.0005) [2023-03-09 11:32:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9147.8, 300 sec: 8511.4). Total num frames: 2510848. Throughput: 0: 9140.7. Samples: 2490368. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:32:12,857][708628] Avg episode reward: [(0, '802.595')] [2023-03-09 11:32:15,984][709034] Updated weights for policy 0, policy_version 4960 (0.0005) [2023-03-09 11:32:17,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9216.0, 300 sec: 8580.8). Total num frames: 2555904. Throughput: 0: 9177.0. Samples: 2546988. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:32:17,858][708628] Avg episode reward: [(0, '952.845')] [2023-03-09 11:32:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000004992_2555904.pth... [2023-03-09 11:32:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000004448_2277376.pth [2023-03-09 11:32:17,864][708990] Saving new best policy, reward=952.845! [2023-03-09 11:32:20,595][709034] Updated weights for policy 0, policy_version 5040 (0.0005) [2023-03-09 11:32:22,857][708628] Fps is (10 sec: 9011.0, 60 sec: 9216.0, 300 sec: 8608.5). Total num frames: 2600960. Throughput: 0: 9190.7. Samples: 2600908. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:32:22,858][708628] Avg episode reward: [(0, '732.928')] [2023-03-09 11:32:25,242][709034] Updated weights for policy 0, policy_version 5120 (0.0004) [2023-03-09 11:32:27,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9079.5, 300 sec: 8608.5). Total num frames: 2641920. Throughput: 0: 9150.2. Samples: 2625936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:32:27,858][708628] Avg episode reward: [(0, '1031.235')] [2023-03-09 11:32:27,858][708990] Saving new best policy, reward=1031.235! [2023-03-09 11:32:29,742][709034] Updated weights for policy 0, policy_version 5200 (0.0006) [2023-03-09 11:32:32,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9079.5, 300 sec: 8608.5). Total num frames: 2686976. Throughput: 0: 9107.7. Samples: 2678796. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:32:32,858][708628] Avg episode reward: [(0, '733.809')] [2023-03-09 11:32:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000005248_2686976.pth... [2023-03-09 11:32:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000004720_2416640.pth [2023-03-09 11:32:34,744][709034] Updated weights for policy 0, policy_version 5280 (0.0006) [2023-03-09 11:32:37,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9011.2, 300 sec: 8608.5). Total num frames: 2727936. Throughput: 0: 9016.2. Samples: 2730388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:32:37,858][708628] Avg episode reward: [(0, '728.733')] [2023-03-09 11:32:39,496][709034] Updated weights for policy 0, policy_version 5360 (0.0005) [2023-03-09 11:32:42,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9011.2, 300 sec: 8636.3). Total num frames: 2772992. Throughput: 0: 8971.5. Samples: 2756608. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:32:42,858][708628] Avg episode reward: [(0, '834.111')] [2023-03-09 11:32:43,944][709034] Updated weights for policy 0, policy_version 5440 (0.0005) [2023-03-09 11:32:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9011.2, 300 sec: 8650.2). Total num frames: 2818048. Throughput: 0: 8929.4. Samples: 2809856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:32:47,858][708628] Avg episode reward: [(0, '878.325')] [2023-03-09 11:32:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000005504_2818048.pth... [2023-03-09 11:32:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000004992_2555904.pth [2023-03-09 11:32:48,800][709034] Updated weights for policy 0, policy_version 5520 (0.0005) [2023-03-09 11:32:52,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 8664.1). Total num frames: 2859008. Throughput: 0: 8840.6. Samples: 2858680. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:32:52,858][708628] Avg episode reward: [(0, '840.357')] [2023-03-09 11:32:53,875][709034] Updated weights for policy 0, policy_version 5600 (0.0005) [2023-03-09 11:32:57,857][708628] Fps is (10 sec: 8192.1, 60 sec: 8874.7, 300 sec: 8678.0). Total num frames: 2899968. Throughput: 0: 8738.1. Samples: 2883584. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:32:57,858][708628] Avg episode reward: [(0, '762.580')] [2023-03-09 11:32:58,775][709034] Updated weights for policy 0, policy_version 5680 (0.0006) [2023-03-09 11:33:02,857][708628] Fps is (10 sec: 7782.3, 60 sec: 8669.9, 300 sec: 8691.9). Total num frames: 2936832. Throughput: 0: 8551.4. Samples: 2931800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:33:02,858][708628] Avg episode reward: [(0, '790.468')] [2023-03-09 11:33:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000005736_2936832.pth... [2023-03-09 11:33:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000005248_2686976.pth [2023-03-09 11:33:04,087][709034] Updated weights for policy 0, policy_version 5760 (0.0005) [2023-03-09 11:33:07,857][708628] Fps is (10 sec: 7782.4, 60 sec: 8669.9, 300 sec: 8705.7). Total num frames: 2977792. Throughput: 0: 8396.9. Samples: 2978768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:33:07,858][708628] Avg episode reward: [(0, '838.652')] [2023-03-09 11:33:09,267][709034] Updated weights for policy 0, policy_version 5840 (0.0005) [2023-03-09 11:33:12,857][708628] Fps is (10 sec: 7782.5, 60 sec: 8396.8, 300 sec: 8691.9). Total num frames: 3014656. Throughput: 0: 8362.8. Samples: 3002264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:33:12,858][708628] Avg episode reward: [(0, '859.914')] [2023-03-09 11:33:14,646][709034] Updated weights for policy 0, policy_version 5920 (0.0005) [2023-03-09 11:33:17,857][708628] Fps is (10 sec: 7372.7, 60 sec: 8260.3, 300 sec: 8664.1). Total num frames: 3051520. Throughput: 0: 8188.6. Samples: 3047284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:33:17,858][708628] Avg episode reward: [(0, '839.983')] [2023-03-09 11:33:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000005960_3051520.pth... [2023-03-09 11:33:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000005504_2818048.pth [2023-03-09 11:33:20,059][709034] Updated weights for policy 0, policy_version 6000 (0.0005) [2023-03-09 11:33:22,857][708628] Fps is (10 sec: 7782.4, 60 sec: 8192.0, 300 sec: 8650.2). Total num frames: 3092480. Throughput: 0: 8125.9. Samples: 3096056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:33:22,858][708628] Avg episode reward: [(0, '823.428')] [2023-03-09 11:33:24,697][709034] Updated weights for policy 0, policy_version 6080 (0.0005) [2023-03-09 11:33:27,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8260.3, 300 sec: 8664.1). Total num frames: 3137536. Throughput: 0: 8103.9. Samples: 3121284. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:33:27,858][708628] Avg episode reward: [(0, '498.366')] [2023-03-09 11:33:29,332][709034] Updated weights for policy 0, policy_version 6160 (0.0005) [2023-03-09 11:33:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 8328.5, 300 sec: 8691.8). Total num frames: 3186688. Throughput: 0: 8166.7. Samples: 3177356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:33:32,858][708628] Avg episode reward: [(0, '484.099')] [2023-03-09 11:33:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000006224_3186688.pth... [2023-03-09 11:33:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000005736_2936832.pth [2023-03-09 11:33:33,561][709034] Updated weights for policy 0, policy_version 6240 (0.0005) [2023-03-09 11:33:37,857][708628] Fps is (10 sec: 9420.7, 60 sec: 8396.8, 300 sec: 8705.7). Total num frames: 3231744. Throughput: 0: 8291.7. Samples: 3231808. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 11:33:37,859][708628] Avg episode reward: [(0, '558.753')] [2023-03-09 11:33:38,296][709034] Updated weights for policy 0, policy_version 6320 (0.0006) [2023-03-09 11:33:42,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8328.5, 300 sec: 8678.0). Total num frames: 3272704. Throughput: 0: 8322.1. Samples: 3258080. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:33:42,858][708628] Avg episode reward: [(0, '537.057')] [2023-03-09 11:33:42,882][709034] Updated weights for policy 0, policy_version 6400 (0.0005) [2023-03-09 11:33:47,506][709034] Updated weights for policy 0, policy_version 6480 (0.0005) [2023-03-09 11:33:47,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8328.5, 300 sec: 8678.0). Total num frames: 3317760. Throughput: 0: 8450.9. Samples: 3312088. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:33:47,858][708628] Avg episode reward: [(0, '596.272')] [2023-03-09 11:33:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000006480_3317760.pth... [2023-03-09 11:33:47,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000005960_3051520.pth [2023-03-09 11:33:52,305][709034] Updated weights for policy 0, policy_version 6560 (0.0005) [2023-03-09 11:33:52,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8396.8, 300 sec: 8678.0). Total num frames: 3362816. Throughput: 0: 8533.0. Samples: 3362752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:33:52,858][708628] Avg episode reward: [(0, '638.708')] [2023-03-09 11:33:57,098][709034] Updated weights for policy 0, policy_version 6640 (0.0005) [2023-03-09 11:33:57,857][708628] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8678.0). Total num frames: 3403776. Throughput: 0: 8590.0. Samples: 3388816. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:33:57,858][708628] Avg episode reward: [(0, '587.789')] [2023-03-09 11:34:01,782][709034] Updated weights for policy 0, policy_version 6720 (0.0006) [2023-03-09 11:34:02,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8691.8). Total num frames: 3448832. Throughput: 0: 8741.2. Samples: 3440640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:34:02,858][708628] Avg episode reward: [(0, '632.765')] [2023-03-09 11:34:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000006736_3448832.pth... [2023-03-09 11:34:02,866][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000006224_3186688.pth [2023-03-09 11:34:06,421][709034] Updated weights for policy 0, policy_version 6800 (0.0005) [2023-03-09 11:34:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8691.9). Total num frames: 3493888. Throughput: 0: 8840.9. Samples: 3493896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:34:07,858][708628] Avg episode reward: [(0, '669.343')] [2023-03-09 11:34:11,222][709034] Updated weights for policy 0, policy_version 6880 (0.0005) [2023-03-09 11:34:12,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8678.0). Total num frames: 3534848. Throughput: 0: 8826.4. Samples: 3518472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:34:12,858][708628] Avg episode reward: [(0, '506.817')] [2023-03-09 11:34:16,055][709034] Updated weights for policy 0, policy_version 6960 (0.0005) [2023-03-09 11:34:17,857][708628] Fps is (10 sec: 8192.1, 60 sec: 8738.2, 300 sec: 8678.0). Total num frames: 3575808. Throughput: 0: 8727.3. Samples: 3570084. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:34:17,858][708628] Avg episode reward: [(0, '643.128')] [2023-03-09 11:34:17,907][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000006992_3579904.pth... [2023-03-09 11:34:17,908][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000006480_3317760.pth [2023-03-09 11:34:20,762][709034] Updated weights for policy 0, policy_version 7040 (0.0005) [2023-03-09 11:34:22,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8678.0). Total num frames: 3620864. Throughput: 0: 8647.3. Samples: 3620936. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:34:22,858][708628] Avg episode reward: [(0, '925.475')] [2023-03-09 11:34:25,406][709034] Updated weights for policy 0, policy_version 7120 (0.0005) [2023-03-09 11:34:27,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8691.9). Total num frames: 3665920. Throughput: 0: 8693.9. Samples: 3649304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:34:27,858][708628] Avg episode reward: [(0, '824.334')] [2023-03-09 11:34:30,103][709034] Updated weights for policy 0, policy_version 7200 (0.0005) [2023-03-09 11:34:32,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8705.7). Total num frames: 3706880. Throughput: 0: 8612.4. Samples: 3699644. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:34:32,858][708628] Avg episode reward: [(0, '576.588')] [2023-03-09 11:34:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000007240_3706880.pth... [2023-03-09 11:34:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000006736_3448832.pth [2023-03-09 11:34:34,796][709034] Updated weights for policy 0, policy_version 7280 (0.0005) [2023-03-09 11:34:37,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8719.6). Total num frames: 3751936. Throughput: 0: 8712.1. Samples: 3754796. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:34:37,858][708628] Avg episode reward: [(0, '616.394')] [2023-03-09 11:34:39,248][709034] Updated weights for policy 0, policy_version 7360 (0.0005) [2023-03-09 11:34:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8747.4). Total num frames: 3796992. Throughput: 0: 8724.1. Samples: 3781400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:34:42,858][708628] Avg episode reward: [(0, '635.368')] [2023-03-09 11:34:43,873][709034] Updated weights for policy 0, policy_version 7440 (0.0005) [2023-03-09 11:34:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8738.1, 300 sec: 8747.4). Total num frames: 3842048. Throughput: 0: 8739.7. Samples: 3833928. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:34:47,873][708628] Avg episode reward: [(0, '829.891')] [2023-03-09 11:34:47,877][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000007504_3842048.pth... [2023-03-09 11:34:47,879][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000006992_3579904.pth [2023-03-09 11:34:48,535][709034] Updated weights for policy 0, policy_version 7520 (0.0005) [2023-03-09 11:34:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8738.2, 300 sec: 8761.3). Total num frames: 3887104. Throughput: 0: 8791.7. Samples: 3889520. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 11:34:52,868][708628] Avg episode reward: [(0, '882.839')] [2023-03-09 11:34:52,925][709034] Updated weights for policy 0, policy_version 7600 (0.0005) [2023-03-09 11:34:57,446][709034] Updated weights for policy 0, policy_version 7680 (0.0005) [2023-03-09 11:34:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 8874.7, 300 sec: 8789.0). Total num frames: 3936256. Throughput: 0: 8868.9. Samples: 3917572. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 11:34:57,858][708628] Avg episode reward: [(0, '870.448')] [2023-03-09 11:35:02,101][709034] Updated weights for policy 0, policy_version 7760 (0.0005) [2023-03-09 11:35:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8789.0). Total num frames: 3977216. Throughput: 0: 8875.5. Samples: 3969484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:35:02,858][708628] Avg episode reward: [(0, '753.963')] [2023-03-09 11:35:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000007768_3977216.pth... [2023-03-09 11:35:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000007240_3706880.pth [2023-03-09 11:35:06,616][709034] Updated weights for policy 0, policy_version 7840 (0.0005) [2023-03-09 11:35:07,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8789.0). Total num frames: 4022272. Throughput: 0: 8938.1. Samples: 4023152. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:35:07,858][708628] Avg episode reward: [(0, '934.577')] [2023-03-09 11:35:11,551][709034] Updated weights for policy 0, policy_version 7920 (0.0005) [2023-03-09 11:35:12,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8789.0). Total num frames: 4063232. Throughput: 0: 8865.3. Samples: 4048244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:35:12,858][708628] Avg episode reward: [(0, '1321.538')] [2023-03-09 11:35:12,858][708990] Saving new best policy, reward=1321.538! [2023-03-09 11:35:15,951][709034] Updated weights for policy 0, policy_version 8000 (0.0005) [2023-03-09 11:35:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8789.0). Total num frames: 4112384. Throughput: 0: 8987.7. Samples: 4104092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:35:17,858][708628] Avg episode reward: [(0, '1265.900')] [2023-03-09 11:35:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000008032_4112384.pth... [2023-03-09 11:35:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000007504_3842048.pth [2023-03-09 11:35:20,448][709034] Updated weights for policy 0, policy_version 8080 (0.0005) [2023-03-09 11:35:22,857][708628] Fps is (10 sec: 9420.9, 60 sec: 8942.9, 300 sec: 8789.0). Total num frames: 4157440. Throughput: 0: 8982.8. Samples: 4159024. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:35:22,858][708628] Avg episode reward: [(0, '834.409')] [2023-03-09 11:35:24,625][709034] Updated weights for policy 0, policy_version 8160 (0.0005) [2023-03-09 11:35:27,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9011.2, 300 sec: 8802.9). Total num frames: 4206592. Throughput: 0: 9034.6. Samples: 4187956. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 11:35:27,858][708628] Avg episode reward: [(0, '1466.200')] [2023-03-09 11:35:27,858][708990] Saving new best policy, reward=1466.200! [2023-03-09 11:35:29,223][709034] Updated weights for policy 0, policy_version 8240 (0.0005) [2023-03-09 11:35:32,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9011.2, 300 sec: 8789.0). Total num frames: 4247552. Throughput: 0: 9031.5. Samples: 4240344. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 11:35:32,858][708628] Avg episode reward: [(0, '1499.265')] [2023-03-09 11:35:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000008296_4247552.pth... [2023-03-09 11:35:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000007768_3977216.pth [2023-03-09 11:35:32,864][708990] Saving new best policy, reward=1499.265! [2023-03-09 11:35:34,026][709034] Updated weights for policy 0, policy_version 8320 (0.0006) [2023-03-09 11:35:37,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9011.2, 300 sec: 8802.9). Total num frames: 4292608. Throughput: 0: 8963.4. Samples: 4292872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:35:37,858][708628] Avg episode reward: [(0, '1405.209')] [2023-03-09 11:35:38,608][709034] Updated weights for policy 0, policy_version 8400 (0.0005) [2023-03-09 11:35:42,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 8789.0). Total num frames: 4333568. Throughput: 0: 8929.0. Samples: 4319376. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 11:35:42,858][708628] Avg episode reward: [(0, '1124.616')] [2023-03-09 11:35:43,478][709034] Updated weights for policy 0, policy_version 8480 (0.0005) [2023-03-09 11:35:47,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 8789.0). Total num frames: 4378624. Throughput: 0: 8850.5. Samples: 4367756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:35:47,858][708628] Avg episode reward: [(0, '862.424')] [2023-03-09 11:35:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000008552_4378624.pth... [2023-03-09 11:35:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000008032_4112384.pth [2023-03-09 11:35:48,248][709034] Updated weights for policy 0, policy_version 8560 (0.0005) [2023-03-09 11:35:52,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8789.0). Total num frames: 4419584. Throughput: 0: 8817.8. Samples: 4419952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:35:52,858][708628] Avg episode reward: [(0, '1385.869')] [2023-03-09 11:35:53,197][709034] Updated weights for policy 0, policy_version 8640 (0.0005) [2023-03-09 11:35:57,812][709034] Updated weights for policy 0, policy_version 8720 (0.0005) [2023-03-09 11:35:57,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8789.0). Total num frames: 4464640. Throughput: 0: 8834.4. Samples: 4445792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:35:57,858][708628] Avg episode reward: [(0, '1502.743')] [2023-03-09 11:35:57,858][708990] Saving new best policy, reward=1502.743! [2023-03-09 11:36:02,444][709034] Updated weights for policy 0, policy_version 8800 (0.0005) [2023-03-09 11:36:02,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8806.4, 300 sec: 8775.2). Total num frames: 4505600. Throughput: 0: 8792.2. Samples: 4499740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:36:02,858][708628] Avg episode reward: [(0, '970.587')] [2023-03-09 11:36:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000008800_4505600.pth... [2023-03-09 11:36:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000008296_4247552.pth [2023-03-09 11:36:06,852][709034] Updated weights for policy 0, policy_version 8880 (0.0005) [2023-03-09 11:36:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8789.0). Total num frames: 4554752. Throughput: 0: 8792.7. Samples: 4554696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:36:07,858][708628] Avg episode reward: [(0, '1316.870')] [2023-03-09 11:36:11,448][709034] Updated weights for policy 0, policy_version 8960 (0.0006) [2023-03-09 11:36:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8789.0). Total num frames: 4595712. Throughput: 0: 8744.3. Samples: 4581448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:36:12,858][708628] Avg episode reward: [(0, '1344.125')] [2023-03-09 11:36:16,208][709034] Updated weights for policy 0, policy_version 9040 (0.0005) [2023-03-09 11:36:17,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8789.0). Total num frames: 4640768. Throughput: 0: 8717.7. Samples: 4632640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:36:17,858][708628] Avg episode reward: [(0, '1188.362')] [2023-03-09 11:36:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000009064_4640768.pth... [2023-03-09 11:36:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000008552_4378624.pth [2023-03-09 11:36:20,840][709034] Updated weights for policy 0, policy_version 9120 (0.0005) [2023-03-09 11:36:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8775.2). Total num frames: 4685824. Throughput: 0: 8731.9. Samples: 4685808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:36:22,858][708628] Avg episode reward: [(0, '1367.781')] [2023-03-09 11:36:25,732][709034] Updated weights for policy 0, policy_version 9200 (0.0005) [2023-03-09 11:36:27,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8761.3). Total num frames: 4726784. Throughput: 0: 8690.8. Samples: 4710464. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:36:27,858][708628] Avg episode reward: [(0, '1682.660')] [2023-03-09 11:36:27,858][708990] Saving new best policy, reward=1682.660! [2023-03-09 11:36:30,512][709034] Updated weights for policy 0, policy_version 9280 (0.0006) [2023-03-09 11:36:32,857][708628] Fps is (10 sec: 8192.0, 60 sec: 8669.9, 300 sec: 8747.4). Total num frames: 4767744. Throughput: 0: 8749.5. Samples: 4761484. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:36:32,858][708628] Avg episode reward: [(0, '1523.848')] [2023-03-09 11:36:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000009312_4767744.pth... [2023-03-09 11:36:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000008800_4505600.pth [2023-03-09 11:36:35,227][709034] Updated weights for policy 0, policy_version 9360 (0.0005) [2023-03-09 11:36:37,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8747.4). Total num frames: 4812800. Throughput: 0: 8761.8. Samples: 4814232. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:36:37,858][708628] Avg episode reward: [(0, '1317.717')] [2023-03-09 11:36:40,082][709034] Updated weights for policy 0, policy_version 9440 (0.0005) [2023-03-09 11:36:42,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8733.5). Total num frames: 4853760. Throughput: 0: 8747.0. Samples: 4839408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:36:42,858][708628] Avg episode reward: [(0, '1073.793')] [2023-03-09 11:36:45,033][709034] Updated weights for policy 0, policy_version 9520 (0.0004) [2023-03-09 11:36:47,857][708628] Fps is (10 sec: 8601.5, 60 sec: 8669.9, 300 sec: 8733.5). Total num frames: 4898816. Throughput: 0: 8645.5. Samples: 4888788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:36:47,858][708628] Avg episode reward: [(0, '1494.759')] [2023-03-09 11:36:47,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000009568_4898816.pth... [2023-03-09 11:36:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000009064_4640768.pth [2023-03-09 11:36:49,685][709034] Updated weights for policy 0, policy_version 9600 (0.0005) [2023-03-09 11:36:52,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8719.6). Total num frames: 4939776. Throughput: 0: 8619.1. Samples: 4942556. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:36:52,858][708628] Avg episode reward: [(0, '1281.035')] [2023-03-09 11:36:54,387][709034] Updated weights for policy 0, policy_version 9680 (0.0005) [2023-03-09 11:36:57,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8705.7). Total num frames: 4984832. Throughput: 0: 8601.4. Samples: 4968512. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:36:57,858][708628] Avg episode reward: [(0, '1393.365')] [2023-03-09 11:36:59,179][709034] Updated weights for policy 0, policy_version 9760 (0.0005) [2023-03-09 11:37:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8738.1, 300 sec: 8719.6). Total num frames: 5029888. Throughput: 0: 8611.0. Samples: 5020136. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:37:02,858][708628] Avg episode reward: [(0, '1817.448')] [2023-03-09 11:37:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000009824_5029888.pth... [2023-03-09 11:37:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000009312_4767744.pth [2023-03-09 11:37:02,864][708990] Saving new best policy, reward=1817.448! [2023-03-09 11:37:03,861][709034] Updated weights for policy 0, policy_version 9840 (0.0005) [2023-03-09 11:37:07,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8678.0). Total num frames: 5070848. Throughput: 0: 8555.2. Samples: 5070792. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:37:07,858][708628] Avg episode reward: [(0, '1730.963')] [2023-03-09 11:37:08,684][709034] Updated weights for policy 0, policy_version 9920 (0.0005) [2023-03-09 11:37:12,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8678.0). Total num frames: 5115904. Throughput: 0: 8636.6. Samples: 5099112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:37:12,858][708628] Avg episode reward: [(0, '1343.505')] [2023-03-09 11:37:13,273][709034] Updated weights for policy 0, policy_version 10000 (0.0005) [2023-03-09 11:37:17,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8664.1). Total num frames: 5156864. Throughput: 0: 8637.9. Samples: 5150188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:37:17,858][708628] Avg episode reward: [(0, '1425.539')] [2023-03-09 11:37:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000010072_5156864.pth... [2023-03-09 11:37:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000009568_4898816.pth [2023-03-09 11:37:17,962][709034] Updated weights for policy 0, policy_version 10080 (0.0005) [2023-03-09 11:37:22,474][709034] Updated weights for policy 0, policy_version 10160 (0.0005) [2023-03-09 11:37:22,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8678.0). Total num frames: 5201920. Throughput: 0: 8682.1. Samples: 5204928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:37:22,858][708628] Avg episode reward: [(0, '1750.434')] [2023-03-09 11:37:27,143][709034] Updated weights for policy 0, policy_version 10240 (0.0005) [2023-03-09 11:37:27,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8669.9, 300 sec: 8678.0). Total num frames: 5246976. Throughput: 0: 8694.9. Samples: 5230680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:37:27,858][708628] Avg episode reward: [(0, '2414.279')] [2023-03-09 11:37:27,858][708990] Saving new best policy, reward=2414.279! [2023-03-09 11:37:31,874][709034] Updated weights for policy 0, policy_version 10320 (0.0005) [2023-03-09 11:37:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8738.1, 300 sec: 8691.9). Total num frames: 5292032. Throughput: 0: 8768.8. Samples: 5283384. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:37:32,858][708628] Avg episode reward: [(0, '1657.416')] [2023-03-09 11:37:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000010336_5292032.pth... [2023-03-09 11:37:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000009824_5029888.pth [2023-03-09 11:37:36,837][709034] Updated weights for policy 0, policy_version 10400 (0.0005) [2023-03-09 11:37:37,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8669.9, 300 sec: 8678.0). Total num frames: 5332992. Throughput: 0: 8676.9. Samples: 5333016. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 11:37:37,858][708628] Avg episode reward: [(0, '1654.775')] [2023-03-09 11:37:41,955][709034] Updated weights for policy 0, policy_version 10480 (0.0006) [2023-03-09 11:37:42,857][708628] Fps is (10 sec: 7782.4, 60 sec: 8601.6, 300 sec: 8650.2). Total num frames: 5369856. Throughput: 0: 8645.7. Samples: 5357568. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 11:37:42,858][708628] Avg episode reward: [(0, '1924.885')] [2023-03-09 11:37:46,788][709034] Updated weights for policy 0, policy_version 10560 (0.0005) [2023-03-09 11:37:47,857][708628] Fps is (10 sec: 8192.0, 60 sec: 8601.6, 300 sec: 8664.1). Total num frames: 5414912. Throughput: 0: 8590.8. Samples: 5406720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:37:47,858][708628] Avg episode reward: [(0, '1968.784')] [2023-03-09 11:37:47,863][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000010576_5414912.pth... [2023-03-09 11:37:47,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000010072_5156864.pth [2023-03-09 11:37:51,711][709034] Updated weights for policy 0, policy_version 10640 (0.0005) [2023-03-09 11:37:52,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8664.1). Total num frames: 5455872. Throughput: 0: 8558.8. Samples: 5455936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:37:52,858][708628] Avg episode reward: [(0, '2118.365')] [2023-03-09 11:37:56,395][709034] Updated weights for policy 0, policy_version 10720 (0.0005) [2023-03-09 11:37:57,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8691.9). Total num frames: 5500928. Throughput: 0: 8547.8. Samples: 5483764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:37:57,858][708628] Avg episode reward: [(0, '1806.971')] [2023-03-09 11:38:01,293][709034] Updated weights for policy 0, policy_version 10800 (0.0005) [2023-03-09 11:38:02,857][708628] Fps is (10 sec: 8601.5, 60 sec: 8533.3, 300 sec: 8691.8). Total num frames: 5541888. Throughput: 0: 8522.4. Samples: 5533696. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:38:02,858][708628] Avg episode reward: [(0, '1067.646')] [2023-03-09 11:38:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000010824_5541888.pth... [2023-03-09 11:38:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000010336_5292032.pth [2023-03-09 11:38:05,912][709034] Updated weights for policy 0, policy_version 10880 (0.0005) [2023-03-09 11:38:07,857][708628] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8705.7). Total num frames: 5582848. Throughput: 0: 8484.2. Samples: 5586716. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:38:07,858][708628] Avg episode reward: [(0, '1373.385')] [2023-03-09 11:38:10,809][709034] Updated weights for policy 0, policy_version 10960 (0.0005) [2023-03-09 11:38:12,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8733.5). Total num frames: 5627904. Throughput: 0: 8463.0. Samples: 5611516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:38:12,858][708628] Avg episode reward: [(0, '1282.705')] [2023-03-09 11:38:15,470][709034] Updated weights for policy 0, policy_version 11040 (0.0005) [2023-03-09 11:38:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8747.4). Total num frames: 5672960. Throughput: 0: 8475.4. Samples: 5664776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:38:17,858][708628] Avg episode reward: [(0, '2509.254')] [2023-03-09 11:38:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000011080_5672960.pth... [2023-03-09 11:38:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000010576_5414912.pth [2023-03-09 11:38:17,865][708990] Saving new best policy, reward=2509.254! [2023-03-09 11:38:19,920][709034] Updated weights for policy 0, policy_version 11120 (0.0005) [2023-03-09 11:38:22,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8733.5). Total num frames: 5713920. Throughput: 0: 8520.7. Samples: 5716448. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:38:22,858][708628] Avg episode reward: [(0, '2496.178')] [2023-03-09 11:38:24,919][709034] Updated weights for policy 0, policy_version 11200 (0.0005) [2023-03-09 11:38:27,857][708628] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8705.7). Total num frames: 5754880. Throughput: 0: 8537.9. Samples: 5741772. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:38:27,858][708628] Avg episode reward: [(0, '2384.808')] [2023-03-09 11:38:30,144][709034] Updated weights for policy 0, policy_version 11280 (0.0006) [2023-03-09 11:38:32,857][708628] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8691.8). Total num frames: 5795840. Throughput: 0: 8467.9. Samples: 5787776. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:38:32,858][708628] Avg episode reward: [(0, '1920.047')] [2023-03-09 11:38:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000011320_5795840.pth... [2023-03-09 11:38:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000010824_5541888.pth [2023-03-09 11:38:35,257][709034] Updated weights for policy 0, policy_version 11360 (0.0006) [2023-03-09 11:38:37,857][708628] Fps is (10 sec: 7782.5, 60 sec: 8328.5, 300 sec: 8678.0). Total num frames: 5832704. Throughput: 0: 8457.3. Samples: 5836516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:38:37,858][708628] Avg episode reward: [(0, '2137.883')] [2023-03-09 11:38:40,506][709034] Updated weights for policy 0, policy_version 11440 (0.0005) [2023-03-09 11:38:42,857][708628] Fps is (10 sec: 7782.5, 60 sec: 8396.8, 300 sec: 8664.1). Total num frames: 5873664. Throughput: 0: 8351.7. Samples: 5859592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:38:42,858][708628] Avg episode reward: [(0, '2302.172')] [2023-03-09 11:38:45,265][709034] Updated weights for policy 0, policy_version 11520 (0.0005) [2023-03-09 11:38:47,857][708628] Fps is (10 sec: 8601.5, 60 sec: 8396.8, 300 sec: 8664.1). Total num frames: 5918720. Throughput: 0: 8375.5. Samples: 5910592. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:38:47,858][708628] Avg episode reward: [(0, '1909.544')] [2023-03-09 11:38:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000011560_5918720.pth... [2023-03-09 11:38:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000011080_5672960.pth [2023-03-09 11:38:49,965][709034] Updated weights for policy 0, policy_version 11600 (0.0005) [2023-03-09 11:38:52,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8465.1, 300 sec: 8678.0). Total num frames: 5963776. Throughput: 0: 8380.5. Samples: 5963840. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:38:52,858][708628] Avg episode reward: [(0, '2008.247')] [2023-03-09 11:38:54,661][709034] Updated weights for policy 0, policy_version 11680 (0.0005) [2023-03-09 11:38:57,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8396.8, 300 sec: 8664.1). Total num frames: 6004736. Throughput: 0: 8401.5. Samples: 5989584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:38:57,858][708628] Avg episode reward: [(0, '2046.377')] [2023-03-09 11:38:59,469][709034] Updated weights for policy 0, policy_version 11760 (0.0005) [2023-03-09 11:39:02,857][708628] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8650.2). Total num frames: 6045696. Throughput: 0: 8333.7. Samples: 6039792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:39:02,858][708628] Avg episode reward: [(0, '2253.100')] [2023-03-09 11:39:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000011808_6045696.pth... [2023-03-09 11:39:02,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000011320_5795840.pth [2023-03-09 11:39:04,286][709034] Updated weights for policy 0, policy_version 11840 (0.0005) [2023-03-09 11:39:07,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8664.1). Total num frames: 6090752. Throughput: 0: 8318.2. Samples: 6090764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:39:07,858][708628] Avg episode reward: [(0, '2449.997')] [2023-03-09 11:39:09,169][709034] Updated weights for policy 0, policy_version 11920 (0.0005) [2023-03-09 11:39:12,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8664.1). Total num frames: 6131712. Throughput: 0: 8302.7. Samples: 6115392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:39:12,858][708628] Avg episode reward: [(0, '1939.104')] [2023-03-09 11:39:13,939][709034] Updated weights for policy 0, policy_version 12000 (0.0005) [2023-03-09 11:39:17,857][708628] Fps is (10 sec: 8601.4, 60 sec: 8396.8, 300 sec: 8664.1). Total num frames: 6176768. Throughput: 0: 8462.4. Samples: 6168584. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:39:17,858][708628] Avg episode reward: [(0, '1342.716')] [2023-03-09 11:39:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000012064_6176768.pth... [2023-03-09 11:39:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000011560_5918720.pth [2023-03-09 11:39:18,664][709034] Updated weights for policy 0, policy_version 12080 (0.0004) [2023-03-09 11:39:22,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8650.2). Total num frames: 6217728. Throughput: 0: 8529.4. Samples: 6220340. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:39:22,858][708628] Avg episode reward: [(0, '1256.641')] [2023-03-09 11:39:23,523][709034] Updated weights for policy 0, policy_version 12160 (0.0005) [2023-03-09 11:39:27,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8664.1). Total num frames: 6262784. Throughput: 0: 8576.5. Samples: 6245536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:39:27,858][708628] Avg episode reward: [(0, '1140.364')] [2023-03-09 11:39:28,286][709034] Updated weights for policy 0, policy_version 12240 (0.0006) [2023-03-09 11:39:32,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8650.2). Total num frames: 6303744. Throughput: 0: 8556.1. Samples: 6295616. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:39:32,858][708628] Avg episode reward: [(0, '1136.314')] [2023-03-09 11:39:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000012312_6303744.pth... [2023-03-09 11:39:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000011808_6045696.pth [2023-03-09 11:39:33,363][709034] Updated weights for policy 0, policy_version 12320 (0.0005) [2023-03-09 11:39:37,857][708628] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8636.3). Total num frames: 6344704. Throughput: 0: 8466.9. Samples: 6344852. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:39:37,858][708628] Avg episode reward: [(0, '802.423')] [2023-03-09 11:39:38,113][709034] Updated weights for policy 0, policy_version 12400 (0.0005) [2023-03-09 11:39:42,857][708628] Fps is (10 sec: 8192.0, 60 sec: 8533.3, 300 sec: 8622.4). Total num frames: 6385664. Throughput: 0: 8463.5. Samples: 6370440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:39:42,858][708628] Avg episode reward: [(0, '1204.318')] [2023-03-09 11:39:42,903][709034] Updated weights for policy 0, policy_version 12480 (0.0005) [2023-03-09 11:39:47,823][709034] Updated weights for policy 0, policy_version 12560 (0.0006) [2023-03-09 11:39:47,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8622.4). Total num frames: 6430720. Throughput: 0: 8503.7. Samples: 6422456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:39:47,858][708628] Avg episode reward: [(0, '833.643')] [2023-03-09 11:39:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000012560_6430720.pth... [2023-03-09 11:39:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000012064_6176768.pth [2023-03-09 11:39:52,579][709034] Updated weights for policy 0, policy_version 12640 (0.0005) [2023-03-09 11:39:52,857][708628] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8594.7). Total num frames: 6471680. Throughput: 0: 8501.6. Samples: 6473336. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 11:39:52,858][708628] Avg episode reward: [(0, '1073.407')] [2023-03-09 11:39:57,288][709034] Updated weights for policy 0, policy_version 12720 (0.0005) [2023-03-09 11:39:57,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8608.5). Total num frames: 6516736. Throughput: 0: 8554.6. Samples: 6500348. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 11:39:57,858][708628] Avg episode reward: [(0, '1339.659')] [2023-03-09 11:40:02,105][709034] Updated weights for policy 0, policy_version 12800 (0.0006) [2023-03-09 11:40:02,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8594.7). Total num frames: 6557696. Throughput: 0: 8494.0. Samples: 6550812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:40:02,858][708628] Avg episode reward: [(0, '1429.317')] [2023-03-09 11:40:02,863][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000012808_6557696.pth... [2023-03-09 11:40:02,866][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000012312_6303744.pth [2023-03-09 11:40:06,925][709034] Updated weights for policy 0, policy_version 12880 (0.0005) [2023-03-09 11:40:07,857][708628] Fps is (10 sec: 8192.0, 60 sec: 8465.0, 300 sec: 8594.7). Total num frames: 6598656. Throughput: 0: 8485.5. Samples: 6602188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:40:07,858][708628] Avg episode reward: [(0, '1235.966')] [2023-03-09 11:40:11,783][709034] Updated weights for policy 0, policy_version 12960 (0.0005) [2023-03-09 11:40:12,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8580.8). Total num frames: 6643712. Throughput: 0: 8473.3. Samples: 6626836. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:40:12,858][708628] Avg episode reward: [(0, '1340.350')] [2023-03-09 11:40:16,864][709034] Updated weights for policy 0, policy_version 13040 (0.0005) [2023-03-09 11:40:17,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8566.9). Total num frames: 6684672. Throughput: 0: 8459.5. Samples: 6676292. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:40:17,858][708628] Avg episode reward: [(0, '814.430')] [2023-03-09 11:40:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000013056_6684672.pth... [2023-03-09 11:40:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000012560_6430720.pth [2023-03-09 11:40:21,473][709034] Updated weights for policy 0, policy_version 13120 (0.0005) [2023-03-09 11:40:22,857][708628] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8539.1). Total num frames: 6725632. Throughput: 0: 8545.2. Samples: 6729388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:40:22,858][708628] Avg episode reward: [(0, '757.205')] [2023-03-09 11:40:26,371][709034] Updated weights for policy 0, policy_version 13200 (0.0005) [2023-03-09 11:40:27,857][708628] Fps is (10 sec: 8601.5, 60 sec: 8465.1, 300 sec: 8553.0). Total num frames: 6770688. Throughput: 0: 8509.6. Samples: 6753372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:40:27,858][708628] Avg episode reward: [(0, '995.721')] [2023-03-09 11:40:31,025][709034] Updated weights for policy 0, policy_version 13280 (0.0005) [2023-03-09 11:40:32,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8539.1). Total num frames: 6811648. Throughput: 0: 8513.1. Samples: 6805544. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 11:40:32,858][708628] Avg episode reward: [(0, '802.200')] [2023-03-09 11:40:32,878][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000013312_6815744.pth... [2023-03-09 11:40:32,880][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000012808_6557696.pth [2023-03-09 11:40:35,803][709034] Updated weights for policy 0, policy_version 13360 (0.0005) [2023-03-09 11:40:37,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8553.0). Total num frames: 6856704. Throughput: 0: 8519.6. Samples: 6856720. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 11:40:37,858][708628] Avg episode reward: [(0, '1150.197')] [2023-03-09 11:40:40,902][709034] Updated weights for policy 0, policy_version 13440 (0.0005) [2023-03-09 11:40:42,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8539.1). Total num frames: 6897664. Throughput: 0: 8458.2. Samples: 6880968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:40:42,858][708628] Avg episode reward: [(0, '1423.481')] [2023-03-09 11:40:45,732][709034] Updated weights for policy 0, policy_version 13520 (0.0005) [2023-03-09 11:40:47,857][708628] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8539.1). Total num frames: 6938624. Throughput: 0: 8462.6. Samples: 6931628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:40:47,858][708628] Avg episode reward: [(0, '1124.996')] [2023-03-09 11:40:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000013552_6938624.pth... [2023-03-09 11:40:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000013056_6684672.pth [2023-03-09 11:40:50,342][709034] Updated weights for policy 0, policy_version 13600 (0.0005) [2023-03-09 11:40:52,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8539.1). Total num frames: 6983680. Throughput: 0: 8477.6. Samples: 6983680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:40:52,858][708628] Avg episode reward: [(0, '553.559')] [2023-03-09 11:40:55,054][709034] Updated weights for policy 0, policy_version 13680 (0.0005) [2023-03-09 11:40:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8533.3, 300 sec: 8553.0). Total num frames: 7028736. Throughput: 0: 8537.2. Samples: 7011008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:40:57,858][708628] Avg episode reward: [(0, '845.638')] [2023-03-09 11:40:59,668][709034] Updated weights for policy 0, policy_version 13760 (0.0006) [2023-03-09 11:41:02,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8525.2). Total num frames: 7069696. Throughput: 0: 8572.2. Samples: 7062040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:41:02,858][708628] Avg episode reward: [(0, '1537.620')] [2023-03-09 11:41:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000013808_7069696.pth... [2023-03-09 11:41:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000013312_6815744.pth [2023-03-09 11:41:04,692][709034] Updated weights for policy 0, policy_version 13840 (0.0005) [2023-03-09 11:41:07,857][708628] Fps is (10 sec: 8191.9, 60 sec: 8533.3, 300 sec: 8525.2). Total num frames: 7110656. Throughput: 0: 8503.0. Samples: 7112024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:41:07,858][708628] Avg episode reward: [(0, '1065.200')] [2023-03-09 11:41:09,519][709034] Updated weights for policy 0, policy_version 13920 (0.0005) [2023-03-09 11:41:12,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8525.2). Total num frames: 7155712. Throughput: 0: 8535.5. Samples: 7137468. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:41:12,858][708628] Avg episode reward: [(0, '1554.443')] [2023-03-09 11:41:14,375][709034] Updated weights for policy 0, policy_version 14000 (0.0005) [2023-03-09 11:41:17,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8533.3, 300 sec: 8511.4). Total num frames: 7196672. Throughput: 0: 8525.4. Samples: 7189188. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:41:17,858][708628] Avg episode reward: [(0, '1001.043')] [2023-03-09 11:41:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000014056_7196672.pth... [2023-03-09 11:41:17,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000013552_6938624.pth [2023-03-09 11:41:19,114][709034] Updated weights for policy 0, policy_version 14080 (0.0005) [2023-03-09 11:41:22,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8525.2). Total num frames: 7241728. Throughput: 0: 8564.3. Samples: 7242112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:41:22,858][708628] Avg episode reward: [(0, '1495.594')] [2023-03-09 11:41:23,658][709034] Updated weights for policy 0, policy_version 14160 (0.0005) [2023-03-09 11:41:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8601.6, 300 sec: 8539.1). Total num frames: 7286784. Throughput: 0: 8602.2. Samples: 7268064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:41:27,858][708628] Avg episode reward: [(0, '1702.845')] [2023-03-09 11:41:28,244][709034] Updated weights for policy 0, policy_version 14240 (0.0006) [2023-03-09 11:41:32,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8601.6, 300 sec: 8525.2). Total num frames: 7327744. Throughput: 0: 8658.9. Samples: 7321280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:41:32,858][708628] Avg episode reward: [(0, '1634.327')] [2023-03-09 11:41:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000014312_7327744.pth... [2023-03-09 11:41:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000013808_7069696.pth [2023-03-09 11:41:33,055][709034] Updated weights for policy 0, policy_version 14320 (0.0005) [2023-03-09 11:41:37,857][708628] Fps is (10 sec: 8191.9, 60 sec: 8533.3, 300 sec: 8525.2). Total num frames: 7368704. Throughput: 0: 8613.8. Samples: 7371300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:41:37,858][708628] Avg episode reward: [(0, '1296.762')] [2023-03-09 11:41:37,995][709034] Updated weights for policy 0, policy_version 14400 (0.0005) [2023-03-09 11:41:42,857][708628] Fps is (10 sec: 8192.1, 60 sec: 8533.3, 300 sec: 8511.4). Total num frames: 7409664. Throughput: 0: 8540.4. Samples: 7395324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:41:42,858][708628] Avg episode reward: [(0, '1593.173')] [2023-03-09 11:41:42,941][709034] Updated weights for policy 0, policy_version 14480 (0.0005) [2023-03-09 11:41:47,845][709034] Updated weights for policy 0, policy_version 14560 (0.0004) [2023-03-09 11:41:47,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8601.6, 300 sec: 8525.2). Total num frames: 7454720. Throughput: 0: 8543.8. Samples: 7446508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:41:47,858][708628] Avg episode reward: [(0, '1606.342')] [2023-03-09 11:41:47,859][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000014560_7454720.pth... [2023-03-09 11:41:47,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000014056_7196672.pth [2023-03-09 11:41:52,476][709034] Updated weights for policy 0, policy_version 14640 (0.0005) [2023-03-09 11:41:52,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8511.3). Total num frames: 7495680. Throughput: 0: 8589.3. Samples: 7498544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:41:52,858][708628] Avg episode reward: [(0, '1109.942')] [2023-03-09 11:41:57,447][709034] Updated weights for policy 0, policy_version 14720 (0.0005) [2023-03-09 11:41:57,857][708628] Fps is (10 sec: 8191.9, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 7536640. Throughput: 0: 8581.2. Samples: 7523620. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:41:57,858][708628] Avg episode reward: [(0, '1123.547')] [2023-03-09 11:42:02,383][709034] Updated weights for policy 0, policy_version 14800 (0.0005) [2023-03-09 11:42:02,857][708628] Fps is (10 sec: 8192.0, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 7577600. Throughput: 0: 8537.8. Samples: 7573388. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:42:02,858][708628] Avg episode reward: [(0, '903.501')] [2023-03-09 11:42:02,886][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000014808_7581696.pth... [2023-03-09 11:42:02,888][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000014312_7327744.pth [2023-03-09 11:42:07,294][709034] Updated weights for policy 0, policy_version 14880 (0.0004) [2023-03-09 11:42:07,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 7622656. Throughput: 0: 8454.9. Samples: 7622584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:42:07,858][708628] Avg episode reward: [(0, '942.840')] [2023-03-09 11:42:12,113][709034] Updated weights for policy 0, policy_version 14960 (0.0005) [2023-03-09 11:42:12,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 7663616. Throughput: 0: 8428.0. Samples: 7647324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:42:12,858][708628] Avg episode reward: [(0, '822.781')] [2023-03-09 11:42:16,918][709034] Updated weights for policy 0, policy_version 15040 (0.0005) [2023-03-09 11:42:17,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 7708672. Throughput: 0: 8402.4. Samples: 7699388. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:42:17,858][708628] Avg episode reward: [(0, '1124.621')] [2023-03-09 11:42:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000015056_7708672.pth... [2023-03-09 11:42:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000014560_7454720.pth [2023-03-09 11:42:21,975][709034] Updated weights for policy 0, policy_version 15120 (0.0005) [2023-03-09 11:42:22,857][708628] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8469.7). Total num frames: 7745536. Throughput: 0: 8382.1. Samples: 7748492. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:42:22,858][708628] Avg episode reward: [(0, '1534.474')] [2023-03-09 11:42:26,654][709034] Updated weights for policy 0, policy_version 15200 (0.0005) [2023-03-09 11:42:27,857][708628] Fps is (10 sec: 8192.0, 60 sec: 8396.8, 300 sec: 8469.7). Total num frames: 7790592. Throughput: 0: 8418.0. Samples: 7774136. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 11:42:27,868][708628] Avg episode reward: [(0, '1550.625')] [2023-03-09 11:42:31,547][709034] Updated weights for policy 0, policy_version 15280 (0.0006) [2023-03-09 11:42:32,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8396.8, 300 sec: 8469.7). Total num frames: 7831552. Throughput: 0: 8411.9. Samples: 7825044. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 11:42:32,858][708628] Avg episode reward: [(0, '1105.122')] [2023-03-09 11:42:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000015296_7831552.pth... [2023-03-09 11:42:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000014808_7581696.pth [2023-03-09 11:42:36,366][709034] Updated weights for policy 0, policy_version 15360 (0.0005) [2023-03-09 11:42:37,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8497.5). Total num frames: 7876608. Throughput: 0: 8397.9. Samples: 7876448. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 11:42:37,858][708628] Avg episode reward: [(0, '701.294')] [2023-03-09 11:42:41,118][709034] Updated weights for policy 0, policy_version 15440 (0.0006) [2023-03-09 11:42:42,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8465.1, 300 sec: 8483.6). Total num frames: 7917568. Throughput: 0: 8420.8. Samples: 7902556. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 11:42:42,858][708628] Avg episode reward: [(0, '1514.745')] [2023-03-09 11:42:45,909][709034] Updated weights for policy 0, policy_version 15520 (0.0005) [2023-03-09 11:42:47,857][708628] Fps is (10 sec: 8601.5, 60 sec: 8465.0, 300 sec: 8497.5). Total num frames: 7962624. Throughput: 0: 8462.7. Samples: 7954212. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 11:42:47,858][708628] Avg episode reward: [(0, '1374.900')] [2023-03-09 11:42:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000015552_7962624.pth... [2023-03-09 11:42:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000015056_7708672.pth [2023-03-09 11:42:50,316][709034] Updated weights for policy 0, policy_version 15600 (0.0005) [2023-03-09 11:42:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8533.3, 300 sec: 8497.5). Total num frames: 8007680. Throughput: 0: 8604.4. Samples: 8009780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:42:52,868][708628] Avg episode reward: [(0, '2041.066')] [2023-03-09 11:42:54,760][709034] Updated weights for policy 0, policy_version 15680 (0.0005) [2023-03-09 11:42:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8601.6, 300 sec: 8511.4). Total num frames: 8052736. Throughput: 0: 8646.5. Samples: 8036416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:42:57,858][708628] Avg episode reward: [(0, '1922.933')] [2023-03-09 11:42:59,581][709034] Updated weights for policy 0, policy_version 15760 (0.0006) [2023-03-09 11:43:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8669.9, 300 sec: 8525.2). Total num frames: 8097792. Throughput: 0: 8662.6. Samples: 8089204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:43:02,868][708628] Avg episode reward: [(0, '2283.580')] [2023-03-09 11:43:02,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000015816_8097792.pth... [2023-03-09 11:43:02,874][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000015296_7831552.pth [2023-03-09 11:43:04,207][709034] Updated weights for policy 0, policy_version 15840 (0.0006) [2023-03-09 11:43:07,857][708628] Fps is (10 sec: 8601.5, 60 sec: 8601.6, 300 sec: 8511.4). Total num frames: 8138752. Throughput: 0: 8734.3. Samples: 8141536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:43:07,858][708628] Avg episode reward: [(0, '2364.346')] [2023-03-09 11:43:08,951][709034] Updated weights for policy 0, policy_version 15920 (0.0005) [2023-03-09 11:43:12,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8669.9, 300 sec: 8511.4). Total num frames: 8183808. Throughput: 0: 8731.3. Samples: 8167044. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 11:43:12,858][708628] Avg episode reward: [(0, '2107.944')] [2023-03-09 11:43:13,499][709034] Updated weights for policy 0, policy_version 16000 (0.0005) [2023-03-09 11:43:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8669.9, 300 sec: 8525.2). Total num frames: 8228864. Throughput: 0: 8792.0. Samples: 8220684. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 11:43:17,858][708628] Avg episode reward: [(0, '1302.325')] [2023-03-09 11:43:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000016072_8228864.pth... [2023-03-09 11:43:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000015552_7962624.pth [2023-03-09 11:43:18,047][709034] Updated weights for policy 0, policy_version 16080 (0.0006) [2023-03-09 11:43:22,851][709034] Updated weights for policy 0, policy_version 16160 (0.0005) [2023-03-09 11:43:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8539.1). Total num frames: 8273920. Throughput: 0: 8824.4. Samples: 8273548. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 11:43:22,858][708628] Avg episode reward: [(0, '1679.079')] [2023-03-09 11:43:27,582][709034] Updated weights for policy 0, policy_version 16240 (0.0005) [2023-03-09 11:43:27,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8539.1). Total num frames: 8314880. Throughput: 0: 8833.8. Samples: 8300076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:43:27,858][708628] Avg episode reward: [(0, '2037.410')] [2023-03-09 11:43:32,408][709034] Updated weights for policy 0, policy_version 16320 (0.0005) [2023-03-09 11:43:32,857][708628] Fps is (10 sec: 8192.0, 60 sec: 8738.1, 300 sec: 8553.0). Total num frames: 8355840. Throughput: 0: 8804.8. Samples: 8350428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:43:32,858][708628] Avg episode reward: [(0, '1850.877')] [2023-03-09 11:43:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000016320_8355840.pth... [2023-03-09 11:43:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000015816_8097792.pth [2023-03-09 11:43:37,219][709034] Updated weights for policy 0, policy_version 16400 (0.0005) [2023-03-09 11:43:37,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 8566.9). Total num frames: 8400896. Throughput: 0: 8698.0. Samples: 8401188. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:43:37,858][708628] Avg episode reward: [(0, '2333.684')] [2023-03-09 11:43:41,645][709034] Updated weights for policy 0, policy_version 16480 (0.0005) [2023-03-09 11:43:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8566.9). Total num frames: 8445952. Throughput: 0: 8740.7. Samples: 8429748. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:43:42,858][708628] Avg episode reward: [(0, '2403.394')] [2023-03-09 11:43:46,145][709034] Updated weights for policy 0, policy_version 16560 (0.0005) [2023-03-09 11:43:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8566.9). Total num frames: 8491008. Throughput: 0: 8785.5. Samples: 8484552. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:43:47,858][708628] Avg episode reward: [(0, '1326.076')] [2023-03-09 11:43:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000016584_8491008.pth... [2023-03-09 11:43:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000016072_8228864.pth [2023-03-09 11:43:50,710][709034] Updated weights for policy 0, policy_version 16640 (0.0005) [2023-03-09 11:43:52,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8806.4, 300 sec: 8580.8). Total num frames: 8536064. Throughput: 0: 8809.3. Samples: 8537956. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:43:52,858][708628] Avg episode reward: [(0, '2241.197')] [2023-03-09 11:43:55,409][709034] Updated weights for policy 0, policy_version 16720 (0.0004) [2023-03-09 11:43:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 8594.7). Total num frames: 8581120. Throughput: 0: 8833.0. Samples: 8564528. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:43:57,858][708628] Avg episode reward: [(0, '2027.153')] [2023-03-09 11:43:59,853][709034] Updated weights for policy 0, policy_version 16800 (0.0005) [2023-03-09 11:44:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8594.7). Total num frames: 8626176. Throughput: 0: 8839.4. Samples: 8618456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:44:02,858][708628] Avg episode reward: [(0, '2021.708')] [2023-03-09 11:44:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000016848_8626176.pth... [2023-03-09 11:44:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000016320_8355840.pth [2023-03-09 11:44:04,389][709034] Updated weights for policy 0, policy_version 16880 (0.0005) [2023-03-09 11:44:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8608.5). Total num frames: 8671232. Throughput: 0: 8904.5. Samples: 8674248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:44:07,858][708628] Avg episode reward: [(0, '2628.949')] [2023-03-09 11:44:07,858][708990] Saving new best policy, reward=2628.949! [2023-03-09 11:44:08,970][709034] Updated weights for policy 0, policy_version 16960 (0.0004) [2023-03-09 11:44:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8874.7, 300 sec: 8608.5). Total num frames: 8716288. Throughput: 0: 8887.5. Samples: 8700012. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:44:12,858][708628] Avg episode reward: [(0, '3052.293')] [2023-03-09 11:44:12,872][708990] Saving new best policy, reward=3052.293! [2023-03-09 11:44:13,385][709034] Updated weights for policy 0, policy_version 17040 (0.0005) [2023-03-09 11:44:17,844][709034] Updated weights for policy 0, policy_version 17120 (0.0005) [2023-03-09 11:44:17,857][708628] Fps is (10 sec: 9420.5, 60 sec: 8942.9, 300 sec: 8636.3). Total num frames: 8765440. Throughput: 0: 8991.1. Samples: 8755028. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:44:17,858][708628] Avg episode reward: [(0, '3043.853')] [2023-03-09 11:44:17,864][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000017120_8765440.pth... [2023-03-09 11:44:17,867][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000016584_8491008.pth [2023-03-09 11:44:22,292][709034] Updated weights for policy 0, policy_version 17200 (0.0006) [2023-03-09 11:44:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 8942.9, 300 sec: 8636.3). Total num frames: 8810496. Throughput: 0: 9108.9. Samples: 8811088. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:44:22,858][708628] Avg episode reward: [(0, '2518.534')] [2023-03-09 11:44:26,489][709034] Updated weights for policy 0, policy_version 17280 (0.0005) [2023-03-09 11:44:27,857][708628] Fps is (10 sec: 9421.0, 60 sec: 9079.5, 300 sec: 8664.1). Total num frames: 8859648. Throughput: 0: 9113.9. Samples: 8839872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:44:27,858][708628] Avg episode reward: [(0, '1813.384')] [2023-03-09 11:44:30,941][709034] Updated weights for policy 0, policy_version 17360 (0.0004) [2023-03-09 11:44:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 8678.0). Total num frames: 8904704. Throughput: 0: 9140.0. Samples: 8895852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:44:32,858][708628] Avg episode reward: [(0, '2869.276')] [2023-03-09 11:44:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000017392_8904704.pth... [2023-03-09 11:44:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000016848_8626176.pth [2023-03-09 11:44:35,576][709034] Updated weights for policy 0, policy_version 17440 (0.0005) [2023-03-09 11:44:37,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 8691.9). Total num frames: 8949760. Throughput: 0: 9216.1. Samples: 8952680. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:44:37,858][708628] Avg episode reward: [(0, '2769.516')] [2023-03-09 11:44:39,786][709034] Updated weights for policy 0, policy_version 17520 (0.0005) [2023-03-09 11:44:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 8691.9). Total num frames: 8994816. Throughput: 0: 9224.8. Samples: 8979644. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:44:42,858][708628] Avg episode reward: [(0, '3361.966')] [2023-03-09 11:44:42,897][708990] Saving new best policy, reward=3361.966! [2023-03-09 11:44:44,315][709034] Updated weights for policy 0, policy_version 17600 (0.0005) [2023-03-09 11:44:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 8719.6). Total num frames: 9043968. Throughput: 0: 9260.4. Samples: 9035172. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:44:47,858][708628] Avg episode reward: [(0, '3048.694')] [2023-03-09 11:44:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000017664_9043968.pth... [2023-03-09 11:44:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000017120_8765440.pth [2023-03-09 11:44:48,618][709034] Updated weights for policy 0, policy_version 17680 (0.0005) [2023-03-09 11:44:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 8719.6). Total num frames: 9089024. Throughput: 0: 9218.8. Samples: 9089096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:44:52,858][708628] Avg episode reward: [(0, '2709.026')] [2023-03-09 11:44:53,110][709034] Updated weights for policy 0, policy_version 17760 (0.0005) [2023-03-09 11:44:57,759][709034] Updated weights for policy 0, policy_version 17840 (0.0005) [2023-03-09 11:44:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 8733.5). Total num frames: 9134080. Throughput: 0: 9270.4. Samples: 9117180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:44:57,858][708628] Avg episode reward: [(0, '3401.906')] [2023-03-09 11:44:57,858][708990] Saving new best policy, reward=3401.906! [2023-03-09 11:45:02,234][709034] Updated weights for policy 0, policy_version 17920 (0.0005) [2023-03-09 11:45:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 8747.4). Total num frames: 9179136. Throughput: 0: 9244.0. Samples: 9171008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:45:02,858][708628] Avg episode reward: [(0, '3262.120')] [2023-03-09 11:45:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000017928_9179136.pth... [2023-03-09 11:45:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000017392_8904704.pth [2023-03-09 11:45:06,699][709034] Updated weights for policy 0, policy_version 18000 (0.0006) [2023-03-09 11:45:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 8747.4). Total num frames: 9224192. Throughput: 0: 9183.6. Samples: 9224352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:45:07,858][708628] Avg episode reward: [(0, '2391.986')] [2023-03-09 11:45:11,538][709034] Updated weights for policy 0, policy_version 18080 (0.0005) [2023-03-09 11:45:12,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9147.7, 300 sec: 8747.4). Total num frames: 9265152. Throughput: 0: 9129.3. Samples: 9250692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:45:12,858][708628] Avg episode reward: [(0, '2326.805')] [2023-03-09 11:45:15,920][709034] Updated weights for policy 0, policy_version 18160 (0.0005) [2023-03-09 11:45:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.8, 300 sec: 8775.2). Total num frames: 9314304. Throughput: 0: 9135.9. Samples: 9306968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:45:17,858][708628] Avg episode reward: [(0, '2973.349')] [2023-03-09 11:45:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000018192_9314304.pth... [2023-03-09 11:45:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000017664_9043968.pth [2023-03-09 11:45:19,970][709034] Updated weights for policy 0, policy_version 18240 (0.0005) [2023-03-09 11:45:22,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9216.0, 300 sec: 8789.0). Total num frames: 9363456. Throughput: 0: 9129.9. Samples: 9363528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:45:22,858][708628] Avg episode reward: [(0, '2829.857')] [2023-03-09 11:45:24,380][709034] Updated weights for policy 0, policy_version 18320 (0.0005) [2023-03-09 11:45:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 8802.9). Total num frames: 9408512. Throughput: 0: 9167.9. Samples: 9392200. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 11:45:27,858][708628] Avg episode reward: [(0, '1549.357')] [2023-03-09 11:45:28,656][709034] Updated weights for policy 0, policy_version 18400 (0.0005) [2023-03-09 11:45:32,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 8802.9). Total num frames: 9453568. Throughput: 0: 9177.2. Samples: 9448144. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 11:45:32,858][708628] Avg episode reward: [(0, '2066.524')] [2023-03-09 11:45:32,902][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000018472_9457664.pth... [2023-03-09 11:45:32,903][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000017928_9179136.pth [2023-03-09 11:45:33,302][709034] Updated weights for policy 0, policy_version 18480 (0.0005) [2023-03-09 11:45:37,786][709034] Updated weights for policy 0, policy_version 18560 (0.0005) [2023-03-09 11:45:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 8830.7). Total num frames: 9502720. Throughput: 0: 9191.3. Samples: 9502704. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 11:45:37,858][708628] Avg episode reward: [(0, '2112.366')] [2023-03-09 11:45:42,125][709034] Updated weights for policy 0, policy_version 18640 (0.0004) [2023-03-09 11:45:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 8844.6). Total num frames: 9547776. Throughput: 0: 9183.6. Samples: 9530444. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:45:42,858][708628] Avg episode reward: [(0, '1845.911')] [2023-03-09 11:45:46,535][709034] Updated weights for policy 0, policy_version 18720 (0.0005) [2023-03-09 11:45:47,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 8844.6). Total num frames: 9592832. Throughput: 0: 9245.5. Samples: 9587052. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:45:47,858][708628] Avg episode reward: [(0, '2104.363')] [2023-03-09 11:45:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000018736_9592832.pth... [2023-03-09 11:45:47,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000018192_9314304.pth [2023-03-09 11:45:51,110][709034] Updated weights for policy 0, policy_version 18800 (0.0005) [2023-03-09 11:45:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 8858.5). Total num frames: 9641984. Throughput: 0: 9282.2. Samples: 9642048. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:45:52,868][708628] Avg episode reward: [(0, '2147.257')] [2023-03-09 11:45:55,415][709034] Updated weights for policy 0, policy_version 18880 (0.0005) [2023-03-09 11:45:57,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 8872.4). Total num frames: 9687040. Throughput: 0: 9323.9. Samples: 9670268. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:45:57,858][708628] Avg episode reward: [(0, '2639.853')] [2023-03-09 11:45:59,988][709034] Updated weights for policy 0, policy_version 18960 (0.0005) [2023-03-09 11:46:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 8886.2). Total num frames: 9732096. Throughput: 0: 9276.0. Samples: 9724388. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:46:02,858][708628] Avg episode reward: [(0, '2128.527')] [2023-03-09 11:46:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000019008_9732096.pth... [2023-03-09 11:46:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000018472_9457664.pth [2023-03-09 11:46:04,499][709034] Updated weights for policy 0, policy_version 19040 (0.0005) [2023-03-09 11:46:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 8886.2). Total num frames: 9777152. Throughput: 0: 9190.8. Samples: 9777112. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 11:46:07,858][708628] Avg episode reward: [(0, '1884.569')] [2023-03-09 11:46:09,029][709034] Updated weights for policy 0, policy_version 19120 (0.0004) [2023-03-09 11:46:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 8900.1). Total num frames: 9822208. Throughput: 0: 9190.7. Samples: 9805780. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 11:46:12,858][708628] Avg episode reward: [(0, '1813.225')] [2023-03-09 11:46:13,597][709034] Updated weights for policy 0, policy_version 19200 (0.0004) [2023-03-09 11:46:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 8900.1). Total num frames: 9867264. Throughput: 0: 9146.8. Samples: 9859752. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 11:46:17,858][708628] Avg episode reward: [(0, '1991.651')] [2023-03-09 11:46:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000019272_9867264.pth... [2023-03-09 11:46:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000018736_9592832.pth [2023-03-09 11:46:17,941][709034] Updated weights for policy 0, policy_version 19280 (0.0005) [2023-03-09 11:46:22,419][709034] Updated weights for policy 0, policy_version 19360 (0.0005) [2023-03-09 11:46:22,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 8914.0). Total num frames: 9916416. Throughput: 0: 9189.2. Samples: 9916220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:46:22,858][708628] Avg episode reward: [(0, '2756.499')] [2023-03-09 11:46:27,141][709034] Updated weights for policy 0, policy_version 19440 (0.0005) [2023-03-09 11:46:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 8914.0). Total num frames: 9957376. Throughput: 0: 9123.5. Samples: 9941000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:46:27,858][708628] Avg episode reward: [(0, '2694.958')] [2023-03-09 11:46:31,630][709034] Updated weights for policy 0, policy_version 19520 (0.0005) [2023-03-09 11:46:32,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9147.7, 300 sec: 8927.9). Total num frames: 10002432. Throughput: 0: 9069.3. Samples: 9995172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:46:32,858][708628] Avg episode reward: [(0, '1932.586')] [2023-03-09 11:46:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000019536_10002432.pth... [2023-03-09 11:46:32,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000019008_9732096.pth [2023-03-09 11:46:36,024][709034] Updated weights for policy 0, policy_version 19600 (0.0005) [2023-03-09 11:46:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 8955.7). Total num frames: 10051584. Throughput: 0: 9097.9. Samples: 10051456. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:46:37,858][708628] Avg episode reward: [(0, '2248.265')] [2023-03-09 11:46:40,551][709034] Updated weights for policy 0, policy_version 19680 (0.0005) [2023-03-09 11:46:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 8941.8). Total num frames: 10092544. Throughput: 0: 9065.4. Samples: 10078212. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:46:42,858][708628] Avg episode reward: [(0, '1718.030')] [2023-03-09 11:46:45,264][709034] Updated weights for policy 0, policy_version 19760 (0.0005) [2023-03-09 11:46:47,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9079.5, 300 sec: 8955.7). Total num frames: 10137600. Throughput: 0: 9008.9. Samples: 10129788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:46:47,858][708628] Avg episode reward: [(0, '2389.310')] [2023-03-09 11:46:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000019800_10137600.pth... [2023-03-09 11:46:47,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000019272_9867264.pth [2023-03-09 11:46:49,942][709034] Updated weights for policy 0, policy_version 19840 (0.0005) [2023-03-09 11:46:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 8969.5). Total num frames: 10182656. Throughput: 0: 9053.3. Samples: 10184508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:46:52,858][708628] Avg episode reward: [(0, '2251.087')] [2023-03-09 11:46:54,142][709034] Updated weights for policy 0, policy_version 19920 (0.0005) [2023-03-09 11:46:57,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9147.7, 300 sec: 9011.2). Total num frames: 10235904. Throughput: 0: 9103.2. Samples: 10215424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:46:57,858][708628] Avg episode reward: [(0, '2731.500')] [2023-03-09 11:46:57,995][709034] Updated weights for policy 0, policy_version 20000 (0.0005) [2023-03-09 11:47:02,218][709034] Updated weights for policy 0, policy_version 20080 (0.0005) [2023-03-09 11:47:02,857][708628] Fps is (10 sec: 10240.0, 60 sec: 9216.0, 300 sec: 9025.1). Total num frames: 10285056. Throughput: 0: 9268.1. Samples: 10276816. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:47:02,858][708628] Avg episode reward: [(0, '3338.441')] [2023-03-09 11:47:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000020088_10285056.pth... [2023-03-09 11:47:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000019536_10002432.pth [2023-03-09 11:47:06,837][709034] Updated weights for policy 0, policy_version 20160 (0.0005) [2023-03-09 11:47:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9039.0). Total num frames: 10330112. Throughput: 0: 9194.6. Samples: 10329976. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:47:07,862][708628] Avg episode reward: [(0, '2803.909')] [2023-03-09 11:47:11,514][709034] Updated weights for policy 0, policy_version 20240 (0.0004) [2023-03-09 11:47:12,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9147.7, 300 sec: 9025.1). Total num frames: 10371072. Throughput: 0: 9207.4. Samples: 10355332. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:47:12,868][708628] Avg episode reward: [(0, '2411.833')] [2023-03-09 11:47:16,303][709034] Updated weights for policy 0, policy_version 20320 (0.0005) [2023-03-09 11:47:17,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9147.7, 300 sec: 9052.9). Total num frames: 10416128. Throughput: 0: 9172.2. Samples: 10407920. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:47:17,868][708628] Avg episode reward: [(0, '2746.143')] [2023-03-09 11:47:17,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000020344_10416128.pth... [2023-03-09 11:47:17,874][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000019800_10137600.pth [2023-03-09 11:47:20,823][709034] Updated weights for policy 0, policy_version 20400 (0.0005) [2023-03-09 11:47:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9052.9). Total num frames: 10461184. Throughput: 0: 9143.1. Samples: 10462896. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:47:22,858][708628] Avg episode reward: [(0, '2786.712')] [2023-03-09 11:47:25,206][709034] Updated weights for policy 0, policy_version 20480 (0.0005) [2023-03-09 11:47:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9080.6). Total num frames: 10510336. Throughput: 0: 9177.6. Samples: 10491204. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:47:27,858][708628] Avg episode reward: [(0, '2999.517')] [2023-03-09 11:47:29,630][709034] Updated weights for policy 0, policy_version 20560 (0.0005) [2023-03-09 11:47:32,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9066.7). Total num frames: 10551296. Throughput: 0: 9226.6. Samples: 10544988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:47:32,858][708628] Avg episode reward: [(0, '2043.433')] [2023-03-09 11:47:32,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000020616_10555392.pth... [2023-03-09 11:47:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000020088_10285056.pth [2023-03-09 11:47:34,277][709034] Updated weights for policy 0, policy_version 20640 (0.0005) [2023-03-09 11:47:37,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9079.5, 300 sec: 9080.6). Total num frames: 10596352. Throughput: 0: 9170.7. Samples: 10597192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:47:37,858][708628] Avg episode reward: [(0, '1870.838')] [2023-03-09 11:47:39,059][709034] Updated weights for policy 0, policy_version 20720 (0.0004) [2023-03-09 11:47:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9080.6). Total num frames: 10641408. Throughput: 0: 9122.8. Samples: 10625948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:47:42,858][708628] Avg episode reward: [(0, '2960.066')] [2023-03-09 11:47:43,403][709034] Updated weights for policy 0, policy_version 20800 (0.0005) [2023-03-09 11:47:47,750][709034] Updated weights for policy 0, policy_version 20880 (0.0005) [2023-03-09 11:47:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9094.5). Total num frames: 10690560. Throughput: 0: 9007.9. Samples: 10682172. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:47:47,858][708628] Avg episode reward: [(0, '3398.363')] [2023-03-09 11:47:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000020880_10690560.pth... [2023-03-09 11:47:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000020344_10416128.pth [2023-03-09 11:47:52,294][709034] Updated weights for policy 0, policy_version 20960 (0.0004) [2023-03-09 11:47:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9094.5). Total num frames: 10735616. Throughput: 0: 9014.4. Samples: 10735624. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:47:52,858][708628] Avg episode reward: [(0, '3159.236')] [2023-03-09 11:47:56,813][709034] Updated weights for policy 0, policy_version 21040 (0.0004) [2023-03-09 11:47:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9094.5). Total num frames: 10780672. Throughput: 0: 9084.1. Samples: 10764116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:47:57,858][708628] Avg episode reward: [(0, '3311.861')] [2023-03-09 11:48:01,086][709034] Updated weights for policy 0, policy_version 21120 (0.0005) [2023-03-09 11:48:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9108.4). Total num frames: 10825728. Throughput: 0: 9159.9. Samples: 10820116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:48:02,858][708628] Avg episode reward: [(0, '2721.341')] [2023-03-09 11:48:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000021144_10825728.pth... [2023-03-09 11:48:02,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000020616_10555392.pth [2023-03-09 11:48:05,480][709034] Updated weights for policy 0, policy_version 21200 (0.0005) [2023-03-09 11:48:07,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 9122.3). Total num frames: 10874880. Throughput: 0: 9155.4. Samples: 10874888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:48:07,858][708628] Avg episode reward: [(0, '2211.811')] [2023-03-09 11:48:09,812][709034] Updated weights for policy 0, policy_version 21280 (0.0006) [2023-03-09 11:48:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9122.3). Total num frames: 10919936. Throughput: 0: 9163.3. Samples: 10903552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:48:12,858][708628] Avg episode reward: [(0, '1945.161')] [2023-03-09 11:48:14,409][709034] Updated weights for policy 0, policy_version 21360 (0.0005) [2023-03-09 11:48:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9122.3). Total num frames: 10964992. Throughput: 0: 9160.4. Samples: 10957204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:48:17,858][708628] Avg episode reward: [(0, '2261.759')] [2023-03-09 11:48:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000021416_10964992.pth... [2023-03-09 11:48:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000020880_10690560.pth [2023-03-09 11:48:18,965][709034] Updated weights for policy 0, policy_version 21440 (0.0006) [2023-03-09 11:48:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9136.2). Total num frames: 11010048. Throughput: 0: 9229.3. Samples: 11012512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:48:22,858][708628] Avg episode reward: [(0, '1782.627')] [2023-03-09 11:48:23,373][709034] Updated weights for policy 0, policy_version 21520 (0.0005) [2023-03-09 11:48:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9150.0). Total num frames: 11055104. Throughput: 0: 9170.9. Samples: 11038640. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:48:27,858][708628] Avg episode reward: [(0, '2175.605')] [2023-03-09 11:48:28,073][709034] Updated weights for policy 0, policy_version 21600 (0.0004) [2023-03-09 11:48:32,441][709034] Updated weights for policy 0, policy_version 21680 (0.0005) [2023-03-09 11:48:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9150.0). Total num frames: 11100160. Throughput: 0: 9129.4. Samples: 11092996. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:48:32,858][708628] Avg episode reward: [(0, '2980.305')] [2023-03-09 11:48:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000021680_11100160.pth... [2023-03-09 11:48:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000021144_10825728.pth [2023-03-09 11:48:37,120][709034] Updated weights for policy 0, policy_version 21760 (0.0005) [2023-03-09 11:48:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9150.0). Total num frames: 11145216. Throughput: 0: 9157.0. Samples: 11147688. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:48:37,858][708628] Avg episode reward: [(0, '2143.976')] [2023-03-09 11:48:41,552][709034] Updated weights for policy 0, policy_version 21840 (0.0005) [2023-03-09 11:48:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9163.9). Total num frames: 11194368. Throughput: 0: 9107.4. Samples: 11173952. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 11:48:42,858][708628] Avg episode reward: [(0, '2047.058')] [2023-03-09 11:48:45,873][709034] Updated weights for policy 0, policy_version 21920 (0.0005) [2023-03-09 11:48:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9163.9). Total num frames: 11239424. Throughput: 0: 9132.4. Samples: 11231076. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 11:48:47,858][708628] Avg episode reward: [(0, '2523.849')] [2023-03-09 11:48:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000021952_11239424.pth... [2023-03-09 11:48:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000021416_10964992.pth [2023-03-09 11:48:50,419][709034] Updated weights for policy 0, policy_version 22000 (0.0005) [2023-03-09 11:48:52,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9163.9). Total num frames: 11284480. Throughput: 0: 9160.2. Samples: 11287096. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 11:48:52,858][708628] Avg episode reward: [(0, '2456.434')] [2023-03-09 11:48:54,682][709034] Updated weights for policy 0, policy_version 22080 (0.0005) [2023-03-09 11:48:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9163.9). Total num frames: 11329536. Throughput: 0: 9105.3. Samples: 11313292. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:48:57,858][708628] Avg episode reward: [(0, '1131.953')] [2023-03-09 11:48:59,420][709034] Updated weights for policy 0, policy_version 22160 (0.0006) [2023-03-09 11:49:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9163.9). Total num frames: 11374592. Throughput: 0: 9093.2. Samples: 11366400. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:49:02,858][708628] Avg episode reward: [(0, '1117.961')] [2023-03-09 11:49:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000022216_11374592.pth... [2023-03-09 11:49:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000021680_11100160.pth [2023-03-09 11:49:04,105][709034] Updated weights for policy 0, policy_version 22240 (0.0005) [2023-03-09 11:49:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9163.9). Total num frames: 11419648. Throughput: 0: 9049.1. Samples: 11419720. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:49:07,858][708628] Avg episode reward: [(0, '1566.626')] [2023-03-09 11:49:08,672][709034] Updated weights for policy 0, policy_version 22320 (0.0005) [2023-03-09 11:49:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9150.1). Total num frames: 11464704. Throughput: 0: 9055.6. Samples: 11446144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:49:12,858][708628] Avg episode reward: [(0, '1800.346')] [2023-03-09 11:49:13,339][709034] Updated weights for policy 0, policy_version 22400 (0.0005) [2023-03-09 11:49:17,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9011.2, 300 sec: 9136.2). Total num frames: 11505664. Throughput: 0: 8989.9. Samples: 11497544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:49:17,858][708628] Avg episode reward: [(0, '2337.991')] [2023-03-09 11:49:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000022472_11505664.pth... [2023-03-09 11:49:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000021952_11239424.pth [2023-03-09 11:49:18,121][709034] Updated weights for policy 0, policy_version 22480 (0.0005) [2023-03-09 11:49:22,778][709034] Updated weights for policy 0, policy_version 22560 (0.0005) [2023-03-09 11:49:22,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9011.2, 300 sec: 9122.3). Total num frames: 11550720. Throughput: 0: 8956.3. Samples: 11550720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:49:22,858][708628] Avg episode reward: [(0, '1820.672')] [2023-03-09 11:49:27,420][709034] Updated weights for policy 0, policy_version 22640 (0.0004) [2023-03-09 11:49:27,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8942.9, 300 sec: 9108.4). Total num frames: 11591680. Throughput: 0: 8929.3. Samples: 11575772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:49:27,858][708628] Avg episode reward: [(0, '964.535')] [2023-03-09 11:49:31,959][709034] Updated weights for policy 0, policy_version 22720 (0.0005) [2023-03-09 11:49:32,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 9108.4). Total num frames: 11636736. Throughput: 0: 8905.0. Samples: 11631800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:49:32,858][708628] Avg episode reward: [(0, '837.072')] [2023-03-09 11:49:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000022728_11636736.pth... [2023-03-09 11:49:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000022216_11374592.pth [2023-03-09 11:49:36,809][709034] Updated weights for policy 0, policy_version 22800 (0.0005) [2023-03-09 11:49:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9108.4). Total num frames: 11681792. Throughput: 0: 8793.5. Samples: 11682804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:49:37,858][708628] Avg episode reward: [(0, '864.587')] [2023-03-09 11:49:41,031][709034] Updated weights for policy 0, policy_version 22880 (0.0005) [2023-03-09 11:49:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 8942.9, 300 sec: 9108.4). Total num frames: 11730944. Throughput: 0: 8856.7. Samples: 11711844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:49:42,858][708628] Avg episode reward: [(0, '1060.583')] [2023-03-09 11:49:45,340][709034] Updated weights for policy 0, policy_version 22960 (0.0005) [2023-03-09 11:49:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 8942.9, 300 sec: 9108.4). Total num frames: 11776000. Throughput: 0: 8930.6. Samples: 11768276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:49:47,858][708628] Avg episode reward: [(0, '1275.820')] [2023-03-09 11:49:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000023000_11776000.pth... [2023-03-09 11:49:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000022472_11505664.pth [2023-03-09 11:49:49,783][709034] Updated weights for policy 0, policy_version 23040 (0.0005) [2023-03-09 11:49:52,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8942.9, 300 sec: 9108.4). Total num frames: 11821056. Throughput: 0: 8942.8. Samples: 11822144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:49:52,858][708628] Avg episode reward: [(0, '1047.197')] [2023-03-09 11:49:54,451][709034] Updated weights for policy 0, policy_version 23120 (0.0005) [2023-03-09 11:49:57,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 9094.5). Total num frames: 11862016. Throughput: 0: 8965.6. Samples: 11849596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:49:57,858][708628] Avg episode reward: [(0, '1031.974')] [2023-03-09 11:49:59,367][709034] Updated weights for policy 0, policy_version 23200 (0.0005) [2023-03-09 11:50:02,857][708628] Fps is (10 sec: 8601.5, 60 sec: 8874.7, 300 sec: 9094.5). Total num frames: 11907072. Throughput: 0: 8930.5. Samples: 11899416. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:50:02,858][708628] Avg episode reward: [(0, '825.708')] [2023-03-09 11:50:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000023256_11907072.pth... [2023-03-09 11:50:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000022728_11636736.pth [2023-03-09 11:50:03,964][709034] Updated weights for policy 0, policy_version 23280 (0.0005) [2023-03-09 11:50:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 9108.4). Total num frames: 11952128. Throughput: 0: 8945.3. Samples: 11953260. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:50:07,858][708628] Avg episode reward: [(0, '826.220')] [2023-03-09 11:50:08,614][709034] Updated weights for policy 0, policy_version 23360 (0.0006) [2023-03-09 11:50:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8874.7, 300 sec: 9094.5). Total num frames: 11997184. Throughput: 0: 8997.6. Samples: 11980664. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:50:12,858][708628] Avg episode reward: [(0, '911.329')] [2023-03-09 11:50:13,017][709034] Updated weights for policy 0, policy_version 23440 (0.0005) [2023-03-09 11:50:17,616][709034] Updated weights for policy 0, policy_version 23520 (0.0005) [2023-03-09 11:50:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9080.6). Total num frames: 12042240. Throughput: 0: 8957.7. Samples: 12034896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:50:17,858][708628] Avg episode reward: [(0, '1243.871')] [2023-03-09 11:50:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000023520_12042240.pth... [2023-03-09 11:50:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000023000_11776000.pth [2023-03-09 11:50:22,373][709034] Updated weights for policy 0, policy_version 23600 (0.0004) [2023-03-09 11:50:22,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 9066.7). Total num frames: 12083200. Throughput: 0: 8985.2. Samples: 12087140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:50:22,858][708628] Avg episode reward: [(0, '1571.676')] [2023-03-09 11:50:27,150][709034] Updated weights for policy 0, policy_version 23680 (0.0005) [2023-03-09 11:50:27,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 9066.7). Total num frames: 12128256. Throughput: 0: 8890.9. Samples: 12111936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:50:27,858][708628] Avg episode reward: [(0, '2730.304')] [2023-03-09 11:50:31,822][709034] Updated weights for policy 0, policy_version 23760 (0.0005) [2023-03-09 11:50:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9052.9). Total num frames: 12173312. Throughput: 0: 8816.8. Samples: 12165032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:50:32,858][708628] Avg episode reward: [(0, '2045.485')] [2023-03-09 11:50:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000023776_12173312.pth... [2023-03-09 11:50:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000023256_11907072.pth [2023-03-09 11:50:36,102][709034] Updated weights for policy 0, policy_version 23840 (0.0005) [2023-03-09 11:50:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9052.9). Total num frames: 12218368. Throughput: 0: 8841.7. Samples: 12220020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:50:37,858][708628] Avg episode reward: [(0, '2295.937')] [2023-03-09 11:50:40,802][709034] Updated weights for policy 0, policy_version 23920 (0.0005) [2023-03-09 11:50:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 9052.9). Total num frames: 12263424. Throughput: 0: 8831.0. Samples: 12246992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:50:42,858][708628] Avg episode reward: [(0, '1626.893')] [2023-03-09 11:50:45,364][709034] Updated weights for policy 0, policy_version 24000 (0.0005) [2023-03-09 11:50:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8874.7, 300 sec: 9039.0). Total num frames: 12308480. Throughput: 0: 8905.6. Samples: 12300168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:50:47,858][708628] Avg episode reward: [(0, '1798.161')] [2023-03-09 11:50:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000024040_12308480.pth... [2023-03-09 11:50:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000023520_12042240.pth [2023-03-09 11:50:50,030][709034] Updated weights for policy 0, policy_version 24080 (0.0005) [2023-03-09 11:50:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.6, 300 sec: 9039.0). Total num frames: 12353536. Throughput: 0: 8889.3. Samples: 12353280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:50:52,858][708628] Avg episode reward: [(0, '2132.713')] [2023-03-09 11:50:54,778][709034] Updated weights for policy 0, policy_version 24160 (0.0005) [2023-03-09 11:50:57,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8874.7, 300 sec: 9025.1). Total num frames: 12394496. Throughput: 0: 8843.7. Samples: 12378632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:50:57,858][708628] Avg episode reward: [(0, '1627.434')] [2023-03-09 11:50:59,226][709034] Updated weights for policy 0, policy_version 24240 (0.0005) [2023-03-09 11:51:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 9039.0). Total num frames: 12443648. Throughput: 0: 8906.4. Samples: 12435684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:51:02,858][708628] Avg episode reward: [(0, '1995.651')] [2023-03-09 11:51:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000024304_12443648.pth... [2023-03-09 11:51:02,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000023776_12173312.pth [2023-03-09 11:51:03,536][709034] Updated weights for policy 0, policy_version 24320 (0.0005) [2023-03-09 11:51:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 8942.9, 300 sec: 9039.0). Total num frames: 12488704. Throughput: 0: 8999.6. Samples: 12492120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:51:07,858][708628] Avg episode reward: [(0, '3101.341')] [2023-03-09 11:51:07,877][709034] Updated weights for policy 0, policy_version 24400 (0.0005) [2023-03-09 11:51:12,263][709034] Updated weights for policy 0, policy_version 24480 (0.0005) [2023-03-09 11:51:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9011.2, 300 sec: 9052.9). Total num frames: 12537856. Throughput: 0: 9093.5. Samples: 12521144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:51:12,868][708628] Avg episode reward: [(0, '3336.400')] [2023-03-09 11:51:16,770][709034] Updated weights for policy 0, policy_version 24560 (0.0005) [2023-03-09 11:51:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9011.2, 300 sec: 9039.0). Total num frames: 12582912. Throughput: 0: 9104.2. Samples: 12574720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:51:17,858][708628] Avg episode reward: [(0, '3510.284')] [2023-03-09 11:51:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000024576_12582912.pth... [2023-03-09 11:51:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000024040_12308480.pth [2023-03-09 11:51:17,864][708990] Saving new best policy, reward=3510.284! [2023-03-09 11:51:21,288][709034] Updated weights for policy 0, policy_version 24640 (0.0005) [2023-03-09 11:51:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9052.9). Total num frames: 12627968. Throughput: 0: 9097.4. Samples: 12629404. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:51:22,858][708628] Avg episode reward: [(0, '3220.356')] [2023-03-09 11:51:25,819][709034] Updated weights for policy 0, policy_version 24720 (0.0005) [2023-03-09 11:51:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9052.9). Total num frames: 12673024. Throughput: 0: 9102.5. Samples: 12656604. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:51:27,858][708628] Avg episode reward: [(0, '3565.856')] [2023-03-09 11:51:27,858][708990] Saving new best policy, reward=3565.856! [2023-03-09 11:51:30,242][709034] Updated weights for policy 0, policy_version 24800 (0.0005) [2023-03-09 11:51:32,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9079.5, 300 sec: 9039.0). Total num frames: 12718080. Throughput: 0: 9133.3. Samples: 12711168. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:51:32,858][708628] Avg episode reward: [(0, '3730.353')] [2023-03-09 11:51:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000024848_12722176.pth... [2023-03-09 11:51:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000024304_12443648.pth [2023-03-09 11:51:32,863][708990] Saving new best policy, reward=3730.353! [2023-03-09 11:51:34,686][709034] Updated weights for policy 0, policy_version 24880 (0.0005) [2023-03-09 11:51:37,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9147.8, 300 sec: 9066.7). Total num frames: 12767232. Throughput: 0: 9252.0. Samples: 12769620. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:51:37,858][708628] Avg episode reward: [(0, '3399.042')] [2023-03-09 11:51:38,878][709034] Updated weights for policy 0, policy_version 24960 (0.0005) [2023-03-09 11:51:42,857][708628] Fps is (10 sec: 9421.0, 60 sec: 9147.7, 300 sec: 9066.7). Total num frames: 12812288. Throughput: 0: 9309.9. Samples: 12797576. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:51:42,857][708628] Avg episode reward: [(0, '2112.228')] [2023-03-09 11:51:43,422][709034] Updated weights for policy 0, policy_version 25040 (0.0005) [2023-03-09 11:51:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9066.7). Total num frames: 12857344. Throughput: 0: 9186.1. Samples: 12849056. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:51:47,858][708628] Avg episode reward: [(0, '2588.852')] [2023-03-09 11:51:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000025112_12857344.pth... [2023-03-09 11:51:47,866][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000024576_12582912.pth [2023-03-09 11:51:48,122][709034] Updated weights for policy 0, policy_version 25120 (0.0005) [2023-03-09 11:51:52,609][709034] Updated weights for policy 0, policy_version 25200 (0.0005) [2023-03-09 11:51:52,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9039.0). Total num frames: 12902400. Throughput: 0: 9141.2. Samples: 12903476. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:51:52,858][708628] Avg episode reward: [(0, '3266.117')] [2023-03-09 11:51:57,339][709034] Updated weights for policy 0, policy_version 25280 (0.0005) [2023-03-09 11:51:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9025.1). Total num frames: 12947456. Throughput: 0: 9101.3. Samples: 12930704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:51:57,858][708628] Avg episode reward: [(0, '3277.009')] [2023-03-09 11:52:01,881][709034] Updated weights for policy 0, policy_version 25360 (0.0005) [2023-03-09 11:52:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9025.1). Total num frames: 12992512. Throughput: 0: 9093.9. Samples: 12983944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:52:02,858][708628] Avg episode reward: [(0, '2699.357')] [2023-03-09 11:52:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000025376_12992512.pth... [2023-03-09 11:52:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000024848_12722176.pth [2023-03-09 11:52:06,335][709034] Updated weights for policy 0, policy_version 25440 (0.0005) [2023-03-09 11:52:07,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9079.5, 300 sec: 9025.1). Total num frames: 13033472. Throughput: 0: 9067.1. Samples: 13037424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:52:07,858][708628] Avg episode reward: [(0, '2919.479')] [2023-03-09 11:52:10,926][709034] Updated weights for policy 0, policy_version 25520 (0.0005) [2023-03-09 11:52:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9039.0). Total num frames: 13082624. Throughput: 0: 9083.1. Samples: 13065344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:52:12,858][708628] Avg episode reward: [(0, '2413.913')] [2023-03-09 11:52:15,274][709034] Updated weights for policy 0, policy_version 25600 (0.0005) [2023-03-09 11:52:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9039.0). Total num frames: 13127680. Throughput: 0: 9074.0. Samples: 13119496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:52:17,858][708628] Avg episode reward: [(0, '2091.143')] [2023-03-09 11:52:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000025640_13127680.pth... [2023-03-09 11:52:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000025112_12857344.pth [2023-03-09 11:52:19,886][709034] Updated weights for policy 0, policy_version 25680 (0.0005) [2023-03-09 11:52:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9025.1). Total num frames: 13172736. Throughput: 0: 8990.6. Samples: 13174196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:52:22,858][708628] Avg episode reward: [(0, '2479.639')] [2023-03-09 11:52:24,496][709034] Updated weights for policy 0, policy_version 25760 (0.0005) [2023-03-09 11:52:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9039.0). Total num frames: 13217792. Throughput: 0: 8955.8. Samples: 13200588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:52:27,858][708628] Avg episode reward: [(0, '2470.052')] [2023-03-09 11:52:29,121][709034] Updated weights for policy 0, policy_version 25840 (0.0005) [2023-03-09 11:52:32,857][708628] Fps is (10 sec: 8601.5, 60 sec: 9011.2, 300 sec: 9025.1). Total num frames: 13258752. Throughput: 0: 9010.6. Samples: 13254532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:52:32,858][708628] Avg episode reward: [(0, '2082.064')] [2023-03-09 11:52:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000025896_13258752.pth... [2023-03-09 11:52:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000025376_12992512.pth [2023-03-09 11:52:33,841][709034] Updated weights for policy 0, policy_version 25920 (0.0005) [2023-03-09 11:52:37,857][708628] Fps is (10 sec: 8601.5, 60 sec: 8942.9, 300 sec: 9025.1). Total num frames: 13303808. Throughput: 0: 8914.2. Samples: 13304616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:52:37,858][708628] Avg episode reward: [(0, '2149.935')] [2023-03-09 11:52:38,531][709034] Updated weights for policy 0, policy_version 26000 (0.0005) [2023-03-09 11:52:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9011.2). Total num frames: 13348864. Throughput: 0: 8926.5. Samples: 13332396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:52:42,858][708628] Avg episode reward: [(0, '2021.948')] [2023-03-09 11:52:43,342][709034] Updated weights for policy 0, policy_version 26080 (0.0004) [2023-03-09 11:52:47,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8997.3). Total num frames: 13389824. Throughput: 0: 8878.2. Samples: 13383460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:52:47,858][708628] Avg episode reward: [(0, '2079.263')] [2023-03-09 11:52:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000026152_13389824.pth... [2023-03-09 11:52:47,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000025640_13127680.pth [2023-03-09 11:52:47,997][709034] Updated weights for policy 0, policy_version 26160 (0.0005) [2023-03-09 11:52:52,590][709034] Updated weights for policy 0, policy_version 26240 (0.0005) [2023-03-09 11:52:52,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8874.7, 300 sec: 8997.3). Total num frames: 13434880. Throughput: 0: 8865.5. Samples: 13436372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:52:52,858][708628] Avg episode reward: [(0, '1756.437')] [2023-03-09 11:52:57,386][709034] Updated weights for policy 0, policy_version 26320 (0.0005) [2023-03-09 11:52:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8997.3). Total num frames: 13479936. Throughput: 0: 8811.2. Samples: 13461848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:52:57,858][708628] Avg episode reward: [(0, '1758.340')] [2023-03-09 11:53:01,870][709034] Updated weights for policy 0, policy_version 26400 (0.0005) [2023-03-09 11:53:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8874.7, 300 sec: 8983.4). Total num frames: 13524992. Throughput: 0: 8824.3. Samples: 13516588. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:53:02,867][708628] Avg episode reward: [(0, '1520.031')] [2023-03-09 11:53:02,870][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000026416_13524992.pth... [2023-03-09 11:53:02,872][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000025896_13258752.pth [2023-03-09 11:53:06,471][709034] Updated weights for policy 0, policy_version 26480 (0.0005) [2023-03-09 11:53:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8983.4). Total num frames: 13570048. Throughput: 0: 8793.7. Samples: 13569912. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:53:07,868][708628] Avg episode reward: [(0, '1590.429')] [2023-03-09 11:53:10,664][709034] Updated weights for policy 0, policy_version 26560 (0.0005) [2023-03-09 11:53:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8983.4). Total num frames: 13615104. Throughput: 0: 8862.2. Samples: 13599388. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:53:12,858][708628] Avg episode reward: [(0, '1047.031')] [2023-03-09 11:53:15,155][709034] Updated weights for policy 0, policy_version 26640 (0.0005) [2023-03-09 11:53:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 8942.9, 300 sec: 8997.3). Total num frames: 13664256. Throughput: 0: 8922.9. Samples: 13656064. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:53:17,858][708628] Avg episode reward: [(0, '279.557')] [2023-03-09 11:53:17,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000026688_13664256.pth... [2023-03-09 11:53:17,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000026152_13389824.pth [2023-03-09 11:53:19,677][709034] Updated weights for policy 0, policy_version 26720 (0.0005) [2023-03-09 11:53:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 8942.9, 300 sec: 8997.3). Total num frames: 13709312. Throughput: 0: 8994.7. Samples: 13709376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:53:22,858][708628] Avg episode reward: [(0, '692.417')] [2023-03-09 11:53:24,051][709034] Updated weights for policy 0, policy_version 26800 (0.0004) [2023-03-09 11:53:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8942.9, 300 sec: 8997.3). Total num frames: 13754368. Throughput: 0: 9001.0. Samples: 13737440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:53:27,858][708628] Avg episode reward: [(0, '1222.833')] [2023-03-09 11:53:28,632][709034] Updated weights for policy 0, policy_version 26880 (0.0005) [2023-03-09 11:53:32,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9011.2, 300 sec: 8997.3). Total num frames: 13799424. Throughput: 0: 9070.4. Samples: 13791628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:53:32,858][708628] Avg episode reward: [(0, '1932.899')] [2023-03-09 11:53:32,879][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000026960_13803520.pth... [2023-03-09 11:53:32,880][709034] Updated weights for policy 0, policy_version 26960 (0.0005) [2023-03-09 11:53:32,881][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000026416_13524992.pth [2023-03-09 11:53:36,975][709034] Updated weights for policy 0, policy_version 27040 (0.0005) [2023-03-09 11:53:37,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9079.5, 300 sec: 8997.3). Total num frames: 13848576. Throughput: 0: 9237.2. Samples: 13852044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:53:37,858][708628] Avg episode reward: [(0, '1740.755')] [2023-03-09 11:53:41,690][709034] Updated weights for policy 0, policy_version 27120 (0.0005) [2023-03-09 11:53:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 8997.3). Total num frames: 13893632. Throughput: 0: 9239.6. Samples: 13877628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:53:42,868][708628] Avg episode reward: [(0, '2424.766')] [2023-03-09 11:53:46,526][709034] Updated weights for policy 0, policy_version 27200 (0.0005) [2023-03-09 11:53:47,857][708628] Fps is (10 sec: 8601.5, 60 sec: 9079.5, 300 sec: 8983.4). Total num frames: 13934592. Throughput: 0: 9161.5. Samples: 13928856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:53:47,858][708628] Avg episode reward: [(0, '2285.600')] [2023-03-09 11:53:47,901][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000027224_13938688.pth... [2023-03-09 11:53:47,903][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000026688_13664256.pth [2023-03-09 11:53:50,783][709034] Updated weights for policy 0, policy_version 27280 (0.0004) [2023-03-09 11:53:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 8997.3). Total num frames: 13983744. Throughput: 0: 9275.4. Samples: 13987304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:53:52,858][708628] Avg episode reward: [(0, '2279.675')] [2023-03-09 11:53:54,988][709034] Updated weights for policy 0, policy_version 27360 (0.0005) [2023-03-09 11:53:57,857][708628] Fps is (10 sec: 9830.5, 60 sec: 9216.0, 300 sec: 9011.2). Total num frames: 14032896. Throughput: 0: 9266.8. Samples: 14016392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:53:57,858][708628] Avg episode reward: [(0, '1980.759')] [2023-03-09 11:53:59,409][709034] Updated weights for policy 0, policy_version 27440 (0.0005) [2023-03-09 11:54:02,857][708628] Fps is (10 sec: 9830.2, 60 sec: 9284.3, 300 sec: 9025.1). Total num frames: 14082048. Throughput: 0: 9216.9. Samples: 14070824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:54:02,858][708628] Avg episode reward: [(0, '1720.957')] [2023-03-09 11:54:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000027504_14082048.pth... [2023-03-09 11:54:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000026960_13803520.pth [2023-03-09 11:54:03,652][709034] Updated weights for policy 0, policy_version 27520 (0.0005) [2023-03-09 11:54:07,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.2, 300 sec: 9025.1). Total num frames: 14127104. Throughput: 0: 9314.3. Samples: 14128520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:54:07,858][708628] Avg episode reward: [(0, '2481.880')] [2023-03-09 11:54:07,981][709034] Updated weights for policy 0, policy_version 27600 (0.0005) [2023-03-09 11:54:12,298][709034] Updated weights for policy 0, policy_version 27680 (0.0005) [2023-03-09 11:54:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9052.9). Total num frames: 14176256. Throughput: 0: 9360.5. Samples: 14158664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:54:12,858][708628] Avg episode reward: [(0, '2271.406')] [2023-03-09 11:54:16,833][709034] Updated weights for policy 0, policy_version 27760 (0.0005) [2023-03-09 11:54:17,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9052.9). Total num frames: 14221312. Throughput: 0: 9364.2. Samples: 14213016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:54:17,858][708628] Avg episode reward: [(0, '1902.672')] [2023-03-09 11:54:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000027776_14221312.pth... [2023-03-09 11:54:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000027224_13938688.pth [2023-03-09 11:54:21,550][709034] Updated weights for policy 0, policy_version 27840 (0.0005) [2023-03-09 11:54:22,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9216.0, 300 sec: 9052.9). Total num frames: 14262272. Throughput: 0: 9169.7. Samples: 14264680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:54:22,858][708628] Avg episode reward: [(0, '1722.450')] [2023-03-09 11:54:26,145][709034] Updated weights for policy 0, policy_version 27920 (0.0005) [2023-03-09 11:54:27,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9216.0, 300 sec: 9052.9). Total num frames: 14307328. Throughput: 0: 9210.7. Samples: 14292108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:54:27,858][708628] Avg episode reward: [(0, '2130.762')] [2023-03-09 11:54:30,735][709034] Updated weights for policy 0, policy_version 28000 (0.0005) [2023-03-09 11:54:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.2, 300 sec: 9066.7). Total num frames: 14356480. Throughput: 0: 9273.9. Samples: 14346180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:54:32,858][708628] Avg episode reward: [(0, '2598.660')] [2023-03-09 11:54:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000028040_14356480.pth... [2023-03-09 11:54:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000027504_14082048.pth [2023-03-09 11:54:35,260][709034] Updated weights for policy 0, policy_version 28080 (0.0005) [2023-03-09 11:54:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9039.0). Total num frames: 14397440. Throughput: 0: 9135.7. Samples: 14398412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:54:37,858][708628] Avg episode reward: [(0, '1525.583')] [2023-03-09 11:54:39,947][709034] Updated weights for policy 0, policy_version 28160 (0.0005) [2023-03-09 11:54:42,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9147.7, 300 sec: 9039.0). Total num frames: 14442496. Throughput: 0: 9085.8. Samples: 14425252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:54:42,858][708628] Avg episode reward: [(0, '2012.861')] [2023-03-09 11:54:44,400][709034] Updated weights for policy 0, policy_version 28240 (0.0005) [2023-03-09 11:54:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9052.8). Total num frames: 14491648. Throughput: 0: 9137.2. Samples: 14482000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:54:47,858][708628] Avg episode reward: [(0, '1734.497')] [2023-03-09 11:54:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000028304_14491648.pth... [2023-03-09 11:54:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000027776_14221312.pth [2023-03-09 11:54:48,621][709034] Updated weights for policy 0, policy_version 28320 (0.0004) [2023-03-09 11:54:52,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9066.7). Total num frames: 14536704. Throughput: 0: 9121.0. Samples: 14538964. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:54:52,858][708628] Avg episode reward: [(0, '1771.948')] [2023-03-09 11:54:53,027][709034] Updated weights for policy 0, policy_version 28400 (0.0005) [2023-03-09 11:54:57,354][709034] Updated weights for policy 0, policy_version 28480 (0.0004) [2023-03-09 11:54:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9080.6). Total num frames: 14585856. Throughput: 0: 9083.0. Samples: 14567400. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:54:57,858][708628] Avg episode reward: [(0, '2148.826')] [2023-03-09 11:55:01,959][709034] Updated weights for policy 0, policy_version 28560 (0.0004) [2023-03-09 11:55:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9080.6). Total num frames: 14630912. Throughput: 0: 9076.7. Samples: 14621468. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:55:02,858][708628] Avg episode reward: [(0, '2471.023')] [2023-03-09 11:55:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000028576_14630912.pth... [2023-03-09 11:55:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000028040_14356480.pth [2023-03-09 11:55:06,395][709034] Updated weights for policy 0, policy_version 28640 (0.0005) [2023-03-09 11:55:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9080.6). Total num frames: 14675968. Throughput: 0: 9139.7. Samples: 14675968. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 11:55:07,858][708628] Avg episode reward: [(0, '2175.494')] [2023-03-09 11:55:10,666][709034] Updated weights for policy 0, policy_version 28720 (0.0005) [2023-03-09 11:55:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9080.6). Total num frames: 14721024. Throughput: 0: 9181.8. Samples: 14705288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:55:12,858][708628] Avg episode reward: [(0, '2338.090')] [2023-03-09 11:55:15,348][709034] Updated weights for policy 0, policy_version 28800 (0.0005) [2023-03-09 11:55:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9094.5). Total num frames: 14766080. Throughput: 0: 9150.5. Samples: 14757952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:55:17,858][708628] Avg episode reward: [(0, '3096.150')] [2023-03-09 11:55:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000028840_14766080.pth... [2023-03-09 11:55:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000028304_14491648.pth [2023-03-09 11:55:19,863][709034] Updated weights for policy 0, policy_version 28880 (0.0005) [2023-03-09 11:55:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9094.5). Total num frames: 14811136. Throughput: 0: 9248.0. Samples: 14814572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:55:22,858][708628] Avg episode reward: [(0, '3117.124')] [2023-03-09 11:55:24,269][709034] Updated weights for policy 0, policy_version 28960 (0.0006) [2023-03-09 11:55:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9094.5). Total num frames: 14856192. Throughput: 0: 9213.8. Samples: 14839872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:55:27,858][708628] Avg episode reward: [(0, '2649.981')] [2023-03-09 11:55:29,026][709034] Updated weights for policy 0, policy_version 29040 (0.0005) [2023-03-09 11:55:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9094.5). Total num frames: 14901248. Throughput: 0: 9172.9. Samples: 14894780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:55:32,858][708628] Avg episode reward: [(0, '2545.155')] [2023-03-09 11:55:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000029104_14901248.pth... [2023-03-09 11:55:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000028576_14630912.pth [2023-03-09 11:55:33,422][709034] Updated weights for policy 0, policy_version 29120 (0.0005) [2023-03-09 11:55:37,814][709034] Updated weights for policy 0, policy_version 29200 (0.0005) [2023-03-09 11:55:37,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9108.4). Total num frames: 14950400. Throughput: 0: 9139.5. Samples: 14950244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:55:37,858][708628] Avg episode reward: [(0, '1366.360')] [2023-03-09 11:55:42,251][709034] Updated weights for policy 0, policy_version 29280 (0.0005) [2023-03-09 11:55:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9108.4). Total num frames: 14995456. Throughput: 0: 9141.5. Samples: 14978768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:55:42,858][708628] Avg episode reward: [(0, '1891.115')] [2023-03-09 11:55:46,503][709034] Updated weights for policy 0, policy_version 29360 (0.0004) [2023-03-09 11:55:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9122.3). Total num frames: 15044608. Throughput: 0: 9196.9. Samples: 15035328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:55:47,858][708628] Avg episode reward: [(0, '1510.518')] [2023-03-09 11:55:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000029384_15044608.pth... [2023-03-09 11:55:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000028840_14766080.pth [2023-03-09 11:55:50,888][709034] Updated weights for policy 0, policy_version 29440 (0.0005) [2023-03-09 11:55:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9136.2). Total num frames: 15089664. Throughput: 0: 9219.4. Samples: 15090840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:55:52,858][708628] Avg episode reward: [(0, '2025.370')] [2023-03-09 11:55:55,322][709034] Updated weights for policy 0, policy_version 29520 (0.0005) [2023-03-09 11:55:57,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9136.2). Total num frames: 15138816. Throughput: 0: 9180.3. Samples: 15118400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:55:57,868][708628] Avg episode reward: [(0, '2429.978')] [2023-03-09 11:55:59,603][709034] Updated weights for policy 0, policy_version 29600 (0.0005) [2023-03-09 11:56:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9136.2). Total num frames: 15183872. Throughput: 0: 9282.5. Samples: 15175664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:56:02,858][708628] Avg episode reward: [(0, '1648.448')] [2023-03-09 11:56:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000029656_15183872.pth... [2023-03-09 11:56:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000029104_14901248.pth [2023-03-09 11:56:03,952][709034] Updated weights for policy 0, policy_version 29680 (0.0005) [2023-03-09 11:56:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9122.3). Total num frames: 15228928. Throughput: 0: 9249.7. Samples: 15230808. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:56:07,858][708628] Avg episode reward: [(0, '1800.646')] [2023-03-09 11:56:08,489][709034] Updated weights for policy 0, policy_version 29760 (0.0005) [2023-03-09 11:56:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9122.3). Total num frames: 15273984. Throughput: 0: 9280.9. Samples: 15257512. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:56:12,858][708628] Avg episode reward: [(0, '1807.885')] [2023-03-09 11:56:12,977][709034] Updated weights for policy 0, policy_version 29840 (0.0006) [2023-03-09 11:56:17,121][709034] Updated weights for policy 0, policy_version 29920 (0.0004) [2023-03-09 11:56:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9136.2). Total num frames: 15323136. Throughput: 0: 9338.4. Samples: 15315008. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:56:17,858][708628] Avg episode reward: [(0, '1508.953')] [2023-03-09 11:56:17,893][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000029936_15327232.pth... [2023-03-09 11:56:17,896][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000029384_15044608.pth [2023-03-09 11:56:21,411][709034] Updated weights for policy 0, policy_version 30000 (0.0005) [2023-03-09 11:56:22,857][708628] Fps is (10 sec: 9830.5, 60 sec: 9352.5, 300 sec: 9150.0). Total num frames: 15372288. Throughput: 0: 9378.8. Samples: 15372288. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 11:56:22,858][708628] Avg episode reward: [(0, '1970.796')] [2023-03-09 11:56:25,938][709034] Updated weights for policy 0, policy_version 30080 (0.0005) [2023-03-09 11:56:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9150.0). Total num frames: 15417344. Throughput: 0: 9363.9. Samples: 15400144. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:56:27,858][708628] Avg episode reward: [(0, '2030.908')] [2023-03-09 11:56:30,576][709034] Updated weights for policy 0, policy_version 30160 (0.0005) [2023-03-09 11:56:32,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9136.2). Total num frames: 15462400. Throughput: 0: 9290.3. Samples: 15453392. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:56:32,858][708628] Avg episode reward: [(0, '2430.229')] [2023-03-09 11:56:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000030200_15462400.pth... [2023-03-09 11:56:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000029656_15183872.pth [2023-03-09 11:56:35,097][709034] Updated weights for policy 0, policy_version 30240 (0.0005) [2023-03-09 11:56:37,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9216.0, 300 sec: 9122.3). Total num frames: 15503360. Throughput: 0: 9256.0. Samples: 15507360. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:56:37,858][708628] Avg episode reward: [(0, '1985.074')] [2023-03-09 11:56:39,533][709034] Updated weights for policy 0, policy_version 30320 (0.0005) [2023-03-09 11:56:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9136.2). Total num frames: 15552512. Throughput: 0: 9282.2. Samples: 15536100. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:56:42,858][708628] Avg episode reward: [(0, '1753.609')] [2023-03-09 11:56:43,921][709034] Updated weights for policy 0, policy_version 30400 (0.0005) [2023-03-09 11:56:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9136.2). Total num frames: 15597568. Throughput: 0: 9249.9. Samples: 15591908. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:56:47,858][708628] Avg episode reward: [(0, '2592.396')] [2023-03-09 11:56:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000030464_15597568.pth... [2023-03-09 11:56:47,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000029936_15327232.pth [2023-03-09 11:56:48,292][709034] Updated weights for policy 0, policy_version 30480 (0.0005) [2023-03-09 11:56:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9136.2). Total num frames: 15642624. Throughput: 0: 9191.8. Samples: 15644440. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:56:52,858][708628] Avg episode reward: [(0, '2051.811')] [2023-03-09 11:56:53,027][709034] Updated weights for policy 0, policy_version 30560 (0.0005) [2023-03-09 11:56:57,353][709034] Updated weights for policy 0, policy_version 30640 (0.0005) [2023-03-09 11:56:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9150.0). Total num frames: 15691776. Throughput: 0: 9237.8. Samples: 15673212. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:56:57,858][708628] Avg episode reward: [(0, '1875.735')] [2023-03-09 11:57:01,715][709034] Updated weights for policy 0, policy_version 30720 (0.0005) [2023-03-09 11:57:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9163.9). Total num frames: 15736832. Throughput: 0: 9193.2. Samples: 15728704. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:57:02,858][708628] Avg episode reward: [(0, '2591.338')] [2023-03-09 11:57:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000030736_15736832.pth... [2023-03-09 11:57:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000030200_15462400.pth [2023-03-09 11:57:06,203][709034] Updated weights for policy 0, policy_version 30800 (0.0004) [2023-03-09 11:57:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9163.9). Total num frames: 15785984. Throughput: 0: 9186.2. Samples: 15785668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:57:07,858][708628] Avg episode reward: [(0, '2987.281')] [2023-03-09 11:57:10,435][709034] Updated weights for policy 0, policy_version 30880 (0.0004) [2023-03-09 11:57:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9163.9). Total num frames: 15831040. Throughput: 0: 9199.2. Samples: 15814108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:57:12,858][708628] Avg episode reward: [(0, '3248.521')] [2023-03-09 11:57:14,729][709034] Updated weights for policy 0, policy_version 30960 (0.0005) [2023-03-09 11:57:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9177.8). Total num frames: 15880192. Throughput: 0: 9302.1. Samples: 15871988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:57:17,858][708628] Avg episode reward: [(0, '2959.735')] [2023-03-09 11:57:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000031016_15880192.pth... [2023-03-09 11:57:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000030464_15597568.pth [2023-03-09 11:57:18,979][709034] Updated weights for policy 0, policy_version 31040 (0.0005) [2023-03-09 11:57:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 15925248. Throughput: 0: 9334.3. Samples: 15927404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:57:22,858][708628] Avg episode reward: [(0, '2782.771')] [2023-03-09 11:57:23,518][709034] Updated weights for policy 0, policy_version 31120 (0.0005) [2023-03-09 11:57:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 15970304. Throughput: 0: 9272.1. Samples: 15953344. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:57:27,858][708628] Avg episode reward: [(0, '2379.179')] [2023-03-09 11:57:28,168][709034] Updated weights for policy 0, policy_version 31200 (0.0005) [2023-03-09 11:57:32,680][709034] Updated weights for policy 0, policy_version 31280 (0.0005) [2023-03-09 11:57:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 16015360. Throughput: 0: 9229.4. Samples: 16007232. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:57:32,858][708628] Avg episode reward: [(0, '2588.660')] [2023-03-09 11:57:32,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000031280_16015360.pth... [2023-03-09 11:57:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000030736_15736832.pth [2023-03-09 11:57:37,315][709034] Updated weights for policy 0, policy_version 31360 (0.0005) [2023-03-09 11:57:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9191.7). Total num frames: 16060416. Throughput: 0: 9245.3. Samples: 16060480. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:57:37,858][708628] Avg episode reward: [(0, '2294.352')] [2023-03-09 11:57:41,657][709034] Updated weights for policy 0, policy_version 31440 (0.0004) [2023-03-09 11:57:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9205.6). Total num frames: 16105472. Throughput: 0: 9251.0. Samples: 16089508. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 11:57:42,858][708628] Avg episode reward: [(0, '2126.772')] [2023-03-09 11:57:46,371][709034] Updated weights for policy 0, policy_version 31520 (0.0005) [2023-03-09 11:57:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9205.6). Total num frames: 16150528. Throughput: 0: 9184.9. Samples: 16142024. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:57:47,858][708628] Avg episode reward: [(0, '2571.963')] [2023-03-09 11:57:47,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000031544_16150528.pth... [2023-03-09 11:57:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000031016_15880192.pth [2023-03-09 11:57:51,267][709034] Updated weights for policy 0, policy_version 31600 (0.0005) [2023-03-09 11:57:52,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9147.7, 300 sec: 9191.7). Total num frames: 16191488. Throughput: 0: 9074.6. Samples: 16194024. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:57:52,858][708628] Avg episode reward: [(0, '2508.825')] [2023-03-09 11:57:55,872][709034] Updated weights for policy 0, policy_version 31680 (0.0005) [2023-03-09 11:57:57,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9079.5, 300 sec: 9191.7). Total num frames: 16236544. Throughput: 0: 9021.3. Samples: 16220068. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:57:57,858][708628] Avg episode reward: [(0, '2641.813')] [2023-03-09 11:58:00,354][709034] Updated weights for policy 0, policy_version 31760 (0.0004) [2023-03-09 11:58:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9079.5, 300 sec: 9191.7). Total num frames: 16281600. Throughput: 0: 8919.2. Samples: 16273352. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:58:02,858][708628] Avg episode reward: [(0, '2761.329')] [2023-03-09 11:58:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000031800_16281600.pth... [2023-03-09 11:58:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000031280_16015360.pth [2023-03-09 11:58:04,906][709034] Updated weights for policy 0, policy_version 31840 (0.0005) [2023-03-09 11:58:07,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9011.2, 300 sec: 9191.7). Total num frames: 16326656. Throughput: 0: 8897.9. Samples: 16327808. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 11:58:07,858][708628] Avg episode reward: [(0, '1895.290')] [2023-03-09 11:58:09,274][709034] Updated weights for policy 0, policy_version 31920 (0.0005) [2023-03-09 11:58:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9191.7). Total num frames: 16375808. Throughput: 0: 8993.2. Samples: 16358040. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:58:12,858][708628] Avg episode reward: [(0, '2269.439')] [2023-03-09 11:58:13,499][709034] Updated weights for policy 0, policy_version 32000 (0.0005) [2023-03-09 11:58:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9011.2, 300 sec: 9191.7). Total num frames: 16420864. Throughput: 0: 9022.8. Samples: 16413260. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:58:17,858][708628] Avg episode reward: [(0, '2423.687')] [2023-03-09 11:58:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000032072_16420864.pth... [2023-03-09 11:58:17,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000031544_16150528.pth [2023-03-09 11:58:18,025][709034] Updated weights for policy 0, policy_version 32080 (0.0005) [2023-03-09 11:58:22,208][709034] Updated weights for policy 0, policy_version 32160 (0.0005) [2023-03-09 11:58:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9205.6). Total num frames: 16470016. Throughput: 0: 9122.7. Samples: 16471000. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:58:22,858][708628] Avg episode reward: [(0, '2278.224')] [2023-03-09 11:58:26,624][709034] Updated weights for policy 0, policy_version 32240 (0.0005) [2023-03-09 11:58:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9205.6). Total num frames: 16515072. Throughput: 0: 9108.6. Samples: 16499396. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 11:58:27,858][708628] Avg episode reward: [(0, '1639.597')] [2023-03-09 11:58:31,281][709034] Updated weights for policy 0, policy_version 32320 (0.0005) [2023-03-09 11:58:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 16564224. Throughput: 0: 9122.2. Samples: 16552520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:58:32,858][708628] Avg episode reward: [(0, '1395.706')] [2023-03-09 11:58:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000032352_16564224.pth... [2023-03-09 11:58:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000031800_16281600.pth [2023-03-09 11:58:35,284][709034] Updated weights for policy 0, policy_version 32400 (0.0005) [2023-03-09 11:58:37,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 16609280. Throughput: 0: 9308.5. Samples: 16612908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:58:37,858][708628] Avg episode reward: [(0, '2876.344')] [2023-03-09 11:58:39,610][709034] Updated weights for policy 0, policy_version 32480 (0.0005) [2023-03-09 11:58:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 16654336. Throughput: 0: 9315.7. Samples: 16639276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:58:42,858][708628] Avg episode reward: [(0, '2789.747')] [2023-03-09 11:58:44,146][709034] Updated weights for policy 0, policy_version 32560 (0.0005) [2023-03-09 11:58:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9219.5). Total num frames: 16703488. Throughput: 0: 9371.7. Samples: 16695080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:58:47,858][708628] Avg episode reward: [(0, '2035.709')] [2023-03-09 11:58:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000032624_16703488.pth... [2023-03-09 11:58:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000032072_16420864.pth [2023-03-09 11:58:48,724][709034] Updated weights for policy 0, policy_version 32640 (0.0005) [2023-03-09 11:58:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.2, 300 sec: 9205.6). Total num frames: 16748544. Throughput: 0: 9351.1. Samples: 16748608. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 11:58:52,858][708628] Avg episode reward: [(0, '1599.337')] [2023-03-09 11:58:53,195][709034] Updated weights for policy 0, policy_version 32720 (0.0005) [2023-03-09 11:58:57,611][709034] Updated weights for policy 0, policy_version 32800 (0.0005) [2023-03-09 11:58:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9191.7). Total num frames: 16793600. Throughput: 0: 9277.2. Samples: 16775512. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 11:58:57,858][708628] Avg episode reward: [(0, '2772.248')] [2023-03-09 11:59:02,136][709034] Updated weights for policy 0, policy_version 32880 (0.0005) [2023-03-09 11:59:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9191.7). Total num frames: 16838656. Throughput: 0: 9279.5. Samples: 16830836. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 11:59:02,858][708628] Avg episode reward: [(0, '2708.172')] [2023-03-09 11:59:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000032888_16838656.pth... [2023-03-09 11:59:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000032352_16564224.pth [2023-03-09 11:59:06,998][709034] Updated weights for policy 0, policy_version 32960 (0.0005) [2023-03-09 11:59:07,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9177.8). Total num frames: 16883712. Throughput: 0: 9164.6. Samples: 16883408. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 11:59:07,858][708628] Avg episode reward: [(0, '1830.433')] [2023-03-09 11:59:11,187][709034] Updated weights for policy 0, policy_version 33040 (0.0005) [2023-03-09 11:59:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 16928768. Throughput: 0: 9178.9. Samples: 16912448. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 11:59:12,858][708628] Avg episode reward: [(0, '2218.479')] [2023-03-09 11:59:15,844][709034] Updated weights for policy 0, policy_version 33120 (0.0005) [2023-03-09 11:59:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 16973824. Throughput: 0: 9180.3. Samples: 16965632. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 11:59:17,858][708628] Avg episode reward: [(0, '2150.582')] [2023-03-09 11:59:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000033152_16973824.pth... [2023-03-09 11:59:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000032624_16703488.pth [2023-03-09 11:59:20,249][709034] Updated weights for policy 0, policy_version 33200 (0.0005) [2023-03-09 11:59:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9205.6). Total num frames: 17022976. Throughput: 0: 9114.0. Samples: 17023040. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 11:59:22,858][708628] Avg episode reward: [(0, '2411.887')] [2023-03-09 11:59:24,604][709034] Updated weights for policy 0, policy_version 33280 (0.0005) [2023-03-09 11:59:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 17068032. Throughput: 0: 9163.0. Samples: 17051612. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 11:59:27,858][708628] Avg episode reward: [(0, '2398.991')] [2023-03-09 11:59:29,215][709034] Updated weights for policy 0, policy_version 33360 (0.0005) [2023-03-09 11:59:32,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9079.5, 300 sec: 9191.7). Total num frames: 17108992. Throughput: 0: 9081.5. Samples: 17103748. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 11:59:32,858][708628] Avg episode reward: [(0, '2665.511')] [2023-03-09 11:59:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000033416_17108992.pth... [2023-03-09 11:59:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000032888_16838656.pth [2023-03-09 11:59:33,760][709034] Updated weights for policy 0, policy_version 33440 (0.0005) [2023-03-09 11:59:37,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 17158144. Throughput: 0: 9098.8. Samples: 17158056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:59:37,858][708628] Avg episode reward: [(0, '2324.632')] [2023-03-09 11:59:38,319][709034] Updated weights for policy 0, policy_version 33520 (0.0005) [2023-03-09 11:59:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9177.8). Total num frames: 17199104. Throughput: 0: 9110.3. Samples: 17185476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:59:42,858][708628] Avg episode reward: [(0, '2505.035')] [2023-03-09 11:59:42,887][709034] Updated weights for policy 0, policy_version 33600 (0.0005) [2023-03-09 11:59:47,517][709034] Updated weights for policy 0, policy_version 33680 (0.0005) [2023-03-09 11:59:47,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9011.2, 300 sec: 9177.8). Total num frames: 17244160. Throughput: 0: 9015.7. Samples: 17236544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:59:47,858][708628] Avg episode reward: [(0, '2698.820')] [2023-03-09 11:59:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000033680_17244160.pth... [2023-03-09 11:59:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000033152_16973824.pth [2023-03-09 11:59:52,131][709034] Updated weights for policy 0, policy_version 33760 (0.0004) [2023-03-09 11:59:52,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9011.2, 300 sec: 9163.9). Total num frames: 17289216. Throughput: 0: 9058.7. Samples: 17291048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:59:52,858][708628] Avg episode reward: [(0, '3351.218')] [2023-03-09 11:59:56,748][709034] Updated weights for policy 0, policy_version 33840 (0.0005) [2023-03-09 11:59:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9011.2, 300 sec: 9163.9). Total num frames: 17334272. Throughput: 0: 9006.9. Samples: 17317760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 11:59:57,858][708628] Avg episode reward: [(0, '3276.333')] [2023-03-09 12:00:01,359][709034] Updated weights for policy 0, policy_version 33920 (0.0005) [2023-03-09 12:00:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9163.9). Total num frames: 17379328. Throughput: 0: 9007.0. Samples: 17370948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:00:02,858][708628] Avg episode reward: [(0, '2072.998')] [2023-03-09 12:00:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000033944_17379328.pth... [2023-03-09 12:00:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000033416_17108992.pth [2023-03-09 12:00:05,979][709034] Updated weights for policy 0, policy_version 34000 (0.0005) [2023-03-09 12:00:07,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9011.2, 300 sec: 9163.9). Total num frames: 17424384. Throughput: 0: 8918.9. Samples: 17424392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:00:07,858][708628] Avg episode reward: [(0, '1449.110')] [2023-03-09 12:00:10,427][709034] Updated weights for policy 0, policy_version 34080 (0.0005) [2023-03-09 12:00:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9163.9). Total num frames: 17469440. Throughput: 0: 8910.0. Samples: 17452560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:00:12,858][708628] Avg episode reward: [(0, '2587.324')] [2023-03-09 12:00:14,743][709034] Updated weights for policy 0, policy_version 34160 (0.0005) [2023-03-09 12:00:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9163.9). Total num frames: 17514496. Throughput: 0: 9010.6. Samples: 17509224. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:00:17,858][708628] Avg episode reward: [(0, '2986.059')] [2023-03-09 12:00:17,905][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000034216_17518592.pth... [2023-03-09 12:00:17,908][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000033680_17244160.pth [2023-03-09 12:00:19,265][709034] Updated weights for policy 0, policy_version 34240 (0.0005) [2023-03-09 12:00:22,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9011.2, 300 sec: 9177.8). Total num frames: 17563648. Throughput: 0: 9013.2. Samples: 17563648. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:00:22,858][708628] Avg episode reward: [(0, '3270.726')] [2023-03-09 12:00:23,650][709034] Updated weights for policy 0, policy_version 34320 (0.0005) [2023-03-09 12:00:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 9177.8). Total num frames: 17608704. Throughput: 0: 9025.5. Samples: 17591624. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:00:27,858][708628] Avg episode reward: [(0, '3057.654')] [2023-03-09 12:00:28,195][709034] Updated weights for policy 0, policy_version 34400 (0.0005) [2023-03-09 12:00:32,785][709034] Updated weights for policy 0, policy_version 34480 (0.0005) [2023-03-09 12:00:32,857][708628] Fps is (10 sec: 9011.0, 60 sec: 9079.4, 300 sec: 9163.9). Total num frames: 17653760. Throughput: 0: 9071.8. Samples: 17644776. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:00:32,858][708628] Avg episode reward: [(0, '2846.730')] [2023-03-09 12:00:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000034480_17653760.pth... [2023-03-09 12:00:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000033944_17379328.pth [2023-03-09 12:00:37,431][709034] Updated weights for policy 0, policy_version 34560 (0.0005) [2023-03-09 12:00:37,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8943.0, 300 sec: 9150.0). Total num frames: 17694720. Throughput: 0: 9051.4. Samples: 17698360. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:00:37,858][708628] Avg episode reward: [(0, '2573.698')] [2023-03-09 12:00:42,023][709034] Updated weights for policy 0, policy_version 34640 (0.0005) [2023-03-09 12:00:42,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9011.2, 300 sec: 9136.2). Total num frames: 17739776. Throughput: 0: 9064.7. Samples: 17725672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:00:42,858][708628] Avg episode reward: [(0, '2978.617')] [2023-03-09 12:00:46,417][709034] Updated weights for policy 0, policy_version 34720 (0.0005) [2023-03-09 12:00:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 9150.0). Total num frames: 17788928. Throughput: 0: 9102.7. Samples: 17780568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:00:47,858][708628] Avg episode reward: [(0, '3151.237')] [2023-03-09 12:00:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000034744_17788928.pth... [2023-03-09 12:00:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000034216_17518592.pth [2023-03-09 12:00:50,576][709034] Updated weights for policy 0, policy_version 34800 (0.0005) [2023-03-09 12:00:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9136.2). Total num frames: 17833984. Throughput: 0: 9169.3. Samples: 17837012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:00:52,858][708628] Avg episode reward: [(0, '2630.445')] [2023-03-09 12:00:55,005][709034] Updated weights for policy 0, policy_version 34880 (0.0005) [2023-03-09 12:00:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9150.1). Total num frames: 17883136. Throughput: 0: 9184.8. Samples: 17865876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:00:57,858][708628] Avg episode reward: [(0, '2197.437')] [2023-03-09 12:00:59,441][709034] Updated weights for policy 0, policy_version 34960 (0.0004) [2023-03-09 12:01:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9150.0). Total num frames: 17928192. Throughput: 0: 9131.6. Samples: 17920144. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:01:02,858][708628] Avg episode reward: [(0, '2749.472')] [2023-03-09 12:01:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000035016_17928192.pth... [2023-03-09 12:01:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000034480_17653760.pth [2023-03-09 12:01:04,073][709034] Updated weights for policy 0, policy_version 35040 (0.0005) [2023-03-09 12:01:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9150.0). Total num frames: 17973248. Throughput: 0: 9104.6. Samples: 17973356. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:01:07,868][708628] Avg episode reward: [(0, '2728.254')] [2023-03-09 12:01:08,631][709034] Updated weights for policy 0, policy_version 35120 (0.0005) [2023-03-09 12:01:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9136.2). Total num frames: 18018304. Throughput: 0: 9087.6. Samples: 18000564. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:01:12,868][708628] Avg episode reward: [(0, '1972.924')] [2023-03-09 12:01:13,204][709034] Updated weights for policy 0, policy_version 35200 (0.0005) [2023-03-09 12:01:17,653][709034] Updated weights for policy 0, policy_version 35280 (0.0005) [2023-03-09 12:01:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9122.3). Total num frames: 18063360. Throughput: 0: 9119.7. Samples: 18055160. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:01:17,868][708628] Avg episode reward: [(0, '2303.194')] [2023-03-09 12:01:17,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000035280_18063360.pth... [2023-03-09 12:01:17,874][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000034744_17788928.pth [2023-03-09 12:01:22,064][709034] Updated weights for policy 0, policy_version 35360 (0.0004) [2023-03-09 12:01:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.4, 300 sec: 9122.3). Total num frames: 18108416. Throughput: 0: 9174.1. Samples: 18111196. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:01:22,868][708628] Avg episode reward: [(0, '2438.638')] [2023-03-09 12:01:26,849][709034] Updated weights for policy 0, policy_version 35440 (0.0004) [2023-03-09 12:01:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9122.3). Total num frames: 18153472. Throughput: 0: 9136.4. Samples: 18136812. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:01:27,868][708628] Avg episode reward: [(0, '2687.065')] [2023-03-09 12:01:31,348][709034] Updated weights for policy 0, policy_version 35520 (0.0004) [2023-03-09 12:01:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9136.2). Total num frames: 18198528. Throughput: 0: 9103.0. Samples: 18190204. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:01:32,868][708628] Avg episode reward: [(0, '2118.929')] [2023-03-09 12:01:32,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000035544_18198528.pth... [2023-03-09 12:01:32,874][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000035016_17928192.pth [2023-03-09 12:01:35,721][709034] Updated weights for policy 0, policy_version 35600 (0.0005) [2023-03-09 12:01:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9122.3). Total num frames: 18243584. Throughput: 0: 9049.0. Samples: 18244216. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:01:37,868][708628] Avg episode reward: [(0, '2526.369')] [2023-03-09 12:01:40,600][709034] Updated weights for policy 0, policy_version 35680 (0.0005) [2023-03-09 12:01:42,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9079.5, 300 sec: 9108.4). Total num frames: 18284544. Throughput: 0: 8970.7. Samples: 18269556. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:01:42,868][708628] Avg episode reward: [(0, '2395.883')] [2023-03-09 12:01:45,174][709034] Updated weights for policy 0, policy_version 35760 (0.0005) [2023-03-09 12:01:47,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9011.2, 300 sec: 9108.4). Total num frames: 18329600. Throughput: 0: 8976.2. Samples: 18324072. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:01:47,868][708628] Avg episode reward: [(0, '2500.246')] [2023-03-09 12:01:47,871][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000035800_18329600.pth... [2023-03-09 12:01:47,874][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000035280_18063360.pth [2023-03-09 12:01:49,644][709034] Updated weights for policy 0, policy_version 35840 (0.0005) [2023-03-09 12:01:52,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 9108.4). Total num frames: 18378752. Throughput: 0: 9010.2. Samples: 18378816. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:01:52,868][708628] Avg episode reward: [(0, '2431.673')] [2023-03-09 12:01:54,135][709034] Updated weights for policy 0, policy_version 35920 (0.0005) [2023-03-09 12:01:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 9108.4). Total num frames: 18423808. Throughput: 0: 9027.7. Samples: 18406808. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:01:57,868][708628] Avg episode reward: [(0, '2757.340')] [2023-03-09 12:01:58,570][709034] Updated weights for policy 0, policy_version 36000 (0.0005) [2023-03-09 12:02:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9094.5). Total num frames: 18468864. Throughput: 0: 9009.4. Samples: 18460584. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:02:02,868][708628] Avg episode reward: [(0, '2755.295')] [2023-03-09 12:02:02,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000036072_18468864.pth... [2023-03-09 12:02:02,874][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000035544_18198528.pth [2023-03-09 12:02:03,278][709034] Updated weights for policy 0, policy_version 36080 (0.0004) [2023-03-09 12:02:07,857][708628] Fps is (10 sec: 8601.5, 60 sec: 8942.9, 300 sec: 9080.6). Total num frames: 18509824. Throughput: 0: 8939.6. Samples: 18513476. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:02:07,858][708628] Avg episode reward: [(0, '2365.615')] [2023-03-09 12:02:07,913][709034] Updated weights for policy 0, policy_version 36160 (0.0005) [2023-03-09 12:02:12,419][709034] Updated weights for policy 0, policy_version 36240 (0.0005) [2023-03-09 12:02:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9011.2, 300 sec: 9080.6). Total num frames: 18558976. Throughput: 0: 8930.9. Samples: 18538704. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:02:12,858][708628] Avg episode reward: [(0, '1708.356')] [2023-03-09 12:02:16,870][709034] Updated weights for policy 0, policy_version 36320 (0.0005) [2023-03-09 12:02:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9011.2, 300 sec: 9080.6). Total num frames: 18604032. Throughput: 0: 9010.7. Samples: 18595684. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:02:17,858][708628] Avg episode reward: [(0, '953.069')] [2023-03-09 12:02:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000036336_18604032.pth... [2023-03-09 12:02:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000035800_18329600.pth [2023-03-09 12:02:21,523][709034] Updated weights for policy 0, policy_version 36400 (0.0005) [2023-03-09 12:02:22,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 9066.7). Total num frames: 18644992. Throughput: 0: 8986.4. Samples: 18648604. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:02:22,858][708628] Avg episode reward: [(0, '1021.142')] [2023-03-09 12:02:25,891][709034] Updated weights for policy 0, policy_version 36480 (0.0005) [2023-03-09 12:02:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9011.2, 300 sec: 9080.6). Total num frames: 18694144. Throughput: 0: 9049.6. Samples: 18676788. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:02:27,858][708628] Avg episode reward: [(0, '1257.813')] [2023-03-09 12:02:30,310][709034] Updated weights for policy 0, policy_version 36560 (0.0005) [2023-03-09 12:02:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9011.2, 300 sec: 9080.6). Total num frames: 18739200. Throughput: 0: 9054.6. Samples: 18731528. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:02:32,858][708628] Avg episode reward: [(0, '1214.000')] [2023-03-09 12:02:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000036600_18739200.pth... [2023-03-09 12:02:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000036072_18468864.pth [2023-03-09 12:02:34,871][709034] Updated weights for policy 0, policy_version 36640 (0.0005) [2023-03-09 12:02:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9080.6). Total num frames: 18784256. Throughput: 0: 9012.3. Samples: 18784368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:02:37,858][708628] Avg episode reward: [(0, '1440.301')] [2023-03-09 12:02:39,530][709034] Updated weights for policy 0, policy_version 36720 (0.0005) [2023-03-09 12:02:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.4, 300 sec: 9080.6). Total num frames: 18829312. Throughput: 0: 9015.5. Samples: 18812508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:02:42,858][708628] Avg episode reward: [(0, '1576.991')] [2023-03-09 12:02:43,882][709034] Updated weights for policy 0, policy_version 36800 (0.0005) [2023-03-09 12:02:47,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9094.5). Total num frames: 18874368. Throughput: 0: 9034.9. Samples: 18867152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:02:47,858][708628] Avg episode reward: [(0, '2011.301')] [2023-03-09 12:02:47,883][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000036872_18878464.pth... [2023-03-09 12:02:47,885][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000036336_18604032.pth [2023-03-09 12:02:48,387][709034] Updated weights for policy 0, policy_version 36880 (0.0005) [2023-03-09 12:02:52,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9011.2, 300 sec: 9094.5). Total num frames: 18919424. Throughput: 0: 9074.5. Samples: 18921828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:02:52,858][708628] Avg episode reward: [(0, '1775.965')] [2023-03-09 12:02:53,025][709034] Updated weights for policy 0, policy_version 36960 (0.0005) [2023-03-09 12:02:57,687][709034] Updated weights for policy 0, policy_version 37040 (0.0005) [2023-03-09 12:02:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9094.5). Total num frames: 18964480. Throughput: 0: 9099.0. Samples: 18948160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:02:57,858][708628] Avg episode reward: [(0, '1839.371')] [2023-03-09 12:03:02,124][709034] Updated weights for policy 0, policy_version 37120 (0.0005) [2023-03-09 12:03:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9011.2, 300 sec: 9094.5). Total num frames: 19009536. Throughput: 0: 9016.1. Samples: 19001408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:03:02,858][708628] Avg episode reward: [(0, '2281.062')] [2023-03-09 12:03:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000037128_19009536.pth... [2023-03-09 12:03:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000036600_18739200.pth [2023-03-09 12:03:06,751][709034] Updated weights for policy 0, policy_version 37200 (0.0005) [2023-03-09 12:03:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9080.6). Total num frames: 19054592. Throughput: 0: 9028.1. Samples: 19054868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:03:07,858][708628] Avg episode reward: [(0, '2530.208')] [2023-03-09 12:03:11,206][709034] Updated weights for policy 0, policy_version 37280 (0.0005) [2023-03-09 12:03:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9080.6). Total num frames: 19099648. Throughput: 0: 9034.4. Samples: 19083336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:03:12,858][708628] Avg episode reward: [(0, '2394.909')] [2023-03-09 12:03:15,941][709034] Updated weights for policy 0, policy_version 37360 (0.0004) [2023-03-09 12:03:17,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9011.2, 300 sec: 9066.7). Total num frames: 19144704. Throughput: 0: 8994.8. Samples: 19136292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:03:17,858][708628] Avg episode reward: [(0, '1990.685')] [2023-03-09 12:03:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000037392_19144704.pth... [2023-03-09 12:03:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000036872_18878464.pth [2023-03-09 12:03:20,723][709034] Updated weights for policy 0, policy_version 37440 (0.0005) [2023-03-09 12:03:22,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9011.2, 300 sec: 9052.9). Total num frames: 19185664. Throughput: 0: 8966.1. Samples: 19187840. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:03:22,858][708628] Avg episode reward: [(0, '2191.208')] [2023-03-09 12:03:25,182][709034] Updated weights for policy 0, policy_version 37520 (0.0005) [2023-03-09 12:03:27,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8942.9, 300 sec: 9039.0). Total num frames: 19230720. Throughput: 0: 8949.4. Samples: 19215232. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:03:27,858][708628] Avg episode reward: [(0, '2202.394')] [2023-03-09 12:03:29,775][709034] Updated weights for policy 0, policy_version 37600 (0.0005) [2023-03-09 12:03:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 9052.9). Total num frames: 19279872. Throughput: 0: 8943.5. Samples: 19269608. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:03:32,858][708628] Avg episode reward: [(0, '2123.398')] [2023-03-09 12:03:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000037656_19279872.pth... [2023-03-09 12:03:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000037128_19009536.pth [2023-03-09 12:03:34,154][709034] Updated weights for policy 0, policy_version 37680 (0.0005) [2023-03-09 12:03:37,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9011.2, 300 sec: 9052.9). Total num frames: 19324928. Throughput: 0: 8959.2. Samples: 19324992. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:03:37,858][708628] Avg episode reward: [(0, '1701.104')] [2023-03-09 12:03:38,636][709034] Updated weights for policy 0, policy_version 37760 (0.0005) [2023-03-09 12:03:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9011.2, 300 sec: 9039.0). Total num frames: 19369984. Throughput: 0: 9009.3. Samples: 19353576. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:03:42,858][708628] Avg episode reward: [(0, '1785.276')] [2023-03-09 12:03:43,099][709034] Updated weights for policy 0, policy_version 37840 (0.0005) [2023-03-09 12:03:47,362][709034] Updated weights for policy 0, policy_version 37920 (0.0005) [2023-03-09 12:03:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9039.0). Total num frames: 19415040. Throughput: 0: 9043.9. Samples: 19408384. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:03:47,858][708628] Avg episode reward: [(0, '1797.937')] [2023-03-09 12:03:47,864][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000037928_19419136.pth... [2023-03-09 12:03:47,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000037392_19144704.pth [2023-03-09 12:03:52,012][709034] Updated weights for policy 0, policy_version 38000 (0.0006) [2023-03-09 12:03:52,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9011.2, 300 sec: 9039.0). Total num frames: 19460096. Throughput: 0: 9048.4. Samples: 19462044. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:03:52,858][708628] Avg episode reward: [(0, '1391.442')] [2023-03-09 12:03:56,692][709034] Updated weights for policy 0, policy_version 38080 (0.0005) [2023-03-09 12:03:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9011.2, 300 sec: 9039.0). Total num frames: 19505152. Throughput: 0: 9009.6. Samples: 19488768. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:03:57,858][708628] Avg episode reward: [(0, '1568.206')] [2023-03-09 12:04:01,035][709034] Updated weights for policy 0, policy_version 38160 (0.0004) [2023-03-09 12:04:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 9052.9). Total num frames: 19554304. Throughput: 0: 9079.0. Samples: 19544848. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:04:02,858][708628] Avg episode reward: [(0, '1523.532')] [2023-03-09 12:04:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000038192_19554304.pth... [2023-03-09 12:04:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000037656_19279872.pth [2023-03-09 12:04:05,492][709034] Updated weights for policy 0, policy_version 38240 (0.0006) [2023-03-09 12:04:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9052.9). Total num frames: 19599360. Throughput: 0: 9165.2. Samples: 19600276. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:04:07,858][708628] Avg episode reward: [(0, '1436.003')] [2023-03-09 12:04:10,129][709034] Updated weights for policy 0, policy_version 38320 (0.0004) [2023-03-09 12:04:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9052.9). Total num frames: 19644416. Throughput: 0: 9118.8. Samples: 19625580. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:04:12,858][708628] Avg episode reward: [(0, '2183.841')] [2023-03-09 12:04:14,499][709034] Updated weights for policy 0, policy_version 38400 (0.0005) [2023-03-09 12:04:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9039.0). Total num frames: 19689472. Throughput: 0: 9146.2. Samples: 19681188. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:04:17,858][708628] Avg episode reward: [(0, '2588.059')] [2023-03-09 12:04:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000038456_19689472.pth... [2023-03-09 12:04:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000037928_19419136.pth [2023-03-09 12:04:19,086][709034] Updated weights for policy 0, policy_version 38480 (0.0005) [2023-03-09 12:04:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9039.0). Total num frames: 19734528. Throughput: 0: 9162.2. Samples: 19737292. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:04:22,858][708628] Avg episode reward: [(0, '2471.443')] [2023-03-09 12:04:23,361][709034] Updated weights for policy 0, policy_version 38560 (0.0005) [2023-03-09 12:04:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9052.9). Total num frames: 19779584. Throughput: 0: 9121.9. Samples: 19764064. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:04:27,858][708628] Avg episode reward: [(0, '2131.310')] [2023-03-09 12:04:27,963][709034] Updated weights for policy 0, policy_version 38640 (0.0006) [2023-03-09 12:04:32,398][709034] Updated weights for policy 0, policy_version 38720 (0.0005) [2023-03-09 12:04:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9052.9). Total num frames: 19828736. Throughput: 0: 9129.6. Samples: 19819216. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:04:32,858][708628] Avg episode reward: [(0, '1949.577')] [2023-03-09 12:04:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000038728_19828736.pth... [2023-03-09 12:04:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000038192_19554304.pth [2023-03-09 12:04:36,649][709034] Updated weights for policy 0, policy_version 38800 (0.0005) [2023-03-09 12:04:37,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9216.0, 300 sec: 9080.6). Total num frames: 19877888. Throughput: 0: 9239.0. Samples: 19877800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:04:37,858][708628] Avg episode reward: [(0, '2102.702')] [2023-03-09 12:04:40,766][709034] Updated weights for policy 0, policy_version 38880 (0.0005) [2023-03-09 12:04:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9080.6). Total num frames: 19922944. Throughput: 0: 9284.3. Samples: 19906560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:04:42,858][708628] Avg episode reward: [(0, '2525.798')] [2023-03-09 12:04:45,328][709034] Updated weights for policy 0, policy_version 38960 (0.0004) [2023-03-09 12:04:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9080.6). Total num frames: 19968000. Throughput: 0: 9222.7. Samples: 19959872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:04:47,858][708628] Avg episode reward: [(0, '2468.720')] [2023-03-09 12:04:47,863][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000039000_19968000.pth... [2023-03-09 12:04:47,866][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000038456_19689472.pth [2023-03-09 12:04:50,228][709034] Updated weights for policy 0, policy_version 39040 (0.0004) [2023-03-09 12:04:52,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9147.7, 300 sec: 9066.7). Total num frames: 20008960. Throughput: 0: 9132.8. Samples: 20011252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:04:52,858][708628] Avg episode reward: [(0, '2408.655')] [2023-03-09 12:04:54,716][709034] Updated weights for policy 0, policy_version 39120 (0.0005) [2023-03-09 12:04:57,857][708628] Fps is (10 sec: 8601.8, 60 sec: 9147.7, 300 sec: 9066.7). Total num frames: 20054016. Throughput: 0: 9208.2. Samples: 20039948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:04:57,858][708628] Avg episode reward: [(0, '2348.172')] [2023-03-09 12:04:59,320][709034] Updated weights for policy 0, policy_version 39200 (0.0005) [2023-03-09 12:05:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9066.7). Total num frames: 20099072. Throughput: 0: 9133.1. Samples: 20092176. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:05:02,858][708628] Avg episode reward: [(0, '1918.264')] [2023-03-09 12:05:02,880][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000039264_20103168.pth... [2023-03-09 12:05:02,882][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000038728_19828736.pth [2023-03-09 12:05:03,830][709034] Updated weights for policy 0, policy_version 39280 (0.0005) [2023-03-09 12:05:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9080.6). Total num frames: 20148224. Throughput: 0: 9133.4. Samples: 20148296. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:05:07,858][708628] Avg episode reward: [(0, '1920.878')] [2023-03-09 12:05:08,170][709034] Updated weights for policy 0, policy_version 39360 (0.0005) [2023-03-09 12:05:12,669][709034] Updated weights for policy 0, policy_version 39440 (0.0005) [2023-03-09 12:05:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9080.6). Total num frames: 20193280. Throughput: 0: 9172.6. Samples: 20176832. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:05:12,858][708628] Avg episode reward: [(0, '2056.034')] [2023-03-09 12:05:17,255][709034] Updated weights for policy 0, policy_version 39520 (0.0005) [2023-03-09 12:05:17,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9066.7). Total num frames: 20238336. Throughput: 0: 9131.7. Samples: 20230144. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:05:17,858][708628] Avg episode reward: [(0, '1262.302')] [2023-03-09 12:05:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000039528_20238336.pth... [2023-03-09 12:05:17,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000039000_19968000.pth [2023-03-09 12:05:21,374][709034] Updated weights for policy 0, policy_version 39600 (0.0005) [2023-03-09 12:05:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9080.6). Total num frames: 20287488. Throughput: 0: 9129.4. Samples: 20288624. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:05:22,858][708628] Avg episode reward: [(0, '926.338')] [2023-03-09 12:05:25,968][709034] Updated weights for policy 0, policy_version 39680 (0.0005) [2023-03-09 12:05:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9080.6). Total num frames: 20332544. Throughput: 0: 9084.2. Samples: 20315348. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:05:27,858][708628] Avg episode reward: [(0, '1570.484')] [2023-03-09 12:05:30,315][709034] Updated weights for policy 0, policy_version 39760 (0.0005) [2023-03-09 12:05:32,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9094.5). Total num frames: 20377600. Throughput: 0: 9101.0. Samples: 20369416. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:05:32,858][708628] Avg episode reward: [(0, '2096.129')] [2023-03-09 12:05:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000039800_20377600.pth... [2023-03-09 12:05:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000039264_20103168.pth [2023-03-09 12:05:34,847][709034] Updated weights for policy 0, policy_version 39840 (0.0004) [2023-03-09 12:05:37,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9108.4). Total num frames: 20426752. Throughput: 0: 9233.6. Samples: 20426764. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:05:37,858][708628] Avg episode reward: [(0, '2050.388')] [2023-03-09 12:05:39,084][709034] Updated weights for policy 0, policy_version 39920 (0.0005) [2023-03-09 12:05:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9094.5). Total num frames: 20471808. Throughput: 0: 9216.5. Samples: 20454692. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:05:42,858][708628] Avg episode reward: [(0, '1873.877')] [2023-03-09 12:05:43,387][709034] Updated weights for policy 0, policy_version 40000 (0.0005) [2023-03-09 12:05:47,706][709034] Updated weights for policy 0, policy_version 40080 (0.0005) [2023-03-09 12:05:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9108.4). Total num frames: 20520960. Throughput: 0: 9344.9. Samples: 20512696. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:05:47,858][708628] Avg episode reward: [(0, '2164.459')] [2023-03-09 12:05:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000040080_20520960.pth... [2023-03-09 12:05:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000039528_20238336.pth [2023-03-09 12:05:51,835][709034] Updated weights for policy 0, policy_version 40160 (0.0005) [2023-03-09 12:05:52,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9108.4). Total num frames: 20570112. Throughput: 0: 9373.7. Samples: 20570112. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:05:52,858][708628] Avg episode reward: [(0, '2199.385')] [2023-03-09 12:05:56,129][709034] Updated weights for policy 0, policy_version 40240 (0.0005) [2023-03-09 12:05:57,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9108.4). Total num frames: 20615168. Throughput: 0: 9392.1. Samples: 20599476. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:05:57,858][708628] Avg episode reward: [(0, '1865.873')] [2023-03-09 12:06:00,543][709034] Updated weights for policy 0, policy_version 40320 (0.0005) [2023-03-09 12:06:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9122.3). Total num frames: 20664320. Throughput: 0: 9460.9. Samples: 20655884. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:06:02,858][708628] Avg episode reward: [(0, '2109.279')] [2023-03-09 12:06:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000040360_20664320.pth... [2023-03-09 12:06:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000039800_20377600.pth [2023-03-09 12:06:04,981][709034] Updated weights for policy 0, policy_version 40400 (0.0005) [2023-03-09 12:06:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9122.3). Total num frames: 20709376. Throughput: 0: 9346.8. Samples: 20709232. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:06:07,858][708628] Avg episode reward: [(0, '1863.065')] [2023-03-09 12:06:09,532][709034] Updated weights for policy 0, policy_version 40480 (0.0006) [2023-03-09 12:06:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9122.3). Total num frames: 20754432. Throughput: 0: 9375.3. Samples: 20737236. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:06:12,858][708628] Avg episode reward: [(0, '2160.078')] [2023-03-09 12:06:13,825][709034] Updated weights for policy 0, policy_version 40560 (0.0006) [2023-03-09 12:06:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9136.2). Total num frames: 20803584. Throughput: 0: 9464.1. Samples: 20795300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:06:17,858][708628] Avg episode reward: [(0, '2360.330')] [2023-03-09 12:06:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000040632_20803584.pth... [2023-03-09 12:06:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000040080_20520960.pth [2023-03-09 12:06:18,096][709034] Updated weights for policy 0, policy_version 40640 (0.0005) [2023-03-09 12:06:22,450][709034] Updated weights for policy 0, policy_version 40720 (0.0005) [2023-03-09 12:06:22,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.6, 300 sec: 9136.2). Total num frames: 20848640. Throughput: 0: 9448.9. Samples: 20851964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:06:22,858][708628] Avg episode reward: [(0, '1769.200')] [2023-03-09 12:06:26,978][709034] Updated weights for policy 0, policy_version 40800 (0.0005) [2023-03-09 12:06:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9150.0). Total num frames: 20897792. Throughput: 0: 9416.8. Samples: 20878448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:06:27,858][708628] Avg episode reward: [(0, '2643.684')] [2023-03-09 12:06:31,335][709034] Updated weights for policy 0, policy_version 40880 (0.0005) [2023-03-09 12:06:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9150.0). Total num frames: 20942848. Throughput: 0: 9375.7. Samples: 20934604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:06:32,858][708628] Avg episode reward: [(0, '2838.279')] [2023-03-09 12:06:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000040904_20942848.pth... [2023-03-09 12:06:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000040360_20664320.pth [2023-03-09 12:06:36,008][709034] Updated weights for policy 0, policy_version 40960 (0.0005) [2023-03-09 12:06:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9163.9). Total num frames: 20987904. Throughput: 0: 9284.0. Samples: 20987892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:06:37,858][708628] Avg episode reward: [(0, '2760.232')] [2023-03-09 12:06:40,564][709034] Updated weights for policy 0, policy_version 41040 (0.0005) [2023-03-09 12:06:42,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9284.3, 300 sec: 9150.0). Total num frames: 21028864. Throughput: 0: 9220.5. Samples: 21014400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:06:42,858][708628] Avg episode reward: [(0, '2568.078')] [2023-03-09 12:06:45,118][709034] Updated weights for policy 0, policy_version 41120 (0.0005) [2023-03-09 12:06:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9150.0). Total num frames: 21078016. Throughput: 0: 9156.4. Samples: 21067920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:06:47,858][708628] Avg episode reward: [(0, '2170.361')] [2023-03-09 12:06:47,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000041168_21078016.pth... [2023-03-09 12:06:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000040632_20803584.pth [2023-03-09 12:06:49,454][709034] Updated weights for policy 0, policy_version 41200 (0.0005) [2023-03-09 12:06:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9150.0). Total num frames: 21123072. Throughput: 0: 9215.8. Samples: 21123944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:06:52,858][708628] Avg episode reward: [(0, '2305.990')] [2023-03-09 12:06:53,941][709034] Updated weights for policy 0, policy_version 41280 (0.0005) [2023-03-09 12:06:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9150.0). Total num frames: 21168128. Throughput: 0: 9211.6. Samples: 21151756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:06:57,858][708628] Avg episode reward: [(0, '2748.711')] [2023-03-09 12:06:58,437][709034] Updated weights for policy 0, policy_version 41360 (0.0004) [2023-03-09 12:07:02,814][709034] Updated weights for policy 0, policy_version 41440 (0.0005) [2023-03-09 12:07:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 21217280. Throughput: 0: 9152.2. Samples: 21207148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:07:02,858][708628] Avg episode reward: [(0, '2649.653')] [2023-03-09 12:07:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000041440_21217280.pth... [2023-03-09 12:07:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000040904_20942848.pth [2023-03-09 12:07:07,243][709034] Updated weights for policy 0, policy_version 41520 (0.0005) [2023-03-09 12:07:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9163.9). Total num frames: 21262336. Throughput: 0: 9142.2. Samples: 21263364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:07:07,858][708628] Avg episode reward: [(0, '2616.498')] [2023-03-09 12:07:11,789][709034] Updated weights for policy 0, policy_version 41600 (0.0005) [2023-03-09 12:07:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9163.9). Total num frames: 21307392. Throughput: 0: 9162.7. Samples: 21290768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:07:12,858][708628] Avg episode reward: [(0, '1733.427')] [2023-03-09 12:07:16,124][709034] Updated weights for policy 0, policy_version 41680 (0.0005) [2023-03-09 12:07:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9177.8). Total num frames: 21352448. Throughput: 0: 9134.1. Samples: 21345640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:07:17,858][708628] Avg episode reward: [(0, '2378.529')] [2023-03-09 12:07:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000041704_21352448.pth... [2023-03-09 12:07:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000041168_21078016.pth [2023-03-09 12:07:20,535][709034] Updated weights for policy 0, policy_version 41760 (0.0005) [2023-03-09 12:07:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 21401600. Throughput: 0: 9193.9. Samples: 21401616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:07:22,858][708628] Avg episode reward: [(0, '1953.370')] [2023-03-09 12:07:24,893][709034] Updated weights for policy 0, policy_version 41840 (0.0005) [2023-03-09 12:07:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9177.8). Total num frames: 21446656. Throughput: 0: 9239.4. Samples: 21430172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:07:27,858][708628] Avg episode reward: [(0, '2326.911')] [2023-03-09 12:07:29,239][709034] Updated weights for policy 0, policy_version 41920 (0.0005) [2023-03-09 12:07:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 21495808. Throughput: 0: 9326.9. Samples: 21487628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:07:32,858][708628] Avg episode reward: [(0, '2666.037')] [2023-03-09 12:07:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000041984_21495808.pth... [2023-03-09 12:07:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000041440_21217280.pth [2023-03-09 12:07:33,409][709034] Updated weights for policy 0, policy_version 42000 (0.0005) [2023-03-09 12:07:37,626][709034] Updated weights for policy 0, policy_version 42080 (0.0005) [2023-03-09 12:07:37,857][708628] Fps is (10 sec: 9830.5, 60 sec: 9284.3, 300 sec: 9205.6). Total num frames: 21544960. Throughput: 0: 9384.4. Samples: 21546240. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:07:37,858][708628] Avg episode reward: [(0, '1483.879')] [2023-03-09 12:07:41,933][709034] Updated weights for policy 0, policy_version 42160 (0.0005) [2023-03-09 12:07:42,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9219.5). Total num frames: 21594112. Throughput: 0: 9380.3. Samples: 21573868. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:07:42,858][708628] Avg episode reward: [(0, '850.417')] [2023-03-09 12:07:46,285][709034] Updated weights for policy 0, policy_version 42240 (0.0004) [2023-03-09 12:07:47,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9233.4). Total num frames: 21643264. Throughput: 0: 9439.3. Samples: 21631916. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:07:47,858][708628] Avg episode reward: [(0, '528.317')] [2023-03-09 12:07:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000042272_21643264.pth... [2023-03-09 12:07:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000041704_21352448.pth [2023-03-09 12:07:50,414][709034] Updated weights for policy 0, policy_version 42320 (0.0005) [2023-03-09 12:07:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9233.4). Total num frames: 21688320. Throughput: 0: 9464.4. Samples: 21689260. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:07:52,858][708628] Avg episode reward: [(0, '798.781')] [2023-03-09 12:07:54,814][709034] Updated weights for policy 0, policy_version 42400 (0.0005) [2023-03-09 12:07:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9233.4). Total num frames: 21733376. Throughput: 0: 9478.6. Samples: 21717304. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:07:57,858][708628] Avg episode reward: [(0, '643.500')] [2023-03-09 12:07:59,554][709034] Updated weights for policy 0, policy_version 42480 (0.0005) [2023-03-09 12:08:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9247.2). Total num frames: 21782528. Throughput: 0: 9442.5. Samples: 21770552. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:08:02,858][708628] Avg episode reward: [(0, '1247.707')] [2023-03-09 12:08:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000042544_21782528.pth... [2023-03-09 12:08:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000041984_21495808.pth [2023-03-09 12:08:03,648][709034] Updated weights for policy 0, policy_version 42560 (0.0005) [2023-03-09 12:08:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9247.2). Total num frames: 21827584. Throughput: 0: 9467.4. Samples: 21827648. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:08:07,858][708628] Avg episode reward: [(0, '728.510')] [2023-03-09 12:08:08,196][709034] Updated weights for policy 0, policy_version 42640 (0.0004) [2023-03-09 12:08:12,680][709034] Updated weights for policy 0, policy_version 42720 (0.0005) [2023-03-09 12:08:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9247.2). Total num frames: 21872640. Throughput: 0: 9457.3. Samples: 21855752. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:08:12,858][708628] Avg episode reward: [(0, '781.871')] [2023-03-09 12:08:17,322][709034] Updated weights for policy 0, policy_version 42800 (0.0004) [2023-03-09 12:08:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9261.1). Total num frames: 21917696. Throughput: 0: 9337.8. Samples: 21907828. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:08:17,858][708628] Avg episode reward: [(0, '890.293')] [2023-03-09 12:08:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000042808_21917696.pth... [2023-03-09 12:08:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000042272_21643264.pth [2023-03-09 12:08:21,682][709034] Updated weights for policy 0, policy_version 42880 (0.0005) [2023-03-09 12:08:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 21962752. Throughput: 0: 9304.4. Samples: 21964940. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:08:22,858][708628] Avg episode reward: [(0, '847.097')] [2023-03-09 12:08:26,068][709034] Updated weights for policy 0, policy_version 42960 (0.0005) [2023-03-09 12:08:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9261.1). Total num frames: 22011904. Throughput: 0: 9315.9. Samples: 21993084. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:08:27,858][708628] Avg episode reward: [(0, '1628.867')] [2023-03-09 12:08:30,585][709034] Updated weights for policy 0, policy_version 43040 (0.0005) [2023-03-09 12:08:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9247.2). Total num frames: 22052864. Throughput: 0: 9259.8. Samples: 22048604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:08:32,858][708628] Avg episode reward: [(0, '1387.072')] [2023-03-09 12:08:32,863][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000043080_22056960.pth... [2023-03-09 12:08:32,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000042544_21782528.pth [2023-03-09 12:08:34,965][709034] Updated weights for policy 0, policy_version 43120 (0.0005) [2023-03-09 12:08:37,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 22097920. Throughput: 0: 9164.0. Samples: 22101640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:08:37,858][708628] Avg episode reward: [(0, '1102.748')] [2023-03-09 12:08:39,756][709034] Updated weights for policy 0, policy_version 43200 (0.0004) [2023-03-09 12:08:42,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 22147072. Throughput: 0: 9148.2. Samples: 22128972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:08:42,858][708628] Avg episode reward: [(0, '1061.305')] [2023-03-09 12:08:43,923][709034] Updated weights for policy 0, policy_version 43280 (0.0005) [2023-03-09 12:08:47,857][708628] Fps is (10 sec: 9830.2, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 22196224. Throughput: 0: 9249.3. Samples: 22186772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:08:47,858][708628] Avg episode reward: [(0, '918.055')] [2023-03-09 12:08:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000043352_22196224.pth... [2023-03-09 12:08:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000042808_21917696.pth [2023-03-09 12:08:48,260][709034] Updated weights for policy 0, policy_version 43360 (0.0006) [2023-03-09 12:08:52,734][709034] Updated weights for policy 0, policy_version 43440 (0.0006) [2023-03-09 12:08:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 22241280. Throughput: 0: 9193.2. Samples: 22241344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:08:52,858][708628] Avg episode reward: [(0, '1043.941')] [2023-03-09 12:08:57,289][709034] Updated weights for policy 0, policy_version 43520 (0.0006) [2023-03-09 12:08:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 22286336. Throughput: 0: 9185.5. Samples: 22269100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:08:57,858][708628] Avg episode reward: [(0, '1182.836')] [2023-03-09 12:09:01,837][709034] Updated weights for policy 0, policy_version 43600 (0.0005) [2023-03-09 12:09:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9261.1). Total num frames: 22331392. Throughput: 0: 9227.9. Samples: 22323084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:09:02,858][708628] Avg episode reward: [(0, '1589.213')] [2023-03-09 12:09:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000043616_22331392.pth... [2023-03-09 12:09:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000043080_22056960.pth [2023-03-09 12:09:06,421][709034] Updated weights for policy 0, policy_version 43680 (0.0005) [2023-03-09 12:09:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9261.1). Total num frames: 22376448. Throughput: 0: 9146.0. Samples: 22376512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:09:07,858][708628] Avg episode reward: [(0, '1400.071')] [2023-03-09 12:09:10,888][709034] Updated weights for policy 0, policy_version 43760 (0.0005) [2023-03-09 12:09:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9261.1). Total num frames: 22421504. Throughput: 0: 9136.8. Samples: 22404240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:09:12,858][708628] Avg episode reward: [(0, '1439.919')] [2023-03-09 12:09:15,396][709034] Updated weights for policy 0, policy_version 43840 (0.0005) [2023-03-09 12:09:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9261.1). Total num frames: 22466560. Throughput: 0: 9105.8. Samples: 22458368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:09:17,858][708628] Avg episode reward: [(0, '1221.836')] [2023-03-09 12:09:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000043880_22466560.pth... [2023-03-09 12:09:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000043352_22196224.pth [2023-03-09 12:09:19,962][709034] Updated weights for policy 0, policy_version 43920 (0.0005) [2023-03-09 12:09:22,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9261.1). Total num frames: 22511616. Throughput: 0: 9194.0. Samples: 22515368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:09:22,858][708628] Avg episode reward: [(0, '1518.432')] [2023-03-09 12:09:24,262][709034] Updated weights for policy 0, policy_version 44000 (0.0004) [2023-03-09 12:09:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9261.1). Total num frames: 22560768. Throughput: 0: 9157.2. Samples: 22541044. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:09:27,858][708628] Avg episode reward: [(0, '1528.526')] [2023-03-09 12:09:28,687][709034] Updated weights for policy 0, policy_version 44080 (0.0006) [2023-03-09 12:09:32,857][708628] Fps is (10 sec: 9011.0, 60 sec: 9147.7, 300 sec: 9233.4). Total num frames: 22601728. Throughput: 0: 9094.6. Samples: 22596028. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:09:32,858][708628] Avg episode reward: [(0, '1868.848')] [2023-03-09 12:09:32,920][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000044152_22605824.pth... [2023-03-09 12:09:32,922][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000043616_22331392.pth [2023-03-09 12:09:33,415][709034] Updated weights for policy 0, policy_version 44160 (0.0005) [2023-03-09 12:09:37,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9147.7, 300 sec: 9233.4). Total num frames: 22646784. Throughput: 0: 9035.6. Samples: 22647948. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:09:37,858][708628] Avg episode reward: [(0, '1874.284')] [2023-03-09 12:09:38,106][709034] Updated weights for policy 0, policy_version 44240 (0.0005) [2023-03-09 12:09:42,815][709034] Updated weights for policy 0, policy_version 44320 (0.0005) [2023-03-09 12:09:42,857][708628] Fps is (10 sec: 9011.4, 60 sec: 9079.5, 300 sec: 9233.4). Total num frames: 22691840. Throughput: 0: 8987.5. Samples: 22673536. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:09:42,858][708628] Avg episode reward: [(0, '1736.461')] [2023-03-09 12:09:47,279][709034] Updated weights for policy 0, policy_version 44400 (0.0005) [2023-03-09 12:09:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9247.2). Total num frames: 22736896. Throughput: 0: 9005.1. Samples: 22728312. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:09:47,858][708628] Avg episode reward: [(0, '2107.376')] [2023-03-09 12:09:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000044408_22736896.pth... [2023-03-09 12:09:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000043880_22466560.pth [2023-03-09 12:09:51,743][709034] Updated weights for policy 0, policy_version 44480 (0.0005) [2023-03-09 12:09:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9247.2). Total num frames: 22781952. Throughput: 0: 9038.1. Samples: 22783228. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:09:52,858][708628] Avg episode reward: [(0, '2225.337')] [2023-03-09 12:09:56,325][709034] Updated weights for policy 0, policy_version 44560 (0.0005) [2023-03-09 12:09:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9247.2). Total num frames: 22827008. Throughput: 0: 9022.7. Samples: 22810260. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:09:57,858][708628] Avg episode reward: [(0, '2484.409')] [2023-03-09 12:10:00,728][709034] Updated weights for policy 0, policy_version 44640 (0.0005) [2023-03-09 12:10:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9233.4). Total num frames: 22872064. Throughput: 0: 9064.4. Samples: 22866264. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:10:02,858][708628] Avg episode reward: [(0, '2269.544')] [2023-03-09 12:10:02,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000044672_22872064.pth... [2023-03-09 12:10:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000044152_22605824.pth [2023-03-09 12:10:05,500][709034] Updated weights for policy 0, policy_version 44720 (0.0004) [2023-03-09 12:10:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9233.4). Total num frames: 22917120. Throughput: 0: 8926.7. Samples: 22917072. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:10:07,858][708628] Avg episode reward: [(0, '2147.867')] [2023-03-09 12:10:10,014][709034] Updated weights for policy 0, policy_version 44800 (0.0005) [2023-03-09 12:10:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9233.4). Total num frames: 22962176. Throughput: 0: 8993.9. Samples: 22945768. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:10:12,858][708628] Avg episode reward: [(0, '2353.285')] [2023-03-09 12:10:14,575][709034] Updated weights for policy 0, policy_version 44880 (0.0005) [2023-03-09 12:10:17,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 9205.6). Total num frames: 23003136. Throughput: 0: 8927.0. Samples: 22997740. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:10:17,858][708628] Avg episode reward: [(0, '1902.780')] [2023-03-09 12:10:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000044928_23003136.pth... [2023-03-09 12:10:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000044408_22736896.pth [2023-03-09 12:10:19,220][709034] Updated weights for policy 0, policy_version 44960 (0.0004) [2023-03-09 12:10:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9233.4). Total num frames: 23056384. Throughput: 0: 9078.0. Samples: 23056456. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:10:22,858][708628] Avg episode reward: [(0, '2140.490')] [2023-03-09 12:10:23,131][709034] Updated weights for policy 0, policy_version 45040 (0.0005) [2023-03-09 12:10:27,475][709034] Updated weights for policy 0, policy_version 45120 (0.0005) [2023-03-09 12:10:27,857][708628] Fps is (10 sec: 9830.5, 60 sec: 9011.2, 300 sec: 9233.4). Total num frames: 23101440. Throughput: 0: 9144.9. Samples: 23085056. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:10:27,858][708628] Avg episode reward: [(0, '1989.809')] [2023-03-09 12:10:31,913][709034] Updated weights for policy 0, policy_version 45200 (0.0005) [2023-03-09 12:10:32,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9147.8, 300 sec: 9233.4). Total num frames: 23150592. Throughput: 0: 9188.0. Samples: 23141772. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:10:32,858][708628] Avg episode reward: [(0, '1470.495')] [2023-03-09 12:10:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000045216_23150592.pth... [2023-03-09 12:10:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000044672_22872064.pth [2023-03-09 12:10:36,239][709034] Updated weights for policy 0, policy_version 45280 (0.0005) [2023-03-09 12:10:37,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9233.4). Total num frames: 23195648. Throughput: 0: 9171.6. Samples: 23195952. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:10:37,858][708628] Avg episode reward: [(0, '2013.247')] [2023-03-09 12:10:40,877][709034] Updated weights for policy 0, policy_version 45360 (0.0006) [2023-03-09 12:10:42,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 23240704. Throughput: 0: 9195.5. Samples: 23224056. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:10:42,858][708628] Avg episode reward: [(0, '2345.773')] [2023-03-09 12:10:45,524][709034] Updated weights for policy 0, policy_version 45440 (0.0005) [2023-03-09 12:10:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.8, 300 sec: 9205.6). Total num frames: 23285760. Throughput: 0: 9132.7. Samples: 23277236. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:10:47,858][708628] Avg episode reward: [(0, '2435.563')] [2023-03-09 12:10:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000045480_23285760.pth... [2023-03-09 12:10:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000044928_23003136.pth [2023-03-09 12:10:49,818][709034] Updated weights for policy 0, policy_version 45520 (0.0005) [2023-03-09 12:10:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 23330816. Throughput: 0: 9195.9. Samples: 23330888. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:10:52,868][708628] Avg episode reward: [(0, '1729.719')] [2023-03-09 12:10:54,474][709034] Updated weights for policy 0, policy_version 45600 (0.0005) [2023-03-09 12:10:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9191.7). Total num frames: 23375872. Throughput: 0: 9193.8. Samples: 23359488. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:10:57,858][708628] Avg episode reward: [(0, '1210.384')] [2023-03-09 12:10:58,914][709034] Updated weights for policy 0, policy_version 45680 (0.0005) [2023-03-09 12:11:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9191.7). Total num frames: 23420928. Throughput: 0: 9268.9. Samples: 23414840. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:11:02,858][708628] Avg episode reward: [(0, '1762.363')] [2023-03-09 12:11:02,864][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000045752_23425024.pth... [2023-03-09 12:11:02,866][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000045216_23150592.pth [2023-03-09 12:11:03,333][709034] Updated weights for policy 0, policy_version 45760 (0.0005) [2023-03-09 12:11:07,758][709034] Updated weights for policy 0, policy_version 45840 (0.0005) [2023-03-09 12:11:07,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9205.6). Total num frames: 23470080. Throughput: 0: 9191.9. Samples: 23470092. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:11:07,858][708628] Avg episode reward: [(0, '1604.464')] [2023-03-09 12:11:12,267][709034] Updated weights for policy 0, policy_version 45920 (0.0005) [2023-03-09 12:11:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 23515136. Throughput: 0: 9190.0. Samples: 23498608. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:11:12,858][708628] Avg episode reward: [(0, '1171.035')] [2023-03-09 12:11:16,574][709034] Updated weights for policy 0, policy_version 46000 (0.0005) [2023-03-09 12:11:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9191.7). Total num frames: 23560192. Throughput: 0: 9160.7. Samples: 23554004. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:11:17,858][708628] Avg episode reward: [(0, '1673.907')] [2023-03-09 12:11:17,891][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000046024_23564288.pth... [2023-03-09 12:11:17,893][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000045480_23285760.pth [2023-03-09 12:11:20,912][709034] Updated weights for policy 0, policy_version 46080 (0.0005) [2023-03-09 12:11:22,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 23609344. Throughput: 0: 9206.7. Samples: 23610252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:11:22,858][708628] Avg episode reward: [(0, '1155.474')] [2023-03-09 12:11:25,264][709034] Updated weights for policy 0, policy_version 46160 (0.0005) [2023-03-09 12:11:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 23654400. Throughput: 0: 9203.1. Samples: 23638196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:11:27,858][708628] Avg episode reward: [(0, '1025.370')] [2023-03-09 12:11:29,809][709034] Updated weights for policy 0, policy_version 46240 (0.0005) [2023-03-09 12:11:32,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9191.7). Total num frames: 23699456. Throughput: 0: 9251.5. Samples: 23693556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:11:32,858][708628] Avg episode reward: [(0, '1074.992')] [2023-03-09 12:11:32,900][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000046296_23703552.pth... [2023-03-09 12:11:32,903][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000045752_23425024.pth [2023-03-09 12:11:34,340][709034] Updated weights for policy 0, policy_version 46320 (0.0005) [2023-03-09 12:11:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 23744512. Throughput: 0: 9262.3. Samples: 23747692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:11:37,858][708628] Avg episode reward: [(0, '984.819')] [2023-03-09 12:11:38,721][709034] Updated weights for policy 0, policy_version 46400 (0.0004) [2023-03-09 12:11:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9205.6). Total num frames: 23793664. Throughput: 0: 9279.5. Samples: 23777064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:11:42,858][708628] Avg episode reward: [(0, '1218.666')] [2023-03-09 12:11:43,006][709034] Updated weights for policy 0, policy_version 46480 (0.0005) [2023-03-09 12:11:47,541][709034] Updated weights for policy 0, policy_version 46560 (0.0004) [2023-03-09 12:11:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9205.6). Total num frames: 23838720. Throughput: 0: 9248.5. Samples: 23831024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:11:47,858][708628] Avg episode reward: [(0, '1040.360')] [2023-03-09 12:11:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000046560_23838720.pth... [2023-03-09 12:11:47,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000046024_23564288.pth [2023-03-09 12:11:52,127][709034] Updated weights for policy 0, policy_version 46640 (0.0005) [2023-03-09 12:11:52,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9205.6). Total num frames: 23883776. Throughput: 0: 9230.1. Samples: 23885444. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:11:52,858][708628] Avg episode reward: [(0, '1440.949')] [2023-03-09 12:11:56,849][709034] Updated weights for policy 0, policy_version 46720 (0.0005) [2023-03-09 12:11:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 23928832. Throughput: 0: 9193.5. Samples: 23912316. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:11:57,858][708628] Avg episode reward: [(0, '1461.916')] [2023-03-09 12:12:01,129][709034] Updated weights for policy 0, policy_version 46800 (0.0005) [2023-03-09 12:12:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 23973888. Throughput: 0: 9177.6. Samples: 23966996. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:12:02,858][708628] Avg episode reward: [(0, '1508.186')] [2023-03-09 12:12:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000046824_23973888.pth... [2023-03-09 12:12:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000046296_23703552.pth [2023-03-09 12:12:05,591][709034] Updated weights for policy 0, policy_version 46880 (0.0005) [2023-03-09 12:12:07,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9191.7). Total num frames: 24018944. Throughput: 0: 9160.2. Samples: 24022460. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:12:07,858][708628] Avg episode reward: [(0, '882.730')] [2023-03-09 12:12:10,302][709034] Updated weights for policy 0, policy_version 46960 (0.0005) [2023-03-09 12:12:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9191.7). Total num frames: 24064000. Throughput: 0: 9098.2. Samples: 24047616. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:12:12,858][708628] Avg episode reward: [(0, '973.674')] [2023-03-09 12:12:14,680][709034] Updated weights for policy 0, policy_version 47040 (0.0005) [2023-03-09 12:12:17,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 24113152. Throughput: 0: 9152.1. Samples: 24105400. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:12:17,858][708628] Avg episode reward: [(0, '1444.920')] [2023-03-09 12:12:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000047096_24113152.pth... [2023-03-09 12:12:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000046560_23838720.pth [2023-03-09 12:12:18,819][709034] Updated weights for policy 0, policy_version 47120 (0.0005) [2023-03-09 12:12:22,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9216.0, 300 sec: 9205.6). Total num frames: 24162304. Throughput: 0: 9212.7. Samples: 24162264. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:12:22,858][708628] Avg episode reward: [(0, '1765.672')] [2023-03-09 12:12:23,238][709034] Updated weights for policy 0, policy_version 47200 (0.0005) [2023-03-09 12:12:27,533][709034] Updated weights for policy 0, policy_version 47280 (0.0005) [2023-03-09 12:12:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 24207360. Throughput: 0: 9193.8. Samples: 24190784. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:12:27,857][708628] Avg episode reward: [(0, '1165.659')] [2023-03-09 12:12:31,932][709034] Updated weights for policy 0, policy_version 47360 (0.0005) [2023-03-09 12:12:32,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9191.7). Total num frames: 24256512. Throughput: 0: 9249.2. Samples: 24247240. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:12:32,858][708628] Avg episode reward: [(0, '1073.254')] [2023-03-09 12:12:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000047376_24256512.pth... [2023-03-09 12:12:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000046824_23973888.pth [2023-03-09 12:12:36,162][709034] Updated weights for policy 0, policy_version 47440 (0.0005) [2023-03-09 12:12:37,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9191.7). Total num frames: 24305664. Throughput: 0: 9325.9. Samples: 24305112. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:12:37,858][708628] Avg episode reward: [(0, '885.352')] [2023-03-09 12:12:40,351][709034] Updated weights for policy 0, policy_version 47520 (0.0005) [2023-03-09 12:12:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9177.8). Total num frames: 24350720. Throughput: 0: 9377.1. Samples: 24334288. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:12:42,858][708628] Avg episode reward: [(0, '1027.759')] [2023-03-09 12:12:44,813][709034] Updated weights for policy 0, policy_version 47600 (0.0004) [2023-03-09 12:12:47,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9177.8). Total num frames: 24395776. Throughput: 0: 9348.0. Samples: 24387656. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:12:47,858][708628] Avg episode reward: [(0, '647.369')] [2023-03-09 12:12:47,874][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000047656_24399872.pth... [2023-03-09 12:12:47,876][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000047096_24113152.pth [2023-03-09 12:12:49,287][709034] Updated weights for policy 0, policy_version 47680 (0.0005) [2023-03-09 12:12:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9177.8). Total num frames: 24440832. Throughput: 0: 9369.0. Samples: 24444064. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:12:52,858][708628] Avg episode reward: [(0, '495.123')] [2023-03-09 12:12:53,741][709034] Updated weights for policy 0, policy_version 47760 (0.0005) [2023-03-09 12:12:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9177.8). Total num frames: 24489984. Throughput: 0: 9436.1. Samples: 24472240. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:12:57,858][708628] Avg episode reward: [(0, '649.481')] [2023-03-09 12:12:58,080][709034] Updated weights for policy 0, policy_version 47840 (0.0005) [2023-03-09 12:13:02,239][709034] Updated weights for policy 0, policy_version 47920 (0.0005) [2023-03-09 12:13:02,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9191.7). Total num frames: 24539136. Throughput: 0: 9456.2. Samples: 24530932. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:13:02,858][708628] Avg episode reward: [(0, '704.249')] [2023-03-09 12:13:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000047928_24539136.pth... [2023-03-09 12:13:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000047376_24256512.pth [2023-03-09 12:13:06,578][709034] Updated weights for policy 0, policy_version 48000 (0.0005) [2023-03-09 12:13:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9191.7). Total num frames: 24584192. Throughput: 0: 9430.1. Samples: 24586616. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:13:07,858][708628] Avg episode reward: [(0, '740.514')] [2023-03-09 12:13:10,970][709034] Updated weights for policy 0, policy_version 48080 (0.0005) [2023-03-09 12:13:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9191.7). Total num frames: 24629248. Throughput: 0: 9426.4. Samples: 24614972. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:13:12,858][708628] Avg episode reward: [(0, '902.257')] [2023-03-09 12:13:15,621][709034] Updated weights for policy 0, policy_version 48160 (0.0005) [2023-03-09 12:13:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9191.7). Total num frames: 24674304. Throughput: 0: 9374.7. Samples: 24669100. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:13:17,858][708628] Avg episode reward: [(0, '1062.570')] [2023-03-09 12:13:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000048192_24674304.pth... [2023-03-09 12:13:17,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000047656_24399872.pth [2023-03-09 12:13:20,211][709034] Updated weights for policy 0, policy_version 48240 (0.0005) [2023-03-09 12:13:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9177.8). Total num frames: 24719360. Throughput: 0: 9246.1. Samples: 24721184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:13:22,858][708628] Avg episode reward: [(0, '710.015')] [2023-03-09 12:13:24,670][709034] Updated weights for policy 0, policy_version 48320 (0.0005) [2023-03-09 12:13:27,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9205.6). Total num frames: 24768512. Throughput: 0: 9238.8. Samples: 24750032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:13:27,858][708628] Avg episode reward: [(0, '677.344')] [2023-03-09 12:13:29,161][709034] Updated weights for policy 0, policy_version 48400 (0.0005) [2023-03-09 12:13:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9205.6). Total num frames: 24813568. Throughput: 0: 9278.3. Samples: 24805180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:13:32,858][708628] Avg episode reward: [(0, '915.723')] [2023-03-09 12:13:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000048464_24813568.pth... [2023-03-09 12:13:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000047928_24539136.pth [2023-03-09 12:13:33,615][709034] Updated weights for policy 0, policy_version 48480 (0.0005) [2023-03-09 12:13:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 24858624. Throughput: 0: 9269.8. Samples: 24861204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:13:37,858][708628] Avg episode reward: [(0, '1123.791')] [2023-03-09 12:13:37,930][709034] Updated weights for policy 0, policy_version 48560 (0.0005) [2023-03-09 12:13:42,310][709034] Updated weights for policy 0, policy_version 48640 (0.0005) [2023-03-09 12:13:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9191.7). Total num frames: 24907776. Throughput: 0: 9287.9. Samples: 24890196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:13:42,858][708628] Avg episode reward: [(0, '383.352')] [2023-03-09 12:13:46,864][709034] Updated weights for policy 0, policy_version 48720 (0.0005) [2023-03-09 12:13:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.2, 300 sec: 9191.7). Total num frames: 24952832. Throughput: 0: 9177.1. Samples: 24943900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:13:47,858][708628] Avg episode reward: [(0, '294.770')] [2023-03-09 12:13:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000048736_24952832.pth... [2023-03-09 12:13:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000048192_24674304.pth [2023-03-09 12:13:51,288][709034] Updated weights for policy 0, policy_version 48800 (0.0004) [2023-03-09 12:13:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9191.7). Total num frames: 24997888. Throughput: 0: 9144.3. Samples: 24998112. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:13:52,858][708628] Avg episode reward: [(0, '376.424')] [2023-03-09 12:13:55,920][709034] Updated weights for policy 0, policy_version 48880 (0.0005) [2023-03-09 12:13:57,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9147.7, 300 sec: 9177.8). Total num frames: 25038848. Throughput: 0: 9131.6. Samples: 25025896. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:13:57,858][708628] Avg episode reward: [(0, '695.226')] [2023-03-09 12:14:00,456][709034] Updated weights for policy 0, policy_version 48960 (0.0005) [2023-03-09 12:14:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9191.7). Total num frames: 25088000. Throughput: 0: 9126.8. Samples: 25079808. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:14:02,858][708628] Avg episode reward: [(0, '473.723')] [2023-03-09 12:14:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000049000_25088000.pth... [2023-03-09 12:14:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000048464_24813568.pth [2023-03-09 12:14:04,786][709034] Updated weights for policy 0, policy_version 49040 (0.0004) [2023-03-09 12:14:07,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9191.7). Total num frames: 25133056. Throughput: 0: 9228.4. Samples: 25136464. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:14:07,858][708628] Avg episode reward: [(0, '635.610')] [2023-03-09 12:14:09,129][709034] Updated weights for policy 0, policy_version 49120 (0.0004) [2023-03-09 12:14:12,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9191.7). Total num frames: 25178112. Throughput: 0: 9199.6. Samples: 25164016. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:14:12,858][708628] Avg episode reward: [(0, '517.921')] [2023-03-09 12:14:13,730][709034] Updated weights for policy 0, policy_version 49200 (0.0005) [2023-03-09 12:14:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9205.6). Total num frames: 25227264. Throughput: 0: 9193.2. Samples: 25218872. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:14:17,858][708628] Avg episode reward: [(0, '824.078')] [2023-03-09 12:14:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000049272_25227264.pth... [2023-03-09 12:14:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000048736_24952832.pth [2023-03-09 12:14:18,139][709034] Updated weights for policy 0, policy_version 49280 (0.0005) [2023-03-09 12:14:22,669][709034] Updated weights for policy 0, policy_version 49360 (0.0005) [2023-03-09 12:14:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 25272320. Throughput: 0: 9149.8. Samples: 25272944. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:14:22,858][708628] Avg episode reward: [(0, '924.461')] [2023-03-09 12:14:26,997][709034] Updated weights for policy 0, policy_version 49440 (0.0005) [2023-03-09 12:14:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9219.5). Total num frames: 25321472. Throughput: 0: 9130.2. Samples: 25301056. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:14:27,858][708628] Avg episode reward: [(0, '270.300')] [2023-03-09 12:14:31,357][709034] Updated weights for policy 0, policy_version 49520 (0.0005) [2023-03-09 12:14:32,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9219.5). Total num frames: 25366528. Throughput: 0: 9207.5. Samples: 25358236. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:14:32,858][708628] Avg episode reward: [(0, '256.433')] [2023-03-09 12:14:32,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000049544_25366528.pth... [2023-03-09 12:14:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000049000_25088000.pth [2023-03-09 12:14:35,944][709034] Updated weights for policy 0, policy_version 49600 (0.0005) [2023-03-09 12:14:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9219.5). Total num frames: 25411584. Throughput: 0: 9188.2. Samples: 25411580. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:14:37,858][708628] Avg episode reward: [(0, '233.324')] [2023-03-09 12:14:40,265][709034] Updated weights for policy 0, policy_version 49680 (0.0005) [2023-03-09 12:14:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 25456640. Throughput: 0: 9209.4. Samples: 25440320. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:14:42,858][708628] Avg episode reward: [(0, '124.426')] [2023-03-09 12:14:44,819][709034] Updated weights for policy 0, policy_version 49760 (0.0005) [2023-03-09 12:14:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 25501696. Throughput: 0: 9241.2. Samples: 25495664. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:14:47,858][708628] Avg episode reward: [(0, '37.250')] [2023-03-09 12:14:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000049816_25505792.pth... [2023-03-09 12:14:47,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000049272_25227264.pth [2023-03-09 12:14:49,275][709034] Updated weights for policy 0, policy_version 49840 (0.0005) [2023-03-09 12:14:52,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 25546752. Throughput: 0: 9164.4. Samples: 25548864. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:14:52,858][708628] Avg episode reward: [(0, '33.159')] [2023-03-09 12:14:54,006][709034] Updated weights for policy 0, policy_version 49920 (0.0005) [2023-03-09 12:14:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9219.5). Total num frames: 25591808. Throughput: 0: 9136.5. Samples: 25575156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:14:57,858][708628] Avg episode reward: [(0, '128.932')] [2023-03-09 12:14:58,394][709034] Updated weights for policy 0, policy_version 50000 (0.0005) [2023-03-09 12:15:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 25636864. Throughput: 0: 9127.9. Samples: 25629628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:15:02,858][708628] Avg episode reward: [(0, '257.155')] [2023-03-09 12:15:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000050072_25636864.pth... [2023-03-09 12:15:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000049544_25366528.pth [2023-03-09 12:15:03,125][709034] Updated weights for policy 0, policy_version 50080 (0.0006) [2023-03-09 12:15:07,546][709034] Updated weights for policy 0, policy_version 50160 (0.0005) [2023-03-09 12:15:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 25681920. Throughput: 0: 9131.3. Samples: 25683852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:15:07,858][708628] Avg episode reward: [(0, '537.464')] [2023-03-09 12:15:12,523][709034] Updated weights for policy 0, policy_version 50240 (0.0005) [2023-03-09 12:15:12,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9079.5, 300 sec: 9219.5). Total num frames: 25722880. Throughput: 0: 9063.9. Samples: 25708932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:15:12,858][708628] Avg episode reward: [(0, '884.350')] [2023-03-09 12:15:17,156][709034] Updated weights for policy 0, policy_version 50320 (0.0005) [2023-03-09 12:15:17,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9011.2, 300 sec: 9191.7). Total num frames: 25767936. Throughput: 0: 8928.4. Samples: 25760016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:15:17,858][708628] Avg episode reward: [(0, '491.638')] [2023-03-09 12:15:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000050328_25767936.pth... [2023-03-09 12:15:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000049816_25505792.pth [2023-03-09 12:15:21,633][709034] Updated weights for policy 0, policy_version 50400 (0.0006) [2023-03-09 12:15:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9191.7). Total num frames: 25812992. Throughput: 0: 8981.0. Samples: 25815724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:15:22,858][708628] Avg episode reward: [(0, '740.562')] [2023-03-09 12:15:26,293][709034] Updated weights for policy 0, policy_version 50480 (0.0004) [2023-03-09 12:15:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8942.9, 300 sec: 9177.8). Total num frames: 25858048. Throughput: 0: 8916.8. Samples: 25841576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:15:27,858][708628] Avg episode reward: [(0, '1027.146')] [2023-03-09 12:15:30,770][709034] Updated weights for policy 0, policy_version 50560 (0.0005) [2023-03-09 12:15:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9177.8). Total num frames: 25903104. Throughput: 0: 8889.1. Samples: 25895672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:15:32,858][708628] Avg episode reward: [(0, '1466.709')] [2023-03-09 12:15:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000050592_25903104.pth... [2023-03-09 12:15:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000050072_25636864.pth [2023-03-09 12:15:35,128][709034] Updated weights for policy 0, policy_version 50640 (0.0005) [2023-03-09 12:15:37,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 9177.8). Total num frames: 25948160. Throughput: 0: 8925.9. Samples: 25950528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:15:37,858][708628] Avg episode reward: [(0, '1153.010')] [2023-03-09 12:15:39,839][709034] Updated weights for policy 0, policy_version 50720 (0.0005) [2023-03-09 12:15:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9177.8). Total num frames: 25993216. Throughput: 0: 8927.7. Samples: 25976904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:15:42,858][708628] Avg episode reward: [(0, '1075.327')] [2023-03-09 12:15:44,223][709034] Updated weights for policy 0, policy_version 50800 (0.0005) [2023-03-09 12:15:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 9177.8). Total num frames: 26038272. Throughput: 0: 8945.1. Samples: 26032156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:15:47,858][708628] Avg episode reward: [(0, '971.381')] [2023-03-09 12:15:47,902][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000050864_26042368.pth... [2023-03-09 12:15:47,904][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000050328_25767936.pth [2023-03-09 12:15:48,757][709034] Updated weights for policy 0, policy_version 50880 (0.0005) [2023-03-09 12:15:52,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 9177.8). Total num frames: 26083328. Throughput: 0: 8952.8. Samples: 26086728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:15:52,858][708628] Avg episode reward: [(0, '577.562')] [2023-03-09 12:15:53,383][709034] Updated weights for policy 0, policy_version 50960 (0.0005) [2023-03-09 12:15:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8942.9, 300 sec: 9177.8). Total num frames: 26128384. Throughput: 0: 8983.5. Samples: 26113188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:15:57,868][708628] Avg episode reward: [(0, '730.773')] [2023-03-09 12:15:57,879][709034] Updated weights for policy 0, policy_version 51040 (0.0005) [2023-03-09 12:16:02,297][709034] Updated weights for policy 0, policy_version 51120 (0.0005) [2023-03-09 12:16:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 9177.8). Total num frames: 26177536. Throughput: 0: 9067.4. Samples: 26168048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:16:02,868][708628] Avg episode reward: [(0, '1384.135')] [2023-03-09 12:16:02,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000051128_26177536.pth... [2023-03-09 12:16:02,874][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000050592_25903104.pth [2023-03-09 12:16:06,881][709034] Updated weights for policy 0, policy_version 51200 (0.0005) [2023-03-09 12:16:07,674][708990] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000002 [2023-03-09 12:16:07,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9011.2, 300 sec: 9177.8). Total num frames: 26222592. Throughput: 0: 9052.9. Samples: 26223104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:16:07,868][708628] Avg episode reward: [(0, '1731.000')] [2023-03-09 12:16:11,240][709034] Updated weights for policy 0, policy_version 51280 (0.0005) [2023-03-09 12:16:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9177.8). Total num frames: 26267648. Throughput: 0: 9095.4. Samples: 26250868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:16:12,858][708628] Avg episode reward: [(0, '1701.022')] [2023-03-09 12:16:16,000][709034] Updated weights for policy 0, policy_version 51360 (0.0004) [2023-03-09 12:16:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9163.9). Total num frames: 26312704. Throughput: 0: 9065.5. Samples: 26303620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:16:17,868][708628] Avg episode reward: [(0, '2009.699')] [2023-03-09 12:16:17,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000051392_26312704.pth... [2023-03-09 12:16:17,875][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000050864_26042368.pth [2023-03-09 12:16:20,421][709034] Updated weights for policy 0, policy_version 51440 (0.0004) [2023-03-09 12:16:22,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9163.9). Total num frames: 26357760. Throughput: 0: 9056.5. Samples: 26358068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:16:22,868][708628] Avg episode reward: [(0, '1480.192')] [2023-03-09 12:16:24,777][709034] Updated weights for policy 0, policy_version 51520 (0.0005) [2023-03-09 12:16:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9177.8). Total num frames: 26406912. Throughput: 0: 9102.2. Samples: 26386504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:16:27,858][708628] Avg episode reward: [(0, '1585.855')] [2023-03-09 12:16:29,010][709034] Updated weights for policy 0, policy_version 51600 (0.0005) [2023-03-09 12:16:32,857][708628] Fps is (10 sec: 9420.6, 60 sec: 9147.7, 300 sec: 9177.8). Total num frames: 26451968. Throughput: 0: 9147.3. Samples: 26443784. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:16:32,868][708628] Avg episode reward: [(0, '1576.537')] [2023-03-09 12:16:32,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000051664_26451968.pth... [2023-03-09 12:16:32,874][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000051128_26177536.pth [2023-03-09 12:16:33,687][709034] Updated weights for policy 0, policy_version 51680 (0.0005) [2023-03-09 12:16:37,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9163.9). Total num frames: 26497024. Throughput: 0: 9116.4. Samples: 26496964. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:16:37,858][708628] Avg episode reward: [(0, '1202.036')] [2023-03-09 12:16:38,272][709034] Updated weights for policy 0, policy_version 51760 (0.0004) [2023-03-09 12:16:42,642][709034] Updated weights for policy 0, policy_version 51840 (0.0005) [2023-03-09 12:16:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9163.9). Total num frames: 26542080. Throughput: 0: 9137.2. Samples: 26524364. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:16:42,858][708628] Avg episode reward: [(0, '1752.567')] [2023-03-09 12:16:47,270][709034] Updated weights for policy 0, policy_version 51920 (0.0004) [2023-03-09 12:16:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.8, 300 sec: 9163.9). Total num frames: 26587136. Throughput: 0: 9131.0. Samples: 26578944. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:16:47,858][708628] Avg episode reward: [(0, '1986.240')] [2023-03-09 12:16:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000051928_26587136.pth... [2023-03-09 12:16:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000051392_26312704.pth [2023-03-09 12:16:51,630][709034] Updated weights for policy 0, policy_version 52000 (0.0005) [2023-03-09 12:16:52,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 26636288. Throughput: 0: 9174.1. Samples: 26635940. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:16:52,858][708628] Avg episode reward: [(0, '1356.949')] [2023-03-09 12:16:55,908][709034] Updated weights for policy 0, policy_version 52080 (0.0005) [2023-03-09 12:16:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 26681344. Throughput: 0: 9181.2. Samples: 26664020. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:16:57,858][708628] Avg episode reward: [(0, '1250.959')] [2023-03-09 12:17:00,344][709034] Updated weights for policy 0, policy_version 52160 (0.0005) [2023-03-09 12:17:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9177.8). Total num frames: 26726400. Throughput: 0: 9214.5. Samples: 26718272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:17:02,858][708628] Avg episode reward: [(0, '1464.404')] [2023-03-09 12:17:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000052200_26726400.pth... [2023-03-09 12:17:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000051664_26451968.pth [2023-03-09 12:17:04,821][709034] Updated weights for policy 0, policy_version 52240 (0.0005) [2023-03-09 12:17:07,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9177.8). Total num frames: 26771456. Throughput: 0: 9245.2. Samples: 26774104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:17:07,858][708628] Avg episode reward: [(0, '1372.307')] [2023-03-09 12:17:09,176][709034] Updated weights for policy 0, policy_version 52320 (0.0005) [2023-03-09 12:17:12,857][708628] Fps is (10 sec: 9421.0, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 26820608. Throughput: 0: 9271.5. Samples: 26803720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:17:12,857][708628] Avg episode reward: [(0, '542.060')] [2023-03-09 12:17:13,441][709034] Updated weights for policy 0, policy_version 52400 (0.0005) [2023-03-09 12:17:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9163.9). Total num frames: 26865664. Throughput: 0: 9208.2. Samples: 26858152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:17:17,858][708628] Avg episode reward: [(0, '1356.945')] [2023-03-09 12:17:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000052472_26865664.pth... [2023-03-09 12:17:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000051928_26587136.pth [2023-03-09 12:17:18,135][709034] Updated weights for policy 0, policy_version 52480 (0.0005) [2023-03-09 12:17:22,391][709034] Updated weights for policy 0, policy_version 52560 (0.0005) [2023-03-09 12:17:22,857][708628] Fps is (10 sec: 9420.6, 60 sec: 9284.2, 300 sec: 9177.8). Total num frames: 26914816. Throughput: 0: 9284.5. Samples: 26914768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:17:22,858][708628] Avg episode reward: [(0, '1456.809')] [2023-03-09 12:17:26,950][709034] Updated weights for policy 0, policy_version 52640 (0.0005) [2023-03-09 12:17:27,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9163.9). Total num frames: 26959872. Throughput: 0: 9236.1. Samples: 26939988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:17:27,858][708628] Avg episode reward: [(0, '1257.534')] [2023-03-09 12:17:31,427][709034] Updated weights for policy 0, policy_version 52720 (0.0005) [2023-03-09 12:17:32,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9147.8, 300 sec: 9136.2). Total num frames: 27000832. Throughput: 0: 9272.5. Samples: 26996204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:17:32,858][708628] Avg episode reward: [(0, '1273.511')] [2023-03-09 12:17:32,892][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000052744_27004928.pth... [2023-03-09 12:17:32,893][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000052200_26726400.pth [2023-03-09 12:17:35,984][709034] Updated weights for policy 0, policy_version 52800 (0.0004) [2023-03-09 12:17:37,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9150.0). Total num frames: 27049984. Throughput: 0: 9199.6. Samples: 27049924. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:17:37,858][708628] Avg episode reward: [(0, '1059.475')] [2023-03-09 12:17:40,552][709034] Updated weights for policy 0, policy_version 52880 (0.0005) [2023-03-09 12:17:42,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9136.2). Total num frames: 27090944. Throughput: 0: 9162.1. Samples: 27076316. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:17:42,858][708628] Avg episode reward: [(0, '1127.153')] [2023-03-09 12:17:45,387][709034] Updated weights for policy 0, policy_version 52960 (0.0005) [2023-03-09 12:17:47,857][708628] Fps is (10 sec: 8601.5, 60 sec: 9147.7, 300 sec: 9136.2). Total num frames: 27136000. Throughput: 0: 9100.8. Samples: 27127808. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:17:47,858][708628] Avg episode reward: [(0, '623.577')] [2023-03-09 12:17:47,863][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000053000_27136000.pth... [2023-03-09 12:17:47,866][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000052472_26865664.pth [2023-03-09 12:17:49,729][709034] Updated weights for policy 0, policy_version 53040 (0.0005) [2023-03-09 12:17:52,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9122.3). Total num frames: 27181056. Throughput: 0: 9082.9. Samples: 27182832. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:17:52,858][708628] Avg episode reward: [(0, '777.100')] [2023-03-09 12:17:54,257][709034] Updated weights for policy 0, policy_version 53120 (0.0005) [2023-03-09 12:17:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9108.4). Total num frames: 27226112. Throughput: 0: 9040.6. Samples: 27210548. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:17:57,858][708628] Avg episode reward: [(0, '858.210')] [2023-03-09 12:17:58,958][709034] Updated weights for policy 0, policy_version 53200 (0.0005) [2023-03-09 12:18:02,857][708628] Fps is (10 sec: 9011.0, 60 sec: 9079.5, 300 sec: 9108.4). Total num frames: 27271168. Throughput: 0: 9011.8. Samples: 27263684. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:18:02,858][708628] Avg episode reward: [(0, '1001.998')] [2023-03-09 12:18:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000053264_27271168.pth... [2023-03-09 12:18:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000052744_27004928.pth [2023-03-09 12:18:03,493][709034] Updated weights for policy 0, policy_version 53280 (0.0004) [2023-03-09 12:18:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9108.4). Total num frames: 27316224. Throughput: 0: 8998.8. Samples: 27319712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:18:07,858][708628] Avg episode reward: [(0, '854.921')] [2023-03-09 12:18:07,928][709034] Updated weights for policy 0, policy_version 53360 (0.0004) [2023-03-09 12:18:12,303][709034] Updated weights for policy 0, policy_version 53440 (0.0005) [2023-03-09 12:18:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9079.5, 300 sec: 9122.3). Total num frames: 27365376. Throughput: 0: 9067.9. Samples: 27348044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:18:12,858][708628] Avg episode reward: [(0, '1494.999')] [2023-03-09 12:18:16,897][709034] Updated weights for policy 0, policy_version 53520 (0.0004) [2023-03-09 12:18:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9108.4). Total num frames: 27406336. Throughput: 0: 9020.4. Samples: 27402124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:18:17,858][708628] Avg episode reward: [(0, '1254.816')] [2023-03-09 12:18:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000053536_27410432.pth... [2023-03-09 12:18:17,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000053000_27136000.pth [2023-03-09 12:18:21,521][709034] Updated weights for policy 0, policy_version 53600 (0.0005) [2023-03-09 12:18:22,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8943.0, 300 sec: 9094.5). Total num frames: 27451392. Throughput: 0: 8982.2. Samples: 27454124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:18:22,858][708628] Avg episode reward: [(0, '988.499')] [2023-03-09 12:18:26,124][709034] Updated weights for policy 0, policy_version 53680 (0.0005) [2023-03-09 12:18:27,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9011.2, 300 sec: 9108.4). Total num frames: 27500544. Throughput: 0: 8978.0. Samples: 27480324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:18:27,858][708628] Avg episode reward: [(0, '611.419')] [2023-03-09 12:18:30,265][709034] Updated weights for policy 0, policy_version 53760 (0.0005) [2023-03-09 12:18:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 9108.4). Total num frames: 27545600. Throughput: 0: 9166.4. Samples: 27540296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:18:32,858][708628] Avg episode reward: [(0, '480.815')] [2023-03-09 12:18:32,892][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000053808_27549696.pth... [2023-03-09 12:18:32,895][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000053264_27271168.pth [2023-03-09 12:18:34,555][709034] Updated weights for policy 0, policy_version 53840 (0.0005) [2023-03-09 12:18:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9108.4). Total num frames: 27594752. Throughput: 0: 9186.7. Samples: 27596236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:18:37,858][708628] Avg episode reward: [(0, '583.302')] [2023-03-09 12:18:38,855][709034] Updated weights for policy 0, policy_version 53920 (0.0005) [2023-03-09 12:18:42,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9216.0, 300 sec: 9122.3). Total num frames: 27643904. Throughput: 0: 9209.0. Samples: 27624952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:18:42,858][708628] Avg episode reward: [(0, '538.712')] [2023-03-09 12:18:43,202][709034] Updated weights for policy 0, policy_version 54000 (0.0005) [2023-03-09 12:18:47,580][709034] Updated weights for policy 0, policy_version 54080 (0.0005) [2023-03-09 12:18:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9122.3). Total num frames: 27688960. Throughput: 0: 9270.1. Samples: 27680840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:18:47,858][708628] Avg episode reward: [(0, '380.687')] [2023-03-09 12:18:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000054080_27688960.pth... [2023-03-09 12:18:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000053536_27410432.pth [2023-03-09 12:18:52,160][709034] Updated weights for policy 0, policy_version 54160 (0.0005) [2023-03-09 12:18:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9136.2). Total num frames: 27734016. Throughput: 0: 9239.9. Samples: 27735508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:18:52,858][708628] Avg episode reward: [(0, '312.120')] [2023-03-09 12:18:56,615][709034] Updated weights for policy 0, policy_version 54240 (0.0005) [2023-03-09 12:18:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9122.3). Total num frames: 27779072. Throughput: 0: 9223.8. Samples: 27763116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:18:57,858][708628] Avg episode reward: [(0, '310.185')] [2023-03-09 12:19:01,047][709034] Updated weights for policy 0, policy_version 54320 (0.0005) [2023-03-09 12:19:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9136.2). Total num frames: 27828224. Throughput: 0: 9268.0. Samples: 27819184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:19:02,858][708628] Avg episode reward: [(0, '230.816')] [2023-03-09 12:19:02,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000054352_27828224.pth... [2023-03-09 12:19:02,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000053808_27549696.pth [2023-03-09 12:19:05,507][709034] Updated weights for policy 0, policy_version 54400 (0.0005) [2023-03-09 12:19:07,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.2, 300 sec: 9136.2). Total num frames: 27873280. Throughput: 0: 9353.8. Samples: 27875048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:19:07,858][708628] Avg episode reward: [(0, '165.326')] [2023-03-09 12:19:09,568][709034] Updated weights for policy 0, policy_version 54480 (0.0005) [2023-03-09 12:19:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9136.2). Total num frames: 27922432. Throughput: 0: 9436.1. Samples: 27904948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:19:12,858][708628] Avg episode reward: [(0, '93.694')] [2023-03-09 12:19:13,958][709034] Updated weights for policy 0, policy_version 54560 (0.0005) [2023-03-09 12:19:17,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9136.2). Total num frames: 27967488. Throughput: 0: 9376.4. Samples: 27962236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:19:17,858][708628] Avg episode reward: [(0, '159.463')] [2023-03-09 12:19:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000054624_27967488.pth... [2023-03-09 12:19:17,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000054080_27688960.pth [2023-03-09 12:19:18,480][709034] Updated weights for policy 0, policy_version 54640 (0.0005) [2023-03-09 12:19:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9122.3). Total num frames: 28012544. Throughput: 0: 9305.6. Samples: 28014988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:19:22,858][708628] Avg episode reward: [(0, '70.352')] [2023-03-09 12:19:22,969][709034] Updated weights for policy 0, policy_version 54720 (0.0004) [2023-03-09 12:19:27,477][709034] Updated weights for policy 0, policy_version 54800 (0.0005) [2023-03-09 12:19:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9122.3). Total num frames: 28057600. Throughput: 0: 9298.1. Samples: 28043364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:19:27,858][708628] Avg episode reward: [(0, '390.949')] [2023-03-09 12:19:32,063][709034] Updated weights for policy 0, policy_version 54880 (0.0005) [2023-03-09 12:19:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9122.3). Total num frames: 28102656. Throughput: 0: 9223.3. Samples: 28095888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:19:32,858][708628] Avg episode reward: [(0, '527.427')] [2023-03-09 12:19:32,905][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000054896_28106752.pth... [2023-03-09 12:19:32,907][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000054352_27828224.pth [2023-03-09 12:19:36,638][709034] Updated weights for policy 0, policy_version 54960 (0.0005) [2023-03-09 12:19:37,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9122.3). Total num frames: 28147712. Throughput: 0: 9180.3. Samples: 28148620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:19:37,858][708628] Avg episode reward: [(0, '505.951')] [2023-03-09 12:19:40,944][709034] Updated weights for policy 0, policy_version 55040 (0.0005) [2023-03-09 12:19:42,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9136.2). Total num frames: 28196864. Throughput: 0: 9239.3. Samples: 28178884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:19:42,858][708628] Avg episode reward: [(0, '303.161')] [2023-03-09 12:19:45,499][709034] Updated weights for policy 0, policy_version 55120 (0.0004) [2023-03-09 12:19:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9136.2). Total num frames: 28241920. Throughput: 0: 9202.2. Samples: 28233284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:19:47,858][708628] Avg episode reward: [(0, '399.653')] [2023-03-09 12:19:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000055160_28241920.pth... [2023-03-09 12:19:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000054624_27967488.pth [2023-03-09 12:19:50,031][709034] Updated weights for policy 0, policy_version 55200 (0.0005) [2023-03-09 12:19:52,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9136.2). Total num frames: 28286976. Throughput: 0: 9164.9. Samples: 28287468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:19:52,858][708628] Avg episode reward: [(0, '754.215')] [2023-03-09 12:19:54,433][709034] Updated weights for policy 0, policy_version 55280 (0.0005) [2023-03-09 12:19:57,857][708628] Fps is (10 sec: 9011.4, 60 sec: 9216.0, 300 sec: 9136.2). Total num frames: 28332032. Throughput: 0: 9141.5. Samples: 28316316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:19:57,857][708628] Avg episode reward: [(0, '1241.625')] [2023-03-09 12:19:58,962][709034] Updated weights for policy 0, policy_version 55360 (0.0005) [2023-03-09 12:20:02,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9136.2). Total num frames: 28377088. Throughput: 0: 9066.9. Samples: 28370244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:20:02,858][708628] Avg episode reward: [(0, '1074.577')] [2023-03-09 12:20:02,892][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000055432_28381184.pth... [2023-03-09 12:20:02,893][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000054896_28106752.pth [2023-03-09 12:20:03,387][709034] Updated weights for policy 0, policy_version 55440 (0.0005) [2023-03-09 12:20:07,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.8, 300 sec: 9150.0). Total num frames: 28422144. Throughput: 0: 9057.4. Samples: 28422572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:20:07,858][708628] Avg episode reward: [(0, '971.872')] [2023-03-09 12:20:08,162][709034] Updated weights for policy 0, policy_version 55520 (0.0005) [2023-03-09 12:20:12,413][709034] Updated weights for policy 0, policy_version 55600 (0.0005) [2023-03-09 12:20:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9150.0). Total num frames: 28467200. Throughput: 0: 9063.7. Samples: 28451232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:20:12,858][708628] Avg episode reward: [(0, '1089.508')] [2023-03-09 12:20:17,096][709034] Updated weights for policy 0, policy_version 55680 (0.0005) [2023-03-09 12:20:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9150.0). Total num frames: 28512256. Throughput: 0: 9110.9. Samples: 28505880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:20:17,858][708628] Avg episode reward: [(0, '1112.337')] [2023-03-09 12:20:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000055688_28512256.pth... [2023-03-09 12:20:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000055160_28241920.pth [2023-03-09 12:20:21,519][709034] Updated weights for policy 0, policy_version 55760 (0.0005) [2023-03-09 12:20:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9150.0). Total num frames: 28557312. Throughput: 0: 9145.4. Samples: 28560164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:20:22,858][708628] Avg episode reward: [(0, '1206.369')] [2023-03-09 12:20:26,243][709034] Updated weights for policy 0, policy_version 55840 (0.0004) [2023-03-09 12:20:27,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9079.5, 300 sec: 9150.0). Total num frames: 28602368. Throughput: 0: 9046.7. Samples: 28585984. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:20:27,858][708628] Avg episode reward: [(0, '1807.236')] [2023-03-09 12:20:30,637][709034] Updated weights for policy 0, policy_version 55920 (0.0005) [2023-03-09 12:20:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9163.9). Total num frames: 28651520. Throughput: 0: 9086.1. Samples: 28642160. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:20:32,858][708628] Avg episode reward: [(0, '945.608')] [2023-03-09 12:20:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000055960_28651520.pth... [2023-03-09 12:20:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000055432_28381184.pth [2023-03-09 12:20:34,688][709034] Updated weights for policy 0, policy_version 56000 (0.0005) [2023-03-09 12:20:37,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 28700672. Throughput: 0: 9201.9. Samples: 28701552. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:20:37,858][708628] Avg episode reward: [(0, '742.783')] [2023-03-09 12:20:38,998][709034] Updated weights for policy 0, policy_version 56080 (0.0005) [2023-03-09 12:20:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9177.8). Total num frames: 28745728. Throughput: 0: 9177.7. Samples: 28729312. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:20:42,858][708628] Avg episode reward: [(0, '556.413')] [2023-03-09 12:20:43,513][709034] Updated weights for policy 0, policy_version 56160 (0.0005) [2023-03-09 12:20:47,734][709034] Updated weights for policy 0, policy_version 56240 (0.0005) [2023-03-09 12:20:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 28794880. Throughput: 0: 9215.6. Samples: 28784948. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:20:47,858][708628] Avg episode reward: [(0, '642.553')] [2023-03-09 12:20:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000056240_28794880.pth... [2023-03-09 12:20:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000055688_28512256.pth [2023-03-09 12:20:52,183][709034] Updated weights for policy 0, policy_version 56320 (0.0005) [2023-03-09 12:20:52,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 28839936. Throughput: 0: 9293.8. Samples: 28840792. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:20:52,858][708628] Avg episode reward: [(0, '717.261')] [2023-03-09 12:20:56,386][709034] Updated weights for policy 0, policy_version 56400 (0.0005) [2023-03-09 12:20:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.2, 300 sec: 9191.7). Total num frames: 28889088. Throughput: 0: 9332.7. Samples: 28871204. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:20:57,858][708628] Avg episode reward: [(0, '682.067')] [2023-03-09 12:21:00,720][709034] Updated weights for policy 0, policy_version 56480 (0.0006) [2023-03-09 12:21:02,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9205.6). Total num frames: 28938240. Throughput: 0: 9422.7. Samples: 28929904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:21:02,858][708628] Avg episode reward: [(0, '1028.374')] [2023-03-09 12:21:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000056520_28938240.pth... [2023-03-09 12:21:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000055960_28651520.pth [2023-03-09 12:21:05,007][709034] Updated weights for policy 0, policy_version 56560 (0.0004) [2023-03-09 12:21:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9205.6). Total num frames: 28983296. Throughput: 0: 9406.1. Samples: 28983440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:21:07,858][708628] Avg episode reward: [(0, '1271.092')] [2023-03-09 12:21:09,396][709034] Updated weights for policy 0, policy_version 56640 (0.0005) [2023-03-09 12:21:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9205.6). Total num frames: 29028352. Throughput: 0: 9466.2. Samples: 29011964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:21:12,858][708628] Avg episode reward: [(0, '1329.541')] [2023-03-09 12:21:13,893][709034] Updated weights for policy 0, policy_version 56720 (0.0005) [2023-03-09 12:21:17,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9205.6). Total num frames: 29073408. Throughput: 0: 9402.7. Samples: 29065280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:21:17,858][708628] Avg episode reward: [(0, '1230.559')] [2023-03-09 12:21:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000056784_29073408.pth... [2023-03-09 12:21:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000056240_28794880.pth [2023-03-09 12:21:18,514][709034] Updated weights for policy 0, policy_version 56800 (0.0005) [2023-03-09 12:21:22,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9191.7). Total num frames: 29118464. Throughput: 0: 9296.4. Samples: 29119888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:21:22,858][708628] Avg episode reward: [(0, '1069.607')] [2023-03-09 12:21:23,056][709034] Updated weights for policy 0, policy_version 56880 (0.0005) [2023-03-09 12:21:27,457][709034] Updated weights for policy 0, policy_version 56960 (0.0005) [2023-03-09 12:21:27,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9191.7). Total num frames: 29163520. Throughput: 0: 9290.8. Samples: 29147400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:21:27,858][708628] Avg episode reward: [(0, '1167.716')] [2023-03-09 12:21:32,037][709034] Updated weights for policy 0, policy_version 57040 (0.0005) [2023-03-09 12:21:32,857][708628] Fps is (10 sec: 9420.6, 60 sec: 9352.5, 300 sec: 9205.6). Total num frames: 29212672. Throughput: 0: 9265.1. Samples: 29201876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:21:32,858][708628] Avg episode reward: [(0, '1065.789')] [2023-03-09 12:21:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000057056_29212672.pth... [2023-03-09 12:21:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000056520_28938240.pth [2023-03-09 12:21:36,505][709034] Updated weights for policy 0, policy_version 57120 (0.0005) [2023-03-09 12:21:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9205.6). Total num frames: 29257728. Throughput: 0: 9261.0. Samples: 29257536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:21:37,858][708628] Avg episode reward: [(0, '1872.951')] [2023-03-09 12:21:40,715][709034] Updated weights for policy 0, policy_version 57200 (0.0005) [2023-03-09 12:21:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9205.6). Total num frames: 29302784. Throughput: 0: 9228.2. Samples: 29286472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:21:42,858][708628] Avg episode reward: [(0, '1789.011')] [2023-03-09 12:21:45,279][709034] Updated weights for policy 0, policy_version 57280 (0.0005) [2023-03-09 12:21:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9205.6). Total num frames: 29351936. Throughput: 0: 9134.8. Samples: 29340968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:21:47,858][708628] Avg episode reward: [(0, '1151.371')] [2023-03-09 12:21:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000057328_29351936.pth... [2023-03-09 12:21:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000056784_29073408.pth [2023-03-09 12:21:49,465][709034] Updated weights for policy 0, policy_version 57360 (0.0004) [2023-03-09 12:21:52,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9205.6). Total num frames: 29396992. Throughput: 0: 9244.0. Samples: 29399420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:21:52,858][708628] Avg episode reward: [(0, '1084.522')] [2023-03-09 12:21:53,945][709034] Updated weights for policy 0, policy_version 57440 (0.0006) [2023-03-09 12:21:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9205.6). Total num frames: 29442048. Throughput: 0: 9193.1. Samples: 29425652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:21:57,858][708628] Avg episode reward: [(0, '1279.612')] [2023-03-09 12:21:58,743][709034] Updated weights for policy 0, policy_version 57520 (0.0005) [2023-03-09 12:22:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 29487104. Throughput: 0: 9193.2. Samples: 29478976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:22:02,858][708628] Avg episode reward: [(0, '1469.710')] [2023-03-09 12:22:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000057592_29487104.pth... [2023-03-09 12:22:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000057056_29212672.pth [2023-03-09 12:22:03,167][709034] Updated weights for policy 0, policy_version 57600 (0.0005) [2023-03-09 12:22:07,730][709034] Updated weights for policy 0, policy_version 57680 (0.0005) [2023-03-09 12:22:07,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9191.7). Total num frames: 29532160. Throughput: 0: 9163.0. Samples: 29532224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:22:07,858][708628] Avg episode reward: [(0, '1293.617')] [2023-03-09 12:22:12,280][709034] Updated weights for policy 0, policy_version 57760 (0.0005) [2023-03-09 12:22:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9191.7). Total num frames: 29577216. Throughput: 0: 9164.1. Samples: 29559784. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:22:12,858][708628] Avg episode reward: [(0, '1247.346')] [2023-03-09 12:22:16,698][709034] Updated weights for policy 0, policy_version 57840 (0.0005) [2023-03-09 12:22:17,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9177.8). Total num frames: 29622272. Throughput: 0: 9164.0. Samples: 29614256. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:22:17,858][708628] Avg episode reward: [(0, '1015.751')] [2023-03-09 12:22:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000057856_29622272.pth... [2023-03-09 12:22:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000057328_29351936.pth [2023-03-09 12:22:21,252][709034] Updated weights for policy 0, policy_version 57920 (0.0005) [2023-03-09 12:22:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9177.8). Total num frames: 29667328. Throughput: 0: 9144.6. Samples: 29669044. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:22:22,858][708628] Avg episode reward: [(0, '897.223')] [2023-03-09 12:22:25,678][709034] Updated weights for policy 0, policy_version 58000 (0.0005) [2023-03-09 12:22:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9191.7). Total num frames: 29712384. Throughput: 0: 9109.7. Samples: 29696408. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:22:27,858][708628] Avg episode reward: [(0, '1025.200')] [2023-03-09 12:22:30,235][709034] Updated weights for policy 0, policy_version 58080 (0.0005) [2023-03-09 12:22:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9177.8). Total num frames: 29757440. Throughput: 0: 9122.9. Samples: 29751496. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:22:32,858][708628] Avg episode reward: [(0, '867.371')] [2023-03-09 12:22:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000058128_29761536.pth... [2023-03-09 12:22:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000057592_29487104.pth [2023-03-09 12:22:34,565][709034] Updated weights for policy 0, policy_version 58160 (0.0005) [2023-03-09 12:22:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 29806592. Throughput: 0: 9060.2. Samples: 29807132. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:22:37,858][708628] Avg episode reward: [(0, '1181.478')] [2023-03-09 12:22:38,838][709034] Updated weights for policy 0, policy_version 58240 (0.0005) [2023-03-09 12:22:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 29851648. Throughput: 0: 9123.7. Samples: 29836220. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:22:42,858][708628] Avg episode reward: [(0, '808.688')] [2023-03-09 12:22:43,400][709034] Updated weights for policy 0, policy_version 58320 (0.0005) [2023-03-09 12:22:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9079.4, 300 sec: 9205.6). Total num frames: 29896704. Throughput: 0: 9148.9. Samples: 29890676. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:22:47,858][708628] Avg episode reward: [(0, '823.370')] [2023-03-09 12:22:47,874][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000058400_29900800.pth... [2023-03-09 12:22:47,875][709034] Updated weights for policy 0, policy_version 58400 (0.0005) [2023-03-09 12:22:47,876][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000057856_29622272.pth [2023-03-09 12:22:52,319][709034] Updated weights for policy 0, policy_version 58480 (0.0005) [2023-03-09 12:22:52,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 29945856. Throughput: 0: 9191.7. Samples: 29945848. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:22:52,858][708628] Avg episode reward: [(0, '1127.060')] [2023-03-09 12:22:56,604][709034] Updated weights for policy 0, policy_version 58560 (0.0005) [2023-03-09 12:22:57,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 29990912. Throughput: 0: 9213.3. Samples: 29974384. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:22:57,858][708628] Avg episode reward: [(0, '763.201')] [2023-03-09 12:23:01,224][709034] Updated weights for policy 0, policy_version 58640 (0.0005) [2023-03-09 12:23:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 30035968. Throughput: 0: 9197.2. Samples: 30028132. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:23:02,858][708628] Avg episode reward: [(0, '904.777')] [2023-03-09 12:23:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000058664_30035968.pth... [2023-03-09 12:23:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000058128_29761536.pth [2023-03-09 12:23:05,641][709034] Updated weights for policy 0, policy_version 58720 (0.0005) [2023-03-09 12:23:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 30081024. Throughput: 0: 9192.7. Samples: 30082716. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:23:07,858][708628] Avg episode reward: [(0, '1114.213')] [2023-03-09 12:23:10,345][709034] Updated weights for policy 0, policy_version 58800 (0.0005) [2023-03-09 12:23:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 30126080. Throughput: 0: 9180.7. Samples: 30109540. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:23:12,858][708628] Avg episode reward: [(0, '817.132')] [2023-03-09 12:23:14,979][709034] Updated weights for policy 0, policy_version 58880 (0.0005) [2023-03-09 12:23:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 30171136. Throughput: 0: 9142.6. Samples: 30162912. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:23:17,858][708628] Avg episode reward: [(0, '1081.458')] [2023-03-09 12:23:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000058928_30171136.pth... [2023-03-09 12:23:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000058400_29900800.pth [2023-03-09 12:23:19,581][709034] Updated weights for policy 0, policy_version 58960 (0.0005) [2023-03-09 12:23:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 30216192. Throughput: 0: 9114.4. Samples: 30217280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:23:22,858][708628] Avg episode reward: [(0, '1328.116')] [2023-03-09 12:23:23,997][709034] Updated weights for policy 0, policy_version 59040 (0.0005) [2023-03-09 12:23:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9219.5). Total num frames: 30265344. Throughput: 0: 9077.5. Samples: 30244708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:23:27,858][708628] Avg episode reward: [(0, '1266.606')] [2023-03-09 12:23:28,217][709034] Updated weights for policy 0, policy_version 59120 (0.0005) [2023-03-09 12:23:32,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9191.7). Total num frames: 30306304. Throughput: 0: 9122.5. Samples: 30301188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:23:32,858][708628] Avg episode reward: [(0, '1101.166')] [2023-03-09 12:23:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000059192_30306304.pth... [2023-03-09 12:23:32,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000058664_30035968.pth [2023-03-09 12:23:32,952][709034] Updated weights for policy 0, policy_version 59200 (0.0004) [2023-03-09 12:23:37,419][709034] Updated weights for policy 0, policy_version 59280 (0.0005) [2023-03-09 12:23:37,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9079.5, 300 sec: 9177.8). Total num frames: 30351360. Throughput: 0: 9091.8. Samples: 30354980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:23:37,858][708628] Avg episode reward: [(0, '1228.532')] [2023-03-09 12:23:41,917][709034] Updated weights for policy 0, policy_version 59360 (0.0005) [2023-03-09 12:23:42,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9191.7). Total num frames: 30400512. Throughput: 0: 9090.3. Samples: 30383448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:23:42,858][708628] Avg episode reward: [(0, '1489.657')] [2023-03-09 12:23:46,344][709034] Updated weights for policy 0, policy_version 59440 (0.0006) [2023-03-09 12:23:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.8, 300 sec: 9191.7). Total num frames: 30445568. Throughput: 0: 9094.1. Samples: 30437368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:23:47,858][708628] Avg episode reward: [(0, '1791.302')] [2023-03-09 12:23:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000059464_30445568.pth... [2023-03-09 12:23:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000058928_30171136.pth [2023-03-09 12:23:50,804][709034] Updated weights for policy 0, policy_version 59520 (0.0004) [2023-03-09 12:23:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9191.7). Total num frames: 30490624. Throughput: 0: 9064.2. Samples: 30490604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:23:52,858][708628] Avg episode reward: [(0, '952.397')] [2023-03-09 12:23:55,375][709034] Updated weights for policy 0, policy_version 59600 (0.0005) [2023-03-09 12:23:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9177.8). Total num frames: 30535680. Throughput: 0: 9105.2. Samples: 30519272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:23:57,858][708628] Avg episode reward: [(0, '920.464')] [2023-03-09 12:23:59,738][709034] Updated weights for policy 0, policy_version 59680 (0.0005) [2023-03-09 12:24:02,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9177.8). Total num frames: 30580736. Throughput: 0: 9148.6. Samples: 30574600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:24:02,858][708628] Avg episode reward: [(0, '851.216')] [2023-03-09 12:24:02,892][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000059736_30584832.pth... [2023-03-09 12:24:02,893][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000059192_30306304.pth [2023-03-09 12:24:04,251][709034] Updated weights for policy 0, policy_version 59760 (0.0005) [2023-03-09 12:24:07,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9177.8). Total num frames: 30629888. Throughput: 0: 9170.5. Samples: 30629952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:24:07,858][708628] Avg episode reward: [(0, '1035.282')] [2023-03-09 12:24:08,603][709034] Updated weights for policy 0, policy_version 59840 (0.0005) [2023-03-09 12:24:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9147.8, 300 sec: 9177.8). Total num frames: 30674944. Throughput: 0: 9139.9. Samples: 30656004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:24:12,858][708628] Avg episode reward: [(0, '716.935')] [2023-03-09 12:24:13,134][709034] Updated weights for policy 0, policy_version 59920 (0.0005) [2023-03-09 12:24:17,564][709034] Updated weights for policy 0, policy_version 60000 (0.0005) [2023-03-09 12:24:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9177.8). Total num frames: 30720000. Throughput: 0: 9126.3. Samples: 30711872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:24:17,858][708628] Avg episode reward: [(0, '1233.753')] [2023-03-09 12:24:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000060000_30720000.pth... [2023-03-09 12:24:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000059464_30445568.pth [2023-03-09 12:24:21,877][709034] Updated weights for policy 0, policy_version 60080 (0.0005) [2023-03-09 12:24:22,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 30769152. Throughput: 0: 9223.7. Samples: 30770048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:24:22,858][708628] Avg episode reward: [(0, '1327.671')] [2023-03-09 12:24:25,955][709034] Updated weights for policy 0, policy_version 60160 (0.0005) [2023-03-09 12:24:27,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9216.0, 300 sec: 9205.6). Total num frames: 30818304. Throughput: 0: 9256.7. Samples: 30800000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:24:27,858][708628] Avg episode reward: [(0, '1222.267')] [2023-03-09 12:24:30,291][709034] Updated weights for policy 0, policy_version 60240 (0.0005) [2023-03-09 12:24:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.2, 300 sec: 9205.6). Total num frames: 30863360. Throughput: 0: 9297.6. Samples: 30855760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:24:32,858][708628] Avg episode reward: [(0, '1085.188')] [2023-03-09 12:24:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000060280_30863360.pth... [2023-03-09 12:24:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000059736_30584832.pth [2023-03-09 12:24:34,986][709034] Updated weights for policy 0, policy_version 60320 (0.0005) [2023-03-09 12:24:37,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9191.7). Total num frames: 30908416. Throughput: 0: 9286.3. Samples: 30908488. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:24:37,858][708628] Avg episode reward: [(0, '1409.022')] [2023-03-09 12:24:39,473][709034] Updated weights for policy 0, policy_version 60400 (0.0005) [2023-03-09 12:24:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 30953472. Throughput: 0: 9275.3. Samples: 30936660. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:24:42,858][708628] Avg episode reward: [(0, '1314.908')] [2023-03-09 12:24:44,172][709034] Updated weights for policy 0, policy_version 60480 (0.0004) [2023-03-09 12:24:47,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9147.7, 300 sec: 9177.8). Total num frames: 30994432. Throughput: 0: 9189.8. Samples: 30988140. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:24:47,858][708628] Avg episode reward: [(0, '1108.873')] [2023-03-09 12:24:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000060536_30994432.pth... [2023-03-09 12:24:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000060000_30720000.pth [2023-03-09 12:24:48,757][709034] Updated weights for policy 0, policy_version 60560 (0.0005) [2023-03-09 12:24:52,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 31043584. Throughput: 0: 9193.2. Samples: 31043648. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:24:52,858][708628] Avg episode reward: [(0, '1201.005')] [2023-03-09 12:24:53,218][709034] Updated weights for policy 0, policy_version 60640 (0.0005) [2023-03-09 12:24:57,856][709034] Updated weights for policy 0, policy_version 60720 (0.0005) [2023-03-09 12:24:57,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 31088640. Throughput: 0: 9219.4. Samples: 31070876. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:24:57,858][708628] Avg episode reward: [(0, '1882.828')] [2023-03-09 12:25:02,365][709034] Updated weights for policy 0, policy_version 60800 (0.0005) [2023-03-09 12:25:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 31133696. Throughput: 0: 9182.8. Samples: 31125100. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:25:02,858][708628] Avg episode reward: [(0, '1850.028')] [2023-03-09 12:25:02,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000060808_31133696.pth... [2023-03-09 12:25:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000060280_30863360.pth [2023-03-09 12:25:06,845][709034] Updated weights for policy 0, policy_version 60880 (0.0005) [2023-03-09 12:25:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9191.7). Total num frames: 31178752. Throughput: 0: 9078.0. Samples: 31178556. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:25:07,858][708628] Avg episode reward: [(0, '1865.871')] [2023-03-09 12:25:11,529][709034] Updated weights for policy 0, policy_version 60960 (0.0005) [2023-03-09 12:25:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9191.7). Total num frames: 31223808. Throughput: 0: 8989.3. Samples: 31204520. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:25:12,858][708628] Avg episode reward: [(0, '1504.054')] [2023-03-09 12:25:15,588][709034] Updated weights for policy 0, policy_version 61040 (0.0005) [2023-03-09 12:25:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9191.7). Total num frames: 31268864. Throughput: 0: 9078.0. Samples: 31264268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:25:17,858][708628] Avg episode reward: [(0, '1612.816')] [2023-03-09 12:25:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000061072_31268864.pth... [2023-03-09 12:25:17,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000060536_30994432.pth [2023-03-09 12:25:20,355][709034] Updated weights for policy 0, policy_version 61120 (0.0005) [2023-03-09 12:25:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9191.7). Total num frames: 31313920. Throughput: 0: 9033.7. Samples: 31315004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:25:22,858][708628] Avg episode reward: [(0, '1468.965')] [2023-03-09 12:25:24,799][709034] Updated weights for policy 0, policy_version 61200 (0.0005) [2023-03-09 12:25:27,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 9191.7). Total num frames: 31363072. Throughput: 0: 9082.1. Samples: 31345356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:25:27,858][708628] Avg episode reward: [(0, '1800.778')] [2023-03-09 12:25:28,977][709034] Updated weights for policy 0, policy_version 61280 (0.0005) [2023-03-09 12:25:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9177.8). Total num frames: 31408128. Throughput: 0: 9152.4. Samples: 31400000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:25:32,858][708628] Avg episode reward: [(0, '1910.486')] [2023-03-09 12:25:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000061344_31408128.pth... [2023-03-09 12:25:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000060808_31133696.pth [2023-03-09 12:25:33,647][709034] Updated weights for policy 0, policy_version 61360 (0.0005) [2023-03-09 12:25:37,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9177.8). Total num frames: 31453184. Throughput: 0: 9158.3. Samples: 31455772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:25:37,858][708628] Avg episode reward: [(0, '2214.159')] [2023-03-09 12:25:38,046][709034] Updated weights for policy 0, policy_version 61440 (0.0005) [2023-03-09 12:25:42,596][709034] Updated weights for policy 0, policy_version 61520 (0.0005) [2023-03-09 12:25:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9163.9). Total num frames: 31498240. Throughput: 0: 9131.3. Samples: 31481784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:25:42,858][708628] Avg episode reward: [(0, '1933.968')] [2023-03-09 12:25:47,430][709034] Updated weights for policy 0, policy_version 61600 (0.0006) [2023-03-09 12:25:47,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9079.5, 300 sec: 9150.1). Total num frames: 31539200. Throughput: 0: 9097.2. Samples: 31534472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:25:47,858][708628] Avg episode reward: [(0, '1716.685')] [2023-03-09 12:25:47,859][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000061600_31539200.pth... [2023-03-09 12:25:47,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000061072_31268864.pth [2023-03-09 12:25:51,999][709034] Updated weights for policy 0, policy_version 61680 (0.0005) [2023-03-09 12:25:52,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9011.2, 300 sec: 9136.2). Total num frames: 31584256. Throughput: 0: 9102.0. Samples: 31588148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:25:52,858][708628] Avg episode reward: [(0, '1551.933')] [2023-03-09 12:25:56,531][709034] Updated weights for policy 0, policy_version 61760 (0.0005) [2023-03-09 12:25:57,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 9136.2). Total num frames: 31633408. Throughput: 0: 9118.0. Samples: 31614832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:25:57,858][708628] Avg episode reward: [(0, '2035.788')] [2023-03-09 12:26:01,052][709034] Updated weights for policy 0, policy_version 61840 (0.0004) [2023-03-09 12:26:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9011.2, 300 sec: 9122.3). Total num frames: 31674368. Throughput: 0: 8979.9. Samples: 31668364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:26:02,858][708628] Avg episode reward: [(0, '2499.645')] [2023-03-09 12:26:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000061872_31678464.pth... [2023-03-09 12:26:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000061344_31408128.pth [2023-03-09 12:26:05,569][709034] Updated weights for policy 0, policy_version 61920 (0.0005) [2023-03-09 12:26:07,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9011.2, 300 sec: 9122.3). Total num frames: 31719424. Throughput: 0: 9075.9. Samples: 31723420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:26:07,858][708628] Avg episode reward: [(0, '2221.386')] [2023-03-09 12:26:10,294][709034] Updated weights for policy 0, policy_version 62000 (0.0005) [2023-03-09 12:26:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9079.5, 300 sec: 9136.2). Total num frames: 31768576. Throughput: 0: 8952.2. Samples: 31748204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:26:12,858][708628] Avg episode reward: [(0, '1453.607')] [2023-03-09 12:26:14,608][709034] Updated weights for policy 0, policy_version 62080 (0.0005) [2023-03-09 12:26:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9136.2). Total num frames: 31813632. Throughput: 0: 8990.3. Samples: 31804564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:26:17,858][708628] Avg episode reward: [(0, '1047.500')] [2023-03-09 12:26:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000062136_31813632.pth... [2023-03-09 12:26:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000061600_31539200.pth [2023-03-09 12:26:19,241][709034] Updated weights for policy 0, policy_version 62160 (0.0005) [2023-03-09 12:26:22,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9011.2, 300 sec: 9122.3). Total num frames: 31854592. Throughput: 0: 8950.0. Samples: 31858524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:26:22,858][708628] Avg episode reward: [(0, '951.788')] [2023-03-09 12:26:23,835][709034] Updated weights for policy 0, policy_version 62240 (0.0005) [2023-03-09 12:26:27,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8942.9, 300 sec: 9108.4). Total num frames: 31899648. Throughput: 0: 8965.2. Samples: 31885216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:26:27,858][708628] Avg episode reward: [(0, '1608.903')] [2023-03-09 12:26:28,445][709034] Updated weights for policy 0, policy_version 62320 (0.0005) [2023-03-09 12:26:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9108.4). Total num frames: 31944704. Throughput: 0: 8978.1. Samples: 31938488. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:26:32,858][708628] Avg episode reward: [(0, '2121.383')] [2023-03-09 12:26:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000062392_31944704.pth... [2023-03-09 12:26:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000061872_31678464.pth [2023-03-09 12:26:32,987][709034] Updated weights for policy 0, policy_version 62400 (0.0004) [2023-03-09 12:26:37,329][709034] Updated weights for policy 0, policy_version 62480 (0.0005) [2023-03-09 12:26:37,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9011.2, 300 sec: 9122.3). Total num frames: 31993856. Throughput: 0: 9017.1. Samples: 31993920. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:26:37,858][708628] Avg episode reward: [(0, '2737.419')] [2023-03-09 12:26:41,706][709034] Updated weights for policy 0, policy_version 62560 (0.0004) [2023-03-09 12:26:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9011.2, 300 sec: 9108.4). Total num frames: 32038912. Throughput: 0: 9060.1. Samples: 32022536. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:26:42,858][708628] Avg episode reward: [(0, '2636.388')] [2023-03-09 12:26:46,129][709034] Updated weights for policy 0, policy_version 62640 (0.0005) [2023-03-09 12:26:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9122.3). Total num frames: 32088064. Throughput: 0: 9095.8. Samples: 32077676. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:26:47,858][708628] Avg episode reward: [(0, '2646.801')] [2023-03-09 12:26:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000062672_32088064.pth... [2023-03-09 12:26:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000062136_31813632.pth [2023-03-09 12:26:50,576][709034] Updated weights for policy 0, policy_version 62720 (0.0005) [2023-03-09 12:26:52,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9122.3). Total num frames: 32133120. Throughput: 0: 9105.9. Samples: 32133184. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:26:52,858][708628] Avg episode reward: [(0, '2866.073')] [2023-03-09 12:26:54,868][709034] Updated weights for policy 0, policy_version 62800 (0.0005) [2023-03-09 12:26:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9122.3). Total num frames: 32178176. Throughput: 0: 9186.8. Samples: 32161612. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:26:57,858][708628] Avg episode reward: [(0, '3136.186')] [2023-03-09 12:26:59,552][709034] Updated weights for policy 0, policy_version 62880 (0.0005) [2023-03-09 12:27:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9122.3). Total num frames: 32223232. Throughput: 0: 9121.9. Samples: 32215048. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:27:02,858][708628] Avg episode reward: [(0, '1912.602')] [2023-03-09 12:27:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000062936_32223232.pth... [2023-03-09 12:27:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000062392_31944704.pth [2023-03-09 12:27:03,998][709034] Updated weights for policy 0, policy_version 62960 (0.0005) [2023-03-09 12:27:07,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9122.3). Total num frames: 32268288. Throughput: 0: 9191.0. Samples: 32272120. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:27:07,858][708628] Avg episode reward: [(0, '2015.698')] [2023-03-09 12:27:08,468][709034] Updated weights for policy 0, policy_version 63040 (0.0005) [2023-03-09 12:27:12,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9011.2, 300 sec: 9108.4). Total num frames: 32309248. Throughput: 0: 9087.6. Samples: 32294160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:27:12,858][708628] Avg episode reward: [(0, '1749.020')] [2023-03-09 12:27:13,360][709034] Updated weights for policy 0, policy_version 63120 (0.0005) [2023-03-09 12:27:17,857][708628] Fps is (10 sec: 8601.5, 60 sec: 9011.2, 300 sec: 9108.4). Total num frames: 32354304. Throughput: 0: 9058.3. Samples: 32346112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:27:17,858][708628] Avg episode reward: [(0, '1981.313')] [2023-03-09 12:27:17,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000063192_32354304.pth... [2023-03-09 12:27:17,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000062672_32088064.pth [2023-03-09 12:27:18,178][709034] Updated weights for policy 0, policy_version 63200 (0.0005) [2023-03-09 12:27:22,857][708628] Fps is (10 sec: 8601.5, 60 sec: 9011.2, 300 sec: 9094.5). Total num frames: 32395264. Throughput: 0: 8957.9. Samples: 32397024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:27:22,858][708628] Avg episode reward: [(0, '1783.366')] [2023-03-09 12:27:22,977][709034] Updated weights for policy 0, policy_version 63280 (0.0005) [2023-03-09 12:27:27,410][709034] Updated weights for policy 0, policy_version 63360 (0.0005) [2023-03-09 12:27:27,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9011.2, 300 sec: 9094.5). Total num frames: 32440320. Throughput: 0: 8952.6. Samples: 32425404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:27:27,858][708628] Avg episode reward: [(0, '2093.654')] [2023-03-09 12:27:31,953][709034] Updated weights for policy 0, policy_version 63440 (0.0005) [2023-03-09 12:27:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9094.5). Total num frames: 32489472. Throughput: 0: 8931.1. Samples: 32479576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:27:32,858][708628] Avg episode reward: [(0, '1280.611')] [2023-03-09 12:27:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000063456_32489472.pth... [2023-03-09 12:27:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000062936_32223232.pth [2023-03-09 12:27:36,477][709034] Updated weights for policy 0, policy_version 63520 (0.0005) [2023-03-09 12:27:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 9094.5). Total num frames: 32534528. Throughput: 0: 8938.6. Samples: 32535420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:27:37,858][708628] Avg episode reward: [(0, '1294.411')] [2023-03-09 12:27:40,907][709034] Updated weights for policy 0, policy_version 63600 (0.0005) [2023-03-09 12:27:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9094.5). Total num frames: 32579584. Throughput: 0: 8907.3. Samples: 32562440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:27:42,858][708628] Avg episode reward: [(0, '1909.577')] [2023-03-09 12:27:45,516][709034] Updated weights for policy 0, policy_version 63680 (0.0005) [2023-03-09 12:27:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 9080.6). Total num frames: 32624640. Throughput: 0: 8918.3. Samples: 32616372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:27:47,858][708628] Avg episode reward: [(0, '1953.201')] [2023-03-09 12:27:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000063720_32624640.pth... [2023-03-09 12:27:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000063192_32354304.pth [2023-03-09 12:27:50,062][709034] Updated weights for policy 0, policy_version 63760 (0.0005) [2023-03-09 12:27:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9080.6). Total num frames: 32669696. Throughput: 0: 8835.2. Samples: 32669704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:27:52,858][708628] Avg episode reward: [(0, '1432.240')] [2023-03-09 12:27:54,621][709034] Updated weights for policy 0, policy_version 63840 (0.0005) [2023-03-09 12:27:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9080.6). Total num frames: 32714752. Throughput: 0: 8930.6. Samples: 32696040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:27:57,858][708628] Avg episode reward: [(0, '1738.712')] [2023-03-09 12:27:59,114][709034] Updated weights for policy 0, policy_version 63920 (0.0005) [2023-03-09 12:28:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9080.6). Total num frames: 32759808. Throughput: 0: 9010.4. Samples: 32751580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:28:02,858][708628] Avg episode reward: [(0, '1763.000')] [2023-03-09 12:28:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000063984_32759808.pth... [2023-03-09 12:28:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000063456_32489472.pth [2023-03-09 12:28:03,533][709034] Updated weights for policy 0, policy_version 64000 (0.0005) [2023-03-09 12:28:07,824][709034] Updated weights for policy 0, policy_version 64080 (0.0005) [2023-03-09 12:28:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 9094.5). Total num frames: 32808960. Throughput: 0: 9153.1. Samples: 32808912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:28:07,858][708628] Avg episode reward: [(0, '2657.466')] [2023-03-09 12:28:12,342][709034] Updated weights for policy 0, policy_version 64160 (0.0005) [2023-03-09 12:28:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9080.6). Total num frames: 32849920. Throughput: 0: 9109.2. Samples: 32835320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:28:12,858][708628] Avg episode reward: [(0, '2703.875')] [2023-03-09 12:28:17,068][709034] Updated weights for policy 0, policy_version 64240 (0.0005) [2023-03-09 12:28:17,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9011.2, 300 sec: 9080.6). Total num frames: 32894976. Throughput: 0: 9071.6. Samples: 32887800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:28:17,858][708628] Avg episode reward: [(0, '2200.917')] [2023-03-09 12:28:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000064248_32894976.pth... [2023-03-09 12:28:17,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000063720_32624640.pth [2023-03-09 12:28:21,538][709034] Updated weights for policy 0, policy_version 64320 (0.0005) [2023-03-09 12:28:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9080.6). Total num frames: 32944128. Throughput: 0: 9080.9. Samples: 32944060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:28:22,858][708628] Avg episode reward: [(0, '2983.594')] [2023-03-09 12:28:25,973][709034] Updated weights for policy 0, policy_version 64400 (0.0004) [2023-03-09 12:28:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9094.5). Total num frames: 32989184. Throughput: 0: 9095.8. Samples: 32971752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:28:27,858][708628] Avg episode reward: [(0, '2746.403')] [2023-03-09 12:28:30,463][709034] Updated weights for policy 0, policy_version 64480 (0.0005) [2023-03-09 12:28:32,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9079.5, 300 sec: 9094.5). Total num frames: 33034240. Throughput: 0: 9124.4. Samples: 33026972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:28:32,858][708628] Avg episode reward: [(0, '3075.025')] [2023-03-09 12:28:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000064520_33034240.pth... [2023-03-09 12:28:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000063984_32759808.pth [2023-03-09 12:28:34,493][709034] Updated weights for policy 0, policy_version 64560 (0.0005) [2023-03-09 12:28:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9094.5). Total num frames: 33083392. Throughput: 0: 9219.6. Samples: 33084588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:28:37,858][708628] Avg episode reward: [(0, '2847.143')] [2023-03-09 12:28:38,827][709034] Updated weights for policy 0, policy_version 64640 (0.0005) [2023-03-09 12:28:42,857][708628] Fps is (10 sec: 9830.6, 60 sec: 9216.0, 300 sec: 9108.4). Total num frames: 33132544. Throughput: 0: 9259.9. Samples: 33112736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:28:42,858][708628] Avg episode reward: [(0, '1799.640')] [2023-03-09 12:28:43,300][709034] Updated weights for policy 0, policy_version 64720 (0.0005) [2023-03-09 12:28:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9094.5). Total num frames: 33173504. Throughput: 0: 9208.6. Samples: 33165968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:28:47,858][708628] Avg episode reward: [(0, '1971.170')] [2023-03-09 12:28:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000064792_33173504.pth... [2023-03-09 12:28:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000064248_32894976.pth [2023-03-09 12:28:48,100][709034] Updated weights for policy 0, policy_version 64800 (0.0005) [2023-03-09 12:28:52,799][709034] Updated weights for policy 0, policy_version 64880 (0.0005) [2023-03-09 12:28:52,857][708628] Fps is (10 sec: 8601.5, 60 sec: 9147.7, 300 sec: 9094.5). Total num frames: 33218560. Throughput: 0: 9101.1. Samples: 33218460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:28:52,858][708628] Avg episode reward: [(0, '1858.561')] [2023-03-09 12:28:57,434][709034] Updated weights for policy 0, policy_version 64960 (0.0005) [2023-03-09 12:28:57,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9079.5, 300 sec: 9080.6). Total num frames: 33259520. Throughput: 0: 9114.5. Samples: 33245472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:28:57,858][708628] Avg episode reward: [(0, '1112.404')] [2023-03-09 12:29:01,902][709034] Updated weights for policy 0, policy_version 65040 (0.0005) [2023-03-09 12:29:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9080.6). Total num frames: 33308672. Throughput: 0: 9140.3. Samples: 33299112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:29:02,858][708628] Avg episode reward: [(0, '1026.990')] [2023-03-09 12:29:02,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000065056_33308672.pth... [2023-03-09 12:29:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000064520_33034240.pth [2023-03-09 12:29:06,397][709034] Updated weights for policy 0, policy_version 65120 (0.0005) [2023-03-09 12:29:07,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 9080.6). Total num frames: 33353728. Throughput: 0: 9114.2. Samples: 33354200. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:29:07,858][708628] Avg episode reward: [(0, '1726.230')] [2023-03-09 12:29:10,783][709034] Updated weights for policy 0, policy_version 65200 (0.0005) [2023-03-09 12:29:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9080.6). Total num frames: 33398784. Throughput: 0: 9125.5. Samples: 33382400. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:29:12,858][708628] Avg episode reward: [(0, '2111.489')] [2023-03-09 12:29:15,050][709034] Updated weights for policy 0, policy_version 65280 (0.0005) [2023-03-09 12:29:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9080.6). Total num frames: 33447936. Throughput: 0: 9167.9. Samples: 33439528. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:29:17,858][708628] Avg episode reward: [(0, '1881.952')] [2023-03-09 12:29:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000065328_33447936.pth... [2023-03-09 12:29:17,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000064792_33173504.pth [2023-03-09 12:29:19,479][709034] Updated weights for policy 0, policy_version 65360 (0.0006) [2023-03-09 12:29:22,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9066.7). Total num frames: 33492992. Throughput: 0: 9079.7. Samples: 33493172. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:29:22,858][708628] Avg episode reward: [(0, '1052.476')] [2023-03-09 12:29:24,111][709034] Updated weights for policy 0, policy_version 65440 (0.0005) [2023-03-09 12:29:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9066.7). Total num frames: 33538048. Throughput: 0: 9075.4. Samples: 33521132. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:29:27,858][708628] Avg episode reward: [(0, '1485.512')] [2023-03-09 12:29:28,764][709034] Updated weights for policy 0, policy_version 65520 (0.0004) [2023-03-09 12:29:32,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9066.7). Total num frames: 33583104. Throughput: 0: 9084.1. Samples: 33574752. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:29:32,858][708628] Avg episode reward: [(0, '1565.329')] [2023-03-09 12:29:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000065592_33583104.pth... [2023-03-09 12:29:32,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000065056_33308672.pth [2023-03-09 12:29:33,259][709034] Updated weights for policy 0, policy_version 65600 (0.0004) [2023-03-09 12:29:37,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9011.2, 300 sec: 9052.9). Total num frames: 33624064. Throughput: 0: 9019.5. Samples: 33624336. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:29:37,858][708628] Avg episode reward: [(0, '1434.473')] [2023-03-09 12:29:38,135][709034] Updated weights for policy 0, policy_version 65680 (0.0005) [2023-03-09 12:29:42,796][709034] Updated weights for policy 0, policy_version 65760 (0.0005) [2023-03-09 12:29:42,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 9066.7). Total num frames: 33669120. Throughput: 0: 9030.8. Samples: 33651860. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:29:42,858][708628] Avg episode reward: [(0, '1273.536')] [2023-03-09 12:29:47,367][709034] Updated weights for policy 0, policy_version 65840 (0.0005) [2023-03-09 12:29:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9052.9). Total num frames: 33714176. Throughput: 0: 9029.0. Samples: 33705416. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:29:47,858][708628] Avg episode reward: [(0, '1382.005')] [2023-03-09 12:29:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000065848_33714176.pth... [2023-03-09 12:29:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000065328_33447936.pth [2023-03-09 12:29:51,926][709034] Updated weights for policy 0, policy_version 65920 (0.0005) [2023-03-09 12:29:52,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9011.2, 300 sec: 9052.9). Total num frames: 33759232. Throughput: 0: 8999.7. Samples: 33759184. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:29:52,858][708628] Avg episode reward: [(0, '1882.385')] [2023-03-09 12:29:56,193][709034] Updated weights for policy 0, policy_version 66000 (0.0005) [2023-03-09 12:29:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.4, 300 sec: 9052.9). Total num frames: 33804288. Throughput: 0: 9011.4. Samples: 33787912. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:29:57,858][708628] Avg episode reward: [(0, '1491.292')] [2023-03-09 12:30:01,170][709034] Updated weights for policy 0, policy_version 66080 (0.0005) [2023-03-09 12:30:02,857][708628] Fps is (10 sec: 8601.5, 60 sec: 8942.9, 300 sec: 9039.0). Total num frames: 33845248. Throughput: 0: 8839.9. Samples: 33837324. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:30:02,858][708628] Avg episode reward: [(0, '2108.894')] [2023-03-09 12:30:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000066104_33845248.pth... [2023-03-09 12:30:02,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000065592_33583104.pth [2023-03-09 12:30:05,450][709034] Updated weights for policy 0, policy_version 66160 (0.0005) [2023-03-09 12:30:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9052.9). Total num frames: 33894400. Throughput: 0: 8929.9. Samples: 33895020. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:30:07,858][708628] Avg episode reward: [(0, '2577.474')] [2023-03-09 12:30:09,807][709034] Updated weights for policy 0, policy_version 66240 (0.0005) [2023-03-09 12:30:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9011.2, 300 sec: 9052.9). Total num frames: 33939456. Throughput: 0: 8939.3. Samples: 33923400. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:30:12,858][708628] Avg episode reward: [(0, '2655.842')] [2023-03-09 12:30:14,284][709034] Updated weights for policy 0, policy_version 66320 (0.0005) [2023-03-09 12:30:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9052.9). Total num frames: 33984512. Throughput: 0: 8930.2. Samples: 33976612. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:30:17,858][708628] Avg episode reward: [(0, '2189.238')] [2023-03-09 12:30:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000066376_33984512.pth... [2023-03-09 12:30:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000065848_33714176.pth [2023-03-09 12:30:19,036][709034] Updated weights for policy 0, policy_version 66400 (0.0005) [2023-03-09 12:30:22,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8942.9, 300 sec: 9039.0). Total num frames: 34029568. Throughput: 0: 9052.3. Samples: 34031688. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:30:22,858][708628] Avg episode reward: [(0, '1498.175')] [2023-03-09 12:30:23,451][709034] Updated weights for policy 0, policy_version 66480 (0.0004) [2023-03-09 12:30:27,824][709034] Updated weights for policy 0, policy_version 66560 (0.0005) [2023-03-09 12:30:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 9052.9). Total num frames: 34078720. Throughput: 0: 9057.9. Samples: 34059464. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:30:27,858][708628] Avg episode reward: [(0, '1158.285')] [2023-03-09 12:30:32,351][709034] Updated weights for policy 0, policy_version 66640 (0.0005) [2023-03-09 12:30:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9011.2, 300 sec: 9052.9). Total num frames: 34123776. Throughput: 0: 9107.1. Samples: 34115236. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:30:32,858][708628] Avg episode reward: [(0, '422.263')] [2023-03-09 12:30:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000066648_34123776.pth... [2023-03-09 12:30:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000066104_33845248.pth [2023-03-09 12:30:36,915][709034] Updated weights for policy 0, policy_version 66720 (0.0005) [2023-03-09 12:30:37,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9011.2, 300 sec: 9039.0). Total num frames: 34164736. Throughput: 0: 9094.3. Samples: 34168428. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:30:37,858][708628] Avg episode reward: [(0, '589.088')] [2023-03-09 12:30:41,419][709034] Updated weights for policy 0, policy_version 66800 (0.0006) [2023-03-09 12:30:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9066.7). Total num frames: 34213888. Throughput: 0: 9067.4. Samples: 34195944. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:30:42,858][708628] Avg episode reward: [(0, '524.190')] [2023-03-09 12:30:45,914][709034] Updated weights for policy 0, policy_version 66880 (0.0005) [2023-03-09 12:30:47,857][708628] Fps is (10 sec: 9420.6, 60 sec: 9079.4, 300 sec: 9066.7). Total num frames: 34258944. Throughput: 0: 9171.9. Samples: 34250060. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:30:47,858][708628] Avg episode reward: [(0, '632.451')] [2023-03-09 12:30:47,863][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000066912_34258944.pth... [2023-03-09 12:30:47,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000066376_33984512.pth [2023-03-09 12:30:50,754][709034] Updated weights for policy 0, policy_version 66960 (0.0005) [2023-03-09 12:30:52,857][708628] Fps is (10 sec: 8601.5, 60 sec: 9011.2, 300 sec: 9039.0). Total num frames: 34299904. Throughput: 0: 9040.8. Samples: 34301856. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:30:52,869][708628] Avg episode reward: [(0, '481.100')] [2023-03-09 12:30:55,357][709034] Updated weights for policy 0, policy_version 67040 (0.0005) [2023-03-09 12:30:57,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9011.2, 300 sec: 9052.9). Total num frames: 34344960. Throughput: 0: 9001.2. Samples: 34328456. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:30:57,858][708628] Avg episode reward: [(0, '511.760')] [2023-03-09 12:31:00,060][709034] Updated weights for policy 0, policy_version 67120 (0.0005) [2023-03-09 12:31:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9052.9). Total num frames: 34390016. Throughput: 0: 8959.2. Samples: 34379776. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:31:02,858][708628] Avg episode reward: [(0, '376.614')] [2023-03-09 12:31:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000067168_34390016.pth... [2023-03-09 12:31:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000066648_34123776.pth [2023-03-09 12:31:04,744][709034] Updated weights for policy 0, policy_version 67200 (0.0005) [2023-03-09 12:31:07,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9011.2, 300 sec: 9039.0). Total num frames: 34435072. Throughput: 0: 8960.0. Samples: 34434888. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:31:07,858][708628] Avg episode reward: [(0, '569.991')] [2023-03-09 12:31:09,230][709034] Updated weights for policy 0, policy_version 67280 (0.0005) [2023-03-09 12:31:12,857][708628] Fps is (10 sec: 9011.4, 60 sec: 9011.2, 300 sec: 9039.0). Total num frames: 34480128. Throughput: 0: 8950.2. Samples: 34462220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:31:12,858][708628] Avg episode reward: [(0, '555.677')] [2023-03-09 12:31:13,862][709034] Updated weights for policy 0, policy_version 67360 (0.0005) [2023-03-09 12:31:17,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 9039.0). Total num frames: 34521088. Throughput: 0: 8873.5. Samples: 34514544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:31:17,858][708628] Avg episode reward: [(0, '1215.236')] [2023-03-09 12:31:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000067424_34521088.pth... [2023-03-09 12:31:17,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000066912_34258944.pth [2023-03-09 12:31:18,411][709034] Updated weights for policy 0, policy_version 67440 (0.0005) [2023-03-09 12:31:22,630][709034] Updated weights for policy 0, policy_version 67520 (0.0005) [2023-03-09 12:31:22,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9011.2, 300 sec: 9052.9). Total num frames: 34570240. Throughput: 0: 8954.0. Samples: 34571360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:31:22,858][708628] Avg episode reward: [(0, '1340.537')] [2023-03-09 12:31:27,292][709034] Updated weights for policy 0, policy_version 67600 (0.0004) [2023-03-09 12:31:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 8942.9, 300 sec: 9052.9). Total num frames: 34615296. Throughput: 0: 8902.0. Samples: 34596532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:31:27,858][708628] Avg episode reward: [(0, '638.158')] [2023-03-09 12:31:31,916][709034] Updated weights for policy 0, policy_version 67680 (0.0005) [2023-03-09 12:31:32,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 9039.0). Total num frames: 34660352. Throughput: 0: 8922.7. Samples: 34651580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:31:32,858][708628] Avg episode reward: [(0, '515.597')] [2023-03-09 12:31:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000067696_34660352.pth... [2023-03-09 12:31:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000067168_34390016.pth [2023-03-09 12:31:36,628][709034] Updated weights for policy 0, policy_version 67760 (0.0005) [2023-03-09 12:31:37,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 9025.1). Total num frames: 34701312. Throughput: 0: 8917.7. Samples: 34703152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:31:37,858][708628] Avg episode reward: [(0, '209.301')] [2023-03-09 12:31:41,118][709034] Updated weights for policy 0, policy_version 67840 (0.0005) [2023-03-09 12:31:42,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8874.7, 300 sec: 9011.2). Total num frames: 34746368. Throughput: 0: 8935.9. Samples: 34730572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:31:42,858][708628] Avg episode reward: [(0, '369.942')] [2023-03-09 12:31:45,660][709034] Updated weights for policy 0, policy_version 67920 (0.0005) [2023-03-09 12:31:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 9011.2). Total num frames: 34791424. Throughput: 0: 8982.8. Samples: 34784000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:31:47,858][708628] Avg episode reward: [(0, '290.154')] [2023-03-09 12:31:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000067952_34791424.pth... [2023-03-09 12:31:47,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000067424_34521088.pth [2023-03-09 12:31:50,329][709034] Updated weights for policy 0, policy_version 68000 (0.0005) [2023-03-09 12:31:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8943.0, 300 sec: 9011.2). Total num frames: 34836480. Throughput: 0: 8966.0. Samples: 34838360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:31:52,858][708628] Avg episode reward: [(0, '455.865')] [2023-03-09 12:31:54,845][709034] Updated weights for policy 0, policy_version 68080 (0.0005) [2023-03-09 12:31:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9011.2). Total num frames: 34881536. Throughput: 0: 8957.8. Samples: 34865324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:31:57,858][708628] Avg episode reward: [(0, '510.842')] [2023-03-09 12:31:59,393][709034] Updated weights for policy 0, policy_version 68160 (0.0005) [2023-03-09 12:32:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 9011.2). Total num frames: 34926592. Throughput: 0: 8976.2. Samples: 34918472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:32:02,858][708628] Avg episode reward: [(0, '655.167')] [2023-03-09 12:32:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000068216_34926592.pth... [2023-03-09 12:32:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000067696_34660352.pth [2023-03-09 12:32:04,020][709034] Updated weights for policy 0, policy_version 68240 (0.0005) [2023-03-09 12:32:07,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 9011.2). Total num frames: 34967552. Throughput: 0: 8882.2. Samples: 34971060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:32:07,858][708628] Avg episode reward: [(0, '1306.408')] [2023-03-09 12:32:08,840][709034] Updated weights for policy 0, policy_version 68320 (0.0006) [2023-03-09 12:32:12,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8874.6, 300 sec: 9011.2). Total num frames: 35012608. Throughput: 0: 8887.9. Samples: 34996488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:32:12,858][708628] Avg episode reward: [(0, '720.890')] [2023-03-09 12:32:13,362][709034] Updated weights for policy 0, policy_version 68400 (0.0005) [2023-03-09 12:32:17,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 9025.1). Total num frames: 35057664. Throughput: 0: 8839.5. Samples: 35049356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:32:17,858][708628] Avg episode reward: [(0, '669.744')] [2023-03-09 12:32:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000068472_35057664.pth... [2023-03-09 12:32:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000067952_34791424.pth [2023-03-09 12:32:18,170][709034] Updated weights for policy 0, policy_version 68480 (0.0005) [2023-03-09 12:32:22,797][709034] Updated weights for policy 0, policy_version 68560 (0.0005) [2023-03-09 12:32:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 9025.1). Total num frames: 35102720. Throughput: 0: 8879.3. Samples: 35102720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:32:22,858][708628] Avg episode reward: [(0, '1128.680')] [2023-03-09 12:32:27,655][709034] Updated weights for policy 0, policy_version 68640 (0.0005) [2023-03-09 12:32:27,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8997.3). Total num frames: 35143680. Throughput: 0: 8839.9. Samples: 35128368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:32:27,858][708628] Avg episode reward: [(0, '1424.296')] [2023-03-09 12:32:31,978][709034] Updated weights for policy 0, policy_version 68720 (0.0005) [2023-03-09 12:32:32,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8997.3). Total num frames: 35188736. Throughput: 0: 8845.0. Samples: 35182024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:32:32,858][708628] Avg episode reward: [(0, '1349.863')] [2023-03-09 12:32:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000068728_35188736.pth... [2023-03-09 12:32:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000068216_34926592.pth [2023-03-09 12:32:36,708][709034] Updated weights for policy 0, policy_version 68800 (0.0005) [2023-03-09 12:32:37,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8874.7, 300 sec: 8997.3). Total num frames: 35233792. Throughput: 0: 8821.7. Samples: 35235336. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:32:37,858][708628] Avg episode reward: [(0, '1482.337')] [2023-03-09 12:32:41,296][709034] Updated weights for policy 0, policy_version 68880 (0.0005) [2023-03-09 12:32:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8997.3). Total num frames: 35278848. Throughput: 0: 8824.1. Samples: 35262408. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:32:42,859][708628] Avg episode reward: [(0, '1280.879')] [2023-03-09 12:32:45,698][709034] Updated weights for policy 0, policy_version 68960 (0.0005) [2023-03-09 12:32:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8874.7, 300 sec: 8997.3). Total num frames: 35323904. Throughput: 0: 8842.9. Samples: 35316404. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:32:47,858][708628] Avg episode reward: [(0, '1518.066')] [2023-03-09 12:32:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000068992_35323904.pth... [2023-03-09 12:32:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000068472_35057664.pth [2023-03-09 12:32:50,245][709034] Updated weights for policy 0, policy_version 69040 (0.0005) [2023-03-09 12:32:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8997.3). Total num frames: 35368960. Throughput: 0: 8894.8. Samples: 35371324. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:32:52,858][708628] Avg episode reward: [(0, '2015.487')] [2023-03-09 12:32:54,795][709034] Updated weights for policy 0, policy_version 69120 (0.0006) [2023-03-09 12:32:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8997.3). Total num frames: 35414016. Throughput: 0: 8914.6. Samples: 35397644. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:32:57,858][708628] Avg episode reward: [(0, '1992.213')] [2023-03-09 12:32:59,335][709034] Updated weights for policy 0, policy_version 69200 (0.0005) [2023-03-09 12:33:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8983.4). Total num frames: 35459072. Throughput: 0: 8940.8. Samples: 35451692. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:33:02,858][708628] Avg episode reward: [(0, '1494.198')] [2023-03-09 12:33:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000069256_35459072.pth... [2023-03-09 12:33:02,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000068728_35188736.pth [2023-03-09 12:33:03,798][709034] Updated weights for policy 0, policy_version 69280 (0.0005) [2023-03-09 12:33:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 9011.2). Total num frames: 35508224. Throughput: 0: 9012.6. Samples: 35508288. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:33:07,858][708628] Avg episode reward: [(0, '1760.945')] [2023-03-09 12:33:08,212][709034] Updated weights for policy 0, policy_version 69360 (0.0006) [2023-03-09 12:33:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8997.3). Total num frames: 35549184. Throughput: 0: 9022.4. Samples: 35534376. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:33:12,858][708628] Avg episode reward: [(0, '2204.529')] [2023-03-09 12:33:12,860][709034] Updated weights for policy 0, policy_version 69440 (0.0006) [2023-03-09 12:33:17,367][709034] Updated weights for policy 0, policy_version 69520 (0.0005) [2023-03-09 12:33:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 8997.3). Total num frames: 35598336. Throughput: 0: 9062.3. Samples: 35589828. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:33:17,858][708628] Avg episode reward: [(0, '2360.090')] [2023-03-09 12:33:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000069528_35598336.pth... [2023-03-09 12:33:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000068992_35323904.pth [2023-03-09 12:33:21,893][709034] Updated weights for policy 0, policy_version 69600 (0.0005) [2023-03-09 12:33:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8983.4). Total num frames: 35639296. Throughput: 0: 9063.2. Samples: 35643180. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:33:22,858][708628] Avg episode reward: [(0, '1770.730')] [2023-03-09 12:33:26,490][709034] Updated weights for policy 0, policy_version 69680 (0.0006) [2023-03-09 12:33:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 8997.3). Total num frames: 35688448. Throughput: 0: 9027.0. Samples: 35668624. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:33:27,858][708628] Avg episode reward: [(0, '1978.757')] [2023-03-09 12:33:30,923][709034] Updated weights for policy 0, policy_version 69760 (0.0005) [2023-03-09 12:33:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 8983.4). Total num frames: 35733504. Throughput: 0: 9087.5. Samples: 35725340. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:33:32,858][708628] Avg episode reward: [(0, '1350.828')] [2023-03-09 12:33:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000069792_35733504.pth... [2023-03-09 12:33:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000069256_35459072.pth [2023-03-09 12:33:35,506][709034] Updated weights for policy 0, policy_version 69840 (0.0005) [2023-03-09 12:33:37,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9011.2, 300 sec: 8955.7). Total num frames: 35774464. Throughput: 0: 9029.7. Samples: 35777660. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:33:37,858][708628] Avg episode reward: [(0, '2010.708')] [2023-03-09 12:33:40,155][709034] Updated weights for policy 0, policy_version 69920 (0.0005) [2023-03-09 12:33:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 8983.4). Total num frames: 35823616. Throughput: 0: 9055.5. Samples: 35805140. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:33:42,858][708628] Avg episode reward: [(0, '2319.892')] [2023-03-09 12:33:44,426][709034] Updated weights for policy 0, policy_version 70000 (0.0005) [2023-03-09 12:33:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 8983.4). Total num frames: 35868672. Throughput: 0: 9138.6. Samples: 35862928. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:33:47,858][708628] Avg episode reward: [(0, '1956.384')] [2023-03-09 12:33:47,904][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000070064_35872768.pth... [2023-03-09 12:33:47,905][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000069528_35598336.pth [2023-03-09 12:33:48,764][709034] Updated weights for policy 0, policy_version 70080 (0.0005) [2023-03-09 12:33:52,845][709034] Updated weights for policy 0, policy_version 70160 (0.0005) [2023-03-09 12:33:52,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9216.0, 300 sec: 9025.1). Total num frames: 35921920. Throughput: 0: 9179.7. Samples: 35921372. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:33:52,858][708628] Avg episode reward: [(0, '1686.750')] [2023-03-09 12:33:57,267][709034] Updated weights for policy 0, policy_version 70240 (0.0005) [2023-03-09 12:33:57,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9216.0, 300 sec: 9011.2). Total num frames: 35966976. Throughput: 0: 9244.2. Samples: 35950364. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:33:57,858][708628] Avg episode reward: [(0, '1880.536')] [2023-03-09 12:34:02,046][709034] Updated weights for policy 0, policy_version 70320 (0.0005) [2023-03-09 12:34:02,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9147.7, 300 sec: 8997.3). Total num frames: 36007936. Throughput: 0: 9154.0. Samples: 36001756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:34:02,858][708628] Avg episode reward: [(0, '1683.570')] [2023-03-09 12:34:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000070328_36007936.pth... [2023-03-09 12:34:02,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000069792_35733504.pth [2023-03-09 12:34:06,677][709034] Updated weights for policy 0, policy_version 70400 (0.0005) [2023-03-09 12:34:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9011.2). Total num frames: 36057088. Throughput: 0: 9199.4. Samples: 36057152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:34:07,858][708628] Avg episode reward: [(0, '1449.174')] [2023-03-09 12:34:10,847][709034] Updated weights for policy 0, policy_version 70480 (0.0005) [2023-03-09 12:34:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 8997.3). Total num frames: 36102144. Throughput: 0: 9268.6. Samples: 36085708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:34:12,858][708628] Avg episode reward: [(0, '1989.371')] [2023-03-09 12:34:15,547][709034] Updated weights for policy 0, policy_version 70560 (0.0005) [2023-03-09 12:34:17,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 8997.3). Total num frames: 36147200. Throughput: 0: 9187.4. Samples: 36138772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:34:17,858][708628] Avg episode reward: [(0, '2369.867')] [2023-03-09 12:34:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000070600_36147200.pth... [2023-03-09 12:34:17,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000070064_35872768.pth [2023-03-09 12:34:20,102][709034] Updated weights for policy 0, policy_version 70640 (0.0005) [2023-03-09 12:34:22,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9147.7, 300 sec: 8983.4). Total num frames: 36188160. Throughput: 0: 9208.9. Samples: 36192060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:34:22,858][708628] Avg episode reward: [(0, '1765.535')] [2023-03-09 12:34:24,683][709034] Updated weights for policy 0, policy_version 70720 (0.0005) [2023-03-09 12:34:27,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 8997.3). Total num frames: 36237312. Throughput: 0: 9165.0. Samples: 36217568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:34:27,858][708628] Avg episode reward: [(0, '1314.474')] [2023-03-09 12:34:29,155][709034] Updated weights for policy 0, policy_version 70800 (0.0005) [2023-03-09 12:34:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9011.2). Total num frames: 36282368. Throughput: 0: 9130.4. Samples: 36273796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:34:32,858][708628] Avg episode reward: [(0, '2239.734')] [2023-03-09 12:34:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000070864_36282368.pth... [2023-03-09 12:34:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000070328_36007936.pth [2023-03-09 12:34:33,701][709034] Updated weights for policy 0, policy_version 70880 (0.0005) [2023-03-09 12:34:37,857][708628] Fps is (10 sec: 8601.8, 60 sec: 9147.7, 300 sec: 8997.3). Total num frames: 36323328. Throughput: 0: 8993.4. Samples: 36326076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:34:37,858][708628] Avg episode reward: [(0, '1966.427')] [2023-03-09 12:34:38,439][709034] Updated weights for policy 0, policy_version 70960 (0.0005) [2023-03-09 12:34:42,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9079.5, 300 sec: 8997.3). Total num frames: 36368384. Throughput: 0: 8945.2. Samples: 36352900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:34:42,858][708628] Avg episode reward: [(0, '2085.178')] [2023-03-09 12:34:42,884][709034] Updated weights for policy 0, policy_version 71040 (0.0005) [2023-03-09 12:34:47,398][709034] Updated weights for policy 0, policy_version 71120 (0.0005) [2023-03-09 12:34:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9011.2). Total num frames: 36417536. Throughput: 0: 9019.9. Samples: 36407652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:34:47,858][708628] Avg episode reward: [(0, '2004.564')] [2023-03-09 12:34:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000071128_36417536.pth... [2023-03-09 12:34:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000070600_36147200.pth [2023-03-09 12:34:51,827][709034] Updated weights for policy 0, policy_version 71200 (0.0005) [2023-03-09 12:34:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 9011.2). Total num frames: 36462592. Throughput: 0: 9007.6. Samples: 36462496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:34:52,858][708628] Avg episode reward: [(0, '2080.824')] [2023-03-09 12:34:56,619][709034] Updated weights for policy 0, policy_version 71280 (0.0005) [2023-03-09 12:34:57,857][708628] Fps is (10 sec: 8601.5, 60 sec: 8942.9, 300 sec: 9011.2). Total num frames: 36503552. Throughput: 0: 8928.3. Samples: 36487484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:34:57,858][708628] Avg episode reward: [(0, '2002.872')] [2023-03-09 12:35:00,978][709034] Updated weights for policy 0, policy_version 71360 (0.0005) [2023-03-09 12:35:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9011.2). Total num frames: 36552704. Throughput: 0: 9003.7. Samples: 36543940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:35:02,858][708628] Avg episode reward: [(0, '2616.279')] [2023-03-09 12:35:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000071392_36552704.pth... [2023-03-09 12:35:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000070864_36282368.pth [2023-03-09 12:35:05,757][709034] Updated weights for policy 0, policy_version 71440 (0.0006) [2023-03-09 12:35:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8997.3). Total num frames: 36593664. Throughput: 0: 8938.8. Samples: 36594308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:35:07,858][708628] Avg episode reward: [(0, '2155.688')] [2023-03-09 12:35:10,198][709034] Updated weights for policy 0, policy_version 71520 (0.0005) [2023-03-09 12:35:12,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 8997.3). Total num frames: 36638720. Throughput: 0: 9009.7. Samples: 36623004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:35:12,858][708628] Avg episode reward: [(0, '1445.654')] [2023-03-09 12:35:14,949][709034] Updated weights for policy 0, policy_version 71600 (0.0005) [2023-03-09 12:35:17,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 8997.3). Total num frames: 36683776. Throughput: 0: 8927.6. Samples: 36675540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:35:17,858][708628] Avg episode reward: [(0, '1121.147')] [2023-03-09 12:35:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000071648_36683776.pth... [2023-03-09 12:35:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000071128_36417536.pth [2023-03-09 12:35:19,483][709034] Updated weights for policy 0, policy_version 71680 (0.0005) [2023-03-09 12:35:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 8983.4). Total num frames: 36728832. Throughput: 0: 8951.7. Samples: 36728904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:35:22,858][708628] Avg episode reward: [(0, '2379.466')] [2023-03-09 12:35:24,128][709034] Updated weights for policy 0, policy_version 71760 (0.0004) [2023-03-09 12:35:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8943.0, 300 sec: 8983.4). Total num frames: 36773888. Throughput: 0: 8989.7. Samples: 36757436. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:35:27,858][708628] Avg episode reward: [(0, '2876.894')] [2023-03-09 12:35:28,683][709034] Updated weights for policy 0, policy_version 71840 (0.0005) [2023-03-09 12:35:32,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8943.0, 300 sec: 8997.3). Total num frames: 36818944. Throughput: 0: 8942.2. Samples: 36810052. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:35:32,858][708628] Avg episode reward: [(0, '2780.080')] [2023-03-09 12:35:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000071912_36818944.pth... [2023-03-09 12:35:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000071392_36552704.pth [2023-03-09 12:35:33,224][709034] Updated weights for policy 0, policy_version 71920 (0.0005) [2023-03-09 12:35:37,756][709034] Updated weights for policy 0, policy_version 72000 (0.0005) [2023-03-09 12:35:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 8983.4). Total num frames: 36864000. Throughput: 0: 8923.7. Samples: 36864064. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:35:37,858][708628] Avg episode reward: [(0, '2488.648')] [2023-03-09 12:35:42,027][709034] Updated weights for policy 0, policy_version 72080 (0.0005) [2023-03-09 12:35:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 8983.4). Total num frames: 36909056. Throughput: 0: 9023.0. Samples: 36893516. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:35:42,858][708628] Avg episode reward: [(0, '2558.693')] [2023-03-09 12:35:46,618][709034] Updated weights for policy 0, policy_version 72160 (0.0005) [2023-03-09 12:35:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 8997.3). Total num frames: 36954112. Throughput: 0: 8959.7. Samples: 36947128. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:35:47,858][708628] Avg episode reward: [(0, '2922.558')] [2023-03-09 12:35:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000072176_36954112.pth... [2023-03-09 12:35:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000071648_36683776.pth [2023-03-09 12:35:51,325][709034] Updated weights for policy 0, policy_version 72240 (0.0004) [2023-03-09 12:35:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8997.3). Total num frames: 36999168. Throughput: 0: 8996.9. Samples: 36999168. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:35:52,858][708628] Avg episode reward: [(0, '3050.587')] [2023-03-09 12:35:56,084][709034] Updated weights for policy 0, policy_version 72320 (0.0005) [2023-03-09 12:35:57,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8942.9, 300 sec: 8983.4). Total num frames: 37040128. Throughput: 0: 8935.0. Samples: 37025080. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:35:57,858][708628] Avg episode reward: [(0, '3266.680')] [2023-03-09 12:36:00,609][709034] Updated weights for policy 0, policy_version 72400 (0.0005) [2023-03-09 12:36:02,857][708628] Fps is (10 sec: 8601.5, 60 sec: 8874.7, 300 sec: 8983.4). Total num frames: 37085184. Throughput: 0: 8989.9. Samples: 37080084. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:36:02,858][708628] Avg episode reward: [(0, '2127.998')] [2023-03-09 12:36:02,891][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000072440_37089280.pth... [2023-03-09 12:36:02,893][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000071912_36818944.pth [2023-03-09 12:36:05,174][709034] Updated weights for policy 0, policy_version 72480 (0.0005) [2023-03-09 12:36:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 8983.4). Total num frames: 37130240. Throughput: 0: 8999.3. Samples: 37133872. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 12:36:07,858][708628] Avg episode reward: [(0, '2253.020')] [2023-03-09 12:36:09,622][709034] Updated weights for policy 0, policy_version 72560 (0.0005) [2023-03-09 12:36:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9011.2, 300 sec: 9011.2). Total num frames: 37179392. Throughput: 0: 8985.6. Samples: 37161788. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:36:12,868][708628] Avg episode reward: [(0, '2355.409')] [2023-03-09 12:36:14,091][709034] Updated weights for policy 0, policy_version 72640 (0.0006) [2023-03-09 12:36:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9011.2, 300 sec: 8997.3). Total num frames: 37224448. Throughput: 0: 9017.5. Samples: 37215840. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:36:17,868][708628] Avg episode reward: [(0, '2431.172')] [2023-03-09 12:36:17,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000072704_37224448.pth... [2023-03-09 12:36:17,874][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000072176_36954112.pth [2023-03-09 12:36:18,632][709034] Updated weights for policy 0, policy_version 72720 (0.0005) [2023-03-09 12:36:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 8997.3). Total num frames: 37269504. Throughput: 0: 9009.8. Samples: 37269504. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:36:22,858][708628] Avg episode reward: [(0, '2585.451')] [2023-03-09 12:36:23,237][709034] Updated weights for policy 0, policy_version 72800 (0.0005) [2023-03-09 12:36:27,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8942.9, 300 sec: 8983.4). Total num frames: 37310464. Throughput: 0: 8938.7. Samples: 37295756. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:36:27,858][708628] Avg episode reward: [(0, '2366.633')] [2023-03-09 12:36:27,978][709034] Updated weights for policy 0, policy_version 72880 (0.0005) [2023-03-09 12:36:32,785][709034] Updated weights for policy 0, policy_version 72960 (0.0006) [2023-03-09 12:36:32,857][708628] Fps is (10 sec: 8601.5, 60 sec: 8942.9, 300 sec: 8997.3). Total num frames: 37355520. Throughput: 0: 8893.3. Samples: 37347328. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:36:32,858][708628] Avg episode reward: [(0, '2294.989')] [2023-03-09 12:36:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000072960_37355520.pth... [2023-03-09 12:36:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000072440_37089280.pth [2023-03-09 12:36:37,686][709034] Updated weights for policy 0, policy_version 73040 (0.0005) [2023-03-09 12:36:37,857][708628] Fps is (10 sec: 8601.5, 60 sec: 8874.7, 300 sec: 8983.4). Total num frames: 37396480. Throughput: 0: 8836.4. Samples: 37396808. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:36:37,858][708628] Avg episode reward: [(0, '2500.543')] [2023-03-09 12:36:42,091][709034] Updated weights for policy 0, policy_version 73120 (0.0006) [2023-03-09 12:36:42,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8874.7, 300 sec: 8983.4). Total num frames: 37441536. Throughput: 0: 8877.1. Samples: 37424548. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:36:42,868][708628] Avg episode reward: [(0, '2168.421')] [2023-03-09 12:36:46,714][709034] Updated weights for policy 0, policy_version 73200 (0.0005) [2023-03-09 12:36:47,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8874.7, 300 sec: 8983.4). Total num frames: 37486592. Throughput: 0: 8853.1. Samples: 37478472. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:36:47,868][708628] Avg episode reward: [(0, '2490.373')] [2023-03-09 12:36:47,871][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000073216_37486592.pth... [2023-03-09 12:36:47,873][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000072704_37224448.pth [2023-03-09 12:36:51,412][709034] Updated weights for policy 0, policy_version 73280 (0.0006) [2023-03-09 12:36:52,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8874.6, 300 sec: 8983.4). Total num frames: 37531648. Throughput: 0: 8837.6. Samples: 37531564. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:36:52,869][708628] Avg episode reward: [(0, '2239.510')] [2023-03-09 12:36:56,084][709034] Updated weights for policy 0, policy_version 73360 (0.0005) [2023-03-09 12:36:57,857][708628] Fps is (10 sec: 8601.5, 60 sec: 8874.7, 300 sec: 8969.5). Total num frames: 37572608. Throughput: 0: 8796.6. Samples: 37557636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:36:57,868][708628] Avg episode reward: [(0, '2318.453')] [2023-03-09 12:37:00,739][709034] Updated weights for policy 0, policy_version 73440 (0.0005) [2023-03-09 12:37:02,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8983.4). Total num frames: 37617664. Throughput: 0: 8757.7. Samples: 37609936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:37:02,858][708628] Avg episode reward: [(0, '2194.048')] [2023-03-09 12:37:02,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000073472_37617664.pth... [2023-03-09 12:37:02,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000072960_37355520.pth [2023-03-09 12:37:05,438][709034] Updated weights for policy 0, policy_version 73520 (0.0005) [2023-03-09 12:37:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8983.4). Total num frames: 37662720. Throughput: 0: 8788.4. Samples: 37664984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:37:07,868][708628] Avg episode reward: [(0, '3117.136')] [2023-03-09 12:37:09,776][709034] Updated weights for policy 0, policy_version 73600 (0.0005) [2023-03-09 12:37:12,857][708628] Fps is (10 sec: 9011.4, 60 sec: 8806.4, 300 sec: 8983.4). Total num frames: 37707776. Throughput: 0: 8793.5. Samples: 37691464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:37:12,868][708628] Avg episode reward: [(0, '3145.059')] [2023-03-09 12:37:14,194][709034] Updated weights for policy 0, policy_version 73680 (0.0005) [2023-03-09 12:37:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 8874.7, 300 sec: 8997.3). Total num frames: 37756928. Throughput: 0: 8915.0. Samples: 37748504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:37:17,868][708628] Avg episode reward: [(0, '3225.467')] [2023-03-09 12:37:17,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000073744_37756928.pth... [2023-03-09 12:37:17,874][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000073216_37486592.pth [2023-03-09 12:37:18,782][709034] Updated weights for policy 0, policy_version 73760 (0.0005) [2023-03-09 12:37:22,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 8997.3). Total num frames: 37797888. Throughput: 0: 8965.2. Samples: 37800244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:37:22,868][708628] Avg episode reward: [(0, '2602.800')] [2023-03-09 12:37:23,457][709034] Updated weights for policy 0, policy_version 73840 (0.0005) [2023-03-09 12:37:27,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 8997.3). Total num frames: 37842944. Throughput: 0: 8932.3. Samples: 37826500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:37:27,868][708628] Avg episode reward: [(0, '3140.082')] [2023-03-09 12:37:27,945][709034] Updated weights for policy 0, policy_version 73920 (0.0005) [2023-03-09 12:37:32,440][709034] Updated weights for policy 0, policy_version 74000 (0.0005) [2023-03-09 12:37:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 8942.9, 300 sec: 9011.2). Total num frames: 37892096. Throughput: 0: 8942.7. Samples: 37880892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:37:32,868][708628] Avg episode reward: [(0, '2999.096')] [2023-03-09 12:37:32,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000074008_37892096.pth... [2023-03-09 12:37:32,875][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000073472_37617664.pth [2023-03-09 12:37:36,855][709034] Updated weights for policy 0, policy_version 74080 (0.0005) [2023-03-09 12:37:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 9011.2). Total num frames: 37937152. Throughput: 0: 9014.5. Samples: 37937216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:37:37,858][708628] Avg episode reward: [(0, '2554.240')] [2023-03-09 12:37:41,368][709034] Updated weights for policy 0, policy_version 74160 (0.0005) [2023-03-09 12:37:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9011.2). Total num frames: 37982208. Throughput: 0: 9055.9. Samples: 37965152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:37:42,858][708628] Avg episode reward: [(0, '1999.592')] [2023-03-09 12:37:45,679][709034] Updated weights for policy 0, policy_version 74240 (0.0005) [2023-03-09 12:37:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9011.2). Total num frames: 38027264. Throughput: 0: 9132.3. Samples: 38020888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:37:47,858][708628] Avg episode reward: [(0, '2766.866')] [2023-03-09 12:37:47,896][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000074280_38031360.pth... [2023-03-09 12:37:47,899][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000073744_37756928.pth [2023-03-09 12:37:50,159][709034] Updated weights for policy 0, policy_version 74320 (0.0005) [2023-03-09 12:37:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9011.2). Total num frames: 38072320. Throughput: 0: 9132.3. Samples: 38075936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:37:52,858][708628] Avg episode reward: [(0, '3084.519')] [2023-03-09 12:37:54,631][709034] Updated weights for policy 0, policy_version 74400 (0.0006) [2023-03-09 12:37:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9011.2). Total num frames: 38117376. Throughput: 0: 9141.9. Samples: 38102852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:37:57,858][708628] Avg episode reward: [(0, '3105.717')] [2023-03-09 12:37:59,296][709034] Updated weights for policy 0, policy_version 74480 (0.0005) [2023-03-09 12:38:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9011.2). Total num frames: 38166528. Throughput: 0: 9119.9. Samples: 38158900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:38:02,858][708628] Avg episode reward: [(0, '2509.655')] [2023-03-09 12:38:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000074544_38166528.pth... [2023-03-09 12:38:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000074008_37892096.pth [2023-03-09 12:38:03,416][709034] Updated weights for policy 0, policy_version 74560 (0.0005) [2023-03-09 12:38:07,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9025.1). Total num frames: 38211584. Throughput: 0: 9206.1. Samples: 38214520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:38:07,858][708628] Avg episode reward: [(0, '2649.058')] [2023-03-09 12:38:07,988][709034] Updated weights for policy 0, policy_version 74640 (0.0005) [2023-03-09 12:38:12,155][709034] Updated weights for policy 0, policy_version 74720 (0.0005) [2023-03-09 12:38:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9025.1). Total num frames: 38260736. Throughput: 0: 9285.2. Samples: 38244336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:38:12,858][708628] Avg episode reward: [(0, '2912.608')] [2023-03-09 12:38:16,855][709034] Updated weights for policy 0, policy_version 74800 (0.0005) [2023-03-09 12:38:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9039.0). Total num frames: 38305792. Throughput: 0: 9253.0. Samples: 38297276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:38:17,858][708628] Avg episode reward: [(0, '2986.629')] [2023-03-09 12:38:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000074816_38305792.pth... [2023-03-09 12:38:17,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000074280_38031360.pth [2023-03-09 12:38:21,295][709034] Updated weights for policy 0, policy_version 74880 (0.0005) [2023-03-09 12:38:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9025.1). Total num frames: 38350848. Throughput: 0: 9197.7. Samples: 38351112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:38:22,858][708628] Avg episode reward: [(0, '2864.321')] [2023-03-09 12:38:25,859][709034] Updated weights for policy 0, policy_version 74960 (0.0005) [2023-03-09 12:38:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9025.1). Total num frames: 38395904. Throughput: 0: 9193.0. Samples: 38378836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:38:27,858][708628] Avg episode reward: [(0, '3267.150')] [2023-03-09 12:38:30,448][709034] Updated weights for policy 0, policy_version 75040 (0.0005) [2023-03-09 12:38:32,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9039.0). Total num frames: 38440960. Throughput: 0: 9141.0. Samples: 38432232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:38:32,858][708628] Avg episode reward: [(0, '3347.706')] [2023-03-09 12:38:32,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000075080_38440960.pth... [2023-03-09 12:38:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000074544_38166528.pth [2023-03-09 12:38:35,213][709034] Updated weights for policy 0, policy_version 75120 (0.0005) [2023-03-09 12:38:37,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9079.5, 300 sec: 9011.2). Total num frames: 38481920. Throughput: 0: 9070.5. Samples: 38484108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:38:37,858][708628] Avg episode reward: [(0, '3155.772')] [2023-03-09 12:38:39,965][709034] Updated weights for policy 0, policy_version 75200 (0.0004) [2023-03-09 12:38:42,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9079.5, 300 sec: 9011.2). Total num frames: 38526976. Throughput: 0: 9039.9. Samples: 38509648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:38:42,858][708628] Avg episode reward: [(0, '2655.909')] [2023-03-09 12:38:44,596][709034] Updated weights for policy 0, policy_version 75280 (0.0005) [2023-03-09 12:38:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9079.5, 300 sec: 8983.4). Total num frames: 38572032. Throughput: 0: 8995.6. Samples: 38563704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:38:47,858][708628] Avg episode reward: [(0, '2507.269')] [2023-03-09 12:38:47,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000075336_38572032.pth... [2023-03-09 12:38:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000074816_38305792.pth [2023-03-09 12:38:49,028][709034] Updated weights for policy 0, policy_version 75360 (0.0005) [2023-03-09 12:38:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 8983.4). Total num frames: 38617088. Throughput: 0: 9000.2. Samples: 38619528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:38:52,858][708628] Avg episode reward: [(0, '2756.880')] [2023-03-09 12:38:53,554][709034] Updated weights for policy 0, policy_version 75440 (0.0005) [2023-03-09 12:38:57,857][708628] Fps is (10 sec: 9011.4, 60 sec: 9079.5, 300 sec: 8997.3). Total num frames: 38662144. Throughput: 0: 8992.8. Samples: 38649012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:38:57,858][708628] Avg episode reward: [(0, '2393.066')] [2023-03-09 12:38:57,880][709034] Updated weights for policy 0, policy_version 75520 (0.0005) [2023-03-09 12:39:02,294][709034] Updated weights for policy 0, policy_version 75600 (0.0004) [2023-03-09 12:39:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 8997.3). Total num frames: 38711296. Throughput: 0: 9018.1. Samples: 38703092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:39:02,858][708628] Avg episode reward: [(0, '2696.759')] [2023-03-09 12:39:02,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000075608_38711296.pth... [2023-03-09 12:39:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000075080_38440960.pth [2023-03-09 12:39:06,916][709034] Updated weights for policy 0, policy_version 75680 (0.0005) [2023-03-09 12:39:07,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 8997.3). Total num frames: 38756352. Throughput: 0: 9004.8. Samples: 38756328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:39:07,858][708628] Avg episode reward: [(0, '2411.650')] [2023-03-09 12:39:11,383][709034] Updated weights for policy 0, policy_version 75760 (0.0005) [2023-03-09 12:39:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 8997.3). Total num frames: 38801408. Throughput: 0: 8998.0. Samples: 38783744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:39:12,858][708628] Avg episode reward: [(0, '1828.817')] [2023-03-09 12:39:16,031][709034] Updated weights for policy 0, policy_version 75840 (0.0006) [2023-03-09 12:39:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9011.2). Total num frames: 38846464. Throughput: 0: 8991.9. Samples: 38836868. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:39:17,858][708628] Avg episode reward: [(0, '2162.538')] [2023-03-09 12:39:17,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000075872_38846464.pth... [2023-03-09 12:39:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000075336_38572032.pth [2023-03-09 12:39:20,249][709034] Updated weights for policy 0, policy_version 75920 (0.0005) [2023-03-09 12:39:22,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9011.2, 300 sec: 8997.3). Total num frames: 38891520. Throughput: 0: 9120.8. Samples: 38894544. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:39:22,858][708628] Avg episode reward: [(0, '2679.465')] [2023-03-09 12:39:24,554][709034] Updated weights for policy 0, policy_version 76000 (0.0005) [2023-03-09 12:39:27,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9079.5, 300 sec: 9011.2). Total num frames: 38940672. Throughput: 0: 9198.2. Samples: 38923568. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:39:27,858][708628] Avg episode reward: [(0, '3166.052')] [2023-03-09 12:39:28,916][709034] Updated weights for policy 0, policy_version 76080 (0.0005) [2023-03-09 12:39:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 9025.1). Total num frames: 38985728. Throughput: 0: 9231.9. Samples: 38979140. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:39:32,858][708628] Avg episode reward: [(0, '3023.180')] [2023-03-09 12:39:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000076144_38985728.pth... [2023-03-09 12:39:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000075608_38711296.pth [2023-03-09 12:39:33,485][709034] Updated weights for policy 0, policy_version 76160 (0.0005) [2023-03-09 12:39:37,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9025.1). Total num frames: 39030784. Throughput: 0: 9213.3. Samples: 39034128. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:39:37,858][708628] Avg episode reward: [(0, '2794.447')] [2023-03-09 12:39:37,960][709034] Updated weights for policy 0, policy_version 76240 (0.0005) [2023-03-09 12:39:42,636][709034] Updated weights for policy 0, policy_version 76320 (0.0004) [2023-03-09 12:39:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9011.2). Total num frames: 39075840. Throughput: 0: 9137.7. Samples: 39060208. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:39:42,858][708628] Avg episode reward: [(0, '2277.808')] [2023-03-09 12:39:47,327][709034] Updated weights for policy 0, policy_version 76400 (0.0005) [2023-03-09 12:39:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9011.2). Total num frames: 39120896. Throughput: 0: 9088.3. Samples: 39112064. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:39:47,858][708628] Avg episode reward: [(0, '1018.856')] [2023-03-09 12:39:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000076408_39120896.pth... [2023-03-09 12:39:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000075872_38846464.pth [2023-03-09 12:39:51,802][709034] Updated weights for policy 0, policy_version 76480 (0.0005) [2023-03-09 12:39:52,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9025.1). Total num frames: 39165952. Throughput: 0: 9115.5. Samples: 39166524. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:39:52,858][708628] Avg episode reward: [(0, '1325.291')] [2023-03-09 12:39:56,241][709034] Updated weights for policy 0, policy_version 76560 (0.0006) [2023-03-09 12:39:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9011.2). Total num frames: 39211008. Throughput: 0: 9130.8. Samples: 39194632. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:39:57,858][708628] Avg episode reward: [(0, '1515.779')] [2023-03-09 12:40:00,646][709034] Updated weights for policy 0, policy_version 76640 (0.0005) [2023-03-09 12:40:02,857][708628] Fps is (10 sec: 9011.0, 60 sec: 9079.5, 300 sec: 9025.1). Total num frames: 39256064. Throughput: 0: 9180.4. Samples: 39249984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:40:02,858][708628] Avg episode reward: [(0, '2532.584')] [2023-03-09 12:40:02,889][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000076680_39260160.pth... [2023-03-09 12:40:02,891][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000076144_38985728.pth [2023-03-09 12:40:05,181][709034] Updated weights for policy 0, policy_version 76720 (0.0005) [2023-03-09 12:40:07,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9147.8, 300 sec: 9039.0). Total num frames: 39305216. Throughput: 0: 9122.6. Samples: 39305060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:40:07,858][708628] Avg episode reward: [(0, '3068.850')] [2023-03-09 12:40:09,722][709034] Updated weights for policy 0, policy_version 76800 (0.0005) [2023-03-09 12:40:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9025.1). Total num frames: 39346176. Throughput: 0: 9038.0. Samples: 39330280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:40:12,858][708628] Avg episode reward: [(0, '3362.362')] [2023-03-09 12:40:14,309][709034] Updated weights for policy 0, policy_version 76880 (0.0005) [2023-03-09 12:40:17,857][708628] Fps is (10 sec: 8601.5, 60 sec: 9079.5, 300 sec: 9025.1). Total num frames: 39391232. Throughput: 0: 9017.4. Samples: 39384924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:40:17,858][708628] Avg episode reward: [(0, '3143.538')] [2023-03-09 12:40:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000076936_39391232.pth... [2023-03-09 12:40:17,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000076408_39120896.pth [2023-03-09 12:40:18,891][709034] Updated weights for policy 0, policy_version 76960 (0.0005) [2023-03-09 12:40:22,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9025.1). Total num frames: 39436288. Throughput: 0: 8994.2. Samples: 39438868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:40:22,858][708628] Avg episode reward: [(0, '2839.752')] [2023-03-09 12:40:23,501][709034] Updated weights for policy 0, policy_version 77040 (0.0005) [2023-03-09 12:40:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9025.1). Total num frames: 39481344. Throughput: 0: 8990.8. Samples: 39464796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:40:27,858][708628] Avg episode reward: [(0, '3365.856')] [2023-03-09 12:40:28,141][709034] Updated weights for policy 0, policy_version 77120 (0.0005) [2023-03-09 12:40:32,688][709034] Updated weights for policy 0, policy_version 77200 (0.0005) [2023-03-09 12:40:32,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9011.2, 300 sec: 9025.1). Total num frames: 39526400. Throughput: 0: 9025.6. Samples: 39518216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:40:32,858][708628] Avg episode reward: [(0, '3570.836')] [2023-03-09 12:40:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000077200_39526400.pth... [2023-03-09 12:40:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000076680_39260160.pth [2023-03-09 12:40:37,118][709034] Updated weights for policy 0, policy_version 77280 (0.0005) [2023-03-09 12:40:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9025.1). Total num frames: 39571456. Throughput: 0: 9067.1. Samples: 39574544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:40:37,858][708628] Avg episode reward: [(0, '2657.029')] [2023-03-09 12:40:41,812][709034] Updated weights for policy 0, policy_version 77360 (0.0005) [2023-03-09 12:40:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9025.1). Total num frames: 39616512. Throughput: 0: 9009.6. Samples: 39600064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:40:42,858][708628] Avg episode reward: [(0, '3442.223')] [2023-03-09 12:40:45,938][709034] Updated weights for policy 0, policy_version 77440 (0.0005) [2023-03-09 12:40:47,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9079.5, 300 sec: 9039.0). Total num frames: 39665664. Throughput: 0: 9051.2. Samples: 39657288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:40:47,858][708628] Avg episode reward: [(0, '3053.018')] [2023-03-09 12:40:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000077472_39665664.pth... [2023-03-09 12:40:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000076936_39391232.pth [2023-03-09 12:40:50,399][709034] Updated weights for policy 0, policy_version 77520 (0.0005) [2023-03-09 12:40:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.4, 300 sec: 9052.9). Total num frames: 39710720. Throughput: 0: 9025.0. Samples: 39711184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:40:52,858][708628] Avg episode reward: [(0, '2798.756')] [2023-03-09 12:40:55,093][709034] Updated weights for policy 0, policy_version 77600 (0.0005) [2023-03-09 12:40:57,857][708628] Fps is (10 sec: 8601.5, 60 sec: 9011.2, 300 sec: 9039.0). Total num frames: 39751680. Throughput: 0: 9035.0. Samples: 39736856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:40:57,858][708628] Avg episode reward: [(0, '2348.422')] [2023-03-09 12:40:59,564][709034] Updated weights for policy 0, policy_version 77680 (0.0004) [2023-03-09 12:41:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9052.9). Total num frames: 39800832. Throughput: 0: 9060.4. Samples: 39792640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:41:02,858][708628] Avg episode reward: [(0, '2943.725')] [2023-03-09 12:41:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000077736_39800832.pth... [2023-03-09 12:41:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000077200_39526400.pth [2023-03-09 12:41:04,037][709034] Updated weights for policy 0, policy_version 77760 (0.0006) [2023-03-09 12:41:07,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9011.2, 300 sec: 9039.0). Total num frames: 39845888. Throughput: 0: 9081.9. Samples: 39847552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:41:07,858][708628] Avg episode reward: [(0, '2887.112')] [2023-03-09 12:41:08,496][709034] Updated weights for policy 0, policy_version 77840 (0.0005) [2023-03-09 12:41:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9039.0). Total num frames: 39890944. Throughput: 0: 9107.5. Samples: 39874632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:41:12,858][708628] Avg episode reward: [(0, '2458.453')] [2023-03-09 12:41:13,011][709034] Updated weights for policy 0, policy_version 77920 (0.0005) [2023-03-09 12:41:17,487][709034] Updated weights for policy 0, policy_version 78000 (0.0004) [2023-03-09 12:41:17,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9079.5, 300 sec: 9039.0). Total num frames: 39936000. Throughput: 0: 9111.6. Samples: 39928236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:41:17,858][708628] Avg episode reward: [(0, '2883.691')] [2023-03-09 12:41:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000078000_39936000.pth... [2023-03-09 12:41:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000077472_39665664.pth [2023-03-09 12:41:21,954][709034] Updated weights for policy 0, policy_version 78080 (0.0005) [2023-03-09 12:41:22,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9052.9). Total num frames: 39981056. Throughput: 0: 9108.3. Samples: 39984416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:41:22,858][708628] Avg episode reward: [(0, '3136.767')] [2023-03-09 12:41:26,570][709034] Updated weights for policy 0, policy_version 78160 (0.0005) [2023-03-09 12:41:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9052.9). Total num frames: 40026112. Throughput: 0: 9127.5. Samples: 40010800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:41:27,858][708628] Avg episode reward: [(0, '3268.270')] [2023-03-09 12:41:31,088][709034] Updated weights for policy 0, policy_version 78240 (0.0004) [2023-03-09 12:41:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9080.6). Total num frames: 40075264. Throughput: 0: 9051.4. Samples: 40064600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:41:32,858][708628] Avg episode reward: [(0, '3387.410')] [2023-03-09 12:41:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000078272_40075264.pth... [2023-03-09 12:41:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000077736_39800832.pth [2023-03-09 12:41:35,493][709034] Updated weights for policy 0, policy_version 78320 (0.0005) [2023-03-09 12:41:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9080.6). Total num frames: 40120320. Throughput: 0: 9104.4. Samples: 40120884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:41:37,858][708628] Avg episode reward: [(0, '2580.127')] [2023-03-09 12:41:39,982][709034] Updated weights for policy 0, policy_version 78400 (0.0005) [2023-03-09 12:41:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9080.6). Total num frames: 40165376. Throughput: 0: 9155.2. Samples: 40148840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:41:42,858][708628] Avg episode reward: [(0, '3243.817')] [2023-03-09 12:41:44,283][709034] Updated weights for policy 0, policy_version 78480 (0.0005) [2023-03-09 12:41:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9080.6). Total num frames: 40210432. Throughput: 0: 9167.4. Samples: 40205172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:41:47,858][708628] Avg episode reward: [(0, '3201.742')] [2023-03-09 12:41:47,867][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000078544_40214528.pth... [2023-03-09 12:41:47,869][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000078000_39936000.pth [2023-03-09 12:41:48,798][709034] Updated weights for policy 0, policy_version 78560 (0.0005) [2023-03-09 12:41:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9094.5). Total num frames: 40255488. Throughput: 0: 9149.9. Samples: 40259296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:41:52,858][708628] Avg episode reward: [(0, '2848.211')] [2023-03-09 12:41:53,343][709034] Updated weights for policy 0, policy_version 78640 (0.0005) [2023-03-09 12:41:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9094.5). Total num frames: 40300544. Throughput: 0: 9124.0. Samples: 40285212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:41:57,858][708628] Avg episode reward: [(0, '2636.693')] [2023-03-09 12:41:58,033][709034] Updated weights for policy 0, policy_version 78720 (0.0005) [2023-03-09 12:42:02,498][709034] Updated weights for policy 0, policy_version 78800 (0.0005) [2023-03-09 12:42:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9079.5, 300 sec: 9094.5). Total num frames: 40345600. Throughput: 0: 9114.6. Samples: 40338392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:42:02,858][708628] Avg episode reward: [(0, '3402.546')] [2023-03-09 12:42:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000078800_40345600.pth... [2023-03-09 12:42:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000078272_40075264.pth [2023-03-09 12:42:07,171][709034] Updated weights for policy 0, policy_version 78880 (0.0005) [2023-03-09 12:42:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9094.5). Total num frames: 40390656. Throughput: 0: 9047.8. Samples: 40391568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:42:07,858][708628] Avg episode reward: [(0, '3015.276')] [2023-03-09 12:42:11,878][709034] Updated weights for policy 0, policy_version 78960 (0.0005) [2023-03-09 12:42:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9080.6). Total num frames: 40435712. Throughput: 0: 9054.8. Samples: 40418268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:42:12,858][708628] Avg episode reward: [(0, '3049.083')] [2023-03-09 12:42:16,080][709034] Updated weights for policy 0, policy_version 79040 (0.0005) [2023-03-09 12:42:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9108.4). Total num frames: 40484864. Throughput: 0: 9133.8. Samples: 40475620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:42:17,858][708628] Avg episode reward: [(0, '3227.033')] [2023-03-09 12:42:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000079072_40484864.pth... [2023-03-09 12:42:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000078544_40214528.pth [2023-03-09 12:42:20,683][709034] Updated weights for policy 0, policy_version 79120 (0.0006) [2023-03-09 12:42:22,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9108.4). Total num frames: 40529920. Throughput: 0: 9087.8. Samples: 40529836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:42:22,858][708628] Avg episode reward: [(0, '3786.920')] [2023-03-09 12:42:22,858][708990] Saving new best policy, reward=3786.920! [2023-03-09 12:42:24,965][709034] Updated weights for policy 0, policy_version 79200 (0.0005) [2023-03-09 12:42:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9094.5). Total num frames: 40574976. Throughput: 0: 9099.5. Samples: 40558316. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:42:27,858][708628] Avg episode reward: [(0, '3597.607')] [2023-03-09 12:42:29,313][709034] Updated weights for policy 0, policy_version 79280 (0.0006) [2023-03-09 12:42:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9108.4). Total num frames: 40624128. Throughput: 0: 9126.0. Samples: 40615844. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:42:32,858][708628] Avg episode reward: [(0, '3617.731')] [2023-03-09 12:42:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000079344_40624128.pth... [2023-03-09 12:42:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000078800_40345600.pth [2023-03-09 12:42:33,682][709034] Updated weights for policy 0, policy_version 79360 (0.0005) [2023-03-09 12:42:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9108.4). Total num frames: 40669184. Throughput: 0: 9116.4. Samples: 40669536. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:42:37,858][708628] Avg episode reward: [(0, '3615.600')] [2023-03-09 12:42:38,158][709034] Updated weights for policy 0, policy_version 79440 (0.0005) [2023-03-09 12:42:42,644][709034] Updated weights for policy 0, policy_version 79520 (0.0005) [2023-03-09 12:42:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9108.4). Total num frames: 40714240. Throughput: 0: 9164.3. Samples: 40697608. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:42:42,858][708628] Avg episode reward: [(0, '2988.937')] [2023-03-09 12:42:47,286][709034] Updated weights for policy 0, policy_version 79600 (0.0006) [2023-03-09 12:42:47,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9108.4). Total num frames: 40759296. Throughput: 0: 9171.1. Samples: 40751092. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:42:47,858][708628] Avg episode reward: [(0, '2964.914')] [2023-03-09 12:42:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000079608_40759296.pth... [2023-03-09 12:42:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000079072_40484864.pth [2023-03-09 12:42:51,941][709034] Updated weights for policy 0, policy_version 79680 (0.0005) [2023-03-09 12:42:52,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9079.5, 300 sec: 9094.5). Total num frames: 40800256. Throughput: 0: 9160.4. Samples: 40803784. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:42:52,858][708628] Avg episode reward: [(0, '3255.022')] [2023-03-09 12:42:56,546][709034] Updated weights for policy 0, policy_version 79760 (0.0006) [2023-03-09 12:42:57,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9079.5, 300 sec: 9080.6). Total num frames: 40845312. Throughput: 0: 9134.6. Samples: 40829324. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:42:57,858][708628] Avg episode reward: [(0, '3030.059')] [2023-03-09 12:43:01,028][709034] Updated weights for policy 0, policy_version 79840 (0.0005) [2023-03-09 12:43:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9080.6). Total num frames: 40890368. Throughput: 0: 9085.5. Samples: 40884468. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:43:02,858][708628] Avg episode reward: [(0, '3133.314')] [2023-03-09 12:43:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000079864_40890368.pth... [2023-03-09 12:43:02,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000079344_40624128.pth [2023-03-09 12:43:05,660][709034] Updated weights for policy 0, policy_version 79920 (0.0005) [2023-03-09 12:43:07,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9080.6). Total num frames: 40939520. Throughput: 0: 9104.4. Samples: 40939536. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 12:43:07,858][708628] Avg episode reward: [(0, '2763.812')] [2023-03-09 12:43:10,108][709034] Updated weights for policy 0, policy_version 80000 (0.0005) [2023-03-09 12:43:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9080.6). Total num frames: 40984576. Throughput: 0: 9088.6. Samples: 40967304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:43:12,858][708628] Avg episode reward: [(0, '3322.663')] [2023-03-09 12:43:14,503][709034] Updated weights for policy 0, policy_version 80080 (0.0005) [2023-03-09 12:43:17,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9080.6). Total num frames: 41029632. Throughput: 0: 9022.2. Samples: 41021840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:43:17,858][708628] Avg episode reward: [(0, '3410.635')] [2023-03-09 12:43:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000080136_41029632.pth... [2023-03-09 12:43:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000079608_40759296.pth [2023-03-09 12:43:19,024][709034] Updated weights for policy 0, policy_version 80160 (0.0005) [2023-03-09 12:43:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9080.6). Total num frames: 41074688. Throughput: 0: 9061.3. Samples: 41077296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:43:22,858][708628] Avg episode reward: [(0, '2758.043')] [2023-03-09 12:43:23,414][709034] Updated weights for policy 0, policy_version 80240 (0.0005) [2023-03-09 12:43:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9080.6). Total num frames: 41119744. Throughput: 0: 9017.3. Samples: 41103384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:43:27,858][708628] Avg episode reward: [(0, '3582.582')] [2023-03-09 12:43:28,048][709034] Updated weights for policy 0, policy_version 80320 (0.0005) [2023-03-09 12:43:32,276][709034] Updated weights for policy 0, policy_version 80400 (0.0005) [2023-03-09 12:43:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 9108.4). Total num frames: 41168896. Throughput: 0: 9089.2. Samples: 41160108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:43:32,858][708628] Avg episode reward: [(0, '3791.043')] [2023-03-09 12:43:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000080408_41168896.pth... [2023-03-09 12:43:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000079864_40890368.pth [2023-03-09 12:43:32,864][708990] Saving new best policy, reward=3791.043! [2023-03-09 12:43:36,790][709034] Updated weights for policy 0, policy_version 80480 (0.0005) [2023-03-09 12:43:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9108.4). Total num frames: 41213952. Throughput: 0: 9140.2. Samples: 41215092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:43:37,858][708628] Avg episode reward: [(0, '3540.736')] [2023-03-09 12:43:41,297][709034] Updated weights for policy 0, policy_version 80560 (0.0005) [2023-03-09 12:43:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9108.4). Total num frames: 41259008. Throughput: 0: 9182.2. Samples: 41242524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:43:42,858][708628] Avg episode reward: [(0, '3233.795')] [2023-03-09 12:43:45,652][709034] Updated weights for policy 0, policy_version 80640 (0.0005) [2023-03-09 12:43:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9108.4). Total num frames: 41304064. Throughput: 0: 9174.9. Samples: 41297340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:43:47,858][708628] Avg episode reward: [(0, '3251.466')] [2023-03-09 12:43:47,866][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000080680_41308160.pth... [2023-03-09 12:43:47,867][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000080136_41029632.pth [2023-03-09 12:43:50,108][709034] Updated weights for policy 0, policy_version 80720 (0.0005) [2023-03-09 12:43:52,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9108.4). Total num frames: 41349120. Throughput: 0: 9171.5. Samples: 41352252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:43:52,858][708628] Avg episode reward: [(0, '3418.033')] [2023-03-09 12:43:54,721][709034] Updated weights for policy 0, policy_version 80800 (0.0005) [2023-03-09 12:43:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9094.5). Total num frames: 41394176. Throughput: 0: 9156.5. Samples: 41379348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:43:57,858][708628] Avg episode reward: [(0, '3443.565')] [2023-03-09 12:43:59,386][709034] Updated weights for policy 0, policy_version 80880 (0.0006) [2023-03-09 12:44:02,857][708628] Fps is (10 sec: 9011.0, 60 sec: 9147.7, 300 sec: 9094.5). Total num frames: 41439232. Throughput: 0: 9114.4. Samples: 41431988. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:44:02,858][708628] Avg episode reward: [(0, '3212.053')] [2023-03-09 12:44:02,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000080936_41439232.pth... [2023-03-09 12:44:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000080408_41168896.pth [2023-03-09 12:44:03,798][709034] Updated weights for policy 0, policy_version 80960 (0.0005) [2023-03-09 12:44:07,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9108.4). Total num frames: 41488384. Throughput: 0: 9135.5. Samples: 41488396. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:44:07,858][708628] Avg episode reward: [(0, '3637.209')] [2023-03-09 12:44:08,235][709034] Updated weights for policy 0, policy_version 81040 (0.0005) [2023-03-09 12:44:12,829][709034] Updated weights for policy 0, policy_version 81120 (0.0005) [2023-03-09 12:44:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9108.4). Total num frames: 41533440. Throughput: 0: 9172.4. Samples: 41516144. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:44:12,858][708628] Avg episode reward: [(0, '3838.416')] [2023-03-09 12:44:12,858][708990] Saving new best policy, reward=3838.416! [2023-03-09 12:44:17,326][709034] Updated weights for policy 0, policy_version 81200 (0.0005) [2023-03-09 12:44:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9108.4). Total num frames: 41578496. Throughput: 0: 9110.7. Samples: 41570088. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:44:17,858][708628] Avg episode reward: [(0, '3693.100')] [2023-03-09 12:44:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000081208_41578496.pth... [2023-03-09 12:44:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000080680_41308160.pth [2023-03-09 12:44:21,709][709034] Updated weights for policy 0, policy_version 81280 (0.0005) [2023-03-09 12:44:22,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9094.5). Total num frames: 41623552. Throughput: 0: 9118.5. Samples: 41625424. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:44:22,858][708628] Avg episode reward: [(0, '3718.129')] [2023-03-09 12:44:26,284][709034] Updated weights for policy 0, policy_version 81360 (0.0005) [2023-03-09 12:44:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9094.5). Total num frames: 41668608. Throughput: 0: 9092.4. Samples: 41651684. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:44:27,858][708628] Avg episode reward: [(0, '3861.952')] [2023-03-09 12:44:27,858][708990] Saving new best policy, reward=3861.952! [2023-03-09 12:44:30,696][709034] Updated weights for policy 0, policy_version 81440 (0.0005) [2023-03-09 12:44:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9108.4). Total num frames: 41717760. Throughput: 0: 9113.9. Samples: 41707464. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:44:32,858][708628] Avg episode reward: [(0, '3782.518')] [2023-03-09 12:44:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000081480_41717760.pth... [2023-03-09 12:44:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000080936_41439232.pth [2023-03-09 12:44:34,779][709034] Updated weights for policy 0, policy_version 81520 (0.0005) [2023-03-09 12:44:37,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9216.0, 300 sec: 9122.3). Total num frames: 41766912. Throughput: 0: 9246.1. Samples: 41768328. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:44:37,858][708628] Avg episode reward: [(0, '3613.081')] [2023-03-09 12:44:38,867][709034] Updated weights for policy 0, policy_version 81600 (0.0005) [2023-03-09 12:44:42,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9136.2). Total num frames: 41816064. Throughput: 0: 9290.1. Samples: 41797404. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:44:42,858][708628] Avg episode reward: [(0, '3925.214')] [2023-03-09 12:44:42,859][708990] Saving new best policy, reward=3925.214! [2023-03-09 12:44:43,248][709034] Updated weights for policy 0, policy_version 81680 (0.0005) [2023-03-09 12:44:47,672][709034] Updated weights for policy 0, policy_version 81760 (0.0005) [2023-03-09 12:44:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9136.2). Total num frames: 41861120. Throughput: 0: 9353.1. Samples: 41852876. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:44:47,858][708628] Avg episode reward: [(0, '3746.211')] [2023-03-09 12:44:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000081760_41861120.pth... [2023-03-09 12:44:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000081208_41578496.pth [2023-03-09 12:44:52,456][709034] Updated weights for policy 0, policy_version 81840 (0.0005) [2023-03-09 12:44:52,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9216.0, 300 sec: 9122.3). Total num frames: 41902080. Throughput: 0: 9265.9. Samples: 41905360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:44:52,858][708628] Avg episode reward: [(0, '3563.304')] [2023-03-09 12:44:57,039][709034] Updated weights for policy 0, policy_version 81920 (0.0005) [2023-03-09 12:44:57,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9216.0, 300 sec: 9122.3). Total num frames: 41947136. Throughput: 0: 9215.1. Samples: 41930824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:44:57,858][708628] Avg episode reward: [(0, '3642.695')] [2023-03-09 12:45:01,557][709034] Updated weights for policy 0, policy_version 82000 (0.0006) [2023-03-09 12:45:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9108.4). Total num frames: 41992192. Throughput: 0: 9247.4. Samples: 41986220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:45:02,858][708628] Avg episode reward: [(0, '3953.883')] [2023-03-09 12:45:02,880][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000082024_41996288.pth... [2023-03-09 12:45:02,882][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000081480_41717760.pth [2023-03-09 12:45:02,882][708990] Saving new best policy, reward=3953.883! [2023-03-09 12:45:06,112][709034] Updated weights for policy 0, policy_version 82080 (0.0005) [2023-03-09 12:45:07,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9122.3). Total num frames: 42037248. Throughput: 0: 9217.0. Samples: 42040188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:45:07,858][708628] Avg episode reward: [(0, '3491.040')] [2023-03-09 12:45:10,655][709034] Updated weights for policy 0, policy_version 82160 (0.0005) [2023-03-09 12:45:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9122.3). Total num frames: 42082304. Throughput: 0: 9223.8. Samples: 42066756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:45:12,858][708628] Avg episode reward: [(0, '3595.366')] [2023-03-09 12:45:15,216][709034] Updated weights for policy 0, policy_version 82240 (0.0005) [2023-03-09 12:45:17,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9122.3). Total num frames: 42127360. Throughput: 0: 9172.0. Samples: 42120204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:45:17,858][708628] Avg episode reward: [(0, '3517.775')] [2023-03-09 12:45:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000082280_42127360.pth... [2023-03-09 12:45:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000081760_41861120.pth [2023-03-09 12:45:19,843][709034] Updated weights for policy 0, policy_version 82320 (0.0004) [2023-03-09 12:45:22,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9122.3). Total num frames: 42172416. Throughput: 0: 9044.4. Samples: 42175324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:45:22,857][708628] Avg episode reward: [(0, '3253.556')] [2023-03-09 12:45:24,456][709034] Updated weights for policy 0, policy_version 82400 (0.0004) [2023-03-09 12:45:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9122.3). Total num frames: 42217472. Throughput: 0: 8974.9. Samples: 42201272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:45:27,858][708628] Avg episode reward: [(0, '3387.142')] [2023-03-09 12:45:28,826][709034] Updated weights for policy 0, policy_version 82480 (0.0005) [2023-03-09 12:45:32,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9079.5, 300 sec: 9122.3). Total num frames: 42262528. Throughput: 0: 8990.7. Samples: 42257460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:45:32,858][708628] Avg episode reward: [(0, '3376.366')] [2023-03-09 12:45:32,888][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000082552_42266624.pth... [2023-03-09 12:45:32,889][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000082024_41996288.pth [2023-03-09 12:45:33,365][709034] Updated weights for policy 0, policy_version 82560 (0.0004) [2023-03-09 12:45:37,669][709034] Updated weights for policy 0, policy_version 82640 (0.0005) [2023-03-09 12:45:37,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 9136.2). Total num frames: 42311680. Throughput: 0: 9039.9. Samples: 42312156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:45:37,858][708628] Avg episode reward: [(0, '3252.852')] [2023-03-09 12:45:42,104][709034] Updated weights for policy 0, policy_version 82720 (0.0005) [2023-03-09 12:45:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9011.2, 300 sec: 9122.3). Total num frames: 42356736. Throughput: 0: 9101.3. Samples: 42340380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:45:42,858][708628] Avg episode reward: [(0, '2854.686')] [2023-03-09 12:45:46,215][709034] Updated weights for policy 0, policy_version 82800 (0.0005) [2023-03-09 12:45:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9136.2). Total num frames: 42405888. Throughput: 0: 9158.8. Samples: 42398368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:45:47,858][708628] Avg episode reward: [(0, '2755.091')] [2023-03-09 12:45:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000082824_42405888.pth... [2023-03-09 12:45:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000082280_42127360.pth [2023-03-09 12:45:50,746][709034] Updated weights for policy 0, policy_version 82880 (0.0005) [2023-03-09 12:45:52,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9150.0). Total num frames: 42450944. Throughput: 0: 9182.9. Samples: 42453420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:45:52,858][708628] Avg episode reward: [(0, '2102.836')] [2023-03-09 12:45:55,144][709034] Updated weights for policy 0, policy_version 82960 (0.0005) [2023-03-09 12:45:57,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9150.1). Total num frames: 42500096. Throughput: 0: 9248.2. Samples: 42482924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:45:57,858][708628] Avg episode reward: [(0, '1665.751')] [2023-03-09 12:45:59,297][709034] Updated weights for policy 0, policy_version 83040 (0.0005) [2023-03-09 12:46:02,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9163.9). Total num frames: 42549248. Throughput: 0: 9328.8. Samples: 42540000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:46:02,858][708628] Avg episode reward: [(0, '1588.893')] [2023-03-09 12:46:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000083104_42549248.pth... [2023-03-09 12:46:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000082552_42266624.pth [2023-03-09 12:46:03,570][709034] Updated weights for policy 0, policy_version 83120 (0.0004) [2023-03-09 12:46:07,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9163.9). Total num frames: 42594304. Throughput: 0: 9328.3. Samples: 42595100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:46:07,858][708628] Avg episode reward: [(0, '1177.408')] [2023-03-09 12:46:08,090][709034] Updated weights for policy 0, policy_version 83200 (0.0005) [2023-03-09 12:46:12,446][709034] Updated weights for policy 0, policy_version 83280 (0.0005) [2023-03-09 12:46:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9177.8). Total num frames: 42643456. Throughput: 0: 9412.6. Samples: 42624840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:46:12,858][708628] Avg episode reward: [(0, '683.472')] [2023-03-09 12:46:16,745][709034] Updated weights for policy 0, policy_version 83360 (0.0005) [2023-03-09 12:46:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9177.8). Total num frames: 42688512. Throughput: 0: 9398.3. Samples: 42680384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:46:17,858][708628] Avg episode reward: [(0, '765.024')] [2023-03-09 12:46:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000083376_42688512.pth... [2023-03-09 12:46:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000082824_42405888.pth [2023-03-09 12:46:20,795][709034] Updated weights for policy 0, policy_version 83440 (0.0005) [2023-03-09 12:46:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9191.7). Total num frames: 42737664. Throughput: 0: 9500.8. Samples: 42739692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:46:22,858][708628] Avg episode reward: [(0, '1598.807')] [2023-03-09 12:46:25,305][709034] Updated weights for policy 0, policy_version 83520 (0.0005) [2023-03-09 12:46:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9177.8). Total num frames: 42782720. Throughput: 0: 9465.7. Samples: 42766336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:46:27,858][708628] Avg episode reward: [(0, '1836.933')] [2023-03-09 12:46:30,008][709034] Updated weights for policy 0, policy_version 83600 (0.0005) [2023-03-09 12:46:32,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9420.8, 300 sec: 9177.8). Total num frames: 42827776. Throughput: 0: 9359.3. Samples: 42819536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:46:32,858][708628] Avg episode reward: [(0, '1602.800')] [2023-03-09 12:46:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000083648_42827776.pth... [2023-03-09 12:46:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000083104_42549248.pth [2023-03-09 12:46:34,570][709034] Updated weights for policy 0, policy_version 83680 (0.0005) [2023-03-09 12:46:37,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9284.3, 300 sec: 9163.9). Total num frames: 42868736. Throughput: 0: 9287.7. Samples: 42871364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:46:37,858][708628] Avg episode reward: [(0, '2200.266')] [2023-03-09 12:46:39,374][709034] Updated weights for policy 0, policy_version 83760 (0.0005) [2023-03-09 12:46:42,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9284.3, 300 sec: 9163.9). Total num frames: 42913792. Throughput: 0: 9208.4. Samples: 42897304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:46:42,858][708628] Avg episode reward: [(0, '2761.927')] [2023-03-09 12:46:44,011][709034] Updated weights for policy 0, policy_version 83840 (0.0005) [2023-03-09 12:46:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9163.9). Total num frames: 42958848. Throughput: 0: 9133.2. Samples: 42950992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:46:47,858][708628] Avg episode reward: [(0, '2823.044')] [2023-03-09 12:46:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000083904_42958848.pth... [2023-03-09 12:46:47,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000083376_42688512.pth [2023-03-09 12:46:48,535][709034] Updated weights for policy 0, policy_version 83920 (0.0005) [2023-03-09 12:46:52,723][709034] Updated weights for policy 0, policy_version 84000 (0.0005) [2023-03-09 12:46:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9177.8). Total num frames: 43008000. Throughput: 0: 9177.0. Samples: 43008064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:46:52,858][708628] Avg episode reward: [(0, '2431.448')] [2023-03-09 12:46:57,169][709034] Updated weights for policy 0, policy_version 84080 (0.0005) [2023-03-09 12:46:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 43053056. Throughput: 0: 9132.3. Samples: 43035792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:46:57,858][708628] Avg episode reward: [(0, '2970.743')] [2023-03-09 12:47:01,551][709034] Updated weights for policy 0, policy_version 84160 (0.0005) [2023-03-09 12:47:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9177.8). Total num frames: 43098112. Throughput: 0: 9145.0. Samples: 43091908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:47:02,858][708628] Avg episode reward: [(0, '2898.568')] [2023-03-09 12:47:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000084176_43098112.pth... [2023-03-09 12:47:02,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000083648_42827776.pth [2023-03-09 12:47:05,739][709034] Updated weights for policy 0, policy_version 84240 (0.0005) [2023-03-09 12:47:07,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 43147264. Throughput: 0: 9109.2. Samples: 43149608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:47:07,858][708628] Avg episode reward: [(0, '2978.148')] [2023-03-09 12:47:10,195][709034] Updated weights for policy 0, policy_version 84320 (0.0005) [2023-03-09 12:47:12,857][708628] Fps is (10 sec: 9421.0, 60 sec: 9147.7, 300 sec: 9177.8). Total num frames: 43192320. Throughput: 0: 9106.1. Samples: 43176108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:47:12,857][708628] Avg episode reward: [(0, '3151.236')] [2023-03-09 12:47:14,569][709034] Updated weights for policy 0, policy_version 84400 (0.0005) [2023-03-09 12:47:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 43241472. Throughput: 0: 9184.1. Samples: 43232820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:47:17,858][708628] Avg episode reward: [(0, '3440.982')] [2023-03-09 12:47:17,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000084456_43241472.pth... [2023-03-09 12:47:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000083904_42958848.pth [2023-03-09 12:47:19,066][709034] Updated weights for policy 0, policy_version 84480 (0.0005) [2023-03-09 12:47:22,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9216.0, 300 sec: 9205.6). Total num frames: 43290624. Throughput: 0: 9315.5. Samples: 43290564. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:47:22,858][708628] Avg episode reward: [(0, '3097.695')] [2023-03-09 12:47:23,288][709034] Updated weights for policy 0, policy_version 84560 (0.0005) [2023-03-09 12:47:27,606][709034] Updated weights for policy 0, policy_version 84640 (0.0006) [2023-03-09 12:47:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 43335680. Throughput: 0: 9368.7. Samples: 43318896. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:47:27,858][708628] Avg episode reward: [(0, '2790.849')] [2023-03-09 12:47:31,832][709034] Updated weights for policy 0, policy_version 84720 (0.0006) [2023-03-09 12:47:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9205.6). Total num frames: 43384832. Throughput: 0: 9452.8. Samples: 43376368. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:47:32,858][708628] Avg episode reward: [(0, '3024.508')] [2023-03-09 12:47:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000084736_43384832.pth... [2023-03-09 12:47:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000084176_43098112.pth [2023-03-09 12:47:36,108][709034] Updated weights for policy 0, policy_version 84800 (0.0006) [2023-03-09 12:47:37,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9205.6). Total num frames: 43429888. Throughput: 0: 9451.0. Samples: 43433360. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:47:37,858][708628] Avg episode reward: [(0, '3166.854')] [2023-03-09 12:47:40,525][709034] Updated weights for policy 0, policy_version 84880 (0.0005) [2023-03-09 12:47:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9219.5). Total num frames: 43479040. Throughput: 0: 9449.4. Samples: 43461016. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:47:42,858][708628] Avg episode reward: [(0, '3366.647')] [2023-03-09 12:47:44,970][709034] Updated weights for policy 0, policy_version 84960 (0.0005) [2023-03-09 12:47:47,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9247.2). Total num frames: 43528192. Throughput: 0: 9422.3. Samples: 43515912. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:47:47,858][708628] Avg episode reward: [(0, '3588.756')] [2023-03-09 12:47:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000085016_43528192.pth... [2023-03-09 12:47:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000084456_43241472.pth [2023-03-09 12:47:48,915][709034] Updated weights for policy 0, policy_version 85040 (0.0005) [2023-03-09 12:47:52,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9247.2). Total num frames: 43573248. Throughput: 0: 9475.6. Samples: 43576008. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:47:52,858][708628] Avg episode reward: [(0, '3733.286')] [2023-03-09 12:47:53,445][709034] Updated weights for policy 0, policy_version 85120 (0.0005) [2023-03-09 12:47:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9247.2). Total num frames: 43618304. Throughput: 0: 9480.0. Samples: 43602708. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:47:57,858][708628] Avg episode reward: [(0, '3620.383')] [2023-03-09 12:47:57,933][709034] Updated weights for policy 0, policy_version 85200 (0.0005) [2023-03-09 12:48:02,251][709034] Updated weights for policy 0, policy_version 85280 (0.0005) [2023-03-09 12:48:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9247.2). Total num frames: 43667456. Throughput: 0: 9475.3. Samples: 43659208. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:48:02,858][708628] Avg episode reward: [(0, '3290.407')] [2023-03-09 12:48:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000085288_43667456.pth... [2023-03-09 12:48:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000084736_43384832.pth [2023-03-09 12:48:06,788][709034] Updated weights for policy 0, policy_version 85360 (0.0005) [2023-03-09 12:48:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9247.2). Total num frames: 43712512. Throughput: 0: 9376.8. Samples: 43712520. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:48:07,858][708628] Avg episode reward: [(0, '2812.259')] [2023-03-09 12:48:11,603][709034] Updated weights for policy 0, policy_version 85440 (0.0006) [2023-03-09 12:48:12,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9352.5, 300 sec: 9233.4). Total num frames: 43753472. Throughput: 0: 9330.1. Samples: 43738752. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:48:12,858][708628] Avg episode reward: [(0, '2299.574')] [2023-03-09 12:48:16,197][709034] Updated weights for policy 0, policy_version 85520 (0.0005) [2023-03-09 12:48:17,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 43798528. Throughput: 0: 9206.5. Samples: 43790660. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:48:17,858][708628] Avg episode reward: [(0, '2096.940')] [2023-03-09 12:48:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000085544_43798528.pth... [2023-03-09 12:48:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000085016_43528192.pth [2023-03-09 12:48:20,617][709034] Updated weights for policy 0, policy_version 85600 (0.0005) [2023-03-09 12:48:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 43843584. Throughput: 0: 9199.8. Samples: 43847352. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:48:22,858][708628] Avg episode reward: [(0, '2533.840')] [2023-03-09 12:48:25,148][709034] Updated weights for policy 0, policy_version 85680 (0.0005) [2023-03-09 12:48:27,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 43892736. Throughput: 0: 9160.8. Samples: 43873252. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:48:27,858][708628] Avg episode reward: [(0, '2700.386')] [2023-03-09 12:48:29,543][709034] Updated weights for policy 0, policy_version 85760 (0.0005) [2023-03-09 12:48:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 43937792. Throughput: 0: 9189.7. Samples: 43929448. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:48:32,858][708628] Avg episode reward: [(0, '2750.226')] [2023-03-09 12:48:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000085816_43937792.pth... [2023-03-09 12:48:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000085288_43667456.pth [2023-03-09 12:48:34,165][709034] Updated weights for policy 0, policy_version 85840 (0.0005) [2023-03-09 12:48:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 43982848. Throughput: 0: 9055.0. Samples: 43983484. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:48:37,858][708628] Avg episode reward: [(0, '2762.535')] [2023-03-09 12:48:38,618][709034] Updated weights for policy 0, policy_version 85920 (0.0005) [2023-03-09 12:48:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9233.4). Total num frames: 44027904. Throughput: 0: 9073.8. Samples: 44011028. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:48:42,858][708628] Avg episode reward: [(0, '2407.969')] [2023-03-09 12:48:43,137][709034] Updated weights for policy 0, policy_version 86000 (0.0005) [2023-03-09 12:48:47,730][709034] Updated weights for policy 0, policy_version 86080 (0.0005) [2023-03-09 12:48:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9233.4). Total num frames: 44072960. Throughput: 0: 9013.9. Samples: 44064832. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:48:47,858][708628] Avg episode reward: [(0, '2245.739')] [2023-03-09 12:48:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000086080_44072960.pth... [2023-03-09 12:48:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000085544_43798528.pth [2023-03-09 12:48:52,412][709034] Updated weights for policy 0, policy_version 86160 (0.0005) [2023-03-09 12:48:52,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9233.4). Total num frames: 44118016. Throughput: 0: 9008.9. Samples: 44117920. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:48:52,858][708628] Avg episode reward: [(0, '2010.324')] [2023-03-09 12:48:56,883][709034] Updated weights for policy 0, policy_version 86240 (0.0005) [2023-03-09 12:48:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9233.4). Total num frames: 44163072. Throughput: 0: 9035.4. Samples: 44145344. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:48:57,858][708628] Avg episode reward: [(0, '2522.676')] [2023-03-09 12:49:01,363][709034] Updated weights for policy 0, policy_version 86320 (0.0005) [2023-03-09 12:49:02,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8943.0, 300 sec: 9205.6). Total num frames: 44204032. Throughput: 0: 9090.5. Samples: 44199732. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:49:02,858][708628] Avg episode reward: [(0, '2352.209')] [2023-03-09 12:49:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000086336_44204032.pth... [2023-03-09 12:49:02,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000085816_43937792.pth [2023-03-09 12:49:06,147][709034] Updated weights for policy 0, policy_version 86400 (0.0005) [2023-03-09 12:49:07,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8942.9, 300 sec: 9205.6). Total num frames: 44249088. Throughput: 0: 8993.4. Samples: 44252052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:49:07,858][708628] Avg episode reward: [(0, '1755.340')] [2023-03-09 12:49:10,654][709034] Updated weights for policy 0, policy_version 86480 (0.0005) [2023-03-09 12:49:12,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9011.2, 300 sec: 9205.6). Total num frames: 44294144. Throughput: 0: 9003.3. Samples: 44278400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:49:12,858][708628] Avg episode reward: [(0, '2240.186')] [2023-03-09 12:49:15,020][709034] Updated weights for policy 0, policy_version 86560 (0.0005) [2023-03-09 12:49:17,857][708628] Fps is (10 sec: 9420.6, 60 sec: 9079.5, 300 sec: 9219.5). Total num frames: 44343296. Throughput: 0: 9007.3. Samples: 44334776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:49:17,858][708628] Avg episode reward: [(0, '2234.709')] [2023-03-09 12:49:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000086608_44343296.pth... [2023-03-09 12:49:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000086080_44072960.pth [2023-03-09 12:49:19,562][709034] Updated weights for policy 0, policy_version 86640 (0.0005) [2023-03-09 12:49:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9219.5). Total num frames: 44388352. Throughput: 0: 8998.5. Samples: 44388416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:49:22,858][708628] Avg episode reward: [(0, '2271.166')] [2023-03-09 12:49:24,125][709034] Updated weights for policy 0, policy_version 86720 (0.0005) [2023-03-09 12:49:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9205.6). Total num frames: 44433408. Throughput: 0: 8994.8. Samples: 44415792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:49:27,858][708628] Avg episode reward: [(0, '1681.498')] [2023-03-09 12:49:28,590][709034] Updated weights for policy 0, policy_version 86800 (0.0006) [2023-03-09 12:49:32,827][709034] Updated weights for policy 0, policy_version 86880 (0.0005) [2023-03-09 12:49:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9205.6). Total num frames: 44482560. Throughput: 0: 9030.3. Samples: 44471196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:49:32,858][708628] Avg episode reward: [(0, '1498.705')] [2023-03-09 12:49:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000086880_44482560.pth... [2023-03-09 12:49:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000086336_44204032.pth [2023-03-09 12:49:37,015][709034] Updated weights for policy 0, policy_version 86960 (0.0004) [2023-03-09 12:49:37,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 44531712. Throughput: 0: 9194.9. Samples: 44531692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:49:37,858][708628] Avg episode reward: [(0, '1559.620')] [2023-03-09 12:49:41,260][709034] Updated weights for policy 0, policy_version 87040 (0.0004) [2023-03-09 12:49:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 44576768. Throughput: 0: 9216.9. Samples: 44560104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:49:42,858][708628] Avg episode reward: [(0, '1363.751')] [2023-03-09 12:49:45,455][709034] Updated weights for policy 0, policy_version 87120 (0.0004) [2023-03-09 12:49:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 44625920. Throughput: 0: 9286.7. Samples: 44617636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:49:47,858][708628] Avg episode reward: [(0, '2003.977')] [2023-03-09 12:49:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000087160_44625920.pth... [2023-03-09 12:49:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000086608_44343296.pth [2023-03-09 12:49:50,015][709034] Updated weights for policy 0, policy_version 87200 (0.0006) [2023-03-09 12:49:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 44670976. Throughput: 0: 9315.7. Samples: 44671260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:49:52,858][708628] Avg episode reward: [(0, '2122.422')] [2023-03-09 12:49:54,463][709034] Updated weights for policy 0, policy_version 87280 (0.0005) [2023-03-09 12:49:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 44716032. Throughput: 0: 9362.5. Samples: 44699712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:49:57,858][708628] Avg episode reward: [(0, '1619.400')] [2023-03-09 12:49:58,915][709034] Updated weights for policy 0, policy_version 87360 (0.0005) [2023-03-09 12:50:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 44761088. Throughput: 0: 9355.3. Samples: 44755764. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:50:02,858][708628] Avg episode reward: [(0, '2283.525')] [2023-03-09 12:50:02,873][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000087432_44765184.pth... [2023-03-09 12:50:02,874][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000086880_44482560.pth [2023-03-09 12:50:03,209][709034] Updated weights for policy 0, policy_version 87440 (0.0005) [2023-03-09 12:50:07,704][709034] Updated weights for policy 0, policy_version 87520 (0.0005) [2023-03-09 12:50:07,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9247.2). Total num frames: 44810240. Throughput: 0: 9376.5. Samples: 44810360. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:50:07,858][708628] Avg episode reward: [(0, '1935.388')] [2023-03-09 12:50:12,268][709034] Updated weights for policy 0, policy_version 87600 (0.0005) [2023-03-09 12:50:12,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9247.2). Total num frames: 44855296. Throughput: 0: 9396.8. Samples: 44838648. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:50:12,858][708628] Avg episode reward: [(0, '1571.010')] [2023-03-09 12:50:16,465][709034] Updated weights for policy 0, policy_version 87680 (0.0005) [2023-03-09 12:50:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 44904448. Throughput: 0: 9434.5. Samples: 44895748. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:50:17,858][708628] Avg episode reward: [(0, '2136.424')] [2023-03-09 12:50:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000087704_44904448.pth... [2023-03-09 12:50:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000087160_44625920.pth [2023-03-09 12:50:21,033][709034] Updated weights for policy 0, policy_version 87760 (0.0005) [2023-03-09 12:50:22,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 44949504. Throughput: 0: 9300.9. Samples: 44950232. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:50:22,858][708628] Avg episode reward: [(0, '2621.632')] [2023-03-09 12:50:25,176][709034] Updated weights for policy 0, policy_version 87840 (0.0005) [2023-03-09 12:50:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 44994560. Throughput: 0: 9310.8. Samples: 44979088. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:50:27,858][708628] Avg episode reward: [(0, '3122.241')] [2023-03-09 12:50:29,718][709034] Updated weights for policy 0, policy_version 87920 (0.0005) [2023-03-09 12:50:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 45043712. Throughput: 0: 9258.2. Samples: 45034256. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:50:32,858][708628] Avg episode reward: [(0, '2974.556')] [2023-03-09 12:50:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000087976_45043712.pth... [2023-03-09 12:50:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000087432_44765184.pth [2023-03-09 12:50:34,038][709034] Updated weights for policy 0, policy_version 88000 (0.0005) [2023-03-09 12:50:37,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 45088768. Throughput: 0: 9295.1. Samples: 45089540. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:50:37,858][708628] Avg episode reward: [(0, '3511.413')] [2023-03-09 12:50:38,594][709034] Updated weights for policy 0, policy_version 88080 (0.0005) [2023-03-09 12:50:42,848][709034] Updated weights for policy 0, policy_version 88160 (0.0004) [2023-03-09 12:50:42,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 45137920. Throughput: 0: 9298.4. Samples: 45118144. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:50:42,858][708628] Avg episode reward: [(0, '3158.354')] [2023-03-09 12:50:47,472][709034] Updated weights for policy 0, policy_version 88240 (0.0005) [2023-03-09 12:50:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 45178880. Throughput: 0: 9262.6. Samples: 45172580. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:50:47,858][708628] Avg episode reward: [(0, '3242.333')] [2023-03-09 12:50:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000088240_45178880.pth... [2023-03-09 12:50:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000087704_44904448.pth [2023-03-09 12:50:51,929][709034] Updated weights for policy 0, policy_version 88320 (0.0005) [2023-03-09 12:50:52,857][708628] Fps is (10 sec: 8601.8, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 45223936. Throughput: 0: 9269.8. Samples: 45227500. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:50:52,874][708628] Avg episode reward: [(0, '3201.003')] [2023-03-09 12:50:56,295][709034] Updated weights for policy 0, policy_version 88400 (0.0005) [2023-03-09 12:50:57,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 45273088. Throughput: 0: 9263.5. Samples: 45255504. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:50:57,858][708628] Avg episode reward: [(0, '3233.303')] [2023-03-09 12:51:00,936][709034] Updated weights for policy 0, policy_version 88480 (0.0005) [2023-03-09 12:51:02,857][708628] Fps is (10 sec: 9420.6, 60 sec: 9284.2, 300 sec: 9233.4). Total num frames: 45318144. Throughput: 0: 9202.7. Samples: 45309868. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:51:02,858][708628] Avg episode reward: [(0, '3497.337')] [2023-03-09 12:51:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000088512_45318144.pth... [2023-03-09 12:51:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000087976_45043712.pth [2023-03-09 12:51:05,116][709034] Updated weights for policy 0, policy_version 88560 (0.0005) [2023-03-09 12:51:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 45367296. Throughput: 0: 9269.7. Samples: 45367368. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:51:07,858][708628] Avg episode reward: [(0, '2391.856')] [2023-03-09 12:51:09,512][709034] Updated weights for policy 0, policy_version 88640 (0.0004) [2023-03-09 12:51:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 45412352. Throughput: 0: 9263.7. Samples: 45395956. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:51:12,858][708628] Avg episode reward: [(0, '2961.110')] [2023-03-09 12:51:13,751][709034] Updated weights for policy 0, policy_version 88720 (0.0005) [2023-03-09 12:51:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 45461504. Throughput: 0: 9299.5. Samples: 45452732. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:51:17,858][708628] Avg episode reward: [(0, '3374.462')] [2023-03-09 12:51:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000088792_45461504.pth... [2023-03-09 12:51:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000088240_45178880.pth [2023-03-09 12:51:18,214][709034] Updated weights for policy 0, policy_version 88800 (0.0005) [2023-03-09 12:51:22,661][709034] Updated weights for policy 0, policy_version 88880 (0.0005) [2023-03-09 12:51:22,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 45506560. Throughput: 0: 9283.6. Samples: 45507304. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:51:22,858][708628] Avg episode reward: [(0, '3407.891')] [2023-03-09 12:51:26,898][709034] Updated weights for policy 0, policy_version 88960 (0.0005) [2023-03-09 12:51:27,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9247.2). Total num frames: 45555712. Throughput: 0: 9274.4. Samples: 45535492. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:51:27,858][708628] Avg episode reward: [(0, '4018.597')] [2023-03-09 12:51:27,858][708990] Saving new best policy, reward=4018.597! [2023-03-09 12:51:31,099][709034] Updated weights for policy 0, policy_version 89040 (0.0005) [2023-03-09 12:51:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 45600768. Throughput: 0: 9381.5. Samples: 45594748. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:51:32,858][708628] Avg episode reward: [(0, '3809.232')] [2023-03-09 12:51:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000089064_45600768.pth... [2023-03-09 12:51:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000088512_45318144.pth [2023-03-09 12:51:35,546][709034] Updated weights for policy 0, policy_version 89120 (0.0005) [2023-03-09 12:51:37,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 45649920. Throughput: 0: 9388.7. Samples: 45649992. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:51:37,858][708628] Avg episode reward: [(0, '3132.175')] [2023-03-09 12:51:40,062][709034] Updated weights for policy 0, policy_version 89200 (0.0005) [2023-03-09 12:51:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 45694976. Throughput: 0: 9355.2. Samples: 45676488. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 12:51:42,858][708628] Avg episode reward: [(0, '3748.090')] [2023-03-09 12:51:44,350][709034] Updated weights for policy 0, policy_version 89280 (0.0005) [2023-03-09 12:51:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 45740032. Throughput: 0: 9406.6. Samples: 45733164. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:51:47,858][708628] Avg episode reward: [(0, '3477.924')] [2023-03-09 12:51:47,907][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000089344_45744128.pth... [2023-03-09 12:51:47,909][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000088792_45461504.pth [2023-03-09 12:51:48,642][709034] Updated weights for policy 0, policy_version 89360 (0.0005) [2023-03-09 12:51:52,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 45789184. Throughput: 0: 9395.6. Samples: 45790168. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:51:52,858][708628] Avg episode reward: [(0, '3869.040')] [2023-03-09 12:51:53,087][709034] Updated weights for policy 0, policy_version 89440 (0.0005) [2023-03-09 12:51:57,592][709034] Updated weights for policy 0, policy_version 89520 (0.0005) [2023-03-09 12:51:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 45834240. Throughput: 0: 9390.6. Samples: 45818532. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:51:57,858][708628] Avg episode reward: [(0, '3618.975')] [2023-03-09 12:52:01,822][709034] Updated weights for policy 0, policy_version 89600 (0.0005) [2023-03-09 12:52:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 45883392. Throughput: 0: 9386.0. Samples: 45875104. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:52:02,858][708628] Avg episode reward: [(0, '2665.289')] [2023-03-09 12:52:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000089616_45883392.pth... [2023-03-09 12:52:02,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000089064_45600768.pth [2023-03-09 12:52:06,153][709034] Updated weights for policy 0, policy_version 89680 (0.0005) [2023-03-09 12:52:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 45928448. Throughput: 0: 9366.0. Samples: 45928776. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:52:07,858][708628] Avg episode reward: [(0, '3013.783')] [2023-03-09 12:52:10,714][709034] Updated weights for policy 0, policy_version 89760 (0.0005) [2023-03-09 12:52:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 45973504. Throughput: 0: 9370.9. Samples: 45957184. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:52:12,858][708628] Avg episode reward: [(0, '3242.439')] [2023-03-09 12:52:15,290][709034] Updated weights for policy 0, policy_version 89840 (0.0005) [2023-03-09 12:52:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9247.2). Total num frames: 46018560. Throughput: 0: 9267.4. Samples: 46011780. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:52:17,858][708628] Avg episode reward: [(0, '3440.035')] [2023-03-09 12:52:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000089880_46018560.pth... [2023-03-09 12:52:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000089344_45744128.pth [2023-03-09 12:52:19,681][709034] Updated weights for policy 0, policy_version 89920 (0.0004) [2023-03-09 12:52:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 46067712. Throughput: 0: 9285.0. Samples: 46067816. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:52:22,858][708628] Avg episode reward: [(0, '3128.850')] [2023-03-09 12:52:23,931][709034] Updated weights for policy 0, policy_version 90000 (0.0005) [2023-03-09 12:52:27,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 46116864. Throughput: 0: 9332.4. Samples: 46096448. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:52:27,867][708628] Avg episode reward: [(0, '3393.771')] [2023-03-09 12:52:28,198][709034] Updated weights for policy 0, policy_version 90080 (0.0005) [2023-03-09 12:52:32,668][709034] Updated weights for policy 0, policy_version 90160 (0.0004) [2023-03-09 12:52:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 46161920. Throughput: 0: 9346.2. Samples: 46153744. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:52:32,868][708628] Avg episode reward: [(0, '2893.753')] [2023-03-09 12:52:32,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000090160_46161920.pth... [2023-03-09 12:52:32,874][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000089616_45883392.pth [2023-03-09 12:52:37,092][709034] Updated weights for policy 0, policy_version 90240 (0.0005) [2023-03-09 12:52:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9247.2). Total num frames: 46206976. Throughput: 0: 9303.1. Samples: 46208808. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 12:52:37,868][708628] Avg episode reward: [(0, '2599.472')] [2023-03-09 12:52:41,581][709034] Updated weights for policy 0, policy_version 90320 (0.0004) [2023-03-09 12:52:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 46252032. Throughput: 0: 9269.3. Samples: 46235648. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:52:42,868][708628] Avg episode reward: [(0, '2973.448')] [2023-03-09 12:52:46,161][709034] Updated weights for policy 0, policy_version 90400 (0.0004) [2023-03-09 12:52:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 46297088. Throughput: 0: 9221.2. Samples: 46290060. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:52:47,868][708628] Avg episode reward: [(0, '2416.952')] [2023-03-09 12:52:47,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000090424_46297088.pth... [2023-03-09 12:52:47,875][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000089880_46018560.pth [2023-03-09 12:52:50,540][709034] Updated weights for policy 0, policy_version 90480 (0.0005) [2023-03-09 12:52:52,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9247.2). Total num frames: 46346240. Throughput: 0: 9278.4. Samples: 46346304. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:52:52,868][708628] Avg episode reward: [(0, '2950.209')] [2023-03-09 12:52:54,919][709034] Updated weights for policy 0, policy_version 90560 (0.0005) [2023-03-09 12:52:57,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 46391296. Throughput: 0: 9281.6. Samples: 46374856. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:52:57,868][708628] Avg episode reward: [(0, '3515.774')] [2023-03-09 12:52:59,557][709034] Updated weights for policy 0, policy_version 90640 (0.0005) [2023-03-09 12:53:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 46436352. Throughput: 0: 9255.6. Samples: 46428280. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:53:02,858][708628] Avg episode reward: [(0, '3364.580')] [2023-03-09 12:53:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000090696_46436352.pth... [2023-03-09 12:53:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000090160_46161920.pth [2023-03-09 12:53:04,083][709034] Updated weights for policy 0, policy_version 90720 (0.0004) [2023-03-09 12:53:07,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 46481408. Throughput: 0: 9223.6. Samples: 46482876. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:53:07,858][708628] Avg episode reward: [(0, '3360.100')] [2023-03-09 12:53:08,512][709034] Updated weights for policy 0, policy_version 90800 (0.0005) [2023-03-09 12:53:12,652][709034] Updated weights for policy 0, policy_version 90880 (0.0005) [2023-03-09 12:53:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 46530560. Throughput: 0: 9231.8. Samples: 46511880. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:53:12,858][708628] Avg episode reward: [(0, '3478.477')] [2023-03-09 12:53:17,078][709034] Updated weights for policy 0, policy_version 90960 (0.0006) [2023-03-09 12:53:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 46575616. Throughput: 0: 9217.1. Samples: 46568512. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:53:17,858][708628] Avg episode reward: [(0, '3422.506')] [2023-03-09 12:53:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000090968_46575616.pth... [2023-03-09 12:53:17,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000090424_46297088.pth [2023-03-09 12:53:21,643][709034] Updated weights for policy 0, policy_version 91040 (0.0005) [2023-03-09 12:53:22,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 46620672. Throughput: 0: 9238.9. Samples: 46624556. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:53:22,858][708628] Avg episode reward: [(0, '3183.527')] [2023-03-09 12:53:25,806][709034] Updated weights for policy 0, policy_version 91120 (0.0004) [2023-03-09 12:53:27,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 46669824. Throughput: 0: 9283.8. Samples: 46653420. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:53:27,858][708628] Avg episode reward: [(0, '3545.083')] [2023-03-09 12:53:30,447][709034] Updated weights for policy 0, policy_version 91200 (0.0005) [2023-03-09 12:53:32,857][708628] Fps is (10 sec: 9420.6, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 46714880. Throughput: 0: 9250.2. Samples: 46706320. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 12:53:32,858][708628] Avg episode reward: [(0, '3837.767')] [2023-03-09 12:53:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000091240_46714880.pth... [2023-03-09 12:53:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000090696_46436352.pth [2023-03-09 12:53:35,046][709034] Updated weights for policy 0, policy_version 91280 (0.0005) [2023-03-09 12:53:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 46759936. Throughput: 0: 9192.1. Samples: 46759948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:53:37,858][708628] Avg episode reward: [(0, '3394.617')] [2023-03-09 12:53:39,593][709034] Updated weights for policy 0, policy_version 91360 (0.0005) [2023-03-09 12:53:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 46804992. Throughput: 0: 9148.8. Samples: 46786552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:53:42,858][708628] Avg episode reward: [(0, '3733.075')] [2023-03-09 12:53:44,105][709034] Updated weights for policy 0, policy_version 91440 (0.0005) [2023-03-09 12:53:47,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 46850048. Throughput: 0: 9192.2. Samples: 46841928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:53:47,858][708628] Avg episode reward: [(0, '3217.967')] [2023-03-09 12:53:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000091504_46850048.pth... [2023-03-09 12:53:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000090968_46575616.pth [2023-03-09 12:53:48,428][709034] Updated weights for policy 0, policy_version 91520 (0.0005) [2023-03-09 12:53:52,688][709034] Updated weights for policy 0, policy_version 91600 (0.0005) [2023-03-09 12:53:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 46899200. Throughput: 0: 9259.2. Samples: 46899540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:53:52,858][708628] Avg episode reward: [(0, '2867.226')] [2023-03-09 12:53:57,106][709034] Updated weights for policy 0, policy_version 91680 (0.0005) [2023-03-09 12:53:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 46944256. Throughput: 0: 9244.3. Samples: 46927872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:53:57,858][708628] Avg episode reward: [(0, '3351.282')] [2023-03-09 12:54:01,501][709034] Updated weights for policy 0, policy_version 91760 (0.0004) [2023-03-09 12:54:02,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 46993408. Throughput: 0: 9231.2. Samples: 46983916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:54:02,858][708628] Avg episode reward: [(0, '3071.242')] [2023-03-09 12:54:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000091784_46993408.pth... [2023-03-09 12:54:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000091240_46714880.pth [2023-03-09 12:54:05,667][709034] Updated weights for policy 0, policy_version 91840 (0.0005) [2023-03-09 12:54:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 47038464. Throughput: 0: 9283.3. Samples: 47042304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:54:07,858][708628] Avg episode reward: [(0, '3719.598')] [2023-03-09 12:54:10,094][709034] Updated weights for policy 0, policy_version 91920 (0.0005) [2023-03-09 12:54:12,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 47087616. Throughput: 0: 9244.0. Samples: 47069400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:54:12,858][708628] Avg episode reward: [(0, '3797.525')] [2023-03-09 12:54:14,286][709034] Updated weights for policy 0, policy_version 92000 (0.0005) [2023-03-09 12:54:17,857][708628] Fps is (10 sec: 9830.5, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 47136768. Throughput: 0: 9377.1. Samples: 47128288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:54:17,858][708628] Avg episode reward: [(0, '3836.203')] [2023-03-09 12:54:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000092064_47136768.pth... [2023-03-09 12:54:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000091504_46850048.pth [2023-03-09 12:54:18,439][709034] Updated weights for policy 0, policy_version 92080 (0.0005) [2023-03-09 12:54:22,801][709034] Updated weights for policy 0, policy_version 92160 (0.0005) [2023-03-09 12:54:22,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 47185920. Throughput: 0: 9465.8. Samples: 47185908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:54:22,858][708628] Avg episode reward: [(0, '4151.362')] [2023-03-09 12:54:22,858][708990] Saving new best policy, reward=4151.362! [2023-03-09 12:54:27,109][709034] Updated weights for policy 0, policy_version 92240 (0.0005) [2023-03-09 12:54:27,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 47230976. Throughput: 0: 9502.0. Samples: 47214140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:54:27,858][708628] Avg episode reward: [(0, '3555.757')] [2023-03-09 12:54:31,216][709034] Updated weights for policy 0, policy_version 92320 (0.0005) [2023-03-09 12:54:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 47280128. Throughput: 0: 9585.2. Samples: 47273264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:54:32,858][708628] Avg episode reward: [(0, '3601.525')] [2023-03-09 12:54:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000092344_47280128.pth... [2023-03-09 12:54:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000091784_46993408.pth [2023-03-09 12:54:35,670][709034] Updated weights for policy 0, policy_version 92400 (0.0005) [2023-03-09 12:54:37,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9330.6). Total num frames: 47329280. Throughput: 0: 9545.0. Samples: 47329064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:54:37,858][708628] Avg episode reward: [(0, '3738.120')] [2023-03-09 12:54:40,100][709034] Updated weights for policy 0, policy_version 92480 (0.0005) [2023-03-09 12:54:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9316.7). Total num frames: 47374336. Throughput: 0: 9513.6. Samples: 47355984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:54:42,858][708628] Avg episode reward: [(0, '3258.967')] [2023-03-09 12:54:44,532][709034] Updated weights for policy 0, policy_version 92560 (0.0005) [2023-03-09 12:54:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9316.7). Total num frames: 47419392. Throughput: 0: 9494.6. Samples: 47411172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:54:47,858][708628] Avg episode reward: [(0, '3347.495')] [2023-03-09 12:54:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000092616_47419392.pth... [2023-03-09 12:54:47,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000092064_47136768.pth [2023-03-09 12:54:49,013][709034] Updated weights for policy 0, policy_version 92640 (0.0005) [2023-03-09 12:54:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 47464448. Throughput: 0: 9448.8. Samples: 47467500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:54:52,858][708628] Avg episode reward: [(0, '2620.808')] [2023-03-09 12:54:53,334][709034] Updated weights for policy 0, policy_version 92720 (0.0005) [2023-03-09 12:54:57,653][709034] Updated weights for policy 0, policy_version 92800 (0.0005) [2023-03-09 12:54:57,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9330.5). Total num frames: 47513600. Throughput: 0: 9478.9. Samples: 47495952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:54:57,858][708628] Avg episode reward: [(0, '2873.623')] [2023-03-09 12:55:02,053][709034] Updated weights for policy 0, policy_version 92880 (0.0006) [2023-03-09 12:55:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 47558656. Throughput: 0: 9387.5. Samples: 47550728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:55:02,858][708628] Avg episode reward: [(0, '2870.113')] [2023-03-09 12:55:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000092888_47558656.pth... [2023-03-09 12:55:02,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000092344_47280128.pth [2023-03-09 12:55:06,476][709034] Updated weights for policy 0, policy_version 92960 (0.0005) [2023-03-09 12:55:07,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9330.6). Total num frames: 47607808. Throughput: 0: 9374.5. Samples: 47607760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:55:07,858][708628] Avg episode reward: [(0, '3141.124')] [2023-03-09 12:55:10,787][709034] Updated weights for policy 0, policy_version 93040 (0.0005) [2023-03-09 12:55:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 47652864. Throughput: 0: 9385.0. Samples: 47636464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:55:12,858][708628] Avg episode reward: [(0, '3383.216')] [2023-03-09 12:55:14,997][709034] Updated weights for policy 0, policy_version 93120 (0.0004) [2023-03-09 12:55:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 47697920. Throughput: 0: 9337.5. Samples: 47693452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:55:17,858][708628] Avg episode reward: [(0, '3522.239')] [2023-03-09 12:55:17,868][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000093168_47702016.pth... [2023-03-09 12:55:17,870][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000092616_47419392.pth [2023-03-09 12:55:19,538][709034] Updated weights for policy 0, policy_version 93200 (0.0005) [2023-03-09 12:55:22,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 47747072. Throughput: 0: 9321.9. Samples: 47748552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:55:22,858][708628] Avg episode reward: [(0, '3423.524')] [2023-03-09 12:55:23,965][709034] Updated weights for policy 0, policy_version 93280 (0.0005) [2023-03-09 12:55:27,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.6, 300 sec: 9316.7). Total num frames: 47792128. Throughput: 0: 9329.9. Samples: 47775828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:55:27,858][708628] Avg episode reward: [(0, '2766.524')] [2023-03-09 12:55:28,413][709034] Updated weights for policy 0, policy_version 93360 (0.0005) [2023-03-09 12:55:32,853][709034] Updated weights for policy 0, policy_version 93440 (0.0004) [2023-03-09 12:55:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 47841280. Throughput: 0: 9307.5. Samples: 47830012. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:55:32,858][708628] Avg episode reward: [(0, '3315.356')] [2023-03-09 12:55:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000093440_47841280.pth... [2023-03-09 12:55:32,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000092888_47558656.pth [2023-03-09 12:55:37,054][709034] Updated weights for policy 0, policy_version 93520 (0.0005) [2023-03-09 12:55:37,857][708628] Fps is (10 sec: 9830.2, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 47890432. Throughput: 0: 9396.9. Samples: 47890360. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:55:37,858][708628] Avg episode reward: [(0, '3472.904')] [2023-03-09 12:55:41,406][709034] Updated weights for policy 0, policy_version 93600 (0.0005) [2023-03-09 12:55:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 47935488. Throughput: 0: 9367.5. Samples: 47917488. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:55:42,858][708628] Avg episode reward: [(0, '3735.478')] [2023-03-09 12:55:45,895][709034] Updated weights for policy 0, policy_version 93680 (0.0005) [2023-03-09 12:55:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 47980544. Throughput: 0: 9381.8. Samples: 47972908. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:55:47,858][708628] Avg episode reward: [(0, '3615.394')] [2023-03-09 12:55:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000093712_47980544.pth... [2023-03-09 12:55:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000093168_47702016.pth [2023-03-09 12:55:50,229][709034] Updated weights for policy 0, policy_version 93760 (0.0005) [2023-03-09 12:55:52,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 48025600. Throughput: 0: 9335.8. Samples: 48027872. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:55:52,858][708628] Avg episode reward: [(0, '3223.902')] [2023-03-09 12:55:54,764][709034] Updated weights for policy 0, policy_version 93840 (0.0005) [2023-03-09 12:55:57,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 48074752. Throughput: 0: 9329.5. Samples: 48056292. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:55:57,871][708628] Avg episode reward: [(0, '3280.318')] [2023-03-09 12:55:58,751][709034] Updated weights for policy 0, policy_version 93920 (0.0005) [2023-03-09 12:56:02,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 48123904. Throughput: 0: 9385.0. Samples: 48115776. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:56:02,868][708628] Avg episode reward: [(0, '3314.467')] [2023-03-09 12:56:02,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000093992_48123904.pth... [2023-03-09 12:56:02,874][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000093440_47841280.pth [2023-03-09 12:56:02,992][709034] Updated weights for policy 0, policy_version 94000 (0.0005) [2023-03-09 12:56:07,397][709034] Updated weights for policy 0, policy_version 94080 (0.0005) [2023-03-09 12:56:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 48168960. Throughput: 0: 9430.9. Samples: 48172940. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:56:07,868][708628] Avg episode reward: [(0, '3307.784')] [2023-03-09 12:56:12,028][709034] Updated weights for policy 0, policy_version 94160 (0.0005) [2023-03-09 12:56:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 48214016. Throughput: 0: 9375.0. Samples: 48197704. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:56:12,858][708628] Avg episode reward: [(0, '3261.452')] [2023-03-09 12:56:16,379][709034] Updated weights for policy 0, policy_version 94240 (0.0005) [2023-03-09 12:56:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 48263168. Throughput: 0: 9439.9. Samples: 48254808. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:56:17,858][708628] Avg episode reward: [(0, '2945.395')] [2023-03-09 12:56:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000094264_48263168.pth... [2023-03-09 12:56:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000093712_47980544.pth [2023-03-09 12:56:20,809][709034] Updated weights for policy 0, policy_version 94320 (0.0006) [2023-03-09 12:56:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 48308224. Throughput: 0: 9329.7. Samples: 48310196. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 12:56:22,858][708628] Avg episode reward: [(0, '3079.817')] [2023-03-09 12:56:25,265][709034] Updated weights for policy 0, policy_version 94400 (0.0005) [2023-03-09 12:56:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 48353280. Throughput: 0: 9321.6. Samples: 48336960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:56:27,858][708628] Avg episode reward: [(0, '2624.874')] [2023-03-09 12:56:29,814][709034] Updated weights for policy 0, policy_version 94480 (0.0005) [2023-03-09 12:56:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 48398336. Throughput: 0: 9273.3. Samples: 48390208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:56:32,858][708628] Avg episode reward: [(0, '2858.706')] [2023-03-09 12:56:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000094528_48398336.pth... [2023-03-09 12:56:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000093992_48123904.pth [2023-03-09 12:56:34,337][709034] Updated weights for policy 0, policy_version 94560 (0.0005) [2023-03-09 12:56:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 48443392. Throughput: 0: 9269.6. Samples: 48445004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:56:37,858][708628] Avg episode reward: [(0, '3023.793')] [2023-03-09 12:56:38,874][709034] Updated weights for policy 0, policy_version 94640 (0.0005) [2023-03-09 12:56:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 48492544. Throughput: 0: 9315.1. Samples: 48475472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:56:42,858][708628] Avg episode reward: [(0, '2795.542')] [2023-03-09 12:56:43,042][709034] Updated weights for policy 0, policy_version 94720 (0.0005) [2023-03-09 12:56:47,328][709034] Updated weights for policy 0, policy_version 94800 (0.0005) [2023-03-09 12:56:47,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 48541696. Throughput: 0: 9274.9. Samples: 48533148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:56:47,858][708628] Avg episode reward: [(0, '2254.270')] [2023-03-09 12:56:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000094808_48541696.pth... [2023-03-09 12:56:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000094264_48263168.pth [2023-03-09 12:56:51,845][709034] Updated weights for policy 0, policy_version 94880 (0.0005) [2023-03-09 12:56:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.6, 300 sec: 9330.6). Total num frames: 48586752. Throughput: 0: 9197.3. Samples: 48586816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:56:52,858][708628] Avg episode reward: [(0, '2649.580')] [2023-03-09 12:56:56,135][709034] Updated weights for policy 0, policy_version 94960 (0.0005) [2023-03-09 12:56:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 48635904. Throughput: 0: 9284.1. Samples: 48615488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:56:57,858][708628] Avg episode reward: [(0, '2938.201')] [2023-03-09 12:57:00,250][709034] Updated weights for policy 0, policy_version 95040 (0.0005) [2023-03-09 12:57:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 48680960. Throughput: 0: 9337.4. Samples: 48674992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:57:02,858][708628] Avg episode reward: [(0, '2788.788')] [2023-03-09 12:57:02,859][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000095080_48680960.pth... [2023-03-09 12:57:02,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000094528_48398336.pth [2023-03-09 12:57:04,602][709034] Updated weights for policy 0, policy_version 95120 (0.0005) [2023-03-09 12:57:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 48730112. Throughput: 0: 9369.2. Samples: 48731808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:57:07,858][708628] Avg episode reward: [(0, '2541.899')] [2023-03-09 12:57:08,875][709034] Updated weights for policy 0, policy_version 95200 (0.0005) [2023-03-09 12:57:12,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 48779264. Throughput: 0: 9398.7. Samples: 48759900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:57:12,858][708628] Avg episode reward: [(0, '1950.852')] [2023-03-09 12:57:13,259][709034] Updated weights for policy 0, policy_version 95280 (0.0005) [2023-03-09 12:57:17,561][709034] Updated weights for policy 0, policy_version 95360 (0.0005) [2023-03-09 12:57:17,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.6, 300 sec: 9344.4). Total num frames: 48824320. Throughput: 0: 9466.5. Samples: 48816200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:57:17,858][708628] Avg episode reward: [(0, '2068.886')] [2023-03-09 12:57:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000095360_48824320.pth... [2023-03-09 12:57:17,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000094808_48541696.pth [2023-03-09 12:57:21,999][709034] Updated weights for policy 0, policy_version 95440 (0.0005) [2023-03-09 12:57:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 48869376. Throughput: 0: 9501.3. Samples: 48872560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:57:22,858][708628] Avg episode reward: [(0, '1937.293')] [2023-03-09 12:57:26,533][709034] Updated weights for policy 0, policy_version 95520 (0.0005) [2023-03-09 12:57:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 48918528. Throughput: 0: 9399.6. Samples: 48898452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:57:27,858][708628] Avg episode reward: [(0, '1924.448')] [2023-03-09 12:57:30,956][709034] Updated weights for policy 0, policy_version 95600 (0.0005) [2023-03-09 12:57:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 48963584. Throughput: 0: 9375.0. Samples: 48955024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:57:32,858][708628] Avg episode reward: [(0, '2925.864')] [2023-03-09 12:57:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000095632_48963584.pth... [2023-03-09 12:57:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000095080_48680960.pth [2023-03-09 12:57:35,237][709034] Updated weights for policy 0, policy_version 95680 (0.0005) [2023-03-09 12:57:37,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 49012736. Throughput: 0: 9488.3. Samples: 49013788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:57:37,858][708628] Avg episode reward: [(0, '2313.332')] [2023-03-09 12:57:39,472][709034] Updated weights for policy 0, policy_version 95760 (0.0005) [2023-03-09 12:57:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 49057792. Throughput: 0: 9462.9. Samples: 49041316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:57:42,858][708628] Avg episode reward: [(0, '2186.535')] [2023-03-09 12:57:43,778][709034] Updated weights for policy 0, policy_version 95840 (0.0004) [2023-03-09 12:57:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 49102848. Throughput: 0: 9342.7. Samples: 49095416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:57:47,858][708628] Avg episode reward: [(0, '1543.396')] [2023-03-09 12:57:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000095904_49102848.pth... [2023-03-09 12:57:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000095360_48824320.pth [2023-03-09 12:57:48,344][709034] Updated weights for policy 0, policy_version 95920 (0.0005) [2023-03-09 12:57:52,248][709034] Updated weights for policy 0, policy_version 96000 (0.0005) [2023-03-09 12:57:52,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 49156096. Throughput: 0: 9430.2. Samples: 49156168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:57:52,858][708628] Avg episode reward: [(0, '1307.879')] [2023-03-09 12:57:56,511][709034] Updated weights for policy 0, policy_version 96080 (0.0005) [2023-03-09 12:57:57,857][708628] Fps is (10 sec: 10240.0, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 49205248. Throughput: 0: 9441.1. Samples: 49184748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:57:57,858][708628] Avg episode reward: [(0, '957.375')] [2023-03-09 12:58:00,777][709034] Updated weights for policy 0, policy_version 96160 (0.0005) [2023-03-09 12:58:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 49250304. Throughput: 0: 9469.2. Samples: 49242316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:58:02,858][708628] Avg episode reward: [(0, '762.215')] [2023-03-09 12:58:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000096192_49250304.pth... [2023-03-09 12:58:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000095632_48963584.pth [2023-03-09 12:58:05,186][709034] Updated weights for policy 0, policy_version 96240 (0.0005) [2023-03-09 12:58:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 49295360. Throughput: 0: 9435.5. Samples: 49297160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:58:07,858][708628] Avg episode reward: [(0, '957.017')] [2023-03-09 12:58:09,901][709034] Updated weights for policy 0, policy_version 96320 (0.0005) [2023-03-09 12:58:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 49340416. Throughput: 0: 9453.4. Samples: 49323856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:58:12,858][708628] Avg episode reward: [(0, '1118.930')] [2023-03-09 12:58:14,261][709034] Updated weights for policy 0, policy_version 96400 (0.0005) [2023-03-09 12:58:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 49389568. Throughput: 0: 9445.4. Samples: 49380068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:58:17,858][708628] Avg episode reward: [(0, '1565.055')] [2023-03-09 12:58:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000096464_49389568.pth... [2023-03-09 12:58:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000095904_49102848.pth [2023-03-09 12:58:18,711][709034] Updated weights for policy 0, policy_version 96480 (0.0005) [2023-03-09 12:58:22,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 49434624. Throughput: 0: 9353.5. Samples: 49434696. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:58:22,858][708628] Avg episode reward: [(0, '1920.826')] [2023-03-09 12:58:23,149][709034] Updated weights for policy 0, policy_version 96560 (0.0005) [2023-03-09 12:58:27,573][709034] Updated weights for policy 0, policy_version 96640 (0.0005) [2023-03-09 12:58:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 49479680. Throughput: 0: 9378.8. Samples: 49463360. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:58:27,858][708628] Avg episode reward: [(0, '1381.225')] [2023-03-09 12:58:31,943][709034] Updated weights for policy 0, policy_version 96720 (0.0005) [2023-03-09 12:58:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 49528832. Throughput: 0: 9425.2. Samples: 49519548. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:58:32,858][708628] Avg episode reward: [(0, '2059.087')] [2023-03-09 12:58:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000096736_49528832.pth... [2023-03-09 12:58:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000096192_49250304.pth [2023-03-09 12:58:36,428][709034] Updated weights for policy 0, policy_version 96800 (0.0005) [2023-03-09 12:58:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 49573888. Throughput: 0: 9284.1. Samples: 49573952. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:58:37,858][708628] Avg episode reward: [(0, '2134.562')] [2023-03-09 12:58:40,801][709034] Updated weights for policy 0, policy_version 96880 (0.0005) [2023-03-09 12:58:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 49618944. Throughput: 0: 9284.4. Samples: 49602544. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:58:42,858][708628] Avg episode reward: [(0, '1882.002')] [2023-03-09 12:58:45,287][709034] Updated weights for policy 0, policy_version 96960 (0.0005) [2023-03-09 12:58:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 49664000. Throughput: 0: 9202.8. Samples: 49656440. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:58:47,858][708628] Avg episode reward: [(0, '2247.987')] [2023-03-09 12:58:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000097000_49664000.pth... [2023-03-09 12:58:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000096464_49389568.pth [2023-03-09 12:58:49,633][709034] Updated weights for policy 0, policy_version 97040 (0.0005) [2023-03-09 12:58:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 49713152. Throughput: 0: 9283.4. Samples: 49714912. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:58:52,858][708628] Avg episode reward: [(0, '1967.172')] [2023-03-09 12:58:53,912][709034] Updated weights for policy 0, policy_version 97120 (0.0005) [2023-03-09 12:58:57,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 49762304. Throughput: 0: 9378.0. Samples: 49745868. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:58:57,858][708628] Avg episode reward: [(0, '2467.521')] [2023-03-09 12:58:58,097][709034] Updated weights for policy 0, policy_version 97200 (0.0005) [2023-03-09 12:59:02,425][709034] Updated weights for policy 0, policy_version 97280 (0.0005) [2023-03-09 12:59:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 49807360. Throughput: 0: 9333.3. Samples: 49800068. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:59:02,857][708628] Avg episode reward: [(0, '2866.759')] [2023-03-09 12:59:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000097280_49807360.pth... [2023-03-09 12:59:02,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000096736_49528832.pth [2023-03-09 12:59:06,991][709034] Updated weights for policy 0, policy_version 97360 (0.0005) [2023-03-09 12:59:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 49852416. Throughput: 0: 9367.7. Samples: 49856244. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:59:07,858][708628] Avg episode reward: [(0, '3238.656')] [2023-03-09 12:59:11,174][709034] Updated weights for policy 0, policy_version 97440 (0.0005) [2023-03-09 12:59:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 49901568. Throughput: 0: 9375.5. Samples: 49885256. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:59:12,858][708628] Avg episode reward: [(0, '3095.114')] [2023-03-09 12:59:15,440][709034] Updated weights for policy 0, policy_version 97520 (0.0005) [2023-03-09 12:59:17,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 49950720. Throughput: 0: 9399.5. Samples: 49942524. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 12:59:17,858][708628] Avg episode reward: [(0, '3252.525')] [2023-03-09 12:59:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000097560_49950720.pth... [2023-03-09 12:59:17,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000097000_49664000.pth [2023-03-09 12:59:19,805][709034] Updated weights for policy 0, policy_version 97600 (0.0005) [2023-03-09 12:59:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 49995776. Throughput: 0: 9438.5. Samples: 49998684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:59:22,858][708628] Avg episode reward: [(0, '3253.172')] [2023-03-09 12:59:24,321][709034] Updated weights for policy 0, policy_version 97680 (0.0005) [2023-03-09 12:59:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 50044928. Throughput: 0: 9396.6. Samples: 50025392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:59:27,858][708628] Avg episode reward: [(0, '3240.309')] [2023-03-09 12:59:28,792][709034] Updated weights for policy 0, policy_version 97760 (0.0005) [2023-03-09 12:59:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 50089984. Throughput: 0: 9424.4. Samples: 50080536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:59:32,858][708628] Avg episode reward: [(0, '3520.542')] [2023-03-09 12:59:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000097832_50089984.pth... [2023-03-09 12:59:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000097280_49807360.pth [2023-03-09 12:59:33,260][709034] Updated weights for policy 0, policy_version 97840 (0.0005) [2023-03-09 12:59:37,716][709034] Updated weights for policy 0, policy_version 97920 (0.0005) [2023-03-09 12:59:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 50135040. Throughput: 0: 9337.8. Samples: 50135112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:59:37,858][708628] Avg episode reward: [(0, '3374.649')] [2023-03-09 12:59:42,203][709034] Updated weights for policy 0, policy_version 98000 (0.0006) [2023-03-09 12:59:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 50180096. Throughput: 0: 9285.8. Samples: 50163728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:59:42,858][708628] Avg episode reward: [(0, '3196.693')] [2023-03-09 12:59:46,507][709034] Updated weights for policy 0, policy_version 98080 (0.0004) [2023-03-09 12:59:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 50229248. Throughput: 0: 9329.3. Samples: 50219888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:59:47,858][708628] Avg episode reward: [(0, '3598.444')] [2023-03-09 12:59:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000098104_50229248.pth... [2023-03-09 12:59:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000097560_49950720.pth [2023-03-09 12:59:50,467][709034] Updated weights for policy 0, policy_version 98160 (0.0005) [2023-03-09 12:59:52,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 50278400. Throughput: 0: 9382.7. Samples: 50278464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:59:52,858][708628] Avg episode reward: [(0, '3198.058')] [2023-03-09 12:59:54,805][709034] Updated weights for policy 0, policy_version 98240 (0.0004) [2023-03-09 12:59:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 50323456. Throughput: 0: 9396.0. Samples: 50308076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 12:59:57,858][708628] Avg episode reward: [(0, '2882.145')] [2023-03-09 12:59:59,249][709034] Updated weights for policy 0, policy_version 98320 (0.0004) [2023-03-09 13:00:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 50368512. Throughput: 0: 9332.3. Samples: 50362480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:00:02,858][708628] Avg episode reward: [(0, '2323.412')] [2023-03-09 13:00:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000098376_50368512.pth... [2023-03-09 13:00:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000097832_50089984.pth [2023-03-09 13:00:03,881][709034] Updated weights for policy 0, policy_version 98400 (0.0005) [2023-03-09 13:00:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 50413568. Throughput: 0: 9249.0. Samples: 50414888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:00:07,858][708628] Avg episode reward: [(0, '2745.423')] [2023-03-09 13:00:08,430][709034] Updated weights for policy 0, policy_version 98480 (0.0005) [2023-03-09 13:00:12,811][709034] Updated weights for policy 0, policy_version 98560 (0.0005) [2023-03-09 13:00:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 50462720. Throughput: 0: 9264.9. Samples: 50442312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:00:12,858][708628] Avg episode reward: [(0, '2815.617')] [2023-03-09 13:00:17,210][709034] Updated weights for policy 0, policy_version 98640 (0.0005) [2023-03-09 13:00:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 50507776. Throughput: 0: 9313.8. Samples: 50499656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:00:17,858][708628] Avg episode reward: [(0, '3305.620')] [2023-03-09 13:00:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000098648_50507776.pth... [2023-03-09 13:00:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000098104_50229248.pth [2023-03-09 13:00:21,650][709034] Updated weights for policy 0, policy_version 98720 (0.0005) [2023-03-09 13:00:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 50552832. Throughput: 0: 9324.8. Samples: 50554728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:00:22,858][708628] Avg episode reward: [(0, '3721.317')] [2023-03-09 13:00:26,230][709034] Updated weights for policy 0, policy_version 98800 (0.0005) [2023-03-09 13:00:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 50597888. Throughput: 0: 9285.3. Samples: 50581568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:00:27,858][708628] Avg episode reward: [(0, '3812.151')] [2023-03-09 13:00:30,670][709034] Updated weights for policy 0, policy_version 98880 (0.0005) [2023-03-09 13:00:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 50647040. Throughput: 0: 9267.8. Samples: 50636940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:00:32,858][708628] Avg episode reward: [(0, '3887.728')] [2023-03-09 13:00:32,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000098920_50647040.pth... [2023-03-09 13:00:32,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000098376_50368512.pth [2023-03-09 13:00:35,037][709034] Updated weights for policy 0, policy_version 98960 (0.0005) [2023-03-09 13:00:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 50692096. Throughput: 0: 9227.8. Samples: 50693716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:00:37,858][708628] Avg episode reward: [(0, '3772.759')] [2023-03-09 13:00:39,377][709034] Updated weights for policy 0, policy_version 99040 (0.0005) [2023-03-09 13:00:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 50737152. Throughput: 0: 9176.1. Samples: 50721000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:00:42,858][708628] Avg episode reward: [(0, '3382.455')] [2023-03-09 13:00:43,761][709034] Updated weights for policy 0, policy_version 99120 (0.0005) [2023-03-09 13:00:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 50786304. Throughput: 0: 9212.0. Samples: 50777020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:00:47,858][708628] Avg episode reward: [(0, '2992.114')] [2023-03-09 13:00:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000099192_50786304.pth... [2023-03-09 13:00:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000098648_50507776.pth [2023-03-09 13:00:48,212][709034] Updated weights for policy 0, policy_version 99200 (0.0005) [2023-03-09 13:00:52,726][709034] Updated weights for policy 0, policy_version 99280 (0.0006) [2023-03-09 13:00:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 50831360. Throughput: 0: 9256.4. Samples: 50831424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:00:52,858][708628] Avg episode reward: [(0, '3261.822')] [2023-03-09 13:00:57,216][709034] Updated weights for policy 0, policy_version 99360 (0.0005) [2023-03-09 13:00:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 50876416. Throughput: 0: 9242.0. Samples: 50858204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:00:57,868][708628] Avg episode reward: [(0, '3516.439')] [2023-03-09 13:01:01,782][709034] Updated weights for policy 0, policy_version 99440 (0.0005) [2023-03-09 13:01:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 50921472. Throughput: 0: 9191.8. Samples: 50913288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:01:02,868][708628] Avg episode reward: [(0, '3427.803')] [2023-03-09 13:01:02,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000099456_50921472.pth... [2023-03-09 13:01:02,875][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000098920_50647040.pth [2023-03-09 13:01:06,066][709034] Updated weights for policy 0, policy_version 99520 (0.0005) [2023-03-09 13:01:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 50970624. Throughput: 0: 9221.2. Samples: 50969684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:01:07,869][708628] Avg episode reward: [(0, '3690.680')] [2023-03-09 13:01:10,536][709034] Updated weights for policy 0, policy_version 99600 (0.0005) [2023-03-09 13:01:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 51015680. Throughput: 0: 9242.4. Samples: 50997476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:01:12,868][708628] Avg episode reward: [(0, '3389.156')] [2023-03-09 13:01:15,030][709034] Updated weights for policy 0, policy_version 99680 (0.0005) [2023-03-09 13:01:17,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 51056640. Throughput: 0: 9207.7. Samples: 51051284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:01:17,868][708628] Avg episode reward: [(0, '3478.764')] [2023-03-09 13:01:17,871][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000099728_51060736.pth... [2023-03-09 13:01:17,872][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000099192_50786304.pth [2023-03-09 13:01:19,614][709034] Updated weights for policy 0, policy_version 99760 (0.0004) [2023-03-09 13:01:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 51105792. Throughput: 0: 9167.2. Samples: 51106240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:01:22,868][708628] Avg episode reward: [(0, '3830.410')] [2023-03-09 13:01:24,052][709034] Updated weights for policy 0, policy_version 99840 (0.0005) [2023-03-09 13:01:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 51150848. Throughput: 0: 9189.5. Samples: 51134528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:01:27,858][708628] Avg episode reward: [(0, '3358.061')] [2023-03-09 13:01:28,511][709034] Updated weights for policy 0, policy_version 99920 (0.0005) [2023-03-09 13:01:32,717][709034] Updated weights for policy 0, policy_version 100000 (0.0006) [2023-03-09 13:01:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 51200000. Throughput: 0: 9199.0. Samples: 51190976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:01:32,858][708628] Avg episode reward: [(0, '3798.115')] [2023-03-09 13:01:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000100000_51200000.pth... [2023-03-09 13:01:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000099456_50921472.pth [2023-03-09 13:01:36,979][709034] Updated weights for policy 0, policy_version 100080 (0.0005) [2023-03-09 13:01:37,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 51249152. Throughput: 0: 9282.8. Samples: 51249152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:01:37,858][708628] Avg episode reward: [(0, '3479.099')] [2023-03-09 13:01:41,154][709034] Updated weights for policy 0, policy_version 100160 (0.0005) [2023-03-09 13:01:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 51294208. Throughput: 0: 9325.1. Samples: 51277832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:01:42,858][708628] Avg episode reward: [(0, '3523.203')] [2023-03-09 13:01:45,395][709034] Updated weights for policy 0, policy_version 100240 (0.0005) [2023-03-09 13:01:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 51343360. Throughput: 0: 9376.7. Samples: 51335240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:01:47,858][708628] Avg episode reward: [(0, '3185.090')] [2023-03-09 13:01:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000100280_51343360.pth... [2023-03-09 13:01:47,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000099728_51060736.pth [2023-03-09 13:01:49,647][709034] Updated weights for policy 0, policy_version 100320 (0.0005) [2023-03-09 13:01:52,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 51392512. Throughput: 0: 9396.2. Samples: 51392512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:01:52,858][708628] Avg episode reward: [(0, '2658.970')] [2023-03-09 13:01:54,142][709034] Updated weights for policy 0, policy_version 100400 (0.0005) [2023-03-09 13:01:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 51437568. Throughput: 0: 9375.4. Samples: 51419368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:01:57,858][708628] Avg episode reward: [(0, '2795.490')] [2023-03-09 13:01:58,728][709034] Updated weights for policy 0, policy_version 100480 (0.0005) [2023-03-09 13:02:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 51482624. Throughput: 0: 9376.4. Samples: 51473224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:02:02,868][708628] Avg episode reward: [(0, '2350.006')] [2023-03-09 13:02:02,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000100552_51482624.pth... [2023-03-09 13:02:02,875][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000100000_51200000.pth [2023-03-09 13:02:03,097][709034] Updated weights for policy 0, policy_version 100560 (0.0006) [2023-03-09 13:02:07,833][709034] Updated weights for policy 0, policy_version 100640 (0.0005) [2023-03-09 13:02:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 51527680. Throughput: 0: 9364.4. Samples: 51527636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:02:07,868][708628] Avg episode reward: [(0, '2773.112')] [2023-03-09 13:02:11,950][709034] Updated weights for policy 0, policy_version 100720 (0.0005) [2023-03-09 13:02:12,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 51576832. Throughput: 0: 9370.4. Samples: 51556196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:02:12,869][708628] Avg episode reward: [(0, '3161.184')] [2023-03-09 13:02:16,442][709034] Updated weights for policy 0, policy_version 100800 (0.0006) [2023-03-09 13:02:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 51621888. Throughput: 0: 9385.1. Samples: 51613304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:02:17,868][708628] Avg episode reward: [(0, '3536.838')] [2023-03-09 13:02:17,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000100824_51621888.pth... [2023-03-09 13:02:17,875][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000100280_51343360.pth [2023-03-09 13:02:20,801][709034] Updated weights for policy 0, policy_version 100880 (0.0005) [2023-03-09 13:02:22,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 51666944. Throughput: 0: 9305.9. Samples: 51667916. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:02:22,868][708628] Avg episode reward: [(0, '3844.529')] [2023-03-09 13:02:25,473][709034] Updated weights for policy 0, policy_version 100960 (0.0005) [2023-03-09 13:02:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 51712000. Throughput: 0: 9274.4. Samples: 51695180. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:02:27,868][708628] Avg episode reward: [(0, '3956.221')] [2023-03-09 13:02:29,817][709034] Updated weights for policy 0, policy_version 101040 (0.0005) [2023-03-09 13:02:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 51757056. Throughput: 0: 9240.3. Samples: 51751052. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:02:32,868][708628] Avg episode reward: [(0, '3926.854')] [2023-03-09 13:02:32,892][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000101096_51761152.pth... [2023-03-09 13:02:32,893][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000100552_51482624.pth [2023-03-09 13:02:34,112][709034] Updated weights for policy 0, policy_version 101120 (0.0005) [2023-03-09 13:02:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 51806208. Throughput: 0: 9204.9. Samples: 51806732. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:02:37,868][708628] Avg episode reward: [(0, '3465.573')] [2023-03-09 13:02:38,484][709034] Updated weights for policy 0, policy_version 101200 (0.0005) [2023-03-09 13:02:42,766][709034] Updated weights for policy 0, policy_version 101280 (0.0005) [2023-03-09 13:02:42,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 51855360. Throughput: 0: 9271.4. Samples: 51836580. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:02:42,858][708628] Avg episode reward: [(0, '3684.678')] [2023-03-09 13:02:47,334][709034] Updated weights for policy 0, policy_version 101360 (0.0004) [2023-03-09 13:02:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 51900416. Throughput: 0: 9292.7. Samples: 51891396. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:02:47,858][708628] Avg episode reward: [(0, '3801.982')] [2023-03-09 13:02:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000101368_51900416.pth... [2023-03-09 13:02:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000100824_51621888.pth [2023-03-09 13:02:51,579][709034] Updated weights for policy 0, policy_version 101440 (0.0005) [2023-03-09 13:02:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 51945472. Throughput: 0: 9342.1. Samples: 51948032. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:02:52,858][708628] Avg episode reward: [(0, '3668.906')] [2023-03-09 13:02:55,924][709034] Updated weights for policy 0, policy_version 101520 (0.0005) [2023-03-09 13:02:57,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 51994624. Throughput: 0: 9348.2. Samples: 51976864. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:02:57,858][708628] Avg episode reward: [(0, '3947.759')] [2023-03-09 13:03:00,201][709034] Updated weights for policy 0, policy_version 101600 (0.0005) [2023-03-09 13:03:02,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 52043776. Throughput: 0: 9370.8. Samples: 52034988. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:03:02,858][708628] Avg episode reward: [(0, '3723.825')] [2023-03-09 13:03:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000101648_52043776.pth... [2023-03-09 13:03:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000101096_51761152.pth [2023-03-09 13:03:04,423][709034] Updated weights for policy 0, policy_version 101680 (0.0005) [2023-03-09 13:03:07,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 52088832. Throughput: 0: 9413.8. Samples: 52091536. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:03:07,858][708628] Avg episode reward: [(0, '3693.796')] [2023-03-09 13:03:08,649][709034] Updated weights for policy 0, policy_version 101760 (0.0005) [2023-03-09 13:03:12,716][709034] Updated weights for policy 0, policy_version 101840 (0.0005) [2023-03-09 13:03:12,857][708628] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 52142080. Throughput: 0: 9521.1. Samples: 52123628. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:03:12,858][708628] Avg episode reward: [(0, '3305.011')] [2023-03-09 13:03:17,071][709034] Updated weights for policy 0, policy_version 101920 (0.0005) [2023-03-09 13:03:17,857][708628] Fps is (10 sec: 10239.9, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 52191232. Throughput: 0: 9525.8. Samples: 52179716. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:03:17,858][708628] Avg episode reward: [(0, '3047.691')] [2023-03-09 13:03:17,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000101936_52191232.pth... [2023-03-09 13:03:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000101368_51900416.pth [2023-03-09 13:03:21,153][709034] Updated weights for policy 0, policy_version 102000 (0.0005) [2023-03-09 13:03:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 52236288. Throughput: 0: 9599.2. Samples: 52238696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:03:22,858][708628] Avg episode reward: [(0, '3453.452')] [2023-03-09 13:03:25,746][709034] Updated weights for policy 0, policy_version 102080 (0.0005) [2023-03-09 13:03:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9489.1, 300 sec: 9330.6). Total num frames: 52281344. Throughput: 0: 9519.7. Samples: 52264968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:03:27,858][708628] Avg episode reward: [(0, '3656.954')] [2023-03-09 13:03:30,450][709034] Updated weights for policy 0, policy_version 102160 (0.0005) [2023-03-09 13:03:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9330.5). Total num frames: 52326400. Throughput: 0: 9484.7. Samples: 52318208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:03:32,858][708628] Avg episode reward: [(0, '3611.545')] [2023-03-09 13:03:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000102200_52326400.pth... [2023-03-09 13:03:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000101648_52043776.pth [2023-03-09 13:03:34,593][709034] Updated weights for policy 0, policy_version 102240 (0.0005) [2023-03-09 13:03:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 52375552. Throughput: 0: 9500.6. Samples: 52375560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:03:37,858][708628] Avg episode reward: [(0, '3829.747')] [2023-03-09 13:03:39,219][709034] Updated weights for policy 0, policy_version 102320 (0.0005) [2023-03-09 13:03:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 52420608. Throughput: 0: 9480.0. Samples: 52403464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:03:42,858][708628] Avg episode reward: [(0, '3599.364')] [2023-03-09 13:03:43,564][709034] Updated weights for policy 0, policy_version 102400 (0.0005) [2023-03-09 13:03:47,851][709034] Updated weights for policy 0, policy_version 102480 (0.0005) [2023-03-09 13:03:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 52469760. Throughput: 0: 9414.4. Samples: 52458636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:03:47,858][708628] Avg episode reward: [(0, '3669.331')] [2023-03-09 13:03:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000102480_52469760.pth... [2023-03-09 13:03:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000101936_52191232.pth [2023-03-09 13:03:52,185][709034] Updated weights for policy 0, policy_version 102560 (0.0005) [2023-03-09 13:03:52,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9330.5). Total num frames: 52514816. Throughput: 0: 9447.0. Samples: 52516652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:03:52,858][708628] Avg episode reward: [(0, '3171.758')] [2023-03-09 13:03:56,561][709034] Updated weights for policy 0, policy_version 102640 (0.0005) [2023-03-09 13:03:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 52559872. Throughput: 0: 9354.4. Samples: 52544576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:03:57,858][708628] Avg episode reward: [(0, '3375.499')] [2023-03-09 13:04:00,764][709034] Updated weights for policy 0, policy_version 102720 (0.0004) [2023-03-09 13:04:02,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 52609024. Throughput: 0: 9370.3. Samples: 52601380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:04:02,858][708628] Avg episode reward: [(0, '3585.154')] [2023-03-09 13:04:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000102752_52609024.pth... [2023-03-09 13:04:02,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000102200_52326400.pth [2023-03-09 13:04:05,001][709034] Updated weights for policy 0, policy_version 102800 (0.0006) [2023-03-09 13:04:07,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 52658176. Throughput: 0: 9381.7. Samples: 52660872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:04:07,858][708628] Avg episode reward: [(0, '3574.562')] [2023-03-09 13:04:09,228][709034] Updated weights for policy 0, policy_version 102880 (0.0005) [2023-03-09 13:04:12,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 52707328. Throughput: 0: 9446.3. Samples: 52690052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:04:12,858][708628] Avg episode reward: [(0, '3893.391')] [2023-03-09 13:04:13,654][709034] Updated weights for policy 0, policy_version 102960 (0.0005) [2023-03-09 13:04:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 52752384. Throughput: 0: 9467.9. Samples: 52744264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:04:17,858][708628] Avg episode reward: [(0, '3610.713')] [2023-03-09 13:04:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000103032_52752384.pth... [2023-03-09 13:04:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000102480_52469760.pth [2023-03-09 13:04:18,025][709034] Updated weights for policy 0, policy_version 103040 (0.0005) [2023-03-09 13:04:22,625][709034] Updated weights for policy 0, policy_version 103120 (0.0005) [2023-03-09 13:04:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 52797440. Throughput: 0: 9397.4. Samples: 52798444. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:04:22,858][708628] Avg episode reward: [(0, '3405.083')] [2023-03-09 13:04:27,141][709034] Updated weights for policy 0, policy_version 103200 (0.0005) [2023-03-09 13:04:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 52842496. Throughput: 0: 9391.8. Samples: 52826096. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:04:27,857][708628] Avg episode reward: [(0, '3919.270')] [2023-03-09 13:04:31,709][709034] Updated weights for policy 0, policy_version 103280 (0.0005) [2023-03-09 13:04:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 52887552. Throughput: 0: 9351.6. Samples: 52879456. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:04:32,858][708628] Avg episode reward: [(0, '4012.987')] [2023-03-09 13:04:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000103296_52887552.pth... [2023-03-09 13:04:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000102752_52609024.pth [2023-03-09 13:04:36,310][709034] Updated weights for policy 0, policy_version 103360 (0.0005) [2023-03-09 13:04:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 52932608. Throughput: 0: 9264.8. Samples: 52933568. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:04:37,858][708628] Avg episode reward: [(0, '3842.584')] [2023-03-09 13:04:40,686][709034] Updated weights for policy 0, policy_version 103440 (0.0005) [2023-03-09 13:04:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 52977664. Throughput: 0: 9267.6. Samples: 52961616. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:04:42,858][708628] Avg episode reward: [(0, '4085.763')] [2023-03-09 13:04:44,855][709034] Updated weights for policy 0, policy_version 103520 (0.0005) [2023-03-09 13:04:47,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 53030912. Throughput: 0: 9363.1. Samples: 53022720. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:04:47,858][708628] Avg episode reward: [(0, '3514.121')] [2023-03-09 13:04:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000103576_53030912.pth... [2023-03-09 13:04:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000103032_52752384.pth [2023-03-09 13:04:48,947][709034] Updated weights for policy 0, policy_version 103600 (0.0005) [2023-03-09 13:04:52,857][708628] Fps is (10 sec: 10240.0, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 53080064. Throughput: 0: 9315.1. Samples: 53080052. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:04:52,858][708628] Avg episode reward: [(0, '3021.662')] [2023-03-09 13:04:53,262][709034] Updated weights for policy 0, policy_version 103680 (0.0005) [2023-03-09 13:04:57,680][709034] Updated weights for policy 0, policy_version 103760 (0.0005) [2023-03-09 13:04:57,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 53125120. Throughput: 0: 9271.6. Samples: 53107272. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:04:57,858][708628] Avg episode reward: [(0, '2737.351')] [2023-03-09 13:05:01,956][709034] Updated weights for policy 0, policy_version 103840 (0.0005) [2023-03-09 13:05:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 53170176. Throughput: 0: 9331.0. Samples: 53164160. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:05:02,858][708628] Avg episode reward: [(0, '3543.544')] [2023-03-09 13:05:02,887][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000103856_53174272.pth... [2023-03-09 13:05:02,889][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000103296_52887552.pth [2023-03-09 13:05:06,402][709034] Updated weights for policy 0, policy_version 103920 (0.0006) [2023-03-09 13:05:07,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 53219328. Throughput: 0: 9351.0. Samples: 53219240. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:05:07,858][708628] Avg episode reward: [(0, '3552.382')] [2023-03-09 13:05:10,794][709034] Updated weights for policy 0, policy_version 104000 (0.0005) [2023-03-09 13:05:12,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 53264384. Throughput: 0: 9374.7. Samples: 53247960. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:05:12,858][708628] Avg episode reward: [(0, '3315.284')] [2023-03-09 13:05:15,316][709034] Updated weights for policy 0, policy_version 104080 (0.0005) [2023-03-09 13:05:17,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 53313536. Throughput: 0: 9462.3. Samples: 53305260. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:05:17,858][708628] Avg episode reward: [(0, '2967.238')] [2023-03-09 13:05:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000104128_53313536.pth... [2023-03-09 13:05:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000103576_53030912.pth [2023-03-09 13:05:19,212][709034] Updated weights for policy 0, policy_version 104160 (0.0005) [2023-03-09 13:05:22,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 53362688. Throughput: 0: 9555.8. Samples: 53363580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:05:22,858][708628] Avg episode reward: [(0, '3126.544')] [2023-03-09 13:05:23,457][709034] Updated weights for policy 0, policy_version 104240 (0.0005) [2023-03-09 13:05:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 53407744. Throughput: 0: 9556.8. Samples: 53391672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:05:27,858][708628] Avg episode reward: [(0, '3160.749')] [2023-03-09 13:05:27,914][709034] Updated weights for policy 0, policy_version 104320 (0.0005) [2023-03-09 13:05:31,986][709034] Updated weights for policy 0, policy_version 104400 (0.0006) [2023-03-09 13:05:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 53456896. Throughput: 0: 9525.0. Samples: 53451344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:05:32,858][708628] Avg episode reward: [(0, '3312.629')] [2023-03-09 13:05:32,906][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000104416_53460992.pth... [2023-03-09 13:05:32,909][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000103856_53174272.pth [2023-03-09 13:05:36,445][709034] Updated weights for policy 0, policy_version 104480 (0.0004) [2023-03-09 13:05:37,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 53506048. Throughput: 0: 9464.6. Samples: 53505960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:05:37,858][708628] Avg episode reward: [(0, '3587.318')] [2023-03-09 13:05:40,690][709034] Updated weights for policy 0, policy_version 104560 (0.0005) [2023-03-09 13:05:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 53551104. Throughput: 0: 9505.8. Samples: 53535032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:05:42,858][708628] Avg episode reward: [(0, '3638.104')] [2023-03-09 13:05:45,195][709034] Updated weights for policy 0, policy_version 104640 (0.0005) [2023-03-09 13:05:47,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 53596160. Throughput: 0: 9429.7. Samples: 53588496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:05:47,858][708628] Avg episode reward: [(0, '3446.396')] [2023-03-09 13:05:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000104680_53596160.pth... [2023-03-09 13:05:47,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000104128_53313536.pth [2023-03-09 13:05:49,473][709034] Updated weights for policy 0, policy_version 104720 (0.0005) [2023-03-09 13:05:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 53645312. Throughput: 0: 9506.1. Samples: 53647012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:05:52,858][708628] Avg episode reward: [(0, '3376.431')] [2023-03-09 13:05:53,858][709034] Updated weights for policy 0, policy_version 104800 (0.0005) [2023-03-09 13:05:57,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 53690368. Throughput: 0: 9481.2. Samples: 53674612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:05:57,858][708628] Avg episode reward: [(0, '3875.003')] [2023-03-09 13:05:58,362][709034] Updated weights for policy 0, policy_version 104880 (0.0004) [2023-03-09 13:06:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 53735424. Throughput: 0: 9395.0. Samples: 53728036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:06:02,858][708628] Avg episode reward: [(0, '3692.081')] [2023-03-09 13:06:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000104952_53735424.pth... [2023-03-09 13:06:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000104416_53460992.pth [2023-03-09 13:06:03,023][709034] Updated weights for policy 0, policy_version 104960 (0.0005) [2023-03-09 13:06:07,365][709034] Updated weights for policy 0, policy_version 105040 (0.0005) [2023-03-09 13:06:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 53784576. Throughput: 0: 9355.6. Samples: 53784584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:06:07,858][708628] Avg episode reward: [(0, '3674.176')] [2023-03-09 13:06:11,655][709034] Updated weights for policy 0, policy_version 105120 (0.0005) [2023-03-09 13:06:12,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 53833728. Throughput: 0: 9368.3. Samples: 53813248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:06:12,858][708628] Avg episode reward: [(0, '3571.186')] [2023-03-09 13:06:16,048][709034] Updated weights for policy 0, policy_version 105200 (0.0005) [2023-03-09 13:06:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 53878784. Throughput: 0: 9276.0. Samples: 53868764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:06:17,858][708628] Avg episode reward: [(0, '3755.827')] [2023-03-09 13:06:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000105232_53878784.pth... [2023-03-09 13:06:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000104680_53596160.pth [2023-03-09 13:06:20,496][709034] Updated weights for policy 0, policy_version 105280 (0.0005) [2023-03-09 13:06:22,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 53923840. Throughput: 0: 9286.0. Samples: 53923828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:06:22,857][708628] Avg episode reward: [(0, '3797.338')] [2023-03-09 13:06:24,926][709034] Updated weights for policy 0, policy_version 105360 (0.0004) [2023-03-09 13:06:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 53972992. Throughput: 0: 9277.1. Samples: 53952500. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:06:27,858][708628] Avg episode reward: [(0, '3627.937')] [2023-03-09 13:06:28,981][709034] Updated weights for policy 0, policy_version 105440 (0.0005) [2023-03-09 13:06:32,857][708628] Fps is (10 sec: 9420.6, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 54018048. Throughput: 0: 9381.3. Samples: 54010656. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:06:32,858][708628] Avg episode reward: [(0, '3764.420')] [2023-03-09 13:06:32,871][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000105512_54022144.pth... [2023-03-09 13:06:32,873][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000104952_53735424.pth [2023-03-09 13:06:33,303][709034] Updated weights for policy 0, policy_version 105520 (0.0005) [2023-03-09 13:06:37,716][709034] Updated weights for policy 0, policy_version 105600 (0.0005) [2023-03-09 13:06:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.6, 300 sec: 9400.0). Total num frames: 54067200. Throughput: 0: 9339.1. Samples: 54067272. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:06:37,858][708628] Avg episode reward: [(0, '3620.864')] [2023-03-09 13:06:41,979][709034] Updated weights for policy 0, policy_version 105680 (0.0005) [2023-03-09 13:06:42,857][708628] Fps is (10 sec: 9830.6, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 54116352. Throughput: 0: 9370.6. Samples: 54096288. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:06:42,858][708628] Avg episode reward: [(0, '3247.319')] [2023-03-09 13:06:46,380][709034] Updated weights for policy 0, policy_version 105760 (0.0005) [2023-03-09 13:06:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 54161408. Throughput: 0: 9449.9. Samples: 54153280. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:06:47,858][708628] Avg episode reward: [(0, '3229.523')] [2023-03-09 13:06:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000105784_54161408.pth... [2023-03-09 13:06:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000105232_53878784.pth [2023-03-09 13:06:50,571][709034] Updated weights for policy 0, policy_version 105840 (0.0005) [2023-03-09 13:06:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 54210560. Throughput: 0: 9471.3. Samples: 54210792. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:06:52,858][708628] Avg episode reward: [(0, '3686.949')] [2023-03-09 13:06:54,927][709034] Updated weights for policy 0, policy_version 105920 (0.0005) [2023-03-09 13:06:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 54255616. Throughput: 0: 9466.3. Samples: 54239232. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:06:57,858][708628] Avg episode reward: [(0, '3657.518')] [2023-03-09 13:06:59,372][709034] Updated weights for policy 0, policy_version 106000 (0.0005) [2023-03-09 13:07:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 54304768. Throughput: 0: 9490.5. Samples: 54295836. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:07:02,858][708628] Avg episode reward: [(0, '3249.458')] [2023-03-09 13:07:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000106064_54304768.pth... [2023-03-09 13:07:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000105512_54022144.pth [2023-03-09 13:07:03,623][709034] Updated weights for policy 0, policy_version 106080 (0.0005) [2023-03-09 13:07:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 54349824. Throughput: 0: 9468.0. Samples: 54349888. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:07:07,858][708628] Avg episode reward: [(0, '3039.721')] [2023-03-09 13:07:08,092][709034] Updated weights for policy 0, policy_version 106160 (0.0006) [2023-03-09 13:07:12,178][709034] Updated weights for policy 0, policy_version 106240 (0.0005) [2023-03-09 13:07:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 54398976. Throughput: 0: 9548.7. Samples: 54382192. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:07:12,858][708628] Avg episode reward: [(0, '3740.832')] [2023-03-09 13:07:16,798][709034] Updated weights for policy 0, policy_version 106320 (0.0005) [2023-03-09 13:07:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 54444032. Throughput: 0: 9448.6. Samples: 54435840. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:07:17,858][708628] Avg episode reward: [(0, '3118.894')] [2023-03-09 13:07:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000106336_54444032.pth... [2023-03-09 13:07:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000105784_54161408.pth [2023-03-09 13:07:21,185][709034] Updated weights for policy 0, policy_version 106400 (0.0005) [2023-03-09 13:07:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 54489088. Throughput: 0: 9429.9. Samples: 54491616. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:07:22,858][708628] Avg episode reward: [(0, '3311.669')] [2023-03-09 13:07:25,520][709034] Updated weights for policy 0, policy_version 106480 (0.0004) [2023-03-09 13:07:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9427.7). Total num frames: 54538240. Throughput: 0: 9419.1. Samples: 54520148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:07:27,858][708628] Avg episode reward: [(0, '2827.365')] [2023-03-09 13:07:29,809][709034] Updated weights for policy 0, policy_version 106560 (0.0004) [2023-03-09 13:07:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 54583296. Throughput: 0: 9404.6. Samples: 54576488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:07:32,858][708628] Avg episode reward: [(0, '2837.380')] [2023-03-09 13:07:32,900][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000106616_54587392.pth... [2023-03-09 13:07:32,901][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000106064_54304768.pth [2023-03-09 13:07:34,331][709034] Updated weights for policy 0, policy_version 106640 (0.0005) [2023-03-09 13:07:37,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 54632448. Throughput: 0: 9398.2. Samples: 54633712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:07:37,858][708628] Avg episode reward: [(0, '2538.761')] [2023-03-09 13:07:38,543][709034] Updated weights for policy 0, policy_version 106720 (0.0004) [2023-03-09 13:07:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 54677504. Throughput: 0: 9376.7. Samples: 54661184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:07:42,857][708628] Avg episode reward: [(0, '3223.588')] [2023-03-09 13:07:43,038][709034] Updated weights for policy 0, policy_version 106800 (0.0005) [2023-03-09 13:07:47,384][709034] Updated weights for policy 0, policy_version 106880 (0.0005) [2023-03-09 13:07:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 54722560. Throughput: 0: 9352.9. Samples: 54716716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:07:47,858][708628] Avg episode reward: [(0, '3428.038')] [2023-03-09 13:07:47,876][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000106888_54726656.pth... [2023-03-09 13:07:47,878][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000106336_54444032.pth [2023-03-09 13:07:51,721][709034] Updated weights for policy 0, policy_version 106960 (0.0006) [2023-03-09 13:07:52,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 54771712. Throughput: 0: 9382.5. Samples: 54772100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:07:52,858][708628] Avg episode reward: [(0, '3340.499')] [2023-03-09 13:07:56,332][709034] Updated weights for policy 0, policy_version 107040 (0.0004) [2023-03-09 13:07:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 54816768. Throughput: 0: 9292.0. Samples: 54800332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:07:57,858][708628] Avg episode reward: [(0, '3199.391')] [2023-03-09 13:08:00,651][709034] Updated weights for policy 0, policy_version 107120 (0.0005) [2023-03-09 13:08:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9413.9). Total num frames: 54865920. Throughput: 0: 9339.0. Samples: 54856096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:08:02,858][708628] Avg episode reward: [(0, '2971.716')] [2023-03-09 13:08:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000107160_54865920.pth... [2023-03-09 13:08:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000106616_54587392.pth [2023-03-09 13:08:04,798][709034] Updated weights for policy 0, policy_version 107200 (0.0005) [2023-03-09 13:08:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 54910976. Throughput: 0: 9400.2. Samples: 54914624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:08:07,858][708628] Avg episode reward: [(0, '2304.474')] [2023-03-09 13:08:09,171][709034] Updated weights for policy 0, policy_version 107280 (0.0004) [2023-03-09 13:08:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 54956032. Throughput: 0: 9360.0. Samples: 54941348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:08:12,857][708628] Avg episode reward: [(0, '2489.286')] [2023-03-09 13:08:13,886][709034] Updated weights for policy 0, policy_version 107360 (0.0005) [2023-03-09 13:08:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 55001088. Throughput: 0: 9297.2. Samples: 54994864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:08:17,858][708628] Avg episode reward: [(0, '2319.979')] [2023-03-09 13:08:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000107424_55001088.pth... [2023-03-09 13:08:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000106888_54726656.pth [2023-03-09 13:08:18,358][709034] Updated weights for policy 0, policy_version 107440 (0.0005) [2023-03-09 13:08:22,743][709034] Updated weights for policy 0, policy_version 107520 (0.0005) [2023-03-09 13:08:22,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 55050240. Throughput: 0: 9256.3. Samples: 55050248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:08:22,858][708628] Avg episode reward: [(0, '1929.099')] [2023-03-09 13:08:27,281][709034] Updated weights for policy 0, policy_version 107600 (0.0005) [2023-03-09 13:08:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 55095296. Throughput: 0: 9231.5. Samples: 55076600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:08:27,858][708628] Avg episode reward: [(0, '1401.251')] [2023-03-09 13:08:31,439][709034] Updated weights for policy 0, policy_version 107680 (0.0005) [2023-03-09 13:08:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 55144448. Throughput: 0: 9314.7. Samples: 55135880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:08:32,858][708628] Avg episode reward: [(0, '2248.548')] [2023-03-09 13:08:32,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000107704_55144448.pth... [2023-03-09 13:08:32,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000107160_54865920.pth [2023-03-09 13:08:35,863][709034] Updated weights for policy 0, policy_version 107760 (0.0005) [2023-03-09 13:08:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 55189504. Throughput: 0: 9358.1. Samples: 55193212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:08:37,858][708628] Avg episode reward: [(0, '2875.283')] [2023-03-09 13:08:40,060][709034] Updated weights for policy 0, policy_version 107840 (0.0005) [2023-03-09 13:08:42,857][708628] Fps is (10 sec: 9421.0, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 55238656. Throughput: 0: 9345.6. Samples: 55220884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:08:42,858][708628] Avg episode reward: [(0, '3366.565')] [2023-03-09 13:08:44,651][709034] Updated weights for policy 0, policy_version 107920 (0.0004) [2023-03-09 13:08:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 55283712. Throughput: 0: 9320.5. Samples: 55275520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:08:47,858][708628] Avg episode reward: [(0, '3478.562')] [2023-03-09 13:08:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000107976_55283712.pth... [2023-03-09 13:08:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000107424_55001088.pth [2023-03-09 13:08:49,017][709034] Updated weights for policy 0, policy_version 108000 (0.0005) [2023-03-09 13:08:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 55328768. Throughput: 0: 9215.1. Samples: 55329304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:08:52,858][708628] Avg episode reward: [(0, '3757.832')] [2023-03-09 13:08:53,562][709034] Updated weights for policy 0, policy_version 108080 (0.0004) [2023-03-09 13:08:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 55373824. Throughput: 0: 9246.4. Samples: 55357436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:08:57,858][708628] Avg episode reward: [(0, '3833.601')] [2023-03-09 13:08:58,164][709034] Updated weights for policy 0, policy_version 108160 (0.0005) [2023-03-09 13:09:02,708][709034] Updated weights for policy 0, policy_version 108240 (0.0005) [2023-03-09 13:09:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 55418880. Throughput: 0: 9239.6. Samples: 55410644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:09:02,858][708628] Avg episode reward: [(0, '3371.236')] [2023-03-09 13:09:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000108240_55418880.pth... [2023-03-09 13:09:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000107704_55144448.pth [2023-03-09 13:09:07,195][709034] Updated weights for policy 0, policy_version 108320 (0.0004) [2023-03-09 13:09:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 55463936. Throughput: 0: 9207.6. Samples: 55464588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:09:07,858][708628] Avg episode reward: [(0, '3411.656')] [2023-03-09 13:09:11,596][709034] Updated weights for policy 0, policy_version 108400 (0.0005) [2023-03-09 13:09:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.2, 300 sec: 9358.3). Total num frames: 55513088. Throughput: 0: 9244.4. Samples: 55492600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:09:12,858][708628] Avg episode reward: [(0, '3564.758')] [2023-03-09 13:09:15,852][709034] Updated weights for policy 0, policy_version 108480 (0.0004) [2023-03-09 13:09:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 55558144. Throughput: 0: 9203.2. Samples: 55550024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:09:17,858][708628] Avg episode reward: [(0, '3669.289')] [2023-03-09 13:09:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000108512_55558144.pth... [2023-03-09 13:09:17,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000107976_55283712.pth [2023-03-09 13:09:19,912][709034] Updated weights for policy 0, policy_version 108560 (0.0005) [2023-03-09 13:09:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 55607296. Throughput: 0: 9251.3. Samples: 55609520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:09:22,858][708628] Avg episode reward: [(0, '3339.201')] [2023-03-09 13:09:24,324][709034] Updated weights for policy 0, policy_version 108640 (0.0005) [2023-03-09 13:09:27,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 55656448. Throughput: 0: 9256.1. Samples: 55637408. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:09:27,858][708628] Avg episode reward: [(0, '3269.880')] [2023-03-09 13:09:28,680][709034] Updated weights for policy 0, policy_version 108720 (0.0005) [2023-03-09 13:09:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 55701504. Throughput: 0: 9285.7. Samples: 55693376. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:09:32,858][708628] Avg episode reward: [(0, '3335.074')] [2023-03-09 13:09:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000108792_55701504.pth... [2023-03-09 13:09:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000108240_55418880.pth [2023-03-09 13:09:33,062][709034] Updated weights for policy 0, policy_version 108800 (0.0005) [2023-03-09 13:09:37,418][709034] Updated weights for policy 0, policy_version 108880 (0.0004) [2023-03-09 13:09:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9400.0). Total num frames: 55750656. Throughput: 0: 9363.4. Samples: 55750656. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:09:37,858][708628] Avg episode reward: [(0, '3413.456')] [2023-03-09 13:09:41,859][709034] Updated weights for policy 0, policy_version 108960 (0.0005) [2023-03-09 13:09:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 55795712. Throughput: 0: 9316.8. Samples: 55776692. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:09:42,858][708628] Avg episode reward: [(0, '3571.955')] [2023-03-09 13:09:46,143][709034] Updated weights for policy 0, policy_version 109040 (0.0005) [2023-03-09 13:09:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 55840768. Throughput: 0: 9417.3. Samples: 55834424. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:09:47,858][708628] Avg episode reward: [(0, '3969.700')] [2023-03-09 13:09:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000109064_55840768.pth... [2023-03-09 13:09:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000108512_55558144.pth [2023-03-09 13:09:50,597][709034] Updated weights for policy 0, policy_version 109120 (0.0005) [2023-03-09 13:09:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 55885824. Throughput: 0: 9447.0. Samples: 55889704. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:09:52,858][708628] Avg episode reward: [(0, '4019.346')] [2023-03-09 13:09:55,140][709034] Updated weights for policy 0, policy_version 109200 (0.0004) [2023-03-09 13:09:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 55934976. Throughput: 0: 9410.7. Samples: 55916080. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:09:57,858][708628] Avg episode reward: [(0, '4122.367')] [2023-03-09 13:09:59,451][709034] Updated weights for policy 0, policy_version 109280 (0.0005) [2023-03-09 13:10:02,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 55984128. Throughput: 0: 9427.0. Samples: 55974240. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:10:02,858][708628] Avg episode reward: [(0, '3852.735')] [2023-03-09 13:10:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000109344_55984128.pth... [2023-03-09 13:10:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000108792_55701504.pth [2023-03-09 13:10:03,718][709034] Updated weights for policy 0, policy_version 109360 (0.0005) [2023-03-09 13:10:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 56029184. Throughput: 0: 9327.3. Samples: 56029248. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:10:07,858][708628] Avg episode reward: [(0, '3597.300')] [2023-03-09 13:10:08,188][709034] Updated weights for policy 0, policy_version 109440 (0.0005) [2023-03-09 13:10:12,540][709034] Updated weights for policy 0, policy_version 109520 (0.0005) [2023-03-09 13:10:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.6, 300 sec: 9358.3). Total num frames: 56074240. Throughput: 0: 9344.7. Samples: 56057920. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:10:12,858][708628] Avg episode reward: [(0, '3542.385')] [2023-03-09 13:10:16,729][709034] Updated weights for policy 0, policy_version 109600 (0.0005) [2023-03-09 13:10:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 56123392. Throughput: 0: 9375.5. Samples: 56115272. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:10:17,858][708628] Avg episode reward: [(0, '3276.100')] [2023-03-09 13:10:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000109616_56123392.pth... [2023-03-09 13:10:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000109064_55840768.pth [2023-03-09 13:10:21,371][709034] Updated weights for policy 0, policy_version 109680 (0.0005) [2023-03-09 13:10:22,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 56168448. Throughput: 0: 9284.1. Samples: 56168440. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:10:22,858][708628] Avg episode reward: [(0, '3279.380')] [2023-03-09 13:10:25,792][709034] Updated weights for policy 0, policy_version 109760 (0.0004) [2023-03-09 13:10:27,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 56217600. Throughput: 0: 9342.8. Samples: 56197120. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:10:27,858][708628] Avg episode reward: [(0, '3421.204')] [2023-03-09 13:10:29,885][709034] Updated weights for policy 0, policy_version 109840 (0.0005) [2023-03-09 13:10:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 56262656. Throughput: 0: 9359.0. Samples: 56255580. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:10:32,858][708628] Avg episode reward: [(0, '3868.124')] [2023-03-09 13:10:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000109888_56262656.pth... [2023-03-09 13:10:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000109344_55984128.pth [2023-03-09 13:10:34,250][709034] Updated weights for policy 0, policy_version 109920 (0.0005) [2023-03-09 13:10:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 56307712. Throughput: 0: 9341.3. Samples: 56310064. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:10:37,858][708628] Avg episode reward: [(0, '3777.370')] [2023-03-09 13:10:38,919][709034] Updated weights for policy 0, policy_version 110000 (0.0005) [2023-03-09 13:10:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 56352768. Throughput: 0: 9340.0. Samples: 56336380. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:10:42,858][708628] Avg episode reward: [(0, '2940.937')] [2023-03-09 13:10:43,400][709034] Updated weights for policy 0, policy_version 110080 (0.0005) [2023-03-09 13:10:47,796][709034] Updated weights for policy 0, policy_version 110160 (0.0005) [2023-03-09 13:10:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 56401920. Throughput: 0: 9280.3. Samples: 56391852. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:10:47,858][708628] Avg episode reward: [(0, '3144.375')] [2023-03-09 13:10:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000110160_56401920.pth... [2023-03-09 13:10:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000109616_56123392.pth [2023-03-09 13:10:51,993][709034] Updated weights for policy 0, policy_version 110240 (0.0005) [2023-03-09 13:10:52,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 56451072. Throughput: 0: 9364.5. Samples: 56450648. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:10:52,858][708628] Avg episode reward: [(0, '3372.034')] [2023-03-09 13:10:56,327][709034] Updated weights for policy 0, policy_version 110320 (0.0005) [2023-03-09 13:10:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 56496128. Throughput: 0: 9365.9. Samples: 56479388. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:10:57,858][708628] Avg episode reward: [(0, '3263.800')] [2023-03-09 13:11:00,650][709034] Updated weights for policy 0, policy_version 110400 (0.0005) [2023-03-09 13:11:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 56545280. Throughput: 0: 9374.0. Samples: 56537104. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:11:02,858][708628] Avg episode reward: [(0, '3327.908')] [2023-03-09 13:11:02,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000110440_56545280.pth... [2023-03-09 13:11:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000109888_56262656.pth [2023-03-09 13:11:04,735][709034] Updated weights for policy 0, policy_version 110480 (0.0005) [2023-03-09 13:11:07,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 56590336. Throughput: 0: 9422.5. Samples: 56592452. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:11:07,857][708628] Avg episode reward: [(0, '3381.130')] [2023-03-09 13:11:09,255][709034] Updated weights for policy 0, policy_version 110560 (0.0005) [2023-03-09 13:11:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 56639488. Throughput: 0: 9411.5. Samples: 56620636. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:11:12,858][708628] Avg episode reward: [(0, '3575.824')] [2023-03-09 13:11:13,531][709034] Updated weights for policy 0, policy_version 110640 (0.0005) [2023-03-09 13:11:17,766][709034] Updated weights for policy 0, policy_version 110720 (0.0005) [2023-03-09 13:11:17,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 56688640. Throughput: 0: 9405.4. Samples: 56678824. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:11:17,858][708628] Avg episode reward: [(0, '3586.205')] [2023-03-09 13:11:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000110720_56688640.pth... [2023-03-09 13:11:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000110160_56401920.pth [2023-03-09 13:11:22,207][709034] Updated weights for policy 0, policy_version 110800 (0.0005) [2023-03-09 13:11:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 56733696. Throughput: 0: 9465.1. Samples: 56735996. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:11:22,858][708628] Avg episode reward: [(0, '3937.408')] [2023-03-09 13:11:26,506][709034] Updated weights for policy 0, policy_version 110880 (0.0005) [2023-03-09 13:11:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 56782848. Throughput: 0: 9521.4. Samples: 56764844. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:11:27,858][708628] Avg episode reward: [(0, '3738.506')] [2023-03-09 13:11:30,414][709034] Updated weights for policy 0, policy_version 110960 (0.0005) [2023-03-09 13:11:32,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 56832000. Throughput: 0: 9645.3. Samples: 56825892. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:11:32,858][708628] Avg episode reward: [(0, '3810.678')] [2023-03-09 13:11:32,866][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000111008_56836096.pth... [2023-03-09 13:11:32,867][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000110440_56545280.pth [2023-03-09 13:11:34,754][709034] Updated weights for policy 0, policy_version 111040 (0.0006) [2023-03-09 13:11:37,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 56881152. Throughput: 0: 9566.8. Samples: 56881152. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:11:37,858][708628] Avg episode reward: [(0, '3382.829')] [2023-03-09 13:11:39,097][709034] Updated weights for policy 0, policy_version 111120 (0.0005) [2023-03-09 13:11:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 56926208. Throughput: 0: 9544.7. Samples: 56908900. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:11:42,858][708628] Avg episode reward: [(0, '3474.415')] [2023-03-09 13:11:43,421][709034] Updated weights for policy 0, policy_version 111200 (0.0005) [2023-03-09 13:11:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9358.3). Total num frames: 56971264. Throughput: 0: 9492.2. Samples: 56964252. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:11:47,858][708628] Avg episode reward: [(0, '3723.450')] [2023-03-09 13:11:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000111272_56971264.pth... [2023-03-09 13:11:47,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000110720_56688640.pth [2023-03-09 13:11:47,982][709034] Updated weights for policy 0, policy_version 111280 (0.0005) [2023-03-09 13:11:52,669][709034] Updated weights for policy 0, policy_version 111360 (0.0004) [2023-03-09 13:11:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 57016320. Throughput: 0: 9432.6. Samples: 57016920. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:11:52,858][708628] Avg episode reward: [(0, '3444.658')] [2023-03-09 13:11:57,022][709034] Updated weights for policy 0, policy_version 111440 (0.0006) [2023-03-09 13:11:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 57061376. Throughput: 0: 9431.7. Samples: 57045064. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:11:57,858][708628] Avg episode reward: [(0, '3168.486')] [2023-03-09 13:12:01,557][709034] Updated weights for policy 0, policy_version 111520 (0.0005) [2023-03-09 13:12:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 57106432. Throughput: 0: 9361.7. Samples: 57100100. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:12:02,858][708628] Avg episode reward: [(0, '2813.052')] [2023-03-09 13:12:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000111544_57110528.pth... [2023-03-09 13:12:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000111008_56836096.pth [2023-03-09 13:12:05,946][709034] Updated weights for policy 0, policy_version 111600 (0.0005) [2023-03-09 13:12:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 57155584. Throughput: 0: 9370.0. Samples: 57157644. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:12:07,858][708628] Avg episode reward: [(0, '3114.361')] [2023-03-09 13:12:10,124][709034] Updated weights for policy 0, policy_version 111680 (0.0005) [2023-03-09 13:12:12,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 57204736. Throughput: 0: 9364.2. Samples: 57186232. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:12:12,858][708628] Avg episode reward: [(0, '3889.643')] [2023-03-09 13:12:14,638][709034] Updated weights for policy 0, policy_version 111760 (0.0005) [2023-03-09 13:12:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 57249792. Throughput: 0: 9274.1. Samples: 57243224. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:12:17,858][708628] Avg episode reward: [(0, '3965.095')] [2023-03-09 13:12:17,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000111824_57253888.pth... [2023-03-09 13:12:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000111272_56971264.pth [2023-03-09 13:12:18,666][709034] Updated weights for policy 0, policy_version 111840 (0.0005) [2023-03-09 13:12:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 57298944. Throughput: 0: 9347.6. Samples: 57301792. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:12:22,858][708628] Avg episode reward: [(0, '4058.977')] [2023-03-09 13:12:22,939][709034] Updated weights for policy 0, policy_version 111920 (0.0005) [2023-03-09 13:12:27,283][709034] Updated weights for policy 0, policy_version 112000 (0.0005) [2023-03-09 13:12:27,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 57348096. Throughput: 0: 9342.8. Samples: 57329324. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:12:27,858][708628] Avg episode reward: [(0, '3935.446')] [2023-03-09 13:12:31,672][709034] Updated weights for policy 0, policy_version 112080 (0.0005) [2023-03-09 13:12:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 57393152. Throughput: 0: 9359.1. Samples: 57385412. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:12:32,858][708628] Avg episode reward: [(0, '3693.350')] [2023-03-09 13:12:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000112096_57393152.pth... [2023-03-09 13:12:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000111544_57110528.pth [2023-03-09 13:12:36,027][709034] Updated weights for policy 0, policy_version 112160 (0.0005) [2023-03-09 13:12:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 57442304. Throughput: 0: 9455.1. Samples: 57442400. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:12:37,858][708628] Avg episode reward: [(0, '4202.507')] [2023-03-09 13:12:37,858][708990] Saving new best policy, reward=4202.507! [2023-03-09 13:12:40,467][709034] Updated weights for policy 0, policy_version 112240 (0.0005) [2023-03-09 13:12:42,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 57487360. Throughput: 0: 9448.6. Samples: 57470252. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:12:42,858][708628] Avg episode reward: [(0, '4104.059')] [2023-03-09 13:12:44,929][709034] Updated weights for policy 0, policy_version 112320 (0.0005) [2023-03-09 13:12:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 57532416. Throughput: 0: 9436.2. Samples: 57524728. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:12:47,858][708628] Avg episode reward: [(0, '3631.656')] [2023-03-09 13:12:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000112368_57532416.pth... [2023-03-09 13:12:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000111824_57253888.pth [2023-03-09 13:12:49,283][709034] Updated weights for policy 0, policy_version 112400 (0.0005) [2023-03-09 13:12:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 57581568. Throughput: 0: 9428.1. Samples: 57581908. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:12:52,858][708628] Avg episode reward: [(0, '3928.027')] [2023-03-09 13:12:53,607][709034] Updated weights for policy 0, policy_version 112480 (0.0005) [2023-03-09 13:12:57,622][709034] Updated weights for policy 0, policy_version 112560 (0.0005) [2023-03-09 13:12:57,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 57630720. Throughput: 0: 9512.1. Samples: 57614276. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:12:57,858][708628] Avg episode reward: [(0, '3832.923')] [2023-03-09 13:13:01,982][709034] Updated weights for policy 0, policy_version 112640 (0.0005) [2023-03-09 13:13:02,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9386.1). Total num frames: 57679872. Throughput: 0: 9467.2. Samples: 57669248. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:13:02,858][708628] Avg episode reward: [(0, '3457.338')] [2023-03-09 13:13:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000112656_57679872.pth... [2023-03-09 13:13:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000112096_57393152.pth [2023-03-09 13:13:06,473][709034] Updated weights for policy 0, policy_version 112720 (0.0005) [2023-03-09 13:13:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 57720832. Throughput: 0: 9386.7. Samples: 57724192. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:13:07,858][708628] Avg episode reward: [(0, '4036.275')] [2023-03-09 13:13:10,992][709034] Updated weights for policy 0, policy_version 112800 (0.0005) [2023-03-09 13:13:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 57769984. Throughput: 0: 9390.3. Samples: 57751888. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:13:12,857][708628] Avg episode reward: [(0, '3750.523')] [2023-03-09 13:13:15,415][709034] Updated weights for policy 0, policy_version 112880 (0.0005) [2023-03-09 13:13:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 57815040. Throughput: 0: 9365.2. Samples: 57806848. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:13:17,858][708628] Avg episode reward: [(0, '3390.296')] [2023-03-09 13:13:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000112920_57815040.pth... [2023-03-09 13:13:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000112368_57532416.pth [2023-03-09 13:13:19,792][709034] Updated weights for policy 0, policy_version 112960 (0.0005) [2023-03-09 13:13:22,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 57864192. Throughput: 0: 9374.8. Samples: 57864264. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:13:22,858][708628] Avg episode reward: [(0, '3546.133')] [2023-03-09 13:13:24,016][709034] Updated weights for policy 0, policy_version 113040 (0.0005) [2023-03-09 13:13:27,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 57913344. Throughput: 0: 9384.9. Samples: 57892572. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:13:27,858][708628] Avg episode reward: [(0, '3994.621')] [2023-03-09 13:13:28,267][709034] Updated weights for policy 0, policy_version 113120 (0.0005) [2023-03-09 13:13:32,852][709034] Updated weights for policy 0, policy_version 113200 (0.0005) [2023-03-09 13:13:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 57958400. Throughput: 0: 9417.9. Samples: 57948536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:13:32,858][708628] Avg episode reward: [(0, '3858.751')] [2023-03-09 13:13:32,863][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000113200_57958400.pth... [2023-03-09 13:13:32,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000112656_57679872.pth [2023-03-09 13:13:37,594][709034] Updated weights for policy 0, policy_version 113280 (0.0005) [2023-03-09 13:13:37,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 57999360. Throughput: 0: 9302.7. Samples: 58000528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:13:37,858][708628] Avg episode reward: [(0, '3836.646')] [2023-03-09 13:13:42,071][709034] Updated weights for policy 0, policy_version 113360 (0.0005) [2023-03-09 13:13:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 58048512. Throughput: 0: 9195.0. Samples: 58028052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:13:42,858][708628] Avg episode reward: [(0, '3309.962')] [2023-03-09 13:13:46,359][709034] Updated weights for policy 0, policy_version 113440 (0.0006) [2023-03-09 13:13:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 58093568. Throughput: 0: 9245.8. Samples: 58085308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:13:47,858][708628] Avg episode reward: [(0, '2864.282')] [2023-03-09 13:13:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000113464_58093568.pth... [2023-03-09 13:13:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000112920_57815040.pth [2023-03-09 13:13:50,669][709034] Updated weights for policy 0, policy_version 113520 (0.0005) [2023-03-09 13:13:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 58142720. Throughput: 0: 9294.7. Samples: 58142452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:13:52,858][708628] Avg episode reward: [(0, '3056.781')] [2023-03-09 13:13:54,925][709034] Updated weights for policy 0, policy_version 113600 (0.0004) [2023-03-09 13:13:57,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 58187776. Throughput: 0: 9314.3. Samples: 58171032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:13:57,858][708628] Avg episode reward: [(0, '3187.174')] [2023-03-09 13:13:59,526][709034] Updated weights for policy 0, policy_version 113680 (0.0005) [2023-03-09 13:14:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9386.1). Total num frames: 58232832. Throughput: 0: 9275.3. Samples: 58224236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:14:02,858][708628] Avg episode reward: [(0, '3592.887')] [2023-03-09 13:14:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000113736_58232832.pth... [2023-03-09 13:14:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000113200_57958400.pth [2023-03-09 13:14:04,053][709034] Updated weights for policy 0, policy_version 113760 (0.0005) [2023-03-09 13:14:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 58281984. Throughput: 0: 9282.7. Samples: 58281984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:14:07,858][708628] Avg episode reward: [(0, '3436.795')] [2023-03-09 13:14:08,259][709034] Updated weights for policy 0, policy_version 113840 (0.0005) [2023-03-09 13:14:12,642][709034] Updated weights for policy 0, policy_version 113920 (0.0005) [2023-03-09 13:14:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9386.1). Total num frames: 58327040. Throughput: 0: 9204.8. Samples: 58306788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:14:12,858][708628] Avg episode reward: [(0, '3226.954')] [2023-03-09 13:14:16,981][709034] Updated weights for policy 0, policy_version 114000 (0.0005) [2023-03-09 13:14:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9386.1). Total num frames: 58376192. Throughput: 0: 9280.5. Samples: 58366156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:14:17,858][708628] Avg episode reward: [(0, '3678.047')] [2023-03-09 13:14:17,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000114016_58376192.pth... [2023-03-09 13:14:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000113464_58093568.pth [2023-03-09 13:14:21,524][709034] Updated weights for policy 0, policy_version 114080 (0.0005) [2023-03-09 13:14:22,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 58417152. Throughput: 0: 9341.1. Samples: 58420876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:14:22,858][708628] Avg episode reward: [(0, '4027.491')] [2023-03-09 13:14:26,032][709034] Updated weights for policy 0, policy_version 114160 (0.0004) [2023-03-09 13:14:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9372.2). Total num frames: 58466304. Throughput: 0: 9322.8. Samples: 58447576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:14:27,858][708628] Avg episode reward: [(0, '3845.633')] [2023-03-09 13:14:30,384][709034] Updated weights for policy 0, policy_version 114240 (0.0005) [2023-03-09 13:14:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 58511360. Throughput: 0: 9285.8. Samples: 58503168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:14:32,858][708628] Avg episode reward: [(0, '4001.618')] [2023-03-09 13:14:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000114280_58511360.pth... [2023-03-09 13:14:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000113736_58232832.pth [2023-03-09 13:14:34,893][709034] Updated weights for policy 0, policy_version 114320 (0.0005) [2023-03-09 13:14:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 58556416. Throughput: 0: 9220.3. Samples: 58557364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:14:37,858][708628] Avg episode reward: [(0, '3775.787')] [2023-03-09 13:14:39,464][709034] Updated weights for policy 0, policy_version 114400 (0.0005) [2023-03-09 13:14:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 58605568. Throughput: 0: 9258.9. Samples: 58587684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:14:42,858][708628] Avg episode reward: [(0, '3658.772')] [2023-03-09 13:14:43,696][709034] Updated weights for policy 0, policy_version 114480 (0.0005) [2023-03-09 13:14:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 58646528. Throughput: 0: 9242.0. Samples: 58640124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:14:47,858][708628] Avg episode reward: [(0, '3827.100')] [2023-03-09 13:14:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000114544_58646528.pth... [2023-03-09 13:14:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000114016_58376192.pth [2023-03-09 13:14:48,412][709034] Updated weights for policy 0, policy_version 114560 (0.0005) [2023-03-09 13:14:52,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9147.8, 300 sec: 9344.4). Total num frames: 58691584. Throughput: 0: 9176.6. Samples: 58694932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:14:52,857][708628] Avg episode reward: [(0, '3684.035')] [2023-03-09 13:14:52,961][709034] Updated weights for policy 0, policy_version 114640 (0.0005) [2023-03-09 13:14:57,439][709034] Updated weights for policy 0, policy_version 114720 (0.0005) [2023-03-09 13:14:57,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 58740736. Throughput: 0: 9225.7. Samples: 58721944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:14:57,858][708628] Avg episode reward: [(0, '3524.319')] [2023-03-09 13:15:01,649][709034] Updated weights for policy 0, policy_version 114800 (0.0005) [2023-03-09 13:15:02,857][708628] Fps is (10 sec: 9420.6, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 58785792. Throughput: 0: 9161.2. Samples: 58778412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:15:02,858][708628] Avg episode reward: [(0, '3685.470')] [2023-03-09 13:15:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000114816_58785792.pth... [2023-03-09 13:15:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000114280_58511360.pth [2023-03-09 13:15:06,143][709034] Updated weights for policy 0, policy_version 114880 (0.0004) [2023-03-09 13:15:07,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9344.4). Total num frames: 58830848. Throughput: 0: 9184.1. Samples: 58834160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:15:07,858][708628] Avg episode reward: [(0, '3768.457')] [2023-03-09 13:15:10,575][709034] Updated weights for policy 0, policy_version 114960 (0.0005) [2023-03-09 13:15:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 58880000. Throughput: 0: 9203.2. Samples: 58861720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:15:12,858][708628] Avg episode reward: [(0, '3775.862')] [2023-03-09 13:15:14,989][709034] Updated weights for policy 0, policy_version 115040 (0.0005) [2023-03-09 13:15:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9344.4). Total num frames: 58925056. Throughput: 0: 9194.7. Samples: 58916928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:15:17,858][708628] Avg episode reward: [(0, '3679.049')] [2023-03-09 13:15:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000115088_58925056.pth... [2023-03-09 13:15:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000114544_58646528.pth [2023-03-09 13:15:19,607][709034] Updated weights for policy 0, policy_version 115120 (0.0005) [2023-03-09 13:15:22,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 58966016. Throughput: 0: 9160.6. Samples: 58969592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:15:22,858][708628] Avg episode reward: [(0, '3590.844')] [2023-03-09 13:15:24,212][709034] Updated weights for policy 0, policy_version 115200 (0.0005) [2023-03-09 13:15:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9330.5). Total num frames: 59015168. Throughput: 0: 9081.1. Samples: 58996332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:15:27,858][708628] Avg episode reward: [(0, '3448.435')] [2023-03-09 13:15:28,663][709034] Updated weights for policy 0, policy_version 115280 (0.0005) [2023-03-09 13:15:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9330.5). Total num frames: 59060224. Throughput: 0: 9148.4. Samples: 59051804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:15:32,858][708628] Avg episode reward: [(0, '3985.770')] [2023-03-09 13:15:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000115352_59060224.pth... [2023-03-09 13:15:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000114816_58785792.pth [2023-03-09 13:15:33,239][709034] Updated weights for policy 0, policy_version 115360 (0.0005) [2023-03-09 13:15:37,640][709034] Updated weights for policy 0, policy_version 115440 (0.0004) [2023-03-09 13:15:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9330.5). Total num frames: 59105280. Throughput: 0: 9142.7. Samples: 59106356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:15:37,858][708628] Avg episode reward: [(0, '3651.831')] [2023-03-09 13:15:41,860][709034] Updated weights for policy 0, policy_version 115520 (0.0005) [2023-03-09 13:15:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9330.5). Total num frames: 59154432. Throughput: 0: 9157.1. Samples: 59134016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:15:42,858][708628] Avg episode reward: [(0, '3841.244')] [2023-03-09 13:15:46,262][709034] Updated weights for policy 0, policy_version 115600 (0.0005) [2023-03-09 13:15:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 59199488. Throughput: 0: 9176.8. Samples: 59191368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:15:47,858][708628] Avg episode reward: [(0, '3718.552')] [2023-03-09 13:15:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000115624_59199488.pth... [2023-03-09 13:15:47,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000115088_58925056.pth [2023-03-09 13:15:50,796][709034] Updated weights for policy 0, policy_version 115680 (0.0004) [2023-03-09 13:15:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 59244544. Throughput: 0: 9188.5. Samples: 59247640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:15:52,868][708628] Avg episode reward: [(0, '3713.046')] [2023-03-09 13:15:55,257][709034] Updated weights for policy 0, policy_version 115760 (0.0005) [2023-03-09 13:15:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9302.8). Total num frames: 59289600. Throughput: 0: 9144.5. Samples: 59273224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:15:57,868][708628] Avg episode reward: [(0, '3167.850')] [2023-03-09 13:15:59,772][709034] Updated weights for policy 0, policy_version 115840 (0.0005) [2023-03-09 13:16:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9302.8). Total num frames: 59334656. Throughput: 0: 9135.2. Samples: 59328012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:16:02,858][708628] Avg episode reward: [(0, '2620.293')] [2023-03-09 13:16:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000115888_59334656.pth... [2023-03-09 13:16:02,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000115352_59060224.pth [2023-03-09 13:16:04,365][709034] Updated weights for policy 0, policy_version 115920 (0.0005) [2023-03-09 13:16:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 59379712. Throughput: 0: 9179.6. Samples: 59382676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:16:07,858][708628] Avg episode reward: [(0, '3023.864')] [2023-03-09 13:16:08,805][709034] Updated weights for policy 0, policy_version 116000 (0.0005) [2023-03-09 13:16:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 59428864. Throughput: 0: 9224.2. Samples: 59411420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:16:12,858][708628] Avg episode reward: [(0, '3503.249')] [2023-03-09 13:16:13,197][709034] Updated weights for policy 0, policy_version 116080 (0.0005) [2023-03-09 13:16:17,750][709034] Updated weights for policy 0, policy_version 116160 (0.0005) [2023-03-09 13:16:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 59473920. Throughput: 0: 9198.7. Samples: 59465744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:16:17,858][708628] Avg episode reward: [(0, '3962.247')] [2023-03-09 13:16:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000116160_59473920.pth... [2023-03-09 13:16:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000115624_59199488.pth [2023-03-09 13:16:22,017][709034] Updated weights for policy 0, policy_version 116240 (0.0006) [2023-03-09 13:16:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 59518976. Throughput: 0: 9244.7. Samples: 59522368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:16:22,858][708628] Avg episode reward: [(0, '3812.904')] [2023-03-09 13:16:26,434][709034] Updated weights for policy 0, policy_version 116320 (0.0005) [2023-03-09 13:16:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 59568128. Throughput: 0: 9226.6. Samples: 59549212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:16:27,858][708628] Avg episode reward: [(0, '3758.635')] [2023-03-09 13:16:30,827][709034] Updated weights for policy 0, policy_version 116400 (0.0005) [2023-03-09 13:16:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 59613184. Throughput: 0: 9197.0. Samples: 59605232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:16:32,858][708628] Avg episode reward: [(0, '4123.002')] [2023-03-09 13:16:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000116440_59617280.pth... [2023-03-09 13:16:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000115888_59334656.pth [2023-03-09 13:16:35,003][709034] Updated weights for policy 0, policy_version 116480 (0.0005) [2023-03-09 13:16:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 59662336. Throughput: 0: 9222.8. Samples: 59662668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:16:37,858][708628] Avg episode reward: [(0, '3718.095')] [2023-03-09 13:16:39,527][709034] Updated weights for policy 0, policy_version 116560 (0.0005) [2023-03-09 13:16:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 59707392. Throughput: 0: 9266.3. Samples: 59690208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:16:42,858][708628] Avg episode reward: [(0, '3871.530')] [2023-03-09 13:16:43,944][709034] Updated weights for policy 0, policy_version 116640 (0.0004) [2023-03-09 13:16:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 59752448. Throughput: 0: 9251.5. Samples: 59744328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:16:47,858][708628] Avg episode reward: [(0, '3835.793')] [2023-03-09 13:16:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000116704_59752448.pth... [2023-03-09 13:16:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000116160_59473920.pth [2023-03-09 13:16:48,418][709034] Updated weights for policy 0, policy_version 116720 (0.0005) [2023-03-09 13:16:52,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 59797504. Throughput: 0: 9227.3. Samples: 59797904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:16:52,857][708628] Avg episode reward: [(0, '3995.208')] [2023-03-09 13:16:53,116][709034] Updated weights for policy 0, policy_version 116800 (0.0005) [2023-03-09 13:16:57,209][709034] Updated weights for policy 0, policy_version 116880 (0.0005) [2023-03-09 13:16:57,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 59846656. Throughput: 0: 9271.6. Samples: 59828644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:16:57,858][708628] Avg episode reward: [(0, '4108.549')] [2023-03-09 13:17:01,685][709034] Updated weights for policy 0, policy_version 116960 (0.0005) [2023-03-09 13:17:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 59891712. Throughput: 0: 9291.2. Samples: 59883848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:17:02,858][708628] Avg episode reward: [(0, '3976.266')] [2023-03-09 13:17:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000116976_59891712.pth... [2023-03-09 13:17:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000116440_59617280.pth [2023-03-09 13:17:06,135][709034] Updated weights for policy 0, policy_version 117040 (0.0005) [2023-03-09 13:17:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 59936768. Throughput: 0: 9269.3. Samples: 59939488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:17:07,858][708628] Avg episode reward: [(0, '4051.025')] [2023-03-09 13:17:10,574][709034] Updated weights for policy 0, policy_version 117120 (0.0005) [2023-03-09 13:17:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 59985920. Throughput: 0: 9287.3. Samples: 59967140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:17:12,858][708628] Avg episode reward: [(0, '4136.715')] [2023-03-09 13:17:15,080][709034] Updated weights for policy 0, policy_version 117200 (0.0005) [2023-03-09 13:17:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 60030976. Throughput: 0: 9257.4. Samples: 60021816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:17:17,858][708628] Avg episode reward: [(0, '4103.136')] [2023-03-09 13:17:17,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000117248_60030976.pth... [2023-03-09 13:17:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000116704_59752448.pth [2023-03-09 13:17:19,325][709034] Updated weights for policy 0, policy_version 117280 (0.0005) [2023-03-09 13:17:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 60080128. Throughput: 0: 9279.2. Samples: 60080232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:17:22,858][708628] Avg episode reward: [(0, '4000.200')] [2023-03-09 13:17:23,463][709034] Updated weights for policy 0, policy_version 117360 (0.0004) [2023-03-09 13:17:27,668][709034] Updated weights for policy 0, policy_version 117440 (0.0005) [2023-03-09 13:17:27,857][708628] Fps is (10 sec: 9830.5, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 60129280. Throughput: 0: 9344.8. Samples: 60110724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:17:27,858][708628] Avg episode reward: [(0, '3784.782')] [2023-03-09 13:17:32,316][709034] Updated weights for policy 0, policy_version 117520 (0.0005) [2023-03-09 13:17:32,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 60174336. Throughput: 0: 9372.9. Samples: 60166108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:17:32,858][708628] Avg episode reward: [(0, '3234.460')] [2023-03-09 13:17:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000117528_60174336.pth... [2023-03-09 13:17:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000116976_59891712.pth [2023-03-09 13:17:36,406][709034] Updated weights for policy 0, policy_version 117600 (0.0005) [2023-03-09 13:17:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 60223488. Throughput: 0: 9462.3. Samples: 60223708. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:17:37,858][708628] Avg episode reward: [(0, '2493.860')] [2023-03-09 13:17:40,509][709034] Updated weights for policy 0, policy_version 117680 (0.0005) [2023-03-09 13:17:42,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9288.9). Total num frames: 60272640. Throughput: 0: 9473.7. Samples: 60254960. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:17:42,858][708628] Avg episode reward: [(0, '2771.202')] [2023-03-09 13:17:44,904][709034] Updated weights for policy 0, policy_version 117760 (0.0005) [2023-03-09 13:17:47,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 60317696. Throughput: 0: 9464.9. Samples: 60309768. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:17:47,858][708628] Avg episode reward: [(0, '3711.216')] [2023-03-09 13:17:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000117808_60317696.pth... [2023-03-09 13:17:47,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000117248_60030976.pth [2023-03-09 13:17:49,373][709034] Updated weights for policy 0, policy_version 117840 (0.0005) [2023-03-09 13:17:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9261.1). Total num frames: 60362752. Throughput: 0: 9476.5. Samples: 60365932. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:17:52,858][708628] Avg episode reward: [(0, '3873.645')] [2023-03-09 13:17:53,862][709034] Updated weights for policy 0, policy_version 117920 (0.0005) [2023-03-09 13:17:57,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9261.1). Total num frames: 60411904. Throughput: 0: 9432.8. Samples: 60391616. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:17:57,858][708628] Avg episode reward: [(0, '4113.285')] [2023-03-09 13:17:58,289][709034] Updated weights for policy 0, policy_version 118000 (0.0005) [2023-03-09 13:18:02,695][709034] Updated weights for policy 0, policy_version 118080 (0.0005) [2023-03-09 13:18:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 60456960. Throughput: 0: 9487.1. Samples: 60448736. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:18:02,858][708628] Avg episode reward: [(0, '4124.987')] [2023-03-09 13:18:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000118080_60456960.pth... [2023-03-09 13:18:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000117528_60174336.pth [2023-03-09 13:18:07,205][709034] Updated weights for policy 0, policy_version 118160 (0.0004) [2023-03-09 13:18:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9261.1). Total num frames: 60502016. Throughput: 0: 9382.4. Samples: 60502440. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:18:07,858][708628] Avg episode reward: [(0, '4054.260')] [2023-03-09 13:18:11,545][709034] Updated weights for policy 0, policy_version 118240 (0.0004) [2023-03-09 13:18:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 60547072. Throughput: 0: 9332.5. Samples: 60530688. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:18:12,858][708628] Avg episode reward: [(0, '3659.409')] [2023-03-09 13:18:15,962][709034] Updated weights for policy 0, policy_version 118320 (0.0005) [2023-03-09 13:18:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9261.1). Total num frames: 60596224. Throughput: 0: 9384.2. Samples: 60588400. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:18:17,858][708628] Avg episode reward: [(0, '3557.006')] [2023-03-09 13:18:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000118352_60596224.pth... [2023-03-09 13:18:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000117808_60317696.pth [2023-03-09 13:18:20,133][709034] Updated weights for policy 0, policy_version 118400 (0.0004) [2023-03-09 13:18:22,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9261.1). Total num frames: 60645376. Throughput: 0: 9370.4. Samples: 60645376. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:18:22,858][708628] Avg episode reward: [(0, '3596.409')] [2023-03-09 13:18:24,517][709034] Updated weights for policy 0, policy_version 118480 (0.0005) [2023-03-09 13:18:27,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 60690432. Throughput: 0: 9296.4. Samples: 60673296. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:18:27,858][708628] Avg episode reward: [(0, '3614.668')] [2023-03-09 13:18:28,815][709034] Updated weights for policy 0, policy_version 118560 (0.0004) [2023-03-09 13:18:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9288.9). Total num frames: 60739584. Throughput: 0: 9369.0. Samples: 60731372. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:18:32,858][708628] Avg episode reward: [(0, '3178.830')] [2023-03-09 13:18:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000118632_60739584.pth... [2023-03-09 13:18:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000118080_60456960.pth [2023-03-09 13:18:33,215][709034] Updated weights for policy 0, policy_version 118640 (0.0005) [2023-03-09 13:18:37,576][709034] Updated weights for policy 0, policy_version 118720 (0.0005) [2023-03-09 13:18:37,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 60784640. Throughput: 0: 9344.0. Samples: 60786412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:18:37,858][708628] Avg episode reward: [(0, '3609.657')] [2023-03-09 13:18:41,753][709034] Updated weights for policy 0, policy_version 118800 (0.0004) [2023-03-09 13:18:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 60833792. Throughput: 0: 9410.0. Samples: 60815064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:18:42,858][708628] Avg episode reward: [(0, '3761.429')] [2023-03-09 13:18:45,964][709034] Updated weights for policy 0, policy_version 118880 (0.0005) [2023-03-09 13:18:47,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9288.9). Total num frames: 60882944. Throughput: 0: 9455.3. Samples: 60874224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:18:47,858][708628] Avg episode reward: [(0, '3602.338')] [2023-03-09 13:18:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000118912_60882944.pth... [2023-03-09 13:18:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000118352_60596224.pth [2023-03-09 13:18:50,344][709034] Updated weights for policy 0, policy_version 118960 (0.0005) [2023-03-09 13:18:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9288.9). Total num frames: 60928000. Throughput: 0: 9472.6. Samples: 60928708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:18:52,858][708628] Avg episode reward: [(0, '3743.871')] [2023-03-09 13:18:54,939][709034] Updated weights for policy 0, policy_version 119040 (0.0004) [2023-03-09 13:18:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 60973056. Throughput: 0: 9458.6. Samples: 60956324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:18:57,858][708628] Avg episode reward: [(0, '3654.430')] [2023-03-09 13:18:59,537][709034] Updated weights for policy 0, policy_version 119120 (0.0005) [2023-03-09 13:19:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 61018112. Throughput: 0: 9390.3. Samples: 61010964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:19:02,868][708628] Avg episode reward: [(0, '3775.391')] [2023-03-09 13:19:02,871][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000119176_61018112.pth... [2023-03-09 13:19:02,873][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000118632_60739584.pth [2023-03-09 13:19:03,816][709034] Updated weights for policy 0, policy_version 119200 (0.0005) [2023-03-09 13:19:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9288.9). Total num frames: 61067264. Throughput: 0: 9383.4. Samples: 61067628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:19:07,868][708628] Avg episode reward: [(0, '3756.261')] [2023-03-09 13:19:08,074][709034] Updated weights for policy 0, policy_version 119280 (0.0005) [2023-03-09 13:19:12,335][709034] Updated weights for policy 0, policy_version 119360 (0.0005) [2023-03-09 13:19:12,857][708628] Fps is (10 sec: 9830.5, 60 sec: 9489.1, 300 sec: 9288.9). Total num frames: 61116416. Throughput: 0: 9407.4. Samples: 61096628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:19:12,858][708628] Avg episode reward: [(0, '3473.559')] [2023-03-09 13:19:16,595][709034] Updated weights for policy 0, policy_version 119440 (0.0005) [2023-03-09 13:19:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9302.8). Total num frames: 61161472. Throughput: 0: 9413.5. Samples: 61154980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:19:17,858][708628] Avg episode reward: [(0, '3366.687')] [2023-03-09 13:19:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000119456_61161472.pth... [2023-03-09 13:19:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000118912_60882944.pth [2023-03-09 13:19:21,336][709034] Updated weights for policy 0, policy_version 119520 (0.0004) [2023-03-09 13:19:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 61206528. Throughput: 0: 9339.1. Samples: 61206672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:19:22,858][708628] Avg episode reward: [(0, '3479.646')] [2023-03-09 13:19:25,844][709034] Updated weights for policy 0, policy_version 119600 (0.0006) [2023-03-09 13:19:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 61251584. Throughput: 0: 9331.4. Samples: 61234976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:19:27,858][708628] Avg episode reward: [(0, '3186.651')] [2023-03-09 13:19:30,390][709034] Updated weights for policy 0, policy_version 119680 (0.0005) [2023-03-09 13:19:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 61296640. Throughput: 0: 9206.6. Samples: 61288520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:19:32,858][708628] Avg episode reward: [(0, '3234.362')] [2023-03-09 13:19:32,859][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000119720_61296640.pth... [2023-03-09 13:19:32,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000119176_61018112.pth [2023-03-09 13:19:34,728][709034] Updated weights for policy 0, policy_version 119760 (0.0004) [2023-03-09 13:19:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 61345792. Throughput: 0: 9248.0. Samples: 61344868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:19:37,858][708628] Avg episode reward: [(0, '3618.027')] [2023-03-09 13:19:39,264][709034] Updated weights for policy 0, policy_version 119840 (0.0005) [2023-03-09 13:19:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 61390848. Throughput: 0: 9226.5. Samples: 61371516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:19:42,858][708628] Avg episode reward: [(0, '3681.852')] [2023-03-09 13:19:43,658][709034] Updated weights for policy 0, policy_version 119920 (0.0005) [2023-03-09 13:19:47,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 61431808. Throughput: 0: 9247.1. Samples: 61427084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:19:47,858][708628] Avg episode reward: [(0, '3552.011')] [2023-03-09 13:19:47,911][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000119992_61435904.pth... [2023-03-09 13:19:47,913][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000119456_61161472.pth [2023-03-09 13:19:48,321][709034] Updated weights for policy 0, policy_version 120000 (0.0005) [2023-03-09 13:19:52,776][709034] Updated weights for policy 0, policy_version 120080 (0.0005) [2023-03-09 13:19:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 61480960. Throughput: 0: 9185.4. Samples: 61480972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:19:52,858][708628] Avg episode reward: [(0, '3489.289')] [2023-03-09 13:19:57,173][709034] Updated weights for policy 0, policy_version 120160 (0.0005) [2023-03-09 13:19:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 61526016. Throughput: 0: 9179.5. Samples: 61509704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:19:57,858][708628] Avg episode reward: [(0, '3353.547')] [2023-03-09 13:20:01,708][709034] Updated weights for policy 0, policy_version 120240 (0.0005) [2023-03-09 13:20:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 61571072. Throughput: 0: 9066.6. Samples: 61562976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:20:02,858][708628] Avg episode reward: [(0, '2190.519')] [2023-03-09 13:20:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000120256_61571072.pth... [2023-03-09 13:20:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000119720_61296640.pth [2023-03-09 13:20:06,273][709034] Updated weights for policy 0, policy_version 120320 (0.0005) [2023-03-09 13:20:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9275.0). Total num frames: 61616128. Throughput: 0: 9132.5. Samples: 61617636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:20:07,858][708628] Avg episode reward: [(0, '2146.021')] [2023-03-09 13:20:10,657][709034] Updated weights for policy 0, policy_version 120400 (0.0005) [2023-03-09 13:20:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9275.0). Total num frames: 61661184. Throughput: 0: 9122.8. Samples: 61645500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:20:12,858][708628] Avg episode reward: [(0, '1547.172')] [2023-03-09 13:20:15,263][709034] Updated weights for policy 0, policy_version 120480 (0.0005) [2023-03-09 13:20:17,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9288.9). Total num frames: 61706240. Throughput: 0: 9131.1. Samples: 61699420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:20:17,858][708628] Avg episode reward: [(0, '1302.577')] [2023-03-09 13:20:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000120520_61706240.pth... [2023-03-09 13:20:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000119992_61435904.pth [2023-03-09 13:20:19,739][709034] Updated weights for policy 0, policy_version 120560 (0.0005) [2023-03-09 13:20:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9275.0). Total num frames: 61751296. Throughput: 0: 9105.8. Samples: 61754628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:20:22,858][708628] Avg episode reward: [(0, '1615.434')] [2023-03-09 13:20:24,189][709034] Updated weights for policy 0, policy_version 120640 (0.0005) [2023-03-09 13:20:27,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 61800448. Throughput: 0: 9115.9. Samples: 61781732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:20:27,858][708628] Avg episode reward: [(0, '2518.415')] [2023-03-09 13:20:28,637][708990] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000005 [2023-03-09 13:20:28,639][709034] Updated weights for policy 0, policy_version 120720 (0.0005) [2023-03-09 13:20:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 61845504. Throughput: 0: 9124.4. Samples: 61837680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:20:32,858][708628] Avg episode reward: [(0, '2151.844')] [2023-03-09 13:20:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000120792_61845504.pth... [2023-03-09 13:20:32,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000120256_61571072.pth [2023-03-09 13:20:32,964][709034] Updated weights for policy 0, policy_version 120800 (0.0005) [2023-03-09 13:20:37,403][709034] Updated weights for policy 0, policy_version 120880 (0.0004) [2023-03-09 13:20:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 61894656. Throughput: 0: 9187.8. Samples: 61894424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:20:37,858][708628] Avg episode reward: [(0, '2914.970')] [2023-03-09 13:20:41,870][709034] Updated weights for policy 0, policy_version 120960 (0.0005) [2023-03-09 13:20:42,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 61939712. Throughput: 0: 9121.9. Samples: 61920188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:20:42,858][708628] Avg episode reward: [(0, '2767.010')] [2023-03-09 13:20:46,260][709034] Updated weights for policy 0, policy_version 121040 (0.0004) [2023-03-09 13:20:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 61984768. Throughput: 0: 9192.5. Samples: 61976640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:20:47,858][708628] Avg episode reward: [(0, '2347.860')] [2023-03-09 13:20:47,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000121064_61984768.pth... [2023-03-09 13:20:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000120520_61706240.pth [2023-03-09 13:20:50,720][709034] Updated weights for policy 0, policy_version 121120 (0.0004) [2023-03-09 13:20:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 62029824. Throughput: 0: 9197.1. Samples: 62031504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:20:52,858][708628] Avg episode reward: [(0, '2791.809')] [2023-03-09 13:20:55,423][709034] Updated weights for policy 0, policy_version 121200 (0.0005) [2023-03-09 13:20:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 62074880. Throughput: 0: 9169.3. Samples: 62058120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:20:57,858][708628] Avg episode reward: [(0, '2361.917')] [2023-03-09 13:20:59,910][709034] Updated weights for policy 0, policy_version 121280 (0.0005) [2023-03-09 13:21:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 62119936. Throughput: 0: 9168.3. Samples: 62111992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:21:02,858][708628] Avg episode reward: [(0, '2089.945')] [2023-03-09 13:21:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000121328_62119936.pth... [2023-03-09 13:21:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000120792_61845504.pth [2023-03-09 13:21:04,474][709034] Updated weights for policy 0, policy_version 121360 (0.0005) [2023-03-09 13:21:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9275.0). Total num frames: 62164992. Throughput: 0: 9127.8. Samples: 62165380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:21:07,858][708628] Avg episode reward: [(0, '2095.413')] [2023-03-09 13:21:08,993][709034] Updated weights for policy 0, policy_version 121440 (0.0005) [2023-03-09 13:21:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 62214144. Throughput: 0: 9177.2. Samples: 62194704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:21:12,868][708628] Avg episode reward: [(0, '2605.558')] [2023-03-09 13:21:13,280][709034] Updated weights for policy 0, policy_version 121520 (0.0005) [2023-03-09 13:21:17,725][709034] Updated weights for policy 0, policy_version 121600 (0.0004) [2023-03-09 13:21:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 62259200. Throughput: 0: 9185.0. Samples: 62251004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:21:17,868][708628] Avg episode reward: [(0, '2284.904')] [2023-03-09 13:21:17,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000121600_62259200.pth... [2023-03-09 13:21:17,874][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000121064_61984768.pth [2023-03-09 13:21:22,193][709034] Updated weights for policy 0, policy_version 121680 (0.0005) [2023-03-09 13:21:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 62304256. Throughput: 0: 9127.8. Samples: 62305176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:21:22,868][708628] Avg episode reward: [(0, '2486.458')] [2023-03-09 13:21:26,543][709034] Updated weights for policy 0, policy_version 121760 (0.0005) [2023-03-09 13:21:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 62353408. Throughput: 0: 9197.5. Samples: 62334076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:21:27,858][708628] Avg episode reward: [(0, '3061.538')] [2023-03-09 13:21:31,022][709034] Updated weights for policy 0, policy_version 121840 (0.0005) [2023-03-09 13:21:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 62398464. Throughput: 0: 9162.8. Samples: 62388964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:21:32,868][708628] Avg episode reward: [(0, '3456.132')] [2023-03-09 13:21:32,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000121872_62398464.pth... [2023-03-09 13:21:32,874][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000121328_62119936.pth [2023-03-09 13:21:35,489][709034] Updated weights for policy 0, policy_version 121920 (0.0005) [2023-03-09 13:21:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9275.0). Total num frames: 62443520. Throughput: 0: 9168.4. Samples: 62444080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:21:37,868][708628] Avg episode reward: [(0, '3442.147')] [2023-03-09 13:21:39,838][709034] Updated weights for policy 0, policy_version 122000 (0.0005) [2023-03-09 13:21:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 62492672. Throughput: 0: 9224.6. Samples: 62473228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:21:42,868][708628] Avg episode reward: [(0, '3250.549')] [2023-03-09 13:21:43,981][709034] Updated weights for policy 0, policy_version 122080 (0.0005) [2023-03-09 13:21:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 62537728. Throughput: 0: 9278.7. Samples: 62529532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:21:47,868][708628] Avg episode reward: [(0, '3133.129')] [2023-03-09 13:21:47,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000122144_62537728.pth... [2023-03-09 13:21:47,875][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000121600_62259200.pth [2023-03-09 13:21:48,672][709034] Updated weights for policy 0, policy_version 122160 (0.0005) [2023-03-09 13:21:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 62582784. Throughput: 0: 9278.3. Samples: 62582904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:21:52,868][708628] Avg episode reward: [(0, '2594.787')] [2023-03-09 13:21:53,121][709034] Updated weights for policy 0, policy_version 122240 (0.0005) [2023-03-09 13:21:57,665][709034] Updated weights for policy 0, policy_version 122320 (0.0005) [2023-03-09 13:21:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 62627840. Throughput: 0: 9258.0. Samples: 62611316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:21:57,868][708628] Avg episode reward: [(0, '2062.098')] [2023-03-09 13:22:01,903][709034] Updated weights for policy 0, policy_version 122400 (0.0005) [2023-03-09 13:22:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 62676992. Throughput: 0: 9271.5. Samples: 62668224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:22:02,858][708628] Avg episode reward: [(0, '1926.585')] [2023-03-09 13:22:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000122416_62676992.pth... [2023-03-09 13:22:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000121872_62398464.pth [2023-03-09 13:22:06,191][709034] Updated weights for policy 0, policy_version 122480 (0.0005) [2023-03-09 13:22:07,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 62726144. Throughput: 0: 9356.8. Samples: 62726232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:22:07,858][708628] Avg episode reward: [(0, '2323.871')] [2023-03-09 13:22:10,227][709034] Updated weights for policy 0, policy_version 122560 (0.0005) [2023-03-09 13:22:12,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9302.8). Total num frames: 62775296. Throughput: 0: 9361.3. Samples: 62755336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:22:12,858][708628] Avg episode reward: [(0, '3228.480')] [2023-03-09 13:22:14,583][709034] Updated weights for policy 0, policy_version 122640 (0.0005) [2023-03-09 13:22:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 62820352. Throughput: 0: 9404.1. Samples: 62812148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:22:17,858][708628] Avg episode reward: [(0, '3257.606')] [2023-03-09 13:22:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000122696_62820352.pth... [2023-03-09 13:22:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000122144_62537728.pth [2023-03-09 13:22:19,085][709034] Updated weights for policy 0, policy_version 122720 (0.0005) [2023-03-09 13:22:22,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 62865408. Throughput: 0: 9364.4. Samples: 62865480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:22:22,858][708628] Avg episode reward: [(0, '3153.454')] [2023-03-09 13:22:23,633][709034] Updated weights for policy 0, policy_version 122800 (0.0005) [2023-03-09 13:22:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 62910464. Throughput: 0: 9342.6. Samples: 62893644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:22:27,858][708628] Avg episode reward: [(0, '3288.571')] [2023-03-09 13:22:27,957][709034] Updated weights for policy 0, policy_version 122880 (0.0005) [2023-03-09 13:22:32,187][709034] Updated weights for policy 0, policy_version 122960 (0.0005) [2023-03-09 13:22:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 62959616. Throughput: 0: 9376.8. Samples: 62951488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:22:32,858][708628] Avg episode reward: [(0, '2309.393')] [2023-03-09 13:22:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000122968_62959616.pth... [2023-03-09 13:22:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000122416_62676992.pth [2023-03-09 13:22:36,479][709034] Updated weights for policy 0, policy_version 123040 (0.0005) [2023-03-09 13:22:37,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 63008768. Throughput: 0: 9462.6. Samples: 63008720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:22:37,858][708628] Avg episode reward: [(0, '2327.404')] [2023-03-09 13:22:40,793][709034] Updated weights for policy 0, policy_version 123120 (0.0005) [2023-03-09 13:22:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 63053824. Throughput: 0: 9468.2. Samples: 63037384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:22:42,858][708628] Avg episode reward: [(0, '2380.932')] [2023-03-09 13:22:45,266][709034] Updated weights for policy 0, policy_version 123200 (0.0005) [2023-03-09 13:22:47,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 63098880. Throughput: 0: 9435.7. Samples: 63092828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:22:47,858][708628] Avg episode reward: [(0, '2542.618')] [2023-03-09 13:22:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000123240_63098880.pth... [2023-03-09 13:22:47,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000122696_62820352.pth [2023-03-09 13:22:49,750][709034] Updated weights for policy 0, policy_version 123280 (0.0005) [2023-03-09 13:22:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 63148032. Throughput: 0: 9368.3. Samples: 63147804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:22:52,858][708628] Avg episode reward: [(0, '2664.222')] [2023-03-09 13:22:54,023][709034] Updated weights for policy 0, policy_version 123360 (0.0004) [2023-03-09 13:22:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 63193088. Throughput: 0: 9357.5. Samples: 63176420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:22:57,858][708628] Avg episode reward: [(0, '2547.846')] [2023-03-09 13:22:58,388][709034] Updated weights for policy 0, policy_version 123440 (0.0005) [2023-03-09 13:23:02,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.6, 300 sec: 9275.0). Total num frames: 63238144. Throughput: 0: 9338.9. Samples: 63232400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:23:02,858][708628] Avg episode reward: [(0, '2923.126')] [2023-03-09 13:23:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000123512_63238144.pth... [2023-03-09 13:23:02,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000122968_62959616.pth [2023-03-09 13:23:02,904][709034] Updated weights for policy 0, policy_version 123520 (0.0005) [2023-03-09 13:23:07,307][709034] Updated weights for policy 0, policy_version 123600 (0.0005) [2023-03-09 13:23:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 63287296. Throughput: 0: 9373.7. Samples: 63287296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:23:07,858][708628] Avg episode reward: [(0, '2615.430')] [2023-03-09 13:23:11,455][709034] Updated weights for policy 0, policy_version 123680 (0.0004) [2023-03-09 13:23:12,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 63336448. Throughput: 0: 9393.5. Samples: 63316352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:23:12,858][708628] Avg episode reward: [(0, '2718.182')] [2023-03-09 13:23:16,034][709034] Updated weights for policy 0, policy_version 123760 (0.0005) [2023-03-09 13:23:17,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 63377408. Throughput: 0: 9356.4. Samples: 63372524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:23:17,858][708628] Avg episode reward: [(0, '2604.322')] [2023-03-09 13:23:17,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000123792_63381504.pth... [2023-03-09 13:23:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000123240_63098880.pth [2023-03-09 13:23:20,560][709034] Updated weights for policy 0, policy_version 123840 (0.0004) [2023-03-09 13:23:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 63426560. Throughput: 0: 9284.5. Samples: 63426524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:23:22,858][708628] Avg episode reward: [(0, '2347.681')] [2023-03-09 13:23:25,048][709034] Updated weights for policy 0, policy_version 123920 (0.0005) [2023-03-09 13:23:27,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 63475712. Throughput: 0: 9264.2. Samples: 63454272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:23:27,858][708628] Avg episode reward: [(0, '2732.081')] [2023-03-09 13:23:29,196][709034] Updated weights for policy 0, policy_version 124000 (0.0005) [2023-03-09 13:23:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 63520768. Throughput: 0: 9325.9. Samples: 63512496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:23:32,858][708628] Avg episode reward: [(0, '2868.521')] [2023-03-09 13:23:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000124064_63520768.pth... [2023-03-09 13:23:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000123512_63238144.pth [2023-03-09 13:23:33,411][709034] Updated weights for policy 0, policy_version 124080 (0.0005) [2023-03-09 13:23:37,792][709034] Updated weights for policy 0, policy_version 124160 (0.0005) [2023-03-09 13:23:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 63569920. Throughput: 0: 9379.5. Samples: 63569880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:23:37,858][708628] Avg episode reward: [(0, '2827.225')] [2023-03-09 13:23:42,121][709034] Updated weights for policy 0, policy_version 124240 (0.0005) [2023-03-09 13:23:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 63614976. Throughput: 0: 9369.1. Samples: 63598028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:23:42,858][708628] Avg episode reward: [(0, '3290.892')] [2023-03-09 13:23:46,446][709034] Updated weights for policy 0, policy_version 124320 (0.0005) [2023-03-09 13:23:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 63664128. Throughput: 0: 9401.0. Samples: 63655444. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:23:47,858][708628] Avg episode reward: [(0, '2485.385')] [2023-03-09 13:23:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000124344_63664128.pth... [2023-03-09 13:23:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000123792_63381504.pth [2023-03-09 13:23:50,799][709034] Updated weights for policy 0, policy_version 124400 (0.0005) [2023-03-09 13:23:52,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 63709184. Throughput: 0: 9393.1. Samples: 63709984. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:23:52,858][708628] Avg episode reward: [(0, '2449.596')] [2023-03-09 13:23:55,395][709034] Updated weights for policy 0, policy_version 124480 (0.0005) [2023-03-09 13:23:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 63754240. Throughput: 0: 9363.1. Samples: 63737692. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:23:57,858][708628] Avg episode reward: [(0, '2659.859')] [2023-03-09 13:23:59,993][709034] Updated weights for policy 0, policy_version 124560 (0.0005) [2023-03-09 13:24:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 63799296. Throughput: 0: 9300.2. Samples: 63791032. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:24:02,858][708628] Avg episode reward: [(0, '2074.310')] [2023-03-09 13:24:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000124608_63799296.pth... [2023-03-09 13:24:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000124064_63520768.pth [2023-03-09 13:24:04,393][709034] Updated weights for policy 0, policy_version 124640 (0.0005) [2023-03-09 13:24:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9247.2). Total num frames: 63844352. Throughput: 0: 9286.5. Samples: 63844416. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:24:07,858][708628] Avg episode reward: [(0, '2321.200')] [2023-03-09 13:24:09,060][709034] Updated weights for policy 0, policy_version 124720 (0.0006) [2023-03-09 13:24:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 63889408. Throughput: 0: 9305.6. Samples: 63873024. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:24:12,858][708628] Avg episode reward: [(0, '3257.669')] [2023-03-09 13:24:13,382][709034] Updated weights for policy 0, policy_version 124800 (0.0005) [2023-03-09 13:24:17,652][709034] Updated weights for policy 0, policy_version 124880 (0.0005) [2023-03-09 13:24:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 63938560. Throughput: 0: 9279.3. Samples: 63930064. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:24:17,858][708628] Avg episode reward: [(0, '3009.311')] [2023-03-09 13:24:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000124880_63938560.pth... [2023-03-09 13:24:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000124344_63664128.pth [2023-03-09 13:24:22,089][709034] Updated weights for policy 0, policy_version 124960 (0.0005) [2023-03-09 13:24:22,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 63987712. Throughput: 0: 9284.7. Samples: 63987692. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:24:22,858][708628] Avg episode reward: [(0, '2858.653')] [2023-03-09 13:24:26,249][709034] Updated weights for policy 0, policy_version 125040 (0.0005) [2023-03-09 13:24:27,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 64032768. Throughput: 0: 9296.9. Samples: 64016388. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:24:27,857][708628] Avg episode reward: [(0, '3064.441')] [2023-03-09 13:24:30,603][709034] Updated weights for policy 0, policy_version 125120 (0.0004) [2023-03-09 13:24:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 64081920. Throughput: 0: 9249.8. Samples: 64071684. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:24:32,858][708628] Avg episode reward: [(0, '2790.717')] [2023-03-09 13:24:32,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000125160_64081920.pth... [2023-03-09 13:24:32,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000124608_63799296.pth [2023-03-09 13:24:35,083][709034] Updated weights for policy 0, policy_version 125200 (0.0005) [2023-03-09 13:24:37,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 64126976. Throughput: 0: 9268.1. Samples: 64127048. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:24:37,858][708628] Avg episode reward: [(0, '2142.361')] [2023-03-09 13:24:39,457][709034] Updated weights for policy 0, policy_version 125280 (0.0005) [2023-03-09 13:24:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 64172032. Throughput: 0: 9284.8. Samples: 64155508. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:24:42,858][708628] Avg episode reward: [(0, '2004.099')] [2023-03-09 13:24:43,736][709034] Updated weights for policy 0, policy_version 125360 (0.0005) [2023-03-09 13:24:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9288.9). Total num frames: 64221184. Throughput: 0: 9412.4. Samples: 64214592. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:24:47,858][708628] Avg episode reward: [(0, '2153.053')] [2023-03-09 13:24:47,869][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000125440_64225280.pth... [2023-03-09 13:24:47,870][709034] Updated weights for policy 0, policy_version 125440 (0.0005) [2023-03-09 13:24:47,871][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000124880_63938560.pth [2023-03-09 13:24:52,237][709034] Updated weights for policy 0, policy_version 125520 (0.0005) [2023-03-09 13:24:52,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9302.8). Total num frames: 64270336. Throughput: 0: 9486.0. Samples: 64271284. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:24:52,858][708628] Avg episode reward: [(0, '1970.554')] [2023-03-09 13:24:56,580][709034] Updated weights for policy 0, policy_version 125600 (0.0005) [2023-03-09 13:24:57,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9302.8). Total num frames: 64315392. Throughput: 0: 9476.6. Samples: 64299472. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:24:57,858][708628] Avg episode reward: [(0, '2015.839')] [2023-03-09 13:25:01,076][709034] Updated weights for policy 0, policy_version 125680 (0.0005) [2023-03-09 13:25:02,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9302.8). Total num frames: 64360448. Throughput: 0: 9450.6. Samples: 64355340. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:25:02,858][708628] Avg episode reward: [(0, '2136.868')] [2023-03-09 13:25:02,908][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000125712_64364544.pth... [2023-03-09 13:25:02,910][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000125160_64081920.pth [2023-03-09 13:25:05,581][709034] Updated weights for policy 0, policy_version 125760 (0.0006) [2023-03-09 13:25:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 64409600. Throughput: 0: 9396.8. Samples: 64410548. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:25:07,858][708628] Avg episode reward: [(0, '2618.002')] [2023-03-09 13:25:09,932][709034] Updated weights for policy 0, policy_version 125840 (0.0005) [2023-03-09 13:25:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 64454656. Throughput: 0: 9367.2. Samples: 64437912. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:25:12,858][708628] Avg episode reward: [(0, '2561.517')] [2023-03-09 13:25:14,216][709034] Updated weights for policy 0, policy_version 125920 (0.0005) [2023-03-09 13:25:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 64503808. Throughput: 0: 9417.9. Samples: 64495488. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:25:17,858][708628] Avg episode reward: [(0, '2656.181')] [2023-03-09 13:25:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000125984_64503808.pth... [2023-03-09 13:25:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000125440_64225280.pth [2023-03-09 13:25:18,513][709034] Updated weights for policy 0, policy_version 126000 (0.0005) [2023-03-09 13:25:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 64548864. Throughput: 0: 9381.3. Samples: 64549208. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:25:22,858][708628] Avg episode reward: [(0, '2293.395')] [2023-03-09 13:25:23,103][709034] Updated weights for policy 0, policy_version 126080 (0.0004) [2023-03-09 13:25:27,449][709034] Updated weights for policy 0, policy_version 126160 (0.0005) [2023-03-09 13:25:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 64593920. Throughput: 0: 9385.0. Samples: 64577832. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:25:27,857][708628] Avg episode reward: [(0, '1799.569')] [2023-03-09 13:25:31,832][709034] Updated weights for policy 0, policy_version 126240 (0.0005) [2023-03-09 13:25:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 64643072. Throughput: 0: 9335.5. Samples: 64634688. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:25:32,858][708628] Avg episode reward: [(0, '1496.772')] [2023-03-09 13:25:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000126256_64643072.pth... [2023-03-09 13:25:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000125712_64364544.pth [2023-03-09 13:25:35,946][709034] Updated weights for policy 0, policy_version 126320 (0.0005) [2023-03-09 13:25:37,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9330.6). Total num frames: 64692224. Throughput: 0: 9353.8. Samples: 64692204. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:25:37,858][708628] Avg episode reward: [(0, '1346.515')] [2023-03-09 13:25:40,366][709034] Updated weights for policy 0, policy_version 126400 (0.0005) [2023-03-09 13:25:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9330.6). Total num frames: 64737280. Throughput: 0: 9363.3. Samples: 64720820. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:25:42,858][708628] Avg episode reward: [(0, '1675.072')] [2023-03-09 13:25:44,677][709034] Updated weights for policy 0, policy_version 126480 (0.0004) [2023-03-09 13:25:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 64786432. Throughput: 0: 9397.8. Samples: 64778240. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:25:47,858][708628] Avg episode reward: [(0, '1376.044')] [2023-03-09 13:25:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000126536_64786432.pth... [2023-03-09 13:25:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000125984_64503808.pth [2023-03-09 13:25:48,804][709034] Updated weights for policy 0, policy_version 126560 (0.0004) [2023-03-09 13:25:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 64831488. Throughput: 0: 9438.7. Samples: 64835288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:25:52,868][708628] Avg episode reward: [(0, '1540.634')] [2023-03-09 13:25:53,348][709034] Updated weights for policy 0, policy_version 126640 (0.0004) [2023-03-09 13:25:57,532][709034] Updated weights for policy 0, policy_version 126720 (0.0005) [2023-03-09 13:25:57,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 64880640. Throughput: 0: 9468.7. Samples: 64864004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:25:57,868][708628] Avg episode reward: [(0, '1408.372')] [2023-03-09 13:26:01,954][709034] Updated weights for policy 0, policy_version 126800 (0.0005) [2023-03-09 13:26:02,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 64929792. Throughput: 0: 9433.6. Samples: 64920000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:26:02,868][708628] Avg episode reward: [(0, '2010.449')] [2023-03-09 13:26:02,871][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000126816_64929792.pth... [2023-03-09 13:26:02,874][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000126256_64643072.pth [2023-03-09 13:26:06,334][709034] Updated weights for policy 0, policy_version 126880 (0.0005) [2023-03-09 13:26:07,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 64974848. Throughput: 0: 9479.5. Samples: 64975784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:26:07,858][708628] Avg episode reward: [(0, '2450.286')] [2023-03-09 13:26:10,628][709034] Updated weights for policy 0, policy_version 126960 (0.0005) [2023-03-09 13:26:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 65024000. Throughput: 0: 9482.8. Samples: 65004560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:26:12,858][708628] Avg episode reward: [(0, '2618.143')] [2023-03-09 13:26:14,912][709034] Updated weights for policy 0, policy_version 127040 (0.0005) [2023-03-09 13:26:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 65069056. Throughput: 0: 9487.4. Samples: 65061620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:26:17,858][708628] Avg episode reward: [(0, '2217.425')] [2023-03-09 13:26:17,885][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000127096_65073152.pth... [2023-03-09 13:26:17,887][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000126536_64786432.pth [2023-03-09 13:26:19,373][709034] Updated weights for policy 0, policy_version 127120 (0.0005) [2023-03-09 13:26:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 65114112. Throughput: 0: 9377.3. Samples: 65114184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:26:22,858][708628] Avg episode reward: [(0, '2526.872')] [2023-03-09 13:26:24,218][709034] Updated weights for policy 0, policy_version 127200 (0.0005) [2023-03-09 13:26:27,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 65155072. Throughput: 0: 9285.9. Samples: 65138688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:26:27,858][708628] Avg episode reward: [(0, '2513.321')] [2023-03-09 13:26:29,111][709034] Updated weights for policy 0, policy_version 127280 (0.0005) [2023-03-09 13:26:32,857][708628] Fps is (10 sec: 8191.9, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 65196032. Throughput: 0: 9111.8. Samples: 65188272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:26:32,858][708628] Avg episode reward: [(0, '2208.175')] [2023-03-09 13:26:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000127336_65196032.pth... [2023-03-09 13:26:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000126816_64929792.pth [2023-03-09 13:26:34,044][709034] Updated weights for policy 0, policy_version 127360 (0.0005) [2023-03-09 13:26:37,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 65241088. Throughput: 0: 9019.2. Samples: 65241152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:26:37,858][708628] Avg episode reward: [(0, '2665.478')] [2023-03-09 13:26:38,594][709034] Updated weights for policy 0, policy_version 127440 (0.0005) [2023-03-09 13:26:42,857][708628] Fps is (10 sec: 9011.4, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 65286144. Throughput: 0: 9047.7. Samples: 65271152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:26:42,857][708628] Avg episode reward: [(0, '3174.010')] [2023-03-09 13:26:42,943][709034] Updated weights for policy 0, policy_version 127520 (0.0005) [2023-03-09 13:26:47,531][709034] Updated weights for policy 0, policy_version 127600 (0.0006) [2023-03-09 13:26:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9316.7). Total num frames: 65331200. Throughput: 0: 8982.3. Samples: 65324204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:26:47,858][708628] Avg episode reward: [(0, '2551.864')] [2023-03-09 13:26:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000127600_65331200.pth... [2023-03-09 13:26:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000127096_65073152.pth [2023-03-09 13:26:51,797][709034] Updated weights for policy 0, policy_version 127680 (0.0005) [2023-03-09 13:26:52,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9330.5). Total num frames: 65380352. Throughput: 0: 9009.4. Samples: 65381208. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:26:52,858][708628] Avg episode reward: [(0, '2531.376')] [2023-03-09 13:26:56,149][709034] Updated weights for policy 0, policy_version 127760 (0.0005) [2023-03-09 13:26:57,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9147.7, 300 sec: 9330.6). Total num frames: 65429504. Throughput: 0: 8989.5. Samples: 65409088. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:26:57,858][708628] Avg episode reward: [(0, '1948.958')] [2023-03-09 13:27:00,374][709034] Updated weights for policy 0, policy_version 127840 (0.0005) [2023-03-09 13:27:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9316.7). Total num frames: 65474560. Throughput: 0: 9016.6. Samples: 65467368. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:27:02,858][708628] Avg episode reward: [(0, '1209.182')] [2023-03-09 13:27:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000127880_65474560.pth... [2023-03-09 13:27:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000127336_65196032.pth [2023-03-09 13:27:04,750][709034] Updated weights for policy 0, policy_version 127920 (0.0005) [2023-03-09 13:27:07,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9302.8). Total num frames: 65519616. Throughput: 0: 9073.7. Samples: 65522500. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:27:07,858][708628] Avg episode reward: [(0, '707.115')] [2023-03-09 13:27:09,233][709034] Updated weights for policy 0, policy_version 128000 (0.0005) [2023-03-09 13:27:12,857][708628] Fps is (10 sec: 9421.0, 60 sec: 9079.5, 300 sec: 9316.7). Total num frames: 65568768. Throughput: 0: 9121.4. Samples: 65549148. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:27:12,857][708628] Avg episode reward: [(0, '317.394')] [2023-03-09 13:27:13,695][709034] Updated weights for policy 0, policy_version 128080 (0.0005) [2023-03-09 13:27:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 9316.7). Total num frames: 65613824. Throughput: 0: 9224.6. Samples: 65603376. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:27:17,858][708628] Avg episode reward: [(0, '656.124')] [2023-03-09 13:27:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000128152_65613824.pth... [2023-03-09 13:27:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000127600_65331200.pth [2023-03-09 13:27:18,241][709034] Updated weights for policy 0, policy_version 128160 (0.0005) [2023-03-09 13:27:22,592][709034] Updated weights for policy 0, policy_version 128240 (0.0005) [2023-03-09 13:27:22,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9079.5, 300 sec: 9316.7). Total num frames: 65658880. Throughput: 0: 9316.4. Samples: 65660392. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:27:22,858][708628] Avg episode reward: [(0, '1139.754')] [2023-03-09 13:27:26,878][709034] Updated weights for policy 0, policy_version 128320 (0.0005) [2023-03-09 13:27:27,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 65708032. Throughput: 0: 9294.1. Samples: 65689388. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:27:27,858][708628] Avg episode reward: [(0, '1554.934')] [2023-03-09 13:27:31,186][709034] Updated weights for policy 0, policy_version 128400 (0.0005) [2023-03-09 13:27:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 65753088. Throughput: 0: 9390.1. Samples: 65746760. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:27:32,858][708628] Avg episode reward: [(0, '1316.287')] [2023-03-09 13:27:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000128424_65753088.pth... [2023-03-09 13:27:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000127880_65474560.pth [2023-03-09 13:27:35,531][709034] Updated weights for policy 0, policy_version 128480 (0.0005) [2023-03-09 13:27:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 65802240. Throughput: 0: 9362.1. Samples: 65802504. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:27:37,858][708628] Avg episode reward: [(0, '1084.031')] [2023-03-09 13:27:39,806][709034] Updated weights for policy 0, policy_version 128560 (0.0005) [2023-03-09 13:27:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 65847296. Throughput: 0: 9373.9. Samples: 65830912. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:27:42,858][708628] Avg episode reward: [(0, '1219.260')] [2023-03-09 13:27:44,294][709034] Updated weights for policy 0, policy_version 128640 (0.0005) [2023-03-09 13:27:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 65896448. Throughput: 0: 9365.6. Samples: 65888820. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:27:47,868][708628] Avg episode reward: [(0, '1540.112')] [2023-03-09 13:27:47,871][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000128704_65896448.pth... [2023-03-09 13:27:47,873][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000128152_65613824.pth [2023-03-09 13:27:48,421][709034] Updated weights for policy 0, policy_version 128720 (0.0005) [2023-03-09 13:27:52,604][709034] Updated weights for policy 0, policy_version 128800 (0.0005) [2023-03-09 13:27:52,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 65945600. Throughput: 0: 9437.6. Samples: 65947192. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:27:52,868][708628] Avg episode reward: [(0, '1383.093')] [2023-03-09 13:27:56,932][709034] Updated weights for policy 0, policy_version 128880 (0.0005) [2023-03-09 13:27:57,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 65994752. Throughput: 0: 9478.0. Samples: 65975660. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:27:57,858][708628] Avg episode reward: [(0, '2520.476')] [2023-03-09 13:28:01,235][709034] Updated weights for policy 0, policy_version 128960 (0.0004) [2023-03-09 13:28:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 66039808. Throughput: 0: 9526.1. Samples: 66032052. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:28:02,858][708628] Avg episode reward: [(0, '2368.238')] [2023-03-09 13:28:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000128984_66039808.pth... [2023-03-09 13:28:02,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000128424_65753088.pth [2023-03-09 13:28:05,494][709034] Updated weights for policy 0, policy_version 129040 (0.0005) [2023-03-09 13:28:07,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 66084864. Throughput: 0: 9518.5. Samples: 66088724. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:28:07,858][708628] Avg episode reward: [(0, '2597.028')] [2023-03-09 13:28:10,147][709034] Updated weights for policy 0, policy_version 129120 (0.0006) [2023-03-09 13:28:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 66129920. Throughput: 0: 9452.9. Samples: 66114768. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:28:12,858][708628] Avg episode reward: [(0, '2134.353')] [2023-03-09 13:28:14,705][709034] Updated weights for policy 0, policy_version 129200 (0.0005) [2023-03-09 13:28:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 66179072. Throughput: 0: 9400.1. Samples: 66169764. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:28:17,858][708628] Avg episode reward: [(0, '2044.479')] [2023-03-09 13:28:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000129256_66179072.pth... [2023-03-09 13:28:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000128704_65896448.pth [2023-03-09 13:28:18,991][709034] Updated weights for policy 0, policy_version 129280 (0.0005) [2023-03-09 13:28:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 66224128. Throughput: 0: 9381.7. Samples: 66224680. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:28:22,858][708628] Avg episode reward: [(0, '2775.336')] [2023-03-09 13:28:23,502][709034] Updated weights for policy 0, policy_version 129360 (0.0005) [2023-03-09 13:28:27,669][709034] Updated weights for policy 0, policy_version 129440 (0.0005) [2023-03-09 13:28:27,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9330.6). Total num frames: 66273280. Throughput: 0: 9411.7. Samples: 66254440. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:28:27,858][708628] Avg episode reward: [(0, '1991.082')] [2023-03-09 13:28:32,078][709034] Updated weights for policy 0, policy_version 129520 (0.0005) [2023-03-09 13:28:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 66318336. Throughput: 0: 9389.7. Samples: 66311356. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:28:32,858][708628] Avg episode reward: [(0, '3084.003')] [2023-03-09 13:28:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000129528_66318336.pth... [2023-03-09 13:28:32,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000128984_66039808.pth [2023-03-09 13:28:36,411][709034] Updated weights for policy 0, policy_version 129600 (0.0005) [2023-03-09 13:28:37,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9330.5). Total num frames: 66367488. Throughput: 0: 9341.5. Samples: 66367560. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:28:37,858][708628] Avg episode reward: [(0, '3298.189')] [2023-03-09 13:28:40,934][709034] Updated weights for policy 0, policy_version 129680 (0.0004) [2023-03-09 13:28:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 66412544. Throughput: 0: 9323.6. Samples: 66395220. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:28:42,858][708628] Avg episode reward: [(0, '3112.973')] [2023-03-09 13:28:45,093][709034] Updated weights for policy 0, policy_version 129760 (0.0004) [2023-03-09 13:28:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9330.6). Total num frames: 66461696. Throughput: 0: 9387.5. Samples: 66454488. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:28:47,858][708628] Avg episode reward: [(0, '3036.418')] [2023-03-09 13:28:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000129808_66461696.pth... [2023-03-09 13:28:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000129256_66179072.pth [2023-03-09 13:28:49,317][709034] Updated weights for policy 0, policy_version 129840 (0.0005) [2023-03-09 13:28:52,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 66510848. Throughput: 0: 9377.0. Samples: 66510688. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:28:52,858][708628] Avg episode reward: [(0, '2808.243')] [2023-03-09 13:28:53,649][709034] Updated weights for policy 0, policy_version 129920 (0.0005) [2023-03-09 13:28:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 66551808. Throughput: 0: 9381.3. Samples: 66536924. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:28:57,858][708628] Avg episode reward: [(0, '2821.985')] [2023-03-09 13:28:58,304][709034] Updated weights for policy 0, policy_version 130000 (0.0006) [2023-03-09 13:29:02,715][709034] Updated weights for policy 0, policy_version 130080 (0.0005) [2023-03-09 13:29:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 66600960. Throughput: 0: 9394.5. Samples: 66592516. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:29:02,858][708628] Avg episode reward: [(0, '1957.546')] [2023-03-09 13:29:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000130080_66600960.pth... [2023-03-09 13:29:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000129528_66318336.pth [2023-03-09 13:29:07,047][709034] Updated weights for policy 0, policy_version 130160 (0.0005) [2023-03-09 13:29:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 66646016. Throughput: 0: 9432.6. Samples: 66649148. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:29:07,858][708628] Avg episode reward: [(0, '2045.318')] [2023-03-09 13:29:11,669][709034] Updated weights for policy 0, policy_version 130240 (0.0005) [2023-03-09 13:29:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 66691072. Throughput: 0: 9352.4. Samples: 66675300. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:29:12,858][708628] Avg episode reward: [(0, '2046.263')] [2023-03-09 13:29:16,247][709034] Updated weights for policy 0, policy_version 130320 (0.0005) [2023-03-09 13:29:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 66736128. Throughput: 0: 9280.2. Samples: 66728964. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:29:17,858][708628] Avg episode reward: [(0, '2294.008')] [2023-03-09 13:29:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000130344_66736128.pth... [2023-03-09 13:29:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000129808_66461696.pth [2023-03-09 13:29:20,819][709034] Updated weights for policy 0, policy_version 130400 (0.0005) [2023-03-09 13:29:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 66781184. Throughput: 0: 9233.9. Samples: 66783084. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:29:22,858][708628] Avg episode reward: [(0, '2307.756')] [2023-03-09 13:29:25,255][709034] Updated weights for policy 0, policy_version 130480 (0.0005) [2023-03-09 13:29:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 66826240. Throughput: 0: 9215.6. Samples: 66809920. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:29:27,858][708628] Avg episode reward: [(0, '2579.030')] [2023-03-09 13:29:29,680][709034] Updated weights for policy 0, policy_version 130560 (0.0005) [2023-03-09 13:29:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 66875392. Throughput: 0: 9158.2. Samples: 66866608. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:29:32,858][708628] Avg episode reward: [(0, '2407.957')] [2023-03-09 13:29:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000130616_66875392.pth... [2023-03-09 13:29:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000130080_66600960.pth [2023-03-09 13:29:34,055][709034] Updated weights for policy 0, policy_version 130640 (0.0005) [2023-03-09 13:29:37,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 66920448. Throughput: 0: 9158.0. Samples: 66922796. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:29:37,858][708628] Avg episode reward: [(0, '2959.587')] [2023-03-09 13:29:38,500][709034] Updated weights for policy 0, policy_version 130720 (0.0005) [2023-03-09 13:29:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 66965504. Throughput: 0: 9158.7. Samples: 66949064. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:29:42,858][708628] Avg episode reward: [(0, '3029.165')] [2023-03-09 13:29:43,186][709034] Updated weights for policy 0, policy_version 130800 (0.0005) [2023-03-09 13:29:47,806][709034] Updated weights for policy 0, policy_version 130880 (0.0005) [2023-03-09 13:29:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 67010560. Throughput: 0: 9086.7. Samples: 67001416. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:29:47,858][708628] Avg episode reward: [(0, '3020.538')] [2023-03-09 13:29:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000130880_67010560.pth... [2023-03-09 13:29:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000130344_66736128.pth [2023-03-09 13:29:52,166][709034] Updated weights for policy 0, policy_version 130960 (0.0005) [2023-03-09 13:29:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9288.9). Total num frames: 67055616. Throughput: 0: 9074.2. Samples: 67057488. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:29:52,858][708628] Avg episode reward: [(0, '2736.143')] [2023-03-09 13:29:56,434][709034] Updated weights for policy 0, policy_version 131040 (0.0006) [2023-03-09 13:29:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 67104768. Throughput: 0: 9107.1. Samples: 67085120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:29:57,858][708628] Avg episode reward: [(0, '2866.381')] [2023-03-09 13:30:01,028][709034] Updated weights for policy 0, policy_version 131120 (0.0004) [2023-03-09 13:30:02,857][708628] Fps is (10 sec: 9420.5, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 67149824. Throughput: 0: 9131.2. Samples: 67139868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:30:02,858][708628] Avg episode reward: [(0, '2759.092')] [2023-03-09 13:30:02,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000131152_67149824.pth... [2023-03-09 13:30:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000130616_66875392.pth [2023-03-09 13:30:05,685][709034] Updated weights for policy 0, policy_version 131200 (0.0005) [2023-03-09 13:30:07,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9079.5, 300 sec: 9275.0). Total num frames: 67190784. Throughput: 0: 9115.7. Samples: 67193292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:30:07,858][708628] Avg episode reward: [(0, '3200.887')] [2023-03-09 13:30:10,270][709034] Updated weights for policy 0, policy_version 131280 (0.0004) [2023-03-09 13:30:12,857][708628] Fps is (10 sec: 8601.8, 60 sec: 9079.5, 300 sec: 9261.1). Total num frames: 67235840. Throughput: 0: 9101.1. Samples: 67219468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:30:12,858][708628] Avg episode reward: [(0, '3034.242')] [2023-03-09 13:30:14,639][709034] Updated weights for policy 0, policy_version 131360 (0.0005) [2023-03-09 13:30:17,858][708628] Fps is (10 sec: 9420.1, 60 sec: 9147.6, 300 sec: 9275.0). Total num frames: 67284992. Throughput: 0: 9109.6. Samples: 67276548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:30:17,858][708628] Avg episode reward: [(0, '3456.453')] [2023-03-09 13:30:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000131416_67284992.pth... [2023-03-09 13:30:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000130880_67010560.pth [2023-03-09 13:30:19,124][709034] Updated weights for policy 0, policy_version 131440 (0.0006) [2023-03-09 13:30:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9275.0). Total num frames: 67330048. Throughput: 0: 9067.0. Samples: 67330812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:30:22,858][708628] Avg episode reward: [(0, '3236.335')] [2023-03-09 13:30:23,594][709034] Updated weights for policy 0, policy_version 131520 (0.0005) [2023-03-09 13:30:27,857][708628] Fps is (10 sec: 9011.9, 60 sec: 9147.7, 300 sec: 9261.1). Total num frames: 67375104. Throughput: 0: 9103.7. Samples: 67358732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:30:27,858][708628] Avg episode reward: [(0, '3235.141')] [2023-03-09 13:30:28,095][709034] Updated weights for policy 0, policy_version 131600 (0.0005) [2023-03-09 13:30:32,556][709034] Updated weights for policy 0, policy_version 131680 (0.0005) [2023-03-09 13:30:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9247.2). Total num frames: 67420160. Throughput: 0: 9124.8. Samples: 67412032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:30:32,858][708628] Avg episode reward: [(0, '3371.497')] [2023-03-09 13:30:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000131680_67420160.pth... [2023-03-09 13:30:32,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000131152_67149824.pth [2023-03-09 13:30:36,937][709034] Updated weights for policy 0, policy_version 131760 (0.0006) [2023-03-09 13:30:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9261.1). Total num frames: 67469312. Throughput: 0: 9163.3. Samples: 67469836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:30:37,858][708628] Avg episode reward: [(0, '3375.357')] [2023-03-09 13:30:41,264][709034] Updated weights for policy 0, policy_version 131840 (0.0006) [2023-03-09 13:30:42,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9247.2). Total num frames: 67514368. Throughput: 0: 9174.7. Samples: 67497984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:30:42,858][708628] Avg episode reward: [(0, '3256.382')] [2023-03-09 13:30:45,750][709034] Updated weights for policy 0, policy_version 131920 (0.0005) [2023-03-09 13:30:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9247.2). Total num frames: 67559424. Throughput: 0: 9153.0. Samples: 67551752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:30:47,858][708628] Avg episode reward: [(0, '3169.259')] [2023-03-09 13:30:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000131952_67559424.pth... [2023-03-09 13:30:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000131416_67284992.pth [2023-03-09 13:30:50,221][709034] Updated weights for policy 0, policy_version 132000 (0.0005) [2023-03-09 13:30:52,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9233.4). Total num frames: 67604480. Throughput: 0: 9206.0. Samples: 67607564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:30:52,858][708628] Avg episode reward: [(0, '3216.629')] [2023-03-09 13:30:54,647][709034] Updated weights for policy 0, policy_version 132080 (0.0005) [2023-03-09 13:30:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9219.5). Total num frames: 67649536. Throughput: 0: 9222.1. Samples: 67634464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:30:57,858][708628] Avg episode reward: [(0, '3266.231')] [2023-03-09 13:30:59,246][709034] Updated weights for policy 0, policy_version 132160 (0.0005) [2023-03-09 13:31:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9079.5, 300 sec: 9219.5). Total num frames: 67694592. Throughput: 0: 9170.5. Samples: 67689216. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:31:02,858][708628] Avg episode reward: [(0, '3362.119')] [2023-03-09 13:31:02,871][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000132224_67698688.pth... [2023-03-09 13:31:02,873][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000131680_67420160.pth [2023-03-09 13:31:03,805][709034] Updated weights for policy 0, policy_version 132240 (0.0006) [2023-03-09 13:31:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 67739648. Throughput: 0: 9115.4. Samples: 67741004. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:31:07,858][708628] Avg episode reward: [(0, '3280.947')] [2023-03-09 13:31:08,526][709034] Updated weights for policy 0, policy_version 132320 (0.0005) [2023-03-09 13:31:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 67784704. Throughput: 0: 9100.3. Samples: 67768244. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:31:12,858][708628] Avg episode reward: [(0, '3465.865')] [2023-03-09 13:31:12,989][709034] Updated weights for policy 0, policy_version 132400 (0.0005) [2023-03-09 13:31:17,645][709034] Updated weights for policy 0, policy_version 132480 (0.0005) [2023-03-09 13:31:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.6, 300 sec: 9205.6). Total num frames: 67829760. Throughput: 0: 9124.1. Samples: 67822616. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:31:17,858][708628] Avg episode reward: [(0, '3431.728')] [2023-03-09 13:31:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000132480_67829760.pth... [2023-03-09 13:31:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000131952_67559424.pth [2023-03-09 13:31:21,878][709034] Updated weights for policy 0, policy_version 132560 (0.0005) [2023-03-09 13:31:22,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9233.4). Total num frames: 67878912. Throughput: 0: 9089.3. Samples: 67878856. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:31:22,858][708628] Avg episode reward: [(0, '3403.457')] [2023-03-09 13:31:26,390][709034] Updated weights for policy 0, policy_version 132640 (0.0005) [2023-03-09 13:31:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9247.2). Total num frames: 67923968. Throughput: 0: 9065.9. Samples: 67905948. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:31:27,858][708628] Avg episode reward: [(0, '3366.880')] [2023-03-09 13:31:30,988][709034] Updated weights for policy 0, policy_version 132720 (0.0005) [2023-03-09 13:31:32,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9247.2). Total num frames: 67969024. Throughput: 0: 9065.0. Samples: 67959676. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:31:32,858][708628] Avg episode reward: [(0, '3560.274')] [2023-03-09 13:31:32,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000132752_67969024.pth... [2023-03-09 13:31:32,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000132224_67698688.pth [2023-03-09 13:31:35,300][709034] Updated weights for policy 0, policy_version 132800 (0.0005) [2023-03-09 13:31:37,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9247.2). Total num frames: 68014080. Throughput: 0: 9115.6. Samples: 68017764. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:31:37,858][708628] Avg episode reward: [(0, '3546.625')] [2023-03-09 13:31:39,660][709034] Updated weights for policy 0, policy_version 132880 (0.0005) [2023-03-09 13:31:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9261.1). Total num frames: 68063232. Throughput: 0: 9112.9. Samples: 68044544. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:31:42,858][708628] Avg episode reward: [(0, '3677.286')] [2023-03-09 13:31:44,249][709034] Updated weights for policy 0, policy_version 132960 (0.0005) [2023-03-09 13:31:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9079.5, 300 sec: 9233.4). Total num frames: 68104192. Throughput: 0: 9112.1. Samples: 68099260. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:31:47,858][708628] Avg episode reward: [(0, '2838.066')] [2023-03-09 13:31:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000133016_68104192.pth... [2023-03-09 13:31:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000132480_67829760.pth [2023-03-09 13:31:48,887][709034] Updated weights for policy 0, policy_version 133040 (0.0005) [2023-03-09 13:31:52,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9079.5, 300 sec: 9219.5). Total num frames: 68149248. Throughput: 0: 9140.8. Samples: 68152340. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:31:52,858][708628] Avg episode reward: [(0, '2554.138')] [2023-03-09 13:31:53,321][709034] Updated weights for policy 0, policy_version 133120 (0.0005) [2023-03-09 13:31:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9219.5). Total num frames: 68194304. Throughput: 0: 9144.9. Samples: 68179764. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:31:57,858][708628] Avg episode reward: [(0, '3077.017')] [2023-03-09 13:31:57,866][709034] Updated weights for policy 0, policy_version 133200 (0.0004) [2023-03-09 13:32:02,290][709034] Updated weights for policy 0, policy_version 133280 (0.0005) [2023-03-09 13:32:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9233.4). Total num frames: 68243456. Throughput: 0: 9167.9. Samples: 68235172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:32:02,858][708628] Avg episode reward: [(0, '3449.638')] [2023-03-09 13:32:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000133288_68243456.pth... [2023-03-09 13:32:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000132752_67969024.pth [2023-03-09 13:32:06,937][709034] Updated weights for policy 0, policy_version 133360 (0.0006) [2023-03-09 13:32:07,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9205.6). Total num frames: 68284416. Throughput: 0: 9089.9. Samples: 68287900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:32:07,858][708628] Avg episode reward: [(0, '3547.619')] [2023-03-09 13:32:11,591][709034] Updated weights for policy 0, policy_version 133440 (0.0005) [2023-03-09 13:32:12,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9079.5, 300 sec: 9205.6). Total num frames: 68329472. Throughput: 0: 9049.0. Samples: 68313152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:32:12,858][708628] Avg episode reward: [(0, '3383.558')] [2023-03-09 13:32:16,236][709034] Updated weights for policy 0, policy_version 133520 (0.0004) [2023-03-09 13:32:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9205.6). Total num frames: 68374528. Throughput: 0: 9038.5. Samples: 68366408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:32:17,858][708628] Avg episode reward: [(0, '2967.384')] [2023-03-09 13:32:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000133544_68374528.pth... [2023-03-09 13:32:17,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000133016_68104192.pth [2023-03-09 13:32:20,799][709034] Updated weights for policy 0, policy_version 133600 (0.0005) [2023-03-09 13:32:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9191.7). Total num frames: 68419584. Throughput: 0: 8952.9. Samples: 68420644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:32:22,858][708628] Avg episode reward: [(0, '3269.427')] [2023-03-09 13:32:25,403][709034] Updated weights for policy 0, policy_version 133680 (0.0005) [2023-03-09 13:32:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9191.7). Total num frames: 68464640. Throughput: 0: 8968.8. Samples: 68448140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:32:27,858][708628] Avg episode reward: [(0, '3656.043')] [2023-03-09 13:32:29,869][709034] Updated weights for policy 0, policy_version 133760 (0.0005) [2023-03-09 13:32:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9177.8). Total num frames: 68509696. Throughput: 0: 8940.4. Samples: 68501576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:32:32,858][708628] Avg episode reward: [(0, '3878.524')] [2023-03-09 13:32:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000133808_68509696.pth... [2023-03-09 13:32:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000133288_68243456.pth [2023-03-09 13:32:34,550][709034] Updated weights for policy 0, policy_version 133840 (0.0005) [2023-03-09 13:32:37,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 9163.9). Total num frames: 68550656. Throughput: 0: 8941.7. Samples: 68554716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:32:37,858][708628] Avg episode reward: [(0, '3543.947')] [2023-03-09 13:32:39,171][709034] Updated weights for policy 0, policy_version 133920 (0.0005) [2023-03-09 13:32:42,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8874.7, 300 sec: 9150.0). Total num frames: 68595712. Throughput: 0: 8926.4. Samples: 68581452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:32:42,858][708628] Avg episode reward: [(0, '3591.034')] [2023-03-09 13:32:43,741][709034] Updated weights for policy 0, policy_version 134000 (0.0005) [2023-03-09 13:32:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 9150.0). Total num frames: 68644864. Throughput: 0: 8910.7. Samples: 68636152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:32:47,858][708628] Avg episode reward: [(0, '3837.946')] [2023-03-09 13:32:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000134072_68644864.pth... [2023-03-09 13:32:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000133544_68374528.pth [2023-03-09 13:32:48,172][709034] Updated weights for policy 0, policy_version 134080 (0.0005) [2023-03-09 13:32:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9122.3). Total num frames: 68685824. Throughput: 0: 8899.7. Samples: 68688388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:32:52,858][708628] Avg episode reward: [(0, '3726.651')] [2023-03-09 13:32:53,009][709034] Updated weights for policy 0, policy_version 134160 (0.0005) [2023-03-09 13:32:57,392][709034] Updated weights for policy 0, policy_version 134240 (0.0005) [2023-03-09 13:32:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9136.2). Total num frames: 68734976. Throughput: 0: 8945.6. Samples: 68715704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:32:57,858][708628] Avg episode reward: [(0, '3237.186')] [2023-03-09 13:33:01,976][709034] Updated weights for policy 0, policy_version 134320 (0.0005) [2023-03-09 13:33:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 8942.9, 300 sec: 9136.2). Total num frames: 68780032. Throughput: 0: 8973.0. Samples: 68770196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:33:02,858][708628] Avg episode reward: [(0, '3171.179')] [2023-03-09 13:33:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000134336_68780032.pth... [2023-03-09 13:33:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000133808_68509696.pth [2023-03-09 13:33:06,436][709034] Updated weights for policy 0, policy_version 134400 (0.0005) [2023-03-09 13:33:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9136.2). Total num frames: 68825088. Throughput: 0: 8987.6. Samples: 68825088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:33:07,858][708628] Avg episode reward: [(0, '3370.141')] [2023-03-09 13:33:11,285][709034] Updated weights for policy 0, policy_version 134480 (0.0005) [2023-03-09 13:33:12,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 9108.4). Total num frames: 68866048. Throughput: 0: 8921.3. Samples: 68849600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:33:12,858][708628] Avg episode reward: [(0, '3433.309')] [2023-03-09 13:33:15,655][709034] Updated weights for policy 0, policy_version 134560 (0.0005) [2023-03-09 13:33:17,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 9108.4). Total num frames: 68911104. Throughput: 0: 8942.2. Samples: 68903976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:33:17,858][708628] Avg episode reward: [(0, '3466.962')] [2023-03-09 13:33:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000134592_68911104.pth... [2023-03-09 13:33:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000134072_68644864.pth [2023-03-09 13:33:20,243][709034] Updated weights for policy 0, policy_version 134640 (0.0005) [2023-03-09 13:33:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9094.5). Total num frames: 68956160. Throughput: 0: 8980.5. Samples: 68958840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:33:22,858][708628] Avg episode reward: [(0, '3476.913')] [2023-03-09 13:33:24,793][709034] Updated weights for policy 0, policy_version 134720 (0.0005) [2023-03-09 13:33:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8942.9, 300 sec: 9094.5). Total num frames: 69001216. Throughput: 0: 8962.4. Samples: 68984760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:33:27,858][708628] Avg episode reward: [(0, '3373.146')] [2023-03-09 13:33:29,526][709034] Updated weights for policy 0, policy_version 134800 (0.0005) [2023-03-09 13:33:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9080.6). Total num frames: 69046272. Throughput: 0: 8933.2. Samples: 69038144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:33:32,858][708628] Avg episode reward: [(0, '3632.319')] [2023-03-09 13:33:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000134856_69046272.pth... [2023-03-09 13:33:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000134336_68780032.pth [2023-03-09 13:33:33,872][709034] Updated weights for policy 0, policy_version 134880 (0.0005) [2023-03-09 13:33:37,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9011.2, 300 sec: 9080.6). Total num frames: 69091328. Throughput: 0: 9032.1. Samples: 69094832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:33:37,858][708628] Avg episode reward: [(0, '3602.373')] [2023-03-09 13:33:38,415][709034] Updated weights for policy 0, policy_version 134960 (0.0005) [2023-03-09 13:33:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9011.2, 300 sec: 9066.7). Total num frames: 69136384. Throughput: 0: 8999.1. Samples: 69120664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:33:42,857][708628] Avg episode reward: [(0, '3420.947')] [2023-03-09 13:33:42,981][709034] Updated weights for policy 0, policy_version 135040 (0.0005) [2023-03-09 13:33:47,264][709034] Updated weights for policy 0, policy_version 135120 (0.0005) [2023-03-09 13:33:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 9066.7). Total num frames: 69185536. Throughput: 0: 9031.5. Samples: 69176612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:33:47,858][708628] Avg episode reward: [(0, '3590.847')] [2023-03-09 13:33:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000135128_69185536.pth... [2023-03-09 13:33:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000134592_68911104.pth [2023-03-09 13:33:51,846][709034] Updated weights for policy 0, policy_version 135200 (0.0005) [2023-03-09 13:33:52,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 9080.6). Total num frames: 69230592. Throughput: 0: 9008.3. Samples: 69230464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:33:52,858][708628] Avg episode reward: [(0, '3298.223')] [2023-03-09 13:33:56,511][709034] Updated weights for policy 0, policy_version 135280 (0.0005) [2023-03-09 13:33:57,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 9052.9). Total num frames: 69271552. Throughput: 0: 9031.5. Samples: 69256016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:33:57,858][708628] Avg episode reward: [(0, '3336.040')] [2023-03-09 13:34:01,227][709034] Updated weights for policy 0, policy_version 135360 (0.0006) [2023-03-09 13:34:02,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 9052.9). Total num frames: 69316608. Throughput: 0: 8996.4. Samples: 69308816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:34:02,858][708628] Avg episode reward: [(0, '3292.152')] [2023-03-09 13:34:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000135384_69316608.pth... [2023-03-09 13:34:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000134856_69046272.pth [2023-03-09 13:34:05,956][709034] Updated weights for policy 0, policy_version 135440 (0.0006) [2023-03-09 13:34:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9052.9). Total num frames: 69361664. Throughput: 0: 8948.4. Samples: 69361516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:34:07,858][708628] Avg episode reward: [(0, '3714.309')] [2023-03-09 13:34:10,535][709034] Updated weights for policy 0, policy_version 135520 (0.0005) [2023-03-09 13:34:12,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8942.9, 300 sec: 9039.0). Total num frames: 69402624. Throughput: 0: 8963.5. Samples: 69388116. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:34:12,858][708628] Avg episode reward: [(0, '3837.476')] [2023-03-09 13:34:15,088][709034] Updated weights for policy 0, policy_version 135600 (0.0006) [2023-03-09 13:34:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9052.9). Total num frames: 69451776. Throughput: 0: 9009.5. Samples: 69443572. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:34:17,858][708628] Avg episode reward: [(0, '3552.279')] [2023-03-09 13:34:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000135648_69451776.pth... [2023-03-09 13:34:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000135128_69185536.pth [2023-03-09 13:34:19,359][709034] Updated weights for policy 0, policy_version 135680 (0.0005) [2023-03-09 13:34:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 9052.9). Total num frames: 69496832. Throughput: 0: 8995.7. Samples: 69499640. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:34:22,858][708628] Avg episode reward: [(0, '3455.981')] [2023-03-09 13:34:24,032][709034] Updated weights for policy 0, policy_version 135760 (0.0005) [2023-03-09 13:34:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9011.2, 300 sec: 9039.0). Total num frames: 69541888. Throughput: 0: 8958.6. Samples: 69523804. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:34:27,858][708628] Avg episode reward: [(0, '3560.542')] [2023-03-09 13:34:28,651][709034] Updated weights for policy 0, policy_version 135840 (0.0005) [2023-03-09 13:34:32,857][708628] Fps is (10 sec: 8601.5, 60 sec: 8942.9, 300 sec: 9025.1). Total num frames: 69582848. Throughput: 0: 8914.0. Samples: 69577744. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:34:32,858][708628] Avg episode reward: [(0, '3833.545')] [2023-03-09 13:34:32,868][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000135912_69586944.pth... [2023-03-09 13:34:32,871][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000135384_69316608.pth [2023-03-09 13:34:33,347][709034] Updated weights for policy 0, policy_version 135920 (0.0004) [2023-03-09 13:34:37,658][709034] Updated weights for policy 0, policy_version 136000 (0.0005) [2023-03-09 13:34:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9039.0). Total num frames: 69632000. Throughput: 0: 8940.7. Samples: 69632796. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:34:37,858][708628] Avg episode reward: [(0, '3810.832')] [2023-03-09 13:34:41,953][709034] Updated weights for policy 0, policy_version 136080 (0.0005) [2023-03-09 13:34:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9011.2, 300 sec: 9039.0). Total num frames: 69677056. Throughput: 0: 8992.8. Samples: 69660692. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:34:42,857][708628] Avg episode reward: [(0, '3555.175')] [2023-03-09 13:34:46,554][709034] Updated weights for policy 0, policy_version 136160 (0.0005) [2023-03-09 13:34:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9039.0). Total num frames: 69722112. Throughput: 0: 9041.1. Samples: 69715664. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:34:47,858][708628] Avg episode reward: [(0, '3598.031')] [2023-03-09 13:34:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000136176_69722112.pth... [2023-03-09 13:34:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000135648_69451776.pth [2023-03-09 13:34:51,176][709034] Updated weights for policy 0, policy_version 136240 (0.0005) [2023-03-09 13:34:52,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 9025.1). Total num frames: 69767168. Throughput: 0: 9031.6. Samples: 69767940. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:34:52,858][708628] Avg episode reward: [(0, '3208.739')] [2023-03-09 13:34:55,765][709034] Updated weights for policy 0, policy_version 136320 (0.0005) [2023-03-09 13:34:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9025.1). Total num frames: 69812224. Throughput: 0: 9060.7. Samples: 69795848. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:34:57,858][708628] Avg episode reward: [(0, '3401.231')] [2023-03-09 13:35:00,404][709034] Updated weights for policy 0, policy_version 136400 (0.0005) [2023-03-09 13:35:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9011.2, 300 sec: 9039.0). Total num frames: 69857280. Throughput: 0: 9010.2. Samples: 69849032. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:35:02,858][708628] Avg episode reward: [(0, '3353.286')] [2023-03-09 13:35:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000136440_69857280.pth... [2023-03-09 13:35:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000135912_69586944.pth [2023-03-09 13:35:04,757][709034] Updated weights for policy 0, policy_version 136480 (0.0005) [2023-03-09 13:35:07,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9011.2, 300 sec: 9039.0). Total num frames: 69902336. Throughput: 0: 9019.6. Samples: 69905520. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:35:07,858][708628] Avg episode reward: [(0, '3427.543')] [2023-03-09 13:35:09,292][709034] Updated weights for policy 0, policy_version 136560 (0.0005) [2023-03-09 13:35:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9025.1). Total num frames: 69947392. Throughput: 0: 9064.8. Samples: 69931720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:35:12,858][708628] Avg episode reward: [(0, '3082.928')] [2023-03-09 13:35:13,833][709034] Updated weights for policy 0, policy_version 136640 (0.0005) [2023-03-09 13:35:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9025.1). Total num frames: 69992448. Throughput: 0: 9094.3. Samples: 69986988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:35:17,858][708628] Avg episode reward: [(0, '2725.447')] [2023-03-09 13:35:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000136704_69992448.pth... [2023-03-09 13:35:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000136176_69722112.pth [2023-03-09 13:35:18,441][709034] Updated weights for policy 0, policy_version 136720 (0.0005) [2023-03-09 13:35:22,796][709034] Updated weights for policy 0, policy_version 136800 (0.0005) [2023-03-09 13:35:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9039.0). Total num frames: 70041600. Throughput: 0: 9083.1. Samples: 70041536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:35:22,858][708628] Avg episode reward: [(0, '2951.792')] [2023-03-09 13:35:27,561][709034] Updated weights for policy 0, policy_version 136880 (0.0005) [2023-03-09 13:35:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9025.1). Total num frames: 70082560. Throughput: 0: 9035.3. Samples: 70067280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:35:27,858][708628] Avg episode reward: [(0, '3387.937')] [2023-03-09 13:35:32,106][709034] Updated weights for policy 0, policy_version 136960 (0.0005) [2023-03-09 13:35:32,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9079.5, 300 sec: 9011.2). Total num frames: 70127616. Throughput: 0: 8991.7. Samples: 70120292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:35:32,858][708628] Avg episode reward: [(0, '3637.959')] [2023-03-09 13:35:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000136968_70127616.pth... [2023-03-09 13:35:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000136440_69857280.pth [2023-03-09 13:35:36,541][709034] Updated weights for policy 0, policy_version 137040 (0.0005) [2023-03-09 13:35:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9011.2). Total num frames: 70172672. Throughput: 0: 9062.1. Samples: 70175732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:35:37,858][708628] Avg episode reward: [(0, '3211.792')] [2023-03-09 13:35:41,144][709034] Updated weights for policy 0, policy_version 137120 (0.0006) [2023-03-09 13:35:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9025.1). Total num frames: 70221824. Throughput: 0: 9029.1. Samples: 70202156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:35:42,858][708628] Avg episode reward: [(0, '3328.017')] [2023-03-09 13:35:45,434][709034] Updated weights for policy 0, policy_version 137200 (0.0005) [2023-03-09 13:35:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9025.1). Total num frames: 70266880. Throughput: 0: 9101.4. Samples: 70258592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:35:47,858][708628] Avg episode reward: [(0, '3461.486')] [2023-03-09 13:35:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000137240_70266880.pth... [2023-03-09 13:35:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000136704_69992448.pth [2023-03-09 13:35:50,068][709034] Updated weights for policy 0, policy_version 137280 (0.0005) [2023-03-09 13:35:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9025.1). Total num frames: 70311936. Throughput: 0: 9067.9. Samples: 70313576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:35:52,858][708628] Avg episode reward: [(0, '3309.092')] [2023-03-09 13:35:54,353][709034] Updated weights for policy 0, policy_version 137360 (0.0005) [2023-03-09 13:35:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9025.1). Total num frames: 70356992. Throughput: 0: 9086.6. Samples: 70340616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:35:57,858][708628] Avg episode reward: [(0, '3056.588')] [2023-03-09 13:35:58,855][709034] Updated weights for policy 0, policy_version 137440 (0.0005) [2023-03-09 13:36:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9079.5, 300 sec: 9025.1). Total num frames: 70402048. Throughput: 0: 9050.4. Samples: 70394256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:36:02,858][708628] Avg episode reward: [(0, '3234.908')] [2023-03-09 13:36:02,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000137504_70402048.pth... [2023-03-09 13:36:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000136968_70127616.pth [2023-03-09 13:36:03,428][709034] Updated weights for policy 0, policy_version 137520 (0.0005) [2023-03-09 13:36:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9025.1). Total num frames: 70447104. Throughput: 0: 9030.1. Samples: 70447892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:36:07,858][708628] Avg episode reward: [(0, '3166.389')] [2023-03-09 13:36:08,104][709034] Updated weights for policy 0, policy_version 137600 (0.0005) [2023-03-09 13:36:12,739][709034] Updated weights for policy 0, policy_version 137680 (0.0005) [2023-03-09 13:36:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9025.1). Total num frames: 70492160. Throughput: 0: 9060.8. Samples: 70475016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:36:12,858][708628] Avg episode reward: [(0, '3099.512')] [2023-03-09 13:36:17,381][709034] Updated weights for policy 0, policy_version 137760 (0.0004) [2023-03-09 13:36:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9011.2). Total num frames: 70537216. Throughput: 0: 9070.3. Samples: 70528456. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:36:17,858][708628] Avg episode reward: [(0, '3203.762')] [2023-03-09 13:36:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000137768_70537216.pth... [2023-03-09 13:36:17,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000137240_70266880.pth [2023-03-09 13:36:21,953][709034] Updated weights for policy 0, policy_version 137840 (0.0005) [2023-03-09 13:36:22,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 8997.3). Total num frames: 70578176. Throughput: 0: 8988.3. Samples: 70580208. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:36:22,858][708628] Avg episode reward: [(0, '2913.563')] [2023-03-09 13:36:26,918][709034] Updated weights for policy 0, policy_version 137920 (0.0005) [2023-03-09 13:36:27,857][708628] Fps is (10 sec: 8192.0, 60 sec: 8942.9, 300 sec: 8983.4). Total num frames: 70619136. Throughput: 0: 8942.1. Samples: 70604552. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:36:27,858][708628] Avg episode reward: [(0, '2927.668')] [2023-03-09 13:36:31,819][709034] Updated weights for policy 0, policy_version 138000 (0.0006) [2023-03-09 13:36:32,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8942.9, 300 sec: 8983.4). Total num frames: 70664192. Throughput: 0: 8830.9. Samples: 70655984. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:36:32,858][708628] Avg episode reward: [(0, '3262.581')] [2023-03-09 13:36:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000138016_70664192.pth... [2023-03-09 13:36:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000137504_70402048.pth [2023-03-09 13:36:36,550][709034] Updated weights for policy 0, policy_version 138080 (0.0005) [2023-03-09 13:36:37,857][708628] Fps is (10 sec: 8601.7, 60 sec: 8874.7, 300 sec: 8955.7). Total num frames: 70705152. Throughput: 0: 8759.1. Samples: 70707736. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:36:37,857][708628] Avg episode reward: [(0, '3501.304')] [2023-03-09 13:36:41,105][709034] Updated weights for policy 0, policy_version 138160 (0.0005) [2023-03-09 13:36:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8874.7, 300 sec: 8983.4). Total num frames: 70754304. Throughput: 0: 8746.3. Samples: 70734200. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:36:42,858][708628] Avg episode reward: [(0, '3348.467')] [2023-03-09 13:36:45,646][709034] Updated weights for policy 0, policy_version 138240 (0.0005) [2023-03-09 13:36:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 8874.7, 300 sec: 8983.4). Total num frames: 70799360. Throughput: 0: 8776.5. Samples: 70789196. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:36:47,858][708628] Avg episode reward: [(0, '3289.236')] [2023-03-09 13:36:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000138280_70799360.pth... [2023-03-09 13:36:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000137768_70537216.pth [2023-03-09 13:36:50,221][709034] Updated weights for policy 0, policy_version 138320 (0.0005) [2023-03-09 13:36:52,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 8969.5). Total num frames: 70840320. Throughput: 0: 8779.9. Samples: 70842988. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:36:52,858][708628] Avg episode reward: [(0, '3445.532')] [2023-03-09 13:36:54,793][709034] Updated weights for policy 0, policy_version 138400 (0.0005) [2023-03-09 13:36:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8969.5). Total num frames: 70889472. Throughput: 0: 8788.0. Samples: 70870476. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:36:57,858][708628] Avg episode reward: [(0, '3292.941')] [2023-03-09 13:36:59,137][709034] Updated weights for policy 0, policy_version 138480 (0.0005) [2023-03-09 13:37:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 8874.7, 300 sec: 8983.4). Total num frames: 70934528. Throughput: 0: 8835.4. Samples: 70926048. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:37:02,858][708628] Avg episode reward: [(0, '3343.686')] [2023-03-09 13:37:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000138544_70934528.pth... [2023-03-09 13:37:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000138016_70664192.pth [2023-03-09 13:37:03,567][709034] Updated weights for policy 0, policy_version 138560 (0.0005) [2023-03-09 13:37:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 8983.4). Total num frames: 70979584. Throughput: 0: 8874.2. Samples: 70979548. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:37:07,858][708628] Avg episode reward: [(0, '2918.322')] [2023-03-09 13:37:08,339][709034] Updated weights for policy 0, policy_version 138640 (0.0005) [2023-03-09 13:37:12,667][709034] Updated weights for policy 0, policy_version 138720 (0.0005) [2023-03-09 13:37:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8874.7, 300 sec: 8983.4). Total num frames: 71024640. Throughput: 0: 8936.9. Samples: 71006712. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:37:12,858][708628] Avg episode reward: [(0, '2915.255')] [2023-03-09 13:37:17,105][709034] Updated weights for policy 0, policy_version 138800 (0.0005) [2023-03-09 13:37:17,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8874.7, 300 sec: 8983.4). Total num frames: 71069696. Throughput: 0: 9026.2. Samples: 71062164. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:37:17,858][708628] Avg episode reward: [(0, '2719.893')] [2023-03-09 13:37:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000138808_71069696.pth... [2023-03-09 13:37:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000138280_70799360.pth [2023-03-09 13:37:21,606][709034] Updated weights for policy 0, policy_version 138880 (0.0004) [2023-03-09 13:37:22,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 8983.4). Total num frames: 71114752. Throughput: 0: 9092.8. Samples: 71116912. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:37:22,858][708628] Avg episode reward: [(0, '2578.530')] [2023-03-09 13:37:26,158][709034] Updated weights for policy 0, policy_version 138960 (0.0005) [2023-03-09 13:37:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 8983.4). Total num frames: 71159808. Throughput: 0: 9094.1. Samples: 71143436. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:37:27,857][708628] Avg episode reward: [(0, '2596.921')] [2023-03-09 13:37:30,531][709034] Updated weights for policy 0, policy_version 139040 (0.0004) [2023-03-09 13:37:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 8997.3). Total num frames: 71204864. Throughput: 0: 9119.8. Samples: 71199588. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:37:32,858][708628] Avg episode reward: [(0, '2820.173')] [2023-03-09 13:37:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000139072_71204864.pth... [2023-03-09 13:37:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000138544_70934528.pth [2023-03-09 13:37:35,288][709034] Updated weights for policy 0, policy_version 139120 (0.0005) [2023-03-09 13:37:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 8997.3). Total num frames: 71249920. Throughput: 0: 9045.1. Samples: 71250016. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:37:37,858][708628] Avg episode reward: [(0, '2898.324')] [2023-03-09 13:37:39,912][709034] Updated weights for policy 0, policy_version 139200 (0.0005) [2023-03-09 13:37:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9011.2, 300 sec: 8983.4). Total num frames: 71294976. Throughput: 0: 9066.9. Samples: 71278484. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:37:42,858][708628] Avg episode reward: [(0, '3120.101')] [2023-03-09 13:37:44,431][709034] Updated weights for policy 0, policy_version 139280 (0.0006) [2023-03-09 13:37:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 8997.3). Total num frames: 71340032. Throughput: 0: 9010.3. Samples: 71331512. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:37:47,858][708628] Avg episode reward: [(0, '3271.840')] [2023-03-09 13:37:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000139336_71340032.pth... [2023-03-09 13:37:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000138808_71069696.pth [2023-03-09 13:37:48,993][709034] Updated weights for policy 0, policy_version 139360 (0.0005) [2023-03-09 13:37:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 8997.3). Total num frames: 71389184. Throughput: 0: 9102.0. Samples: 71389140. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:37:52,858][708628] Avg episode reward: [(0, '3615.739')] [2023-03-09 13:37:53,316][709034] Updated weights for policy 0, policy_version 139440 (0.0005) [2023-03-09 13:37:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 8983.4). Total num frames: 71430144. Throughput: 0: 9052.4. Samples: 71414068. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:37:57,868][708628] Avg episode reward: [(0, '3592.643')] [2023-03-09 13:37:57,941][709034] Updated weights for policy 0, policy_version 139520 (0.0005) [2023-03-09 13:38:02,282][709034] Updated weights for policy 0, policy_version 139600 (0.0005) [2023-03-09 13:38:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 8997.3). Total num frames: 71479296. Throughput: 0: 9084.4. Samples: 71470964. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:38:02,858][708628] Avg episode reward: [(0, '3478.416')] [2023-03-09 13:38:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000139608_71479296.pth... [2023-03-09 13:38:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000139072_71204864.pth [2023-03-09 13:38:06,770][709034] Updated weights for policy 0, policy_version 139680 (0.0004) [2023-03-09 13:38:07,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 9011.2). Total num frames: 71524352. Throughput: 0: 9058.0. Samples: 71524524. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:38:07,858][708628] Avg episode reward: [(0, '3413.217')] [2023-03-09 13:38:11,327][709034] Updated weights for policy 0, policy_version 139760 (0.0005) [2023-03-09 13:38:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9011.2). Total num frames: 71569408. Throughput: 0: 9085.3. Samples: 71552276. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:38:12,858][708628] Avg episode reward: [(0, '3377.819')] [2023-03-09 13:38:15,738][709034] Updated weights for policy 0, policy_version 139840 (0.0005) [2023-03-09 13:38:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9011.2). Total num frames: 71614464. Throughput: 0: 9046.1. Samples: 71606664. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:38:17,858][708628] Avg episode reward: [(0, '3531.521')] [2023-03-09 13:38:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000139872_71614464.pth... [2023-03-09 13:38:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000139336_71340032.pth [2023-03-09 13:38:20,325][709034] Updated weights for policy 0, policy_version 139920 (0.0005) [2023-03-09 13:38:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9011.2). Total num frames: 71659520. Throughput: 0: 9164.6. Samples: 71662424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:38:22,858][708628] Avg episode reward: [(0, '3222.669')] [2023-03-09 13:38:24,819][709034] Updated weights for policy 0, policy_version 140000 (0.0005) [2023-03-09 13:38:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9011.2). Total num frames: 71704576. Throughput: 0: 9111.4. Samples: 71688496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:38:27,858][708628] Avg episode reward: [(0, '3219.453')] [2023-03-09 13:38:29,240][709034] Updated weights for policy 0, policy_version 140080 (0.0005) [2023-03-09 13:38:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9025.1). Total num frames: 71753728. Throughput: 0: 9175.1. Samples: 71744392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:38:32,858][708628] Avg episode reward: [(0, '2949.760')] [2023-03-09 13:38:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000140144_71753728.pth... [2023-03-09 13:38:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000139608_71479296.pth [2023-03-09 13:38:33,506][709034] Updated weights for policy 0, policy_version 140160 (0.0005) [2023-03-09 13:38:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9025.1). Total num frames: 71798784. Throughput: 0: 9104.6. Samples: 71798848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:38:37,858][708628] Avg episode reward: [(0, '2880.205')] [2023-03-09 13:38:38,230][709034] Updated weights for policy 0, policy_version 140240 (0.0005) [2023-03-09 13:38:42,518][709034] Updated weights for policy 0, policy_version 140320 (0.0005) [2023-03-09 13:38:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9011.2). Total num frames: 71843840. Throughput: 0: 9185.6. Samples: 71827420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:38:42,858][708628] Avg episode reward: [(0, '3281.621')] [2023-03-09 13:38:46,992][709034] Updated weights for policy 0, policy_version 140400 (0.0005) [2023-03-09 13:38:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9025.1). Total num frames: 71892992. Throughput: 0: 9159.3. Samples: 71883132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:38:47,858][708628] Avg episode reward: [(0, '2705.424')] [2023-03-09 13:38:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000140416_71892992.pth... [2023-03-09 13:38:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000139872_71614464.pth [2023-03-09 13:38:51,273][709034] Updated weights for policy 0, policy_version 140480 (0.0005) [2023-03-09 13:38:52,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9216.0, 300 sec: 9052.9). Total num frames: 71942144. Throughput: 0: 9282.0. Samples: 71942216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:38:52,858][708628] Avg episode reward: [(0, '2307.280')] [2023-03-09 13:38:55,273][709034] Updated weights for policy 0, policy_version 140560 (0.0005) [2023-03-09 13:38:57,857][708628] Fps is (10 sec: 9830.5, 60 sec: 9352.5, 300 sec: 9066.7). Total num frames: 71991296. Throughput: 0: 9321.3. Samples: 71971736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:38:57,858][708628] Avg episode reward: [(0, '2610.526')] [2023-03-09 13:38:59,630][709034] Updated weights for policy 0, policy_version 140640 (0.0005) [2023-03-09 13:39:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9066.7). Total num frames: 72036352. Throughput: 0: 9364.3. Samples: 72028056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:39:02,858][708628] Avg episode reward: [(0, '2590.855')] [2023-03-09 13:39:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000140696_72036352.pth... [2023-03-09 13:39:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000140144_71753728.pth [2023-03-09 13:39:04,033][709034] Updated weights for policy 0, policy_version 140720 (0.0005) [2023-03-09 13:39:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9080.6). Total num frames: 72081408. Throughput: 0: 9351.0. Samples: 72083220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:39:07,858][708628] Avg episode reward: [(0, '2218.602')] [2023-03-09 13:39:08,469][709034] Updated weights for policy 0, policy_version 140800 (0.0004) [2023-03-09 13:39:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9066.7). Total num frames: 72126464. Throughput: 0: 9378.4. Samples: 72110524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:39:12,858][708628] Avg episode reward: [(0, '2676.190')] [2023-03-09 13:39:12,932][709034] Updated weights for policy 0, policy_version 140880 (0.0005) [2023-03-09 13:39:17,550][709034] Updated weights for policy 0, policy_version 140960 (0.0005) [2023-03-09 13:39:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9066.7). Total num frames: 72171520. Throughput: 0: 9313.4. Samples: 72163496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:39:17,858][708628] Avg episode reward: [(0, '2885.112')] [2023-03-09 13:39:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000140960_72171520.pth... [2023-03-09 13:39:17,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000140416_71892992.pth [2023-03-09 13:39:21,955][709034] Updated weights for policy 0, policy_version 141040 (0.0005) [2023-03-09 13:39:22,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9066.7). Total num frames: 72216576. Throughput: 0: 9364.0. Samples: 72220228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:39:22,858][708628] Avg episode reward: [(0, '2896.955')] [2023-03-09 13:39:26,584][709034] Updated weights for policy 0, policy_version 141120 (0.0005) [2023-03-09 13:39:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9080.6). Total num frames: 72261632. Throughput: 0: 9301.2. Samples: 72245972. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:39:27,858][708628] Avg episode reward: [(0, '2775.647')] [2023-03-09 13:39:30,881][709034] Updated weights for policy 0, policy_version 141200 (0.0005) [2023-03-09 13:39:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9080.6). Total num frames: 72310784. Throughput: 0: 9321.0. Samples: 72302576. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:39:32,858][708628] Avg episode reward: [(0, '2993.390')] [2023-03-09 13:39:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000141232_72310784.pth... [2023-03-09 13:39:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000140696_72036352.pth [2023-03-09 13:39:35,409][709034] Updated weights for policy 0, policy_version 141280 (0.0005) [2023-03-09 13:39:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9080.6). Total num frames: 72355840. Throughput: 0: 9215.9. Samples: 72356932. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:39:37,858][708628] Avg episode reward: [(0, '3103.597')] [2023-03-09 13:39:39,805][709034] Updated weights for policy 0, policy_version 141360 (0.0005) [2023-03-09 13:39:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9094.5). Total num frames: 72404992. Throughput: 0: 9197.3. Samples: 72385616. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:39:42,858][708628] Avg episode reward: [(0, '2758.611')] [2023-03-09 13:39:44,087][709034] Updated weights for policy 0, policy_version 141440 (0.0005) [2023-03-09 13:39:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9094.5). Total num frames: 72450048. Throughput: 0: 9195.7. Samples: 72441864. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:39:47,858][708628] Avg episode reward: [(0, '2691.438')] [2023-03-09 13:39:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000141504_72450048.pth... [2023-03-09 13:39:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000140960_72171520.pth [2023-03-09 13:39:48,415][709034] Updated weights for policy 0, policy_version 141520 (0.0005) [2023-03-09 13:39:52,778][709034] Updated weights for policy 0, policy_version 141600 (0.0005) [2023-03-09 13:39:52,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9108.4). Total num frames: 72499200. Throughput: 0: 9244.2. Samples: 72499208. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:39:52,858][708628] Avg episode reward: [(0, '3186.032')] [2023-03-09 13:39:57,230][709034] Updated weights for policy 0, policy_version 141680 (0.0005) [2023-03-09 13:39:57,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9108.4). Total num frames: 72544256. Throughput: 0: 9241.1. Samples: 72526372. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:39:57,858][708628] Avg episode reward: [(0, '3170.966')] [2023-03-09 13:40:01,672][709034] Updated weights for policy 0, policy_version 141760 (0.0005) [2023-03-09 13:40:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9108.4). Total num frames: 72589312. Throughput: 0: 9290.2. Samples: 72581556. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:40:02,858][708628] Avg episode reward: [(0, '2958.953')] [2023-03-09 13:40:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000141776_72589312.pth... [2023-03-09 13:40:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000141232_72310784.pth [2023-03-09 13:40:06,041][709034] Updated weights for policy 0, policy_version 141840 (0.0006) [2023-03-09 13:40:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9122.3). Total num frames: 72638464. Throughput: 0: 9294.0. Samples: 72638456. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:40:07,858][708628] Avg episode reward: [(0, '2607.986')] [2023-03-09 13:40:10,382][709034] Updated weights for policy 0, policy_version 141920 (0.0005) [2023-03-09 13:40:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9122.3). Total num frames: 72683520. Throughput: 0: 9359.2. Samples: 72667136. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:40:12,858][708628] Avg episode reward: [(0, '3045.867')] [2023-03-09 13:40:14,748][709034] Updated weights for policy 0, policy_version 142000 (0.0005) [2023-03-09 13:40:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9122.3). Total num frames: 72732672. Throughput: 0: 9379.0. Samples: 72724632. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:40:17,858][708628] Avg episode reward: [(0, '3215.708')] [2023-03-09 13:40:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000142056_72732672.pth... [2023-03-09 13:40:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000141504_72450048.pth [2023-03-09 13:40:18,917][709034] Updated weights for policy 0, policy_version 142080 (0.0005) [2023-03-09 13:40:22,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9136.2). Total num frames: 72777728. Throughput: 0: 9417.6. Samples: 72780724. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:40:22,858][708628] Avg episode reward: [(0, '3454.245')] [2023-03-09 13:40:23,407][709034] Updated weights for policy 0, policy_version 142160 (0.0005) [2023-03-09 13:40:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9136.2). Total num frames: 72822784. Throughput: 0: 9352.2. Samples: 72806464. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:40:27,858][708628] Avg episode reward: [(0, '3202.189')] [2023-03-09 13:40:28,123][709034] Updated weights for policy 0, policy_version 142240 (0.0005) [2023-03-09 13:40:32,517][709034] Updated weights for policy 0, policy_version 142320 (0.0005) [2023-03-09 13:40:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9136.2). Total num frames: 72867840. Throughput: 0: 9320.4. Samples: 72861280. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:40:32,858][708628] Avg episode reward: [(0, '3237.688')] [2023-03-09 13:40:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000142320_72867840.pth... [2023-03-09 13:40:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000141776_72589312.pth [2023-03-09 13:40:36,847][709034] Updated weights for policy 0, policy_version 142400 (0.0005) [2023-03-09 13:40:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9136.2). Total num frames: 72916992. Throughput: 0: 9288.7. Samples: 72917200. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:40:37,858][708628] Avg episode reward: [(0, '3833.809')] [2023-03-09 13:40:41,276][709034] Updated weights for policy 0, policy_version 142480 (0.0005) [2023-03-09 13:40:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9136.2). Total num frames: 72962048. Throughput: 0: 9316.2. Samples: 72945600. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:40:42,858][708628] Avg episode reward: [(0, '3847.324')] [2023-03-09 13:40:45,850][709034] Updated weights for policy 0, policy_version 142560 (0.0004) [2023-03-09 13:40:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9136.2). Total num frames: 73007104. Throughput: 0: 9274.7. Samples: 72998920. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:40:47,858][708628] Avg episode reward: [(0, '3271.391')] [2023-03-09 13:40:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000142592_73007104.pth... [2023-03-09 13:40:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000142056_72732672.pth [2023-03-09 13:40:50,232][709034] Updated weights for policy 0, policy_version 142640 (0.0005) [2023-03-09 13:40:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9150.0). Total num frames: 73056256. Throughput: 0: 9284.4. Samples: 73056252. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:40:52,858][708628] Avg episode reward: [(0, '2855.725')] [2023-03-09 13:40:54,605][709034] Updated weights for policy 0, policy_version 142720 (0.0005) [2023-03-09 13:40:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9136.2). Total num frames: 73097216. Throughput: 0: 9243.4. Samples: 73083092. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:40:57,858][708628] Avg episode reward: [(0, '3613.180')] [2023-03-09 13:40:59,260][709034] Updated weights for policy 0, policy_version 142800 (0.0005) [2023-03-09 13:41:02,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9216.0, 300 sec: 9136.2). Total num frames: 73142272. Throughput: 0: 9126.9. Samples: 73135344. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:41:02,858][708628] Avg episode reward: [(0, '3728.932')] [2023-03-09 13:41:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000142856_73142272.pth... [2023-03-09 13:41:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000142320_72867840.pth [2023-03-09 13:41:03,901][709034] Updated weights for policy 0, policy_version 142880 (0.0005) [2023-03-09 13:41:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9136.2). Total num frames: 73187328. Throughput: 0: 9070.3. Samples: 73188888. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:41:07,858][708628] Avg episode reward: [(0, '3500.323')] [2023-03-09 13:41:08,524][709034] Updated weights for policy 0, policy_version 142960 (0.0005) [2023-03-09 13:41:12,762][709034] Updated weights for policy 0, policy_version 143040 (0.0005) [2023-03-09 13:41:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9150.0). Total num frames: 73236480. Throughput: 0: 9102.2. Samples: 73216064. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:41:12,858][708628] Avg episode reward: [(0, '3894.480')] [2023-03-09 13:41:17,042][709034] Updated weights for policy 0, policy_version 143120 (0.0005) [2023-03-09 13:41:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9163.9). Total num frames: 73281536. Throughput: 0: 9190.8. Samples: 73274868. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:41:17,858][708628] Avg episode reward: [(0, '3368.599')] [2023-03-09 13:41:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000143128_73281536.pth... [2023-03-09 13:41:17,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000142592_73007104.pth [2023-03-09 13:41:21,595][709034] Updated weights for policy 0, policy_version 143200 (0.0005) [2023-03-09 13:41:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9177.8). Total num frames: 73326592. Throughput: 0: 9144.7. Samples: 73328712. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:41:22,866][708628] Avg episode reward: [(0, '3165.451')] [2023-03-09 13:41:26,058][709034] Updated weights for policy 0, policy_version 143280 (0.0006) [2023-03-09 13:41:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9177.8). Total num frames: 73371648. Throughput: 0: 9111.3. Samples: 73355608. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 13:41:27,858][708628] Avg episode reward: [(0, '3520.096')] [2023-03-09 13:41:30,640][709034] Updated weights for policy 0, policy_version 143360 (0.0006) [2023-03-09 13:41:32,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9191.7). Total num frames: 73416704. Throughput: 0: 9158.1. Samples: 73411032. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:41:32,858][708628] Avg episode reward: [(0, '3174.186')] [2023-03-09 13:41:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000143392_73416704.pth... [2023-03-09 13:41:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000142856_73142272.pth [2023-03-09 13:41:35,304][709034] Updated weights for policy 0, policy_version 143440 (0.0006) [2023-03-09 13:41:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9177.8). Total num frames: 73461760. Throughput: 0: 9068.7. Samples: 73464344. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:41:37,858][708628] Avg episode reward: [(0, '2916.751')] [2023-03-09 13:41:40,026][709034] Updated weights for policy 0, policy_version 143520 (0.0005) [2023-03-09 13:41:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9177.8). Total num frames: 73506816. Throughput: 0: 9030.0. Samples: 73489444. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:41:42,858][708628] Avg episode reward: [(0, '2841.874')] [2023-03-09 13:41:44,328][709034] Updated weights for policy 0, policy_version 143600 (0.0005) [2023-03-09 13:41:47,857][708628] Fps is (10 sec: 9010.9, 60 sec: 9079.4, 300 sec: 9191.7). Total num frames: 73551872. Throughput: 0: 9113.6. Samples: 73545460. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:41:47,858][708628] Avg episode reward: [(0, '3191.403')] [2023-03-09 13:41:47,863][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000143664_73555968.pth... [2023-03-09 13:41:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000143128_73281536.pth [2023-03-09 13:41:48,800][709034] Updated weights for policy 0, policy_version 143680 (0.0005) [2023-03-09 13:41:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9191.7). Total num frames: 73601024. Throughput: 0: 9158.6. Samples: 73601024. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:41:52,858][708628] Avg episode reward: [(0, '3176.385')] [2023-03-09 13:41:53,207][709034] Updated weights for policy 0, policy_version 143760 (0.0005) [2023-03-09 13:41:57,857][708628] Fps is (10 sec: 9011.4, 60 sec: 9079.5, 300 sec: 9177.8). Total num frames: 73641984. Throughput: 0: 9146.1. Samples: 73627640. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:41:57,858][708628] Avg episode reward: [(0, '3136.607')] [2023-03-09 13:41:57,885][709034] Updated weights for policy 0, policy_version 143840 (0.0005) [2023-03-09 13:42:02,356][709034] Updated weights for policy 0, policy_version 143920 (0.0005) [2023-03-09 13:42:02,858][708628] Fps is (10 sec: 9010.8, 60 sec: 9147.7, 300 sec: 9191.7). Total num frames: 73691136. Throughput: 0: 9033.9. Samples: 73681400. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:42:02,858][708628] Avg episode reward: [(0, '3540.924')] [2023-03-09 13:42:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000143928_73691136.pth... [2023-03-09 13:42:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000143392_73416704.pth [2023-03-09 13:42:06,617][709034] Updated weights for policy 0, policy_version 144000 (0.0005) [2023-03-09 13:42:07,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9147.8, 300 sec: 9191.7). Total num frames: 73736192. Throughput: 0: 9131.4. Samples: 73739624. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:42:07,857][708628] Avg episode reward: [(0, '3107.716')] [2023-03-09 13:42:10,936][709034] Updated weights for policy 0, policy_version 144080 (0.0005) [2023-03-09 13:42:12,857][708628] Fps is (10 sec: 9421.2, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 73785344. Throughput: 0: 9152.9. Samples: 73767488. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:42:12,858][708628] Avg episode reward: [(0, '3375.875')] [2023-03-09 13:42:15,611][709034] Updated weights for policy 0, policy_version 144160 (0.0005) [2023-03-09 13:42:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 73830400. Throughput: 0: 9087.2. Samples: 73819956. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:42:17,858][708628] Avg episode reward: [(0, '3201.813')] [2023-03-09 13:42:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000144200_73830400.pth... [2023-03-09 13:42:17,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000143664_73555968.pth [2023-03-09 13:42:20,017][709034] Updated weights for policy 0, policy_version 144240 (0.0006) [2023-03-09 13:42:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 73875456. Throughput: 0: 9220.4. Samples: 73879264. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:42:22,858][708628] Avg episode reward: [(0, '2132.006')] [2023-03-09 13:42:24,287][709034] Updated weights for policy 0, policy_version 144320 (0.0005) [2023-03-09 13:42:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 73920512. Throughput: 0: 9216.6. Samples: 73904192. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:42:27,858][708628] Avg episode reward: [(0, '3204.013')] [2023-03-09 13:42:28,764][709034] Updated weights for policy 0, policy_version 144400 (0.0005) [2023-03-09 13:42:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 73965568. Throughput: 0: 9196.6. Samples: 73959304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:42:32,858][708628] Avg episode reward: [(0, '3676.115')] [2023-03-09 13:42:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000144464_73965568.pth... [2023-03-09 13:42:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000143928_73691136.pth [2023-03-09 13:42:33,416][709034] Updated weights for policy 0, policy_version 144480 (0.0005) [2023-03-09 13:42:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 74010624. Throughput: 0: 9127.8. Samples: 74011776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:42:37,858][708628] Avg episode reward: [(0, '3711.576')] [2023-03-09 13:42:37,985][709034] Updated weights for policy 0, policy_version 144560 (0.0005) [2023-03-09 13:42:42,276][709034] Updated weights for policy 0, policy_version 144640 (0.0005) [2023-03-09 13:42:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9219.5). Total num frames: 74059776. Throughput: 0: 9205.2. Samples: 74041872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:42:42,858][708628] Avg episode reward: [(0, '3884.516')] [2023-03-09 13:42:46,795][709034] Updated weights for policy 0, policy_version 144720 (0.0005) [2023-03-09 13:42:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9205.6). Total num frames: 74104832. Throughput: 0: 9227.6. Samples: 74096636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:42:47,858][708628] Avg episode reward: [(0, '3882.302')] [2023-03-09 13:42:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000144736_74104832.pth... [2023-03-09 13:42:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000144200_73830400.pth [2023-03-09 13:42:51,223][709034] Updated weights for policy 0, policy_version 144800 (0.0005) [2023-03-09 13:42:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 74149888. Throughput: 0: 9154.8. Samples: 74151592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:42:52,857][708628] Avg episode reward: [(0, '3710.149')] [2023-03-09 13:42:55,871][709034] Updated weights for policy 0, policy_version 144880 (0.0005) [2023-03-09 13:42:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9205.6). Total num frames: 74194944. Throughput: 0: 9127.1. Samples: 74178208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:42:57,858][708628] Avg episode reward: [(0, '3795.566')] [2023-03-09 13:43:00,534][709034] Updated weights for policy 0, policy_version 144960 (0.0004) [2023-03-09 13:43:02,857][708628] Fps is (10 sec: 8601.5, 60 sec: 9079.5, 300 sec: 9191.7). Total num frames: 74235904. Throughput: 0: 9131.9. Samples: 74230892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:43:02,858][708628] Avg episode reward: [(0, '3767.932')] [2023-03-09 13:43:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000144992_74235904.pth... [2023-03-09 13:43:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000144464_73965568.pth [2023-03-09 13:43:05,226][709034] Updated weights for policy 0, policy_version 145040 (0.0005) [2023-03-09 13:43:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 74285056. Throughput: 0: 9017.6. Samples: 74285056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:43:07,858][708628] Avg episode reward: [(0, '3963.368')] [2023-03-09 13:43:09,738][709034] Updated weights for policy 0, policy_version 145120 (0.0005) [2023-03-09 13:43:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9191.7). Total num frames: 74326016. Throughput: 0: 9018.0. Samples: 74310000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:43:12,858][708628] Avg episode reward: [(0, '3738.661')] [2023-03-09 13:43:14,339][709034] Updated weights for policy 0, policy_version 145200 (0.0005) [2023-03-09 13:43:17,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9011.2, 300 sec: 9191.7). Total num frames: 74371072. Throughput: 0: 9025.0. Samples: 74365428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:43:17,858][708628] Avg episode reward: [(0, '3269.311')] [2023-03-09 13:43:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000145256_74371072.pth... [2023-03-09 13:43:17,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000144736_74104832.pth [2023-03-09 13:43:18,736][709034] Updated weights for policy 0, policy_version 145280 (0.0005) [2023-03-09 13:43:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9205.6). Total num frames: 74420224. Throughput: 0: 9076.9. Samples: 74420236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:43:22,858][708628] Avg episode reward: [(0, '3733.391')] [2023-03-09 13:43:23,207][709034] Updated weights for policy 0, policy_version 145360 (0.0004) [2023-03-09 13:43:27,486][709034] Updated weights for policy 0, policy_version 145440 (0.0005) [2023-03-09 13:43:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9191.7). Total num frames: 74465280. Throughput: 0: 9061.9. Samples: 74449660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:43:27,858][708628] Avg episode reward: [(0, '3222.336')] [2023-03-09 13:43:32,043][709034] Updated weights for policy 0, policy_version 145520 (0.0006) [2023-03-09 13:43:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9191.7). Total num frames: 74510336. Throughput: 0: 9040.8. Samples: 74503472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:43:32,858][708628] Avg episode reward: [(0, '3723.434')] [2023-03-09 13:43:32,893][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000145536_74514432.pth... [2023-03-09 13:43:32,895][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000144992_74235904.pth [2023-03-09 13:43:36,521][709034] Updated weights for policy 0, policy_version 145600 (0.0006) [2023-03-09 13:43:37,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 74559488. Throughput: 0: 9062.7. Samples: 74559412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:43:37,858][708628] Avg episode reward: [(0, '3493.090')] [2023-03-09 13:43:40,795][709034] Updated weights for policy 0, policy_version 145680 (0.0005) [2023-03-09 13:43:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9079.5, 300 sec: 9191.7). Total num frames: 74604544. Throughput: 0: 9110.0. Samples: 74588160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:43:42,858][708628] Avg episode reward: [(0, '3256.499')] [2023-03-09 13:43:45,336][709034] Updated weights for policy 0, policy_version 145760 (0.0005) [2023-03-09 13:43:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9079.5, 300 sec: 9177.8). Total num frames: 74649600. Throughput: 0: 9122.7. Samples: 74641416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:43:47,858][708628] Avg episode reward: [(0, '3333.942')] [2023-03-09 13:43:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000145800_74649600.pth... [2023-03-09 13:43:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000145256_74371072.pth [2023-03-09 13:43:49,931][709034] Updated weights for policy 0, policy_version 145840 (0.0005) [2023-03-09 13:43:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.4, 300 sec: 9163.9). Total num frames: 74694656. Throughput: 0: 9169.6. Samples: 74697688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:43:52,858][708628] Avg episode reward: [(0, '3254.062')] [2023-03-09 13:43:54,332][709034] Updated weights for policy 0, policy_version 145920 (0.0005) [2023-03-09 13:43:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9177.8). Total num frames: 74743808. Throughput: 0: 9218.8. Samples: 74724848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:43:57,858][708628] Avg episode reward: [(0, '3393.107')] [2023-03-09 13:43:58,457][709034] Updated weights for policy 0, policy_version 146000 (0.0005) [2023-03-09 13:44:02,708][709034] Updated weights for policy 0, policy_version 146080 (0.0005) [2023-03-09 13:44:02,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9191.7). Total num frames: 74792960. Throughput: 0: 9295.8. Samples: 74783740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:44:02,858][708628] Avg episode reward: [(0, '3245.624')] [2023-03-09 13:44:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000146080_74792960.pth... [2023-03-09 13:44:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000145536_74514432.pth [2023-03-09 13:44:07,065][709034] Updated weights for policy 0, policy_version 146160 (0.0006) [2023-03-09 13:44:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 74838016. Throughput: 0: 9329.5. Samples: 74840064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:44:07,858][708628] Avg episode reward: [(0, '3361.771')] [2023-03-09 13:44:11,573][709034] Updated weights for policy 0, policy_version 146240 (0.0005) [2023-03-09 13:44:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9191.7). Total num frames: 74883072. Throughput: 0: 9268.7. Samples: 74866752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:44:12,858][708628] Avg episode reward: [(0, '2916.148')] [2023-03-09 13:44:16,132][709034] Updated weights for policy 0, policy_version 146320 (0.0005) [2023-03-09 13:44:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9205.6). Total num frames: 74932224. Throughput: 0: 9312.5. Samples: 74922536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:44:17,858][708628] Avg episode reward: [(0, '2669.848')] [2023-03-09 13:44:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000146352_74932224.pth... [2023-03-09 13:44:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000145800_74649600.pth [2023-03-09 13:44:20,485][709034] Updated weights for policy 0, policy_version 146400 (0.0005) [2023-03-09 13:44:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9205.6). Total num frames: 74977280. Throughput: 0: 9308.1. Samples: 74978276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:44:22,858][708628] Avg episode reward: [(0, '2174.241')] [2023-03-09 13:44:24,943][709034] Updated weights for policy 0, policy_version 146480 (0.0005) [2023-03-09 13:44:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9191.7). Total num frames: 75022336. Throughput: 0: 9278.2. Samples: 75005680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:44:27,858][708628] Avg episode reward: [(0, '2675.161')] [2023-03-09 13:44:29,587][709034] Updated weights for policy 0, policy_version 146560 (0.0005) [2023-03-09 13:44:32,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9191.7). Total num frames: 75067392. Throughput: 0: 9271.8. Samples: 75058648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:44:32,858][708628] Avg episode reward: [(0, '2315.666')] [2023-03-09 13:44:32,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000146616_75067392.pth... [2023-03-09 13:44:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000146080_74792960.pth [2023-03-09 13:44:34,167][709034] Updated weights for policy 0, policy_version 146640 (0.0005) [2023-03-09 13:44:37,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 75112448. Throughput: 0: 9213.4. Samples: 75112292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:44:37,858][708628] Avg episode reward: [(0, '2426.094')] [2023-03-09 13:44:38,646][709034] Updated weights for policy 0, policy_version 146720 (0.0005) [2023-03-09 13:44:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 75157504. Throughput: 0: 9251.9. Samples: 75141184. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:44:42,858][708628] Avg episode reward: [(0, '2881.909')] [2023-03-09 13:44:42,867][709034] Updated weights for policy 0, policy_version 146800 (0.0005) [2023-03-09 13:44:47,286][709034] Updated weights for policy 0, policy_version 146880 (0.0005) [2023-03-09 13:44:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9177.8). Total num frames: 75206656. Throughput: 0: 9211.2. Samples: 75198244. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:44:47,858][708628] Avg episode reward: [(0, '2818.254')] [2023-03-09 13:44:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000146888_75206656.pth... [2023-03-09 13:44:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000146352_74932224.pth [2023-03-09 13:44:51,585][709034] Updated weights for policy 0, policy_version 146960 (0.0005) [2023-03-09 13:44:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9177.8). Total num frames: 75251712. Throughput: 0: 9215.7. Samples: 75254772. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:44:52,858][708628] Avg episode reward: [(0, '2631.895')] [2023-03-09 13:44:56,033][709034] Updated weights for policy 0, policy_version 147040 (0.0005) [2023-03-09 13:44:57,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9191.7). Total num frames: 75300864. Throughput: 0: 9240.5. Samples: 75282576. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:44:57,858][708628] Avg episode reward: [(0, '2629.632')] [2023-03-09 13:45:00,605][709034] Updated weights for policy 0, policy_version 147120 (0.0005) [2023-03-09 13:45:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9163.9). Total num frames: 75341824. Throughput: 0: 9177.0. Samples: 75335500. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:45:02,858][708628] Avg episode reward: [(0, '1879.608')] [2023-03-09 13:45:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000147152_75341824.pth... [2023-03-09 13:45:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000146616_75067392.pth [2023-03-09 13:45:05,286][709034] Updated weights for policy 0, policy_version 147200 (0.0004) [2023-03-09 13:45:07,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9147.7, 300 sec: 9163.9). Total num frames: 75386880. Throughput: 0: 9128.7. Samples: 75389068. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:45:07,858][708628] Avg episode reward: [(0, '2270.695')] [2023-03-09 13:45:09,915][709034] Updated weights for policy 0, policy_version 147280 (0.0005) [2023-03-09 13:45:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9150.1). Total num frames: 75431936. Throughput: 0: 9109.9. Samples: 75415624. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:45:12,857][708628] Avg episode reward: [(0, '1887.358')] [2023-03-09 13:45:14,324][709034] Updated weights for policy 0, policy_version 147360 (0.0005) [2023-03-09 13:45:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9163.9). Total num frames: 75481088. Throughput: 0: 9184.3. Samples: 75471940. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:45:17,858][708628] Avg episode reward: [(0, '2593.612')] [2023-03-09 13:45:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000147424_75481088.pth... [2023-03-09 13:45:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000146888_75206656.pth [2023-03-09 13:45:18,601][709034] Updated weights for policy 0, policy_version 147440 (0.0005) [2023-03-09 13:45:22,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9163.9). Total num frames: 75526144. Throughput: 0: 9202.7. Samples: 75526416. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:45:22,858][708628] Avg episode reward: [(0, '2534.373')] [2023-03-09 13:45:23,184][709034] Updated weights for policy 0, policy_version 147520 (0.0005) [2023-03-09 13:45:27,553][709034] Updated weights for policy 0, policy_version 147600 (0.0005) [2023-03-09 13:45:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9163.9). Total num frames: 75571200. Throughput: 0: 9174.6. Samples: 75554040. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:45:27,858][708628] Avg episode reward: [(0, '2409.488')] [2023-03-09 13:45:32,156][709034] Updated weights for policy 0, policy_version 147680 (0.0005) [2023-03-09 13:45:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9150.0). Total num frames: 75616256. Throughput: 0: 9108.7. Samples: 75608136. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:45:32,858][708628] Avg episode reward: [(0, '2345.939')] [2023-03-09 13:45:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000147688_75616256.pth... [2023-03-09 13:45:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000147152_75341824.pth [2023-03-09 13:45:36,654][709034] Updated weights for policy 0, policy_version 147760 (0.0005) [2023-03-09 13:45:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9150.0). Total num frames: 75661312. Throughput: 0: 9060.4. Samples: 75662492. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:45:37,858][708628] Avg episode reward: [(0, '1914.415')] [2023-03-09 13:45:41,221][709034] Updated weights for policy 0, policy_version 147840 (0.0005) [2023-03-09 13:45:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9150.0). Total num frames: 75706368. Throughput: 0: 9052.4. Samples: 75689936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:45:42,858][708628] Avg episode reward: [(0, '1645.072')] [2023-03-09 13:45:45,547][709034] Updated weights for policy 0, policy_version 147920 (0.0005) [2023-03-09 13:45:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9150.0). Total num frames: 75755520. Throughput: 0: 9150.7. Samples: 75747280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:45:47,858][708628] Avg episode reward: [(0, '1083.954')] [2023-03-09 13:45:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000147960_75755520.pth... [2023-03-09 13:45:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000147424_75481088.pth [2023-03-09 13:45:49,875][709034] Updated weights for policy 0, policy_version 148000 (0.0005) [2023-03-09 13:45:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9163.9). Total num frames: 75800576. Throughput: 0: 9163.8. Samples: 75801440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:45:52,858][708628] Avg episode reward: [(0, '1656.556')] [2023-03-09 13:45:54,404][709034] Updated weights for policy 0, policy_version 148080 (0.0005) [2023-03-09 13:45:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.4, 300 sec: 9163.9). Total num frames: 75845632. Throughput: 0: 9186.5. Samples: 75829016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:45:57,858][708628] Avg episode reward: [(0, '1782.195')] [2023-03-09 13:45:59,038][709034] Updated weights for policy 0, policy_version 148160 (0.0005) [2023-03-09 13:46:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9163.9). Total num frames: 75890688. Throughput: 0: 9125.0. Samples: 75882568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:46:02,858][708628] Avg episode reward: [(0, '1638.136')] [2023-03-09 13:46:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000148224_75890688.pth... [2023-03-09 13:46:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000147688_75616256.pth [2023-03-09 13:46:03,579][709034] Updated weights for policy 0, policy_version 148240 (0.0005) [2023-03-09 13:46:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9150.0). Total num frames: 75935744. Throughput: 0: 9119.2. Samples: 75936780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:46:07,858][708628] Avg episode reward: [(0, '1325.934')] [2023-03-09 13:46:08,048][709034] Updated weights for policy 0, policy_version 148320 (0.0005) [2023-03-09 13:46:12,617][709034] Updated weights for policy 0, policy_version 148400 (0.0005) [2023-03-09 13:46:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9150.0). Total num frames: 75980800. Throughput: 0: 9107.9. Samples: 75963896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:46:12,858][708628] Avg episode reward: [(0, '1885.431')] [2023-03-09 13:46:16,908][709034] Updated weights for policy 0, policy_version 148480 (0.0005) [2023-03-09 13:46:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9163.9). Total num frames: 76029952. Throughput: 0: 9166.4. Samples: 76020624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:46:17,858][708628] Avg episode reward: [(0, '1831.890')] [2023-03-09 13:46:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000148496_76029952.pth... [2023-03-09 13:46:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000147960_75755520.pth [2023-03-09 13:46:21,436][709034] Updated weights for policy 0, policy_version 148560 (0.0005) [2023-03-09 13:46:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9163.9). Total num frames: 76075008. Throughput: 0: 9173.3. Samples: 76075292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:46:22,858][708628] Avg episode reward: [(0, '1493.194')] [2023-03-09 13:46:25,484][709034] Updated weights for policy 0, policy_version 148640 (0.0005) [2023-03-09 13:46:27,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 76124160. Throughput: 0: 9266.6. Samples: 76106932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:46:27,858][708628] Avg episode reward: [(0, '1288.015')] [2023-03-09 13:46:29,838][709034] Updated weights for policy 0, policy_version 148720 (0.0005) [2023-03-09 13:46:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 76169216. Throughput: 0: 9227.2. Samples: 76162504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:46:32,858][708628] Avg episode reward: [(0, '1664.491')] [2023-03-09 13:46:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000148768_76169216.pth... [2023-03-09 13:46:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000148224_75890688.pth [2023-03-09 13:46:34,435][709034] Updated weights for policy 0, policy_version 148800 (0.0005) [2023-03-09 13:46:37,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9191.7). Total num frames: 76218368. Throughput: 0: 9261.1. Samples: 76218192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:46:37,858][708628] Avg episode reward: [(0, '2227.113')] [2023-03-09 13:46:38,720][709034] Updated weights for policy 0, policy_version 148880 (0.0006) [2023-03-09 13:46:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9191.7). Total num frames: 76263424. Throughput: 0: 9234.2. Samples: 76244556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:46:42,858][708628] Avg episode reward: [(0, '2060.667')] [2023-03-09 13:46:43,232][709034] Updated weights for policy 0, policy_version 148960 (0.0005) [2023-03-09 13:46:47,835][709034] Updated weights for policy 0, policy_version 149040 (0.0004) [2023-03-09 13:46:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 76308480. Throughput: 0: 9247.2. Samples: 76298692. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:46:47,858][708628] Avg episode reward: [(0, '2528.131')] [2023-03-09 13:46:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000149040_76308480.pth... [2023-03-09 13:46:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000148496_76029952.pth [2023-03-09 13:46:52,261][709034] Updated weights for policy 0, policy_version 149120 (0.0005) [2023-03-09 13:46:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 76353536. Throughput: 0: 9262.7. Samples: 76353600. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:46:52,858][708628] Avg episode reward: [(0, '2827.117')] [2023-03-09 13:46:56,619][709034] Updated weights for policy 0, policy_version 149200 (0.0005) [2023-03-09 13:46:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 76398592. Throughput: 0: 9295.6. Samples: 76382200. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:46:57,858][708628] Avg episode reward: [(0, '3119.300')] [2023-03-09 13:47:01,091][709034] Updated weights for policy 0, policy_version 149280 (0.0006) [2023-03-09 13:47:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 76443648. Throughput: 0: 9275.0. Samples: 76438000. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:47:02,858][708628] Avg episode reward: [(0, '2918.646')] [2023-03-09 13:47:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000149304_76443648.pth... [2023-03-09 13:47:02,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000148768_76169216.pth [2023-03-09 13:47:05,809][709034] Updated weights for policy 0, policy_version 149360 (0.0006) [2023-03-09 13:47:07,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9163.9). Total num frames: 76488704. Throughput: 0: 9228.6. Samples: 76490580. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:47:07,858][708628] Avg episode reward: [(0, '2921.738')] [2023-03-09 13:47:10,277][709034] Updated weights for policy 0, policy_version 149440 (0.0005) [2023-03-09 13:47:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9163.9). Total num frames: 76533760. Throughput: 0: 9121.1. Samples: 76517384. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:47:12,858][708628] Avg episode reward: [(0, '2677.732')] [2023-03-09 13:47:14,699][709034] Updated weights for policy 0, policy_version 149520 (0.0005) [2023-03-09 13:47:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 76582912. Throughput: 0: 9142.1. Samples: 76573900. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:47:17,858][708628] Avg episode reward: [(0, '2884.665')] [2023-03-09 13:47:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000149576_76582912.pth... [2023-03-09 13:47:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000149040_76308480.pth [2023-03-09 13:47:19,051][709034] Updated weights for policy 0, policy_version 149600 (0.0005) [2023-03-09 13:47:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 76627968. Throughput: 0: 9136.7. Samples: 76629344. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:47:22,858][708628] Avg episode reward: [(0, '3279.384')] [2023-03-09 13:47:23,364][709034] Updated weights for policy 0, policy_version 149680 (0.0005) [2023-03-09 13:47:27,642][709034] Updated weights for policy 0, policy_version 149760 (0.0005) [2023-03-09 13:47:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 76677120. Throughput: 0: 9208.7. Samples: 76658948. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:47:27,858][708628] Avg episode reward: [(0, '3078.395')] [2023-03-09 13:47:31,809][709034] Updated weights for policy 0, policy_version 149840 (0.0005) [2023-03-09 13:47:32,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9205.6). Total num frames: 76726272. Throughput: 0: 9319.7. Samples: 76718080. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:47:32,858][708628] Avg episode reward: [(0, '2789.132')] [2023-03-09 13:47:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000149856_76726272.pth... [2023-03-09 13:47:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000149304_76443648.pth [2023-03-09 13:47:35,849][709034] Updated weights for policy 0, policy_version 149920 (0.0005) [2023-03-09 13:47:37,857][708628] Fps is (10 sec: 9830.5, 60 sec: 9284.3, 300 sec: 9205.6). Total num frames: 76775424. Throughput: 0: 9417.3. Samples: 76777376. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:47:37,858][708628] Avg episode reward: [(0, '2756.520')] [2023-03-09 13:47:40,317][709034] Updated weights for policy 0, policy_version 150000 (0.0005) [2023-03-09 13:47:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9205.6). Total num frames: 76820480. Throughput: 0: 9385.4. Samples: 76804544. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:47:42,858][708628] Avg episode reward: [(0, '2020.642')] [2023-03-09 13:47:44,534][709034] Updated weights for policy 0, policy_version 150080 (0.0005) [2023-03-09 13:47:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9219.5). Total num frames: 76869632. Throughput: 0: 9409.9. Samples: 76861448. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 13:47:47,858][708628] Avg episode reward: [(0, '2379.043')] [2023-03-09 13:47:47,866][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000150144_76873728.pth... [2023-03-09 13:47:47,868][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000149576_76582912.pth [2023-03-09 13:47:48,775][709034] Updated weights for policy 0, policy_version 150160 (0.0005) [2023-03-09 13:47:52,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9233.4). Total num frames: 76918784. Throughput: 0: 9513.3. Samples: 76918680. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:47:52,858][708628] Avg episode reward: [(0, '2303.727')] [2023-03-09 13:47:53,235][709034] Updated weights for policy 0, policy_version 150240 (0.0005) [2023-03-09 13:47:57,590][709034] Updated weights for policy 0, policy_version 150320 (0.0005) [2023-03-09 13:47:57,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9247.2). Total num frames: 76963840. Throughput: 0: 9568.7. Samples: 76947976. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:47:57,858][708628] Avg episode reward: [(0, '2330.777')] [2023-03-09 13:48:01,812][709034] Updated weights for policy 0, policy_version 150400 (0.0005) [2023-03-09 13:48:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9247.2). Total num frames: 77012992. Throughput: 0: 9574.8. Samples: 77004764. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:48:02,858][708628] Avg episode reward: [(0, '2319.192')] [2023-03-09 13:48:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000150416_77012992.pth... [2023-03-09 13:48:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000149856_76726272.pth [2023-03-09 13:48:06,055][709034] Updated weights for policy 0, policy_version 150480 (0.0005) [2023-03-09 13:48:07,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9275.0). Total num frames: 77062144. Throughput: 0: 9633.6. Samples: 77062856. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:48:07,858][708628] Avg episode reward: [(0, '2239.173')] [2023-03-09 13:48:10,560][709034] Updated weights for policy 0, policy_version 150560 (0.0005) [2023-03-09 13:48:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9275.0). Total num frames: 77107200. Throughput: 0: 9542.2. Samples: 77088348. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:48:12,858][708628] Avg episode reward: [(0, '2604.208')] [2023-03-09 13:48:14,903][709034] Updated weights for policy 0, policy_version 150640 (0.0005) [2023-03-09 13:48:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9261.1). Total num frames: 77152256. Throughput: 0: 9481.8. Samples: 77144760. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:48:17,858][708628] Avg episode reward: [(0, '1827.551')] [2023-03-09 13:48:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000150688_77152256.pth... [2023-03-09 13:48:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000150144_76873728.pth [2023-03-09 13:48:19,503][709034] Updated weights for policy 0, policy_version 150720 (0.0006) [2023-03-09 13:48:22,857][708628] Fps is (10 sec: 8601.5, 60 sec: 9420.8, 300 sec: 9247.2). Total num frames: 77193216. Throughput: 0: 9324.3. Samples: 77196968. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:48:22,858][708628] Avg episode reward: [(0, '2071.426')] [2023-03-09 13:48:24,376][709034] Updated weights for policy 0, policy_version 150800 (0.0005) [2023-03-09 13:48:27,857][708628] Fps is (10 sec: 8601.5, 60 sec: 9352.5, 300 sec: 9247.2). Total num frames: 77238272. Throughput: 0: 9271.8. Samples: 77221776. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:48:27,858][708628] Avg episode reward: [(0, '2423.767')] [2023-03-09 13:48:29,211][709034] Updated weights for policy 0, policy_version 150880 (0.0005) [2023-03-09 13:48:32,857][708628] Fps is (10 sec: 8601.5, 60 sec: 9216.0, 300 sec: 9219.5). Total num frames: 77279232. Throughput: 0: 9145.6. Samples: 77273000. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:48:32,858][708628] Avg episode reward: [(0, '2155.381')] [2023-03-09 13:48:32,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000150936_77279232.pth... [2023-03-09 13:48:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000150416_77012992.pth [2023-03-09 13:48:33,793][709034] Updated weights for policy 0, policy_version 150960 (0.0005) [2023-03-09 13:48:37,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 77324288. Throughput: 0: 9013.7. Samples: 77324296. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:48:37,858][708628] Avg episode reward: [(0, '2451.467')] [2023-03-09 13:48:38,631][709034] Updated weights for policy 0, policy_version 151040 (0.0005) [2023-03-09 13:48:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 77369344. Throughput: 0: 8982.1. Samples: 77352172. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:48:42,858][708628] Avg episode reward: [(0, '2351.807')] [2023-03-09 13:48:43,261][709034] Updated weights for policy 0, policy_version 151120 (0.0004) [2023-03-09 13:48:47,773][709034] Updated weights for policy 0, policy_version 151200 (0.0006) [2023-03-09 13:48:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9079.5, 300 sec: 9219.5). Total num frames: 77414400. Throughput: 0: 8912.9. Samples: 77405844. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 13:48:47,858][708628] Avg episode reward: [(0, '2175.384')] [2023-03-09 13:48:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000151200_77414400.pth... [2023-03-09 13:48:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000150688_77152256.pth [2023-03-09 13:48:52,294][709034] Updated weights for policy 0, policy_version 151280 (0.0005) [2023-03-09 13:48:52,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9011.2, 300 sec: 9205.6). Total num frames: 77459456. Throughput: 0: 8814.8. Samples: 77459520. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:48:52,858][708628] Avg episode reward: [(0, '2424.897')] [2023-03-09 13:48:56,671][709034] Updated weights for policy 0, policy_version 151360 (0.0006) [2023-03-09 13:48:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9191.7). Total num frames: 77504512. Throughput: 0: 8884.2. Samples: 77488136. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:48:57,858][708628] Avg episode reward: [(0, '2723.793')] [2023-03-09 13:49:01,152][709034] Updated weights for policy 0, policy_version 151440 (0.0005) [2023-03-09 13:49:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8942.9, 300 sec: 9191.7). Total num frames: 77549568. Throughput: 0: 8853.6. Samples: 77543172. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:49:02,858][708628] Avg episode reward: [(0, '2621.479')] [2023-03-09 13:49:02,884][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000151472_77553664.pth... [2023-03-09 13:49:02,886][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000150936_77279232.pth [2023-03-09 13:49:05,721][709034] Updated weights for policy 0, policy_version 151520 (0.0005) [2023-03-09 13:49:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 9191.7). Total num frames: 77594624. Throughput: 0: 8871.1. Samples: 77596168. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:49:07,858][708628] Avg episode reward: [(0, '2424.576')] [2023-03-09 13:49:10,061][709034] Updated weights for policy 0, policy_version 151600 (0.0005) [2023-03-09 13:49:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 8942.9, 300 sec: 9191.7). Total num frames: 77643776. Throughput: 0: 8984.6. Samples: 77626084. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:49:12,858][708628] Avg episode reward: [(0, '2707.683')] [2023-03-09 13:49:14,770][709034] Updated weights for policy 0, policy_version 151680 (0.0005) [2023-03-09 13:49:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 9177.8). Total num frames: 77684736. Throughput: 0: 8977.8. Samples: 77677000. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:49:17,858][708628] Avg episode reward: [(0, '2101.825')] [2023-03-09 13:49:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000151728_77684736.pth... [2023-03-09 13:49:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000151200_77414400.pth [2023-03-09 13:49:19,542][709034] Updated weights for policy 0, policy_version 151760 (0.0005) [2023-03-09 13:49:22,857][708628] Fps is (10 sec: 8191.9, 60 sec: 8874.7, 300 sec: 9163.9). Total num frames: 77725696. Throughput: 0: 8991.9. Samples: 77728932. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:49:22,858][708628] Avg episode reward: [(0, '2575.653')] [2023-03-09 13:49:24,391][709034] Updated weights for policy 0, policy_version 151840 (0.0005) [2023-03-09 13:49:27,857][708628] Fps is (10 sec: 8192.0, 60 sec: 8806.4, 300 sec: 9150.0). Total num frames: 77766656. Throughput: 0: 8926.0. Samples: 77753844. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:49:27,858][708628] Avg episode reward: [(0, '2650.149')] [2023-03-09 13:49:29,544][709034] Updated weights for policy 0, policy_version 151920 (0.0005) [2023-03-09 13:49:32,857][708628] Fps is (10 sec: 8192.0, 60 sec: 8806.4, 300 sec: 9136.2). Total num frames: 77807616. Throughput: 0: 8760.6. Samples: 77800072. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:49:32,858][708628] Avg episode reward: [(0, '2320.315')] [2023-03-09 13:49:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000151968_77807616.pth... [2023-03-09 13:49:32,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000151472_77553664.pth [2023-03-09 13:49:34,465][709034] Updated weights for policy 0, policy_version 152000 (0.0006) [2023-03-09 13:49:37,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8806.4, 300 sec: 9136.2). Total num frames: 77852672. Throughput: 0: 8799.6. Samples: 77855504. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:49:37,858][708628] Avg episode reward: [(0, '1747.878')] [2023-03-09 13:49:38,863][709034] Updated weights for policy 0, policy_version 152080 (0.0006) [2023-03-09 13:49:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8806.4, 300 sec: 9122.3). Total num frames: 77897728. Throughput: 0: 8746.9. Samples: 77881748. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:49:42,858][708628] Avg episode reward: [(0, '1479.392')] [2023-03-09 13:49:43,371][709034] Updated weights for policy 0, policy_version 152160 (0.0005) [2023-03-09 13:49:47,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8806.4, 300 sec: 9122.3). Total num frames: 77942784. Throughput: 0: 8752.7. Samples: 77937044. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:49:47,858][708628] Avg episode reward: [(0, '1941.929')] [2023-03-09 13:49:47,867][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000152240_77946880.pth... [2023-03-09 13:49:47,867][709034] Updated weights for policy 0, policy_version 152240 (0.0004) [2023-03-09 13:49:47,868][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000151728_77684736.pth [2023-03-09 13:49:52,277][709034] Updated weights for policy 0, policy_version 152320 (0.0005) [2023-03-09 13:49:52,857][708628] Fps is (10 sec: 9420.7, 60 sec: 8874.7, 300 sec: 9122.3). Total num frames: 77991936. Throughput: 0: 8794.8. Samples: 77991936. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 13:49:52,858][708628] Avg episode reward: [(0, '2148.229')] [2023-03-09 13:49:56,711][709034] Updated weights for policy 0, policy_version 152400 (0.0005) [2023-03-09 13:49:57,857][708628] Fps is (10 sec: 9420.7, 60 sec: 8874.7, 300 sec: 9136.2). Total num frames: 78036992. Throughput: 0: 8752.3. Samples: 78019940. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:49:57,858][708628] Avg episode reward: [(0, '2158.995')] [2023-03-09 13:50:01,281][709034] Updated weights for policy 0, policy_version 152480 (0.0005) [2023-03-09 13:50:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 9136.2). Total num frames: 78082048. Throughput: 0: 8820.6. Samples: 78073928. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:50:02,858][708628] Avg episode reward: [(0, '1918.846')] [2023-03-09 13:50:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000152504_78082048.pth... [2023-03-09 13:50:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000151968_77807616.pth [2023-03-09 13:50:05,422][709034] Updated weights for policy 0, policy_version 152560 (0.0005) [2023-03-09 13:50:07,857][708628] Fps is (10 sec: 9830.5, 60 sec: 9011.2, 300 sec: 9163.9). Total num frames: 78135296. Throughput: 0: 9063.0. Samples: 78136768. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:50:07,858][708628] Avg episode reward: [(0, '1974.558')] [2023-03-09 13:50:09,288][709034] Updated weights for policy 0, policy_version 152640 (0.0005) [2023-03-09 13:50:12,857][708628] Fps is (10 sec: 10240.0, 60 sec: 9011.2, 300 sec: 9163.9). Total num frames: 78184448. Throughput: 0: 9149.5. Samples: 78165572. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:50:12,858][708628] Avg episode reward: [(0, '1374.148')] [2023-03-09 13:50:13,376][709034] Updated weights for policy 0, policy_version 152720 (0.0005) [2023-03-09 13:50:17,781][709034] Updated weights for policy 0, policy_version 152800 (0.0005) [2023-03-09 13:50:17,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9147.7, 300 sec: 9177.8). Total num frames: 78233600. Throughput: 0: 9422.6. Samples: 78224088. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:50:17,858][708628] Avg episode reward: [(0, '1940.384')] [2023-03-09 13:50:17,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000152800_78233600.pth... [2023-03-09 13:50:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000152240_77946880.pth [2023-03-09 13:50:22,291][709034] Updated weights for policy 0, policy_version 152880 (0.0005) [2023-03-09 13:50:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 78278656. Throughput: 0: 9420.6. Samples: 78279432. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:50:22,858][708628] Avg episode reward: [(0, '2279.866')] [2023-03-09 13:50:26,553][709034] Updated weights for policy 0, policy_version 152960 (0.0004) [2023-03-09 13:50:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9177.8). Total num frames: 78323712. Throughput: 0: 9487.2. Samples: 78308672. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:50:27,858][708628] Avg episode reward: [(0, '2616.031')] [2023-03-09 13:50:31,043][709034] Updated weights for policy 0, policy_version 153040 (0.0005) [2023-03-09 13:50:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9191.7). Total num frames: 78372864. Throughput: 0: 9488.8. Samples: 78364040. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:50:32,858][708628] Avg episode reward: [(0, '2825.692')] [2023-03-09 13:50:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000153072_78372864.pth... [2023-03-09 13:50:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000152504_78082048.pth [2023-03-09 13:50:35,468][709034] Updated weights for policy 0, policy_version 153120 (0.0004) [2023-03-09 13:50:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9191.7). Total num frames: 78417920. Throughput: 0: 9503.6. Samples: 78419596. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:50:37,858][708628] Avg episode reward: [(0, '2454.608')] [2023-03-09 13:50:39,866][709034] Updated weights for policy 0, policy_version 153200 (0.0005) [2023-03-09 13:50:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9177.8). Total num frames: 78462976. Throughput: 0: 9482.8. Samples: 78446664. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:50:42,858][708628] Avg episode reward: [(0, '2367.250')] [2023-03-09 13:50:44,496][709034] Updated weights for policy 0, policy_version 153280 (0.0004) [2023-03-09 13:50:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9191.7). Total num frames: 78512128. Throughput: 0: 9517.4. Samples: 78502212. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:50:47,858][708628] Avg episode reward: [(0, '3141.489')] [2023-03-09 13:50:47,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000153344_78512128.pth... [2023-03-09 13:50:47,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000152800_78233600.pth [2023-03-09 13:50:48,770][709034] Updated weights for policy 0, policy_version 153360 (0.0006) [2023-03-09 13:50:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9191.7). Total num frames: 78557184. Throughput: 0: 9331.8. Samples: 78556700. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:50:52,858][708628] Avg episode reward: [(0, '2988.753')] [2023-03-09 13:50:53,333][709034] Updated weights for policy 0, policy_version 153440 (0.0005) [2023-03-09 13:50:57,674][709034] Updated weights for policy 0, policy_version 153520 (0.0005) [2023-03-09 13:50:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9191.7). Total num frames: 78602240. Throughput: 0: 9300.8. Samples: 78584108. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 13:50:57,858][708628] Avg episode reward: [(0, '2807.521')] [2023-03-09 13:51:01,970][709034] Updated weights for policy 0, policy_version 153600 (0.0005) [2023-03-09 13:51:02,857][708628] Fps is (10 sec: 9420.6, 60 sec: 9489.1, 300 sec: 9205.6). Total num frames: 78651392. Throughput: 0: 9267.3. Samples: 78641116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:51:02,858][708628] Avg episode reward: [(0, '3241.056')] [2023-03-09 13:51:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000153616_78651392.pth... [2023-03-09 13:51:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000153072_78372864.pth [2023-03-09 13:51:06,297][709034] Updated weights for policy 0, policy_version 153680 (0.0005) [2023-03-09 13:51:07,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9205.6). Total num frames: 78696448. Throughput: 0: 9309.8. Samples: 78698372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:51:07,858][708628] Avg episode reward: [(0, '2756.061')] [2023-03-09 13:51:10,691][709034] Updated weights for policy 0, policy_version 153760 (0.0004) [2023-03-09 13:51:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9191.7). Total num frames: 78741504. Throughput: 0: 9260.1. Samples: 78725376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:51:12,858][708628] Avg episode reward: [(0, '2600.106')] [2023-03-09 13:51:15,132][709034] Updated weights for policy 0, policy_version 153840 (0.0005) [2023-03-09 13:51:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9205.6). Total num frames: 78790656. Throughput: 0: 9299.7. Samples: 78782528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:51:17,858][708628] Avg episode reward: [(0, '3116.447')] [2023-03-09 13:51:17,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000153888_78790656.pth... [2023-03-09 13:51:17,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000153344_78512128.pth [2023-03-09 13:51:19,424][709034] Updated weights for policy 0, policy_version 153920 (0.0005) [2023-03-09 13:51:22,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9191.7). Total num frames: 78835712. Throughput: 0: 9317.3. Samples: 78838872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:51:22,858][708628] Avg episode reward: [(0, '1925.496')] [2023-03-09 13:51:23,701][709034] Updated weights for policy 0, policy_version 154000 (0.0005) [2023-03-09 13:51:27,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9205.6). Total num frames: 78884864. Throughput: 0: 9359.0. Samples: 78867820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:51:27,858][708628] Avg episode reward: [(0, '2424.172')] [2023-03-09 13:51:28,013][709034] Updated weights for policy 0, policy_version 154080 (0.0005) [2023-03-09 13:51:32,405][709034] Updated weights for policy 0, policy_version 154160 (0.0004) [2023-03-09 13:51:32,857][708628] Fps is (10 sec: 9830.2, 60 sec: 9352.5, 300 sec: 9205.6). Total num frames: 78934016. Throughput: 0: 9359.9. Samples: 78923408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:51:32,858][708628] Avg episode reward: [(0, '2518.486')] [2023-03-09 13:51:32,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000154168_78934016.pth... [2023-03-09 13:51:32,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000153616_78651392.pth [2023-03-09 13:51:36,909][709034] Updated weights for policy 0, policy_version 154240 (0.0005) [2023-03-09 13:51:37,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.6, 300 sec: 9205.6). Total num frames: 78979072. Throughput: 0: 9383.7. Samples: 78978968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:51:37,858][708628] Avg episode reward: [(0, '3220.525')] [2023-03-09 13:51:41,380][709034] Updated weights for policy 0, policy_version 154320 (0.0005) [2023-03-09 13:51:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9205.6). Total num frames: 79024128. Throughput: 0: 9373.9. Samples: 79005932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:51:42,858][708628] Avg episode reward: [(0, '3134.567')] [2023-03-09 13:51:45,911][709034] Updated weights for policy 0, policy_version 154400 (0.0005) [2023-03-09 13:51:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9205.6). Total num frames: 79069184. Throughput: 0: 9332.2. Samples: 79061064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:51:47,858][708628] Avg episode reward: [(0, '3325.587')] [2023-03-09 13:51:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000154432_79069184.pth... [2023-03-09 13:51:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000153888_78790656.pth [2023-03-09 13:51:50,185][709034] Updated weights for policy 0, policy_version 154480 (0.0005) [2023-03-09 13:51:52,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9219.5). Total num frames: 79118336. Throughput: 0: 9332.0. Samples: 79118312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:51:52,858][708628] Avg episode reward: [(0, '3570.303')] [2023-03-09 13:51:54,779][709034] Updated weights for policy 0, policy_version 154560 (0.0005) [2023-03-09 13:51:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9205.6). Total num frames: 79159296. Throughput: 0: 9290.3. Samples: 79143440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:51:57,857][708628] Avg episode reward: [(0, '3453.553')] [2023-03-09 13:51:59,357][709034] Updated weights for policy 0, policy_version 154640 (0.0004) [2023-03-09 13:52:02,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9216.0, 300 sec: 9205.6). Total num frames: 79204352. Throughput: 0: 9193.3. Samples: 79196224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:52:02,858][708628] Avg episode reward: [(0, '3068.758')] [2023-03-09 13:52:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000154696_79204352.pth... [2023-03-09 13:52:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000154168_78934016.pth [2023-03-09 13:52:03,913][709034] Updated weights for policy 0, policy_version 154720 (0.0005) [2023-03-09 13:52:07,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9219.5). Total num frames: 79253504. Throughput: 0: 9212.3. Samples: 79253428. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:52:07,858][708628] Avg episode reward: [(0, '3260.843')] [2023-03-09 13:52:08,266][709034] Updated weights for policy 0, policy_version 154800 (0.0005) [2023-03-09 13:52:12,522][709034] Updated weights for policy 0, policy_version 154880 (0.0005) [2023-03-09 13:52:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9205.6). Total num frames: 79298560. Throughput: 0: 9202.9. Samples: 79281952. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:52:12,858][708628] Avg episode reward: [(0, '3470.541')] [2023-03-09 13:52:16,867][709034] Updated weights for policy 0, policy_version 154960 (0.0005) [2023-03-09 13:52:17,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9219.5). Total num frames: 79347712. Throughput: 0: 9242.6. Samples: 79339324. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:52:17,858][708628] Avg episode reward: [(0, '2959.783')] [2023-03-09 13:52:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000154976_79347712.pth... [2023-03-09 13:52:17,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000154432_79069184.pth [2023-03-09 13:52:21,228][709034] Updated weights for policy 0, policy_version 155040 (0.0005) [2023-03-09 13:52:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9205.6). Total num frames: 79392768. Throughput: 0: 9246.7. Samples: 79395072. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:52:22,858][708628] Avg episode reward: [(0, '3151.639')] [2023-03-09 13:52:25,510][709034] Updated weights for policy 0, policy_version 155120 (0.0005) [2023-03-09 13:52:27,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9205.6). Total num frames: 79441920. Throughput: 0: 9292.9. Samples: 79424112. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:52:27,858][708628] Avg episode reward: [(0, '2743.905')] [2023-03-09 13:52:29,879][709034] Updated weights for policy 0, policy_version 155200 (0.0005) [2023-03-09 13:52:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 79486976. Throughput: 0: 9282.7. Samples: 79478784. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:52:32,858][708628] Avg episode reward: [(0, '2285.154')] [2023-03-09 13:52:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000155248_79486976.pth... [2023-03-09 13:52:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000154696_79204352.pth [2023-03-09 13:52:34,415][709034] Updated weights for policy 0, policy_version 155280 (0.0005) [2023-03-09 13:52:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9191.7). Total num frames: 79532032. Throughput: 0: 9195.6. Samples: 79532112. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:52:37,858][708628] Avg episode reward: [(0, '1771.790')] [2023-03-09 13:52:38,886][709034] Updated weights for policy 0, policy_version 155360 (0.0005) [2023-03-09 13:52:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9191.7). Total num frames: 79581184. Throughput: 0: 9356.3. Samples: 79564472. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:52:42,858][708628] Avg episode reward: [(0, '1974.046')] [2023-03-09 13:52:43,065][709034] Updated weights for policy 0, policy_version 155440 (0.0005) [2023-03-09 13:52:47,450][709034] Updated weights for policy 0, policy_version 155520 (0.0005) [2023-03-09 13:52:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9177.8). Total num frames: 79626240. Throughput: 0: 9400.9. Samples: 79619264. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:52:47,858][708628] Avg episode reward: [(0, '2303.579')] [2023-03-09 13:52:47,907][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000155528_79630336.pth... [2023-03-09 13:52:47,908][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000154976_79347712.pth [2023-03-09 13:52:52,046][709034] Updated weights for policy 0, policy_version 155600 (0.0005) [2023-03-09 13:52:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 79671296. Throughput: 0: 9346.6. Samples: 79674024. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:52:52,858][708628] Avg episode reward: [(0, '2654.252')] [2023-03-09 13:52:56,466][709034] Updated weights for policy 0, policy_version 155680 (0.0005) [2023-03-09 13:52:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9177.8). Total num frames: 79720448. Throughput: 0: 9314.7. Samples: 79701112. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:52:57,858][708628] Avg episode reward: [(0, '3038.616')] [2023-03-09 13:53:00,934][709034] Updated weights for policy 0, policy_version 155760 (0.0005) [2023-03-09 13:53:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9163.9). Total num frames: 79765504. Throughput: 0: 9275.6. Samples: 79756728. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:53:02,858][708628] Avg episode reward: [(0, '3042.653')] [2023-03-09 13:53:02,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000155792_79765504.pth... [2023-03-09 13:53:02,866][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000155248_79486976.pth [2023-03-09 13:53:05,396][709034] Updated weights for policy 0, policy_version 155840 (0.0004) [2023-03-09 13:53:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9163.9). Total num frames: 79810560. Throughput: 0: 9262.9. Samples: 79811904. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-09 13:53:07,858][708628] Avg episode reward: [(0, '3008.491')] [2023-03-09 13:53:09,653][709034] Updated weights for policy 0, policy_version 155920 (0.0005) [2023-03-09 13:53:12,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9177.8). Total num frames: 79859712. Throughput: 0: 9255.1. Samples: 79840592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:53:12,858][708628] Avg episode reward: [(0, '3101.654')] [2023-03-09 13:53:14,179][709034] Updated weights for policy 0, policy_version 156000 (0.0005) [2023-03-09 13:53:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9177.8). Total num frames: 79900672. Throughput: 0: 9222.9. Samples: 79893816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:53:17,858][708628] Avg episode reward: [(0, '2825.438')] [2023-03-09 13:53:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000156056_79900672.pth... [2023-03-09 13:53:17,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000155528_79630336.pth [2023-03-09 13:53:18,947][709034] Updated weights for policy 0, policy_version 156080 (0.0005) [2023-03-09 13:53:22,857][708628] Fps is (10 sec: 8192.1, 60 sec: 9147.7, 300 sec: 9163.9). Total num frames: 79941632. Throughput: 0: 9178.8. Samples: 79945160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:53:22,858][708628] Avg episode reward: [(0, '2948.049')] [2023-03-09 13:53:23,838][709034] Updated weights for policy 0, policy_version 156160 (0.0005) [2023-03-09 13:53:27,857][708628] Fps is (10 sec: 8192.0, 60 sec: 9011.2, 300 sec: 9163.9). Total num frames: 79982592. Throughput: 0: 8985.9. Samples: 79968840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:53:27,858][708628] Avg episode reward: [(0, '2576.624')] [2023-03-09 13:53:29,000][709034] Updated weights for policy 0, policy_version 156240 (0.0006) [2023-03-09 13:53:32,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9011.2, 300 sec: 9163.9). Total num frames: 80027648. Throughput: 0: 8899.5. Samples: 80019744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:53:32,858][708628] Avg episode reward: [(0, '2731.328')] [2023-03-09 13:53:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000156304_80027648.pth... [2023-03-09 13:53:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000155792_79765504.pth [2023-03-09 13:53:33,525][709034] Updated weights for policy 0, policy_version 156320 (0.0005) [2023-03-09 13:53:37,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9011.2, 300 sec: 9163.9). Total num frames: 80072704. Throughput: 0: 8937.7. Samples: 80076220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:53:37,858][708628] Avg episode reward: [(0, '2964.288')] [2023-03-09 13:53:37,915][709034] Updated weights for policy 0, policy_version 156400 (0.0005) [2023-03-09 13:53:42,408][709034] Updated weights for policy 0, policy_version 156480 (0.0005) [2023-03-09 13:53:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 9177.8). Total num frames: 80121856. Throughput: 0: 8915.0. Samples: 80102288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:53:42,858][708628] Avg episode reward: [(0, '2525.497')] [2023-03-09 13:53:46,690][709034] Updated weights for policy 0, policy_version 156560 (0.0005) [2023-03-09 13:53:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9011.2, 300 sec: 9177.8). Total num frames: 80166912. Throughput: 0: 8939.6. Samples: 80159012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:53:47,858][708628] Avg episode reward: [(0, '2337.951')] [2023-03-09 13:53:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000156576_80166912.pth... [2023-03-09 13:53:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000156056_79900672.pth [2023-03-09 13:53:51,189][709034] Updated weights for policy 0, policy_version 156640 (0.0005) [2023-03-09 13:53:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9177.8). Total num frames: 80211968. Throughput: 0: 8956.7. Samples: 80214956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:53:52,858][708628] Avg episode reward: [(0, '2150.842')] [2023-03-09 13:53:55,663][709034] Updated weights for policy 0, policy_version 156720 (0.0005) [2023-03-09 13:53:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9011.2, 300 sec: 9191.7). Total num frames: 80261120. Throughput: 0: 8899.1. Samples: 80241052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:53:57,858][708628] Avg episode reward: [(0, '2697.019')] [2023-03-09 13:53:59,982][709034] Updated weights for policy 0, policy_version 156800 (0.0005) [2023-03-09 13:54:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9011.2, 300 sec: 9191.7). Total num frames: 80306176. Throughput: 0: 8971.9. Samples: 80297552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:54:02,858][708628] Avg episode reward: [(0, '3247.791')] [2023-03-09 13:54:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000156848_80306176.pth... [2023-03-09 13:54:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000156304_80027648.pth [2023-03-09 13:54:04,624][709034] Updated weights for policy 0, policy_version 156880 (0.0006) [2023-03-09 13:54:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9011.2, 300 sec: 9177.8). Total num frames: 80351232. Throughput: 0: 9022.9. Samples: 80351192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:54:07,858][708628] Avg episode reward: [(0, '3323.801')] [2023-03-09 13:54:09,179][709034] Updated weights for policy 0, policy_version 156960 (0.0005) [2023-03-09 13:54:12,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8942.9, 300 sec: 9191.7). Total num frames: 80396288. Throughput: 0: 9124.9. Samples: 80379460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:54:12,858][708628] Avg episode reward: [(0, '3097.715')] [2023-03-09 13:54:13,492][709034] Updated weights for policy 0, policy_version 157040 (0.0005) [2023-03-09 13:54:17,858][708628] Fps is (10 sec: 9010.8, 60 sec: 9011.1, 300 sec: 9205.6). Total num frames: 80441344. Throughput: 0: 9209.8. Samples: 80434188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:54:17,858][708628] Avg episode reward: [(0, '3095.336')] [2023-03-09 13:54:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000157112_80441344.pth... [2023-03-09 13:54:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000156576_80166912.pth [2023-03-09 13:54:18,021][709034] Updated weights for policy 0, policy_version 157120 (0.0005) [2023-03-09 13:54:22,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9011.2, 300 sec: 9205.6). Total num frames: 80482304. Throughput: 0: 9093.2. Samples: 80485416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:54:22,858][708628] Avg episode reward: [(0, '2955.311')] [2023-03-09 13:54:22,910][709034] Updated weights for policy 0, policy_version 157200 (0.0005) [2023-03-09 13:54:27,857][708628] Fps is (10 sec: 8192.4, 60 sec: 9011.2, 300 sec: 9205.6). Total num frames: 80523264. Throughput: 0: 9020.2. Samples: 80508196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:54:27,858][708628] Avg episode reward: [(0, '3073.272')] [2023-03-09 13:54:27,966][709034] Updated weights for policy 0, policy_version 157280 (0.0005) [2023-03-09 13:54:32,857][708628] Fps is (10 sec: 8191.9, 60 sec: 8942.9, 300 sec: 9191.7). Total num frames: 80564224. Throughput: 0: 8853.3. Samples: 80557412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:54:32,858][708628] Avg episode reward: [(0, '2947.539')] [2023-03-09 13:54:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000157352_80564224.pth... [2023-03-09 13:54:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000156848_80306176.pth [2023-03-09 13:54:33,213][709034] Updated weights for policy 0, policy_version 157360 (0.0005) [2023-03-09 13:54:37,857][708628] Fps is (10 sec: 8191.9, 60 sec: 8874.6, 300 sec: 9177.8). Total num frames: 80605184. Throughput: 0: 8671.0. Samples: 80605152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:54:37,858][708628] Avg episode reward: [(0, '2842.778')] [2023-03-09 13:54:38,224][709034] Updated weights for policy 0, policy_version 157440 (0.0006) [2023-03-09 13:54:42,814][709034] Updated weights for policy 0, policy_version 157520 (0.0005) [2023-03-09 13:54:42,857][708628] Fps is (10 sec: 8601.8, 60 sec: 8806.4, 300 sec: 9177.8). Total num frames: 80650240. Throughput: 0: 8702.1. Samples: 80632648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:54:42,858][708628] Avg episode reward: [(0, '2348.588')] [2023-03-09 13:54:47,562][709034] Updated weights for policy 0, policy_version 157600 (0.0005) [2023-03-09 13:54:47,857][708628] Fps is (10 sec: 8601.6, 60 sec: 8738.1, 300 sec: 9150.0). Total num frames: 80691200. Throughput: 0: 8593.3. Samples: 80684252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:54:47,858][708628] Avg episode reward: [(0, '2461.631')] [2023-03-09 13:54:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000157600_80691200.pth... [2023-03-09 13:54:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000157112_80441344.pth [2023-03-09 13:54:51,793][709034] Updated weights for policy 0, policy_version 157680 (0.0005) [2023-03-09 13:54:52,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8806.4, 300 sec: 9163.9). Total num frames: 80740352. Throughput: 0: 8662.8. Samples: 80741016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:54:52,858][708628] Avg episode reward: [(0, '2198.671')] [2023-03-09 13:54:56,283][709034] Updated weights for policy 0, policy_version 157760 (0.0005) [2023-03-09 13:54:57,857][708628] Fps is (10 sec: 9420.9, 60 sec: 8738.1, 300 sec: 9163.9). Total num frames: 80785408. Throughput: 0: 8648.6. Samples: 80768644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:54:57,858][708628] Avg episode reward: [(0, '2638.437')] [2023-03-09 13:55:01,133][709034] Updated weights for policy 0, policy_version 157840 (0.0005) [2023-03-09 13:55:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8738.1, 300 sec: 9136.2). Total num frames: 80830464. Throughput: 0: 8599.6. Samples: 80821168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:55:02,858][708628] Avg episode reward: [(0, '2640.100')] [2023-03-09 13:55:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000157872_80830464.pth... [2023-03-09 13:55:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000157352_80564224.pth [2023-03-09 13:55:05,336][709034] Updated weights for policy 0, policy_version 157920 (0.0005) [2023-03-09 13:55:07,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8738.1, 300 sec: 9122.3). Total num frames: 80875520. Throughput: 0: 8739.7. Samples: 80878700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:55:07,858][708628] Avg episode reward: [(0, '2754.015')] [2023-03-09 13:55:09,798][709034] Updated weights for policy 0, policy_version 158000 (0.0005) [2023-03-09 13:55:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 8738.2, 300 sec: 9108.4). Total num frames: 80920576. Throughput: 0: 8826.8. Samples: 80905404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:55:12,858][708628] Avg episode reward: [(0, '2759.056')] [2023-03-09 13:55:14,469][709034] Updated weights for policy 0, policy_version 158080 (0.0005) [2023-03-09 13:55:17,857][708628] Fps is (10 sec: 9011.1, 60 sec: 8738.2, 300 sec: 9108.4). Total num frames: 80965632. Throughput: 0: 8892.4. Samples: 80957568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:55:17,858][708628] Avg episode reward: [(0, '3037.287')] [2023-03-09 13:55:17,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000158136_80965632.pth... [2023-03-09 13:55:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000157600_80691200.pth [2023-03-09 13:55:19,052][709034] Updated weights for policy 0, policy_version 158160 (0.0005) [2023-03-09 13:55:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8806.4, 300 sec: 9108.4). Total num frames: 81010688. Throughput: 0: 9046.3. Samples: 81012236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:55:22,858][708628] Avg episode reward: [(0, '3208.855')] [2023-03-09 13:55:23,553][709034] Updated weights for policy 0, policy_version 158240 (0.0005) [2023-03-09 13:55:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 8874.7, 300 sec: 9094.5). Total num frames: 81055744. Throughput: 0: 9038.2. Samples: 81039368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:55:27,858][708628] Avg episode reward: [(0, '3359.260')] [2023-03-09 13:55:28,186][709034] Updated weights for policy 0, policy_version 158320 (0.0005) [2023-03-09 13:55:32,297][709034] Updated weights for policy 0, policy_version 158400 (0.0005) [2023-03-09 13:55:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9011.2, 300 sec: 9108.4). Total num frames: 81104896. Throughput: 0: 9124.6. Samples: 81094860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:55:32,858][708628] Avg episode reward: [(0, '3319.535')] [2023-03-09 13:55:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000158408_81104896.pth... [2023-03-09 13:55:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000157872_80830464.pth [2023-03-09 13:55:36,825][709034] Updated weights for policy 0, policy_version 158480 (0.0005) [2023-03-09 13:55:37,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9079.5, 300 sec: 9108.4). Total num frames: 81149952. Throughput: 0: 9138.8. Samples: 81152260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:55:37,858][708628] Avg episode reward: [(0, '3401.922')] [2023-03-09 13:55:41,302][709034] Updated weights for policy 0, policy_version 158560 (0.0006) [2023-03-09 13:55:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9094.5). Total num frames: 81195008. Throughput: 0: 9110.7. Samples: 81178624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:55:42,858][708628] Avg episode reward: [(0, '3295.200')] [2023-03-09 13:55:45,922][709034] Updated weights for policy 0, policy_version 158640 (0.0005) [2023-03-09 13:55:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9094.5). Total num frames: 81240064. Throughput: 0: 9127.1. Samples: 81231888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:55:47,858][708628] Avg episode reward: [(0, '3438.153')] [2023-03-09 13:55:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000158672_81240064.pth... [2023-03-09 13:55:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000158136_80965632.pth [2023-03-09 13:55:50,268][709034] Updated weights for policy 0, policy_version 158720 (0.0005) [2023-03-09 13:55:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9108.4). Total num frames: 81289216. Throughput: 0: 9118.6. Samples: 81289036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:55:52,858][708628] Avg episode reward: [(0, '3266.445')] [2023-03-09 13:55:54,479][709034] Updated weights for policy 0, policy_version 158800 (0.0005) [2023-03-09 13:55:57,857][708628] Fps is (10 sec: 9830.5, 60 sec: 9216.0, 300 sec: 9108.4). Total num frames: 81338368. Throughput: 0: 9166.7. Samples: 81317904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:55:57,858][708628] Avg episode reward: [(0, '3462.650')] [2023-03-09 13:55:58,669][709034] Updated weights for policy 0, policy_version 158880 (0.0005) [2023-03-09 13:56:02,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9108.4). Total num frames: 81383424. Throughput: 0: 9283.0. Samples: 81375304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:56:02,858][708628] Avg episode reward: [(0, '2816.572')] [2023-03-09 13:56:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000158952_81383424.pth... [2023-03-09 13:56:02,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000158408_81104896.pth [2023-03-09 13:56:02,911][709034] Updated weights for policy 0, policy_version 158960 (0.0005) [2023-03-09 13:56:07,275][709034] Updated weights for policy 0, policy_version 159040 (0.0005) [2023-03-09 13:56:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9122.3). Total num frames: 81432576. Throughput: 0: 9342.5. Samples: 81432648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:56:07,858][708628] Avg episode reward: [(0, '2957.325')] [2023-03-09 13:56:11,903][709034] Updated weights for policy 0, policy_version 159120 (0.0005) [2023-03-09 13:56:12,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9108.4). Total num frames: 81477632. Throughput: 0: 9352.4. Samples: 81460224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:56:12,858][708628] Avg episode reward: [(0, '2983.930')] [2023-03-09 13:56:16,376][709034] Updated weights for policy 0, policy_version 159200 (0.0005) [2023-03-09 13:56:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9108.4). Total num frames: 81522688. Throughput: 0: 9326.7. Samples: 81514560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:56:17,858][708628] Avg episode reward: [(0, '3386.537')] [2023-03-09 13:56:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000159224_81522688.pth... [2023-03-09 13:56:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000158672_81240064.pth [2023-03-09 13:56:20,634][709034] Updated weights for policy 0, policy_version 159280 (0.0005) [2023-03-09 13:56:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9094.5). Total num frames: 81567744. Throughput: 0: 9276.2. Samples: 81569688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:56:22,858][708628] Avg episode reward: [(0, '3537.665')] [2023-03-09 13:56:25,100][709034] Updated weights for policy 0, policy_version 159360 (0.0005) [2023-03-09 13:56:27,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9094.5). Total num frames: 81616896. Throughput: 0: 9354.1. Samples: 81599560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:56:27,858][708628] Avg episode reward: [(0, '3193.168')] [2023-03-09 13:56:29,453][709034] Updated weights for policy 0, policy_version 159440 (0.0005) [2023-03-09 13:56:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9094.5). Total num frames: 81661952. Throughput: 0: 9395.9. Samples: 81654704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:56:32,858][708628] Avg episode reward: [(0, '3173.948')] [2023-03-09 13:56:32,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000159496_81661952.pth... [2023-03-09 13:56:32,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000158952_81383424.pth [2023-03-09 13:56:33,946][709034] Updated weights for policy 0, policy_version 159520 (0.0005) [2023-03-09 13:56:37,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9284.2, 300 sec: 9094.5). Total num frames: 81707008. Throughput: 0: 9320.2. Samples: 81708444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:56:37,858][708628] Avg episode reward: [(0, '3025.889')] [2023-03-09 13:56:38,428][709034] Updated weights for policy 0, policy_version 159600 (0.0005) [2023-03-09 13:56:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9094.5). Total num frames: 81752064. Throughput: 0: 9332.4. Samples: 81737864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:56:42,858][708628] Avg episode reward: [(0, '2902.558')] [2023-03-09 13:56:42,893][709034] Updated weights for policy 0, policy_version 159680 (0.0005) [2023-03-09 13:56:47,104][709034] Updated weights for policy 0, policy_version 159760 (0.0006) [2023-03-09 13:56:47,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.6, 300 sec: 9094.5). Total num frames: 81801216. Throughput: 0: 9284.1. Samples: 81793088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:56:47,858][708628] Avg episode reward: [(0, '3530.199')] [2023-03-09 13:56:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000159768_81801216.pth... [2023-03-09 13:56:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000159224_81522688.pth [2023-03-09 13:56:51,706][709034] Updated weights for policy 0, policy_version 159840 (0.0005) [2023-03-09 13:56:52,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9108.4). Total num frames: 81846272. Throughput: 0: 9236.6. Samples: 81848296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:56:52,858][708628] Avg episode reward: [(0, '3631.242')] [2023-03-09 13:56:56,160][709034] Updated weights for policy 0, policy_version 159920 (0.0005) [2023-03-09 13:56:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9122.3). Total num frames: 81895424. Throughput: 0: 9228.1. Samples: 81875488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:56:57,858][708628] Avg episode reward: [(0, '2715.395')] [2023-03-09 13:57:00,410][709034] Updated weights for policy 0, policy_version 160000 (0.0005) [2023-03-09 13:57:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9108.4). Total num frames: 81940480. Throughput: 0: 9284.3. Samples: 81932352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:57:02,858][708628] Avg episode reward: [(0, '2887.724')] [2023-03-09 13:57:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000160040_81940480.pth... [2023-03-09 13:57:02,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000159496_81661952.pth [2023-03-09 13:57:04,985][709034] Updated weights for policy 0, policy_version 160080 (0.0005) [2023-03-09 13:57:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9108.4). Total num frames: 81985536. Throughput: 0: 9243.0. Samples: 81985624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:57:07,858][708628] Avg episode reward: [(0, '3441.313')] [2023-03-09 13:57:09,413][709034] Updated weights for policy 0, policy_version 160160 (0.0006) [2023-03-09 13:57:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9094.5). Total num frames: 82030592. Throughput: 0: 9214.4. Samples: 82014208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:57:12,858][708628] Avg episode reward: [(0, '3566.421')] [2023-03-09 13:57:13,955][709034] Updated weights for policy 0, policy_version 160240 (0.0005) [2023-03-09 13:57:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9094.5). Total num frames: 82075648. Throughput: 0: 9196.7. Samples: 82068556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:57:17,858][708628] Avg episode reward: [(0, '3500.036')] [2023-03-09 13:57:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000160304_82075648.pth... [2023-03-09 13:57:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000159768_81801216.pth [2023-03-09 13:57:18,438][709034] Updated weights for policy 0, policy_version 160320 (0.0005) [2023-03-09 13:57:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9080.6). Total num frames: 82120704. Throughput: 0: 9238.4. Samples: 82124172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:57:22,858][708628] Avg episode reward: [(0, '3396.211')] [2023-03-09 13:57:22,861][709034] Updated weights for policy 0, policy_version 160400 (0.0006) [2023-03-09 13:57:27,542][709034] Updated weights for policy 0, policy_version 160480 (0.0005) [2023-03-09 13:57:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9080.6). Total num frames: 82165760. Throughput: 0: 9144.9. Samples: 82149384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:57:27,858][708628] Avg episode reward: [(0, '3052.890')] [2023-03-09 13:57:32,170][709034] Updated weights for policy 0, policy_version 160560 (0.0005) [2023-03-09 13:57:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9080.6). Total num frames: 82210816. Throughput: 0: 9109.8. Samples: 82203028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:57:32,858][708628] Avg episode reward: [(0, '3020.809')] [2023-03-09 13:57:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000160568_82210816.pth... [2023-03-09 13:57:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000160040_81940480.pth [2023-03-09 13:57:36,631][709034] Updated weights for policy 0, policy_version 160640 (0.0005) [2023-03-09 13:57:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9066.7). Total num frames: 82255872. Throughput: 0: 9096.1. Samples: 82257620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:57:37,858][708628] Avg episode reward: [(0, '3241.169')] [2023-03-09 13:57:40,998][709034] Updated weights for policy 0, policy_version 160720 (0.0005) [2023-03-09 13:57:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9080.6). Total num frames: 82305024. Throughput: 0: 9112.2. Samples: 82285536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:57:42,858][708628] Avg episode reward: [(0, '2948.112')] [2023-03-09 13:57:45,038][709034] Updated weights for policy 0, policy_version 160800 (0.0005) [2023-03-09 13:57:47,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9216.0, 300 sec: 9094.5). Total num frames: 82354176. Throughput: 0: 9191.3. Samples: 82345960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:57:47,858][708628] Avg episode reward: [(0, '2777.247')] [2023-03-09 13:57:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000160848_82354176.pth... [2023-03-09 13:57:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000160304_82075648.pth [2023-03-09 13:57:49,444][709034] Updated weights for policy 0, policy_version 160880 (0.0005) [2023-03-09 13:57:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9080.6). Total num frames: 82399232. Throughput: 0: 9265.2. Samples: 82402560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:57:52,858][708628] Avg episode reward: [(0, '2814.799')] [2023-03-09 13:57:53,659][709034] Updated weights for policy 0, policy_version 160960 (0.0006) [2023-03-09 13:57:57,857][708628] Fps is (10 sec: 9421.0, 60 sec: 9216.0, 300 sec: 9094.5). Total num frames: 82448384. Throughput: 0: 9278.3. Samples: 82431732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:57:57,857][708628] Avg episode reward: [(0, '2769.000')] [2023-03-09 13:57:58,037][709034] Updated weights for policy 0, policy_version 161040 (0.0006) [2023-03-09 13:58:02,516][709034] Updated weights for policy 0, policy_version 161120 (0.0005) [2023-03-09 13:58:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9094.5). Total num frames: 82493440. Throughput: 0: 9265.9. Samples: 82485520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:58:02,868][708628] Avg episode reward: [(0, '2674.345')] [2023-03-09 13:58:02,870][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000161128_82497536.pth... [2023-03-09 13:58:02,873][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000160568_82210816.pth [2023-03-09 13:58:06,818][709034] Updated weights for policy 0, policy_version 161200 (0.0005) [2023-03-09 13:58:07,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9094.5). Total num frames: 82542592. Throughput: 0: 9298.2. Samples: 82542592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:58:07,858][708628] Avg episode reward: [(0, '2592.917')] [2023-03-09 13:58:11,547][709034] Updated weights for policy 0, policy_version 161280 (0.0005) [2023-03-09 13:58:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9094.5). Total num frames: 82583552. Throughput: 0: 9315.2. Samples: 82568568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:58:12,858][708628] Avg episode reward: [(0, '2239.202')] [2023-03-09 13:58:16,353][709034] Updated weights for policy 0, policy_version 161360 (0.0005) [2023-03-09 13:58:17,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9216.0, 300 sec: 9108.4). Total num frames: 82628608. Throughput: 0: 9275.3. Samples: 82620416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:58:17,858][708628] Avg episode reward: [(0, '2641.851')] [2023-03-09 13:58:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000161384_82628608.pth... [2023-03-09 13:58:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000160848_82354176.pth [2023-03-09 13:58:20,808][709034] Updated weights for policy 0, policy_version 161440 (0.0005) [2023-03-09 13:58:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9122.3). Total num frames: 82673664. Throughput: 0: 9290.8. Samples: 82675704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:58:22,858][708628] Avg episode reward: [(0, '2832.719')] [2023-03-09 13:58:25,219][709034] Updated weights for policy 0, policy_version 161520 (0.0005) [2023-03-09 13:58:27,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9136.2). Total num frames: 82722816. Throughput: 0: 9277.2. Samples: 82703008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:58:27,858][708628] Avg episode reward: [(0, '3264.299')] [2023-03-09 13:58:29,643][709034] Updated weights for policy 0, policy_version 161600 (0.0005) [2023-03-09 13:58:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9136.2). Total num frames: 82767872. Throughput: 0: 9193.3. Samples: 82759660. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:58:32,858][708628] Avg episode reward: [(0, '3288.022')] [2023-03-09 13:58:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000161656_82767872.pth... [2023-03-09 13:58:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000161128_82497536.pth [2023-03-09 13:58:34,107][709034] Updated weights for policy 0, policy_version 161680 (0.0004) [2023-03-09 13:58:37,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9122.3). Total num frames: 82812928. Throughput: 0: 9145.2. Samples: 82814096. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:58:37,858][708628] Avg episode reward: [(0, '3018.095')] [2023-03-09 13:58:38,519][709034] Updated weights for policy 0, policy_version 161760 (0.0005) [2023-03-09 13:58:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9122.3). Total num frames: 82857984. Throughput: 0: 9108.2. Samples: 82841600. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:58:42,858][708628] Avg episode reward: [(0, '2733.038')] [2023-03-09 13:58:43,137][709034] Updated weights for policy 0, policy_version 161840 (0.0005) [2023-03-09 13:58:47,525][709034] Updated weights for policy 0, policy_version 161920 (0.0005) [2023-03-09 13:58:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.8, 300 sec: 9122.3). Total num frames: 82903040. Throughput: 0: 9096.4. Samples: 82894856. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:58:47,858][708628] Avg episode reward: [(0, '3300.350')] [2023-03-09 13:58:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000161920_82903040.pth... [2023-03-09 13:58:47,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000161384_82628608.pth [2023-03-09 13:58:51,918][709034] Updated weights for policy 0, policy_version 162000 (0.0005) [2023-03-09 13:58:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9122.3). Total num frames: 82952192. Throughput: 0: 9100.6. Samples: 82952120. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:58:52,858][708628] Avg episode reward: [(0, '3170.301')] [2023-03-09 13:58:56,331][709034] Updated weights for policy 0, policy_version 162080 (0.0005) [2023-03-09 13:58:57,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9122.3). Total num frames: 82997248. Throughput: 0: 9121.4. Samples: 82979032. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:58:57,858][708628] Avg episode reward: [(0, '2446.648')] [2023-03-09 13:59:00,686][709034] Updated weights for policy 0, policy_version 162160 (0.0004) [2023-03-09 13:59:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9122.3). Total num frames: 83042304. Throughput: 0: 9258.0. Samples: 83037028. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:59:02,858][708628] Avg episode reward: [(0, '2898.190')] [2023-03-09 13:59:02,890][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000162200_83046400.pth... [2023-03-09 13:59:02,891][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000161656_82767872.pth [2023-03-09 13:59:05,183][709034] Updated weights for policy 0, policy_version 162240 (0.0005) [2023-03-09 13:59:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9136.2). Total num frames: 83091456. Throughput: 0: 9238.8. Samples: 83091452. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:59:07,858][708628] Avg episode reward: [(0, '2952.821')] [2023-03-09 13:59:09,422][709034] Updated weights for policy 0, policy_version 162320 (0.0005) [2023-03-09 13:59:12,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9150.1). Total num frames: 83140608. Throughput: 0: 9291.3. Samples: 83121116. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:59:12,858][708628] Avg episode reward: [(0, '3526.889')] [2023-03-09 13:59:13,602][709034] Updated weights for policy 0, policy_version 162400 (0.0005) [2023-03-09 13:59:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9163.9). Total num frames: 83185664. Throughput: 0: 9302.1. Samples: 83178256. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:59:17,858][708628] Avg episode reward: [(0, '3705.369')] [2023-03-09 13:59:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000162472_83185664.pth... [2023-03-09 13:59:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000161920_82903040.pth [2023-03-09 13:59:18,095][709034] Updated weights for policy 0, policy_version 162480 (0.0005) [2023-03-09 13:59:22,689][709034] Updated weights for policy 0, policy_version 162560 (0.0005) [2023-03-09 13:59:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9177.8). Total num frames: 83230720. Throughput: 0: 9265.0. Samples: 83231020. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:59:22,858][708628] Avg episode reward: [(0, '3615.744')] [2023-03-09 13:59:26,848][709034] Updated weights for policy 0, policy_version 162640 (0.0005) [2023-03-09 13:59:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9205.6). Total num frames: 83279872. Throughput: 0: 9336.9. Samples: 83261760. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:59:27,858][708628] Avg episode reward: [(0, '3317.168')] [2023-03-09 13:59:31,333][709034] Updated weights for policy 0, policy_version 162720 (0.0005) [2023-03-09 13:59:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9219.5). Total num frames: 83324928. Throughput: 0: 9373.7. Samples: 83316672. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 13:59:32,858][708628] Avg episode reward: [(0, '3226.761')] [2023-03-09 13:59:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000162744_83324928.pth... [2023-03-09 13:59:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000162200_83046400.pth [2023-03-09 13:59:35,920][709034] Updated weights for policy 0, policy_version 162800 (0.0005) [2023-03-09 13:59:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9219.5). Total num frames: 83369984. Throughput: 0: 9286.1. Samples: 83369992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:59:37,858][708628] Avg episode reward: [(0, '3210.300')] [2023-03-09 13:59:40,486][709034] Updated weights for policy 0, policy_version 162880 (0.0005) [2023-03-09 13:59:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 83415040. Throughput: 0: 9297.6. Samples: 83397424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:59:42,858][708628] Avg episode reward: [(0, '3583.786')] [2023-03-09 13:59:44,892][709034] Updated weights for policy 0, policy_version 162960 (0.0005) [2023-03-09 13:59:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9233.4). Total num frames: 83464192. Throughput: 0: 9293.7. Samples: 83455244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:59:47,858][708628] Avg episode reward: [(0, '2922.597')] [2023-03-09 13:59:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000163016_83464192.pth... [2023-03-09 13:59:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000162472_83185664.pth [2023-03-09 13:59:49,122][709034] Updated weights for policy 0, policy_version 163040 (0.0005) [2023-03-09 13:59:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 83509248. Throughput: 0: 9296.9. Samples: 83509812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:59:52,858][708628] Avg episode reward: [(0, '2796.733')] [2023-03-09 13:59:53,486][709034] Updated weights for policy 0, policy_version 163120 (0.0005) [2023-03-09 13:59:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9233.4). Total num frames: 83554304. Throughput: 0: 9262.6. Samples: 83537932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 13:59:57,858][708628] Avg episode reward: [(0, '3154.032')] [2023-03-09 13:59:58,009][709034] Updated weights for policy 0, policy_version 163200 (0.0005) [2023-03-09 14:00:02,224][709034] Updated weights for policy 0, policy_version 163280 (0.0005) [2023-03-09 14:00:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9247.2). Total num frames: 83603456. Throughput: 0: 9266.5. Samples: 83595248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:00:02,858][708628] Avg episode reward: [(0, '2573.926')] [2023-03-09 14:00:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000163288_83603456.pth... [2023-03-09 14:00:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000162744_83324928.pth [2023-03-09 14:00:06,580][709034] Updated weights for policy 0, policy_version 163360 (0.0005) [2023-03-09 14:00:07,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 83652608. Throughput: 0: 9353.2. Samples: 83651912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:00:07,858][708628] Avg episode reward: [(0, '3127.539')] [2023-03-09 14:00:10,866][709034] Updated weights for policy 0, policy_version 163440 (0.0005) [2023-03-09 14:00:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 83697664. Throughput: 0: 9311.9. Samples: 83680796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:00:12,858][708628] Avg episode reward: [(0, '2854.554')] [2023-03-09 14:00:15,172][709034] Updated weights for policy 0, policy_version 163520 (0.0005) [2023-03-09 14:00:17,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 83742720. Throughput: 0: 9316.4. Samples: 83735912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:00:17,858][708628] Avg episode reward: [(0, '2536.845')] [2023-03-09 14:00:17,891][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000163568_83746816.pth... [2023-03-09 14:00:17,893][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000163016_83464192.pth [2023-03-09 14:00:19,848][709034] Updated weights for policy 0, policy_version 163600 (0.0005) [2023-03-09 14:00:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 83787776. Throughput: 0: 9334.4. Samples: 83790040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:00:22,858][708628] Avg episode reward: [(0, '2718.280')] [2023-03-09 14:00:24,250][709034] Updated weights for policy 0, policy_version 163680 (0.0005) [2023-03-09 14:00:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 83836928. Throughput: 0: 9347.8. Samples: 83818076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:00:27,858][708628] Avg episode reward: [(0, '2863.985')] [2023-03-09 14:00:28,597][709034] Updated weights for policy 0, policy_version 163760 (0.0005) [2023-03-09 14:00:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 83881984. Throughput: 0: 9299.5. Samples: 83873720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:00:32,858][708628] Avg episode reward: [(0, '2995.570')] [2023-03-09 14:00:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000163832_83881984.pth... [2023-03-09 14:00:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000163288_83603456.pth [2023-03-09 14:00:33,228][709034] Updated weights for policy 0, policy_version 163840 (0.0005) [2023-03-09 14:00:37,677][709034] Updated weights for policy 0, policy_version 163920 (0.0005) [2023-03-09 14:00:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 83927040. Throughput: 0: 9281.5. Samples: 83927480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:00:37,858][708628] Avg episode reward: [(0, '3320.388')] [2023-03-09 14:00:42,249][709034] Updated weights for policy 0, policy_version 164000 (0.0005) [2023-03-09 14:00:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 83972096. Throughput: 0: 9269.3. Samples: 83955052. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:00:42,858][708628] Avg episode reward: [(0, '3109.323')] [2023-03-09 14:00:46,649][709034] Updated weights for policy 0, policy_version 164080 (0.0005) [2023-03-09 14:00:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 84017152. Throughput: 0: 9213.0. Samples: 84009832. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:00:47,858][708628] Avg episode reward: [(0, '3423.969')] [2023-03-09 14:00:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000164096_84017152.pth... [2023-03-09 14:00:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000163568_83746816.pth [2023-03-09 14:00:51,158][709034] Updated weights for policy 0, policy_version 164160 (0.0005) [2023-03-09 14:00:52,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9247.2). Total num frames: 84066304. Throughput: 0: 9196.1. Samples: 84065736. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:00:52,858][708628] Avg episode reward: [(0, '3057.017')] [2023-03-09 14:00:55,407][709034] Updated weights for policy 0, policy_version 164240 (0.0005) [2023-03-09 14:00:57,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9247.2). Total num frames: 84111360. Throughput: 0: 9203.6. Samples: 84094960. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:00:57,858][708628] Avg episode reward: [(0, '3274.167')] [2023-03-09 14:01:00,012][709034] Updated weights for policy 0, policy_version 164320 (0.0005) [2023-03-09 14:01:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 84156416. Throughput: 0: 9161.0. Samples: 84148156. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:01:02,868][708628] Avg episode reward: [(0, '3481.221')] [2023-03-09 14:01:02,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000164368_84156416.pth... [2023-03-09 14:01:02,874][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000163832_83881984.pth [2023-03-09 14:01:04,305][709034] Updated weights for policy 0, policy_version 164400 (0.0005) [2023-03-09 14:01:07,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 84205568. Throughput: 0: 9240.9. Samples: 84205880. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:01:07,868][708628] Avg episode reward: [(0, '3293.726')] [2023-03-09 14:01:08,617][709034] Updated weights for policy 0, policy_version 164480 (0.0005) [2023-03-09 14:01:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 84250624. Throughput: 0: 9225.6. Samples: 84233228. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:01:12,868][708628] Avg episode reward: [(0, '3533.307')] [2023-03-09 14:01:13,230][709034] Updated weights for policy 0, policy_version 164560 (0.0005) [2023-03-09 14:01:17,482][709034] Updated weights for policy 0, policy_version 164640 (0.0005) [2023-03-09 14:01:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 84295680. Throughput: 0: 9239.0. Samples: 84289476. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:01:17,868][708628] Avg episode reward: [(0, '3452.264')] [2023-03-09 14:01:17,870][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000164640_84295680.pth... [2023-03-09 14:01:17,872][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000164096_84017152.pth [2023-03-09 14:01:22,041][709034] Updated weights for policy 0, policy_version 164720 (0.0005) [2023-03-09 14:01:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 84340736. Throughput: 0: 9244.7. Samples: 84343492. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:01:22,858][708628] Avg episode reward: [(0, '3565.352')] [2023-03-09 14:01:26,510][709034] Updated weights for policy 0, policy_version 164800 (0.0005) [2023-03-09 14:01:27,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 84389888. Throughput: 0: 9231.2. Samples: 84370456. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:01:27,858][708628] Avg episode reward: [(0, '3525.997')] [2023-03-09 14:01:30,943][709034] Updated weights for policy 0, policy_version 164880 (0.0005) [2023-03-09 14:01:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 84434944. Throughput: 0: 9263.0. Samples: 84426668. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:01:32,858][708628] Avg episode reward: [(0, '3442.895')] [2023-03-09 14:01:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000164912_84434944.pth... [2023-03-09 14:01:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000164368_84156416.pth [2023-03-09 14:01:35,399][709034] Updated weights for policy 0, policy_version 164960 (0.0005) [2023-03-09 14:01:37,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 84484096. Throughput: 0: 9291.7. Samples: 84483864. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:01:37,858][708628] Avg episode reward: [(0, '3606.031')] [2023-03-09 14:01:39,616][709034] Updated weights for policy 0, policy_version 165040 (0.0005) [2023-03-09 14:01:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9247.2). Total num frames: 84529152. Throughput: 0: 9250.8. Samples: 84511248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:01:42,858][708628] Avg episode reward: [(0, '3341.496')] [2023-03-09 14:01:43,957][709034] Updated weights for policy 0, policy_version 165120 (0.0005) [2023-03-09 14:01:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 84578304. Throughput: 0: 9342.7. Samples: 84568576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:01:47,858][708628] Avg episode reward: [(0, '3560.328')] [2023-03-09 14:01:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000165192_84578304.pth... [2023-03-09 14:01:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000164640_84295680.pth [2023-03-09 14:01:48,222][709034] Updated weights for policy 0, policy_version 165200 (0.0005) [2023-03-09 14:01:52,606][709034] Updated weights for policy 0, policy_version 165280 (0.0005) [2023-03-09 14:01:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9247.2). Total num frames: 84623360. Throughput: 0: 9304.7. Samples: 84624592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:01:52,858][708628] Avg episode reward: [(0, '3651.097')] [2023-03-09 14:01:56,739][709034] Updated weights for policy 0, policy_version 165360 (0.0005) [2023-03-09 14:01:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 84672512. Throughput: 0: 9395.0. Samples: 84656004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:01:57,858][708628] Avg episode reward: [(0, '3663.238')] [2023-03-09 14:02:01,264][709034] Updated weights for policy 0, policy_version 165440 (0.0005) [2023-03-09 14:02:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 84717568. Throughput: 0: 9332.5. Samples: 84709440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:02:02,858][708628] Avg episode reward: [(0, '3843.315')] [2023-03-09 14:02:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000165464_84717568.pth... [2023-03-09 14:02:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000164912_84434944.pth [2023-03-09 14:02:05,738][709034] Updated weights for policy 0, policy_version 165520 (0.0004) [2023-03-09 14:02:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.2, 300 sec: 9261.1). Total num frames: 84762624. Throughput: 0: 9339.6. Samples: 84763776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:02:07,858][708628] Avg episode reward: [(0, '3664.681')] [2023-03-09 14:02:10,134][709034] Updated weights for policy 0, policy_version 165600 (0.0005) [2023-03-09 14:02:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 84811776. Throughput: 0: 9388.4. Samples: 84792932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:02:12,858][708628] Avg episode reward: [(0, '3310.251')] [2023-03-09 14:02:14,668][709034] Updated weights for policy 0, policy_version 165680 (0.0005) [2023-03-09 14:02:17,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 84856832. Throughput: 0: 9375.1. Samples: 84848548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:02:17,858][708628] Avg episode reward: [(0, '3653.675')] [2023-03-09 14:02:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000165736_84856832.pth... [2023-03-09 14:02:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000165192_84578304.pth [2023-03-09 14:02:18,961][709034] Updated weights for policy 0, policy_version 165760 (0.0004) [2023-03-09 14:02:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 84901888. Throughput: 0: 9314.9. Samples: 84903032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:02:22,858][708628] Avg episode reward: [(0, '3737.130')] [2023-03-09 14:02:23,575][709034] Updated weights for policy 0, policy_version 165840 (0.0005) [2023-03-09 14:02:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 84946944. Throughput: 0: 9319.5. Samples: 84930624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:02:27,858][708628] Avg episode reward: [(0, '3689.537')] [2023-03-09 14:02:28,016][709034] Updated weights for policy 0, policy_version 165920 (0.0004) [2023-03-09 14:02:32,430][709034] Updated weights for policy 0, policy_version 166000 (0.0005) [2023-03-09 14:02:32,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 84992000. Throughput: 0: 9285.3. Samples: 84986412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:02:32,858][708628] Avg episode reward: [(0, '3550.884')] [2023-03-09 14:02:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000166000_84992000.pth... [2023-03-09 14:02:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000165464_84717568.pth [2023-03-09 14:02:37,011][709034] Updated weights for policy 0, policy_version 166080 (0.0005) [2023-03-09 14:02:37,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 85037056. Throughput: 0: 9255.4. Samples: 85041084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:02:37,858][708628] Avg episode reward: [(0, '3661.187')] [2023-03-09 14:02:41,378][709034] Updated weights for policy 0, policy_version 166160 (0.0005) [2023-03-09 14:02:42,857][708628] Fps is (10 sec: 9420.6, 60 sec: 9284.2, 300 sec: 9261.1). Total num frames: 85086208. Throughput: 0: 9192.4. Samples: 85069660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:02:42,858][708628] Avg episode reward: [(0, '3717.615')] [2023-03-09 14:02:45,847][709034] Updated weights for policy 0, policy_version 166240 (0.0005) [2023-03-09 14:02:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 85131264. Throughput: 0: 9207.1. Samples: 85123760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:02:47,858][708628] Avg episode reward: [(0, '3465.715')] [2023-03-09 14:02:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000166272_85131264.pth... [2023-03-09 14:02:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000165736_84856832.pth [2023-03-09 14:02:50,377][709034] Updated weights for policy 0, policy_version 166320 (0.0005) [2023-03-09 14:02:52,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 85176320. Throughput: 0: 9209.2. Samples: 85178188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:02:52,858][708628] Avg episode reward: [(0, '3704.909')] [2023-03-09 14:02:54,995][709034] Updated weights for policy 0, policy_version 166400 (0.0005) [2023-03-09 14:02:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9247.2). Total num frames: 85221376. Throughput: 0: 9147.5. Samples: 85204568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:02:57,858][708628] Avg episode reward: [(0, '3625.193')] [2023-03-09 14:02:59,334][709034] Updated weights for policy 0, policy_version 166480 (0.0005) [2023-03-09 14:03:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 85270528. Throughput: 0: 9143.7. Samples: 85260016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:03:02,858][708628] Avg episode reward: [(0, '3601.960')] [2023-03-09 14:03:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000166544_85270528.pth... [2023-03-09 14:03:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000166000_84992000.pth [2023-03-09 14:03:03,669][709034] Updated weights for policy 0, policy_version 166560 (0.0005) [2023-03-09 14:03:07,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 85315584. Throughput: 0: 9208.5. Samples: 85317416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:03:07,858][708628] Avg episode reward: [(0, '3205.555')] [2023-03-09 14:03:07,972][709034] Updated weights for policy 0, policy_version 166640 (0.0005) [2023-03-09 14:03:12,267][709034] Updated weights for policy 0, policy_version 166720 (0.0004) [2023-03-09 14:03:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 85364736. Throughput: 0: 9241.6. Samples: 85346496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:03:12,858][708628] Avg episode reward: [(0, '3123.194')] [2023-03-09 14:03:16,828][709034] Updated weights for policy 0, policy_version 166800 (0.0005) [2023-03-09 14:03:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 85409792. Throughput: 0: 9225.6. Samples: 85401564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:03:17,858][708628] Avg episode reward: [(0, '3171.000')] [2023-03-09 14:03:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000166816_85409792.pth... [2023-03-09 14:03:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000166272_85131264.pth [2023-03-09 14:03:21,208][709034] Updated weights for policy 0, policy_version 166880 (0.0005) [2023-03-09 14:03:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 85454848. Throughput: 0: 9236.3. Samples: 85456720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:03:22,858][708628] Avg episode reward: [(0, '2693.847')] [2023-03-09 14:03:25,690][709034] Updated weights for policy 0, policy_version 166960 (0.0006) [2023-03-09 14:03:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 85499904. Throughput: 0: 9204.0. Samples: 85483840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:03:27,858][708628] Avg episode reward: [(0, '3105.945')] [2023-03-09 14:03:30,204][709034] Updated weights for policy 0, policy_version 167040 (0.0006) [2023-03-09 14:03:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 85544960. Throughput: 0: 9236.4. Samples: 85539396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:03:32,868][708628] Avg episode reward: [(0, '3244.761')] [2023-03-09 14:03:32,871][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000167080_85544960.pth... [2023-03-09 14:03:32,874][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000166544_85270528.pth [2023-03-09 14:03:34,700][709034] Updated weights for policy 0, policy_version 167120 (0.0005) [2023-03-09 14:03:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 85594112. Throughput: 0: 9241.0. Samples: 85594032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:03:37,858][708628] Avg episode reward: [(0, '3535.554')] [2023-03-09 14:03:39,077][709034] Updated weights for policy 0, policy_version 167200 (0.0005) [2023-03-09 14:03:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 85639168. Throughput: 0: 9282.9. Samples: 85622296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:03:42,858][708628] Avg episode reward: [(0, '3215.738')] [2023-03-09 14:03:43,396][709034] Updated weights for policy 0, policy_version 167280 (0.0005) [2023-03-09 14:03:47,701][709034] Updated weights for policy 0, policy_version 167360 (0.0004) [2023-03-09 14:03:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 85688320. Throughput: 0: 9335.8. Samples: 85680128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:03:47,858][708628] Avg episode reward: [(0, '3295.894')] [2023-03-09 14:03:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000167360_85688320.pth... [2023-03-09 14:03:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000166816_85409792.pth [2023-03-09 14:03:52,229][709034] Updated weights for policy 0, policy_version 167440 (0.0004) [2023-03-09 14:03:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 85733376. Throughput: 0: 9245.1. Samples: 85733448. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 14:03:52,858][708628] Avg episode reward: [(0, '3412.819')] [2023-03-09 14:03:56,695][709034] Updated weights for policy 0, policy_version 167520 (0.0004) [2023-03-09 14:03:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 85778432. Throughput: 0: 9234.7. Samples: 85762056. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 14:03:57,858][708628] Avg episode reward: [(0, '3320.002')] [2023-03-09 14:04:01,100][709034] Updated weights for policy 0, policy_version 167600 (0.0005) [2023-03-09 14:04:02,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 85823488. Throughput: 0: 9223.7. Samples: 85816628. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 14:04:02,858][708628] Avg episode reward: [(0, '3335.540')] [2023-03-09 14:04:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000167624_85823488.pth... [2023-03-09 14:04:02,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000167080_85544960.pth [2023-03-09 14:04:05,599][709034] Updated weights for policy 0, policy_version 167680 (0.0005) [2023-03-09 14:04:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 85872640. Throughput: 0: 9242.5. Samples: 85872632. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 14:04:07,858][708628] Avg episode reward: [(0, '3672.382')] [2023-03-09 14:04:09,950][709034] Updated weights for policy 0, policy_version 167760 (0.0005) [2023-03-09 14:04:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 85917696. Throughput: 0: 9274.6. Samples: 85901196. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 14:04:12,858][708628] Avg episode reward: [(0, '3609.857')] [2023-03-09 14:04:14,274][709034] Updated weights for policy 0, policy_version 167840 (0.0005) [2023-03-09 14:04:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 85966848. Throughput: 0: 9294.7. Samples: 85957660. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 14:04:17,858][708628] Avg episode reward: [(0, '3420.014')] [2023-03-09 14:04:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000167904_85966848.pth... [2023-03-09 14:04:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000167360_85688320.pth [2023-03-09 14:04:18,699][709034] Updated weights for policy 0, policy_version 167920 (0.0005) [2023-03-09 14:04:22,857][708628] Fps is (10 sec: 9420.6, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 86011904. Throughput: 0: 9309.1. Samples: 86012944. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 14:04:22,858][708628] Avg episode reward: [(0, '3565.953')] [2023-03-09 14:04:23,047][709034] Updated weights for policy 0, policy_version 168000 (0.0005) [2023-03-09 14:04:27,154][709034] Updated weights for policy 0, policy_version 168080 (0.0005) [2023-03-09 14:04:27,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 86061056. Throughput: 0: 9350.7. Samples: 86043076. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 14:04:27,858][708628] Avg episode reward: [(0, '3329.472')] [2023-03-09 14:04:31,494][709034] Updated weights for policy 0, policy_version 168160 (0.0005) [2023-03-09 14:04:32,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 86106112. Throughput: 0: 9343.2. Samples: 86100572. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 14:04:32,868][708628] Avg episode reward: [(0, '3087.384')] [2023-03-09 14:04:32,900][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000168184_86110208.pth... [2023-03-09 14:04:32,901][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000167624_85823488.pth [2023-03-09 14:04:35,958][709034] Updated weights for policy 0, policy_version 168240 (0.0006) [2023-03-09 14:04:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 86155264. Throughput: 0: 9375.1. Samples: 86155328. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 14:04:37,858][708628] Avg episode reward: [(0, '3292.164')] [2023-03-09 14:04:40,454][709034] Updated weights for policy 0, policy_version 168320 (0.0005) [2023-03-09 14:04:42,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 86200320. Throughput: 0: 9356.7. Samples: 86183108. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 14:04:42,858][708628] Avg episode reward: [(0, '3371.342')] [2023-03-09 14:04:44,783][709034] Updated weights for policy 0, policy_version 168400 (0.0005) [2023-03-09 14:04:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 86245376. Throughput: 0: 9375.6. Samples: 86238532. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 14:04:47,858][708628] Avg episode reward: [(0, '3448.412')] [2023-03-09 14:04:47,876][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000168456_86249472.pth... [2023-03-09 14:04:47,877][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000167904_85966848.pth [2023-03-09 14:04:49,207][709034] Updated weights for policy 0, policy_version 168480 (0.0005) [2023-03-09 14:04:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 86294528. Throughput: 0: 9374.7. Samples: 86294492. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-09 14:04:52,858][708628] Avg episode reward: [(0, '3437.666')] [2023-03-09 14:04:53,747][709034] Updated weights for policy 0, policy_version 168560 (0.0006) [2023-03-09 14:04:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 86339584. Throughput: 0: 9337.3. Samples: 86321376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:04:57,858][708628] Avg episode reward: [(0, '3461.111')] [2023-03-09 14:04:58,216][709034] Updated weights for policy 0, policy_version 168640 (0.0005) [2023-03-09 14:05:02,683][709034] Updated weights for policy 0, policy_version 168720 (0.0005) [2023-03-09 14:05:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 86384640. Throughput: 0: 9307.8. Samples: 86376512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:05:02,858][708628] Avg episode reward: [(0, '3422.633')] [2023-03-09 14:05:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000168720_86384640.pth... [2023-03-09 14:05:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000168184_86110208.pth [2023-03-09 14:05:07,014][709034] Updated weights for policy 0, policy_version 168800 (0.0005) [2023-03-09 14:05:07,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 86429696. Throughput: 0: 9315.9. Samples: 86432160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:05:07,858][708628] Avg episode reward: [(0, '3376.878')] [2023-03-09 14:05:11,288][709034] Updated weights for policy 0, policy_version 168880 (0.0005) [2023-03-09 14:05:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 86478848. Throughput: 0: 9309.2. Samples: 86461988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:05:12,858][708628] Avg episode reward: [(0, '3516.112')] [2023-03-09 14:05:15,545][709034] Updated weights for policy 0, policy_version 168960 (0.0005) [2023-03-09 14:05:17,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9288.9). Total num frames: 86528000. Throughput: 0: 9315.6. Samples: 86519776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:05:17,858][708628] Avg episode reward: [(0, '3754.380')] [2023-03-09 14:05:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000169000_86528000.pth... [2023-03-09 14:05:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000168456_86249472.pth [2023-03-09 14:05:19,903][709034] Updated weights for policy 0, policy_version 169040 (0.0006) [2023-03-09 14:05:22,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9288.9). Total num frames: 86577152. Throughput: 0: 9375.3. Samples: 86577216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:05:22,858][708628] Avg episode reward: [(0, '3826.212')] [2023-03-09 14:05:23,953][709034] Updated weights for policy 0, policy_version 169120 (0.0005) [2023-03-09 14:05:27,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9420.8, 300 sec: 9302.8). Total num frames: 86626304. Throughput: 0: 9482.9. Samples: 86609836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:05:27,858][708628] Avg episode reward: [(0, '3901.872')] [2023-03-09 14:05:27,861][709034] Updated weights for policy 0, policy_version 169200 (0.0005) [2023-03-09 14:05:32,273][709034] Updated weights for policy 0, policy_version 169280 (0.0005) [2023-03-09 14:05:32,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9489.0, 300 sec: 9316.7). Total num frames: 86675456. Throughput: 0: 9527.4. Samples: 86667264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:05:32,858][708628] Avg episode reward: [(0, '3898.049')] [2023-03-09 14:05:32,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000169288_86675456.pth... [2023-03-09 14:05:32,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000168720_86384640.pth [2023-03-09 14:05:36,670][709034] Updated weights for policy 0, policy_version 169360 (0.0004) [2023-03-09 14:05:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9316.7). Total num frames: 86720512. Throughput: 0: 9518.1. Samples: 86722804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:05:37,858][708628] Avg episode reward: [(0, '3923.608')] [2023-03-09 14:05:41,060][709034] Updated weights for policy 0, policy_version 169440 (0.0004) [2023-03-09 14:05:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9330.6). Total num frames: 86769664. Throughput: 0: 9546.7. Samples: 86750976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:05:42,858][708628] Avg episode reward: [(0, '3839.771')] [2023-03-09 14:05:45,471][709034] Updated weights for policy 0, policy_version 169520 (0.0005) [2023-03-09 14:05:47,857][708628] Fps is (10 sec: 9420.6, 60 sec: 9489.0, 300 sec: 9316.7). Total num frames: 86814720. Throughput: 0: 9555.9. Samples: 86806528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:05:47,858][708628] Avg episode reward: [(0, '3906.304')] [2023-03-09 14:05:47,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000169560_86814720.pth... [2023-03-09 14:05:47,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000169000_86528000.pth [2023-03-09 14:05:49,837][709034] Updated weights for policy 0, policy_version 169600 (0.0005) [2023-03-09 14:05:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9330.5). Total num frames: 86863872. Throughput: 0: 9593.6. Samples: 86863872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:05:52,858][708628] Avg episode reward: [(0, '3836.939')] [2023-03-09 14:05:54,039][709034] Updated weights for policy 0, policy_version 169680 (0.0005) [2023-03-09 14:05:57,857][708628] Fps is (10 sec: 9421.0, 60 sec: 9489.1, 300 sec: 9330.6). Total num frames: 86908928. Throughput: 0: 9566.7. Samples: 86892488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:05:57,858][708628] Avg episode reward: [(0, '3631.455')] [2023-03-09 14:05:58,329][709034] Updated weights for policy 0, policy_version 169760 (0.0005) [2023-03-09 14:06:02,565][709034] Updated weights for policy 0, policy_version 169840 (0.0005) [2023-03-09 14:06:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9330.5). Total num frames: 86958080. Throughput: 0: 9559.6. Samples: 86949960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:06:02,858][708628] Avg episode reward: [(0, '3627.504')] [2023-03-09 14:06:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000169840_86958080.pth... [2023-03-09 14:06:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000169288_86675456.pth [2023-03-09 14:06:07,085][709034] Updated weights for policy 0, policy_version 169920 (0.0005) [2023-03-09 14:06:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9330.5). Total num frames: 87003136. Throughput: 0: 9511.7. Samples: 87005244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:06:07,858][708628] Avg episode reward: [(0, '3690.456')] [2023-03-09 14:06:11,370][709034] Updated weights for policy 0, policy_version 170000 (0.0005) [2023-03-09 14:06:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9344.4). Total num frames: 87052288. Throughput: 0: 9410.4. Samples: 87033304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:06:12,858][708628] Avg episode reward: [(0, '3824.067')] [2023-03-09 14:06:15,816][709034] Updated weights for policy 0, policy_version 170080 (0.0005) [2023-03-09 14:06:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 87097344. Throughput: 0: 9423.7. Samples: 87091332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:06:17,858][708628] Avg episode reward: [(0, '3974.868')] [2023-03-09 14:06:17,867][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000170120_87101440.pth... [2023-03-09 14:06:17,868][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000169560_86814720.pth [2023-03-09 14:06:20,136][709034] Updated weights for policy 0, policy_version 170160 (0.0005) [2023-03-09 14:06:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9344.4). Total num frames: 87146496. Throughput: 0: 9425.8. Samples: 87146964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:06:22,858][708628] Avg episode reward: [(0, '3756.217')] [2023-03-09 14:06:24,440][709034] Updated weights for policy 0, policy_version 170240 (0.0005) [2023-03-09 14:06:27,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 87191552. Throughput: 0: 9426.5. Samples: 87175168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:06:27,858][708628] Avg episode reward: [(0, '3820.920')] [2023-03-09 14:06:28,784][709034] Updated weights for policy 0, policy_version 170320 (0.0005) [2023-03-09 14:06:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 87240704. Throughput: 0: 9466.6. Samples: 87232524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:06:32,858][708628] Avg episode reward: [(0, '3936.938')] [2023-03-09 14:06:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000170392_87240704.pth... [2023-03-09 14:06:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000169840_86958080.pth [2023-03-09 14:06:33,007][709034] Updated weights for policy 0, policy_version 170400 (0.0005) [2023-03-09 14:06:37,553][709034] Updated weights for policy 0, policy_version 170480 (0.0004) [2023-03-09 14:06:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 87285760. Throughput: 0: 9419.9. Samples: 87287768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:06:37,858][708628] Avg episode reward: [(0, '3661.172')] [2023-03-09 14:06:42,194][709034] Updated weights for policy 0, policy_version 170560 (0.0005) [2023-03-09 14:06:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9330.6). Total num frames: 87330816. Throughput: 0: 9376.5. Samples: 87314432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:06:42,858][708628] Avg episode reward: [(0, '3572.413')] [2023-03-09 14:06:46,694][709034] Updated weights for policy 0, policy_version 170640 (0.0005) [2023-03-09 14:06:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 87375872. Throughput: 0: 9287.8. Samples: 87367912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:06:47,858][708628] Avg episode reward: [(0, '3815.587')] [2023-03-09 14:06:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000170656_87375872.pth... [2023-03-09 14:06:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000170120_87101440.pth [2023-03-09 14:06:51,078][709034] Updated weights for policy 0, policy_version 170720 (0.0005) [2023-03-09 14:06:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 87420928. Throughput: 0: 9310.9. Samples: 87424236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:06:52,858][708628] Avg episode reward: [(0, '3854.054')] [2023-03-09 14:06:55,778][709034] Updated weights for policy 0, policy_version 170800 (0.0004) [2023-03-09 14:06:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 87465984. Throughput: 0: 9251.2. Samples: 87449608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:06:57,858][708628] Avg episode reward: [(0, '3863.931')] [2023-03-09 14:07:00,043][709034] Updated weights for policy 0, policy_version 170880 (0.0004) [2023-03-09 14:07:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 87515136. Throughput: 0: 9251.1. Samples: 87507632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:07:02,858][708628] Avg episode reward: [(0, '3517.025')] [2023-03-09 14:07:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000170928_87515136.pth... [2023-03-09 14:07:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000170392_87240704.pth [2023-03-09 14:07:04,563][709034] Updated weights for policy 0, policy_version 170960 (0.0005) [2023-03-09 14:07:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 87560192. Throughput: 0: 9206.3. Samples: 87561248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:07:07,858][708628] Avg episode reward: [(0, '3581.010')] [2023-03-09 14:07:08,998][709034] Updated weights for policy 0, policy_version 171040 (0.0005) [2023-03-09 14:07:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 87605248. Throughput: 0: 9189.3. Samples: 87588688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:07:12,858][708628] Avg episode reward: [(0, '3662.630')] [2023-03-09 14:07:13,476][709034] Updated weights for policy 0, policy_version 171120 (0.0004) [2023-03-09 14:07:17,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 87650304. Throughput: 0: 9106.2. Samples: 87642304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:07:17,858][708628] Avg episode reward: [(0, '3861.674')] [2023-03-09 14:07:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000171192_87650304.pth... [2023-03-09 14:07:17,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000170656_87375872.pth [2023-03-09 14:07:17,964][709034] Updated weights for policy 0, policy_version 171200 (0.0004) [2023-03-09 14:07:22,719][709034] Updated weights for policy 0, policy_version 171280 (0.0004) [2023-03-09 14:07:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 87695360. Throughput: 0: 9059.2. Samples: 87695432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:07:22,858][708628] Avg episode reward: [(0, '3517.133')] [2023-03-09 14:07:27,089][709034] Updated weights for policy 0, policy_version 171360 (0.0005) [2023-03-09 14:07:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 87740416. Throughput: 0: 9101.7. Samples: 87724008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:07:27,858][708628] Avg episode reward: [(0, '3317.190')] [2023-03-09 14:07:31,389][709034] Updated weights for policy 0, policy_version 171440 (0.0005) [2023-03-09 14:07:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9330.5). Total num frames: 87789568. Throughput: 0: 9182.9. Samples: 87781144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:07:32,858][708628] Avg episode reward: [(0, '3325.985')] [2023-03-09 14:07:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000171464_87789568.pth... [2023-03-09 14:07:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000170928_87515136.pth [2023-03-09 14:07:35,441][709034] Updated weights for policy 0, policy_version 171520 (0.0005) [2023-03-09 14:07:37,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 87838720. Throughput: 0: 9245.4. Samples: 87840280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:07:37,858][708628] Avg episode reward: [(0, '3208.768')] [2023-03-09 14:07:39,752][709034] Updated weights for policy 0, policy_version 171600 (0.0005) [2023-03-09 14:07:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 87883776. Throughput: 0: 9298.6. Samples: 87868044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:07:42,858][708628] Avg episode reward: [(0, '3555.184')] [2023-03-09 14:07:44,359][709034] Updated weights for policy 0, policy_version 171680 (0.0005) [2023-03-09 14:07:47,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 87928832. Throughput: 0: 9190.0. Samples: 87921180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:07:47,868][708628] Avg episode reward: [(0, '3725.788')] [2023-03-09 14:07:47,870][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000171736_87928832.pth... [2023-03-09 14:07:47,872][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000171192_87650304.pth [2023-03-09 14:07:48,905][709034] Updated weights for policy 0, policy_version 171760 (0.0005) [2023-03-09 14:07:52,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 87977984. Throughput: 0: 9260.1. Samples: 87977952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:07:52,868][708628] Avg episode reward: [(0, '3603.945')] [2023-03-09 14:07:53,229][709034] Updated weights for policy 0, policy_version 171840 (0.0005) [2023-03-09 14:07:57,415][709034] Updated weights for policy 0, policy_version 171920 (0.0005) [2023-03-09 14:07:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 88023040. Throughput: 0: 9276.0. Samples: 88006108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:07:57,867][708628] Avg episode reward: [(0, '3498.421')] [2023-03-09 14:08:01,814][709034] Updated weights for policy 0, policy_version 172000 (0.0005) [2023-03-09 14:08:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 88072192. Throughput: 0: 9369.0. Samples: 88063912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:08:02,868][708628] Avg episode reward: [(0, '3582.450')] [2023-03-09 14:08:02,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000172016_88072192.pth... [2023-03-09 14:08:02,875][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000171464_87789568.pth [2023-03-09 14:08:06,203][709034] Updated weights for policy 0, policy_version 172080 (0.0005) [2023-03-09 14:08:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 88117248. Throughput: 0: 9423.0. Samples: 88119464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:08:07,858][708628] Avg episode reward: [(0, '3733.747')] [2023-03-09 14:08:10,755][709034] Updated weights for policy 0, policy_version 172160 (0.0006) [2023-03-09 14:08:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 88166400. Throughput: 0: 9376.0. Samples: 88145928. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 14:08:12,858][708628] Avg episode reward: [(0, '3773.744')] [2023-03-09 14:08:14,845][709034] Updated weights for policy 0, policy_version 172240 (0.0005) [2023-03-09 14:08:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 88211456. Throughput: 0: 9381.9. Samples: 88203328. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 14:08:17,858][708628] Avg episode reward: [(0, '3714.690')] [2023-03-09 14:08:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000172288_88211456.pth... [2023-03-09 14:08:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000171736_87928832.pth [2023-03-09 14:08:19,424][709034] Updated weights for policy 0, policy_version 172320 (0.0005) [2023-03-09 14:08:22,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 88256512. Throughput: 0: 9308.8. Samples: 88259176. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 14:08:22,858][708628] Avg episode reward: [(0, '3657.264')] [2023-03-09 14:08:23,839][709034] Updated weights for policy 0, policy_version 172400 (0.0004) [2023-03-09 14:08:27,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 88305664. Throughput: 0: 9269.8. Samples: 88285184. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 14:08:27,858][708628] Avg episode reward: [(0, '3436.598')] [2023-03-09 14:08:28,182][709034] Updated weights for policy 0, policy_version 172480 (0.0005) [2023-03-09 14:08:32,689][709034] Updated weights for policy 0, policy_version 172560 (0.0005) [2023-03-09 14:08:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 88350720. Throughput: 0: 9363.4. Samples: 88342536. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 14:08:32,858][708628] Avg episode reward: [(0, '3631.720')] [2023-03-09 14:08:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000172560_88350720.pth... [2023-03-09 14:08:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000172016_88072192.pth [2023-03-09 14:08:37,302][709034] Updated weights for policy 0, policy_version 172640 (0.0005) [2023-03-09 14:08:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 88395776. Throughput: 0: 9290.7. Samples: 88396032. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 14:08:37,858][708628] Avg episode reward: [(0, '3804.168')] [2023-03-09 14:08:41,618][709034] Updated weights for policy 0, policy_version 172720 (0.0005) [2023-03-09 14:08:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 88440832. Throughput: 0: 9297.8. Samples: 88424512. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 14:08:42,858][708628] Avg episode reward: [(0, '3487.328')] [2023-03-09 14:08:46,214][709034] Updated weights for policy 0, policy_version 172800 (0.0004) [2023-03-09 14:08:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.2, 300 sec: 9330.5). Total num frames: 88485888. Throughput: 0: 9200.9. Samples: 88477952. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 14:08:47,858][708628] Avg episode reward: [(0, '3175.993')] [2023-03-09 14:08:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000172824_88485888.pth... [2023-03-09 14:08:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000172288_88211456.pth [2023-03-09 14:08:50,664][709034] Updated weights for policy 0, policy_version 172880 (0.0006) [2023-03-09 14:08:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 88530944. Throughput: 0: 9223.1. Samples: 88534504. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 14:08:52,858][708628] Avg episode reward: [(0, '3626.693')] [2023-03-09 14:08:55,179][709034] Updated weights for policy 0, policy_version 172960 (0.0004) [2023-03-09 14:08:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 88576000. Throughput: 0: 9217.2. Samples: 88560700. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 14:08:57,858][708628] Avg episode reward: [(0, '3653.470')] [2023-03-09 14:08:59,676][709034] Updated weights for policy 0, policy_version 173040 (0.0005) [2023-03-09 14:09:02,857][708628] Fps is (10 sec: 9420.6, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 88625152. Throughput: 0: 9165.3. Samples: 88615768. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 14:09:02,858][708628] Avg episode reward: [(0, '3568.172')] [2023-03-09 14:09:02,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000173096_88625152.pth... [2023-03-09 14:09:02,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000172560_88350720.pth [2023-03-09 14:09:04,112][709034] Updated weights for policy 0, policy_version 173120 (0.0005) [2023-03-09 14:09:07,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 88670208. Throughput: 0: 9146.2. Samples: 88670756. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 14:09:07,858][708628] Avg episode reward: [(0, '3841.863')] [2023-03-09 14:09:08,424][709034] Updated weights for policy 0, policy_version 173200 (0.0005) [2023-03-09 14:09:12,857][708628] Fps is (10 sec: 9011.4, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 88715264. Throughput: 0: 9246.9. Samples: 88701296. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-09 14:09:12,858][708628] Avg episode reward: [(0, '3846.483')] [2023-03-09 14:09:12,934][709034] Updated weights for policy 0, policy_version 173280 (0.0004) [2023-03-09 14:09:17,388][709034] Updated weights for policy 0, policy_version 173360 (0.0005) [2023-03-09 14:09:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 88764416. Throughput: 0: 9165.4. Samples: 88754980. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:09:17,858][708628] Avg episode reward: [(0, '3752.610')] [2023-03-09 14:09:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000173368_88764416.pth... [2023-03-09 14:09:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000172824_88485888.pth [2023-03-09 14:09:21,917][709034] Updated weights for policy 0, policy_version 173440 (0.0005) [2023-03-09 14:09:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9302.8). Total num frames: 88805376. Throughput: 0: 9180.9. Samples: 88809172. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:09:22,858][708628] Avg episode reward: [(0, '3752.372')] [2023-03-09 14:09:26,377][709034] Updated weights for policy 0, policy_version 173520 (0.0005) [2023-03-09 14:09:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9316.7). Total num frames: 88854528. Throughput: 0: 9175.6. Samples: 88837416. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:09:27,858][708628] Avg episode reward: [(0, '3645.972')] [2023-03-09 14:09:30,724][709034] Updated weights for policy 0, policy_version 173600 (0.0005) [2023-03-09 14:09:32,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9147.8, 300 sec: 9302.8). Total num frames: 88899584. Throughput: 0: 9208.0. Samples: 88892312. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:09:32,858][708628] Avg episode reward: [(0, '3517.823')] [2023-03-09 14:09:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000173632_88899584.pth... [2023-03-09 14:09:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000173096_88625152.pth [2023-03-09 14:09:35,226][709034] Updated weights for policy 0, policy_version 173680 (0.0006) [2023-03-09 14:09:37,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.8, 300 sec: 9302.8). Total num frames: 88944640. Throughput: 0: 9157.3. Samples: 88946584. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:09:37,858][708628] Avg episode reward: [(0, '3759.354')] [2023-03-09 14:09:39,847][709034] Updated weights for policy 0, policy_version 173760 (0.0005) [2023-03-09 14:09:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9302.8). Total num frames: 88989696. Throughput: 0: 9172.8. Samples: 88973476. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:09:42,858][708628] Avg episode reward: [(0, '3920.005')] [2023-03-09 14:09:44,227][709034] Updated weights for policy 0, policy_version 173840 (0.0004) [2023-03-09 14:09:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.8, 300 sec: 9288.9). Total num frames: 89034752. Throughput: 0: 9145.0. Samples: 89027292. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:09:47,858][708628] Avg episode reward: [(0, '3943.093')] [2023-03-09 14:09:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000173896_89034752.pth... [2023-03-09 14:09:47,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000173368_88764416.pth [2023-03-09 14:09:48,923][709034] Updated weights for policy 0, policy_version 173920 (0.0005) [2023-03-09 14:09:52,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9288.9). Total num frames: 89079808. Throughput: 0: 9167.3. Samples: 89083284. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:09:52,858][708628] Avg episode reward: [(0, '3829.649')] [2023-03-09 14:09:53,269][709034] Updated weights for policy 0, policy_version 174000 (0.0005) [2023-03-09 14:09:57,678][709034] Updated weights for policy 0, policy_version 174080 (0.0005) [2023-03-09 14:09:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 89128960. Throughput: 0: 9120.9. Samples: 89111736. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:09:57,858][708628] Avg episode reward: [(0, '3918.777')] [2023-03-09 14:10:02,084][709034] Updated weights for policy 0, policy_version 174160 (0.0005) [2023-03-09 14:10:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9302.8). Total num frames: 89174016. Throughput: 0: 9147.5. Samples: 89166616. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:10:02,858][708628] Avg episode reward: [(0, '3933.204')] [2023-03-09 14:10:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000174168_89174016.pth... [2023-03-09 14:10:02,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000173632_88899584.pth [2023-03-09 14:10:06,338][709034] Updated weights for policy 0, policy_version 174240 (0.0005) [2023-03-09 14:10:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 89223168. Throughput: 0: 9230.9. Samples: 89224564. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:10:07,858][708628] Avg episode reward: [(0, '3958.184')] [2023-03-09 14:10:10,689][709034] Updated weights for policy 0, policy_version 174320 (0.0005) [2023-03-09 14:10:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 89268224. Throughput: 0: 9215.7. Samples: 89252120. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:10:12,858][708628] Avg episode reward: [(0, '3809.700')] [2023-03-09 14:10:15,160][709034] Updated weights for policy 0, policy_version 174400 (0.0005) [2023-03-09 14:10:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 89317376. Throughput: 0: 9263.3. Samples: 89309160. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:10:17,858][708628] Avg episode reward: [(0, '3889.627')] [2023-03-09 14:10:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000174448_89317376.pth... [2023-03-09 14:10:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000173896_89034752.pth [2023-03-09 14:10:19,431][709034] Updated weights for policy 0, policy_version 174480 (0.0005) [2023-03-09 14:10:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9275.0). Total num frames: 89362432. Throughput: 0: 9272.7. Samples: 89363856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:10:22,858][708628] Avg episode reward: [(0, '3911.162')] [2023-03-09 14:10:23,993][709034] Updated weights for policy 0, policy_version 174560 (0.0005) [2023-03-09 14:10:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 89407488. Throughput: 0: 9278.9. Samples: 89391028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:10:27,858][708628] Avg episode reward: [(0, '3879.874')] [2023-03-09 14:10:28,638][709034] Updated weights for policy 0, policy_version 174640 (0.0005) [2023-03-09 14:10:32,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9261.1). Total num frames: 89452544. Throughput: 0: 9269.6. Samples: 89444424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:10:32,858][708628] Avg episode reward: [(0, '3951.629')] [2023-03-09 14:10:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000174712_89452544.pth... [2023-03-09 14:10:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000174168_89174016.pth [2023-03-09 14:10:32,948][709034] Updated weights for policy 0, policy_version 174720 (0.0005) [2023-03-09 14:10:37,529][709034] Updated weights for policy 0, policy_version 174800 (0.0006) [2023-03-09 14:10:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 89497600. Throughput: 0: 9258.7. Samples: 89499928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:10:37,858][708628] Avg episode reward: [(0, '3927.229')] [2023-03-09 14:10:42,017][709034] Updated weights for policy 0, policy_version 174880 (0.0005) [2023-03-09 14:10:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 89542656. Throughput: 0: 9219.2. Samples: 89526600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:10:42,858][708628] Avg episode reward: [(0, '3966.680')] [2023-03-09 14:10:46,590][709034] Updated weights for policy 0, policy_version 174960 (0.0005) [2023-03-09 14:10:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.2, 300 sec: 9247.2). Total num frames: 89591808. Throughput: 0: 9210.0. Samples: 89581068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:10:47,858][708628] Avg episode reward: [(0, '3842.827')] [2023-03-09 14:10:47,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000174984_89591808.pth... [2023-03-09 14:10:47,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000174448_89317376.pth [2023-03-09 14:10:50,816][709034] Updated weights for policy 0, policy_version 175040 (0.0005) [2023-03-09 14:10:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9247.2). Total num frames: 89636864. Throughput: 0: 9193.3. Samples: 89638264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:10:52,858][708628] Avg episode reward: [(0, '3914.330')] [2023-03-09 14:10:55,263][709034] Updated weights for policy 0, policy_version 175120 (0.0005) [2023-03-09 14:10:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 89681920. Throughput: 0: 9188.6. Samples: 89665608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:10:57,868][708628] Avg episode reward: [(0, '3867.426')] [2023-03-09 14:10:59,705][709034] Updated weights for policy 0, policy_version 175200 (0.0005) [2023-03-09 14:11:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9247.2). Total num frames: 89731072. Throughput: 0: 9157.5. Samples: 89721248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:11:02,868][708628] Avg episode reward: [(0, '3669.271')] [2023-03-09 14:11:02,872][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000175256_89731072.pth... [2023-03-09 14:11:02,874][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000174712_89452544.pth [2023-03-09 14:11:04,189][709034] Updated weights for policy 0, policy_version 175280 (0.0005) [2023-03-09 14:11:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 89776128. Throughput: 0: 9159.5. Samples: 89776032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:11:07,858][708628] Avg episode reward: [(0, '3693.877')] [2023-03-09 14:11:08,789][709034] Updated weights for policy 0, policy_version 175360 (0.0004) [2023-03-09 14:11:12,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 89817088. Throughput: 0: 9132.3. Samples: 89801980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:11:12,868][708628] Avg episode reward: [(0, '3804.664')] [2023-03-09 14:11:13,316][709034] Updated weights for policy 0, policy_version 175440 (0.0005) [2023-03-09 14:11:17,763][709034] Updated weights for policy 0, policy_version 175520 (0.0005) [2023-03-09 14:11:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 89866240. Throughput: 0: 9187.2. Samples: 89857848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:11:17,858][708628] Avg episode reward: [(0, '3980.073')] [2023-03-09 14:11:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000175520_89866240.pth... [2023-03-09 14:11:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000174984_89591808.pth [2023-03-09 14:11:22,231][709034] Updated weights for policy 0, policy_version 175600 (0.0005) [2023-03-09 14:11:22,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 89911296. Throughput: 0: 9145.1. Samples: 89911456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:11:22,868][708628] Avg episode reward: [(0, '3662.380')] [2023-03-09 14:11:26,781][709034] Updated weights for policy 0, policy_version 175680 (0.0004) [2023-03-09 14:11:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 89956352. Throughput: 0: 9184.4. Samples: 89939900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:11:27,868][708628] Avg episode reward: [(0, '3633.767')] [2023-03-09 14:11:31,364][709034] Updated weights for policy 0, policy_version 175760 (0.0004) [2023-03-09 14:11:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 90001408. Throughput: 0: 9156.1. Samples: 89993092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:11:32,858][708628] Avg episode reward: [(0, '3863.233')] [2023-03-09 14:11:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000175784_90001408.pth... [2023-03-09 14:11:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000175256_89731072.pth [2023-03-09 14:11:35,878][709034] Updated weights for policy 0, policy_version 175840 (0.0005) [2023-03-09 14:11:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 90046464. Throughput: 0: 9107.2. Samples: 90048088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:11:37,858][708628] Avg episode reward: [(0, '3885.911')] [2023-03-09 14:11:40,358][709034] Updated weights for policy 0, policy_version 175920 (0.0005) [2023-03-09 14:11:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9205.6). Total num frames: 90091520. Throughput: 0: 9102.1. Samples: 90075200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:11:42,858][708628] Avg episode reward: [(0, '3899.214')] [2023-03-09 14:11:44,669][709034] Updated weights for policy 0, policy_version 176000 (0.0005) [2023-03-09 14:11:47,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9147.8, 300 sec: 9219.5). Total num frames: 90140672. Throughput: 0: 9138.2. Samples: 90132464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:11:47,858][708628] Avg episode reward: [(0, '3856.635')] [2023-03-09 14:11:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000176056_90140672.pth... [2023-03-09 14:11:47,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000175520_89866240.pth [2023-03-09 14:11:48,856][709034] Updated weights for policy 0, policy_version 176080 (0.0005) [2023-03-09 14:11:52,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 90189824. Throughput: 0: 9196.8. Samples: 90189888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:11:52,858][708628] Avg episode reward: [(0, '4016.845')] [2023-03-09 14:11:53,240][709034] Updated weights for policy 0, policy_version 176160 (0.0004) [2023-03-09 14:11:57,608][709034] Updated weights for policy 0, policy_version 176240 (0.0004) [2023-03-09 14:11:57,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9219.5). Total num frames: 90234880. Throughput: 0: 9256.4. Samples: 90218520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:11:57,858][708628] Avg episode reward: [(0, '4025.344')] [2023-03-09 14:12:01,632][709034] Updated weights for policy 0, policy_version 176320 (0.0005) [2023-03-09 14:12:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 90284032. Throughput: 0: 9314.2. Samples: 90276988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:12:02,858][708628] Avg episode reward: [(0, '3738.685')] [2023-03-09 14:12:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000176336_90284032.pth... [2023-03-09 14:12:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000175784_90001408.pth [2023-03-09 14:12:06,275][709034] Updated weights for policy 0, policy_version 176400 (0.0004) [2023-03-09 14:12:07,857][708628] Fps is (10 sec: 9421.0, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 90329088. Throughput: 0: 9326.8. Samples: 90331160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:12:07,857][708628] Avg episode reward: [(0, '3766.069')] [2023-03-09 14:12:10,558][709034] Updated weights for policy 0, policy_version 176480 (0.0005) [2023-03-09 14:12:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9247.2). Total num frames: 90378240. Throughput: 0: 9331.0. Samples: 90359796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:12:12,858][708628] Avg episode reward: [(0, '3993.192')] [2023-03-09 14:12:14,744][709034] Updated weights for policy 0, policy_version 176560 (0.0005) [2023-03-09 14:12:17,857][708628] Fps is (10 sec: 9830.2, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 90427392. Throughput: 0: 9429.4. Samples: 90417416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:12:17,858][708628] Avg episode reward: [(0, '3933.571')] [2023-03-09 14:12:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000176616_90427392.pth... [2023-03-09 14:12:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000176056_90140672.pth [2023-03-09 14:12:18,968][709034] Updated weights for policy 0, policy_version 176640 (0.0005) [2023-03-09 14:12:22,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.6, 300 sec: 9261.1). Total num frames: 90472448. Throughput: 0: 9462.9. Samples: 90473916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:12:22,857][708628] Avg episode reward: [(0, '4023.643')] [2023-03-09 14:12:23,567][709034] Updated weights for policy 0, policy_version 176720 (0.0005) [2023-03-09 14:12:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9247.2). Total num frames: 90517504. Throughput: 0: 9484.9. Samples: 90502020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:12:27,858][708628] Avg episode reward: [(0, '3753.287')] [2023-03-09 14:12:27,891][709034] Updated weights for policy 0, policy_version 176800 (0.0005) [2023-03-09 14:12:31,939][709034] Updated weights for policy 0, policy_version 176880 (0.0005) [2023-03-09 14:12:32,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9489.1, 300 sec: 9261.1). Total num frames: 90570752. Throughput: 0: 9509.9. Samples: 90560412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:12:32,858][708628] Avg episode reward: [(0, '3749.450')] [2023-03-09 14:12:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000176896_90570752.pth... [2023-03-09 14:12:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000176336_90284032.pth [2023-03-09 14:12:36,128][709034] Updated weights for policy 0, policy_version 176960 (0.0005) [2023-03-09 14:12:37,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9261.1). Total num frames: 90615808. Throughput: 0: 9498.3. Samples: 90617312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:12:37,858][708628] Avg episode reward: [(0, '3958.563')] [2023-03-09 14:12:40,632][709034] Updated weights for policy 0, policy_version 177040 (0.0004) [2023-03-09 14:12:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9557.3, 300 sec: 9275.0). Total num frames: 90664960. Throughput: 0: 9490.8. Samples: 90645604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:12:42,857][708628] Avg episode reward: [(0, '3865.493')] [2023-03-09 14:12:44,651][709034] Updated weights for policy 0, policy_version 177120 (0.0005) [2023-03-09 14:12:47,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9275.0). Total num frames: 90714112. Throughput: 0: 9505.2. Samples: 90704724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:12:47,858][708628] Avg episode reward: [(0, '3801.056')] [2023-03-09 14:12:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000177176_90714112.pth... [2023-03-09 14:12:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000176616_90427392.pth [2023-03-09 14:12:49,067][709034] Updated weights for policy 0, policy_version 177200 (0.0005) [2023-03-09 14:12:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9275.0). Total num frames: 90759168. Throughput: 0: 9569.1. Samples: 90761772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:12:52,858][708628] Avg episode reward: [(0, '3638.340')] [2023-03-09 14:12:53,393][709034] Updated weights for policy 0, policy_version 177280 (0.0006) [2023-03-09 14:12:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9489.1, 300 sec: 9261.1). Total num frames: 90804224. Throughput: 0: 9562.3. Samples: 90790100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:12:57,858][708628] Avg episode reward: [(0, '3824.012')] [2023-03-09 14:12:57,870][709034] Updated weights for policy 0, policy_version 177360 (0.0004) [2023-03-09 14:13:02,043][709034] Updated weights for policy 0, policy_version 177440 (0.0005) [2023-03-09 14:13:02,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9557.3, 300 sec: 9288.9). Total num frames: 90857472. Throughput: 0: 9535.7. Samples: 90846524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:13:02,858][708628] Avg episode reward: [(0, '3715.550')] [2023-03-09 14:13:02,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000177456_90857472.pth... [2023-03-09 14:13:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000176896_90570752.pth [2023-03-09 14:13:06,279][709034] Updated weights for policy 0, policy_version 177520 (0.0004) [2023-03-09 14:13:07,857][708628] Fps is (10 sec: 10239.9, 60 sec: 9625.6, 300 sec: 9288.9). Total num frames: 90906624. Throughput: 0: 9607.3. Samples: 90906248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:13:07,858][708628] Avg episode reward: [(0, '3697.742')] [2023-03-09 14:13:10,268][709034] Updated weights for policy 0, policy_version 177600 (0.0005) [2023-03-09 14:13:12,857][708628] Fps is (10 sec: 9421.0, 60 sec: 9557.4, 300 sec: 9288.9). Total num frames: 90951680. Throughput: 0: 9630.2. Samples: 90935380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:13:12,857][708628] Avg episode reward: [(0, '3790.492')] [2023-03-09 14:13:14,671][709034] Updated weights for policy 0, policy_version 177680 (0.0005) [2023-03-09 14:13:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9302.8). Total num frames: 91000832. Throughput: 0: 9583.5. Samples: 90991668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:13:17,858][708628] Avg episode reward: [(0, '3836.917')] [2023-03-09 14:13:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000177736_91000832.pth... [2023-03-09 14:13:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000177176_90714112.pth [2023-03-09 14:13:18,922][709034] Updated weights for policy 0, policy_version 177760 (0.0005) [2023-03-09 14:13:22,857][708628] Fps is (10 sec: 9830.2, 60 sec: 9625.6, 300 sec: 9302.8). Total num frames: 91049984. Throughput: 0: 9615.1. Samples: 91049992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:13:22,858][708628] Avg episode reward: [(0, '3858.725')] [2023-03-09 14:13:23,177][709034] Updated weights for policy 0, policy_version 177840 (0.0006) [2023-03-09 14:13:27,442][709034] Updated weights for policy 0, policy_version 177920 (0.0005) [2023-03-09 14:13:27,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9625.6, 300 sec: 9302.8). Total num frames: 91095040. Throughput: 0: 9651.2. Samples: 91079908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:13:27,858][708628] Avg episode reward: [(0, '3968.690')] [2023-03-09 14:13:31,619][709034] Updated weights for policy 0, policy_version 178000 (0.0005) [2023-03-09 14:13:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9316.7). Total num frames: 91144192. Throughput: 0: 9616.4. Samples: 91137460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:13:32,858][708628] Avg episode reward: [(0, '4191.424')] [2023-03-09 14:13:32,895][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000178024_91148288.pth... [2023-03-09 14:13:32,897][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000177456_90857472.pth [2023-03-09 14:13:35,828][709034] Updated weights for policy 0, policy_version 178080 (0.0005) [2023-03-09 14:13:37,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9330.5). Total num frames: 91193344. Throughput: 0: 9610.7. Samples: 91194256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:13:37,858][708628] Avg episode reward: [(0, '4085.371')] [2023-03-09 14:13:40,226][709034] Updated weights for policy 0, policy_version 178160 (0.0006) [2023-03-09 14:13:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9557.3, 300 sec: 9330.6). Total num frames: 91238400. Throughput: 0: 9599.7. Samples: 91222088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:13:42,858][708628] Avg episode reward: [(0, '3853.273')] [2023-03-09 14:13:44,990][709034] Updated weights for policy 0, policy_version 178240 (0.0005) [2023-03-09 14:13:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9330.6). Total num frames: 91283456. Throughput: 0: 9525.3. Samples: 91275160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:13:47,858][708628] Avg episode reward: [(0, '4066.864')] [2023-03-09 14:13:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000178288_91283456.pth... [2023-03-09 14:13:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000177736_91000832.pth [2023-03-09 14:13:49,555][709034] Updated weights for policy 0, policy_version 178320 (0.0005) [2023-03-09 14:13:52,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9489.0, 300 sec: 9330.5). Total num frames: 91328512. Throughput: 0: 9382.9. Samples: 91328480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:13:52,858][708628] Avg episode reward: [(0, '3806.423')] [2023-03-09 14:13:54,116][709034] Updated weights for policy 0, policy_version 178400 (0.0006) [2023-03-09 14:13:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9489.1, 300 sec: 9316.7). Total num frames: 91373568. Throughput: 0: 9370.2. Samples: 91357040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:13:57,858][708628] Avg episode reward: [(0, '3879.388')] [2023-03-09 14:13:58,386][709034] Updated weights for policy 0, policy_version 178480 (0.0005) [2023-03-09 14:14:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 91418624. Throughput: 0: 9346.6. Samples: 91412264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:14:02,858][708628] Avg episode reward: [(0, '3860.673')] [2023-03-09 14:14:02,898][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000178560_91422720.pth... [2023-03-09 14:14:02,899][709034] Updated weights for policy 0, policy_version 178560 (0.0005) [2023-03-09 14:14:02,901][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000178024_91148288.pth [2023-03-09 14:14:07,399][709034] Updated weights for policy 0, policy_version 178640 (0.0005) [2023-03-09 14:14:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 91467776. Throughput: 0: 9277.2. Samples: 91467464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:14:07,858][708628] Avg episode reward: [(0, '3962.526')] [2023-03-09 14:14:11,773][709034] Updated weights for policy 0, policy_version 178720 (0.0005) [2023-03-09 14:14:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9316.7). Total num frames: 91512832. Throughput: 0: 9251.3. Samples: 91496216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:14:12,858][708628] Avg episode reward: [(0, '3947.144')] [2023-03-09 14:14:16,293][709034] Updated weights for policy 0, policy_version 178800 (0.0005) [2023-03-09 14:14:17,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 91557888. Throughput: 0: 9174.8. Samples: 91550324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:14:17,858][708628] Avg episode reward: [(0, '4043.102')] [2023-03-09 14:14:17,859][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000178824_91557888.pth... [2023-03-09 14:14:17,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000178288_91283456.pth [2023-03-09 14:14:20,933][709034] Updated weights for policy 0, policy_version 178880 (0.0004) [2023-03-09 14:14:22,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 91602944. Throughput: 0: 9098.0. Samples: 91603668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:14:22,858][708628] Avg episode reward: [(0, '3964.135')] [2023-03-09 14:14:25,329][709034] Updated weights for policy 0, policy_version 178960 (0.0005) [2023-03-09 14:14:27,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 91652096. Throughput: 0: 9117.4. Samples: 91632372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:14:27,858][708628] Avg episode reward: [(0, '3800.489')] [2023-03-09 14:14:29,413][709034] Updated weights for policy 0, policy_version 179040 (0.0005) [2023-03-09 14:14:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 91697152. Throughput: 0: 9195.4. Samples: 91688956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:14:32,858][708628] Avg episode reward: [(0, '3909.519')] [2023-03-09 14:14:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000179096_91697152.pth... [2023-03-09 14:14:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000178560_91422720.pth [2023-03-09 14:14:34,126][709034] Updated weights for policy 0, policy_version 179120 (0.0005) [2023-03-09 14:14:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9330.5). Total num frames: 91742208. Throughput: 0: 9234.9. Samples: 91744052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:14:37,858][708628] Avg episode reward: [(0, '3987.842')] [2023-03-09 14:14:38,483][709034] Updated weights for policy 0, policy_version 179200 (0.0005) [2023-03-09 14:14:42,811][709034] Updated weights for policy 0, policy_version 179280 (0.0005) [2023-03-09 14:14:42,857][708628] Fps is (10 sec: 9421.0, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 91791360. Throughput: 0: 9205.7. Samples: 91771296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:14:42,858][708628] Avg episode reward: [(0, '4120.921')] [2023-03-09 14:14:47,303][709034] Updated weights for policy 0, policy_version 179360 (0.0005) [2023-03-09 14:14:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 91836416. Throughput: 0: 9231.7. Samples: 91827692. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 14:14:47,858][708628] Avg episode reward: [(0, '4059.348')] [2023-03-09 14:14:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000179368_91836416.pth... [2023-03-09 14:14:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000178824_91557888.pth [2023-03-09 14:14:51,762][709034] Updated weights for policy 0, policy_version 179440 (0.0005) [2023-03-09 14:14:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 91881472. Throughput: 0: 9206.7. Samples: 91881764. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 14:14:52,857][708628] Avg episode reward: [(0, '4169.530')] [2023-03-09 14:14:56,354][709034] Updated weights for policy 0, policy_version 179520 (0.0005) [2023-03-09 14:14:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 91926528. Throughput: 0: 9197.3. Samples: 91910092. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 14:14:57,858][708628] Avg episode reward: [(0, '4070.032')] [2023-03-09 14:15:00,717][709034] Updated weights for policy 0, policy_version 179600 (0.0005) [2023-03-09 14:15:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 91971584. Throughput: 0: 9205.3. Samples: 91964564. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 14:15:02,858][708628] Avg episode reward: [(0, '4192.301')] [2023-03-09 14:15:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000179632_91971584.pth... [2023-03-09 14:15:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000179096_91697152.pth [2023-03-09 14:15:05,222][709034] Updated weights for policy 0, policy_version 179680 (0.0005) [2023-03-09 14:15:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 92020736. Throughput: 0: 9264.1. Samples: 92020552. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 14:15:07,858][708628] Avg episode reward: [(0, '3977.804')] [2023-03-09 14:15:09,412][709034] Updated weights for policy 0, policy_version 179760 (0.0005) [2023-03-09 14:15:12,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 92069888. Throughput: 0: 9302.7. Samples: 92050992. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 14:15:12,858][708628] Avg episode reward: [(0, '4145.927')] [2023-03-09 14:15:13,660][709034] Updated weights for policy 0, policy_version 179840 (0.0005) [2023-03-09 14:15:17,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 92114944. Throughput: 0: 9305.2. Samples: 92107688. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 14:15:17,858][708628] Avg episode reward: [(0, '4137.174')] [2023-03-09 14:15:17,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000179912_92114944.pth... [2023-03-09 14:15:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000179368_91836416.pth [2023-03-09 14:15:17,965][709034] Updated weights for policy 0, policy_version 179920 (0.0005) [2023-03-09 14:15:22,184][709034] Updated weights for policy 0, policy_version 180000 (0.0005) [2023-03-09 14:15:22,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 92164096. Throughput: 0: 9365.3. Samples: 92165492. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 14:15:22,858][708628] Avg episode reward: [(0, '4104.818')] [2023-03-09 14:15:26,635][709034] Updated weights for policy 0, policy_version 180080 (0.0005) [2023-03-09 14:15:27,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 92209152. Throughput: 0: 9365.4. Samples: 92192740. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 14:15:27,858][708628] Avg episode reward: [(0, '4180.051')] [2023-03-09 14:15:31,048][709034] Updated weights for policy 0, policy_version 180160 (0.0005) [2023-03-09 14:15:32,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 92258304. Throughput: 0: 9356.6. Samples: 92248740. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 14:15:32,858][708628] Avg episode reward: [(0, '4127.898')] [2023-03-09 14:15:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000180192_92258304.pth... [2023-03-09 14:15:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000179632_91971584.pth [2023-03-09 14:15:35,414][709034] Updated weights for policy 0, policy_version 180240 (0.0005) [2023-03-09 14:15:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 92303360. Throughput: 0: 9411.8. Samples: 92305296. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 14:15:37,858][708628] Avg episode reward: [(0, '3967.772')] [2023-03-09 14:15:39,787][709034] Updated weights for policy 0, policy_version 180320 (0.0005) [2023-03-09 14:15:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 92352512. Throughput: 0: 9424.7. Samples: 92334204. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 14:15:42,858][708628] Avg episode reward: [(0, '4141.159')] [2023-03-09 14:15:43,918][709034] Updated weights for policy 0, policy_version 180400 (0.0005) [2023-03-09 14:15:47,857][708628] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 92401664. Throughput: 0: 9498.1. Samples: 92391980. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-09 14:15:47,858][708628] Avg episode reward: [(0, '4089.613')] [2023-03-09 14:15:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000180472_92401664.pth... [2023-03-09 14:15:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000179912_92114944.pth [2023-03-09 14:15:48,293][709034] Updated weights for policy 0, policy_version 180480 (0.0005) [2023-03-09 14:15:52,696][709034] Updated weights for policy 0, policy_version 180560 (0.0006) [2023-03-09 14:15:52,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 92446720. Throughput: 0: 9475.0. Samples: 92446928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:15:52,858][708628] Avg episode reward: [(0, '4233.353')] [2023-03-09 14:15:52,858][708990] Saving new best policy, reward=4233.353! [2023-03-09 14:15:57,151][709034] Updated weights for policy 0, policy_version 180640 (0.0005) [2023-03-09 14:15:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 92491776. Throughput: 0: 9438.0. Samples: 92475700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:15:57,858][708628] Avg episode reward: [(0, '4045.186')] [2023-03-09 14:16:01,502][709034] Updated weights for policy 0, policy_version 180720 (0.0004) [2023-03-09 14:16:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9372.2). Total num frames: 92540928. Throughput: 0: 9422.1. Samples: 92531684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:16:02,858][708628] Avg episode reward: [(0, '4133.407')] [2023-03-09 14:16:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000180744_92540928.pth... [2023-03-09 14:16:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000180192_92258304.pth [2023-03-09 14:16:05,914][709034] Updated weights for policy 0, policy_version 180800 (0.0006) [2023-03-09 14:16:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 92585984. Throughput: 0: 9345.9. Samples: 92586056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:16:07,858][708628] Avg episode reward: [(0, '4177.368')] [2023-03-09 14:16:10,264][709034] Updated weights for policy 0, policy_version 180880 (0.0005) [2023-03-09 14:16:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9372.2). Total num frames: 92631040. Throughput: 0: 9376.1. Samples: 92614664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:16:12,858][708628] Avg episode reward: [(0, '4182.533')] [2023-03-09 14:16:14,871][709034] Updated weights for policy 0, policy_version 180960 (0.0005) [2023-03-09 14:16:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 92680192. Throughput: 0: 9405.1. Samples: 92671972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:16:17,858][708628] Avg episode reward: [(0, '4246.336')] [2023-03-09 14:16:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000181016_92680192.pth... [2023-03-09 14:16:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000180472_92401664.pth [2023-03-09 14:16:17,864][708990] Saving new best policy, reward=4246.336! [2023-03-09 14:16:18,690][709034] Updated weights for policy 0, policy_version 181040 (0.0005) [2023-03-09 14:16:22,812][709034] Updated weights for policy 0, policy_version 181120 (0.0005) [2023-03-09 14:16:22,857][708628] Fps is (10 sec: 10239.9, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 92733440. Throughput: 0: 9512.5. Samples: 92733360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:16:22,858][708628] Avg episode reward: [(0, '4147.488')] [2023-03-09 14:16:27,132][709034] Updated weights for policy 0, policy_version 181200 (0.0005) [2023-03-09 14:16:27,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9413.9). Total num frames: 92778496. Throughput: 0: 9508.8. Samples: 92762100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:16:27,858][708628] Avg episode reward: [(0, '4225.647')] [2023-03-09 14:16:31,560][709034] Updated weights for policy 0, policy_version 181280 (0.0004) [2023-03-09 14:16:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 92827648. Throughput: 0: 9453.0. Samples: 92817368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:16:32,858][708628] Avg episode reward: [(0, '4186.972')] [2023-03-09 14:16:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000181304_92827648.pth... [2023-03-09 14:16:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000180744_92540928.pth [2023-03-09 14:16:35,661][709034] Updated weights for policy 0, policy_version 181360 (0.0005) [2023-03-09 14:16:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 92872704. Throughput: 0: 9527.1. Samples: 92875648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:16:37,858][708628] Avg episode reward: [(0, '4228.253')] [2023-03-09 14:16:39,899][709034] Updated weights for policy 0, policy_version 181440 (0.0005) [2023-03-09 14:16:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 92921856. Throughput: 0: 9550.0. Samples: 92905448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:16:42,858][708628] Avg episode reward: [(0, '4182.724')] [2023-03-09 14:16:44,370][709034] Updated weights for policy 0, policy_version 181520 (0.0004) [2023-03-09 14:16:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9413.9). Total num frames: 92966912. Throughput: 0: 9522.3. Samples: 92960188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:16:47,858][708628] Avg episode reward: [(0, '4171.565')] [2023-03-09 14:16:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000181576_92966912.pth... [2023-03-09 14:16:47,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000181016_92680192.pth [2023-03-09 14:16:48,902][709034] Updated weights for policy 0, policy_version 181600 (0.0005) [2023-03-09 14:16:52,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9427.7). Total num frames: 93016064. Throughput: 0: 9555.7. Samples: 93016064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:16:52,858][708628] Avg episode reward: [(0, '4149.366')] [2023-03-09 14:16:53,241][709034] Updated weights for policy 0, policy_version 181680 (0.0005) [2023-03-09 14:16:57,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 93057024. Throughput: 0: 9491.5. Samples: 93041780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:16:57,860][709034] Updated weights for policy 0, policy_version 181760 (0.0005) [2023-03-09 14:16:57,868][708628] Avg episode reward: [(0, '4019.352')] [2023-03-09 14:17:02,385][709034] Updated weights for policy 0, policy_version 181840 (0.0005) [2023-03-09 14:17:02,857][708628] Fps is (10 sec: 9011.0, 60 sec: 9420.8, 300 sec: 9413.8). Total num frames: 93106176. Throughput: 0: 9430.7. Samples: 93096356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:17:02,869][708628] Avg episode reward: [(0, '4129.817')] [2023-03-09 14:17:02,874][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000181848_93106176.pth... [2023-03-09 14:17:02,876][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000181304_92827648.pth [2023-03-09 14:17:06,686][709034] Updated weights for policy 0, policy_version 181920 (0.0005) [2023-03-09 14:17:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 93151232. Throughput: 0: 9316.0. Samples: 93152580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:17:07,868][708628] Avg episode reward: [(0, '4185.299')] [2023-03-09 14:17:11,121][709034] Updated weights for policy 0, policy_version 182000 (0.0005) [2023-03-09 14:17:12,857][708628] Fps is (10 sec: 9421.0, 60 sec: 9489.1, 300 sec: 9400.0). Total num frames: 93200384. Throughput: 0: 9300.5. Samples: 93180624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:17:12,868][708628] Avg episode reward: [(0, '4180.375')] [2023-03-09 14:17:15,605][709034] Updated weights for policy 0, policy_version 182080 (0.0005) [2023-03-09 14:17:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9400.0). Total num frames: 93245440. Throughput: 0: 9305.8. Samples: 93236128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:17:17,858][708628] Avg episode reward: [(0, '4130.507')] [2023-03-09 14:17:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000182120_93245440.pth... [2023-03-09 14:17:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000181576_92966912.pth [2023-03-09 14:17:20,045][709034] Updated weights for policy 0, policy_version 182160 (0.0005) [2023-03-09 14:17:22,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9400.0). Total num frames: 93290496. Throughput: 0: 9218.5. Samples: 93290480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:17:22,857][708628] Avg episode reward: [(0, '4223.450')] [2023-03-09 14:17:24,543][709034] Updated weights for policy 0, policy_version 182240 (0.0005) [2023-03-09 14:17:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 93335552. Throughput: 0: 9169.8. Samples: 93318088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:17:27,858][708628] Avg episode reward: [(0, '4068.557')] [2023-03-09 14:17:29,114][709034] Updated weights for policy 0, policy_version 182320 (0.0005) [2023-03-09 14:17:32,857][708628] Fps is (10 sec: 9011.0, 60 sec: 9216.0, 300 sec: 9372.2). Total num frames: 93380608. Throughput: 0: 9160.8. Samples: 93372424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:17:32,858][708628] Avg episode reward: [(0, '3960.042')] [2023-03-09 14:17:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000182384_93380608.pth... [2023-03-09 14:17:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000181848_93106176.pth [2023-03-09 14:17:33,583][709034] Updated weights for policy 0, policy_version 182400 (0.0005) [2023-03-09 14:17:37,571][709034] Updated weights for policy 0, policy_version 182480 (0.0005) [2023-03-09 14:17:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 93429760. Throughput: 0: 9237.2. Samples: 93431736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:17:37,858][708628] Avg episode reward: [(0, '4012.155')] [2023-03-09 14:17:42,033][709034] Updated weights for policy 0, policy_version 182560 (0.0005) [2023-03-09 14:17:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 93474816. Throughput: 0: 9271.5. Samples: 93458996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:17:42,868][708628] Avg episode reward: [(0, '4156.097')] [2023-03-09 14:17:46,450][709034] Updated weights for policy 0, policy_version 182640 (0.0005) [2023-03-09 14:17:47,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9358.3). Total num frames: 93519872. Throughput: 0: 9310.8. Samples: 93515340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:17:47,857][708628] Avg episode reward: [(0, '4020.925')] [2023-03-09 14:17:47,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000182656_93519872.pth... [2023-03-09 14:17:47,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000182120_93245440.pth [2023-03-09 14:17:50,850][709034] Updated weights for policy 0, policy_version 182720 (0.0005) [2023-03-09 14:17:52,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9372.2). Total num frames: 93569024. Throughput: 0: 9292.6. Samples: 93570748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:17:52,858][708628] Avg episode reward: [(0, '4157.014')] [2023-03-09 14:17:55,201][709034] Updated weights for policy 0, policy_version 182800 (0.0004) [2023-03-09 14:17:57,857][708628] Fps is (10 sec: 9830.2, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 93618176. Throughput: 0: 9311.0. Samples: 93599620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:17:57,858][708628] Avg episode reward: [(0, '4265.718')] [2023-03-09 14:17:57,858][708990] Saving new best policy, reward=4265.718! [2023-03-09 14:17:59,640][709034] Updated weights for policy 0, policy_version 182880 (0.0004) [2023-03-09 14:18:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 93663232. Throughput: 0: 9309.2. Samples: 93655040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:18:02,858][708628] Avg episode reward: [(0, '3962.109')] [2023-03-09 14:18:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000182936_93663232.pth... [2023-03-09 14:18:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000182384_93380608.pth [2023-03-09 14:18:03,944][709034] Updated weights for policy 0, policy_version 182960 (0.0005) [2023-03-09 14:18:07,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 93708288. Throughput: 0: 9353.6. Samples: 93711392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:18:07,858][708628] Avg episode reward: [(0, '4132.359')] [2023-03-09 14:18:08,377][709034] Updated weights for policy 0, policy_version 183040 (0.0005) [2023-03-09 14:18:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 93753344. Throughput: 0: 9349.8. Samples: 93738828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:18:12,858][708628] Avg episode reward: [(0, '4103.894')] [2023-03-09 14:18:12,945][709034] Updated weights for policy 0, policy_version 183120 (0.0005) [2023-03-09 14:18:17,239][709034] Updated weights for policy 0, policy_version 183200 (0.0004) [2023-03-09 14:18:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 93802496. Throughput: 0: 9357.5. Samples: 93793512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:18:17,858][708628] Avg episode reward: [(0, '4246.957')] [2023-03-09 14:18:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000183208_93802496.pth... [2023-03-09 14:18:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000182656_93519872.pth [2023-03-09 14:18:22,009][709034] Updated weights for policy 0, policy_version 183280 (0.0004) [2023-03-09 14:18:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 93843456. Throughput: 0: 9230.1. Samples: 93847088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:18:22,858][708628] Avg episode reward: [(0, '4254.384')] [2023-03-09 14:18:26,138][709034] Updated weights for policy 0, policy_version 183360 (0.0005) [2023-03-09 14:18:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 93892608. Throughput: 0: 9271.9. Samples: 93876232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:18:27,858][708628] Avg episode reward: [(0, '4161.681')] [2023-03-09 14:18:30,801][709034] Updated weights for policy 0, policy_version 183440 (0.0005) [2023-03-09 14:18:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9302.8). Total num frames: 93937664. Throughput: 0: 9217.2. Samples: 93930116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:18:32,858][708628] Avg episode reward: [(0, '4056.653')] [2023-03-09 14:18:32,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000183472_93937664.pth... [2023-03-09 14:18:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000182936_93663232.pth [2023-03-09 14:18:35,175][709034] Updated weights for policy 0, policy_version 183520 (0.0005) [2023-03-09 14:18:37,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 93986816. Throughput: 0: 9246.3. Samples: 93986832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:18:37,858][708628] Avg episode reward: [(0, '4186.620')] [2023-03-09 14:18:39,549][709034] Updated weights for policy 0, policy_version 183600 (0.0005) [2023-03-09 14:18:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 94031872. Throughput: 0: 9237.5. Samples: 94015304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:18:42,858][708628] Avg episode reward: [(0, '4076.811')] [2023-03-09 14:18:43,863][709034] Updated weights for policy 0, policy_version 183680 (0.0005) [2023-03-09 14:18:47,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 94076928. Throughput: 0: 9239.4. Samples: 94070812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:18:47,858][708628] Avg episode reward: [(0, '4205.450')] [2023-03-09 14:18:47,894][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000183752_94081024.pth... [2023-03-09 14:18:47,896][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000183208_93802496.pth [2023-03-09 14:18:48,287][709034] Updated weights for policy 0, policy_version 183760 (0.0004) [2023-03-09 14:18:52,584][709034] Updated weights for policy 0, policy_version 183840 (0.0005) [2023-03-09 14:18:52,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 94126080. Throughput: 0: 9249.4. Samples: 94127616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:18:52,858][708628] Avg episode reward: [(0, '4062.258')] [2023-03-09 14:18:57,204][709034] Updated weights for policy 0, policy_version 183920 (0.0005) [2023-03-09 14:18:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 94171136. Throughput: 0: 9241.6. Samples: 94154700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:18:57,858][708628] Avg episode reward: [(0, '4011.007')] [2023-03-09 14:19:01,607][709034] Updated weights for policy 0, policy_version 184000 (0.0005) [2023-03-09 14:19:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 94220288. Throughput: 0: 9242.0. Samples: 94209404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:19:02,858][708628] Avg episode reward: [(0, '3896.477')] [2023-03-09 14:19:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000184024_94220288.pth... [2023-03-09 14:19:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000183472_93937664.pth [2023-03-09 14:19:06,039][709034] Updated weights for policy 0, policy_version 184080 (0.0006) [2023-03-09 14:19:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 94261248. Throughput: 0: 9280.3. Samples: 94264700. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:19:07,858][708628] Avg episode reward: [(0, '3946.595')] [2023-03-09 14:19:10,476][709034] Updated weights for policy 0, policy_version 184160 (0.0005) [2023-03-09 14:19:12,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.2, 300 sec: 9330.5). Total num frames: 94310400. Throughput: 0: 9269.7. Samples: 94293368. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:19:12,858][708628] Avg episode reward: [(0, '4036.124')] [2023-03-09 14:19:14,787][709034] Updated weights for policy 0, policy_version 184240 (0.0005) [2023-03-09 14:19:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 94355456. Throughput: 0: 9331.0. Samples: 94350012. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:19:17,858][708628] Avg episode reward: [(0, '4156.431')] [2023-03-09 14:19:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000184296_94359552.pth... [2023-03-09 14:19:17,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000183752_94081024.pth [2023-03-09 14:19:19,126][709034] Updated weights for policy 0, policy_version 184320 (0.0005) [2023-03-09 14:19:22,857][708628] Fps is (10 sec: 9830.5, 60 sec: 9420.8, 300 sec: 9344.4). Total num frames: 94408704. Throughput: 0: 9347.7. Samples: 94407480. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:19:22,868][708628] Avg episode reward: [(0, '3994.988')] [2023-03-09 14:19:23,240][709034] Updated weights for policy 0, policy_version 184400 (0.0005) [2023-03-09 14:19:27,335][709034] Updated weights for policy 0, policy_version 184480 (0.0005) [2023-03-09 14:19:27,857][708628] Fps is (10 sec: 10240.1, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 94457856. Throughput: 0: 9420.4. Samples: 94439224. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:19:27,858][708628] Avg episode reward: [(0, '3990.536')] [2023-03-09 14:19:31,334][709034] Updated weights for policy 0, policy_version 184560 (0.0005) [2023-03-09 14:19:32,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9489.0, 300 sec: 9372.2). Total num frames: 94507008. Throughput: 0: 9511.2. Samples: 94498816. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:19:32,858][708628] Avg episode reward: [(0, '4270.927')] [2023-03-09 14:19:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000184584_94507008.pth... [2023-03-09 14:19:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000184024_94220288.pth [2023-03-09 14:19:32,864][708990] Saving new best policy, reward=4270.927! [2023-03-09 14:19:36,065][709034] Updated weights for policy 0, policy_version 184640 (0.0005) [2023-03-09 14:19:37,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 94552064. Throughput: 0: 9432.2. Samples: 94552064. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:19:37,858][708628] Avg episode reward: [(0, '4208.807')] [2023-03-09 14:19:40,465][709034] Updated weights for policy 0, policy_version 184720 (0.0005) [2023-03-09 14:19:42,857][708628] Fps is (10 sec: 9011.4, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 94597120. Throughput: 0: 9452.6. Samples: 94580068. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:19:42,868][708628] Avg episode reward: [(0, '4165.006')] [2023-03-09 14:19:44,576][709034] Updated weights for policy 0, policy_version 184800 (0.0005) [2023-03-09 14:19:47,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9489.0, 300 sec: 9372.2). Total num frames: 94646272. Throughput: 0: 9529.7. Samples: 94638240. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:19:47,858][708628] Avg episode reward: [(0, '4199.756')] [2023-03-09 14:19:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000184856_94646272.pth... [2023-03-09 14:19:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000184296_94359552.pth [2023-03-09 14:19:48,958][709034] Updated weights for policy 0, policy_version 184880 (0.0004) [2023-03-09 14:19:52,857][708628] Fps is (10 sec: 9830.2, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 94695424. Throughput: 0: 9570.6. Samples: 94695380. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:19:52,858][708628] Avg episode reward: [(0, '4245.912')] [2023-03-09 14:19:53,333][709034] Updated weights for policy 0, policy_version 184960 (0.0005) [2023-03-09 14:19:57,718][709034] Updated weights for policy 0, policy_version 185040 (0.0005) [2023-03-09 14:19:57,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 94740480. Throughput: 0: 9531.0. Samples: 94722264. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:19:57,858][708628] Avg episode reward: [(0, '4214.730')] [2023-03-09 14:20:01,872][709034] Updated weights for policy 0, policy_version 185120 (0.0005) [2023-03-09 14:20:02,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 94789632. Throughput: 0: 9564.8. Samples: 94780428. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:20:02,858][708628] Avg episode reward: [(0, '4287.058')] [2023-03-09 14:20:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000185136_94789632.pth... [2023-03-09 14:20:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000184584_94507008.pth [2023-03-09 14:20:02,864][708990] Saving new best policy, reward=4287.058! [2023-03-09 14:20:06,156][709034] Updated weights for policy 0, policy_version 185200 (0.0005) [2023-03-09 14:20:07,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9625.6, 300 sec: 9386.1). Total num frames: 94838784. Throughput: 0: 9580.3. Samples: 94838592. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:20:07,858][708628] Avg episode reward: [(0, '4198.636')] [2023-03-09 14:20:10,213][709034] Updated weights for policy 0, policy_version 185280 (0.0005) [2023-03-09 14:20:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9557.4, 300 sec: 9386.1). Total num frames: 94883840. Throughput: 0: 9521.4. Samples: 94867688. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-09 14:20:12,858][708628] Avg episode reward: [(0, '4247.676')] [2023-03-09 14:20:14,750][709034] Updated weights for policy 0, policy_version 185360 (0.0005) [2023-03-09 14:20:17,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9557.3, 300 sec: 9372.2). Total num frames: 94928896. Throughput: 0: 9406.5. Samples: 94922108. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:20:17,858][708628] Avg episode reward: [(0, '4258.462')] [2023-03-09 14:20:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000185408_94928896.pth... [2023-03-09 14:20:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000184856_94646272.pth [2023-03-09 14:20:19,127][709034] Updated weights for policy 0, policy_version 185440 (0.0005) [2023-03-09 14:20:22,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 94978048. Throughput: 0: 9532.6. Samples: 94981032. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:20:22,868][708628] Avg episode reward: [(0, '4248.017')] [2023-03-09 14:20:23,420][709034] Updated weights for policy 0, policy_version 185520 (0.0005) [2023-03-09 14:20:27,708][709034] Updated weights for policy 0, policy_version 185600 (0.0005) [2023-03-09 14:20:27,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9489.1, 300 sec: 9386.1). Total num frames: 95027200. Throughput: 0: 9551.9. Samples: 95009904. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:20:27,868][708628] Avg episode reward: [(0, '4280.237')] [2023-03-09 14:20:32,310][709034] Updated weights for policy 0, policy_version 185680 (0.0005) [2023-03-09 14:20:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9386.1). Total num frames: 95072256. Throughput: 0: 9461.6. Samples: 95064012. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:20:32,868][708628] Avg episode reward: [(0, '4244.192')] [2023-03-09 14:20:32,871][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000185688_95072256.pth... [2023-03-09 14:20:32,874][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000185136_94789632.pth [2023-03-09 14:20:36,649][709034] Updated weights for policy 0, policy_version 185760 (0.0006) [2023-03-09 14:20:37,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9372.2). Total num frames: 95117312. Throughput: 0: 9427.7. Samples: 95119624. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:20:37,868][708628] Avg episode reward: [(0, '4249.368')] [2023-03-09 14:20:41,177][709034] Updated weights for policy 0, policy_version 185840 (0.0005) [2023-03-09 14:20:42,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 95162368. Throughput: 0: 9422.9. Samples: 95146296. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:20:42,868][708628] Avg episode reward: [(0, '4216.665')] [2023-03-09 14:20:45,731][709034] Updated weights for policy 0, policy_version 185920 (0.0005) [2023-03-09 14:20:47,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 95207424. Throughput: 0: 9325.9. Samples: 95200092. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:20:47,858][708628] Avg episode reward: [(0, '4286.649')] [2023-03-09 14:20:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000185952_95207424.pth... [2023-03-09 14:20:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000185408_94928896.pth [2023-03-09 14:20:50,195][709034] Updated weights for policy 0, policy_version 186000 (0.0005) [2023-03-09 14:20:52,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.6, 300 sec: 9372.2). Total num frames: 95256576. Throughput: 0: 9274.0. Samples: 95255924. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:20:52,858][708628] Avg episode reward: [(0, '4178.549')] [2023-03-09 14:20:54,549][709034] Updated weights for policy 0, policy_version 186080 (0.0005) [2023-03-09 14:20:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 95301632. Throughput: 0: 9249.4. Samples: 95283912. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:20:57,868][708628] Avg episode reward: [(0, '4169.118')] [2023-03-09 14:20:59,063][709034] Updated weights for policy 0, policy_version 186160 (0.0005) [2023-03-09 14:21:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 95346688. Throughput: 0: 9260.2. Samples: 95338816. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:21:02,858][708628] Avg episode reward: [(0, '4042.248')] [2023-03-09 14:21:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000186224_95346688.pth... [2023-03-09 14:21:02,861][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000185688_95072256.pth [2023-03-09 14:21:03,430][709034] Updated weights for policy 0, policy_version 186240 (0.0005) [2023-03-09 14:21:07,824][709034] Updated weights for policy 0, policy_version 186320 (0.0005) [2023-03-09 14:21:07,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9372.2). Total num frames: 95395840. Throughput: 0: 9217.9. Samples: 95395836. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:21:07,858][708628] Avg episode reward: [(0, '4129.721')] [2023-03-09 14:21:12,268][709034] Updated weights for policy 0, policy_version 186400 (0.0004) [2023-03-09 14:21:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9358.3). Total num frames: 95440896. Throughput: 0: 9194.0. Samples: 95423632. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:21:12,858][708628] Avg episode reward: [(0, '4129.742')] [2023-03-09 14:21:16,387][709034] Updated weights for policy 0, policy_version 186480 (0.0005) [2023-03-09 14:21:17,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 95485952. Throughput: 0: 9282.7. Samples: 95481732. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:21:17,858][708628] Avg episode reward: [(0, '4279.005')] [2023-03-09 14:21:17,866][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000186504_95490048.pth... [2023-03-09 14:21:17,868][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000185952_95207424.pth [2023-03-09 14:21:20,973][709034] Updated weights for policy 0, policy_version 186560 (0.0005) [2023-03-09 14:21:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 95535104. Throughput: 0: 9234.3. Samples: 95535168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:21:22,858][708628] Avg episode reward: [(0, '4218.359')] [2023-03-09 14:21:25,466][709034] Updated weights for policy 0, policy_version 186640 (0.0006) [2023-03-09 14:21:27,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 95580160. Throughput: 0: 9263.2. Samples: 95563140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:21:27,858][708628] Avg episode reward: [(0, '4204.401')] [2023-03-09 14:21:29,949][709034] Updated weights for policy 0, policy_version 186720 (0.0005) [2023-03-09 14:21:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 95625216. Throughput: 0: 9265.3. Samples: 95617032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:21:32,858][708628] Avg episode reward: [(0, '4234.851')] [2023-03-09 14:21:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000186768_95625216.pth... [2023-03-09 14:21:32,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000186224_95346688.pth [2023-03-09 14:21:34,461][709034] Updated weights for policy 0, policy_version 186800 (0.0005) [2023-03-09 14:21:37,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 95670272. Throughput: 0: 9254.9. Samples: 95672392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:21:37,858][708628] Avg episode reward: [(0, '4295.607')] [2023-03-09 14:21:37,858][708990] Saving new best policy, reward=4295.607! [2023-03-09 14:21:38,783][709034] Updated weights for policy 0, policy_version 186880 (0.0005) [2023-03-09 14:21:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 95719424. Throughput: 0: 9239.4. Samples: 95699684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:21:42,858][708628] Avg episode reward: [(0, '4280.810')] [2023-03-09 14:21:43,170][709034] Updated weights for policy 0, policy_version 186960 (0.0005) [2023-03-09 14:21:47,238][709034] Updated weights for policy 0, policy_version 187040 (0.0005) [2023-03-09 14:21:47,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9330.5). Total num frames: 95768576. Throughput: 0: 9368.4. Samples: 95760396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:21:47,858][708628] Avg episode reward: [(0, '4283.235')] [2023-03-09 14:21:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000187048_95768576.pth... [2023-03-09 14:21:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000186504_95490048.pth [2023-03-09 14:21:51,771][709034] Updated weights for policy 0, policy_version 187120 (0.0005) [2023-03-09 14:21:52,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 95813632. Throughput: 0: 9287.5. Samples: 95813776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:21:52,858][708628] Avg episode reward: [(0, '4242.954')] [2023-03-09 14:21:56,276][709034] Updated weights for policy 0, policy_version 187200 (0.0005) [2023-03-09 14:21:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 95858688. Throughput: 0: 9301.6. Samples: 95842204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:21:57,858][708628] Avg episode reward: [(0, '4204.294')] [2023-03-09 14:22:00,500][709034] Updated weights for policy 0, policy_version 187280 (0.0005) [2023-03-09 14:22:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 95907840. Throughput: 0: 9282.0. Samples: 95899424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:22:02,858][708628] Avg episode reward: [(0, '4255.971')] [2023-03-09 14:22:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000187320_95907840.pth... [2023-03-09 14:22:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000186768_95625216.pth [2023-03-09 14:22:04,950][709034] Updated weights for policy 0, policy_version 187360 (0.0005) [2023-03-09 14:22:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 95952896. Throughput: 0: 9286.1. Samples: 95953044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:22:07,858][708628] Avg episode reward: [(0, '4300.462')] [2023-03-09 14:22:07,858][708990] Saving new best policy, reward=4300.462! [2023-03-09 14:22:09,447][709034] Updated weights for policy 0, policy_version 187440 (0.0005) [2023-03-09 14:22:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 95997952. Throughput: 0: 9300.0. Samples: 95981640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:22:12,858][708628] Avg episode reward: [(0, '4231.943')] [2023-03-09 14:22:13,927][709034] Updated weights for policy 0, policy_version 187520 (0.0004) [2023-03-09 14:22:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9344.4). Total num frames: 96047104. Throughput: 0: 9349.9. Samples: 96037780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:22:17,858][708628] Avg episode reward: [(0, '4135.653')] [2023-03-09 14:22:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000187592_96047104.pth... [2023-03-09 14:22:17,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000187048_95768576.pth [2023-03-09 14:22:18,113][709034] Updated weights for policy 0, policy_version 187600 (0.0005) [2023-03-09 14:22:22,584][709034] Updated weights for policy 0, policy_version 187680 (0.0005) [2023-03-09 14:22:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 96092160. Throughput: 0: 9367.5. Samples: 96093932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:22:22,858][708628] Avg episode reward: [(0, '4193.900')] [2023-03-09 14:22:26,818][709034] Updated weights for policy 0, policy_version 187760 (0.0005) [2023-03-09 14:22:27,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 96141312. Throughput: 0: 9430.0. Samples: 96124036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:22:27,858][708628] Avg episode reward: [(0, '4224.181')] [2023-03-09 14:22:31,068][709034] Updated weights for policy 0, policy_version 187840 (0.0005) [2023-03-09 14:22:32,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 96190464. Throughput: 0: 9336.7. Samples: 96180548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:22:32,858][708628] Avg episode reward: [(0, '4286.171')] [2023-03-09 14:22:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000187872_96190464.pth... [2023-03-09 14:22:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000187320_95907840.pth [2023-03-09 14:22:35,486][709034] Updated weights for policy 0, policy_version 187920 (0.0005) [2023-03-09 14:22:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9358.3). Total num frames: 96235520. Throughput: 0: 9392.1. Samples: 96236420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:22:37,858][708628] Avg episode reward: [(0, '4192.524')] [2023-03-09 14:22:39,698][709034] Updated weights for policy 0, policy_version 188000 (0.0005) [2023-03-09 14:22:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9352.5, 300 sec: 9358.3). Total num frames: 96280576. Throughput: 0: 9382.7. Samples: 96264424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:22:42,858][708628] Avg episode reward: [(0, '4190.074')] [2023-03-09 14:22:44,405][709034] Updated weights for policy 0, policy_version 188080 (0.0004) [2023-03-09 14:22:47,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 96325632. Throughput: 0: 9300.1. Samples: 96317928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:22:47,858][708628] Avg episode reward: [(0, '4113.145')] [2023-03-09 14:22:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000188136_96325632.pth... [2023-03-09 14:22:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000187592_96047104.pth [2023-03-09 14:22:49,020][709034] Updated weights for policy 0, policy_version 188160 (0.0005) [2023-03-09 14:22:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 96370688. Throughput: 0: 9300.6. Samples: 96371572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:22:52,858][708628] Avg episode reward: [(0, '4245.217')] [2023-03-09 14:22:53,494][709034] Updated weights for policy 0, policy_version 188240 (0.0005) [2023-03-09 14:22:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 96415744. Throughput: 0: 9277.2. Samples: 96399116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:22:57,858][708628] Avg episode reward: [(0, '4049.481')] [2023-03-09 14:22:58,082][709034] Updated weights for policy 0, policy_version 188320 (0.0005) [2023-03-09 14:23:02,763][709034] Updated weights for policy 0, policy_version 188400 (0.0005) [2023-03-09 14:23:02,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 96460800. Throughput: 0: 9213.9. Samples: 96452404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:23:02,858][708628] Avg episode reward: [(0, '4066.934')] [2023-03-09 14:23:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000188400_96460800.pth... [2023-03-09 14:23:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000187872_96190464.pth [2023-03-09 14:23:07,249][709034] Updated weights for policy 0, policy_version 188480 (0.0005) [2023-03-09 14:23:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 96505856. Throughput: 0: 9161.6. Samples: 96506204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:23:07,858][708628] Avg episode reward: [(0, '4202.865')] [2023-03-09 14:23:11,490][709034] Updated weights for policy 0, policy_version 188560 (0.0005) [2023-03-09 14:23:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.5). Total num frames: 96555008. Throughput: 0: 9150.4. Samples: 96535804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:23:12,858][708628] Avg episode reward: [(0, '4107.206')] [2023-03-09 14:23:15,957][709034] Updated weights for policy 0, policy_version 188640 (0.0005) [2023-03-09 14:23:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 96600064. Throughput: 0: 9135.9. Samples: 96591664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:23:17,858][708628] Avg episode reward: [(0, '4223.211')] [2023-03-09 14:23:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000188672_96600064.pth... [2023-03-09 14:23:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000188136_96325632.pth [2023-03-09 14:23:20,074][709034] Updated weights for policy 0, policy_version 188720 (0.0005) [2023-03-09 14:23:22,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 96649216. Throughput: 0: 9170.3. Samples: 96649084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:23:22,858][708628] Avg episode reward: [(0, '3896.804')] [2023-03-09 14:23:24,538][709034] Updated weights for policy 0, policy_version 188800 (0.0006) [2023-03-09 14:23:27,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9344.4). Total num frames: 96694272. Throughput: 0: 9184.5. Samples: 96677728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:23:27,858][708628] Avg episode reward: [(0, '4109.699')] [2023-03-09 14:23:29,043][709034] Updated weights for policy 0, policy_version 188880 (0.0005) [2023-03-09 14:23:32,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9330.5). Total num frames: 96739328. Throughput: 0: 9199.4. Samples: 96731900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:23:32,858][708628] Avg episode reward: [(0, '4028.304')] [2023-03-09 14:23:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000188944_96739328.pth... [2023-03-09 14:23:32,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000188400_96460800.pth [2023-03-09 14:23:33,561][709034] Updated weights for policy 0, policy_version 188960 (0.0005) [2023-03-09 14:23:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9330.6). Total num frames: 96784384. Throughput: 0: 9226.2. Samples: 96786748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:23:37,858][708628] Avg episode reward: [(0, '3438.518')] [2023-03-09 14:23:37,985][709034] Updated weights for policy 0, policy_version 189040 (0.0005) [2023-03-09 14:23:42,533][709034] Updated weights for policy 0, policy_version 189120 (0.0005) [2023-03-09 14:23:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9330.5). Total num frames: 96829440. Throughput: 0: 9210.1. Samples: 96813572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:23:42,858][708628] Avg episode reward: [(0, '3314.537')] [2023-03-09 14:23:46,854][709034] Updated weights for policy 0, policy_version 189200 (0.0005) [2023-03-09 14:23:47,857][708628] Fps is (10 sec: 9420.6, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 96878592. Throughput: 0: 9277.0. Samples: 96869872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:23:47,858][708628] Avg episode reward: [(0, '3135.501')] [2023-03-09 14:23:47,863][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000189216_96878592.pth... [2023-03-09 14:23:47,867][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000188672_96600064.pth [2023-03-09 14:23:51,168][709034] Updated weights for policy 0, policy_version 189280 (0.0005) [2023-03-09 14:23:52,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9330.5). Total num frames: 96923648. Throughput: 0: 9352.0. Samples: 96927044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:23:52,858][708628] Avg episode reward: [(0, '3683.478')] [2023-03-09 14:23:55,681][709034] Updated weights for policy 0, policy_version 189360 (0.0005) [2023-03-09 14:23:57,857][708628] Fps is (10 sec: 9011.4, 60 sec: 9216.0, 300 sec: 9316.7). Total num frames: 96968704. Throughput: 0: 9264.9. Samples: 96952724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:23:57,858][708628] Avg episode reward: [(0, '3526.714')] [2023-03-09 14:24:00,044][709034] Updated weights for policy 0, policy_version 189440 (0.0005) [2023-03-09 14:24:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9344.4). Total num frames: 97017856. Throughput: 0: 9291.0. Samples: 97009760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:24:02,858][708628] Avg episode reward: [(0, '3435.361')] [2023-03-09 14:24:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000189488_97017856.pth... [2023-03-09 14:24:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000188944_96739328.pth [2023-03-09 14:24:04,443][709034] Updated weights for policy 0, policy_version 189520 (0.0005) [2023-03-09 14:24:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9330.6). Total num frames: 97062912. Throughput: 0: 9275.2. Samples: 97066468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:24:07,858][708628] Avg episode reward: [(0, '3030.083')] [2023-03-09 14:24:08,780][709034] Updated weights for policy 0, policy_version 189600 (0.0005) [2023-03-09 14:24:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9330.6). Total num frames: 97107968. Throughput: 0: 9220.6. Samples: 97092656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:24:12,858][708628] Avg episode reward: [(0, '3500.209')] [2023-03-09 14:24:13,347][709034] Updated weights for policy 0, policy_version 189680 (0.0005) [2023-03-09 14:24:17,765][709034] Updated weights for policy 0, policy_version 189760 (0.0005) [2023-03-09 14:24:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9316.7). Total num frames: 97157120. Throughput: 0: 9265.0. Samples: 97148824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:24:17,858][708628] Avg episode reward: [(0, '3558.727')] [2023-03-09 14:24:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000189760_97157120.pth... [2023-03-09 14:24:17,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000189216_96878592.pth [2023-03-09 14:24:22,204][709034] Updated weights for policy 0, policy_version 189840 (0.0005) [2023-03-09 14:24:22,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9302.8). Total num frames: 97202176. Throughput: 0: 9238.9. Samples: 97202500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:24:22,858][708628] Avg episode reward: [(0, '3571.863')] [2023-03-09 14:24:26,776][709034] Updated weights for policy 0, policy_version 189920 (0.0004) [2023-03-09 14:24:27,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 97247232. Throughput: 0: 9272.2. Samples: 97230820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:24:27,858][708628] Avg episode reward: [(0, '3746.181')] [2023-03-09 14:24:31,225][709034] Updated weights for policy 0, policy_version 190000 (0.0005) [2023-03-09 14:24:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9288.9). Total num frames: 97292288. Throughput: 0: 9229.0. Samples: 97285176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:24:32,858][708628] Avg episode reward: [(0, '3294.068')] [2023-03-09 14:24:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000190024_97292288.pth... [2023-03-09 14:24:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000189488_97017856.pth [2023-03-09 14:24:35,665][709034] Updated weights for policy 0, policy_version 190080 (0.0005) [2023-03-09 14:24:37,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.2, 300 sec: 9302.8). Total num frames: 97341440. Throughput: 0: 9206.4. Samples: 97341332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:24:37,858][708628] Avg episode reward: [(0, '3264.079')] [2023-03-09 14:24:40,246][709034] Updated weights for policy 0, policy_version 190160 (0.0005) [2023-03-09 14:24:42,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9275.0). Total num frames: 97382400. Throughput: 0: 9185.9. Samples: 97366088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:24:42,858][708628] Avg episode reward: [(0, '3543.890')] [2023-03-09 14:24:44,923][709034] Updated weights for policy 0, policy_version 190240 (0.0005) [2023-03-09 14:24:47,857][708628] Fps is (10 sec: 8601.6, 60 sec: 9147.8, 300 sec: 9261.1). Total num frames: 97427456. Throughput: 0: 9124.1. Samples: 97420344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:24:47,858][708628] Avg episode reward: [(0, '3925.303')] [2023-03-09 14:24:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000190288_97427456.pth... [2023-03-09 14:24:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000189760_97157120.pth [2023-03-09 14:24:49,342][709034] Updated weights for policy 0, policy_version 190320 (0.0005) [2023-03-09 14:24:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9261.1). Total num frames: 97472512. Throughput: 0: 9096.7. Samples: 97475820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:24:52,858][708628] Avg episode reward: [(0, '3455.010')] [2023-03-09 14:24:53,861][709034] Updated weights for policy 0, policy_version 190400 (0.0004) [2023-03-09 14:24:57,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9247.2). Total num frames: 97517568. Throughput: 0: 9099.3. Samples: 97502124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:24:57,858][708628] Avg episode reward: [(0, '3736.065')] [2023-03-09 14:24:58,395][709034] Updated weights for policy 0, policy_version 190480 (0.0004) [2023-03-09 14:25:02,836][709034] Updated weights for policy 0, policy_version 190560 (0.0005) [2023-03-09 14:25:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9247.2). Total num frames: 97566720. Throughput: 0: 9071.5. Samples: 97557040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:25:02,858][708628] Avg episode reward: [(0, '3891.384')] [2023-03-09 14:25:02,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000190560_97566720.pth... [2023-03-09 14:25:02,866][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000190024_97292288.pth [2023-03-09 14:25:07,187][709034] Updated weights for policy 0, policy_version 190640 (0.0005) [2023-03-09 14:25:07,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9247.2). Total num frames: 97611776. Throughput: 0: 9115.5. Samples: 97612696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:25:07,858][708628] Avg episode reward: [(0, '3553.180')] [2023-03-09 14:25:11,639][709034] Updated weights for policy 0, policy_version 190720 (0.0005) [2023-03-09 14:25:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9147.7, 300 sec: 9247.2). Total num frames: 97656832. Throughput: 0: 9104.3. Samples: 97640512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:25:12,858][708628] Avg episode reward: [(0, '3751.107')] [2023-03-09 14:25:15,958][709034] Updated weights for policy 0, policy_version 190800 (0.0005) [2023-03-09 14:25:17,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9247.2). Total num frames: 97705984. Throughput: 0: 9163.7. Samples: 97697544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:25:17,858][708628] Avg episode reward: [(0, '3828.237')] [2023-03-09 14:25:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000190832_97705984.pth... [2023-03-09 14:25:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000190288_97427456.pth [2023-03-09 14:25:20,228][709034] Updated weights for policy 0, policy_version 190880 (0.0005) [2023-03-09 14:25:22,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9233.4). Total num frames: 97751040. Throughput: 0: 9178.4. Samples: 97754360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:25:22,858][708628] Avg episode reward: [(0, '3818.772')] [2023-03-09 14:25:24,624][709034] Updated weights for policy 0, policy_version 190960 (0.0005) [2023-03-09 14:25:27,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 97800192. Throughput: 0: 9244.0. Samples: 97782068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:25:27,858][708628] Avg episode reward: [(0, '3954.491')] [2023-03-09 14:25:29,038][709034] Updated weights for policy 0, policy_version 191040 (0.0005) [2023-03-09 14:25:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 97845248. Throughput: 0: 9259.0. Samples: 97837000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:25:32,858][708628] Avg episode reward: [(0, '3683.324')] [2023-03-09 14:25:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000191104_97845248.pth... [2023-03-09 14:25:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000190560_97566720.pth [2023-03-09 14:25:33,564][709034] Updated weights for policy 0, policy_version 191120 (0.0005) [2023-03-09 14:25:37,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.8, 300 sec: 9247.2). Total num frames: 97890304. Throughput: 0: 9266.5. Samples: 97892812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:25:37,858][708628] Avg episode reward: [(0, '3875.452')] [2023-03-09 14:25:37,943][709034] Updated weights for policy 0, policy_version 191200 (0.0006) [2023-03-09 14:25:42,382][709034] Updated weights for policy 0, policy_version 191280 (0.0005) [2023-03-09 14:25:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 97935360. Throughput: 0: 9336.3. Samples: 97922256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:25:42,858][708628] Avg episode reward: [(0, '4106.194')] [2023-03-09 14:25:46,928][709034] Updated weights for policy 0, policy_version 191360 (0.0005) [2023-03-09 14:25:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9247.2). Total num frames: 97984512. Throughput: 0: 9279.9. Samples: 97974636. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:25:47,858][708628] Avg episode reward: [(0, '3969.170')] [2023-03-09 14:25:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000191376_97984512.pth... [2023-03-09 14:25:47,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000190832_97705984.pth [2023-03-09 14:25:51,122][709034] Updated weights for policy 0, policy_version 191440 (0.0005) [2023-03-09 14:25:52,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 98033664. Throughput: 0: 9354.8. Samples: 98033664. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:25:52,858][708628] Avg episode reward: [(0, '3875.042')] [2023-03-09 14:25:55,348][709034] Updated weights for policy 0, policy_version 191520 (0.0005) [2023-03-09 14:25:57,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 98078720. Throughput: 0: 9370.0. Samples: 98062160. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:25:57,858][708628] Avg episode reward: [(0, '3988.525')] [2023-03-09 14:25:59,607][709034] Updated weights for policy 0, policy_version 191600 (0.0005) [2023-03-09 14:26:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 98127872. Throughput: 0: 9365.9. Samples: 98119012. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:26:02,858][708628] Avg episode reward: [(0, '3771.680')] [2023-03-09 14:26:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000191656_98127872.pth... [2023-03-09 14:26:02,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000191104_97845248.pth [2023-03-09 14:26:03,871][709034] Updated weights for policy 0, policy_version 191680 (0.0004) [2023-03-09 14:26:07,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 98172928. Throughput: 0: 9371.9. Samples: 98176096. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:26:07,858][708628] Avg episode reward: [(0, '3728.541')] [2023-03-09 14:26:08,323][709034] Updated weights for policy 0, policy_version 191760 (0.0005) [2023-03-09 14:26:12,704][709034] Updated weights for policy 0, policy_version 191840 (0.0005) [2023-03-09 14:26:12,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 98222080. Throughput: 0: 9402.8. Samples: 98205196. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:26:12,858][708628] Avg episode reward: [(0, '3670.415')] [2023-03-09 14:26:17,178][709034] Updated weights for policy 0, policy_version 191920 (0.0004) [2023-03-09 14:26:17,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 98267136. Throughput: 0: 9378.0. Samples: 98259008. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:26:17,858][708628] Avg episode reward: [(0, '3790.821')] [2023-03-09 14:26:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000191928_98267136.pth... [2023-03-09 14:26:17,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000191376_97984512.pth [2023-03-09 14:26:21,631][709034] Updated weights for policy 0, policy_version 192000 (0.0005) [2023-03-09 14:26:22,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 98316288. Throughput: 0: 9410.7. Samples: 98316296. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:26:22,858][708628] Avg episode reward: [(0, '3410.050')] [2023-03-09 14:26:25,878][709034] Updated weights for policy 0, policy_version 192080 (0.0005) [2023-03-09 14:26:27,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 98361344. Throughput: 0: 9382.8. Samples: 98344480. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:26:27,858][708628] Avg episode reward: [(0, '3468.333')] [2023-03-09 14:26:30,157][709034] Updated weights for policy 0, policy_version 192160 (0.0004) [2023-03-09 14:26:32,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9288.9). Total num frames: 98410496. Throughput: 0: 9490.7. Samples: 98401716. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:26:32,858][708628] Avg episode reward: [(0, '3360.832')] [2023-03-09 14:26:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000192208_98410496.pth... [2023-03-09 14:26:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000191656_98127872.pth [2023-03-09 14:26:34,422][709034] Updated weights for policy 0, policy_version 192240 (0.0005) [2023-03-09 14:26:37,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 98455552. Throughput: 0: 9401.9. Samples: 98456748. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:26:37,858][708628] Avg episode reward: [(0, '3790.866')] [2023-03-09 14:26:39,005][709034] Updated weights for policy 0, policy_version 192320 (0.0005) [2023-03-09 14:26:42,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9420.8, 300 sec: 9261.1). Total num frames: 98500608. Throughput: 0: 9377.0. Samples: 98484124. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:26:42,858][708628] Avg episode reward: [(0, '3955.480')] [2023-03-09 14:26:43,514][709034] Updated weights for policy 0, policy_version 192400 (0.0005) [2023-03-09 14:26:47,724][709034] Updated weights for policy 0, policy_version 192480 (0.0005) [2023-03-09 14:26:47,857][708628] Fps is (10 sec: 9420.5, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 98549760. Throughput: 0: 9365.5. Samples: 98540460. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-09 14:26:47,858][708628] Avg episode reward: [(0, '3667.731')] [2023-03-09 14:26:47,863][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000192480_98549760.pth... [2023-03-09 14:26:47,866][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000191928_98267136.pth [2023-03-09 14:26:52,277][709034] Updated weights for policy 0, policy_version 192560 (0.0005) [2023-03-09 14:26:52,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9352.5, 300 sec: 9275.0). Total num frames: 98594816. Throughput: 0: 9316.2. Samples: 98595324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:26:52,858][708628] Avg episode reward: [(0, '3591.697')] [2023-03-09 14:26:56,846][709034] Updated weights for policy 0, policy_version 192640 (0.0005) [2023-03-09 14:26:57,857][708628] Fps is (10 sec: 9011.4, 60 sec: 9352.5, 300 sec: 9261.1). Total num frames: 98639872. Throughput: 0: 9294.0. Samples: 98623428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:26:57,858][708628] Avg episode reward: [(0, '3428.842')] [2023-03-09 14:27:01,233][709034] Updated weights for policy 0, policy_version 192720 (0.0004) [2023-03-09 14:27:02,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 98684928. Throughput: 0: 9289.1. Samples: 98677016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:27:02,858][708628] Avg episode reward: [(0, '3163.723')] [2023-03-09 14:27:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000192744_98684928.pth... [2023-03-09 14:27:02,862][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000192208_98410496.pth [2023-03-09 14:27:05,762][709034] Updated weights for policy 0, policy_version 192800 (0.0005) [2023-03-09 14:27:07,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9284.3, 300 sec: 9261.1). Total num frames: 98729984. Throughput: 0: 9258.9. Samples: 98732944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:27:07,858][708628] Avg episode reward: [(0, '3124.301')] [2023-03-09 14:27:10,287][709034] Updated weights for policy 0, policy_version 192880 (0.0005) [2023-03-09 14:27:12,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 98775040. Throughput: 0: 9205.4. Samples: 98758720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:27:12,858][708628] Avg episode reward: [(0, '3236.182')] [2023-03-09 14:27:14,893][709034] Updated weights for policy 0, policy_version 192960 (0.0005) [2023-03-09 14:27:17,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 98820096. Throughput: 0: 9114.0. Samples: 98811844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:27:17,858][708628] Avg episode reward: [(0, '3015.244')] [2023-03-09 14:27:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000193008_98820096.pth... [2023-03-09 14:27:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000192480_98549760.pth [2023-03-09 14:27:19,528][709034] Updated weights for policy 0, policy_version 193040 (0.0005) [2023-03-09 14:27:22,857][708628] Fps is (10 sec: 9011.1, 60 sec: 9147.7, 300 sec: 9233.4). Total num frames: 98865152. Throughput: 0: 9100.1. Samples: 98866252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:27:22,858][708628] Avg episode reward: [(0, '2889.484')] [2023-03-09 14:27:23,942][709034] Updated weights for policy 0, policy_version 193120 (0.0005) [2023-03-09 14:27:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9147.7, 300 sec: 9219.5). Total num frames: 98910208. Throughput: 0: 9104.0. Samples: 98893804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:27:27,858][708628] Avg episode reward: [(0, '3291.385')] [2023-03-09 14:27:28,632][709034] Updated weights for policy 0, policy_version 193200 (0.0005) [2023-03-09 14:27:32,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9219.5). Total num frames: 98955264. Throughput: 0: 9037.5. Samples: 98947144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:27:32,858][708628] Avg episode reward: [(0, '3235.782')] [2023-03-09 14:27:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000193272_98955264.pth... [2023-03-09 14:27:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000192744_98684928.pth [2023-03-09 14:27:33,142][709034] Updated weights for policy 0, policy_version 193280 (0.0005) [2023-03-09 14:27:37,804][709034] Updated weights for policy 0, policy_version 193360 (0.0005) [2023-03-09 14:27:37,857][708628] Fps is (10 sec: 9011.3, 60 sec: 9079.5, 300 sec: 9219.5). Total num frames: 99000320. Throughput: 0: 8999.0. Samples: 99000280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:27:37,858][708628] Avg episode reward: [(0, '3250.129')] [2023-03-09 14:27:41,942][709034] Updated weights for policy 0, policy_version 193440 (0.0005) [2023-03-09 14:27:42,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9233.4). Total num frames: 99049472. Throughput: 0: 9019.5. Samples: 99029304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:27:42,858][708628] Avg episode reward: [(0, '3296.442')] [2023-03-09 14:27:46,288][709034] Updated weights for policy 0, policy_version 193520 (0.0005) [2023-03-09 14:27:47,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9079.5, 300 sec: 9233.4). Total num frames: 99094528. Throughput: 0: 9097.4. Samples: 99086400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:27:47,858][708628] Avg episode reward: [(0, '3478.783')] [2023-03-09 14:27:47,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000193544_99094528.pth... [2023-03-09 14:27:47,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000193008_98820096.pth [2023-03-09 14:27:50,602][709034] Updated weights for policy 0, policy_version 193600 (0.0005) [2023-03-09 14:27:52,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9079.5, 300 sec: 9233.4). Total num frames: 99139584. Throughput: 0: 9126.5. Samples: 99143636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:27:52,858][708628] Avg episode reward: [(0, '3042.569')] [2023-03-09 14:27:55,043][709034] Updated weights for policy 0, policy_version 193680 (0.0005) [2023-03-09 14:27:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9147.7, 300 sec: 9247.2). Total num frames: 99188736. Throughput: 0: 9167.2. Samples: 99171244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:27:57,858][708628] Avg episode reward: [(0, '3288.261')] [2023-03-09 14:27:59,663][709034] Updated weights for policy 0, policy_version 193760 (0.0005) [2023-03-09 14:28:02,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9147.7, 300 sec: 9247.2). Total num frames: 99233792. Throughput: 0: 9169.2. Samples: 99224460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:28:02,858][708628] Avg episode reward: [(0, '3367.182')] [2023-03-09 14:28:02,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000193816_99233792.pth... [2023-03-09 14:28:02,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000193272_98955264.pth [2023-03-09 14:28:04,234][709034] Updated weights for policy 0, policy_version 193840 (0.0005) [2023-03-09 14:28:07,857][708628] Fps is (10 sec: 8601.7, 60 sec: 9079.5, 300 sec: 9219.5). Total num frames: 99274752. Throughput: 0: 9157.0. Samples: 99278316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:28:07,858][708628] Avg episode reward: [(0, '3344.864')] [2023-03-09 14:28:08,630][709034] Updated weights for policy 0, policy_version 193920 (0.0005) [2023-03-09 14:28:12,791][709034] Updated weights for policy 0, policy_version 194000 (0.0005) [2023-03-09 14:28:12,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9216.0, 300 sec: 9247.2). Total num frames: 99328000. Throughput: 0: 9193.9. Samples: 99307528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:28:12,858][708628] Avg episode reward: [(0, '3613.619')] [2023-03-09 14:28:17,151][709034] Updated weights for policy 0, policy_version 194080 (0.0005) [2023-03-09 14:28:17,857][708628] Fps is (10 sec: 9830.3, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 99373056. Throughput: 0: 9281.6. Samples: 99364816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:28:17,858][708628] Avg episode reward: [(0, '3316.488')] [2023-03-09 14:28:17,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000194088_99373056.pth... [2023-03-09 14:28:17,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000193544_99094528.pth [2023-03-09 14:28:21,624][709034] Updated weights for policy 0, policy_version 194160 (0.0005) [2023-03-09 14:28:22,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 99418112. Throughput: 0: 9324.2. Samples: 99419872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:28:22,858][708628] Avg episode reward: [(0, '3326.269')] [2023-03-09 14:28:26,187][709034] Updated weights for policy 0, policy_version 194240 (0.0004) [2023-03-09 14:28:27,857][708628] Fps is (10 sec: 9011.2, 60 sec: 9216.0, 300 sec: 9233.4). Total num frames: 99463168. Throughput: 0: 9281.6. Samples: 99446976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:28:27,858][708628] Avg episode reward: [(0, '3175.778')] [2023-03-09 14:28:30,660][709034] Updated weights for policy 0, policy_version 194320 (0.0005) [2023-03-09 14:28:32,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9284.3, 300 sec: 9247.2). Total num frames: 99512320. Throughput: 0: 9199.8. Samples: 99500392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:28:32,858][708628] Avg episode reward: [(0, '3523.787')] [2023-03-09 14:28:32,861][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000194360_99512320.pth... [2023-03-09 14:28:32,864][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000193816_99233792.pth [2023-03-09 14:28:34,725][709034] Updated weights for policy 0, policy_version 194400 (0.0005) [2023-03-09 14:28:37,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9284.3, 300 sec: 9247.2). Total num frames: 99557376. Throughput: 0: 9270.6. Samples: 99560812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:28:37,858][708628] Avg episode reward: [(0, '3387.647')] [2023-03-09 14:28:39,091][709034] Updated weights for policy 0, policy_version 194480 (0.0005) [2023-03-09 14:28:42,857][708628] Fps is (10 sec: 9420.9, 60 sec: 9284.3, 300 sec: 9247.2). Total num frames: 99606528. Throughput: 0: 9309.1. Samples: 99590152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:28:42,858][708628] Avg episode reward: [(0, '3441.813')] [2023-03-09 14:28:43,302][709034] Updated weights for policy 0, policy_version 194560 (0.0005) [2023-03-09 14:28:47,451][709034] Updated weights for policy 0, policy_version 194640 (0.0005) [2023-03-09 14:28:47,857][708628] Fps is (10 sec: 10240.0, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 99659776. Throughput: 0: 9402.1. Samples: 99647552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:28:47,858][708628] Avg episode reward: [(0, '3665.298')] [2023-03-09 14:28:47,862][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000194648_99659776.pth... [2023-03-09 14:28:47,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000194088_99373056.pth [2023-03-09 14:28:51,622][709034] Updated weights for policy 0, policy_version 194720 (0.0005) [2023-03-09 14:28:52,857][708628] Fps is (10 sec: 10239.9, 60 sec: 9489.1, 300 sec: 9288.9). Total num frames: 99708928. Throughput: 0: 9564.7. Samples: 99708728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:28:52,858][708628] Avg episode reward: [(0, '3596.097')] [2023-03-09 14:28:55,805][709034] Updated weights for policy 0, policy_version 194800 (0.0005) [2023-03-09 14:28:57,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9420.8, 300 sec: 9275.0). Total num frames: 99753984. Throughput: 0: 9556.9. Samples: 99737588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:28:57,858][708628] Avg episode reward: [(0, '3427.412')] [2023-03-09 14:29:00,113][709034] Updated weights for policy 0, policy_version 194880 (0.0006) [2023-03-09 14:29:02,857][708628] Fps is (10 sec: 9420.8, 60 sec: 9489.1, 300 sec: 9288.9). Total num frames: 99803136. Throughput: 0: 9556.8. Samples: 99794872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-09 14:29:02,858][708628] Avg episode reward: [(0, '3576.977')] [2023-03-09 14:29:02,860][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000194928_99803136.pth... [2023-03-09 14:29:02,863][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000194360_99512320.pth [2023-03-09 14:29:04,399][709034] Updated weights for policy 0, policy_version 194960 (0.0005) [2023-03-09 14:29:07,857][708628] Fps is (10 sec: 9830.5, 60 sec: 9625.6, 300 sec: 9302.8). Total num frames: 99852288. Throughput: 0: 9613.2. Samples: 99852464. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 14:29:07,858][708628] Avg episode reward: [(0, '3967.038')] [2023-03-09 14:29:08,495][709034] Updated weights for policy 0, policy_version 195040 (0.0005) [2023-03-09 14:29:12,588][709034] Updated weights for policy 0, policy_version 195120 (0.0005) [2023-03-09 14:29:12,857][708628] Fps is (10 sec: 9830.4, 60 sec: 9557.3, 300 sec: 9302.8). Total num frames: 99901440. Throughput: 0: 9679.9. Samples: 99882572. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 14:29:12,858][708628] Avg episode reward: [(0, '3422.596')] [2023-03-09 14:29:16,927][709034] Updated weights for policy 0, policy_version 195200 (0.0005) [2023-03-09 14:29:17,857][708628] Fps is (10 sec: 9830.2, 60 sec: 9625.6, 300 sec: 9316.7). Total num frames: 99950592. Throughput: 0: 9795.2. Samples: 99941176. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 14:29:17,858][708628] Avg episode reward: [(0, '3492.165')] [2023-03-09 14:29:17,863][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000195216_99950592.pth... [2023-03-09 14:29:17,865][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000194648_99659776.pth [2023-03-09 14:29:21,297][709034] Updated weights for policy 0, policy_version 195280 (0.0005) [2023-03-09 14:29:22,857][708628] Fps is (10 sec: 9420.7, 60 sec: 9625.6, 300 sec: 9316.7). Total num frames: 99995648. Throughput: 0: 9664.6. Samples: 99995720. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-09 14:29:22,858][708628] Avg episode reward: [(0, '3499.978')] [2023-03-09 14:29:23,675][708990] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000000 [2023-03-09 14:29:24,154][708990] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000000 [2023-03-09 14:29:24,155][709070] Stopping RolloutWorker_w4... [2023-03-09 14:29:24,155][709166] Stopping RolloutWorker_w6... [2023-03-09 14:29:24,155][709037] Stopping RolloutWorker_w1... [2023-03-09 14:29:24,155][709103] Stopping RolloutWorker_w7... [2023-03-09 14:29:24,155][709038] Stopping RolloutWorker_w3... [2023-03-09 14:29:24,155][709035] Stopping RolloutWorker_w0... [2023-03-09 14:29:24,155][709036] Stopping RolloutWorker_w2... [2023-03-09 14:29:24,155][709166] Loop rollout_proc6_evt_loop terminating... [2023-03-09 14:29:24,155][709102] Stopping RolloutWorker_w5... [2023-03-09 14:29:24,155][709070] Loop rollout_proc4_evt_loop terminating... [2023-03-09 14:29:24,155][709103] Loop rollout_proc7_evt_loop terminating... [2023-03-09 14:29:24,155][709038] Loop rollout_proc3_evt_loop terminating... [2023-03-09 14:29:24,155][709037] Loop rollout_proc1_evt_loop terminating... [2023-03-09 14:29:24,155][709036] Loop rollout_proc2_evt_loop terminating... [2023-03-09 14:29:24,155][708990] Stopping Batcher_0... [2023-03-09 14:29:24,155][709035] Loop rollout_proc0_evt_loop terminating... [2023-03-09 14:29:24,155][708628] Component RolloutWorker_w6 stopped! [2023-03-09 14:29:24,155][709102] Loop rollout_proc5_evt_loop terminating... [2023-03-09 14:29:24,156][708990] Loop batcher_evt_loop terminating... [2023-03-09 14:29:24,156][708628] Component RolloutWorker_w4 stopped! [2023-03-09 14:29:24,156][708628] Component RolloutWorker_w3 stopped! [2023-03-09 14:29:24,156][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000195328_100007936.pth... [2023-03-09 14:29:24,156][708628] Component RolloutWorker_w1 stopped! [2023-03-09 14:29:24,156][708628] Component RolloutWorker_w0 stopped! [2023-03-09 14:29:24,157][708628] Component RolloutWorker_w7 stopped! [2023-03-09 14:29:24,157][708628] Component RolloutWorker_w2 stopped! [2023-03-09 14:29:24,157][708628] Component RolloutWorker_w5 stopped! [2023-03-09 14:29:24,157][708628] Component Batcher_0 stopped! [2023-03-09 14:29:24,158][708990] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000194928_99803136.pth [2023-03-09 14:29:24,158][708990] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/peg-unplug-side-v2/checkpoint_p0/checkpoint_000195328_100007936.pth... [2023-03-09 14:29:24,160][708990] Stopping LearnerWorker_p0... [2023-03-09 14:29:24,160][708990] Loop learner_proc0_evt_loop terminating... [2023-03-09 14:29:24,160][708628] Component LearnerWorker_p0 stopped! [2023-03-09 14:29:24,210][709034] Weights refcount: 2 0 [2023-03-09 14:29:24,211][709034] Stopping InferenceWorker_p0-w0... [2023-03-09 14:29:24,211][709034] Loop inference_proc0-0_evt_loop terminating... [2023-03-09 14:29:24,211][708628] Component InferenceWorker_p0-w0 stopped! [2023-03-09 14:29:24,212][708628] Waiting for process learner_proc0 to stop... [2023-03-09 14:29:24,689][708628] Waiting for process inference_proc0-0 to join... [2023-03-09 14:29:24,732][708628] Waiting for process rollout_proc0 to join... [2023-03-09 14:29:24,733][708628] Waiting for process rollout_proc1 to join... [2023-03-09 14:29:24,740][708628] Waiting for process rollout_proc2 to join... [2023-03-09 14:29:24,740][708628] Waiting for process rollout_proc3 to join... [2023-03-09 14:29:24,740][708628] Waiting for process rollout_proc4 to join... [2023-03-09 14:29:24,741][708628] Waiting for process rollout_proc5 to join... [2023-03-09 14:29:24,741][708628] Waiting for process rollout_proc6 to join... [2023-03-09 14:29:24,741][708628] Waiting for process rollout_proc7 to join... [2023-03-09 14:29:24,741][708628] Batcher 0 profile tree view: batching: 18.4710, releasing_batches: 15.5584 [2023-03-09 14:29:24,741][708628] InferenceWorker_p0-w0 profile tree view: wait_policy: 0.0051 wait_policy_total: 4067.9243 update_model: 119.5558 weight_update: 0.0004 one_step: 0.0010 handle_policy_step: 6006.7911 deserialize: 253.4794, stack: 63.4037, obs_to_device_normalize: 1071.8970, forward: 2992.9672, send_messages: 451.9093 prepare_outputs: 649.3093 to_cpu: 101.7033 [2023-03-09 14:29:24,742][708628] Learner 0 profile tree view: misc: 0.1138, prepare_batch: 81.9856 train: 1062.9092 epoch_init: 0.3691, minibatch_init: 11.6532, losses_postprocess: 12.7542, kl_divergence: 4.0829, after_optimizer: 6.0395 calculate_losses: 432.8276 losses_init: 0.3153, forward_head: 207.9347, bptt_initial: 1.1879, bptt: 1.2528, tail: 107.7378, advantages_returns: 8.7503, losses: 92.4418 update: 579.9473 clip: 53.3224 [2023-03-09 14:29:24,742][708628] RolloutWorker_w0 profile tree view: wait_for_trajectories: 4.5227, enqueue_policy_requests: 163.5312, env_step: 6521.8089, overhead: 338.6957, complete_rollouts: 3.7989 save_policy_outputs: 380.0360 split_output_tensors: 186.6145 [2023-03-09 14:29:24,742][708628] RolloutWorker_w7 profile tree view: wait_for_trajectories: 4.3514, enqueue_policy_requests: 167.9657, env_step: 6453.6193, overhead: 331.8876, complete_rollouts: 3.7770 save_policy_outputs: 370.6274 split_output_tensors: 181.8253 [2023-03-09 14:29:24,742][708628] Loop Runner_EvtLoop terminating... [2023-03-09 14:29:24,743][708628] Runner profile tree view: main_loop: 10939.2308 [2023-03-09 14:29:24,743][708628] Collected {0: 100007936}, FPS: 9142.1