[2023-03-08 01:18:37,999][304334] Saving configuration to /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/config.json... [2023-03-08 01:18:38,015][304334] Rollout worker 0 uses device cpu [2023-03-08 01:18:38,015][304334] Rollout worker 1 uses device cpu [2023-03-08 01:18:38,016][304334] Rollout worker 2 uses device cpu [2023-03-08 01:18:38,016][304334] Rollout worker 3 uses device cpu [2023-03-08 01:18:38,016][304334] Rollout worker 4 uses device cpu [2023-03-08 01:18:38,016][304334] Rollout worker 5 uses device cpu [2023-03-08 01:18:38,016][304334] Rollout worker 6 uses device cpu [2023-03-08 01:18:38,016][304334] Rollout worker 7 uses device cpu [2023-03-08 01:18:38,016][304334] In synchronous mode, we only accumulate one batch. Setting num_batches_to_accumulate to 1 [2023-03-08 01:18:38,027][304334] InferenceWorker_p0-w0: min num requests: 2 [2023-03-08 01:18:38,044][304334] Starting all processes... [2023-03-08 01:18:38,044][304334] Starting process learner_proc0 [2023-03-08 01:18:38,094][304334] Starting all processes... [2023-03-08 01:18:38,135][304334] Starting process inference_proc0-0 [2023-03-08 01:18:38,136][304334] Starting process rollout_proc0 [2023-03-08 01:18:38,136][304334] Starting process rollout_proc1 [2023-03-08 01:18:38,136][304334] Starting process rollout_proc2 [2023-03-08 01:18:38,136][304334] Starting process rollout_proc3 [2023-03-08 01:18:38,137][304334] Starting process rollout_proc4 [2023-03-08 01:18:38,137][304334] Starting process rollout_proc5 [2023-03-08 01:18:38,137][304334] Starting process rollout_proc6 [2023-03-08 01:18:38,138][304334] Starting process rollout_proc7 [2023-03-08 01:18:39,504][304573] Starting seed is not provided [2023-03-08 01:18:39,504][304573] Initializing actor-critic model on device cpu [2023-03-08 01:18:39,505][304573] RunningMeanStd input shape: (39,) [2023-03-08 01:18:39,505][304573] RunningMeanStd input shape: (1,) [2023-03-08 01:18:39,563][304573] Created Actor Critic model with architecture: [2023-03-08 01:18:39,563][304573] ActorCriticSharedWeights( (obs_normalizer): ObservationNormalizer( (running_mean_std): RunningMeanStdDictInPlace( (running_mean_std): ModuleDict( (obs): RunningMeanStdInPlace() ) ) ) (returns_normalizer): RecursiveScriptModule(original_name=RunningMeanStdInPlace) (encoder): MultiInputEncoder( (encoders): ModuleDict( (obs): MlpEncoder( (mlp_head): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Linear) (1): RecursiveScriptModule(original_name=Tanh) (2): RecursiveScriptModule(original_name=Linear) (3): RecursiveScriptModule(original_name=Tanh) ) ) ) ) (core): ModelCoreIdentity() (decoder): MlpDecoder( (mlp): Identity() ) (critic_linear): Linear(in_features=64, out_features=1, bias=True) (action_parameterization): ActionParameterizationContinuousNonAdaptiveStddev( (distribution_linear): Linear(in_features=64, out_features=4, bias=True) ) ) [2023-03-08 01:18:39,809][304630] Worker 4 uses CPU cores [16, 17, 18, 19] [2023-03-08 01:18:39,837][304621] Worker 3 uses CPU cores [12, 13, 14, 15] [2023-03-08 01:18:39,878][304573] Using optimizer [2023-03-08 01:18:39,878][304573] No checkpoints found [2023-03-08 01:18:39,878][304573] Did not load from checkpoint, starting from scratch! [2023-03-08 01:18:39,878][304573] Initialized policy 0 weights for model version 0 [2023-03-08 01:18:39,879][304573] LearnerWorker_p0 finished initialization! [2023-03-08 01:18:39,880][304623] RunningMeanStd input shape: (39,) [2023-03-08 01:18:39,881][304623] RunningMeanStd input shape: (1,) [2023-03-08 01:18:39,938][304334] Inference worker 0-0 is ready! [2023-03-08 01:18:39,938][304334] All inference workers are ready! Signal rollout workers to start! [2023-03-08 01:18:39,958][304622] Worker 0 uses CPU cores [0, 1, 2, 3] [2023-03-08 01:18:40,026][304625] Worker 1 uses CPU cores [4, 5, 6, 7] [2023-03-08 01:18:40,162][304626] Worker 5 uses CPU cores [20, 21, 22, 23] [2023-03-08 01:18:40,220][304627] Worker 6 uses CPU cores [24, 25, 26, 27] [2023-03-08 01:18:40,349][304624] Worker 2 uses CPU cores [8, 9, 10, 11] [2023-03-08 01:18:40,360][304628] Worker 7 uses CPU cores [28, 29, 30, 31] [2023-03-08 01:18:40,769][304334] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 0. Throughput: 0: nan. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-08 01:18:44,219][304630] Decorrelating experience for 0 frames... [2023-03-08 01:18:44,232][304630] Decorrelating experience for 64 frames... [2023-03-08 01:18:44,268][304630] Decorrelating experience for 128 frames... [2023-03-08 01:18:44,282][304621] Decorrelating experience for 0 frames... [2023-03-08 01:18:44,294][304622] Decorrelating experience for 0 frames... [2023-03-08 01:18:44,296][304621] Decorrelating experience for 64 frames... [2023-03-08 01:18:44,308][304622] Decorrelating experience for 64 frames... [2023-03-08 01:18:44,331][304621] Decorrelating experience for 128 frames... [2023-03-08 01:18:44,333][304630] Decorrelating experience for 192 frames... [2023-03-08 01:18:44,345][304622] Decorrelating experience for 128 frames... [2023-03-08 01:18:44,387][304625] Decorrelating experience for 0 frames... [2023-03-08 01:18:44,389][304621] Decorrelating experience for 192 frames... [2023-03-08 01:18:44,401][304625] Decorrelating experience for 64 frames... [2023-03-08 01:18:44,405][304622] Decorrelating experience for 192 frames... [2023-03-08 01:18:44,440][304625] Decorrelating experience for 128 frames... [2023-03-08 01:18:44,491][304626] Decorrelating experience for 0 frames... [2023-03-08 01:18:44,500][304625] Decorrelating experience for 192 frames... [2023-03-08 01:18:44,505][304626] Decorrelating experience for 64 frames... [2023-03-08 01:18:44,540][304626] Decorrelating experience for 128 frames... [2023-03-08 01:18:44,546][304627] Decorrelating experience for 0 frames... [2023-03-08 01:18:44,560][304627] Decorrelating experience for 64 frames... [2023-03-08 01:18:44,597][304627] Decorrelating experience for 128 frames... [2023-03-08 01:18:44,597][304626] Decorrelating experience for 192 frames... [2023-03-08 01:18:44,655][304627] Decorrelating experience for 192 frames... [2023-03-08 01:18:44,682][304628] Decorrelating experience for 0 frames... [2023-03-08 01:18:44,696][304628] Decorrelating experience for 64 frames... [2023-03-08 01:18:44,732][304628] Decorrelating experience for 128 frames... [2023-03-08 01:18:44,732][304624] Decorrelating experience for 0 frames... [2023-03-08 01:18:44,746][304624] Decorrelating experience for 64 frames... [2023-03-08 01:18:44,783][304624] Decorrelating experience for 128 frames... [2023-03-08 01:18:44,791][304628] Decorrelating experience for 192 frames... [2023-03-08 01:18:44,847][304624] Decorrelating experience for 192 frames... [2023-03-08 01:18:45,769][304334] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-08 01:18:48,614][304630] Decorrelating experience for 256 frames... [2023-03-08 01:18:48,666][304621] Decorrelating experience for 256 frames... [2023-03-08 01:18:48,685][304622] Decorrelating experience for 256 frames... [2023-03-08 01:18:48,710][304630] Decorrelating experience for 320 frames... [2023-03-08 01:18:48,763][304621] Decorrelating experience for 320 frames... [2023-03-08 01:18:48,767][304625] Decorrelating experience for 256 frames... [2023-03-08 01:18:48,798][304622] Decorrelating experience for 320 frames... [2023-03-08 01:18:48,833][304630] Decorrelating experience for 384 frames... [2023-03-08 01:18:48,875][304625] Decorrelating experience for 320 frames... [2023-03-08 01:18:48,884][304626] Decorrelating experience for 256 frames... [2023-03-08 01:18:48,903][304621] Decorrelating experience for 384 frames... [2023-03-08 01:18:48,917][304622] Decorrelating experience for 384 frames... [2023-03-08 01:18:48,927][304627] Decorrelating experience for 256 frames... [2023-03-08 01:18:48,982][304626] Decorrelating experience for 320 frames... [2023-03-08 01:18:48,995][304625] Decorrelating experience for 384 frames... [2023-03-08 01:18:49,000][304630] Decorrelating experience for 448 frames... [2023-03-08 01:18:49,025][304627] Decorrelating experience for 320 frames... [2023-03-08 01:18:49,052][304621] Decorrelating experience for 448 frames... [2023-03-08 01:18:49,061][304622] Decorrelating experience for 448 frames... [2023-03-08 01:18:49,083][304628] Decorrelating experience for 256 frames... [2023-03-08 01:18:49,100][304626] Decorrelating experience for 384 frames... [2023-03-08 01:18:49,124][304624] Decorrelating experience for 256 frames... [2023-03-08 01:18:49,137][304625] Decorrelating experience for 448 frames... [2023-03-08 01:18:49,145][304627] Decorrelating experience for 384 frames... [2023-03-08 01:18:49,182][304628] Decorrelating experience for 320 frames... [2023-03-08 01:18:49,240][304624] Decorrelating experience for 320 frames... [2023-03-08 01:18:49,245][304626] Decorrelating experience for 448 frames... [2023-03-08 01:18:49,284][304627] Decorrelating experience for 448 frames... [2023-03-08 01:18:49,298][304628] Decorrelating experience for 384 frames... [2023-03-08 01:18:49,357][304624] Decorrelating experience for 384 frames... [2023-03-08 01:18:49,436][304628] Decorrelating experience for 448 frames... [2023-03-08 01:18:49,498][304624] Decorrelating experience for 448 frames... [2023-03-08 01:18:50,769][304334] Fps is (10 sec: 819.2, 60 sec: 819.2, 300 sec: 819.2). Total num frames: 8192. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:18:50,769][304334] Avg episode reward: [(0, '148.992')] [2023-03-08 01:18:50,771][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000000016_8192.pth... [2023-03-08 01:18:52,901][304623] Updated weights for policy 0, policy_version 80 (0.0005) [2023-03-08 01:18:55,769][304334] Fps is (10 sec: 6963.2, 60 sec: 4642.1, 300 sec: 4642.1). Total num frames: 69632. Throughput: 0: 4287.5. Samples: 64312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:18:55,769][304334] Avg episode reward: [(0, '578.504')] [2023-03-08 01:18:56,619][304623] Updated weights for policy 0, policy_version 160 (0.0005) [2023-03-08 01:18:58,023][304334] Heartbeat connected on Batcher_0 [2023-03-08 01:18:58,025][304334] Heartbeat connected on LearnerWorker_p0 [2023-03-08 01:18:58,029][304334] Heartbeat connected on InferenceWorker_p0-w0 [2023-03-08 01:18:58,033][304334] Heartbeat connected on RolloutWorker_w0 [2023-03-08 01:18:58,035][304334] Heartbeat connected on RolloutWorker_w1 [2023-03-08 01:18:58,038][304334] Heartbeat connected on RolloutWorker_w2 [2023-03-08 01:18:58,039][304334] Heartbeat connected on RolloutWorker_w3 [2023-03-08 01:18:58,041][304334] Heartbeat connected on RolloutWorker_w4 [2023-03-08 01:18:58,044][304334] Heartbeat connected on RolloutWorker_w5 [2023-03-08 01:18:58,045][304334] Heartbeat connected on RolloutWorker_w6 [2023-03-08 01:18:58,046][304334] Heartbeat connected on RolloutWorker_w7 [2023-03-08 01:19:00,547][304623] Updated weights for policy 0, policy_version 240 (0.0005) [2023-03-08 01:19:00,769][304334] Fps is (10 sec: 11468.8, 60 sec: 6144.0, 300 sec: 6144.0). Total num frames: 122880. Throughput: 0: 4788.4. Samples: 95768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:19:00,769][304334] Avg episode reward: [(0, '1026.024')] [2023-03-08 01:19:00,770][304573] Saving new best policy, reward=1026.024! [2023-03-08 01:19:04,256][304623] Updated weights for policy 0, policy_version 320 (0.0005) [2023-03-08 01:19:05,769][304334] Fps is (10 sec: 11059.2, 60 sec: 7209.0, 300 sec: 7209.0). Total num frames: 180224. Throughput: 0: 6407.2. Samples: 160180. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:19:05,769][304334] Avg episode reward: [(0, '723.867')] [2023-03-08 01:19:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000000352_180224.pth... [2023-03-08 01:19:07,998][304623] Updated weights for policy 0, policy_version 400 (0.0005) [2023-03-08 01:19:10,769][304334] Fps is (10 sec: 11059.2, 60 sec: 7782.4, 300 sec: 7782.4). Total num frames: 233472. Throughput: 0: 7515.9. Samples: 225476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:19:10,769][304334] Avg episode reward: [(0, '1126.717')] [2023-03-08 01:19:10,770][304573] Saving new best policy, reward=1126.717! [2023-03-08 01:19:11,841][304623] Updated weights for policy 0, policy_version 480 (0.0005) [2023-03-08 01:19:15,684][304623] Updated weights for policy 0, policy_version 560 (0.0005) [2023-03-08 01:19:15,769][304334] Fps is (10 sec: 10649.6, 60 sec: 8192.0, 300 sec: 8192.0). Total num frames: 286720. Throughput: 0: 7374.9. Samples: 258120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:19:15,769][304334] Avg episode reward: [(0, '1108.390')] [2023-03-08 01:19:19,674][304623] Updated weights for policy 0, policy_version 640 (0.0005) [2023-03-08 01:19:20,769][304334] Fps is (10 sec: 10240.0, 60 sec: 8396.8, 300 sec: 8396.8). Total num frames: 335872. Throughput: 0: 8000.6. Samples: 320024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:19:20,769][304334] Avg episode reward: [(0, '1451.129')] [2023-03-08 01:19:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000000656_335872.pth... [2023-03-08 01:19:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000000016_8192.pth [2023-03-08 01:19:20,775][304573] Saving new best policy, reward=1451.129! [2023-03-08 01:19:23,512][304623] Updated weights for policy 0, policy_version 720 (0.0005) [2023-03-08 01:19:25,769][304334] Fps is (10 sec: 10240.0, 60 sec: 8647.1, 300 sec: 8647.1). Total num frames: 389120. Throughput: 0: 8541.1. Samples: 384352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:19:25,769][304334] Avg episode reward: [(0, '1284.933')] [2023-03-08 01:19:27,313][304623] Updated weights for policy 0, policy_version 800 (0.0005) [2023-03-08 01:19:30,769][304334] Fps is (10 sec: 11059.2, 60 sec: 8929.3, 300 sec: 8929.3). Total num frames: 446464. Throughput: 0: 9276.6. Samples: 417448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:19:30,769][304334] Avg episode reward: [(0, '1691.209')] [2023-03-08 01:19:30,770][304573] Saving new best policy, reward=1691.209! [2023-03-08 01:19:30,859][304623] Updated weights for policy 0, policy_version 880 (0.0004) [2023-03-08 01:19:34,347][304623] Updated weights for policy 0, policy_version 960 (0.0004) [2023-03-08 01:19:35,769][304334] Fps is (10 sec: 11878.3, 60 sec: 9234.6, 300 sec: 9234.6). Total num frames: 507904. Throughput: 0: 10831.6. Samples: 487424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:19:35,769][304334] Avg episode reward: [(0, '2169.303')] [2023-03-08 01:19:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000000992_507904.pth... [2023-03-08 01:19:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000000352_180224.pth [2023-03-08 01:19:35,776][304573] Saving new best policy, reward=2169.303! [2023-03-08 01:19:37,740][304623] Updated weights for policy 0, policy_version 1040 (0.0004) [2023-03-08 01:19:40,769][304334] Fps is (10 sec: 12288.0, 60 sec: 9489.1, 300 sec: 9489.1). Total num frames: 569344. Throughput: 0: 11033.2. Samples: 560808. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:19:40,769][304334] Avg episode reward: [(0, '2517.186')] [2023-03-08 01:19:40,770][304573] Saving new best policy, reward=2517.186! [2023-03-08 01:19:41,007][304623] Updated weights for policy 0, policy_version 1120 (0.0004) [2023-03-08 01:19:44,459][304623] Updated weights for policy 0, policy_version 1200 (0.0005) [2023-03-08 01:19:45,769][304334] Fps is (10 sec: 11878.5, 60 sec: 10444.8, 300 sec: 9641.3). Total num frames: 626688. Throughput: 0: 11134.7. Samples: 596828. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 01:19:45,769][304334] Avg episode reward: [(0, '2590.808')] [2023-03-08 01:19:45,770][304573] Saving new best policy, reward=2590.808! [2023-03-08 01:19:48,115][304623] Updated weights for policy 0, policy_version 1280 (0.0003) [2023-03-08 01:19:50,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 9771.9). Total num frames: 684032. Throughput: 0: 11202.8. Samples: 664308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:19:50,769][304334] Avg episode reward: [(0, '2705.117')] [2023-03-08 01:19:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000001336_684032.pth... [2023-03-08 01:19:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000000656_335872.pth [2023-03-08 01:19:50,775][304573] Saving new best policy, reward=2705.117! [2023-03-08 01:19:51,767][304623] Updated weights for policy 0, policy_version 1360 (0.0005) [2023-03-08 01:19:55,478][304623] Updated weights for policy 0, policy_version 1440 (0.0005) [2023-03-08 01:19:55,769][304334] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 9830.4). Total num frames: 737280. Throughput: 0: 11255.6. Samples: 731980. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:19:55,769][304334] Avg episode reward: [(0, '3035.698')] [2023-03-08 01:19:55,770][304573] Saving new best policy, reward=3035.698! [2023-03-08 01:19:59,144][304623] Updated weights for policy 0, policy_version 1520 (0.0004) [2023-03-08 01:20:00,769][304334] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 9932.8). Total num frames: 794624. Throughput: 0: 11255.7. Samples: 764628. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:20:00,780][304334] Avg episode reward: [(0, '3197.903')] [2023-03-08 01:20:00,780][304573] Saving new best policy, reward=3197.903! [2023-03-08 01:20:02,807][304623] Updated weights for policy 0, policy_version 1600 (0.0005) [2023-03-08 01:20:05,769][304334] Fps is (10 sec: 11059.1, 60 sec: 11127.4, 300 sec: 9975.0). Total num frames: 847872. Throughput: 0: 11377.5. Samples: 832012. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:20:05,780][304334] Avg episode reward: [(0, '3133.814')] [2023-03-08 01:20:05,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000001664_851968.pth... [2023-03-08 01:20:05,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000000992_507904.pth [2023-03-08 01:20:06,528][304623] Updated weights for policy 0, policy_version 1680 (0.0005) [2023-03-08 01:20:10,226][304623] Updated weights for policy 0, policy_version 1760 (0.0005) [2023-03-08 01:20:10,769][304334] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 10058.0). Total num frames: 905216. Throughput: 0: 11417.8. Samples: 898152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:20:10,780][304334] Avg episode reward: [(0, '3356.933')] [2023-03-08 01:20:10,780][304573] Saving new best policy, reward=3356.933! [2023-03-08 01:20:13,726][304623] Updated weights for policy 0, policy_version 1840 (0.0004) [2023-03-08 01:20:15,769][304334] Fps is (10 sec: 11878.5, 60 sec: 11332.3, 300 sec: 10175.3). Total num frames: 966656. Throughput: 0: 11451.2. Samples: 932752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:20:15,769][304334] Avg episode reward: [(0, '3651.878')] [2023-03-08 01:20:15,770][304573] Saving new best policy, reward=3651.878! [2023-03-08 01:20:17,125][304623] Updated weights for policy 0, policy_version 1920 (0.0003) [2023-03-08 01:20:20,653][304623] Updated weights for policy 0, policy_version 2000 (0.0003) [2023-03-08 01:20:20,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 10240.0). Total num frames: 1024000. Throughput: 0: 11470.2. Samples: 1003584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:20:20,769][304334] Avg episode reward: [(0, '3855.447')] [2023-03-08 01:20:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000002000_1024000.pth... [2023-03-08 01:20:20,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000001336_684032.pth [2023-03-08 01:20:20,776][304573] Saving new best policy, reward=3855.447! [2023-03-08 01:20:24,311][304623] Updated weights for policy 0, policy_version 2080 (0.0006) [2023-03-08 01:20:25,769][304334] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 10298.5). Total num frames: 1081344. Throughput: 0: 11385.6. Samples: 1073160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:20:25,769][304334] Avg episode reward: [(0, '4186.566')] [2023-03-08 01:20:25,770][304573] Saving new best policy, reward=4186.566! [2023-03-08 01:20:27,912][304623] Updated weights for policy 0, policy_version 2160 (0.0006) [2023-03-08 01:20:30,769][304334] Fps is (10 sec: 11059.2, 60 sec: 11468.8, 300 sec: 10314.5). Total num frames: 1134592. Throughput: 0: 11322.9. Samples: 1106360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:20:30,769][304334] Avg episode reward: [(0, '4242.931')] [2023-03-08 01:20:30,770][304573] Saving new best policy, reward=4242.931! [2023-03-08 01:20:31,601][304623] Updated weights for policy 0, policy_version 2240 (0.0006) [2023-03-08 01:20:35,256][304623] Updated weights for policy 0, policy_version 2320 (0.0005) [2023-03-08 01:20:35,769][304334] Fps is (10 sec: 11059.3, 60 sec: 11400.6, 300 sec: 10364.7). Total num frames: 1191936. Throughput: 0: 11315.7. Samples: 1173516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:20:35,769][304334] Avg episode reward: [(0, '4329.661')] [2023-03-08 01:20:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000002328_1191936.pth... [2023-03-08 01:20:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000001664_851968.pth [2023-03-08 01:20:35,776][304573] Saving new best policy, reward=4329.661! [2023-03-08 01:20:38,809][304623] Updated weights for policy 0, policy_version 2400 (0.0004) [2023-03-08 01:20:40,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 10410.7). Total num frames: 1249280. Throughput: 0: 11347.9. Samples: 1242636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:20:40,769][304334] Avg episode reward: [(0, '4357.955')] [2023-03-08 01:20:40,770][304573] Saving new best policy, reward=4357.955! [2023-03-08 01:20:42,187][304623] Updated weights for policy 0, policy_version 2480 (0.0004) [2023-03-08 01:20:45,442][304623] Updated weights for policy 0, policy_version 2560 (0.0004) [2023-03-08 01:20:45,769][304334] Fps is (10 sec: 12288.0, 60 sec: 11468.8, 300 sec: 10518.5). Total num frames: 1314816. Throughput: 0: 11439.7. Samples: 1279412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:20:45,769][304334] Avg episode reward: [(0, '4396.075')] [2023-03-08 01:20:45,770][304573] Saving new best policy, reward=4396.075! [2023-03-08 01:20:48,755][304623] Updated weights for policy 0, policy_version 2640 (0.0005) [2023-03-08 01:20:50,769][304334] Fps is (10 sec: 12697.6, 60 sec: 11537.1, 300 sec: 10586.6). Total num frames: 1376256. Throughput: 0: 11615.8. Samples: 1354724. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 01:20:50,769][304334] Avg episode reward: [(0, '4431.471')] [2023-03-08 01:20:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000002688_1376256.pth... [2023-03-08 01:20:50,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000002000_1024000.pth [2023-03-08 01:20:50,775][304573] Saving new best policy, reward=4431.471! [2023-03-08 01:20:52,093][304623] Updated weights for policy 0, policy_version 2720 (0.0005) [2023-03-08 01:20:55,341][304623] Updated weights for policy 0, policy_version 2800 (0.0005) [2023-03-08 01:20:55,769][304334] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 10649.6). Total num frames: 1437696. Throughput: 0: 11808.0. Samples: 1429512. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 01:20:55,769][304334] Avg episode reward: [(0, '4498.609')] [2023-03-08 01:20:55,770][304573] Saving new best policy, reward=4498.609! [2023-03-08 01:20:58,524][304623] Updated weights for policy 0, policy_version 2880 (0.0004) [2023-03-08 01:21:00,769][304334] Fps is (10 sec: 12288.1, 60 sec: 11741.9, 300 sec: 10708.1). Total num frames: 1499136. Throughput: 0: 11875.2. Samples: 1467136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:21:00,769][304334] Avg episode reward: [(0, '4390.215')] [2023-03-08 01:21:01,823][304623] Updated weights for policy 0, policy_version 2960 (0.0005) [2023-03-08 01:21:04,986][304623] Updated weights for policy 0, policy_version 3040 (0.0005) [2023-03-08 01:21:05,769][304334] Fps is (10 sec: 12697.6, 60 sec: 11946.7, 300 sec: 10790.8). Total num frames: 1564672. Throughput: 0: 11996.3. Samples: 1543416. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:21:05,769][304334] Avg episode reward: [(0, '4519.724')] [2023-03-08 01:21:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000003056_1564672.pth... [2023-03-08 01:21:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000002328_1191936.pth [2023-03-08 01:21:05,775][304573] Saving new best policy, reward=4519.724! [2023-03-08 01:21:08,145][304623] Updated weights for policy 0, policy_version 3120 (0.0005) [2023-03-08 01:21:10,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12083.2, 300 sec: 10868.1). Total num frames: 1630208. Throughput: 0: 12176.1. Samples: 1621084. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:21:10,769][304334] Avg episode reward: [(0, '4501.815')] [2023-03-08 01:21:11,289][304623] Updated weights for policy 0, policy_version 3200 (0.0004) [2023-03-08 01:21:14,527][304623] Updated weights for policy 0, policy_version 3280 (0.0005) [2023-03-08 01:21:15,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12083.2, 300 sec: 10913.9). Total num frames: 1691648. Throughput: 0: 12296.4. Samples: 1659696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:21:15,769][304334] Avg episode reward: [(0, '4517.338')] [2023-03-08 01:21:17,739][304623] Updated weights for policy 0, policy_version 3360 (0.0004) [2023-03-08 01:21:20,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 10982.4). Total num frames: 1757184. Throughput: 0: 12516.7. Samples: 1736768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:21:20,769][304334] Avg episode reward: [(0, '4561.398')] [2023-03-08 01:21:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000003432_1757184.pth... [2023-03-08 01:21:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000002688_1376256.pth [2023-03-08 01:21:20,776][304573] Saving new best policy, reward=4561.398! [2023-03-08 01:21:20,876][304623] Updated weights for policy 0, policy_version 3440 (0.0004) [2023-03-08 01:21:24,435][304623] Updated weights for policy 0, policy_version 3520 (0.0005) [2023-03-08 01:21:25,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12219.8, 300 sec: 10997.1). Total num frames: 1814528. Throughput: 0: 12572.8. Samples: 1808412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:21:25,769][304334] Avg episode reward: [(0, '4563.686')] [2023-03-08 01:21:25,837][304573] Saving new best policy, reward=4563.686! [2023-03-08 01:21:27,994][304623] Updated weights for policy 0, policy_version 3600 (0.0005) [2023-03-08 01:21:30,769][304334] Fps is (10 sec: 11468.9, 60 sec: 12288.0, 300 sec: 11011.0). Total num frames: 1871872. Throughput: 0: 12528.8. Samples: 1843208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:21:30,769][304334] Avg episode reward: [(0, '4498.800')] [2023-03-08 01:21:31,574][304623] Updated weights for policy 0, policy_version 3680 (0.0006) [2023-03-08 01:21:35,051][304623] Updated weights for policy 0, policy_version 3760 (0.0006) [2023-03-08 01:21:35,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 11047.5). Total num frames: 1933312. Throughput: 0: 12402.6. Samples: 1912840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:21:35,769][304334] Avg episode reward: [(0, '4572.588')] [2023-03-08 01:21:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000003776_1933312.pth... [2023-03-08 01:21:35,773][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000003056_1564672.pth [2023-03-08 01:21:35,774][304573] Saving new best policy, reward=4572.588! [2023-03-08 01:21:38,520][304623] Updated weights for policy 0, policy_version 3840 (0.0005) [2023-03-08 01:21:40,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 11059.2). Total num frames: 1990656. Throughput: 0: 12289.4. Samples: 1982536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:21:40,769][304334] Avg episode reward: [(0, '4579.079')] [2023-03-08 01:21:40,770][304573] Saving new best policy, reward=4579.079! [2023-03-08 01:21:41,988][304623] Updated weights for policy 0, policy_version 3920 (0.0005) [2023-03-08 01:21:45,424][304623] Updated weights for policy 0, policy_version 4000 (0.0006) [2023-03-08 01:21:45,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12288.0, 300 sec: 11092.4). Total num frames: 2052096. Throughput: 0: 12270.9. Samples: 2019328. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:21:45,769][304334] Avg episode reward: [(0, '4601.316')] [2023-03-08 01:21:45,770][304573] Saving new best policy, reward=4601.316! [2023-03-08 01:21:48,877][304623] Updated weights for policy 0, policy_version 4080 (0.0005) [2023-03-08 01:21:50,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12219.7, 300 sec: 11102.3). Total num frames: 2109440. Throughput: 0: 12146.8. Samples: 2090024. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:21:50,769][304334] Avg episode reward: [(0, '4631.651')] [2023-03-08 01:21:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000004120_2109440.pth... [2023-03-08 01:21:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000003432_1757184.pth [2023-03-08 01:21:50,776][304573] Saving new best policy, reward=4631.651! [2023-03-08 01:21:52,219][304623] Updated weights for policy 0, policy_version 4160 (0.0004) [2023-03-08 01:21:55,659][304623] Updated weights for policy 0, policy_version 4240 (0.0005) [2023-03-08 01:21:55,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12219.8, 300 sec: 11132.7). Total num frames: 2170880. Throughput: 0: 12037.3. Samples: 2162760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:21:55,769][304334] Avg episode reward: [(0, '4637.332')] [2023-03-08 01:21:55,769][304573] Saving new best policy, reward=4637.332! [2023-03-08 01:21:59,097][304623] Updated weights for policy 0, policy_version 4320 (0.0005) [2023-03-08 01:22:00,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12151.5, 300 sec: 11141.1). Total num frames: 2228224. Throughput: 0: 11976.3. Samples: 2198632. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:22:00,769][304334] Avg episode reward: [(0, '4587.227')] [2023-03-08 01:22:02,563][304623] Updated weights for policy 0, policy_version 4400 (0.0005) [2023-03-08 01:22:05,769][304334] Fps is (10 sec: 11878.2, 60 sec: 12083.2, 300 sec: 11169.1). Total num frames: 2289664. Throughput: 0: 11849.7. Samples: 2270004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:22:05,769][304334] Avg episode reward: [(0, '4664.932')] [2023-03-08 01:22:05,782][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000004480_2293760.pth... [2023-03-08 01:22:05,782][304623] Updated weights for policy 0, policy_version 4480 (0.0003) [2023-03-08 01:22:05,784][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000003776_1933312.pth [2023-03-08 01:22:05,784][304573] Saving new best policy, reward=4664.932! [2023-03-08 01:22:08,944][304623] Updated weights for policy 0, policy_version 4560 (0.0003) [2023-03-08 01:22:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12083.2, 300 sec: 11215.2). Total num frames: 2355200. Throughput: 0: 11981.8. Samples: 2347592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:22:10,769][304334] Avg episode reward: [(0, '4650.842')] [2023-03-08 01:22:12,111][304623] Updated weights for policy 0, policy_version 4640 (0.0004) [2023-03-08 01:22:15,285][304623] Updated weights for policy 0, policy_version 4720 (0.0005) [2023-03-08 01:22:15,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12151.5, 300 sec: 11259.2). Total num frames: 2420736. Throughput: 0: 12089.3. Samples: 2387228. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:22:15,769][304334] Avg episode reward: [(0, '4632.339')] [2023-03-08 01:22:18,467][304623] Updated weights for policy 0, policy_version 4800 (0.0005) [2023-03-08 01:22:20,769][304334] Fps is (10 sec: 13107.3, 60 sec: 12151.5, 300 sec: 11301.2). Total num frames: 2486272. Throughput: 0: 12253.9. Samples: 2464264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:22:20,769][304334] Avg episode reward: [(0, '4597.191')] [2023-03-08 01:22:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000004856_2486272.pth... [2023-03-08 01:22:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000004120_2109440.pth [2023-03-08 01:22:21,620][304623] Updated weights for policy 0, policy_version 4880 (0.0005) [2023-03-08 01:22:24,836][304623] Updated weights for policy 0, policy_version 4960 (0.0005) [2023-03-08 01:22:25,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12288.0, 300 sec: 11341.4). Total num frames: 2551808. Throughput: 0: 12417.1. Samples: 2541304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:22:25,769][304334] Avg episode reward: [(0, '4652.802')] [2023-03-08 01:22:27,935][304623] Updated weights for policy 0, policy_version 5040 (0.0004) [2023-03-08 01:22:30,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12356.3, 300 sec: 11361.9). Total num frames: 2613248. Throughput: 0: 12471.8. Samples: 2580560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:22:30,769][304334] Avg episode reward: [(0, '4665.924')] [2023-03-08 01:22:30,777][304573] Saving new best policy, reward=4665.924! [2023-03-08 01:22:31,086][304623] Updated weights for policy 0, policy_version 5120 (0.0004) [2023-03-08 01:22:34,534][304623] Updated weights for policy 0, policy_version 5200 (0.0005) [2023-03-08 01:22:35,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12356.2, 300 sec: 11381.6). Total num frames: 2674688. Throughput: 0: 12575.5. Samples: 2655920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:22:35,769][304334] Avg episode reward: [(0, '4638.490')] [2023-03-08 01:22:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000005224_2674688.pth... [2023-03-08 01:22:35,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000004480_2293760.pth [2023-03-08 01:22:38,048][304623] Updated weights for policy 0, policy_version 5280 (0.0005) [2023-03-08 01:22:40,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 11400.5). Total num frames: 2736128. Throughput: 0: 12549.2. Samples: 2727476. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:22:40,769][304334] Avg episode reward: [(0, '4681.739')] [2023-03-08 01:22:40,770][304573] Saving new best policy, reward=4681.739! [2023-03-08 01:22:41,313][304623] Updated weights for policy 0, policy_version 5360 (0.0005) [2023-03-08 01:22:44,455][304623] Updated weights for policy 0, policy_version 5440 (0.0005) [2023-03-08 01:22:45,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12492.8, 300 sec: 11435.4). Total num frames: 2801664. Throughput: 0: 12589.2. Samples: 2765144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:22:45,769][304334] Avg episode reward: [(0, '4675.752')] [2023-03-08 01:22:47,632][304623] Updated weights for policy 0, policy_version 5520 (0.0005) [2023-03-08 01:22:50,724][304623] Updated weights for policy 0, policy_version 5600 (0.0004) [2023-03-08 01:22:50,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12629.3, 300 sec: 11468.8). Total num frames: 2867200. Throughput: 0: 12753.3. Samples: 2843904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:22:50,769][304334] Avg episode reward: [(0, '4651.380')] [2023-03-08 01:22:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000005600_2867200.pth... [2023-03-08 01:22:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000004856_2486272.pth [2023-03-08 01:22:53,895][304623] Updated weights for policy 0, policy_version 5680 (0.0005) [2023-03-08 01:22:55,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12697.6, 300 sec: 11500.9). Total num frames: 2932736. Throughput: 0: 12770.2. Samples: 2922252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:22:55,769][304334] Avg episode reward: [(0, '4634.759')] [2023-03-08 01:22:57,027][304623] Updated weights for policy 0, policy_version 5760 (0.0005) [2023-03-08 01:23:00,055][304623] Updated weights for policy 0, policy_version 5840 (0.0004) [2023-03-08 01:23:00,769][304334] Fps is (10 sec: 13107.3, 60 sec: 12834.1, 300 sec: 11531.8). Total num frames: 2998272. Throughput: 0: 12763.1. Samples: 2961568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:23:00,769][304334] Avg episode reward: [(0, '4669.066')] [2023-03-08 01:23:03,113][304623] Updated weights for policy 0, policy_version 5920 (0.0004) [2023-03-08 01:23:05,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12902.4, 300 sec: 11561.5). Total num frames: 3063808. Throughput: 0: 12851.1. Samples: 3042564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:23:05,769][304334] Avg episode reward: [(0, '4649.571')] [2023-03-08 01:23:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000005984_3063808.pth... [2023-03-08 01:23:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000005224_2674688.pth [2023-03-08 01:23:06,192][304623] Updated weights for policy 0, policy_version 6000 (0.0005) [2023-03-08 01:23:09,284][304623] Updated weights for policy 0, policy_version 6080 (0.0005) [2023-03-08 01:23:10,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12902.4, 300 sec: 11590.2). Total num frames: 3129344. Throughput: 0: 12889.2. Samples: 3121320. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:23:10,769][304334] Avg episode reward: [(0, '4649.737')] [2023-03-08 01:23:12,348][304623] Updated weights for policy 0, policy_version 6160 (0.0004) [2023-03-08 01:23:15,442][304623] Updated weights for policy 0, policy_version 6240 (0.0004) [2023-03-08 01:23:15,769][304334] Fps is (10 sec: 13516.9, 60 sec: 12970.7, 300 sec: 11632.6). Total num frames: 3198976. Throughput: 0: 12924.8. Samples: 3162176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:23:15,769][304334] Avg episode reward: [(0, '4642.709')] [2023-03-08 01:23:18,551][304623] Updated weights for policy 0, policy_version 6320 (0.0004) [2023-03-08 01:23:20,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12970.6, 300 sec: 11659.0). Total num frames: 3264512. Throughput: 0: 13003.9. Samples: 3241096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:23:20,769][304334] Avg episode reward: [(0, '4644.675')] [2023-03-08 01:23:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000006376_3264512.pth... [2023-03-08 01:23:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000005600_2867200.pth [2023-03-08 01:23:21,591][304623] Updated weights for policy 0, policy_version 6400 (0.0004) [2023-03-08 01:23:24,609][304623] Updated weights for policy 0, policy_version 6480 (0.0004) [2023-03-08 01:23:25,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12970.7, 300 sec: 11684.4). Total num frames: 3330048. Throughput: 0: 13209.9. Samples: 3321920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:23:25,769][304334] Avg episode reward: [(0, '4663.462')] [2023-03-08 01:23:27,757][304623] Updated weights for policy 0, policy_version 6560 (0.0004) [2023-03-08 01:23:30,769][304334] Fps is (10 sec: 13107.3, 60 sec: 13038.9, 300 sec: 11708.9). Total num frames: 3395584. Throughput: 0: 13255.6. Samples: 3361644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:23:30,769][304334] Avg episode reward: [(0, '4641.878')] [2023-03-08 01:23:31,082][304623] Updated weights for policy 0, policy_version 6640 (0.0005) [2023-03-08 01:23:34,281][304623] Updated weights for policy 0, policy_version 6720 (0.0005) [2023-03-08 01:23:35,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13038.9, 300 sec: 11718.7). Total num frames: 3457024. Throughput: 0: 13171.2. Samples: 3436608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:23:35,769][304334] Avg episode reward: [(0, '4688.264')] [2023-03-08 01:23:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000006752_3457024.pth... [2023-03-08 01:23:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000005984_3063808.pth [2023-03-08 01:23:35,775][304573] Saving new best policy, reward=4688.264! [2023-03-08 01:23:37,341][304623] Updated weights for policy 0, policy_version 6800 (0.0005) [2023-03-08 01:23:40,446][304623] Updated weights for policy 0, policy_version 6880 (0.0004) [2023-03-08 01:23:40,769][304334] Fps is (10 sec: 13107.3, 60 sec: 13175.5, 300 sec: 11954.8). Total num frames: 3526656. Throughput: 0: 13193.1. Samples: 3515940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:23:40,769][304334] Avg episode reward: [(0, '4681.666')] [2023-03-08 01:23:43,466][304623] Updated weights for policy 0, policy_version 6960 (0.0004) [2023-03-08 01:23:45,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13175.5, 300 sec: 12149.2). Total num frames: 3592192. Throughput: 0: 13215.6. Samples: 3556268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:23:45,769][304334] Avg episode reward: [(0, '4647.528')] [2023-03-08 01:23:46,514][304623] Updated weights for policy 0, policy_version 7040 (0.0005) [2023-03-08 01:23:49,564][304623] Updated weights for policy 0, policy_version 7120 (0.0004) [2023-03-08 01:23:50,769][304334] Fps is (10 sec: 13107.1, 60 sec: 13175.5, 300 sec: 12163.0). Total num frames: 3657728. Throughput: 0: 13217.3. Samples: 3637344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:23:50,769][304334] Avg episode reward: [(0, '4667.973')] [2023-03-08 01:23:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000007144_3657728.pth... [2023-03-08 01:23:50,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000006376_3264512.pth [2023-03-08 01:23:52,914][304623] Updated weights for policy 0, policy_version 7200 (0.0005) [2023-03-08 01:23:55,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13107.2, 300 sec: 12190.8). Total num frames: 3719168. Throughput: 0: 13105.1. Samples: 3711048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:23:55,769][304334] Avg episode reward: [(0, '4679.122')] [2023-03-08 01:23:56,254][304623] Updated weights for policy 0, policy_version 7280 (0.0005) [2023-03-08 01:23:59,593][304623] Updated weights for policy 0, policy_version 7360 (0.0005) [2023-03-08 01:24:00,769][304334] Fps is (10 sec: 12288.1, 60 sec: 13038.9, 300 sec: 12204.7). Total num frames: 3780608. Throughput: 0: 13016.2. Samples: 3747904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:24:00,769][304334] Avg episode reward: [(0, '4675.812')] [2023-03-08 01:24:02,916][304623] Updated weights for policy 0, policy_version 7440 (0.0005) [2023-03-08 01:24:05,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12970.7, 300 sec: 12232.5). Total num frames: 3842048. Throughput: 0: 12901.9. Samples: 3821680. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:24:05,769][304334] Avg episode reward: [(0, '4685.692')] [2023-03-08 01:24:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000007504_3842048.pth... [2023-03-08 01:24:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000006752_3457024.pth [2023-03-08 01:24:06,259][304623] Updated weights for policy 0, policy_version 7520 (0.0005) [2023-03-08 01:24:09,586][304623] Updated weights for policy 0, policy_version 7600 (0.0005) [2023-03-08 01:24:10,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12902.4, 300 sec: 12260.2). Total num frames: 3903488. Throughput: 0: 12743.3. Samples: 3895368. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:24:10,769][304334] Avg episode reward: [(0, '4654.734')] [2023-03-08 01:24:13,079][304623] Updated weights for policy 0, policy_version 7680 (0.0005) [2023-03-08 01:24:15,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12765.9, 300 sec: 12301.9). Total num frames: 3964928. Throughput: 0: 12669.0. Samples: 3931748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:24:15,769][304334] Avg episode reward: [(0, '4597.318')] [2023-03-08 01:24:16,211][304623] Updated weights for policy 0, policy_version 7760 (0.0003) [2023-03-08 01:24:19,437][304623] Updated weights for policy 0, policy_version 7840 (0.0003) [2023-03-08 01:24:20,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12765.9, 300 sec: 12343.5). Total num frames: 4030464. Throughput: 0: 12709.2. Samples: 4008520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:24:20,769][304334] Avg episode reward: [(0, '4505.014')] [2023-03-08 01:24:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000007872_4030464.pth... [2023-03-08 01:24:20,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000007144_3657728.pth [2023-03-08 01:24:22,663][304623] Updated weights for policy 0, policy_version 7920 (0.0003) [2023-03-08 01:24:25,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12697.6, 300 sec: 12357.4). Total num frames: 4091904. Throughput: 0: 12647.6. Samples: 4085080. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:24:25,769][304334] Avg episode reward: [(0, '4628.173')] [2023-03-08 01:24:25,773][304623] Updated weights for policy 0, policy_version 8000 (0.0003) [2023-03-08 01:24:29,031][304623] Updated weights for policy 0, policy_version 8080 (0.0003) [2023-03-08 01:24:30,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12697.6, 300 sec: 12371.3). Total num frames: 4157440. Throughput: 0: 12622.6. Samples: 4124284. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:24:30,769][304334] Avg episode reward: [(0, '4551.967')] [2023-03-08 01:24:32,147][304623] Updated weights for policy 0, policy_version 8160 (0.0003) [2023-03-08 01:24:35,278][304623] Updated weights for policy 0, policy_version 8240 (0.0004) [2023-03-08 01:24:35,769][304334] Fps is (10 sec: 13107.0, 60 sec: 12765.9, 300 sec: 12385.2). Total num frames: 4222976. Throughput: 0: 12552.7. Samples: 4202216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:24:35,769][304334] Avg episode reward: [(0, '4600.698')] [2023-03-08 01:24:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000008248_4222976.pth... [2023-03-08 01:24:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000007504_3842048.pth [2023-03-08 01:24:38,494][304623] Updated weights for policy 0, policy_version 8320 (0.0005) [2023-03-08 01:24:40,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12697.6, 300 sec: 12413.0). Total num frames: 4288512. Throughput: 0: 12650.7. Samples: 4280328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:24:40,769][304334] Avg episode reward: [(0, '4670.362')] [2023-03-08 01:24:41,539][304623] Updated weights for policy 0, policy_version 8400 (0.0004) [2023-03-08 01:24:44,641][304623] Updated weights for policy 0, policy_version 8480 (0.0003) [2023-03-08 01:24:45,769][304334] Fps is (10 sec: 13107.3, 60 sec: 12697.6, 300 sec: 12440.7). Total num frames: 4354048. Throughput: 0: 12716.5. Samples: 4320148. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:24:45,769][304334] Avg episode reward: [(0, '4643.093')] [2023-03-08 01:24:47,780][304623] Updated weights for policy 0, policy_version 8560 (0.0004) [2023-03-08 01:24:50,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12629.4, 300 sec: 12468.5). Total num frames: 4415488. Throughput: 0: 12797.3. Samples: 4397556. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:24:50,769][304334] Avg episode reward: [(0, '4647.813')] [2023-03-08 01:24:50,786][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000008632_4419584.pth... [2023-03-08 01:24:50,788][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000007872_4030464.pth [2023-03-08 01:24:51,110][304623] Updated weights for policy 0, policy_version 8640 (0.0005) [2023-03-08 01:24:54,444][304623] Updated weights for policy 0, policy_version 8720 (0.0005) [2023-03-08 01:24:55,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 12496.3). Total num frames: 4481024. Throughput: 0: 12810.2. Samples: 4471828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:24:55,769][304334] Avg episode reward: [(0, '4665.748')] [2023-03-08 01:24:57,747][304623] Updated weights for policy 0, policy_version 8800 (0.0005) [2023-03-08 01:25:00,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 12524.0). Total num frames: 4542464. Throughput: 0: 12823.1. Samples: 4508788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:25:00,769][304334] Avg episode reward: [(0, '4703.108')] [2023-03-08 01:25:00,770][304573] Saving new best policy, reward=4703.108! [2023-03-08 01:25:01,063][304623] Updated weights for policy 0, policy_version 8880 (0.0005) [2023-03-08 01:25:04,419][304623] Updated weights for policy 0, policy_version 8960 (0.0005) [2023-03-08 01:25:05,769][304334] Fps is (10 sec: 12287.8, 60 sec: 12697.6, 300 sec: 12537.9). Total num frames: 4603904. Throughput: 0: 12747.8. Samples: 4582172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:25:05,769][304334] Avg episode reward: [(0, '4708.817')] [2023-03-08 01:25:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000008992_4603904.pth... [2023-03-08 01:25:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000008248_4222976.pth [2023-03-08 01:25:05,775][304573] Saving new best policy, reward=4708.817! [2023-03-08 01:25:07,782][304623] Updated weights for policy 0, policy_version 9040 (0.0005) [2023-03-08 01:25:10,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12697.6, 300 sec: 12537.9). Total num frames: 4665344. Throughput: 0: 12690.2. Samples: 4656140. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 01:25:10,769][304334] Avg episode reward: [(0, '4700.651')] [2023-03-08 01:25:11,020][304623] Updated weights for policy 0, policy_version 9120 (0.0004) [2023-03-08 01:25:14,056][304623] Updated weights for policy 0, policy_version 9200 (0.0003) [2023-03-08 01:25:15,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12765.9, 300 sec: 12565.7). Total num frames: 4730880. Throughput: 0: 12684.4. Samples: 4695084. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:25:15,769][304334] Avg episode reward: [(0, '4669.844')] [2023-03-08 01:25:17,075][304623] Updated weights for policy 0, policy_version 9280 (0.0003) [2023-03-08 01:25:20,165][304623] Updated weights for policy 0, policy_version 9360 (0.0003) [2023-03-08 01:25:20,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12834.1, 300 sec: 12607.4). Total num frames: 4800512. Throughput: 0: 12754.5. Samples: 4776168. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:25:20,769][304334] Avg episode reward: [(0, '4673.397')] [2023-03-08 01:25:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000009376_4800512.pth... [2023-03-08 01:25:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000008632_4419584.pth [2023-03-08 01:25:23,199][304623] Updated weights for policy 0, policy_version 9440 (0.0003) [2023-03-08 01:25:25,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12834.1, 300 sec: 12635.1). Total num frames: 4861952. Throughput: 0: 12750.3. Samples: 4854092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:25:25,769][304334] Avg episode reward: [(0, '4660.251')] [2023-03-08 01:25:26,582][304623] Updated weights for policy 0, policy_version 9520 (0.0005) [2023-03-08 01:25:29,933][304623] Updated weights for policy 0, policy_version 9600 (0.0005) [2023-03-08 01:25:30,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12765.9, 300 sec: 12649.0). Total num frames: 4923392. Throughput: 0: 12689.3. Samples: 4891168. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:25:30,769][304334] Avg episode reward: [(0, '4684.162')] [2023-03-08 01:25:33,248][304623] Updated weights for policy 0, policy_version 9680 (0.0005) [2023-03-08 01:25:35,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12697.6, 300 sec: 12662.9). Total num frames: 4984832. Throughput: 0: 12596.9. Samples: 4964416. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:25:35,769][304334] Avg episode reward: [(0, '4688.496')] [2023-03-08 01:25:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000009736_4984832.pth... [2023-03-08 01:25:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000008992_4603904.pth [2023-03-08 01:25:36,718][304623] Updated weights for policy 0, policy_version 9760 (0.0005) [2023-03-08 01:25:40,211][304623] Updated weights for policy 0, policy_version 9840 (0.0005) [2023-03-08 01:25:40,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12561.1, 300 sec: 12635.1). Total num frames: 5042176. Throughput: 0: 12520.3. Samples: 5035244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:25:40,769][304334] Avg episode reward: [(0, '4675.988')] [2023-03-08 01:25:43,585][304623] Updated weights for policy 0, policy_version 9920 (0.0005) [2023-03-08 01:25:45,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12492.8, 300 sec: 12635.1). Total num frames: 5103616. Throughput: 0: 12493.3. Samples: 5070988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:25:45,769][304334] Avg episode reward: [(0, '4700.249')] [2023-03-08 01:25:46,937][304623] Updated weights for policy 0, policy_version 10000 (0.0005) [2023-03-08 01:25:50,244][304623] Updated weights for policy 0, policy_version 10080 (0.0005) [2023-03-08 01:25:50,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12492.8, 300 sec: 12635.1). Total num frames: 5165056. Throughput: 0: 12499.5. Samples: 5144648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:25:50,769][304334] Avg episode reward: [(0, '4681.159')] [2023-03-08 01:25:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000010088_5165056.pth... [2023-03-08 01:25:50,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000009376_4800512.pth [2023-03-08 01:25:53,371][304623] Updated weights for policy 0, policy_version 10160 (0.0004) [2023-03-08 01:25:55,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12492.8, 300 sec: 12649.0). Total num frames: 5230592. Throughput: 0: 12585.1. Samples: 5222472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:25:55,769][304334] Avg episode reward: [(0, '4697.463')] [2023-03-08 01:25:56,533][304623] Updated weights for policy 0, policy_version 10240 (0.0004) [2023-03-08 01:25:59,642][304623] Updated weights for policy 0, policy_version 10320 (0.0003) [2023-03-08 01:26:00,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12561.1, 300 sec: 12649.0). Total num frames: 5296128. Throughput: 0: 12615.7. Samples: 5262792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:26:00,769][304334] Avg episode reward: [(0, '4686.278')] [2023-03-08 01:26:02,756][304623] Updated weights for policy 0, policy_version 10400 (0.0003) [2023-03-08 01:26:05,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12629.3, 300 sec: 12649.0). Total num frames: 5361664. Throughput: 0: 12557.3. Samples: 5341248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:26:05,769][304334] Avg episode reward: [(0, '4700.153')] [2023-03-08 01:26:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000010472_5361664.pth... [2023-03-08 01:26:05,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000009736_4984832.pth [2023-03-08 01:26:05,848][304623] Updated weights for policy 0, policy_version 10480 (0.0003) [2023-03-08 01:26:09,190][304623] Updated weights for policy 0, policy_version 10560 (0.0005) [2023-03-08 01:26:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12649.0). Total num frames: 5423104. Throughput: 0: 12481.1. Samples: 5415740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:26:10,769][304334] Avg episode reward: [(0, '4688.009')] [2023-03-08 01:26:12,574][304623] Updated weights for policy 0, policy_version 10640 (0.0005) [2023-03-08 01:26:15,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12635.1). Total num frames: 5484544. Throughput: 0: 12461.8. Samples: 5451948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:26:15,769][304334] Avg episode reward: [(0, '4667.207')] [2023-03-08 01:26:15,919][304623] Updated weights for policy 0, policy_version 10720 (0.0005) [2023-03-08 01:26:19,278][304623] Updated weights for policy 0, policy_version 10800 (0.0005) [2023-03-08 01:26:20,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12649.0). Total num frames: 5545984. Throughput: 0: 12470.3. Samples: 5525580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:26:20,769][304334] Avg episode reward: [(0, '4673.499')] [2023-03-08 01:26:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000010832_5545984.pth... [2023-03-08 01:26:20,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000010088_5165056.pth [2023-03-08 01:26:22,598][304623] Updated weights for policy 0, policy_version 10880 (0.0005) [2023-03-08 01:26:25,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12662.9). Total num frames: 5607424. Throughput: 0: 12534.7. Samples: 5599304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:26:25,769][304334] Avg episode reward: [(0, '4697.685')] [2023-03-08 01:26:25,943][304623] Updated weights for policy 0, policy_version 10960 (0.0005) [2023-03-08 01:26:29,115][304623] Updated weights for policy 0, policy_version 11040 (0.0004) [2023-03-08 01:26:30,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12676.8). Total num frames: 5672960. Throughput: 0: 12588.4. Samples: 5637468. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:26:30,769][304334] Avg episode reward: [(0, '4682.314')] [2023-03-08 01:26:32,113][304623] Updated weights for policy 0, policy_version 11120 (0.0003) [2023-03-08 01:26:35,427][304623] Updated weights for policy 0, policy_version 11200 (0.0005) [2023-03-08 01:26:35,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12690.7). Total num frames: 5734400. Throughput: 0: 12704.0. Samples: 5716328. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:26:35,769][304334] Avg episode reward: [(0, '4633.380')] [2023-03-08 01:26:35,778][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000011208_5738496.pth... [2023-03-08 01:26:35,781][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000010472_5361664.pth [2023-03-08 01:26:38,804][304623] Updated weights for policy 0, policy_version 11280 (0.0005) [2023-03-08 01:26:40,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12690.7). Total num frames: 5795840. Throughput: 0: 12586.6. Samples: 5788868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:26:40,769][304334] Avg episode reward: [(0, '4420.616')] [2023-03-08 01:26:42,273][304623] Updated weights for policy 0, policy_version 11360 (0.0005) [2023-03-08 01:26:45,731][304623] Updated weights for policy 0, policy_version 11440 (0.0004) [2023-03-08 01:26:45,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12561.1, 300 sec: 12704.5). Total num frames: 5857280. Throughput: 0: 12492.3. Samples: 5824944. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:26:45,769][304334] Avg episode reward: [(0, '4382.161')] [2023-03-08 01:26:49,242][304623] Updated weights for policy 0, policy_version 11520 (0.0005) [2023-03-08 01:26:50,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12492.8, 300 sec: 12690.7). Total num frames: 5914624. Throughput: 0: 12312.8. Samples: 5895324. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:26:50,769][304334] Avg episode reward: [(0, '4589.435')] [2023-03-08 01:26:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000011552_5914624.pth... [2023-03-08 01:26:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000010832_5545984.pth [2023-03-08 01:26:52,722][304623] Updated weights for policy 0, policy_version 11600 (0.0005) [2023-03-08 01:26:55,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 12704.5). Total num frames: 5976064. Throughput: 0: 12240.3. Samples: 5966552. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:26:55,769][304334] Avg episode reward: [(0, '4590.153')] [2023-03-08 01:26:56,101][304623] Updated weights for policy 0, policy_version 11680 (0.0005) [2023-03-08 01:26:59,500][304623] Updated weights for policy 0, policy_version 11760 (0.0005) [2023-03-08 01:27:00,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 12690.7). Total num frames: 6033408. Throughput: 0: 12261.9. Samples: 6003732. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:27:00,769][304334] Avg episode reward: [(0, '4507.667')] [2023-03-08 01:27:02,972][304623] Updated weights for policy 0, policy_version 11840 (0.0005) [2023-03-08 01:27:05,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12219.7, 300 sec: 12676.8). Total num frames: 6094848. Throughput: 0: 12196.7. Samples: 6074432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:27:05,769][304334] Avg episode reward: [(0, '4519.834')] [2023-03-08 01:27:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000011904_6094848.pth... [2023-03-08 01:27:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000011208_5738496.pth [2023-03-08 01:27:06,283][304623] Updated weights for policy 0, policy_version 11920 (0.0005) [2023-03-08 01:27:09,647][304623] Updated weights for policy 0, policy_version 12000 (0.0005) [2023-03-08 01:27:10,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12662.9). Total num frames: 6156288. Throughput: 0: 12196.8. Samples: 6148160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:27:10,769][304334] Avg episode reward: [(0, '4586.574')] [2023-03-08 01:27:12,982][304623] Updated weights for policy 0, policy_version 12080 (0.0005) [2023-03-08 01:27:15,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12151.5, 300 sec: 12635.1). Total num frames: 6213632. Throughput: 0: 12166.7. Samples: 6184968. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:27:15,780][304334] Avg episode reward: [(0, '4554.416')] [2023-03-08 01:27:16,544][304623] Updated weights for policy 0, policy_version 12160 (0.0005) [2023-03-08 01:27:19,590][304623] Updated weights for policy 0, policy_version 12240 (0.0004) [2023-03-08 01:27:20,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12635.1). Total num frames: 6279168. Throughput: 0: 12053.9. Samples: 6258752. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:27:20,780][304334] Avg episode reward: [(0, '4316.294')] [2023-03-08 01:27:20,782][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000012264_6279168.pth... [2023-03-08 01:27:20,783][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000011552_5914624.pth [2023-03-08 01:27:22,805][304623] Updated weights for policy 0, policy_version 12320 (0.0005) [2023-03-08 01:27:25,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12219.8, 300 sec: 12635.1). Total num frames: 6340608. Throughput: 0: 12146.5. Samples: 6335460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:27:25,780][304334] Avg episode reward: [(0, '4538.951')] [2023-03-08 01:27:26,158][304623] Updated weights for policy 0, policy_version 12400 (0.0005) [2023-03-08 01:27:29,330][304623] Updated weights for policy 0, policy_version 12480 (0.0005) [2023-03-08 01:27:30,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12219.8, 300 sec: 12649.0). Total num frames: 6406144. Throughput: 0: 12143.3. Samples: 6371392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:27:30,779][304334] Avg episode reward: [(0, '4646.883')] [2023-03-08 01:27:32,205][304623] Updated weights for policy 0, policy_version 12560 (0.0004) [2023-03-08 01:27:35,105][304623] Updated weights for policy 0, policy_version 12640 (0.0005) [2023-03-08 01:27:35,769][304334] Fps is (10 sec: 13926.3, 60 sec: 12424.5, 300 sec: 12690.7). Total num frames: 6479872. Throughput: 0: 12447.4. Samples: 6455456. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 01:27:35,769][304334] Avg episode reward: [(0, '4681.633')] [2023-03-08 01:27:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000012656_6479872.pth... [2023-03-08 01:27:35,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000011904_6094848.pth [2023-03-08 01:27:38,410][304623] Updated weights for policy 0, policy_version 12720 (0.0005) [2023-03-08 01:27:40,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12424.5, 300 sec: 12676.8). Total num frames: 6541312. Throughput: 0: 12573.6. Samples: 6532364. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 01:27:40,769][304334] Avg episode reward: [(0, '4648.509')] [2023-03-08 01:27:41,596][304623] Updated weights for policy 0, policy_version 12800 (0.0005) [2023-03-08 01:27:45,008][304623] Updated weights for policy 0, policy_version 12880 (0.0005) [2023-03-08 01:27:45,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12424.5, 300 sec: 12662.9). Total num frames: 6602752. Throughput: 0: 12585.0. Samples: 6570056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:27:45,769][304334] Avg episode reward: [(0, '4602.400')] [2023-03-08 01:27:48,063][304623] Updated weights for policy 0, policy_version 12960 (0.0004) [2023-03-08 01:27:50,769][304334] Fps is (10 sec: 13107.0, 60 sec: 12629.3, 300 sec: 12676.8). Total num frames: 6672384. Throughput: 0: 12743.1. Samples: 6647872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:27:50,769][304334] Avg episode reward: [(0, '4562.492')] [2023-03-08 01:27:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000013032_6672384.pth... [2023-03-08 01:27:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000012264_6279168.pth [2023-03-08 01:27:50,994][304623] Updated weights for policy 0, policy_version 13040 (0.0003) [2023-03-08 01:27:53,711][304623] Updated weights for policy 0, policy_version 13120 (0.0004) [2023-03-08 01:27:55,769][304334] Fps is (10 sec: 14336.0, 60 sec: 12834.1, 300 sec: 12704.5). Total num frames: 6746112. Throughput: 0: 13085.3. Samples: 6736996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:27:55,769][304334] Avg episode reward: [(0, '4644.119')] [2023-03-08 01:27:56,456][304623] Updated weights for policy 0, policy_version 13200 (0.0004) [2023-03-08 01:27:59,342][304623] Updated weights for policy 0, policy_version 13280 (0.0004) [2023-03-08 01:28:00,769][304334] Fps is (10 sec: 14336.2, 60 sec: 13038.9, 300 sec: 12718.4). Total num frames: 6815744. Throughput: 0: 13228.0. Samples: 6780228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:28:00,769][304334] Avg episode reward: [(0, '4539.236')] [2023-03-08 01:28:02,260][304623] Updated weights for policy 0, policy_version 13360 (0.0005) [2023-03-08 01:28:05,071][304623] Updated weights for policy 0, policy_version 13440 (0.0004) [2023-03-08 01:28:05,769][304334] Fps is (10 sec: 14335.8, 60 sec: 13243.7, 300 sec: 12746.2). Total num frames: 6889472. Throughput: 0: 13473.6. Samples: 6865064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:28:05,769][304334] Avg episode reward: [(0, '4611.926')] [2023-03-08 01:28:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000013456_6889472.pth... [2023-03-08 01:28:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000012656_6479872.pth [2023-03-08 01:28:07,880][304623] Updated weights for policy 0, policy_version 13520 (0.0004) [2023-03-08 01:28:10,732][304623] Updated weights for policy 0, policy_version 13600 (0.0004) [2023-03-08 01:28:10,769][304334] Fps is (10 sec: 14745.4, 60 sec: 13448.5, 300 sec: 12760.1). Total num frames: 6963200. Throughput: 0: 13700.9. Samples: 6952000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:28:10,769][304334] Avg episode reward: [(0, '4675.291')] [2023-03-08 01:28:13,557][304623] Updated weights for policy 0, policy_version 13680 (0.0005) [2023-03-08 01:28:15,769][304334] Fps is (10 sec: 14336.1, 60 sec: 13653.3, 300 sec: 12774.0). Total num frames: 7032832. Throughput: 0: 13879.6. Samples: 6995976. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 01:28:15,769][304334] Avg episode reward: [(0, '4676.823')] [2023-03-08 01:28:16,414][304623] Updated weights for policy 0, policy_version 13760 (0.0004) [2023-03-08 01:28:19,300][304623] Updated weights for policy 0, policy_version 13840 (0.0004) [2023-03-08 01:28:20,769][304334] Fps is (10 sec: 14336.0, 60 sec: 13789.9, 300 sec: 12801.7). Total num frames: 7106560. Throughput: 0: 13917.9. Samples: 7081760. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 01:28:20,769][304334] Avg episode reward: [(0, '4687.301')] [2023-03-08 01:28:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000013880_7106560.pth... [2023-03-08 01:28:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000013032_6672384.pth [2023-03-08 01:28:22,271][304623] Updated weights for policy 0, policy_version 13920 (0.0004) [2023-03-08 01:28:25,182][304623] Updated weights for policy 0, policy_version 14000 (0.0004) [2023-03-08 01:28:25,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 12801.7). Total num frames: 7172096. Throughput: 0: 14049.6. Samples: 7164596. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:28:25,769][304334] Avg episode reward: [(0, '4689.493')] [2023-03-08 01:28:28,113][304623] Updated weights for policy 0, policy_version 14080 (0.0005) [2023-03-08 01:28:30,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13926.4, 300 sec: 12829.5). Total num frames: 7241728. Throughput: 0: 14159.9. Samples: 7207252. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:28:30,769][304334] Avg episode reward: [(0, '4663.910')] [2023-03-08 01:28:31,068][304623] Updated weights for policy 0, policy_version 14160 (0.0005) [2023-03-08 01:28:34,118][304623] Updated weights for policy 0, policy_version 14240 (0.0005) [2023-03-08 01:28:35,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13858.1, 300 sec: 12829.5). Total num frames: 7311360. Throughput: 0: 14250.0. Samples: 7289124. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 01:28:35,769][304334] Avg episode reward: [(0, '4643.665')] [2023-03-08 01:28:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000014280_7311360.pth... [2023-03-08 01:28:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000013456_6889472.pth [2023-03-08 01:28:37,101][304623] Updated weights for policy 0, policy_version 14320 (0.0004) [2023-03-08 01:28:40,507][304623] Updated weights for policy 0, policy_version 14400 (0.0005) [2023-03-08 01:28:40,769][304334] Fps is (10 sec: 13107.1, 60 sec: 13858.1, 300 sec: 12815.6). Total num frames: 7372800. Throughput: 0: 13998.7. Samples: 7366940. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 01:28:40,780][304334] Avg episode reward: [(0, '4635.904')] [2023-03-08 01:28:43,596][304623] Updated weights for policy 0, policy_version 14480 (0.0004) [2023-03-08 01:28:45,769][304334] Fps is (10 sec: 13107.3, 60 sec: 13994.7, 300 sec: 12829.5). Total num frames: 7442432. Throughput: 0: 13896.6. Samples: 7405576. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:28:45,780][304334] Avg episode reward: [(0, '4698.264')] [2023-03-08 01:28:46,532][304623] Updated weights for policy 0, policy_version 14560 (0.0003) [2023-03-08 01:28:49,601][304623] Updated weights for policy 0, policy_version 14640 (0.0004) [2023-03-08 01:28:50,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13926.4, 300 sec: 12843.4). Total num frames: 7507968. Throughput: 0: 13833.3. Samples: 7487560. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:28:50,780][304334] Avg episode reward: [(0, '4687.287')] [2023-03-08 01:28:50,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000014664_7507968.pth... [2023-03-08 01:28:50,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000013880_7106560.pth [2023-03-08 01:28:52,888][304623] Updated weights for policy 0, policy_version 14720 (0.0005) [2023-03-08 01:28:55,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13789.8, 300 sec: 12857.3). Total num frames: 7573504. Throughput: 0: 13587.7. Samples: 7563448. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:28:55,780][304334] Avg episode reward: [(0, '4681.141')] [2023-03-08 01:28:56,066][304623] Updated weights for policy 0, policy_version 14800 (0.0005) [2023-03-08 01:28:59,104][304623] Updated weights for policy 0, policy_version 14880 (0.0004) [2023-03-08 01:29:00,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13721.6, 300 sec: 12871.2). Total num frames: 7639040. Throughput: 0: 13475.8. Samples: 7602388. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:29:00,780][304334] Avg episode reward: [(0, '4626.252')] [2023-03-08 01:29:02,177][304623] Updated weights for policy 0, policy_version 14960 (0.0004) [2023-03-08 01:29:05,167][304623] Updated weights for policy 0, policy_version 15040 (0.0005) [2023-03-08 01:29:05,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13585.1, 300 sec: 12885.0). Total num frames: 7704576. Throughput: 0: 13386.7. Samples: 7684160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:29:05,780][304334] Avg episode reward: [(0, '4655.361')] [2023-03-08 01:29:05,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000015056_7708672.pth... [2023-03-08 01:29:05,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000014280_7311360.pth [2023-03-08 01:29:08,161][304623] Updated weights for policy 0, policy_version 15120 (0.0004) [2023-03-08 01:29:10,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 12912.8). Total num frames: 7774208. Throughput: 0: 13366.5. Samples: 7766088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:29:10,780][304334] Avg episode reward: [(0, '4689.427')] [2023-03-08 01:29:11,112][304623] Updated weights for policy 0, policy_version 15200 (0.0003) [2023-03-08 01:29:14,152][304623] Updated weights for policy 0, policy_version 15280 (0.0004) [2023-03-08 01:29:15,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13516.8, 300 sec: 12926.7). Total num frames: 7843840. Throughput: 0: 13332.2. Samples: 7807200. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:29:15,780][304334] Avg episode reward: [(0, '4584.465')] [2023-03-08 01:29:17,249][304623] Updated weights for policy 0, policy_version 15360 (0.0004) [2023-03-08 01:29:20,295][304623] Updated weights for policy 0, policy_version 15440 (0.0004) [2023-03-08 01:29:20,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 12940.6). Total num frames: 7909376. Throughput: 0: 13297.0. Samples: 7887488. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:29:20,780][304334] Avg episode reward: [(0, '4434.070')] [2023-03-08 01:29:20,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000015448_7909376.pth... [2023-03-08 01:29:20,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000014664_7507968.pth [2023-03-08 01:29:23,269][304623] Updated weights for policy 0, policy_version 15520 (0.0004) [2023-03-08 01:29:25,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 12954.5). Total num frames: 7979008. Throughput: 0: 13408.5. Samples: 7970320. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:29:25,780][304334] Avg episode reward: [(0, '4634.597')] [2023-03-08 01:29:26,195][304623] Updated weights for policy 0, policy_version 15600 (0.0004) [2023-03-08 01:29:29,186][304623] Updated weights for policy 0, policy_version 15680 (0.0004) [2023-03-08 01:29:30,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13448.5, 300 sec: 12968.4). Total num frames: 8048640. Throughput: 0: 13471.5. Samples: 8011792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:29:30,769][304334] Avg episode reward: [(0, '4682.369')] [2023-03-08 01:29:32,173][304623] Updated weights for policy 0, policy_version 15760 (0.0004) [2023-03-08 01:29:35,145][304623] Updated weights for policy 0, policy_version 15840 (0.0004) [2023-03-08 01:29:35,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13448.5, 300 sec: 12982.2). Total num frames: 8118272. Throughput: 0: 13471.3. Samples: 8093768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:29:35,769][304334] Avg episode reward: [(0, '4682.813')] [2023-03-08 01:29:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000015856_8118272.pth... [2023-03-08 01:29:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000015056_7708672.pth [2023-03-08 01:29:38,363][304623] Updated weights for policy 0, policy_version 15920 (0.0004) [2023-03-08 01:29:40,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13448.6, 300 sec: 12968.4). Total num frames: 8179712. Throughput: 0: 13508.7. Samples: 8171340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:29:40,769][304334] Avg episode reward: [(0, '4646.493')] [2023-03-08 01:29:41,712][304623] Updated weights for policy 0, policy_version 16000 (0.0005) [2023-03-08 01:29:45,005][304623] Updated weights for policy 0, policy_version 16080 (0.0005) [2023-03-08 01:29:45,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13312.0, 300 sec: 12968.3). Total num frames: 8241152. Throughput: 0: 13451.9. Samples: 8207724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:29:45,769][304334] Avg episode reward: [(0, '4660.136')] [2023-03-08 01:29:48,388][304623] Updated weights for policy 0, policy_version 16160 (0.0005) [2023-03-08 01:29:50,769][304334] Fps is (10 sec: 11878.4, 60 sec: 13175.5, 300 sec: 12940.6). Total num frames: 8298496. Throughput: 0: 13265.1. Samples: 8281088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:29:50,769][304334] Avg episode reward: [(0, '4655.224')] [2023-03-08 01:29:50,801][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000016216_8302592.pth... [2023-03-08 01:29:50,803][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000015448_7909376.pth [2023-03-08 01:29:51,858][304623] Updated weights for policy 0, policy_version 16240 (0.0005) [2023-03-08 01:29:55,204][304623] Updated weights for policy 0, policy_version 16320 (0.0005) [2023-03-08 01:29:55,769][304334] Fps is (10 sec: 11878.5, 60 sec: 13107.2, 300 sec: 12940.6). Total num frames: 8359936. Throughput: 0: 13045.3. Samples: 8353124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:29:55,769][304334] Avg episode reward: [(0, '4664.167')] [2023-03-08 01:29:58,559][304623] Updated weights for policy 0, policy_version 16400 (0.0005) [2023-03-08 01:30:00,769][304334] Fps is (10 sec: 12697.5, 60 sec: 13107.2, 300 sec: 12954.5). Total num frames: 8425472. Throughput: 0: 12946.7. Samples: 8389800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:30:00,769][304334] Avg episode reward: [(0, '4661.437')] [2023-03-08 01:30:01,612][304623] Updated weights for policy 0, policy_version 16480 (0.0004) [2023-03-08 01:30:04,654][304623] Updated weights for policy 0, policy_version 16560 (0.0004) [2023-03-08 01:30:05,769][304334] Fps is (10 sec: 13107.1, 60 sec: 13107.2, 300 sec: 12968.3). Total num frames: 8491008. Throughput: 0: 12933.3. Samples: 8469488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:30:05,769][304334] Avg episode reward: [(0, '4657.029')] [2023-03-08 01:30:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000016584_8491008.pth... [2023-03-08 01:30:05,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000015856_8118272.pth [2023-03-08 01:30:08,003][304623] Updated weights for policy 0, policy_version 16640 (0.0005) [2023-03-08 01:30:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12970.7, 300 sec: 12954.5). Total num frames: 8552448. Throughput: 0: 12754.5. Samples: 8544272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:30:10,769][304334] Avg episode reward: [(0, '4683.594')] [2023-03-08 01:30:11,340][304623] Updated weights for policy 0, policy_version 16720 (0.0005) [2023-03-08 01:30:14,484][304623] Updated weights for policy 0, policy_version 16800 (0.0004) [2023-03-08 01:30:15,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12902.4, 300 sec: 12940.6). Total num frames: 8617984. Throughput: 0: 12653.2. Samples: 8581184. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:30:15,769][304334] Avg episode reward: [(0, '4664.411')] [2023-03-08 01:30:17,686][304623] Updated weights for policy 0, policy_version 16880 (0.0005) [2023-03-08 01:30:20,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12834.1, 300 sec: 12940.6). Total num frames: 8679424. Throughput: 0: 12560.9. Samples: 8659008. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:30:20,769][304334] Avg episode reward: [(0, '4685.863')] [2023-03-08 01:30:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000016952_8679424.pth... [2023-03-08 01:30:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000016216_8302592.pth [2023-03-08 01:30:20,954][304623] Updated weights for policy 0, policy_version 16960 (0.0005) [2023-03-08 01:30:24,250][304623] Updated weights for policy 0, policy_version 17040 (0.0005) [2023-03-08 01:30:25,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12697.6, 300 sec: 12940.6). Total num frames: 8740864. Throughput: 0: 12492.4. Samples: 8733496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:30:25,769][304334] Avg episode reward: [(0, '4686.485')] [2023-03-08 01:30:27,583][304623] Updated weights for policy 0, policy_version 17120 (0.0004) [2023-03-08 01:30:30,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12561.1, 300 sec: 12940.6). Total num frames: 8802304. Throughput: 0: 12492.3. Samples: 8769876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:30:30,769][304334] Avg episode reward: [(0, '4574.620')] [2023-03-08 01:30:30,879][304623] Updated weights for policy 0, policy_version 17200 (0.0004) [2023-03-08 01:30:34,198][304623] Updated weights for policy 0, policy_version 17280 (0.0004) [2023-03-08 01:30:35,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12954.5). Total num frames: 8863744. Throughput: 0: 12529.3. Samples: 8844908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:30:35,769][304334] Avg episode reward: [(0, '4655.951')] [2023-03-08 01:30:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000017312_8863744.pth... [2023-03-08 01:30:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000016584_8491008.pth [2023-03-08 01:30:37,858][304623] Updated weights for policy 0, policy_version 17360 (0.0005) [2023-03-08 01:30:40,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12954.5). Total num frames: 8925184. Throughput: 0: 12508.7. Samples: 8916016. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:30:40,769][304334] Avg episode reward: [(0, '4559.881')] [2023-03-08 01:30:41,020][304623] Updated weights for policy 0, policy_version 17440 (0.0003) [2023-03-08 01:30:44,247][304623] Updated weights for policy 0, policy_version 17520 (0.0004) [2023-03-08 01:30:45,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12954.5). Total num frames: 8986624. Throughput: 0: 12550.6. Samples: 8954576. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:30:45,769][304334] Avg episode reward: [(0, '4656.731')] [2023-03-08 01:30:47,690][304623] Updated weights for policy 0, policy_version 17600 (0.0005) [2023-03-08 01:30:50,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 12926.7). Total num frames: 9043968. Throughput: 0: 12397.5. Samples: 9027376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:30:50,769][304334] Avg episode reward: [(0, '4647.423')] [2023-03-08 01:30:50,828][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000017672_9048064.pth... [2023-03-08 01:30:50,831][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000016952_8679424.pth [2023-03-08 01:30:51,162][304623] Updated weights for policy 0, policy_version 17680 (0.0005) [2023-03-08 01:30:54,555][304623] Updated weights for policy 0, policy_version 17760 (0.0005) [2023-03-08 01:30:55,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 12912.8). Total num frames: 9105408. Throughput: 0: 12303.6. Samples: 9097936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:30:55,769][304334] Avg episode reward: [(0, '4672.800')] [2023-03-08 01:30:57,900][304623] Updated weights for policy 0, policy_version 17840 (0.0005) [2023-03-08 01:31:00,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12898.9). Total num frames: 9166848. Throughput: 0: 12301.1. Samples: 9134732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:31:00,769][304334] Avg episode reward: [(0, '4588.015')] [2023-03-08 01:31:01,310][304623] Updated weights for policy 0, policy_version 17920 (0.0005) [2023-03-08 01:31:04,633][304623] Updated weights for policy 0, policy_version 18000 (0.0005) [2023-03-08 01:31:05,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12898.9). Total num frames: 9228288. Throughput: 0: 12189.3. Samples: 9207528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:31:05,769][304334] Avg episode reward: [(0, '4660.538')] [2023-03-08 01:31:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000018024_9228288.pth... [2023-03-08 01:31:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000017312_8863744.pth [2023-03-08 01:31:07,815][304623] Updated weights for policy 0, policy_version 18080 (0.0003) [2023-03-08 01:31:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12356.3, 300 sec: 12912.8). Total num frames: 9293824. Throughput: 0: 12266.8. Samples: 9285504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:31:10,769][304334] Avg episode reward: [(0, '4474.400')] [2023-03-08 01:31:10,960][304623] Updated weights for policy 0, policy_version 18160 (0.0003) [2023-03-08 01:31:14,373][304623] Updated weights for policy 0, policy_version 18240 (0.0005) [2023-03-08 01:31:15,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 12912.8). Total num frames: 9355264. Throughput: 0: 12281.9. Samples: 9322560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:31:15,769][304334] Avg episode reward: [(0, '4584.786')] [2023-03-08 01:31:17,782][304623] Updated weights for policy 0, policy_version 18320 (0.0005) [2023-03-08 01:31:20,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12219.7, 300 sec: 12898.9). Total num frames: 9412608. Throughput: 0: 12210.8. Samples: 9394396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:31:20,769][304334] Avg episode reward: [(0, '4557.372')] [2023-03-08 01:31:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000018384_9412608.pth... [2023-03-08 01:31:20,773][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000017672_9048064.pth [2023-03-08 01:31:21,167][304623] Updated weights for policy 0, policy_version 18400 (0.0005) [2023-03-08 01:31:24,614][304623] Updated weights for policy 0, policy_version 18480 (0.0005) [2023-03-08 01:31:25,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12885.0). Total num frames: 9474048. Throughput: 0: 12220.1. Samples: 9465920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:31:25,769][304334] Avg episode reward: [(0, '4530.025')] [2023-03-08 01:31:27,913][304623] Updated weights for policy 0, policy_version 18560 (0.0005) [2023-03-08 01:31:30,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12219.7, 300 sec: 12885.0). Total num frames: 9535488. Throughput: 0: 12190.4. Samples: 9503144. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 01:31:30,769][304334] Avg episode reward: [(0, '4509.878')] [2023-03-08 01:31:31,274][304623] Updated weights for policy 0, policy_version 18640 (0.0005) [2023-03-08 01:31:34,644][304623] Updated weights for policy 0, policy_version 18720 (0.0005) [2023-03-08 01:31:35,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12219.7, 300 sec: 12885.0). Total num frames: 9596928. Throughput: 0: 12203.0. Samples: 9576512. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 01:31:35,769][304334] Avg episode reward: [(0, '4667.644')] [2023-03-08 01:31:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000018744_9596928.pth... [2023-03-08 01:31:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000018024_9228288.pth [2023-03-08 01:31:37,972][304623] Updated weights for policy 0, policy_version 18800 (0.0005) [2023-03-08 01:31:40,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12219.7, 300 sec: 12885.0). Total num frames: 9658368. Throughput: 0: 12272.3. Samples: 9650188. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 01:31:40,769][304334] Avg episode reward: [(0, '4685.049')] [2023-03-08 01:31:41,348][304623] Updated weights for policy 0, policy_version 18880 (0.0005) [2023-03-08 01:31:44,755][304623] Updated weights for policy 0, policy_version 18960 (0.0005) [2023-03-08 01:31:45,769][304334] Fps is (10 sec: 11878.6, 60 sec: 12151.5, 300 sec: 12885.0). Total num frames: 9715712. Throughput: 0: 12268.4. Samples: 9686808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:31:45,769][304334] Avg episode reward: [(0, '4662.038')] [2023-03-08 01:31:48,208][304623] Updated weights for policy 0, policy_version 19040 (0.0005) [2023-03-08 01:31:50,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12219.7, 300 sec: 12885.0). Total num frames: 9777152. Throughput: 0: 12215.4. Samples: 9757220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:31:50,769][304334] Avg episode reward: [(0, '4672.734')] [2023-03-08 01:31:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000019096_9777152.pth... [2023-03-08 01:31:50,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000018384_9412608.pth [2023-03-08 01:31:51,731][304623] Updated weights for policy 0, policy_version 19120 (0.0005) [2023-03-08 01:31:55,382][304623] Updated weights for policy 0, policy_version 19200 (0.0005) [2023-03-08 01:31:55,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12885.0). Total num frames: 9834496. Throughput: 0: 12017.8. Samples: 9826304. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:31:55,769][304334] Avg episode reward: [(0, '4628.180')] [2023-03-08 01:31:58,879][304623] Updated weights for policy 0, policy_version 19280 (0.0004) [2023-03-08 01:32:00,769][304334] Fps is (10 sec: 11468.7, 60 sec: 12083.2, 300 sec: 12871.2). Total num frames: 9891840. Throughput: 0: 11956.4. Samples: 9860596. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:32:00,769][304334] Avg episode reward: [(0, '4621.543')] [2023-03-08 01:32:02,502][304623] Updated weights for policy 0, policy_version 19360 (0.0005) [2023-03-08 01:32:05,769][304334] Fps is (10 sec: 11468.7, 60 sec: 12014.9, 300 sec: 12857.3). Total num frames: 9949184. Throughput: 0: 11875.1. Samples: 9928776. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:32:05,769][304334] Avg episode reward: [(0, '4639.061')] [2023-03-08 01:32:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000019432_9949184.pth... [2023-03-08 01:32:05,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000018744_9596928.pth [2023-03-08 01:32:06,087][304623] Updated weights for policy 0, policy_version 19440 (0.0005) [2023-03-08 01:32:09,607][304623] Updated weights for policy 0, policy_version 19520 (0.0005) [2023-03-08 01:32:10,769][304334] Fps is (10 sec: 11468.9, 60 sec: 11878.4, 300 sec: 12857.3). Total num frames: 10006528. Throughput: 0: 11833.1. Samples: 9998408. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 01:32:10,769][304334] Avg episode reward: [(0, '4589.936')] [2023-03-08 01:32:13,040][304623] Updated weights for policy 0, policy_version 19600 (0.0005) [2023-03-08 01:32:15,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 12829.5). Total num frames: 10063872. Throughput: 0: 11814.6. Samples: 10034800. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 01:32:15,769][304334] Avg episode reward: [(0, '4642.472')] [2023-03-08 01:32:16,592][304623] Updated weights for policy 0, policy_version 19680 (0.0005) [2023-03-08 01:32:19,980][304623] Updated weights for policy 0, policy_version 19760 (0.0005) [2023-03-08 01:32:20,769][304334] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 12829.5). Total num frames: 10125312. Throughput: 0: 11740.6. Samples: 10104840. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 01:32:20,769][304334] Avg episode reward: [(0, '4676.127')] [2023-03-08 01:32:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000019776_10125312.pth... [2023-03-08 01:32:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000019096_9777152.pth [2023-03-08 01:32:23,489][304623] Updated weights for policy 0, policy_version 19840 (0.0005) [2023-03-08 01:32:25,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 12801.7). Total num frames: 10182656. Throughput: 0: 11692.5. Samples: 10176352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:32:25,769][304334] Avg episode reward: [(0, '4631.927')] [2023-03-08 01:32:26,858][304623] Updated weights for policy 0, policy_version 19920 (0.0005) [2023-03-08 01:32:30,336][304623] Updated weights for policy 0, policy_version 20000 (0.0005) [2023-03-08 01:32:30,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 12760.1). Total num frames: 10244096. Throughput: 0: 11670.6. Samples: 10211984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:32:30,769][304334] Avg episode reward: [(0, '4697.401')] [2023-03-08 01:32:33,750][304623] Updated weights for policy 0, policy_version 20080 (0.0005) [2023-03-08 01:32:35,769][304334] Fps is (10 sec: 11878.3, 60 sec: 11741.9, 300 sec: 12746.2). Total num frames: 10301440. Throughput: 0: 11705.0. Samples: 10283944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:32:35,769][304334] Avg episode reward: [(0, '4684.533')] [2023-03-08 01:32:35,815][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000020128_10305536.pth... [2023-03-08 01:32:35,817][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000019432_9949184.pth [2023-03-08 01:32:37,158][304623] Updated weights for policy 0, policy_version 20160 (0.0005) [2023-03-08 01:32:40,483][304623] Updated weights for policy 0, policy_version 20240 (0.0005) [2023-03-08 01:32:40,769][304334] Fps is (10 sec: 11878.5, 60 sec: 11741.9, 300 sec: 12746.2). Total num frames: 10362880. Throughput: 0: 11779.6. Samples: 10356384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:32:40,769][304334] Avg episode reward: [(0, '4702.107')] [2023-03-08 01:32:43,952][304623] Updated weights for policy 0, policy_version 20320 (0.0005) [2023-03-08 01:32:45,769][304334] Fps is (10 sec: 12288.1, 60 sec: 11810.1, 300 sec: 12718.4). Total num frames: 10424320. Throughput: 0: 11818.9. Samples: 10392444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:32:45,769][304334] Avg episode reward: [(0, '4685.121')] [2023-03-08 01:32:47,339][304623] Updated weights for policy 0, policy_version 20400 (0.0005) [2023-03-08 01:32:50,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 12662.9). Total num frames: 10481664. Throughput: 0: 11914.2. Samples: 10464912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:32:50,769][304334] Avg episode reward: [(0, '4679.242')] [2023-03-08 01:32:50,808][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000020480_10485760.pth... [2023-03-08 01:32:50,808][304623] Updated weights for policy 0, policy_version 20480 (0.0005) [2023-03-08 01:32:50,809][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000019776_10125312.pth [2023-03-08 01:32:54,343][304623] Updated weights for policy 0, policy_version 20560 (0.0005) [2023-03-08 01:32:55,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 12635.1). Total num frames: 10543104. Throughput: 0: 11922.5. Samples: 10534920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:32:55,769][304334] Avg episode reward: [(0, '4671.550')] [2023-03-08 01:32:57,727][304623] Updated weights for policy 0, policy_version 20640 (0.0005) [2023-03-08 01:33:00,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 12579.6). Total num frames: 10600448. Throughput: 0: 11922.7. Samples: 10571320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:33:00,769][304334] Avg episode reward: [(0, '4639.083')] [2023-03-08 01:33:01,198][304623] Updated weights for policy 0, policy_version 20720 (0.0005) [2023-03-08 01:33:04,626][304623] Updated weights for policy 0, policy_version 20800 (0.0005) [2023-03-08 01:33:05,769][304334] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 12537.9). Total num frames: 10661888. Throughput: 0: 11925.2. Samples: 10641472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:33:05,769][304334] Avg episode reward: [(0, '4442.035')] [2023-03-08 01:33:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000020824_10661888.pth... [2023-03-08 01:33:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000020128_10305536.pth [2023-03-08 01:33:07,974][304623] Updated weights for policy 0, policy_version 20880 (0.0005) [2023-03-08 01:33:10,769][304334] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 12510.2). Total num frames: 10723328. Throughput: 0: 11974.6. Samples: 10715208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:33:10,769][304334] Avg episode reward: [(0, '4581.340')] [2023-03-08 01:33:11,324][304623] Updated weights for policy 0, policy_version 20960 (0.0005) [2023-03-08 01:33:14,625][304623] Updated weights for policy 0, policy_version 21040 (0.0005) [2023-03-08 01:33:15,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 12468.5). Total num frames: 10784768. Throughput: 0: 12000.6. Samples: 10752012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:33:15,769][304334] Avg episode reward: [(0, '4647.673')] [2023-03-08 01:33:18,052][304623] Updated weights for policy 0, policy_version 21120 (0.0005) [2023-03-08 01:33:20,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12440.7). Total num frames: 10842112. Throughput: 0: 11998.7. Samples: 10823884. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:33:20,769][304334] Avg episode reward: [(0, '4697.498')] [2023-03-08 01:33:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000021176_10842112.pth... [2023-03-08 01:33:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000020480_10485760.pth [2023-03-08 01:33:21,497][304623] Updated weights for policy 0, policy_version 21200 (0.0005) [2023-03-08 01:33:24,843][304623] Updated weights for policy 0, policy_version 21280 (0.0005) [2023-03-08 01:33:25,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12014.9, 300 sec: 12413.0). Total num frames: 10903552. Throughput: 0: 12008.5. Samples: 10896768. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:33:25,769][304334] Avg episode reward: [(0, '4685.875')] [2023-03-08 01:33:28,194][304623] Updated weights for policy 0, policy_version 21360 (0.0004) [2023-03-08 01:33:30,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 12385.2). Total num frames: 10964992. Throughput: 0: 12030.3. Samples: 10933808. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:33:30,769][304334] Avg episode reward: [(0, '4654.653')] [2023-03-08 01:33:31,604][304623] Updated weights for policy 0, policy_version 21440 (0.0005) [2023-03-08 01:33:35,030][304623] Updated weights for policy 0, policy_version 21520 (0.0005) [2023-03-08 01:33:35,769][304334] Fps is (10 sec: 12287.8, 60 sec: 12083.2, 300 sec: 12385.2). Total num frames: 11026432. Throughput: 0: 12018.0. Samples: 11005724. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:33:35,769][304334] Avg episode reward: [(0, '4711.192')] [2023-03-08 01:33:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000021536_11026432.pth... [2023-03-08 01:33:35,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000020824_10661888.pth [2023-03-08 01:33:35,776][304573] Saving new best policy, reward=4711.192! [2023-03-08 01:33:38,516][304623] Updated weights for policy 0, policy_version 21600 (0.0005) [2023-03-08 01:33:40,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 12343.5). Total num frames: 11083776. Throughput: 0: 12039.4. Samples: 11076692. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:33:40,769][304334] Avg episode reward: [(0, '4571.515')] [2023-03-08 01:33:41,902][304623] Updated weights for policy 0, policy_version 21680 (0.0005) [2023-03-08 01:33:45,240][304623] Updated weights for policy 0, policy_version 21760 (0.0005) [2023-03-08 01:33:45,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12014.9, 300 sec: 12329.7). Total num frames: 11145216. Throughput: 0: 12034.1. Samples: 11112856. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:33:45,769][304334] Avg episode reward: [(0, '4675.943')] [2023-03-08 01:33:48,526][304623] Updated weights for policy 0, policy_version 21840 (0.0005) [2023-03-08 01:33:50,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 12315.8). Total num frames: 11206656. Throughput: 0: 12132.0. Samples: 11187412. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:33:50,769][304334] Avg episode reward: [(0, '4706.564')] [2023-03-08 01:33:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000021888_11206656.pth... [2023-03-08 01:33:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000021176_10842112.pth [2023-03-08 01:33:51,884][304623] Updated weights for policy 0, policy_version 21920 (0.0005) [2023-03-08 01:33:55,178][304623] Updated weights for policy 0, policy_version 22000 (0.0005) [2023-03-08 01:33:55,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 12301.9). Total num frames: 11268096. Throughput: 0: 12136.7. Samples: 11261360. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:33:55,769][304334] Avg episode reward: [(0, '4665.489')] [2023-03-08 01:33:58,484][304623] Updated weights for policy 0, policy_version 22080 (0.0005) [2023-03-08 01:34:00,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 12288.0). Total num frames: 11329536. Throughput: 0: 12163.6. Samples: 11299376. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:34:00,769][304334] Avg episode reward: [(0, '4692.634')] [2023-03-08 01:34:01,850][304623] Updated weights for policy 0, policy_version 22160 (0.0005) [2023-03-08 01:34:05,151][304623] Updated weights for policy 0, policy_version 22240 (0.0005) [2023-03-08 01:34:05,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12151.5, 300 sec: 12260.2). Total num frames: 11390976. Throughput: 0: 12185.1. Samples: 11372212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:34:05,769][304334] Avg episode reward: [(0, '4699.009')] [2023-03-08 01:34:05,805][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000022256_11395072.pth... [2023-03-08 01:34:05,806][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000021536_11026432.pth [2023-03-08 01:34:08,478][304623] Updated weights for policy 0, policy_version 22320 (0.0005) [2023-03-08 01:34:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 12246.3). Total num frames: 11456512. Throughput: 0: 12245.8. Samples: 11447828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:34:10,769][304334] Avg episode reward: [(0, '4704.555')] [2023-03-08 01:34:11,727][304623] Updated weights for policy 0, policy_version 22400 (0.0004) [2023-03-08 01:34:15,194][304623] Updated weights for policy 0, policy_version 22480 (0.0005) [2023-03-08 01:34:15,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 12218.6). Total num frames: 11513856. Throughput: 0: 12225.9. Samples: 11483972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:34:15,769][304334] Avg episode reward: [(0, '4646.252')] [2023-03-08 01:34:18,582][304623] Updated weights for policy 0, policy_version 22560 (0.0005) [2023-03-08 01:34:20,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12190.8). Total num frames: 11575296. Throughput: 0: 12214.8. Samples: 11555388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:34:20,769][304334] Avg episode reward: [(0, '4695.728')] [2023-03-08 01:34:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000022608_11575296.pth... [2023-03-08 01:34:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000021888_11206656.pth [2023-03-08 01:34:21,958][304623] Updated weights for policy 0, policy_version 22640 (0.0005) [2023-03-08 01:34:25,412][304623] Updated weights for policy 0, policy_version 22720 (0.0005) [2023-03-08 01:34:25,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12219.7, 300 sec: 12163.0). Total num frames: 11636736. Throughput: 0: 12248.8. Samples: 11627888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:34:25,769][304334] Avg episode reward: [(0, '4576.108')] [2023-03-08 01:34:28,776][304623] Updated weights for policy 0, policy_version 22800 (0.0005) [2023-03-08 01:34:30,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12151.5, 300 sec: 12121.4). Total num frames: 11694080. Throughput: 0: 12243.8. Samples: 11663828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:34:30,769][304334] Avg episode reward: [(0, '4462.921')] [2023-03-08 01:34:32,148][304623] Updated weights for policy 0, policy_version 22880 (0.0005) [2023-03-08 01:34:35,544][304623] Updated weights for policy 0, policy_version 22960 (0.0005) [2023-03-08 01:34:35,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12121.4). Total num frames: 11755520. Throughput: 0: 12212.0. Samples: 11736952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:34:35,769][304334] Avg episode reward: [(0, '4625.841')] [2023-03-08 01:34:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000022960_11755520.pth... [2023-03-08 01:34:35,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000022256_11395072.pth [2023-03-08 01:34:38,641][304623] Updated weights for policy 0, policy_version 23040 (0.0004) [2023-03-08 01:34:40,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12356.3, 300 sec: 12149.2). Total num frames: 11825152. Throughput: 0: 12298.0. Samples: 11814772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:34:40,769][304334] Avg episode reward: [(0, '4668.769')] [2023-03-08 01:34:41,667][304623] Updated weights for policy 0, policy_version 23120 (0.0004) [2023-03-08 01:34:44,667][304623] Updated weights for policy 0, policy_version 23200 (0.0003) [2023-03-08 01:34:45,769][304334] Fps is (10 sec: 13516.9, 60 sec: 12424.5, 300 sec: 12176.9). Total num frames: 11890688. Throughput: 0: 12342.3. Samples: 11854780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:34:45,769][304334] Avg episode reward: [(0, '4662.521')] [2023-03-08 01:34:47,738][304623] Updated weights for policy 0, policy_version 23280 (0.0004) [2023-03-08 01:34:50,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12492.8, 300 sec: 12190.8). Total num frames: 11956224. Throughput: 0: 12524.4. Samples: 11935808. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:34:50,769][304334] Avg episode reward: [(0, '4635.539')] [2023-03-08 01:34:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000023352_11956224.pth... [2023-03-08 01:34:50,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000022608_11575296.pth [2023-03-08 01:34:50,859][304623] Updated weights for policy 0, policy_version 23360 (0.0004) [2023-03-08 01:34:53,968][304623] Updated weights for policy 0, policy_version 23440 (0.0004) [2023-03-08 01:34:55,769][304334] Fps is (10 sec: 13107.3, 60 sec: 12561.1, 300 sec: 12190.8). Total num frames: 12021760. Throughput: 0: 12588.2. Samples: 12014296. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:34:55,769][304334] Avg episode reward: [(0, '4644.703')] [2023-03-08 01:34:57,093][304623] Updated weights for policy 0, policy_version 23520 (0.0004) [2023-03-08 01:35:00,211][304623] Updated weights for policy 0, policy_version 23600 (0.0004) [2023-03-08 01:35:00,769][304334] Fps is (10 sec: 13107.3, 60 sec: 12629.3, 300 sec: 12190.8). Total num frames: 12087296. Throughput: 0: 12659.7. Samples: 12053660. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:35:00,769][304334] Avg episode reward: [(0, '4682.198')] [2023-03-08 01:35:03,292][304623] Updated weights for policy 0, policy_version 23680 (0.0004) [2023-03-08 01:35:05,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12697.6, 300 sec: 12204.7). Total num frames: 12152832. Throughput: 0: 12841.1. Samples: 12133236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:35:05,769][304334] Avg episode reward: [(0, '4694.650')] [2023-03-08 01:35:05,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000023744_12156928.pth... [2023-03-08 01:35:05,784][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000022960_11755520.pth [2023-03-08 01:35:06,428][304623] Updated weights for policy 0, policy_version 23760 (0.0004) [2023-03-08 01:35:09,827][304623] Updated weights for policy 0, policy_version 23840 (0.0005) [2023-03-08 01:35:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12629.4, 300 sec: 12190.8). Total num frames: 12214272. Throughput: 0: 12886.2. Samples: 12207764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:35:10,769][304334] Avg episode reward: [(0, '4635.671')] [2023-03-08 01:35:13,259][304623] Updated weights for policy 0, policy_version 23920 (0.0005) [2023-03-08 01:35:15,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12697.6, 300 sec: 12190.8). Total num frames: 12275712. Throughput: 0: 12873.7. Samples: 12243144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:35:15,769][304334] Avg episode reward: [(0, '4490.146')] [2023-03-08 01:35:16,640][304623] Updated weights for policy 0, policy_version 24000 (0.0005) [2023-03-08 01:35:19,995][304623] Updated weights for policy 0, policy_version 24080 (0.0005) [2023-03-08 01:35:20,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12697.6, 300 sec: 12190.8). Total num frames: 12337152. Throughput: 0: 12884.1. Samples: 12316736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:35:20,769][304334] Avg episode reward: [(0, '4564.888')] [2023-03-08 01:35:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000024096_12337152.pth... [2023-03-08 01:35:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000023352_11956224.pth [2023-03-08 01:35:23,463][304623] Updated weights for policy 0, policy_version 24160 (0.0005) [2023-03-08 01:35:25,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12697.6, 300 sec: 12190.8). Total num frames: 12398592. Throughput: 0: 12785.0. Samples: 12390096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:35:25,769][304334] Avg episode reward: [(0, '4613.108')] [2023-03-08 01:35:26,577][304623] Updated weights for policy 0, policy_version 24240 (0.0004) [2023-03-08 01:35:29,906][304623] Updated weights for policy 0, policy_version 24320 (0.0005) [2023-03-08 01:35:30,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12765.8, 300 sec: 12190.8). Total num frames: 12460032. Throughput: 0: 12736.4. Samples: 12427916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:35:30,769][304334] Avg episode reward: [(0, '4655.061')] [2023-03-08 01:35:33,323][304623] Updated weights for policy 0, policy_version 24400 (0.0004) [2023-03-08 01:35:35,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12765.9, 300 sec: 12190.8). Total num frames: 12521472. Throughput: 0: 12559.6. Samples: 12500992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:35:35,769][304334] Avg episode reward: [(0, '4687.530')] [2023-03-08 01:35:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000024456_12521472.pth... [2023-03-08 01:35:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000023744_12156928.pth [2023-03-08 01:35:36,844][304623] Updated weights for policy 0, policy_version 24480 (0.0005) [2023-03-08 01:35:40,376][304623] Updated weights for policy 0, policy_version 24560 (0.0005) [2023-03-08 01:35:40,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12561.1, 300 sec: 12176.9). Total num frames: 12578816. Throughput: 0: 12362.8. Samples: 12570624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:35:40,769][304334] Avg episode reward: [(0, '4695.277')] [2023-03-08 01:35:43,658][304623] Updated weights for policy 0, policy_version 24640 (0.0004) [2023-03-08 01:35:45,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12492.8, 300 sec: 12190.8). Total num frames: 12640256. Throughput: 0: 12308.7. Samples: 12607552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:35:45,769][304334] Avg episode reward: [(0, '4690.234')] [2023-03-08 01:35:46,733][304623] Updated weights for policy 0, policy_version 24720 (0.0003) [2023-03-08 01:35:49,790][304623] Updated weights for policy 0, policy_version 24800 (0.0003) [2023-03-08 01:35:50,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12561.1, 300 sec: 12218.6). Total num frames: 12709888. Throughput: 0: 12292.4. Samples: 12686396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:35:50,769][304334] Avg episode reward: [(0, '4700.108')] [2023-03-08 01:35:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000024824_12709888.pth... [2023-03-08 01:35:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000024096_12337152.pth [2023-03-08 01:35:52,911][304623] Updated weights for policy 0, policy_version 24880 (0.0004) [2023-03-08 01:35:55,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12561.1, 300 sec: 12232.5). Total num frames: 12775424. Throughput: 0: 12391.5. Samples: 12765384. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 01:35:55,769][304334] Avg episode reward: [(0, '4689.762')] [2023-03-08 01:35:56,070][304623] Updated weights for policy 0, policy_version 24960 (0.0004) [2023-03-08 01:35:59,164][304623] Updated weights for policy 0, policy_version 25040 (0.0004) [2023-03-08 01:36:00,769][304334] Fps is (10 sec: 13107.3, 60 sec: 12561.1, 300 sec: 12246.3). Total num frames: 12840960. Throughput: 0: 12473.9. Samples: 12804468. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 01:36:00,769][304334] Avg episode reward: [(0, '4700.138')] [2023-03-08 01:36:02,400][304623] Updated weights for policy 0, policy_version 25120 (0.0004) [2023-03-08 01:36:05,759][304623] Updated weights for policy 0, policy_version 25200 (0.0005) [2023-03-08 01:36:05,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12232.5). Total num frames: 12902400. Throughput: 0: 12534.5. Samples: 12880788. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 01:36:05,769][304334] Avg episode reward: [(0, '4703.710')] [2023-03-08 01:36:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000025200_12902400.pth... [2023-03-08 01:36:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000024456_12521472.pth [2023-03-08 01:36:09,051][304623] Updated weights for policy 0, policy_version 25280 (0.0004) [2023-03-08 01:36:10,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12492.8, 300 sec: 12232.5). Total num frames: 12963840. Throughput: 0: 12569.2. Samples: 12955712. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 01:36:10,769][304334] Avg episode reward: [(0, '4580.363')] [2023-03-08 01:36:12,190][304623] Updated weights for policy 0, policy_version 25360 (0.0004) [2023-03-08 01:36:15,394][304623] Updated weights for policy 0, policy_version 25440 (0.0004) [2023-03-08 01:36:15,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12260.2). Total num frames: 13029376. Throughput: 0: 12594.0. Samples: 12994648. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 01:36:15,769][304334] Avg episode reward: [(0, '4695.928')] [2023-03-08 01:36:18,480][304623] Updated weights for policy 0, policy_version 25520 (0.0004) [2023-03-08 01:36:20,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12629.3, 300 sec: 12274.1). Total num frames: 13094912. Throughput: 0: 12708.2. Samples: 13072860. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 01:36:20,769][304334] Avg episode reward: [(0, '4650.629')] [2023-03-08 01:36:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000025576_13094912.pth... [2023-03-08 01:36:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000024824_12709888.pth [2023-03-08 01:36:21,547][304623] Updated weights for policy 0, policy_version 25600 (0.0003) [2023-03-08 01:36:24,691][304623] Updated weights for policy 0, policy_version 25680 (0.0004) [2023-03-08 01:36:25,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12697.6, 300 sec: 12288.0). Total num frames: 13160448. Throughput: 0: 12922.5. Samples: 13152136. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 01:36:25,769][304334] Avg episode reward: [(0, '4576.363')] [2023-03-08 01:36:27,805][304623] Updated weights for policy 0, policy_version 25760 (0.0004) [2023-03-08 01:36:30,769][304334] Fps is (10 sec: 13107.3, 60 sec: 12765.9, 300 sec: 12301.9). Total num frames: 13225984. Throughput: 0: 12974.0. Samples: 13191380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:36:30,769][304334] Avg episode reward: [(0, '4678.608')] [2023-03-08 01:36:30,918][304623] Updated weights for policy 0, policy_version 25840 (0.0003) [2023-03-08 01:36:34,032][304623] Updated weights for policy 0, policy_version 25920 (0.0004) [2023-03-08 01:36:35,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12834.1, 300 sec: 12315.8). Total num frames: 13291520. Throughput: 0: 12976.3. Samples: 13270332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:36:35,769][304334] Avg episode reward: [(0, '4692.167')] [2023-03-08 01:36:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000025960_13291520.pth... [2023-03-08 01:36:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000025200_12902400.pth [2023-03-08 01:36:37,201][304623] Updated weights for policy 0, policy_version 26000 (0.0005) [2023-03-08 01:36:40,255][304623] Updated weights for policy 0, policy_version 26080 (0.0003) [2023-03-08 01:36:40,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12970.6, 300 sec: 12343.5). Total num frames: 13357056. Throughput: 0: 12969.9. Samples: 13349032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:36:40,769][304334] Avg episode reward: [(0, '4661.507')] [2023-03-08 01:36:43,381][304623] Updated weights for policy 0, policy_version 26160 (0.0004) [2023-03-08 01:36:45,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13038.9, 300 sec: 12357.4). Total num frames: 13422592. Throughput: 0: 12978.1. Samples: 13388484. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:36:45,769][304334] Avg episode reward: [(0, '4675.917')] [2023-03-08 01:36:46,521][304623] Updated weights for policy 0, policy_version 26240 (0.0004) [2023-03-08 01:36:49,712][304623] Updated weights for policy 0, policy_version 26320 (0.0004) [2023-03-08 01:36:50,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12970.7, 300 sec: 12385.2). Total num frames: 13488128. Throughput: 0: 13023.2. Samples: 13466832. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:36:50,769][304334] Avg episode reward: [(0, '4668.577')] [2023-03-08 01:36:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000026344_13488128.pth... [2023-03-08 01:36:50,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000025576_13094912.pth [2023-03-08 01:36:52,893][304623] Updated weights for policy 0, policy_version 26400 (0.0004) [2023-03-08 01:36:55,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12902.4, 300 sec: 12399.1). Total num frames: 13549568. Throughput: 0: 13027.3. Samples: 13541940. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:36:55,769][304334] Avg episode reward: [(0, '4707.843')] [2023-03-08 01:36:56,292][304623] Updated weights for policy 0, policy_version 26480 (0.0004) [2023-03-08 01:36:59,479][304623] Updated weights for policy 0, policy_version 26560 (0.0004) [2023-03-08 01:37:00,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12902.4, 300 sec: 12426.9). Total num frames: 13615104. Throughput: 0: 12994.9. Samples: 13579416. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:37:00,769][304334] Avg episode reward: [(0, '4699.143')] [2023-03-08 01:37:02,579][304623] Updated weights for policy 0, policy_version 26640 (0.0003) [2023-03-08 01:37:05,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12902.4, 300 sec: 12440.7). Total num frames: 13676544. Throughput: 0: 13005.8. Samples: 13658120. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:37:05,769][304334] Avg episode reward: [(0, '4690.243')] [2023-03-08 01:37:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000026712_13676544.pth... [2023-03-08 01:37:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000025960_13291520.pth [2023-03-08 01:37:05,853][304623] Updated weights for policy 0, policy_version 26720 (0.0004) [2023-03-08 01:37:08,995][304623] Updated weights for policy 0, policy_version 26800 (0.0003) [2023-03-08 01:37:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12970.7, 300 sec: 12468.5). Total num frames: 13742080. Throughput: 0: 12928.0. Samples: 13733896. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:37:10,769][304334] Avg episode reward: [(0, '4685.430')] [2023-03-08 01:37:12,213][304623] Updated weights for policy 0, policy_version 26880 (0.0004) [2023-03-08 01:37:15,400][304623] Updated weights for policy 0, policy_version 26960 (0.0004) [2023-03-08 01:37:15,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12970.7, 300 sec: 12482.4). Total num frames: 13807616. Throughput: 0: 12899.7. Samples: 13771868. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:37:15,769][304334] Avg episode reward: [(0, '4677.431')] [2023-03-08 01:37:18,605][304623] Updated weights for policy 0, policy_version 27040 (0.0005) [2023-03-08 01:37:20,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12902.4, 300 sec: 12496.3). Total num frames: 13869056. Throughput: 0: 12852.2. Samples: 13848680. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:37:20,769][304334] Avg episode reward: [(0, '4654.797')] [2023-03-08 01:37:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000027088_13869056.pth... [2023-03-08 01:37:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000026344_13488128.pth [2023-03-08 01:37:21,789][304623] Updated weights for policy 0, policy_version 27120 (0.0004) [2023-03-08 01:37:25,061][304623] Updated weights for policy 0, policy_version 27200 (0.0004) [2023-03-08 01:37:25,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12902.4, 300 sec: 12510.2). Total num frames: 13934592. Throughput: 0: 12811.3. Samples: 13925540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:37:25,769][304334] Avg episode reward: [(0, '4494.725')] [2023-03-08 01:37:28,241][304623] Updated weights for policy 0, policy_version 27280 (0.0004) [2023-03-08 01:37:30,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12834.1, 300 sec: 12524.0). Total num frames: 13996032. Throughput: 0: 12780.2. Samples: 13963592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:37:30,769][304334] Avg episode reward: [(0, '4394.425')] [2023-03-08 01:37:31,517][304623] Updated weights for policy 0, policy_version 27360 (0.0004) [2023-03-08 01:37:34,680][304623] Updated weights for policy 0, policy_version 27440 (0.0003) [2023-03-08 01:37:35,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12834.1, 300 sec: 12537.9). Total num frames: 14061568. Throughput: 0: 12733.9. Samples: 14039856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:37:35,769][304334] Avg episode reward: [(0, '4380.823')] [2023-03-08 01:37:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000027464_14061568.pth... [2023-03-08 01:37:35,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000026712_13676544.pth [2023-03-08 01:37:37,883][304623] Updated weights for policy 0, policy_version 27520 (0.0004) [2023-03-08 01:37:40,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12765.9, 300 sec: 12537.9). Total num frames: 14123008. Throughput: 0: 12770.7. Samples: 14116620. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 01:37:40,769][304334] Avg episode reward: [(0, '4575.320')] [2023-03-08 01:37:41,098][304623] Updated weights for policy 0, policy_version 27600 (0.0004) [2023-03-08 01:37:44,285][304623] Updated weights for policy 0, policy_version 27680 (0.0004) [2023-03-08 01:37:45,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12765.9, 300 sec: 12565.7). Total num frames: 14188544. Throughput: 0: 12803.5. Samples: 14155576. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 01:37:45,780][304334] Avg episode reward: [(0, '4595.797')] [2023-03-08 01:37:47,490][304623] Updated weights for policy 0, policy_version 27760 (0.0004) [2023-03-08 01:37:50,745][304623] Updated weights for policy 0, policy_version 27840 (0.0004) [2023-03-08 01:37:50,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12765.9, 300 sec: 12579.6). Total num frames: 14254080. Throughput: 0: 12756.6. Samples: 14232168. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 01:37:50,780][304334] Avg episode reward: [(0, '4670.615')] [2023-03-08 01:37:50,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000027840_14254080.pth... [2023-03-08 01:37:50,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000027088_13869056.pth [2023-03-08 01:37:54,025][304623] Updated weights for policy 0, policy_version 27920 (0.0004) [2023-03-08 01:37:55,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12765.9, 300 sec: 12593.5). Total num frames: 14315520. Throughput: 0: 12742.9. Samples: 14307328. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 01:37:55,780][304334] Avg episode reward: [(0, '4652.055')] [2023-03-08 01:37:57,172][304623] Updated weights for policy 0, policy_version 28000 (0.0004) [2023-03-08 01:38:00,360][304623] Updated weights for policy 0, policy_version 28080 (0.0004) [2023-03-08 01:38:00,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12765.9, 300 sec: 12607.4). Total num frames: 14381056. Throughput: 0: 12774.0. Samples: 14346696. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:38:00,780][304334] Avg episode reward: [(0, '4668.272')] [2023-03-08 01:38:03,555][304623] Updated weights for policy 0, policy_version 28160 (0.0004) [2023-03-08 01:38:05,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12765.9, 300 sec: 12607.3). Total num frames: 14442496. Throughput: 0: 12759.1. Samples: 14422840. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:38:05,780][304334] Avg episode reward: [(0, '4617.211')] [2023-03-08 01:38:05,803][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000028216_14446592.pth... [2023-03-08 01:38:05,804][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000027464_14061568.pth [2023-03-08 01:38:06,726][304623] Updated weights for policy 0, policy_version 28240 (0.0004) [2023-03-08 01:38:09,939][304623] Updated weights for policy 0, policy_version 28320 (0.0004) [2023-03-08 01:38:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12765.9, 300 sec: 12621.2). Total num frames: 14508032. Throughput: 0: 12763.8. Samples: 14499912. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:38:10,780][304334] Avg episode reward: [(0, '4684.213')] [2023-03-08 01:38:13,443][304623] Updated weights for policy 0, policy_version 28400 (0.0004) [2023-03-08 01:38:15,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12629.3, 300 sec: 12621.2). Total num frames: 14565376. Throughput: 0: 12714.7. Samples: 14535756. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:38:15,780][304334] Avg episode reward: [(0, '4656.516')] [2023-03-08 01:38:16,898][304623] Updated weights for policy 0, policy_version 28480 (0.0005) [2023-03-08 01:38:20,412][304623] Updated weights for policy 0, policy_version 28560 (0.0005) [2023-03-08 01:38:20,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12629.3, 300 sec: 12621.2). Total num frames: 14626816. Throughput: 0: 12588.5. Samples: 14606336. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:38:20,780][304334] Avg episode reward: [(0, '4626.214')] [2023-03-08 01:38:20,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000028568_14626816.pth... [2023-03-08 01:38:20,784][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000027840_14254080.pth [2023-03-08 01:38:23,849][304623] Updated weights for policy 0, policy_version 28640 (0.0004) [2023-03-08 01:38:25,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12492.8, 300 sec: 12607.4). Total num frames: 14684160. Throughput: 0: 12455.1. Samples: 14677100. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:38:25,769][304334] Avg episode reward: [(0, '4694.000')] [2023-03-08 01:38:27,232][304623] Updated weights for policy 0, policy_version 28720 (0.0005) [2023-03-08 01:38:30,710][304623] Updated weights for policy 0, policy_version 28800 (0.0004) [2023-03-08 01:38:30,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12492.8, 300 sec: 12607.4). Total num frames: 14745600. Throughput: 0: 12388.8. Samples: 14713072. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:38:30,769][304334] Avg episode reward: [(0, '4676.159')] [2023-03-08 01:38:34,086][304623] Updated weights for policy 0, policy_version 28880 (0.0005) [2023-03-08 01:38:35,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12356.3, 300 sec: 12607.3). Total num frames: 14802944. Throughput: 0: 12293.3. Samples: 14785368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:38:35,769][304334] Avg episode reward: [(0, '4687.547')] [2023-03-08 01:38:35,789][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000028920_14807040.pth... [2023-03-08 01:38:35,791][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000028216_14446592.pth [2023-03-08 01:38:37,591][304623] Updated weights for policy 0, policy_version 28960 (0.0005) [2023-03-08 01:38:40,761][304623] Updated weights for policy 0, policy_version 29040 (0.0004) [2023-03-08 01:38:40,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12621.2). Total num frames: 14868480. Throughput: 0: 12251.5. Samples: 14858644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:38:40,769][304334] Avg episode reward: [(0, '4694.596')] [2023-03-08 01:38:44,014][304623] Updated weights for policy 0, policy_version 29120 (0.0004) [2023-03-08 01:38:45,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12356.3, 300 sec: 12621.2). Total num frames: 14929920. Throughput: 0: 12201.2. Samples: 14895748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:38:45,769][304334] Avg episode reward: [(0, '4697.116')] [2023-03-08 01:38:47,251][304623] Updated weights for policy 0, policy_version 29200 (0.0003) [2023-03-08 01:38:50,525][304623] Updated weights for policy 0, policy_version 29280 (0.0003) [2023-03-08 01:38:50,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 12621.2). Total num frames: 14991360. Throughput: 0: 12203.6. Samples: 14972000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:38:50,769][304334] Avg episode reward: [(0, '4696.611')] [2023-03-08 01:38:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000029280_14991360.pth... [2023-03-08 01:38:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000028568_14626816.pth [2023-03-08 01:38:53,713][304623] Updated weights for policy 0, policy_version 29360 (0.0004) [2023-03-08 01:38:55,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12356.3, 300 sec: 12635.1). Total num frames: 15056896. Throughput: 0: 12182.4. Samples: 15048120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:38:55,769][304334] Avg episode reward: [(0, '4692.368')] [2023-03-08 01:38:57,028][304623] Updated weights for policy 0, policy_version 29440 (0.0005) [2023-03-08 01:39:00,157][304623] Updated weights for policy 0, policy_version 29520 (0.0004) [2023-03-08 01:39:00,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 12635.1). Total num frames: 15118336. Throughput: 0: 12218.2. Samples: 15085576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:39:00,769][304334] Avg episode reward: [(0, '4700.762')] [2023-03-08 01:39:03,396][304623] Updated weights for policy 0, policy_version 29600 (0.0004) [2023-03-08 01:39:05,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12356.3, 300 sec: 12635.1). Total num frames: 15183872. Throughput: 0: 12369.2. Samples: 15162952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:39:05,769][304334] Avg episode reward: [(0, '4690.518')] [2023-03-08 01:39:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000029656_15183872.pth... [2023-03-08 01:39:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000028920_14807040.pth [2023-03-08 01:39:06,611][304623] Updated weights for policy 0, policy_version 29680 (0.0004) [2023-03-08 01:39:09,925][304623] Updated weights for policy 0, policy_version 29760 (0.0005) [2023-03-08 01:39:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 12649.0). Total num frames: 15245312. Throughput: 0: 12450.0. Samples: 15237352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:39:10,769][304334] Avg episode reward: [(0, '4699.601')] [2023-03-08 01:39:13,233][304623] Updated weights for policy 0, policy_version 29840 (0.0005) [2023-03-08 01:39:15,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 12649.0). Total num frames: 15306752. Throughput: 0: 12479.8. Samples: 15274664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:39:15,769][304334] Avg episode reward: [(0, '4687.215')] [2023-03-08 01:39:16,444][304623] Updated weights for policy 0, policy_version 29920 (0.0004) [2023-03-08 01:39:19,620][304623] Updated weights for policy 0, policy_version 30000 (0.0004) [2023-03-08 01:39:20,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12424.5, 300 sec: 12662.9). Total num frames: 15372288. Throughput: 0: 12587.7. Samples: 15351816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:39:20,769][304334] Avg episode reward: [(0, '4681.960')] [2023-03-08 01:39:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000030024_15372288.pth... [2023-03-08 01:39:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000029280_14991360.pth [2023-03-08 01:39:22,879][304623] Updated weights for policy 0, policy_version 30080 (0.0005) [2023-03-08 01:39:25,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12561.1, 300 sec: 12690.7). Total num frames: 15437824. Throughput: 0: 12671.7. Samples: 15428872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:39:25,769][304334] Avg episode reward: [(0, '4646.077')] [2023-03-08 01:39:26,062][304623] Updated weights for policy 0, policy_version 30160 (0.0004) [2023-03-08 01:39:29,496][304623] Updated weights for policy 0, policy_version 30240 (0.0005) [2023-03-08 01:39:30,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12676.8). Total num frames: 15495168. Throughput: 0: 12625.0. Samples: 15463872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:39:30,769][304334] Avg episode reward: [(0, '4599.568')] [2023-03-08 01:39:33,027][304623] Updated weights for policy 0, policy_version 30320 (0.0005) [2023-03-08 01:39:35,769][304334] Fps is (10 sec: 11468.7, 60 sec: 12492.8, 300 sec: 12635.1). Total num frames: 15552512. Throughput: 0: 12515.5. Samples: 15535200. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:39:35,769][304334] Avg episode reward: [(0, '4652.992')] [2023-03-08 01:39:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000030376_15552512.pth... [2023-03-08 01:39:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000029656_15183872.pth [2023-03-08 01:39:36,603][304623] Updated weights for policy 0, policy_version 30400 (0.0005) [2023-03-08 01:39:40,181][304623] Updated weights for policy 0, policy_version 30480 (0.0005) [2023-03-08 01:39:40,769][304334] Fps is (10 sec: 11468.9, 60 sec: 12356.3, 300 sec: 12607.4). Total num frames: 15609856. Throughput: 0: 12337.6. Samples: 15603312. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:39:40,780][304334] Avg episode reward: [(0, '4646.049')] [2023-03-08 01:39:43,659][304623] Updated weights for policy 0, policy_version 30560 (0.0005) [2023-03-08 01:39:45,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12356.3, 300 sec: 12593.5). Total num frames: 15671296. Throughput: 0: 12289.4. Samples: 15638600. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:39:45,780][304334] Avg episode reward: [(0, '4688.758')] [2023-03-08 01:39:47,019][304623] Updated weights for policy 0, policy_version 30640 (0.0004) [2023-03-08 01:39:50,507][304623] Updated weights for policy 0, policy_version 30720 (0.0003) [2023-03-08 01:39:50,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12288.0, 300 sec: 12565.7). Total num frames: 15728640. Throughput: 0: 12173.8. Samples: 15710772. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:39:50,780][304334] Avg episode reward: [(0, '4700.224')] [2023-03-08 01:39:50,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000030720_15728640.pth... [2023-03-08 01:39:50,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000030024_15372288.pth [2023-03-08 01:39:54,043][304623] Updated weights for policy 0, policy_version 30800 (0.0004) [2023-03-08 01:39:55,769][304334] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 12537.9). Total num frames: 15785984. Throughput: 0: 12071.6. Samples: 15780572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:39:55,780][304334] Avg episode reward: [(0, '4685.304')] [2023-03-08 01:39:57,659][304623] Updated weights for policy 0, policy_version 30880 (0.0005) [2023-03-08 01:40:00,769][304334] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 12510.2). Total num frames: 15843328. Throughput: 0: 11999.6. Samples: 15814648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:40:00,780][304334] Avg episode reward: [(0, '4699.896')] [2023-03-08 01:40:01,163][304623] Updated weights for policy 0, policy_version 30960 (0.0003) [2023-03-08 01:40:04,468][304623] Updated weights for policy 0, policy_version 31040 (0.0003) [2023-03-08 01:40:05,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12014.9, 300 sec: 12510.2). Total num frames: 15904768. Throughput: 0: 11888.4. Samples: 15886792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:40:05,780][304334] Avg episode reward: [(0, '4691.472')] [2023-03-08 01:40:05,814][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000031072_15908864.pth... [2023-03-08 01:40:05,816][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000030376_15552512.pth [2023-03-08 01:40:07,808][304623] Updated weights for policy 0, policy_version 31120 (0.0003) [2023-03-08 01:40:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12083.2, 300 sec: 12524.0). Total num frames: 15970304. Throughput: 0: 11811.2. Samples: 15960376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:40:10,769][304334] Avg episode reward: [(0, '4671.727')] [2023-03-08 01:40:11,071][304623] Updated weights for policy 0, policy_version 31200 (0.0004) [2023-03-08 01:40:14,512][304623] Updated weights for policy 0, policy_version 31280 (0.0005) [2023-03-08 01:40:15,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 12510.2). Total num frames: 16027648. Throughput: 0: 11879.6. Samples: 15998456. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 01:40:15,769][304334] Avg episode reward: [(0, '4694.505')] [2023-03-08 01:40:18,147][304623] Updated weights for policy 0, policy_version 31360 (0.0005) [2023-03-08 01:40:20,769][304334] Fps is (10 sec: 11468.7, 60 sec: 11878.4, 300 sec: 12496.3). Total num frames: 16084992. Throughput: 0: 11793.4. Samples: 16065904. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 01:40:20,769][304334] Avg episode reward: [(0, '4694.993')] [2023-03-08 01:40:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000031416_16084992.pth... [2023-03-08 01:40:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000030720_15728640.pth [2023-03-08 01:40:21,753][304623] Updated weights for policy 0, policy_version 31440 (0.0005) [2023-03-08 01:40:25,208][304623] Updated weights for policy 0, policy_version 31520 (0.0005) [2023-03-08 01:40:25,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 12482.4). Total num frames: 16142336. Throughput: 0: 11825.8. Samples: 16135476. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 01:40:25,769][304334] Avg episode reward: [(0, '4691.455')] [2023-03-08 01:40:28,603][304623] Updated weights for policy 0, policy_version 31600 (0.0005) [2023-03-08 01:40:30,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 12482.4). Total num frames: 16203776. Throughput: 0: 11843.6. Samples: 16171564. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 01:40:30,769][304334] Avg episode reward: [(0, '4624.016')] [2023-03-08 01:40:31,780][304623] Updated weights for policy 0, policy_version 31680 (0.0004) [2023-03-08 01:40:35,037][304623] Updated weights for policy 0, policy_version 31760 (0.0004) [2023-03-08 01:40:35,769][304334] Fps is (10 sec: 12287.8, 60 sec: 11878.4, 300 sec: 12496.3). Total num frames: 16265216. Throughput: 0: 11951.6. Samples: 16248596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:40:35,770][304334] Avg episode reward: [(0, '4674.207')] [2023-03-08 01:40:35,800][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000031776_16269312.pth... [2023-03-08 01:40:35,802][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000031072_15908864.pth [2023-03-08 01:40:38,670][304623] Updated weights for policy 0, policy_version 31840 (0.0005) [2023-03-08 01:40:40,769][304334] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 12482.4). Total num frames: 16322560. Throughput: 0: 11922.0. Samples: 16317064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:40:40,770][304334] Avg episode reward: [(0, '4632.311')] [2023-03-08 01:40:42,186][304623] Updated weights for policy 0, policy_version 31920 (0.0005) [2023-03-08 01:40:45,769][304334] Fps is (10 sec: 11469.1, 60 sec: 11810.1, 300 sec: 12440.7). Total num frames: 16379904. Throughput: 0: 11930.7. Samples: 16351528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:40:45,769][304334] Avg episode reward: [(0, '4695.210')] [2023-03-08 01:40:45,779][304623] Updated weights for policy 0, policy_version 32000 (0.0005) [2023-03-08 01:40:49,340][304623] Updated weights for policy 0, policy_version 32080 (0.0005) [2023-03-08 01:40:50,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 12413.0). Total num frames: 16437248. Throughput: 0: 11869.7. Samples: 16420928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:40:50,769][304334] Avg episode reward: [(0, '4681.703')] [2023-03-08 01:40:50,792][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000032112_16441344.pth... [2023-03-08 01:40:50,793][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000031416_16084992.pth [2023-03-08 01:40:52,978][304623] Updated weights for policy 0, policy_version 32160 (0.0005) [2023-03-08 01:40:55,769][304334] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 12385.2). Total num frames: 16494592. Throughput: 0: 11765.7. Samples: 16489832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:40:55,769][304334] Avg episode reward: [(0, '4689.665')] [2023-03-08 01:40:56,544][304623] Updated weights for policy 0, policy_version 32240 (0.0005) [2023-03-08 01:41:00,031][304623] Updated weights for policy 0, policy_version 32320 (0.0005) [2023-03-08 01:41:00,769][304334] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 12371.3). Total num frames: 16551936. Throughput: 0: 11664.0. Samples: 16523336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:41:00,769][304334] Avg episode reward: [(0, '4679.103')] [2023-03-08 01:41:03,600][304623] Updated weights for policy 0, policy_version 32400 (0.0005) [2023-03-08 01:41:05,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 12371.3). Total num frames: 16613376. Throughput: 0: 11712.6. Samples: 16592968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:41:05,769][304334] Avg episode reward: [(0, '4673.549')] [2023-03-08 01:41:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000032448_16613376.pth... [2023-03-08 01:41:05,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000031776_16269312.pth [2023-03-08 01:41:07,138][304623] Updated weights for policy 0, policy_version 32480 (0.0005) [2023-03-08 01:41:10,752][304623] Updated weights for policy 0, policy_version 32560 (0.0005) [2023-03-08 01:41:10,769][304334] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 12343.5). Total num frames: 16670720. Throughput: 0: 11712.5. Samples: 16662536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:41:10,769][304334] Avg episode reward: [(0, '4673.264')] [2023-03-08 01:41:14,408][304623] Updated weights for policy 0, policy_version 32640 (0.0005) [2023-03-08 01:41:15,769][304334] Fps is (10 sec: 11059.1, 60 sec: 11605.3, 300 sec: 12301.9). Total num frames: 16723968. Throughput: 0: 11638.6. Samples: 16695304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:41:15,770][304334] Avg episode reward: [(0, '4674.729')] [2023-03-08 01:41:17,855][304623] Updated weights for policy 0, policy_version 32720 (0.0004) [2023-03-08 01:41:20,769][304334] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 12288.0). Total num frames: 16785408. Throughput: 0: 11496.7. Samples: 16765948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:41:20,769][304334] Avg episode reward: [(0, '4657.632')] [2023-03-08 01:41:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000032784_16785408.pth... [2023-03-08 01:41:20,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000032112_16441344.pth [2023-03-08 01:41:21,344][304623] Updated weights for policy 0, policy_version 32800 (0.0005) [2023-03-08 01:41:24,897][304623] Updated weights for policy 0, policy_version 32880 (0.0005) [2023-03-08 01:41:25,769][304334] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 12260.2). Total num frames: 16842752. Throughput: 0: 11515.5. Samples: 16835260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:41:25,769][304334] Avg episode reward: [(0, '4631.125')] [2023-03-08 01:41:28,428][304623] Updated weights for policy 0, policy_version 32960 (0.0005) [2023-03-08 01:41:30,769][304334] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 12232.5). Total num frames: 16900096. Throughput: 0: 11536.4. Samples: 16870668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:41:30,769][304334] Avg episode reward: [(0, '4539.145')] [2023-03-08 01:41:31,857][304623] Updated weights for policy 0, policy_version 33040 (0.0005) [2023-03-08 01:41:35,380][304623] Updated weights for policy 0, policy_version 33120 (0.0005) [2023-03-08 01:41:35,769][304334] Fps is (10 sec: 11878.3, 60 sec: 11605.4, 300 sec: 12218.6). Total num frames: 16961536. Throughput: 0: 11559.8. Samples: 16941120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:41:35,769][304334] Avg episode reward: [(0, '4628.197')] [2023-03-08 01:41:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000033128_16961536.pth... [2023-03-08 01:41:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000032448_16613376.pth [2023-03-08 01:41:38,919][304623] Updated weights for policy 0, policy_version 33200 (0.0005) [2023-03-08 01:41:40,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11605.4, 300 sec: 12190.8). Total num frames: 17018880. Throughput: 0: 11576.0. Samples: 17010752. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 01:41:40,769][304334] Avg episode reward: [(0, '4696.194')] [2023-03-08 01:41:42,415][304623] Updated weights for policy 0, policy_version 33280 (0.0005) [2023-03-08 01:41:45,769][304334] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 12163.0). Total num frames: 17076224. Throughput: 0: 11623.9. Samples: 17046412. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 01:41:45,769][304334] Avg episode reward: [(0, '4706.565')] [2023-03-08 01:41:45,886][304623] Updated weights for policy 0, policy_version 33360 (0.0005) [2023-03-08 01:41:49,316][304623] Updated weights for policy 0, policy_version 33440 (0.0005) [2023-03-08 01:41:50,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 12163.0). Total num frames: 17137664. Throughput: 0: 11649.6. Samples: 17117200. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 01:41:50,769][304334] Avg episode reward: [(0, '4699.615')] [2023-03-08 01:41:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000033472_17137664.pth... [2023-03-08 01:41:50,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000032784_16785408.pth [2023-03-08 01:41:52,862][304623] Updated weights for policy 0, policy_version 33520 (0.0005) [2023-03-08 01:41:55,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 12135.3). Total num frames: 17195008. Throughput: 0: 11650.9. Samples: 17186828. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 01:41:55,780][304334] Avg episode reward: [(0, '4690.762')] [2023-03-08 01:41:56,415][304623] Updated weights for policy 0, policy_version 33600 (0.0005) [2023-03-08 01:42:00,027][304623] Updated weights for policy 0, policy_version 33680 (0.0005) [2023-03-08 01:42:00,769][304334] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 12121.4). Total num frames: 17252352. Throughput: 0: 11664.2. Samples: 17220192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:42:00,780][304334] Avg episode reward: [(0, '4688.697')] [2023-03-08 01:42:03,651][304623] Updated weights for policy 0, policy_version 33760 (0.0005) [2023-03-08 01:42:05,769][304334] Fps is (10 sec: 11059.1, 60 sec: 11537.1, 300 sec: 12079.7). Total num frames: 17305600. Throughput: 0: 11628.2. Samples: 17289216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:42:05,780][304334] Avg episode reward: [(0, '4682.385')] [2023-03-08 01:42:05,810][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000033808_17309696.pth... [2023-03-08 01:42:05,812][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000033128_16961536.pth [2023-03-08 01:42:07,200][304623] Updated weights for policy 0, policy_version 33840 (0.0005) [2023-03-08 01:42:10,754][304623] Updated weights for policy 0, policy_version 33920 (0.0005) [2023-03-08 01:42:10,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12065.8). Total num frames: 17367040. Throughput: 0: 11623.9. Samples: 17358336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:42:10,780][304334] Avg episode reward: [(0, '4672.336')] [2023-03-08 01:42:14,333][304623] Updated weights for policy 0, policy_version 34000 (0.0005) [2023-03-08 01:42:15,769][304334] Fps is (10 sec: 11468.9, 60 sec: 11605.4, 300 sec: 12038.1). Total num frames: 17420288. Throughput: 0: 11578.1. Samples: 17391680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:42:15,780][304334] Avg episode reward: [(0, '4679.071')] [2023-03-08 01:42:17,960][304623] Updated weights for policy 0, policy_version 34080 (0.0005) [2023-03-08 01:42:20,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11605.4, 300 sec: 12024.2). Total num frames: 17481728. Throughput: 0: 11562.3. Samples: 17461424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:42:20,780][304334] Avg episode reward: [(0, '4665.405')] [2023-03-08 01:42:20,782][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000034144_17481728.pth... [2023-03-08 01:42:20,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000033472_17137664.pth [2023-03-08 01:42:21,400][304623] Updated weights for policy 0, policy_version 34160 (0.0004) [2023-03-08 01:42:24,840][304623] Updated weights for policy 0, policy_version 34240 (0.0005) [2023-03-08 01:42:25,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 12010.3). Total num frames: 17539072. Throughput: 0: 11588.3. Samples: 17532224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:42:25,780][304334] Avg episode reward: [(0, '4651.236')] [2023-03-08 01:42:28,376][304623] Updated weights for policy 0, policy_version 34320 (0.0005) [2023-03-08 01:42:30,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11982.5). Total num frames: 17596416. Throughput: 0: 11585.2. Samples: 17567744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:42:30,780][304334] Avg episode reward: [(0, '4683.054')] [2023-03-08 01:42:31,968][304623] Updated weights for policy 0, policy_version 34400 (0.0005) [2023-03-08 01:42:35,530][304623] Updated weights for policy 0, policy_version 34480 (0.0005) [2023-03-08 01:42:35,769][304334] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11968.6). Total num frames: 17653760. Throughput: 0: 11532.1. Samples: 17636144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:42:35,780][304334] Avg episode reward: [(0, '4676.049')] [2023-03-08 01:42:35,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000034480_17653760.pth... [2023-03-08 01:42:35,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000033808_17309696.pth [2023-03-08 01:42:39,103][304623] Updated weights for policy 0, policy_version 34560 (0.0005) [2023-03-08 01:42:40,769][304334] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11940.9). Total num frames: 17711104. Throughput: 0: 11509.4. Samples: 17704752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:42:40,780][304334] Avg episode reward: [(0, '4692.474')] [2023-03-08 01:42:42,567][304623] Updated weights for policy 0, policy_version 34640 (0.0005) [2023-03-08 01:42:45,769][304334] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11927.0). Total num frames: 17772544. Throughput: 0: 11562.9. Samples: 17740524. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:42:45,780][304334] Avg episode reward: [(0, '4685.608')] [2023-03-08 01:42:45,947][304623] Updated weights for policy 0, policy_version 34720 (0.0005) [2023-03-08 01:42:49,357][304623] Updated weights for policy 0, policy_version 34800 (0.0005) [2023-03-08 01:42:50,769][304334] Fps is (10 sec: 12288.0, 60 sec: 11605.3, 300 sec: 11927.0). Total num frames: 17833984. Throughput: 0: 11650.5. Samples: 17813488. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:42:50,769][304334] Avg episode reward: [(0, '4679.553')] [2023-03-08 01:42:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000034832_17833984.pth... [2023-03-08 01:42:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000034144_17481728.pth [2023-03-08 01:42:52,784][304623] Updated weights for policy 0, policy_version 34880 (0.0005) [2023-03-08 01:42:55,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11899.2). Total num frames: 17891328. Throughput: 0: 11699.3. Samples: 17884804. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:42:55,769][304334] Avg episode reward: [(0, '4673.912')] [2023-03-08 01:42:56,234][304623] Updated weights for policy 0, policy_version 34960 (0.0005) [2023-03-08 01:42:59,667][304623] Updated weights for policy 0, policy_version 35040 (0.0005) [2023-03-08 01:43:00,769][304334] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 11899.2). Total num frames: 17952768. Throughput: 0: 11754.0. Samples: 17920608. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:43:00,769][304334] Avg episode reward: [(0, '4680.627')] [2023-03-08 01:43:03,207][304623] Updated weights for policy 0, policy_version 35120 (0.0005) [2023-03-08 01:43:05,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11871.5). Total num frames: 18010112. Throughput: 0: 11751.6. Samples: 17990248. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:43:05,769][304334] Avg episode reward: [(0, '4683.287')] [2023-03-08 01:43:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000035176_18010112.pth... [2023-03-08 01:43:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000034480_17653760.pth [2023-03-08 01:43:06,663][304623] Updated weights for policy 0, policy_version 35200 (0.0005) [2023-03-08 01:43:10,110][304623] Updated weights for policy 0, policy_version 35280 (0.0005) [2023-03-08 01:43:10,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11871.5). Total num frames: 18067456. Throughput: 0: 11777.3. Samples: 18062200. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:43:10,769][304334] Avg episode reward: [(0, '4682.433')] [2023-03-08 01:43:13,499][304623] Updated weights for policy 0, policy_version 35360 (0.0005) [2023-03-08 01:43:15,769][304334] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11885.3). Total num frames: 18132992. Throughput: 0: 11770.0. Samples: 18097396. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:43:15,769][304334] Avg episode reward: [(0, '4663.900')] [2023-03-08 01:43:16,583][304623] Updated weights for policy 0, policy_version 35440 (0.0004) [2023-03-08 01:43:19,759][304623] Updated weights for policy 0, policy_version 35520 (0.0005) [2023-03-08 01:43:20,769][304334] Fps is (10 sec: 13107.1, 60 sec: 11946.7, 300 sec: 11913.1). Total num frames: 18198528. Throughput: 0: 11997.7. Samples: 18176040. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:43:20,769][304334] Avg episode reward: [(0, '4663.463')] [2023-03-08 01:43:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000035544_18198528.pth... [2023-03-08 01:43:20,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000034832_17833984.pth [2023-03-08 01:43:22,855][304623] Updated weights for policy 0, policy_version 35600 (0.0004) [2023-03-08 01:43:25,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12083.2, 300 sec: 11927.0). Total num frames: 18264064. Throughput: 0: 12227.5. Samples: 18254988. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:43:25,769][304334] Avg episode reward: [(0, '4679.104')] [2023-03-08 01:43:26,016][304623] Updated weights for policy 0, policy_version 35680 (0.0004) [2023-03-08 01:43:29,233][304623] Updated weights for policy 0, policy_version 35760 (0.0005) [2023-03-08 01:43:30,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12151.5, 300 sec: 11940.9). Total num frames: 18325504. Throughput: 0: 12273.0. Samples: 18292808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:43:30,769][304334] Avg episode reward: [(0, '4687.889')] [2023-03-08 01:43:32,467][304623] Updated weights for policy 0, policy_version 35840 (0.0004) [2023-03-08 01:43:35,664][304623] Updated weights for policy 0, policy_version 35920 (0.0004) [2023-03-08 01:43:35,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 11940.9). Total num frames: 18391040. Throughput: 0: 12363.9. Samples: 18369864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:43:35,769][304334] Avg episode reward: [(0, '4673.559')] [2023-03-08 01:43:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000035920_18391040.pth... [2023-03-08 01:43:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000035176_18010112.pth [2023-03-08 01:43:38,893][304623] Updated weights for policy 0, policy_version 36000 (0.0005) [2023-03-08 01:43:40,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12356.3, 300 sec: 11940.9). Total num frames: 18452480. Throughput: 0: 12451.5. Samples: 18445120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:43:40,769][304334] Avg episode reward: [(0, '4682.896')] [2023-03-08 01:43:42,242][304623] Updated weights for policy 0, policy_version 36080 (0.0005) [2023-03-08 01:43:45,515][304623] Updated weights for policy 0, policy_version 36160 (0.0004) [2023-03-08 01:43:45,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 11940.9). Total num frames: 18513920. Throughput: 0: 12469.6. Samples: 18481740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:43:45,769][304334] Avg episode reward: [(0, '4677.013')] [2023-03-08 01:43:48,942][304623] Updated weights for policy 0, policy_version 36240 (0.0004) [2023-03-08 01:43:50,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 11927.0). Total num frames: 18575360. Throughput: 0: 12549.0. Samples: 18554952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:43:50,769][304334] Avg episode reward: [(0, '4669.401')] [2023-03-08 01:43:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000036280_18575360.pth... [2023-03-08 01:43:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000035544_18198528.pth [2023-03-08 01:43:52,320][304623] Updated weights for policy 0, policy_version 36320 (0.0003) [2023-03-08 01:43:55,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12356.3, 300 sec: 11913.1). Total num frames: 18632704. Throughput: 0: 12540.3. Samples: 18626512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:43:55,769][304334] Avg episode reward: [(0, '4683.474')] [2023-03-08 01:43:55,839][304623] Updated weights for policy 0, policy_version 36400 (0.0003) [2023-03-08 01:43:59,217][304623] Updated weights for policy 0, policy_version 36480 (0.0004) [2023-03-08 01:44:00,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 11899.2). Total num frames: 18694144. Throughput: 0: 12539.4. Samples: 18661668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:44:00,769][304334] Avg episode reward: [(0, '4682.262')] [2023-03-08 01:44:02,520][304623] Updated weights for policy 0, policy_version 36560 (0.0003) [2023-03-08 01:44:05,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 11899.2). Total num frames: 18755584. Throughput: 0: 12436.2. Samples: 18735668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:44:05,769][304334] Avg episode reward: [(0, '4691.210')] [2023-03-08 01:44:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000036632_18755584.pth... [2023-03-08 01:44:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000035920_18391040.pth [2023-03-08 01:44:05,960][304623] Updated weights for policy 0, policy_version 36640 (0.0003) [2023-03-08 01:44:09,583][304623] Updated weights for policy 0, policy_version 36720 (0.0005) [2023-03-08 01:44:10,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 11885.3). Total num frames: 18812928. Throughput: 0: 12218.2. Samples: 18804808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:44:10,769][304334] Avg episode reward: [(0, '4686.646')] [2023-03-08 01:44:13,136][304623] Updated weights for policy 0, policy_version 36800 (0.0005) [2023-03-08 01:44:15,769][304334] Fps is (10 sec: 11468.8, 60 sec: 12288.0, 300 sec: 11857.6). Total num frames: 18870272. Throughput: 0: 12156.1. Samples: 18839832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:44:15,769][304334] Avg episode reward: [(0, '4673.735')] [2023-03-08 01:44:16,721][304623] Updated weights for policy 0, policy_version 36880 (0.0005) [2023-03-08 01:44:20,236][304623] Updated weights for policy 0, policy_version 36960 (0.0003) [2023-03-08 01:44:20,769][304334] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 11829.8). Total num frames: 18927616. Throughput: 0: 11998.6. Samples: 18909800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:44:20,769][304334] Avg episode reward: [(0, '4653.181')] [2023-03-08 01:44:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000036968_18927616.pth... [2023-03-08 01:44:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000036280_18575360.pth [2023-03-08 01:44:23,580][304623] Updated weights for policy 0, policy_version 37040 (0.0003) [2023-03-08 01:44:25,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 11843.7). Total num frames: 18989056. Throughput: 0: 11905.6. Samples: 18980872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:44:25,769][304334] Avg episode reward: [(0, '4618.565')] [2023-03-08 01:44:27,121][304623] Updated weights for policy 0, policy_version 37120 (0.0005) [2023-03-08 01:44:30,694][304623] Updated weights for policy 0, policy_version 37200 (0.0005) [2023-03-08 01:44:30,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11843.7). Total num frames: 19046400. Throughput: 0: 11854.5. Samples: 19015192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:44:30,769][304334] Avg episode reward: [(0, '4625.578')] [2023-03-08 01:44:34,164][304623] Updated weights for policy 0, policy_version 37280 (0.0004) [2023-03-08 01:44:35,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11843.7). Total num frames: 19103744. Throughput: 0: 11770.6. Samples: 19084628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:44:35,769][304334] Avg episode reward: [(0, '4562.295')] [2023-03-08 01:44:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000037312_19103744.pth... [2023-03-08 01:44:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000036632_18755584.pth [2023-03-08 01:44:37,784][304623] Updated weights for policy 0, policy_version 37360 (0.0005) [2023-03-08 01:44:40,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11829.8). Total num frames: 19161088. Throughput: 0: 11700.4. Samples: 19153032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:44:40,769][304334] Avg episode reward: [(0, '4660.641')] [2023-03-08 01:44:41,412][304623] Updated weights for policy 0, policy_version 37440 (0.0005) [2023-03-08 01:44:44,971][304623] Updated weights for policy 0, policy_version 37520 (0.0005) [2023-03-08 01:44:45,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11829.8). Total num frames: 19218432. Throughput: 0: 11674.1. Samples: 19187000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:44:45,769][304334] Avg episode reward: [(0, '4680.899')] [2023-03-08 01:44:48,272][304623] Updated weights for policy 0, policy_version 37600 (0.0004) [2023-03-08 01:44:50,769][304334] Fps is (10 sec: 11878.3, 60 sec: 11741.9, 300 sec: 11843.7). Total num frames: 19279872. Throughput: 0: 11639.9. Samples: 19259464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:44:50,769][304334] Avg episode reward: [(0, '4681.393')] [2023-03-08 01:44:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000037656_19279872.pth... [2023-03-08 01:44:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000036968_18927616.pth [2023-03-08 01:44:51,572][304623] Updated weights for policy 0, policy_version 37680 (0.0004) [2023-03-08 01:44:54,835][304623] Updated weights for policy 0, policy_version 37760 (0.0004) [2023-03-08 01:44:55,769][304334] Fps is (10 sec: 12287.9, 60 sec: 11810.1, 300 sec: 11857.6). Total num frames: 19341312. Throughput: 0: 11779.4. Samples: 19334880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:44:55,769][304334] Avg episode reward: [(0, '4681.856')] [2023-03-08 01:44:58,297][304623] Updated weights for policy 0, policy_version 37840 (0.0005) [2023-03-08 01:45:00,769][304334] Fps is (10 sec: 12288.1, 60 sec: 11810.1, 300 sec: 11857.6). Total num frames: 19402752. Throughput: 0: 11782.8. Samples: 19370056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:45:00,769][304334] Avg episode reward: [(0, '4686.454')] [2023-03-08 01:45:01,708][304623] Updated weights for policy 0, policy_version 37920 (0.0004) [2023-03-08 01:45:05,029][304623] Updated weights for policy 0, policy_version 38000 (0.0005) [2023-03-08 01:45:05,769][304334] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 11843.7). Total num frames: 19464192. Throughput: 0: 11861.5. Samples: 19443568. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:45:05,769][304334] Avg episode reward: [(0, '4693.584')] [2023-03-08 01:45:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000038016_19464192.pth... [2023-03-08 01:45:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000037312_19103744.pth [2023-03-08 01:45:08,380][304623] Updated weights for policy 0, policy_version 38080 (0.0005) [2023-03-08 01:45:10,769][304334] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11857.6). Total num frames: 19525632. Throughput: 0: 11920.9. Samples: 19517312. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:45:10,780][304334] Avg episode reward: [(0, '4692.479')] [2023-03-08 01:45:11,691][304623] Updated weights for policy 0, policy_version 38160 (0.0005) [2023-03-08 01:45:15,168][304623] Updated weights for policy 0, policy_version 38240 (0.0005) [2023-03-08 01:45:15,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11857.6). Total num frames: 19582976. Throughput: 0: 11973.3. Samples: 19553992. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:45:15,769][304334] Avg episode reward: [(0, '4693.819')] [2023-03-08 01:45:18,665][304623] Updated weights for policy 0, policy_version 38320 (0.0005) [2023-03-08 01:45:20,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11857.6). Total num frames: 19640320. Throughput: 0: 11984.9. Samples: 19623948. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:45:20,780][304334] Avg episode reward: [(0, '4691.639')] [2023-03-08 01:45:20,816][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000038368_19644416.pth... [2023-03-08 01:45:20,818][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000037656_19279872.pth [2023-03-08 01:45:22,207][304623] Updated weights for policy 0, policy_version 38400 (0.0005) [2023-03-08 01:45:25,716][304623] Updated weights for policy 0, policy_version 38480 (0.0005) [2023-03-08 01:45:25,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11857.6). Total num frames: 19701760. Throughput: 0: 12011.9. Samples: 19693568. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:45:25,780][304334] Avg episode reward: [(0, '4697.312')] [2023-03-08 01:45:29,173][304623] Updated weights for policy 0, policy_version 38560 (0.0005) [2023-03-08 01:45:30,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11843.7). Total num frames: 19759104. Throughput: 0: 12031.8. Samples: 19728432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:45:30,769][304334] Avg episode reward: [(0, '4699.798')] [2023-03-08 01:45:32,728][304623] Updated weights for policy 0, policy_version 38640 (0.0005) [2023-03-08 01:45:35,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11843.7). Total num frames: 19816448. Throughput: 0: 11990.0. Samples: 19799016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:45:35,780][304334] Avg episode reward: [(0, '4644.042')] [2023-03-08 01:45:35,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000038704_19816448.pth... [2023-03-08 01:45:35,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000038016_19464192.pth [2023-03-08 01:45:36,296][304623] Updated weights for policy 0, policy_version 38720 (0.0005) [2023-03-08 01:45:39,831][304623] Updated weights for policy 0, policy_version 38800 (0.0005) [2023-03-08 01:45:40,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11843.7). Total num frames: 19873792. Throughput: 0: 11832.1. Samples: 19867324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:45:40,780][304334] Avg episode reward: [(0, '4690.027')] [2023-03-08 01:45:43,339][304623] Updated weights for policy 0, policy_version 38880 (0.0005) [2023-03-08 01:45:45,769][304334] Fps is (10 sec: 11468.9, 60 sec: 11878.4, 300 sec: 11843.7). Total num frames: 19931136. Throughput: 0: 11831.7. Samples: 19902484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:45:45,769][304334] Avg episode reward: [(0, '4673.750')] [2023-03-08 01:45:46,942][304623] Updated weights for policy 0, policy_version 38960 (0.0005) [2023-03-08 01:45:50,163][304623] Updated weights for policy 0, policy_version 39040 (0.0003) [2023-03-08 01:45:50,769][304334] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 11857.6). Total num frames: 19992576. Throughput: 0: 11760.4. Samples: 19972788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:45:50,769][304334] Avg episode reward: [(0, '4676.520')] [2023-03-08 01:45:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000039048_19992576.pth... [2023-03-08 01:45:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000038368_19644416.pth [2023-03-08 01:45:53,512][304623] Updated weights for policy 0, policy_version 39120 (0.0004) [2023-03-08 01:45:55,769][304334] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11871.5). Total num frames: 20054016. Throughput: 0: 11777.9. Samples: 20047320. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:45:55,769][304334] Avg episode reward: [(0, '4653.482')] [2023-03-08 01:45:56,816][304623] Updated weights for policy 0, policy_version 39200 (0.0004) [2023-03-08 01:46:00,290][304623] Updated weights for policy 0, policy_version 39280 (0.0005) [2023-03-08 01:46:00,769][304334] Fps is (10 sec: 12288.1, 60 sec: 11878.4, 300 sec: 11871.5). Total num frames: 20115456. Throughput: 0: 11786.3. Samples: 20084376. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:46:00,769][304334] Avg episode reward: [(0, '4694.348')] [2023-03-08 01:46:03,703][304623] Updated weights for policy 0, policy_version 39360 (0.0005) [2023-03-08 01:46:05,769][304334] Fps is (10 sec: 12287.7, 60 sec: 11878.4, 300 sec: 11885.3). Total num frames: 20176896. Throughput: 0: 11822.2. Samples: 20155948. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:46:05,770][304334] Avg episode reward: [(0, '4697.187')] [2023-03-08 01:46:05,774][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000039408_20176896.pth... [2023-03-08 01:46:05,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000038704_19816448.pth [2023-03-08 01:46:07,122][304623] Updated weights for policy 0, policy_version 39440 (0.0005) [2023-03-08 01:46:10,494][304623] Updated weights for policy 0, policy_version 39520 (0.0005) [2023-03-08 01:46:10,769][304334] Fps is (10 sec: 11878.5, 60 sec: 11810.1, 300 sec: 11899.2). Total num frames: 20234240. Throughput: 0: 11862.9. Samples: 20227400. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:46:10,780][304334] Avg episode reward: [(0, '4677.684')] [2023-03-08 01:46:13,863][304623] Updated weights for policy 0, policy_version 39600 (0.0004) [2023-03-08 01:46:15,769][304334] Fps is (10 sec: 11878.6, 60 sec: 11878.4, 300 sec: 11899.2). Total num frames: 20295680. Throughput: 0: 11910.9. Samples: 20264424. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:46:15,780][304334] Avg episode reward: [(0, '4691.846')] [2023-03-08 01:46:17,280][304623] Updated weights for policy 0, policy_version 39680 (0.0004) [2023-03-08 01:46:20,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11899.2). Total num frames: 20353024. Throughput: 0: 11947.1. Samples: 20336636. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:46:20,780][304334] Avg episode reward: [(0, '4697.198')] [2023-03-08 01:46:20,788][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000039760_20357120.pth... [2023-03-08 01:46:20,788][304623] Updated weights for policy 0, policy_version 39760 (0.0005) [2023-03-08 01:46:20,790][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000039048_19992576.pth [2023-03-08 01:46:24,332][304623] Updated weights for policy 0, policy_version 39840 (0.0004) [2023-03-08 01:46:25,769][304334] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 11899.2). Total num frames: 20410368. Throughput: 0: 11964.8. Samples: 20405740. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:46:25,780][304334] Avg episode reward: [(0, '4695.417')] [2023-03-08 01:46:28,004][304623] Updated weights for policy 0, policy_version 39920 (0.0005) [2023-03-08 01:46:30,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11885.3). Total num frames: 20467712. Throughput: 0: 11923.6. Samples: 20439048. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:46:30,780][304334] Avg episode reward: [(0, '4681.480')] [2023-03-08 01:46:31,667][304623] Updated weights for policy 0, policy_version 40000 (0.0005) [2023-03-08 01:46:35,391][304623] Updated weights for policy 0, policy_version 40080 (0.0005) [2023-03-08 01:46:35,769][304334] Fps is (10 sec: 11468.6, 60 sec: 11810.1, 300 sec: 11885.3). Total num frames: 20525056. Throughput: 0: 11832.3. Samples: 20505240. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:46:35,780][304334] Avg episode reward: [(0, '4677.335')] [2023-03-08 01:46:35,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000040088_20525056.pth... [2023-03-08 01:46:35,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000039408_20176896.pth [2023-03-08 01:46:38,989][304623] Updated weights for policy 0, policy_version 40160 (0.0005) [2023-03-08 01:46:40,769][304334] Fps is (10 sec: 11059.3, 60 sec: 11741.9, 300 sec: 11871.5). Total num frames: 20578304. Throughput: 0: 11687.2. Samples: 20573244. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:46:40,780][304334] Avg episode reward: [(0, '4691.144')] [2023-03-08 01:46:42,742][304623] Updated weights for policy 0, policy_version 40240 (0.0005) [2023-03-08 01:46:45,769][304334] Fps is (10 sec: 11059.3, 60 sec: 11741.9, 300 sec: 11857.6). Total num frames: 20635648. Throughput: 0: 11584.9. Samples: 20605696. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:46:45,780][304334] Avg episode reward: [(0, '4654.634')] [2023-03-08 01:46:46,514][304623] Updated weights for policy 0, policy_version 40320 (0.0005) [2023-03-08 01:46:50,127][304623] Updated weights for policy 0, policy_version 40400 (0.0005) [2023-03-08 01:46:50,769][304334] Fps is (10 sec: 11059.1, 60 sec: 11605.3, 300 sec: 11843.7). Total num frames: 20688896. Throughput: 0: 11470.3. Samples: 20672108. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:46:50,780][304334] Avg episode reward: [(0, '4677.871')] [2023-03-08 01:46:50,782][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000040408_20688896.pth... [2023-03-08 01:46:50,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000039760_20357120.pth [2023-03-08 01:46:53,884][304623] Updated weights for policy 0, policy_version 40480 (0.0005) [2023-03-08 01:46:55,769][304334] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11843.7). Total num frames: 20746240. Throughput: 0: 11349.1. Samples: 20738112. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:46:55,780][304334] Avg episode reward: [(0, '4691.231')] [2023-03-08 01:46:57,617][304623] Updated weights for policy 0, policy_version 40560 (0.0005) [2023-03-08 01:47:00,769][304334] Fps is (10 sec: 11059.2, 60 sec: 11400.5, 300 sec: 11843.7). Total num frames: 20799488. Throughput: 0: 11253.4. Samples: 20770828. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:47:00,780][304334] Avg episode reward: [(0, '4692.050')] [2023-03-08 01:47:01,375][304623] Updated weights for policy 0, policy_version 40640 (0.0005) [2023-03-08 01:47:05,165][304623] Updated weights for policy 0, policy_version 40720 (0.0005) [2023-03-08 01:47:05,769][304334] Fps is (10 sec: 10649.6, 60 sec: 11264.0, 300 sec: 11815.9). Total num frames: 20852736. Throughput: 0: 11104.8. Samples: 20836352. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:47:05,780][304334] Avg episode reward: [(0, '4685.186')] [2023-03-08 01:47:05,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000040728_20852736.pth... [2023-03-08 01:47:05,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000040088_20525056.pth [2023-03-08 01:47:08,880][304623] Updated weights for policy 0, policy_version 40800 (0.0005) [2023-03-08 01:47:10,769][304334] Fps is (10 sec: 11059.2, 60 sec: 11264.0, 300 sec: 11829.8). Total num frames: 20910080. Throughput: 0: 11027.1. Samples: 20901960. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:47:10,780][304334] Avg episode reward: [(0, '4699.336')] [2023-03-08 01:47:12,412][304623] Updated weights for policy 0, policy_version 40880 (0.0005) [2023-03-08 01:47:15,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 11815.9). Total num frames: 20967424. Throughput: 0: 11063.6. Samples: 20936912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:47:15,769][304334] Avg episode reward: [(0, '4692.013')] [2023-03-08 01:47:16,055][304623] Updated weights for policy 0, policy_version 40960 (0.0005) [2023-03-08 01:47:19,759][304623] Updated weights for policy 0, policy_version 41040 (0.0005) [2023-03-08 01:47:20,769][304334] Fps is (10 sec: 11059.3, 60 sec: 11127.5, 300 sec: 11802.0). Total num frames: 21020672. Throughput: 0: 11090.0. Samples: 21004288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:47:20,769][304334] Avg episode reward: [(0, '4680.407')] [2023-03-08 01:47:20,771][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000041056_21020672.pth... [2023-03-08 01:47:20,773][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000040408_20688896.pth [2023-03-08 01:47:23,272][304623] Updated weights for policy 0, policy_version 41120 (0.0004) [2023-03-08 01:47:25,769][304334] Fps is (10 sec: 11468.9, 60 sec: 11195.7, 300 sec: 11815.9). Total num frames: 21082112. Throughput: 0: 11126.3. Samples: 21073928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:47:25,769][304334] Avg episode reward: [(0, '4602.797')] [2023-03-08 01:47:26,696][304623] Updated weights for policy 0, policy_version 41200 (0.0005) [2023-03-08 01:47:29,996][304623] Updated weights for policy 0, policy_version 41280 (0.0004) [2023-03-08 01:47:30,769][304334] Fps is (10 sec: 12288.0, 60 sec: 11264.0, 300 sec: 11829.8). Total num frames: 21143552. Throughput: 0: 11208.6. Samples: 21110084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:47:30,769][304334] Avg episode reward: [(0, '4697.364')] [2023-03-08 01:47:33,451][304623] Updated weights for policy 0, policy_version 41360 (0.0005) [2023-03-08 01:47:35,769][304334] Fps is (10 sec: 11878.3, 60 sec: 11264.0, 300 sec: 11829.8). Total num frames: 21200896. Throughput: 0: 11355.1. Samples: 21183088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:47:35,769][304334] Avg episode reward: [(0, '4692.385')] [2023-03-08 01:47:35,776][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000041416_21204992.pth... [2023-03-08 01:47:35,778][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000040728_20852736.pth [2023-03-08 01:47:36,756][304623] Updated weights for policy 0, policy_version 41440 (0.0004) [2023-03-08 01:47:40,426][304623] Updated weights for policy 0, policy_version 41520 (0.0005) [2023-03-08 01:47:40,769][304334] Fps is (10 sec: 11468.9, 60 sec: 11332.3, 300 sec: 11815.9). Total num frames: 21258240. Throughput: 0: 11445.6. Samples: 21253164. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:47:40,769][304334] Avg episode reward: [(0, '4655.630')] [2023-03-08 01:47:43,947][304623] Updated weights for policy 0, policy_version 41600 (0.0005) [2023-03-08 01:47:45,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11400.5, 300 sec: 11815.9). Total num frames: 21319680. Throughput: 0: 11470.1. Samples: 21286984. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:47:45,769][304334] Avg episode reward: [(0, '4685.431')] [2023-03-08 01:47:47,282][304623] Updated weights for policy 0, policy_version 41680 (0.0005) [2023-03-08 01:47:50,536][304623] Updated weights for policy 0, policy_version 41760 (0.0004) [2023-03-08 01:47:50,769][304334] Fps is (10 sec: 12287.9, 60 sec: 11537.1, 300 sec: 11829.8). Total num frames: 21381120. Throughput: 0: 11661.3. Samples: 21361112. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:47:50,769][304334] Avg episode reward: [(0, '4679.991')] [2023-03-08 01:47:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000041760_21381120.pth... [2023-03-08 01:47:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000041056_21020672.pth [2023-03-08 01:47:53,888][304623] Updated weights for policy 0, policy_version 41840 (0.0005) [2023-03-08 01:47:55,769][304334] Fps is (10 sec: 12288.1, 60 sec: 11605.3, 300 sec: 11829.8). Total num frames: 21442560. Throughput: 0: 11853.0. Samples: 21435344. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:47:55,769][304334] Avg episode reward: [(0, '4690.485')] [2023-03-08 01:47:57,145][304623] Updated weights for policy 0, policy_version 41920 (0.0004) [2023-03-08 01:48:00,327][304623] Updated weights for policy 0, policy_version 42000 (0.0005) [2023-03-08 01:48:00,769][304334] Fps is (10 sec: 12697.7, 60 sec: 11810.1, 300 sec: 11857.6). Total num frames: 21508096. Throughput: 0: 11934.1. Samples: 21473944. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:48:00,769][304334] Avg episode reward: [(0, '4678.522')] [2023-03-08 01:48:03,779][304623] Updated weights for policy 0, policy_version 42080 (0.0005) [2023-03-08 01:48:05,769][304334] Fps is (10 sec: 12287.9, 60 sec: 11878.4, 300 sec: 11857.6). Total num frames: 21565440. Throughput: 0: 12071.4. Samples: 21547504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:48:05,769][304334] Avg episode reward: [(0, '4675.311')] [2023-03-08 01:48:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000042120_21565440.pth... [2023-03-08 01:48:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000041416_21204992.pth [2023-03-08 01:48:07,356][304623] Updated weights for policy 0, policy_version 42160 (0.0005) [2023-03-08 01:48:10,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11829.8). Total num frames: 21622784. Throughput: 0: 12016.4. Samples: 21614664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:48:10,769][304334] Avg episode reward: [(0, '4595.710')] [2023-03-08 01:48:10,988][304623] Updated weights for policy 0, policy_version 42240 (0.0005) [2023-03-08 01:48:14,606][304623] Updated weights for policy 0, policy_version 42320 (0.0005) [2023-03-08 01:48:15,769][304334] Fps is (10 sec: 11468.9, 60 sec: 11878.4, 300 sec: 11802.0). Total num frames: 21680128. Throughput: 0: 11988.1. Samples: 21649548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:48:15,769][304334] Avg episode reward: [(0, '4644.877')] [2023-03-08 01:48:18,223][304623] Updated weights for policy 0, policy_version 42400 (0.0005) [2023-03-08 01:48:20,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11774.3). Total num frames: 21737472. Throughput: 0: 11866.2. Samples: 21717064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:48:20,769][304334] Avg episode reward: [(0, '4685.302')] [2023-03-08 01:48:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000042456_21737472.pth... [2023-03-08 01:48:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000041760_21381120.pth [2023-03-08 01:48:21,634][304623] Updated weights for policy 0, policy_version 42480 (0.0004) [2023-03-08 01:48:24,894][304623] Updated weights for policy 0, policy_version 42560 (0.0004) [2023-03-08 01:48:25,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11774.3). Total num frames: 21798912. Throughput: 0: 11962.3. Samples: 21791468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:48:25,769][304334] Avg episode reward: [(0, '4679.357')] [2023-03-08 01:48:28,230][304623] Updated weights for policy 0, policy_version 42640 (0.0004) [2023-03-08 01:48:30,769][304334] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11760.4). Total num frames: 21860352. Throughput: 0: 12026.2. Samples: 21828164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:48:30,769][304334] Avg episode reward: [(0, '4676.046')] [2023-03-08 01:48:31,721][304623] Updated weights for policy 0, policy_version 42720 (0.0005) [2023-03-08 01:48:35,095][304623] Updated weights for policy 0, policy_version 42800 (0.0003) [2023-03-08 01:48:35,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12014.9, 300 sec: 11760.4). Total num frames: 21921792. Throughput: 0: 11990.7. Samples: 21900696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:48:35,769][304334] Avg episode reward: [(0, '4673.486')] [2023-03-08 01:48:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000042816_21921792.pth... [2023-03-08 01:48:35,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000042120_21565440.pth [2023-03-08 01:48:38,476][304623] Updated weights for policy 0, policy_version 42880 (0.0003) [2023-03-08 01:48:40,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11746.5). Total num frames: 21979136. Throughput: 0: 11918.8. Samples: 21971692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:48:40,769][304334] Avg episode reward: [(0, '4683.348')] [2023-03-08 01:48:42,099][304623] Updated weights for policy 0, policy_version 42960 (0.0004) [2023-03-08 01:48:45,568][304623] Updated weights for policy 0, policy_version 43040 (0.0004) [2023-03-08 01:48:45,769][304334] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11732.6). Total num frames: 22036480. Throughput: 0: 11834.2. Samples: 22006484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:48:45,769][304334] Avg episode reward: [(0, '4687.817')] [2023-03-08 01:48:49,196][304623] Updated weights for policy 0, policy_version 43120 (0.0005) [2023-03-08 01:48:50,769][304334] Fps is (10 sec: 11468.7, 60 sec: 11878.4, 300 sec: 11732.6). Total num frames: 22093824. Throughput: 0: 11719.6. Samples: 22074888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:48:50,769][304334] Avg episode reward: [(0, '4650.833')] [2023-03-08 01:48:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000043152_22093824.pth... [2023-03-08 01:48:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000042456_21737472.pth [2023-03-08 01:48:52,993][304623] Updated weights for policy 0, policy_version 43200 (0.0005) [2023-03-08 01:48:55,769][304334] Fps is (10 sec: 11059.2, 60 sec: 11741.9, 300 sec: 11704.8). Total num frames: 22147072. Throughput: 0: 11668.2. Samples: 22139732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:48:55,769][304334] Avg episode reward: [(0, '4630.019')] [2023-03-08 01:48:56,723][304623] Updated weights for policy 0, policy_version 43280 (0.0005) [2023-03-08 01:49:00,257][304623] Updated weights for policy 0, policy_version 43360 (0.0003) [2023-03-08 01:49:00,769][304334] Fps is (10 sec: 11059.3, 60 sec: 11605.3, 300 sec: 11691.0). Total num frames: 22204416. Throughput: 0: 11636.5. Samples: 22173192. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:49:00,769][304334] Avg episode reward: [(0, '4675.248')] [2023-03-08 01:49:03,790][304623] Updated weights for policy 0, policy_version 43440 (0.0003) [2023-03-08 01:49:05,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11691.0). Total num frames: 22261760. Throughput: 0: 11697.0. Samples: 22243428. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:49:05,769][304334] Avg episode reward: [(0, '4695.722')] [2023-03-08 01:49:05,779][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000043488_22265856.pth... [2023-03-08 01:49:05,781][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000042816_21921792.pth [2023-03-08 01:49:07,111][304623] Updated weights for policy 0, policy_version 43520 (0.0003) [2023-03-08 01:49:10,713][304623] Updated weights for policy 0, policy_version 43600 (0.0003) [2023-03-08 01:49:10,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11704.8). Total num frames: 22323200. Throughput: 0: 11633.9. Samples: 22314992. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:49:10,769][304334] Avg episode reward: [(0, '4682.781')] [2023-03-08 01:49:14,140][304623] Updated weights for policy 0, policy_version 43680 (0.0003) [2023-03-08 01:49:15,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11704.8). Total num frames: 22380544. Throughput: 0: 11592.6. Samples: 22349832. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:49:15,769][304334] Avg episode reward: [(0, '4680.956')] [2023-03-08 01:49:17,699][304623] Updated weights for policy 0, policy_version 43760 (0.0003) [2023-03-08 01:49:20,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11691.0). Total num frames: 22437888. Throughput: 0: 11537.1. Samples: 22419864. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:49:20,769][304334] Avg episode reward: [(0, '4698.442')] [2023-03-08 01:49:20,777][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000043832_22441984.pth... [2023-03-08 01:49:20,779][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000043152_22093824.pth [2023-03-08 01:49:21,114][304623] Updated weights for policy 0, policy_version 43840 (0.0003) [2023-03-08 01:49:24,400][304623] Updated weights for policy 0, policy_version 43920 (0.0003) [2023-03-08 01:49:25,769][304334] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 11704.8). Total num frames: 22499328. Throughput: 0: 11602.6. Samples: 22493808. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 01:49:25,769][304334] Avg episode reward: [(0, '4688.052')] [2023-03-08 01:49:27,816][304623] Updated weights for policy 0, policy_version 44000 (0.0004) [2023-03-08 01:49:30,769][304334] Fps is (10 sec: 12697.6, 60 sec: 11741.9, 300 sec: 11732.6). Total num frames: 22564864. Throughput: 0: 11634.1. Samples: 22530020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:49:30,769][304334] Avg episode reward: [(0, '4679.350')] [2023-03-08 01:49:31,062][304623] Updated weights for policy 0, policy_version 44080 (0.0003) [2023-03-08 01:49:34,655][304623] Updated weights for policy 0, policy_version 44160 (0.0005) [2023-03-08 01:49:35,769][304334] Fps is (10 sec: 11878.1, 60 sec: 11605.3, 300 sec: 11718.7). Total num frames: 22618112. Throughput: 0: 11710.2. Samples: 22601848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:49:35,770][304334] Avg episode reward: [(0, '4669.359')] [2023-03-08 01:49:35,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000044184_22622208.pth... [2023-03-08 01:49:35,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000043488_22265856.pth [2023-03-08 01:49:38,249][304623] Updated weights for policy 0, policy_version 44240 (0.0005) [2023-03-08 01:49:40,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11732.6). Total num frames: 22679552. Throughput: 0: 11831.6. Samples: 22672156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:49:40,769][304334] Avg episode reward: [(0, '4682.068')] [2023-03-08 01:49:41,539][304623] Updated weights for policy 0, policy_version 44320 (0.0004) [2023-03-08 01:49:44,685][304623] Updated weights for policy 0, policy_version 44400 (0.0004) [2023-03-08 01:49:45,769][304334] Fps is (10 sec: 12697.8, 60 sec: 11810.1, 300 sec: 11746.5). Total num frames: 22745088. Throughput: 0: 11946.0. Samples: 22710760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:49:45,769][304334] Avg episode reward: [(0, '4632.350')] [2023-03-08 01:49:47,866][304623] Updated weights for policy 0, policy_version 44480 (0.0004) [2023-03-08 01:49:50,769][304334] Fps is (10 sec: 13107.0, 60 sec: 11946.7, 300 sec: 11760.4). Total num frames: 22810624. Throughput: 0: 12096.7. Samples: 22787780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:49:50,769][304334] Avg episode reward: [(0, '4595.984')] [2023-03-08 01:49:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000044552_22810624.pth... [2023-03-08 01:49:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000043832_22441984.pth [2023-03-08 01:49:51,056][304623] Updated weights for policy 0, policy_version 44560 (0.0005) [2023-03-08 01:49:54,247][304623] Updated weights for policy 0, policy_version 44640 (0.0004) [2023-03-08 01:49:55,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12083.2, 300 sec: 11760.4). Total num frames: 22872064. Throughput: 0: 12227.2. Samples: 22865216. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:49:55,769][304334] Avg episode reward: [(0, '4665.352')] [2023-03-08 01:49:57,394][304623] Updated weights for policy 0, policy_version 44720 (0.0004) [2023-03-08 01:50:00,638][304623] Updated weights for policy 0, policy_version 44800 (0.0005) [2023-03-08 01:50:00,769][304334] Fps is (10 sec: 12697.8, 60 sec: 12219.7, 300 sec: 11774.3). Total num frames: 22937600. Throughput: 0: 12318.7. Samples: 22904172. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:50:00,769][304334] Avg episode reward: [(0, '4693.348')] [2023-03-08 01:50:04,106][304623] Updated weights for policy 0, policy_version 44880 (0.0005) [2023-03-08 01:50:05,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 11760.4). Total num frames: 22994944. Throughput: 0: 12390.5. Samples: 22977436. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:50:05,769][304334] Avg episode reward: [(0, '4702.749')] [2023-03-08 01:50:05,771][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000044912_22994944.pth... [2023-03-08 01:50:05,773][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000044184_22622208.pth [2023-03-08 01:50:07,387][304623] Updated weights for policy 0, policy_version 44960 (0.0004) [2023-03-08 01:50:10,612][304623] Updated weights for policy 0, policy_version 45040 (0.0003) [2023-03-08 01:50:10,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 11788.1). Total num frames: 23060480. Throughput: 0: 12410.9. Samples: 23052300. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:50:10,769][304334] Avg episode reward: [(0, '4669.428')] [2023-03-08 01:50:13,912][304623] Updated weights for policy 0, policy_version 45120 (0.0004) [2023-03-08 01:50:15,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12356.3, 300 sec: 11802.0). Total num frames: 23121920. Throughput: 0: 12460.6. Samples: 23090748. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:50:15,769][304334] Avg episode reward: [(0, '4636.446')] [2023-03-08 01:50:17,339][304623] Updated weights for policy 0, policy_version 45200 (0.0005) [2023-03-08 01:50:20,625][304623] Updated weights for policy 0, policy_version 45280 (0.0004) [2023-03-08 01:50:20,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 11802.0). Total num frames: 23183360. Throughput: 0: 12467.2. Samples: 23162872. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 01:50:20,769][304334] Avg episode reward: [(0, '4680.003')] [2023-03-08 01:50:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000045280_23183360.pth... [2023-03-08 01:50:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000044552_22810624.pth [2023-03-08 01:50:24,157][304623] Updated weights for policy 0, policy_version 45360 (0.0005) [2023-03-08 01:50:25,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 11802.0). Total num frames: 23240704. Throughput: 0: 12493.5. Samples: 23234364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:50:25,769][304334] Avg episode reward: [(0, '4660.894')] [2023-03-08 01:50:27,409][304623] Updated weights for policy 0, policy_version 45440 (0.0004) [2023-03-08 01:50:30,764][304623] Updated weights for policy 0, policy_version 45520 (0.0005) [2023-03-08 01:50:30,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 11829.8). Total num frames: 23306240. Throughput: 0: 12472.3. Samples: 23272012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:50:30,780][304334] Avg episode reward: [(0, '4698.502')] [2023-03-08 01:50:34,362][304623] Updated weights for policy 0, policy_version 45600 (0.0005) [2023-03-08 01:50:35,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 11815.9). Total num frames: 23359488. Throughput: 0: 12340.8. Samples: 23343116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:50:35,775][304334] Avg episode reward: [(0, '4627.461')] [2023-03-08 01:50:35,778][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000045624_23359488.pth... [2023-03-08 01:50:35,781][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000044912_22994944.pth [2023-03-08 01:50:37,999][304623] Updated weights for policy 0, policy_version 45680 (0.0005) [2023-03-08 01:50:40,769][304334] Fps is (10 sec: 11059.3, 60 sec: 12288.0, 300 sec: 11815.9). Total num frames: 23416832. Throughput: 0: 12123.8. Samples: 23410788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:50:40,769][304334] Avg episode reward: [(0, '4699.555')] [2023-03-08 01:50:41,507][304623] Updated weights for policy 0, policy_version 45760 (0.0005) [2023-03-08 01:50:44,968][304623] Updated weights for policy 0, policy_version 45840 (0.0005) [2023-03-08 01:50:45,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 11815.9). Total num frames: 23478272. Throughput: 0: 12072.0. Samples: 23447412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:50:45,769][304334] Avg episode reward: [(0, '4682.465')] [2023-03-08 01:50:48,516][304623] Updated weights for policy 0, policy_version 45920 (0.0005) [2023-03-08 01:50:50,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 11802.0). Total num frames: 23535616. Throughput: 0: 11975.4. Samples: 23516328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:50:50,769][304334] Avg episode reward: [(0, '4700.769')] [2023-03-08 01:50:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000045968_23535616.pth... [2023-03-08 01:50:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000045280_23183360.pth [2023-03-08 01:50:51,881][304623] Updated weights for policy 0, policy_version 46000 (0.0005) [2023-03-08 01:50:55,373][304623] Updated weights for policy 0, policy_version 46080 (0.0005) [2023-03-08 01:50:55,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11802.0). Total num frames: 23597056. Throughput: 0: 11917.2. Samples: 23588576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:50:55,769][304334] Avg episode reward: [(0, '4642.094')] [2023-03-08 01:50:58,616][304623] Updated weights for policy 0, policy_version 46160 (0.0004) [2023-03-08 01:51:00,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12014.9, 300 sec: 11802.0). Total num frames: 23658496. Throughput: 0: 11890.0. Samples: 23625800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:51:00,769][304334] Avg episode reward: [(0, '4712.220')] [2023-03-08 01:51:00,770][304573] Saving new best policy, reward=4712.220! [2023-03-08 01:51:01,908][304623] Updated weights for policy 0, policy_version 46240 (0.0005) [2023-03-08 01:51:05,249][304623] Updated weights for policy 0, policy_version 46320 (0.0005) [2023-03-08 01:51:05,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11815.9). Total num frames: 23719936. Throughput: 0: 11931.7. Samples: 23699800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:51:05,769][304334] Avg episode reward: [(0, '4710.916')] [2023-03-08 01:51:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000046328_23719936.pth... [2023-03-08 01:51:05,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000045624_23359488.pth [2023-03-08 01:51:08,499][304623] Updated weights for policy 0, policy_version 46400 (0.0004) [2023-03-08 01:51:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12083.2, 300 sec: 11829.8). Total num frames: 23785472. Throughput: 0: 12037.3. Samples: 23776044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:51:10,769][304334] Avg episode reward: [(0, '4697.036')] [2023-03-08 01:51:11,710][304623] Updated weights for policy 0, policy_version 46480 (0.0004) [2023-03-08 01:51:14,871][304623] Updated weights for policy 0, policy_version 46560 (0.0004) [2023-03-08 01:51:15,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12083.2, 300 sec: 11843.7). Total num frames: 23846912. Throughput: 0: 12048.8. Samples: 23814208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:51:15,769][304334] Avg episode reward: [(0, '4675.933')] [2023-03-08 01:51:17,931][304623] Updated weights for policy 0, policy_version 46640 (0.0004) [2023-03-08 01:51:20,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12219.7, 300 sec: 11885.3). Total num frames: 23916544. Throughput: 0: 12228.9. Samples: 23893416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:51:20,769][304334] Avg episode reward: [(0, '4674.665')] [2023-03-08 01:51:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000046712_23916544.pth... [2023-03-08 01:51:20,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000045968_23535616.pth [2023-03-08 01:51:21,073][304623] Updated weights for policy 0, policy_version 46720 (0.0005) [2023-03-08 01:51:24,506][304623] Updated weights for policy 0, policy_version 46800 (0.0005) [2023-03-08 01:51:25,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12219.7, 300 sec: 11885.3). Total num frames: 23973888. Throughput: 0: 12370.1. Samples: 23967444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:51:25,769][304334] Avg episode reward: [(0, '4682.328')] [2023-03-08 01:51:27,918][304623] Updated weights for policy 0, policy_version 46880 (0.0006) [2023-03-08 01:51:30,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11899.2). Total num frames: 24035328. Throughput: 0: 12344.7. Samples: 24002924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:51:30,769][304334] Avg episode reward: [(0, '4705.009')] [2023-03-08 01:51:31,389][304623] Updated weights for policy 0, policy_version 46960 (0.0005) [2023-03-08 01:51:34,872][304623] Updated weights for policy 0, policy_version 47040 (0.0005) [2023-03-08 01:51:35,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12219.7, 300 sec: 11913.1). Total num frames: 24092672. Throughput: 0: 12390.1. Samples: 24073884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:51:35,769][304334] Avg episode reward: [(0, '4698.563')] [2023-03-08 01:51:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000047056_24092672.pth... [2023-03-08 01:51:35,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000046328_23719936.pth [2023-03-08 01:51:38,419][304623] Updated weights for policy 0, policy_version 47120 (0.0005) [2023-03-08 01:51:40,769][304334] Fps is (10 sec: 11468.8, 60 sec: 12219.7, 300 sec: 11913.1). Total num frames: 24150016. Throughput: 0: 12330.8. Samples: 24143460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:51:40,769][304334] Avg episode reward: [(0, '4620.943')] [2023-03-08 01:51:41,978][304623] Updated weights for policy 0, policy_version 47200 (0.0005) [2023-03-08 01:51:45,555][304623] Updated weights for policy 0, policy_version 47280 (0.0005) [2023-03-08 01:51:45,769][304334] Fps is (10 sec: 11468.9, 60 sec: 12151.5, 300 sec: 11927.0). Total num frames: 24207360. Throughput: 0: 12281.5. Samples: 24178468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:51:45,769][304334] Avg episode reward: [(0, '4676.359')] [2023-03-08 01:51:48,954][304623] Updated weights for policy 0, policy_version 47360 (0.0005) [2023-03-08 01:51:50,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12219.7, 300 sec: 11940.9). Total num frames: 24268800. Throughput: 0: 12190.8. Samples: 24248384. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 01:51:50,769][304334] Avg episode reward: [(0, '4556.661')] [2023-03-08 01:51:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000047400_24268800.pth... [2023-03-08 01:51:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000046712_23916544.pth [2023-03-08 01:51:52,424][304623] Updated weights for policy 0, policy_version 47440 (0.0005) [2023-03-08 01:51:55,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11954.8). Total num frames: 24326144. Throughput: 0: 12052.7. Samples: 24318416. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 01:51:55,769][304334] Avg episode reward: [(0, '4666.081')] [2023-03-08 01:51:55,951][304623] Updated weights for policy 0, policy_version 47520 (0.0005) [2023-03-08 01:51:59,554][304623] Updated weights for policy 0, policy_version 47600 (0.0005) [2023-03-08 01:52:00,769][304334] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 11968.7). Total num frames: 24383488. Throughput: 0: 11980.5. Samples: 24353332. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 01:52:00,769][304334] Avg episode reward: [(0, '4711.016')] [2023-03-08 01:52:03,108][304623] Updated weights for policy 0, policy_version 47680 (0.0005) [2023-03-08 01:52:05,769][304334] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11968.7). Total num frames: 24440832. Throughput: 0: 11749.7. Samples: 24422152. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 01:52:05,769][304334] Avg episode reward: [(0, '4696.677')] [2023-03-08 01:52:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000047736_24440832.pth... [2023-03-08 01:52:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000047056_24092672.pth [2023-03-08 01:52:06,595][304623] Updated weights for policy 0, policy_version 47760 (0.0005) [2023-03-08 01:52:10,128][304623] Updated weights for policy 0, policy_version 47840 (0.0005) [2023-03-08 01:52:10,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11968.7). Total num frames: 24498176. Throughput: 0: 11674.0. Samples: 24492776. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 01:52:10,769][304334] Avg episode reward: [(0, '4666.966')] [2023-03-08 01:52:13,615][304623] Updated weights for policy 0, policy_version 47920 (0.0005) [2023-03-08 01:52:15,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11996.4). Total num frames: 24559616. Throughput: 0: 11644.2. Samples: 24526912. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 01:52:15,769][304334] Avg episode reward: [(0, '4685.679')] [2023-03-08 01:52:16,794][304623] Updated weights for policy 0, policy_version 48000 (0.0005) [2023-03-08 01:52:20,257][304623] Updated weights for policy 0, policy_version 48080 (0.0005) [2023-03-08 01:52:20,769][304334] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11996.4). Total num frames: 24621056. Throughput: 0: 11726.7. Samples: 24601584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:52:20,769][304334] Avg episode reward: [(0, '4648.244')] [2023-03-08 01:52:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000048088_24621056.pth... [2023-03-08 01:52:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000047400_24268800.pth [2023-03-08 01:52:23,420][304623] Updated weights for policy 0, policy_version 48160 (0.0004) [2023-03-08 01:52:25,769][304334] Fps is (10 sec: 12697.6, 60 sec: 11878.4, 300 sec: 12010.3). Total num frames: 24686592. Throughput: 0: 11861.0. Samples: 24677204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:52:25,769][304334] Avg episode reward: [(0, '4610.375')] [2023-03-08 01:52:26,791][304623] Updated weights for policy 0, policy_version 48240 (0.0004) [2023-03-08 01:52:30,330][304623] Updated weights for policy 0, policy_version 48320 (0.0005) [2023-03-08 01:52:30,769][304334] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 12010.3). Total num frames: 24743936. Throughput: 0: 11876.0. Samples: 24712888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:52:30,769][304334] Avg episode reward: [(0, '4551.380')] [2023-03-08 01:52:33,762][304623] Updated weights for policy 0, policy_version 48400 (0.0005) [2023-03-08 01:52:35,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 12024.2). Total num frames: 24805376. Throughput: 0: 11895.3. Samples: 24783672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:52:35,769][304334] Avg episode reward: [(0, '4627.684')] [2023-03-08 01:52:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000048448_24805376.pth... [2023-03-08 01:52:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000047736_24440832.pth [2023-03-08 01:52:37,011][304623] Updated weights for policy 0, policy_version 48480 (0.0004) [2023-03-08 01:52:40,229][304623] Updated weights for policy 0, policy_version 48560 (0.0004) [2023-03-08 01:52:40,769][304334] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 12024.2). Total num frames: 24866816. Throughput: 0: 12015.0. Samples: 24859092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:52:40,769][304334] Avg episode reward: [(0, '4646.672')] [2023-03-08 01:52:43,344][304623] Updated weights for policy 0, policy_version 48640 (0.0004) [2023-03-08 01:52:45,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12083.2, 300 sec: 12038.1). Total num frames: 24932352. Throughput: 0: 12131.6. Samples: 24899256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:52:45,769][304334] Avg episode reward: [(0, '4677.705')] [2023-03-08 01:52:46,490][304623] Updated weights for policy 0, policy_version 48720 (0.0004) [2023-03-08 01:52:49,660][304623] Updated weights for policy 0, policy_version 48800 (0.0004) [2023-03-08 01:52:50,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12151.5, 300 sec: 12052.0). Total num frames: 24997888. Throughput: 0: 12338.9. Samples: 24977404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:52:50,769][304334] Avg episode reward: [(0, '4668.803')] [2023-03-08 01:52:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000048824_24997888.pth... [2023-03-08 01:52:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000048088_24621056.pth [2023-03-08 01:52:53,052][304623] Updated weights for policy 0, policy_version 48880 (0.0005) [2023-03-08 01:52:55,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 12038.1). Total num frames: 25059328. Throughput: 0: 12412.7. Samples: 25051348. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:52:55,769][304334] Avg episode reward: [(0, '4705.039')] [2023-03-08 01:52:56,185][304623] Updated weights for policy 0, policy_version 48960 (0.0004) [2023-03-08 01:52:59,234][304623] Updated weights for policy 0, policy_version 49040 (0.0004) [2023-03-08 01:53:00,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12356.3, 300 sec: 12065.8). Total num frames: 25124864. Throughput: 0: 12561.1. Samples: 25092160. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:53:00,769][304334] Avg episode reward: [(0, '4706.826')] [2023-03-08 01:53:02,568][304623] Updated weights for policy 0, policy_version 49120 (0.0005) [2023-03-08 01:53:05,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12424.5, 300 sec: 12079.7). Total num frames: 25186304. Throughput: 0: 12540.3. Samples: 25165896. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:53:05,769][304334] Avg episode reward: [(0, '4703.845')] [2023-03-08 01:53:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000049192_25186304.pth... [2023-03-08 01:53:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000048448_24805376.pth [2023-03-08 01:53:05,995][304623] Updated weights for policy 0, policy_version 49200 (0.0005) [2023-03-08 01:53:09,394][304623] Updated weights for policy 0, policy_version 49280 (0.0004) [2023-03-08 01:53:10,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 12079.7). Total num frames: 25243648. Throughput: 0: 12470.9. Samples: 25238392. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:53:10,769][304334] Avg episode reward: [(0, '4699.221')] [2023-03-08 01:53:12,835][304623] Updated weights for policy 0, policy_version 49360 (0.0005) [2023-03-08 01:53:15,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12492.8, 300 sec: 12107.5). Total num frames: 25309184. Throughput: 0: 12471.7. Samples: 25274116. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:53:15,769][304334] Avg episode reward: [(0, '4687.554')] [2023-03-08 01:53:16,044][304623] Updated weights for policy 0, policy_version 49440 (0.0004) [2023-03-08 01:53:19,195][304623] Updated weights for policy 0, policy_version 49520 (0.0003) [2023-03-08 01:53:20,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12561.1, 300 sec: 12121.4). Total num frames: 25374720. Throughput: 0: 12616.0. Samples: 25351392. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:53:20,780][304334] Avg episode reward: [(0, '4694.793')] [2023-03-08 01:53:20,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000049560_25374720.pth... [2023-03-08 01:53:20,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000048824_24997888.pth [2023-03-08 01:53:22,261][304623] Updated weights for policy 0, policy_version 49600 (0.0004) [2023-03-08 01:53:25,506][304623] Updated weights for policy 0, policy_version 49680 (0.0005) [2023-03-08 01:53:25,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12492.8, 300 sec: 12121.4). Total num frames: 25436160. Throughput: 0: 12684.2. Samples: 25429880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:53:25,780][304334] Avg episode reward: [(0, '4673.475')] [2023-03-08 01:53:28,999][304623] Updated weights for policy 0, policy_version 49760 (0.0005) [2023-03-08 01:53:30,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12561.1, 300 sec: 12121.4). Total num frames: 25497600. Throughput: 0: 12570.0. Samples: 25464904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:53:30,780][304334] Avg episode reward: [(0, '4713.794')] [2023-03-08 01:53:30,780][304573] Saving new best policy, reward=4713.794! [2023-03-08 01:53:32,478][304623] Updated weights for policy 0, policy_version 49840 (0.0005) [2023-03-08 01:53:35,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12492.8, 300 sec: 12121.4). Total num frames: 25554944. Throughput: 0: 12393.3. Samples: 25535100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:53:35,780][304334] Avg episode reward: [(0, '4675.726')] [2023-03-08 01:53:35,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000049912_25554944.pth... [2023-03-08 01:53:35,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000049192_25186304.pth [2023-03-08 01:53:36,032][304623] Updated weights for policy 0, policy_version 49920 (0.0005) [2023-03-08 01:53:39,522][304623] Updated weights for policy 0, policy_version 50000 (0.0005) [2023-03-08 01:53:40,769][304334] Fps is (10 sec: 11468.7, 60 sec: 12424.5, 300 sec: 12121.4). Total num frames: 25612288. Throughput: 0: 12313.8. Samples: 25605468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:53:40,780][304334] Avg episode reward: [(0, '4709.902')] [2023-03-08 01:53:43,050][304623] Updated weights for policy 0, policy_version 50080 (0.0005) [2023-03-08 01:53:45,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 12135.3). Total num frames: 25673728. Throughput: 0: 12190.5. Samples: 25640732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:53:45,780][304334] Avg episode reward: [(0, '4691.132')] [2023-03-08 01:53:46,428][304623] Updated weights for policy 0, policy_version 50160 (0.0005) [2023-03-08 01:53:49,892][304623] Updated weights for policy 0, policy_version 50240 (0.0005) [2023-03-08 01:53:50,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12149.1). Total num frames: 25731072. Throughput: 0: 12140.4. Samples: 25712216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:53:50,780][304334] Avg episode reward: [(0, '4635.647')] [2023-03-08 01:53:50,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000050256_25731072.pth... [2023-03-08 01:53:50,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000049560_25374720.pth [2023-03-08 01:53:53,317][304623] Updated weights for policy 0, policy_version 50320 (0.0005) [2023-03-08 01:53:55,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12219.8, 300 sec: 12163.0). Total num frames: 25792512. Throughput: 0: 12131.7. Samples: 25784320. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:53:55,780][304334] Avg episode reward: [(0, '4713.780')] [2023-03-08 01:53:56,740][304623] Updated weights for policy 0, policy_version 50400 (0.0005) [2023-03-08 01:54:00,203][304623] Updated weights for policy 0, policy_version 50480 (0.0005) [2023-03-08 01:54:00,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 12163.0). Total num frames: 25849856. Throughput: 0: 12137.1. Samples: 25820284. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:54:00,769][304334] Avg episode reward: [(0, '4703.162')] [2023-03-08 01:54:03,695][304623] Updated weights for policy 0, policy_version 50560 (0.0005) [2023-03-08 01:54:05,769][304334] Fps is (10 sec: 11468.7, 60 sec: 12014.9, 300 sec: 12149.2). Total num frames: 25907200. Throughput: 0: 11982.4. Samples: 25890600. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:54:05,769][304334] Avg episode reward: [(0, '4713.669')] [2023-03-08 01:54:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000050608_25911296.pth... [2023-03-08 01:54:05,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000049912_25554944.pth [2023-03-08 01:54:07,211][304623] Updated weights for policy 0, policy_version 50640 (0.0005) [2023-03-08 01:54:10,645][304623] Updated weights for policy 0, policy_version 50720 (0.0004) [2023-03-08 01:54:10,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 12163.0). Total num frames: 25968640. Throughput: 0: 11790.6. Samples: 25960460. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:54:10,769][304334] Avg episode reward: [(0, '4711.598')] [2023-03-08 01:54:13,868][304623] Updated weights for policy 0, policy_version 50800 (0.0003) [2023-03-08 01:54:15,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 12176.9). Total num frames: 26030080. Throughput: 0: 11859.2. Samples: 25998568. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:54:15,780][304334] Avg episode reward: [(0, '4698.942')] [2023-03-08 01:54:17,125][304623] Updated weights for policy 0, policy_version 50880 (0.0003) [2023-03-08 01:54:20,526][304623] Updated weights for policy 0, policy_version 50960 (0.0005) [2023-03-08 01:54:20,769][304334] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 12176.9). Total num frames: 26091520. Throughput: 0: 11972.2. Samples: 26073852. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:54:20,780][304334] Avg episode reward: [(0, '4710.096')] [2023-03-08 01:54:20,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000050960_26091520.pth... [2023-03-08 01:54:20,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000050256_25731072.pth [2023-03-08 01:54:23,896][304623] Updated weights for policy 0, policy_version 51040 (0.0005) [2023-03-08 01:54:25,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 12176.9). Total num frames: 26157056. Throughput: 0: 12022.4. Samples: 26146476. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:54:25,780][304334] Avg episode reward: [(0, '4691.414')] [2023-03-08 01:54:27,012][304623] Updated weights for policy 0, policy_version 51120 (0.0004) [2023-03-08 01:54:30,088][304623] Updated weights for policy 0, policy_version 51200 (0.0004) [2023-03-08 01:54:30,769][304334] Fps is (10 sec: 13107.3, 60 sec: 12083.2, 300 sec: 12218.6). Total num frames: 26222592. Throughput: 0: 12121.6. Samples: 26186204. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:54:30,780][304334] Avg episode reward: [(0, '4705.173')] [2023-03-08 01:54:33,170][304623] Updated weights for policy 0, policy_version 51280 (0.0004) [2023-03-08 01:54:35,769][304334] Fps is (10 sec: 13107.0, 60 sec: 12219.7, 300 sec: 12232.5). Total num frames: 26288128. Throughput: 0: 12293.9. Samples: 26265440. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:54:35,780][304334] Avg episode reward: [(0, '4702.562')] [2023-03-08 01:54:35,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000051344_26288128.pth... [2023-03-08 01:54:35,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000050608_25911296.pth [2023-03-08 01:54:36,355][304623] Updated weights for policy 0, policy_version 51360 (0.0005) [2023-03-08 01:54:39,476][304623] Updated weights for policy 0, policy_version 51440 (0.0004) [2023-03-08 01:54:40,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12356.3, 300 sec: 12232.5). Total num frames: 26353664. Throughput: 0: 12433.7. Samples: 26343836. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:54:40,780][304334] Avg episode reward: [(0, '4712.331')] [2023-03-08 01:54:42,581][304623] Updated weights for policy 0, policy_version 51520 (0.0004) [2023-03-08 01:54:45,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12356.3, 300 sec: 12218.6). Total num frames: 26415104. Throughput: 0: 12501.7. Samples: 26382860. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:54:45,780][304334] Avg episode reward: [(0, '4700.128')] [2023-03-08 01:54:45,976][304623] Updated weights for policy 0, policy_version 51600 (0.0005) [2023-03-08 01:54:49,448][304623] Updated weights for policy 0, policy_version 51680 (0.0005) [2023-03-08 01:54:50,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 12204.7). Total num frames: 26472448. Throughput: 0: 12549.4. Samples: 26455324. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:54:50,780][304334] Avg episode reward: [(0, '4701.718')] [2023-03-08 01:54:50,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000051704_26472448.pth... [2023-03-08 01:54:50,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000050960_26091520.pth [2023-03-08 01:54:52,977][304623] Updated weights for policy 0, policy_version 51760 (0.0005) [2023-03-08 01:54:55,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12356.3, 300 sec: 12190.8). Total num frames: 26533888. Throughput: 0: 12548.0. Samples: 26525120. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:54:55,780][304334] Avg episode reward: [(0, '4694.778')] [2023-03-08 01:54:56,411][304623] Updated weights for policy 0, policy_version 51840 (0.0005) [2023-03-08 01:54:59,911][304623] Updated weights for policy 0, policy_version 51920 (0.0005) [2023-03-08 01:55:00,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 12190.8). Total num frames: 26591232. Throughput: 0: 12492.1. Samples: 26560712. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:55:00,780][304334] Avg episode reward: [(0, '4665.858')] [2023-03-08 01:55:03,395][304623] Updated weights for policy 0, policy_version 52000 (0.0005) [2023-03-08 01:55:05,769][304334] Fps is (10 sec: 11468.7, 60 sec: 12356.3, 300 sec: 12163.0). Total num frames: 26648576. Throughput: 0: 12384.6. Samples: 26631160. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:55:05,780][304334] Avg episode reward: [(0, '4700.897')] [2023-03-08 01:55:05,830][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000052056_26652672.pth... [2023-03-08 01:55:05,832][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000051344_26288128.pth [2023-03-08 01:55:06,892][304623] Updated weights for policy 0, policy_version 52080 (0.0005) [2023-03-08 01:55:10,396][304623] Updated weights for policy 0, policy_version 52160 (0.0005) [2023-03-08 01:55:10,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 12163.0). Total num frames: 26710016. Throughput: 0: 12330.9. Samples: 26701368. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:55:10,769][304334] Avg episode reward: [(0, '4685.973')] [2023-03-08 01:55:13,932][304623] Updated weights for policy 0, policy_version 52240 (0.0005) [2023-03-08 01:55:15,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 12149.2). Total num frames: 26767360. Throughput: 0: 12208.4. Samples: 26735584. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:55:15,769][304334] Avg episode reward: [(0, '4706.596')] [2023-03-08 01:55:17,266][304623] Updated weights for policy 0, policy_version 52320 (0.0005) [2023-03-08 01:55:20,475][304623] Updated weights for policy 0, policy_version 52400 (0.0004) [2023-03-08 01:55:20,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 12163.0). Total num frames: 26828800. Throughput: 0: 12095.2. Samples: 26809724. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:55:20,769][304334] Avg episode reward: [(0, '4714.271')] [2023-03-08 01:55:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000052400_26828800.pth... [2023-03-08 01:55:20,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000051704_26472448.pth [2023-03-08 01:55:20,774][304573] Saving new best policy, reward=4714.271! [2023-03-08 01:55:23,732][304623] Updated weights for policy 0, policy_version 52480 (0.0005) [2023-03-08 01:55:25,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 12163.0). Total num frames: 26894336. Throughput: 0: 12052.7. Samples: 26886208. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:55:25,769][304334] Avg episode reward: [(0, '4654.120')] [2023-03-08 01:55:26,806][304623] Updated weights for policy 0, policy_version 52560 (0.0004) [2023-03-08 01:55:29,944][304623] Updated weights for policy 0, policy_version 52640 (0.0004) [2023-03-08 01:55:30,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12288.0, 300 sec: 12204.7). Total num frames: 26959872. Throughput: 0: 12068.8. Samples: 26925956. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:55:30,769][304334] Avg episode reward: [(0, '4615.648')] [2023-03-08 01:55:33,083][304623] Updated weights for policy 0, policy_version 52720 (0.0004) [2023-03-08 01:55:35,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12288.0, 300 sec: 12232.5). Total num frames: 27025408. Throughput: 0: 12214.8. Samples: 27004992. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:55:35,769][304334] Avg episode reward: [(0, '4662.468')] [2023-03-08 01:55:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000052784_27025408.pth... [2023-03-08 01:55:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000052056_26652672.pth [2023-03-08 01:55:36,159][304623] Updated weights for policy 0, policy_version 52800 (0.0004) [2023-03-08 01:55:39,241][304623] Updated weights for policy 0, policy_version 52880 (0.0003) [2023-03-08 01:55:40,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12288.0, 300 sec: 12246.3). Total num frames: 27090944. Throughput: 0: 12405.9. Samples: 27083388. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:55:40,769][304334] Avg episode reward: [(0, '4644.924')] [2023-03-08 01:55:42,416][304623] Updated weights for policy 0, policy_version 52960 (0.0004) [2023-03-08 01:55:45,548][304623] Updated weights for policy 0, policy_version 53040 (0.0004) [2023-03-08 01:55:45,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12356.3, 300 sec: 12274.1). Total num frames: 27156480. Throughput: 0: 12498.5. Samples: 27123144. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:55:45,769][304334] Avg episode reward: [(0, '4698.546')] [2023-03-08 01:55:48,680][304623] Updated weights for policy 0, policy_version 53120 (0.0004) [2023-03-08 01:55:50,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12492.8, 300 sec: 12288.0). Total num frames: 27222016. Throughput: 0: 12674.3. Samples: 27201504. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:55:50,769][304334] Avg episode reward: [(0, '4694.649')] [2023-03-08 01:55:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000053168_27222016.pth... [2023-03-08 01:55:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000052400_26828800.pth [2023-03-08 01:55:51,825][304623] Updated weights for policy 0, policy_version 53200 (0.0004) [2023-03-08 01:55:55,028][304623] Updated weights for policy 0, policy_version 53280 (0.0005) [2023-03-08 01:55:55,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12561.1, 300 sec: 12301.9). Total num frames: 27287552. Throughput: 0: 12830.4. Samples: 27278736. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:55:55,769][304334] Avg episode reward: [(0, '4703.215')] [2023-03-08 01:55:58,323][304623] Updated weights for policy 0, policy_version 53360 (0.0005) [2023-03-08 01:56:00,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12629.3, 300 sec: 12301.9). Total num frames: 27348992. Throughput: 0: 12904.5. Samples: 27316288. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 01:56:00,769][304334] Avg episode reward: [(0, '4715.962')] [2023-03-08 01:56:00,770][304573] Saving new best policy, reward=4715.962! [2023-03-08 01:56:01,736][304623] Updated weights for policy 0, policy_version 53440 (0.0005) [2023-03-08 01:56:05,269][304623] Updated weights for policy 0, policy_version 53520 (0.0005) [2023-03-08 01:56:05,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12629.3, 300 sec: 12274.1). Total num frames: 27406336. Throughput: 0: 12826.7. Samples: 27386924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:56:05,769][304334] Avg episode reward: [(0, '4709.550')] [2023-03-08 01:56:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000053528_27406336.pth... [2023-03-08 01:56:05,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000052784_27025408.pth [2023-03-08 01:56:08,783][304623] Updated weights for policy 0, policy_version 53600 (0.0005) [2023-03-08 01:56:10,769][304334] Fps is (10 sec: 11468.8, 60 sec: 12561.1, 300 sec: 12260.2). Total num frames: 27463680. Throughput: 0: 12675.3. Samples: 27456596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:56:10,769][304334] Avg episode reward: [(0, '4714.546')] [2023-03-08 01:56:12,263][304623] Updated weights for policy 0, policy_version 53680 (0.0005) [2023-03-08 01:56:15,714][304623] Updated weights for policy 0, policy_version 53760 (0.0005) [2023-03-08 01:56:15,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12629.3, 300 sec: 12232.5). Total num frames: 27525120. Throughput: 0: 12588.0. Samples: 27492416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:56:15,769][304334] Avg episode reward: [(0, '4711.535')] [2023-03-08 01:56:19,310][304623] Updated weights for policy 0, policy_version 53840 (0.0005) [2023-03-08 01:56:20,769][304334] Fps is (10 sec: 11468.8, 60 sec: 12492.8, 300 sec: 12218.6). Total num frames: 27578368. Throughput: 0: 12379.2. Samples: 27562056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:56:20,769][304334] Avg episode reward: [(0, '4703.490')] [2023-03-08 01:56:20,803][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000053872_27582464.pth... [2023-03-08 01:56:20,805][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000053168_27222016.pth [2023-03-08 01:56:22,992][304623] Updated weights for policy 0, policy_version 53920 (0.0005) [2023-03-08 01:56:25,769][304334] Fps is (10 sec: 11059.3, 60 sec: 12356.3, 300 sec: 12204.7). Total num frames: 27635712. Throughput: 0: 12142.1. Samples: 27629780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:56:25,769][304334] Avg episode reward: [(0, '4693.769')] [2023-03-08 01:56:26,491][304623] Updated weights for policy 0, policy_version 54000 (0.0005) [2023-03-08 01:56:30,058][304623] Updated weights for policy 0, policy_version 54080 (0.0005) [2023-03-08 01:56:30,769][304334] Fps is (10 sec: 11878.6, 60 sec: 12288.0, 300 sec: 12218.6). Total num frames: 27697152. Throughput: 0: 12032.1. Samples: 27664588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:56:30,769][304334] Avg episode reward: [(0, '4711.428')] [2023-03-08 01:56:33,551][304623] Updated weights for policy 0, policy_version 54160 (0.0005) [2023-03-08 01:56:35,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12151.5, 300 sec: 12218.6). Total num frames: 27754496. Throughput: 0: 11857.7. Samples: 27735100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:56:35,769][304334] Avg episode reward: [(0, '4690.097')] [2023-03-08 01:56:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000054208_27754496.pth... [2023-03-08 01:56:35,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000053528_27406336.pth [2023-03-08 01:56:37,107][304623] Updated weights for policy 0, policy_version 54240 (0.0005) [2023-03-08 01:56:40,565][304623] Updated weights for policy 0, policy_version 54320 (0.0005) [2023-03-08 01:56:40,769][304334] Fps is (10 sec: 11468.7, 60 sec: 12014.9, 300 sec: 12218.6). Total num frames: 27811840. Throughput: 0: 11697.4. Samples: 27805120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:56:40,769][304334] Avg episode reward: [(0, '4698.163')] [2023-03-08 01:56:44,199][304623] Updated weights for policy 0, policy_version 54400 (0.0005) [2023-03-08 01:56:45,769][304334] Fps is (10 sec: 11468.9, 60 sec: 11878.4, 300 sec: 12204.7). Total num frames: 27869184. Throughput: 0: 11632.9. Samples: 27839768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:56:45,769][304334] Avg episode reward: [(0, '4662.489')] [2023-03-08 01:56:47,798][304623] Updated weights for policy 0, policy_version 54480 (0.0005) [2023-03-08 01:56:50,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 12204.7). Total num frames: 27926528. Throughput: 0: 11551.3. Samples: 27906732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:56:50,769][304334] Avg episode reward: [(0, '4641.183')] [2023-03-08 01:56:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000054544_27926528.pth... [2023-03-08 01:56:50,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000053872_27582464.pth [2023-03-08 01:56:51,392][304623] Updated weights for policy 0, policy_version 54560 (0.0005) [2023-03-08 01:56:54,910][304623] Updated weights for policy 0, policy_version 54640 (0.0005) [2023-03-08 01:56:55,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12204.7). Total num frames: 27983872. Throughput: 0: 11546.2. Samples: 27976172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:56:55,769][304334] Avg episode reward: [(0, '4581.641')] [2023-03-08 01:56:57,364][304573] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000009 [2023-03-08 01:56:58,394][304623] Updated weights for policy 0, policy_version 54720 (0.0004) [2023-03-08 01:57:00,769][304334] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 12204.7). Total num frames: 28041216. Throughput: 0: 11550.9. Samples: 28012208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:57:00,769][304334] Avg episode reward: [(0, '4648.157')] [2023-03-08 01:57:01,899][304623] Updated weights for policy 0, policy_version 54800 (0.0005) [2023-03-08 01:57:05,355][304623] Updated weights for policy 0, policy_version 54880 (0.0005) [2023-03-08 01:57:05,769][304334] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 12218.6). Total num frames: 28102656. Throughput: 0: 11559.6. Samples: 28082240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:57:05,769][304334] Avg episode reward: [(0, '4679.061')] [2023-03-08 01:57:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000054888_28102656.pth... [2023-03-08 01:57:05,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000054208_27754496.pth [2023-03-08 01:57:08,678][304623] Updated weights for policy 0, policy_version 54960 (0.0005) [2023-03-08 01:57:10,769][304334] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 12218.6). Total num frames: 28164096. Throughput: 0: 11691.6. Samples: 28155904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:57:10,769][304334] Avg episode reward: [(0, '4666.468')] [2023-03-08 01:57:12,102][304623] Updated weights for policy 0, policy_version 55040 (0.0005) [2023-03-08 01:57:15,449][304623] Updated weights for policy 0, policy_version 55120 (0.0004) [2023-03-08 01:57:15,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 12204.7). Total num frames: 28221440. Throughput: 0: 11705.0. Samples: 28191316. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:57:15,769][304334] Avg episode reward: [(0, '4681.564')] [2023-03-08 01:57:18,736][304623] Updated weights for policy 0, policy_version 55200 (0.0003) [2023-03-08 01:57:20,769][304334] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 12204.7). Total num frames: 28286976. Throughput: 0: 11789.2. Samples: 28265616. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:57:20,769][304334] Avg episode reward: [(0, '4702.554')] [2023-03-08 01:57:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000055248_28286976.pth... [2023-03-08 01:57:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000054544_27926528.pth [2023-03-08 01:57:22,015][304623] Updated weights for policy 0, policy_version 55280 (0.0003) [2023-03-08 01:57:25,288][304623] Updated weights for policy 0, policy_version 55360 (0.0004) [2023-03-08 01:57:25,769][304334] Fps is (10 sec: 12697.7, 60 sec: 11878.4, 300 sec: 12218.6). Total num frames: 28348416. Throughput: 0: 11893.5. Samples: 28340328. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:57:25,769][304334] Avg episode reward: [(0, '4680.899')] [2023-03-08 01:57:28,831][304623] Updated weights for policy 0, policy_version 55440 (0.0005) [2023-03-08 01:57:30,769][304334] Fps is (10 sec: 11878.5, 60 sec: 11810.1, 300 sec: 12204.7). Total num frames: 28405760. Throughput: 0: 11907.9. Samples: 28375624. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:57:30,769][304334] Avg episode reward: [(0, '4548.840')] [2023-03-08 01:57:32,236][304623] Updated weights for policy 0, policy_version 55520 (0.0005) [2023-03-08 01:57:35,603][304623] Updated weights for policy 0, policy_version 55600 (0.0005) [2023-03-08 01:57:35,769][304334] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 12204.7). Total num frames: 28467200. Throughput: 0: 12012.5. Samples: 28447296. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:57:35,769][304334] Avg episode reward: [(0, '4682.476')] [2023-03-08 01:57:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000055600_28467200.pth... [2023-03-08 01:57:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000054888_28102656.pth [2023-03-08 01:57:38,724][304623] Updated weights for policy 0, policy_version 55680 (0.0004) [2023-03-08 01:57:40,769][304334] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 12190.8). Total num frames: 28528640. Throughput: 0: 12167.7. Samples: 28523720. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:57:40,769][304334] Avg episode reward: [(0, '4628.126')] [2023-03-08 01:57:42,038][304623] Updated weights for policy 0, policy_version 55760 (0.0004) [2023-03-08 01:57:45,447][304623] Updated weights for policy 0, policy_version 55840 (0.0004) [2023-03-08 01:57:45,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12083.2, 300 sec: 12190.8). Total num frames: 28594176. Throughput: 0: 12184.4. Samples: 28560508. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:57:45,769][304334] Avg episode reward: [(0, '4637.099')] [2023-03-08 01:57:48,541][304623] Updated weights for policy 0, policy_version 55920 (0.0003) [2023-03-08 01:57:50,769][304334] Fps is (10 sec: 12697.4, 60 sec: 12151.5, 300 sec: 12190.8). Total num frames: 28655616. Throughput: 0: 12316.4. Samples: 28636480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:57:50,769][304334] Avg episode reward: [(0, '4517.646')] [2023-03-08 01:57:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000055968_28655616.pth... [2023-03-08 01:57:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000055248_28286976.pth [2023-03-08 01:57:51,782][304623] Updated weights for policy 0, policy_version 56000 (0.0003) [2023-03-08 01:57:54,914][304623] Updated weights for policy 0, policy_version 56080 (0.0003) [2023-03-08 01:57:55,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 12190.8). Total num frames: 28721152. Throughput: 0: 12388.3. Samples: 28713376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:57:55,769][304334] Avg episode reward: [(0, '4577.748')] [2023-03-08 01:57:57,932][304623] Updated weights for policy 0, policy_version 56160 (0.0003) [2023-03-08 01:58:00,769][304334] Fps is (10 sec: 13516.9, 60 sec: 12492.8, 300 sec: 12218.6). Total num frames: 28790784. Throughput: 0: 12505.4. Samples: 28754060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:58:00,769][304334] Avg episode reward: [(0, '4612.446')] [2023-03-08 01:58:00,937][304623] Updated weights for policy 0, policy_version 56240 (0.0003) [2023-03-08 01:58:04,123][304623] Updated weights for policy 0, policy_version 56320 (0.0003) [2023-03-08 01:58:05,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12561.1, 300 sec: 12246.3). Total num frames: 28856320. Throughput: 0: 12637.2. Samples: 28834292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:58:05,769][304334] Avg episode reward: [(0, '4672.509')] [2023-03-08 01:58:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000056360_28856320.pth... [2023-03-08 01:58:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000055600_28467200.pth [2023-03-08 01:58:07,360][304623] Updated weights for policy 0, policy_version 56400 (0.0003) [2023-03-08 01:58:10,469][304623] Updated weights for policy 0, policy_version 56480 (0.0003) [2023-03-08 01:58:10,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12629.3, 300 sec: 12246.3). Total num frames: 28921856. Throughput: 0: 12680.3. Samples: 28910940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:58:10,769][304334] Avg episode reward: [(0, '4640.572')] [2023-03-08 01:58:13,527][304623] Updated weights for policy 0, policy_version 56560 (0.0005) [2023-03-08 01:58:15,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12697.6, 300 sec: 12232.5). Total num frames: 28983296. Throughput: 0: 12777.2. Samples: 28950600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:58:15,769][304334] Avg episode reward: [(0, '4546.418')] [2023-03-08 01:58:16,792][304623] Updated weights for policy 0, policy_version 56640 (0.0005) [2023-03-08 01:58:20,281][304623] Updated weights for policy 0, policy_version 56720 (0.0005) [2023-03-08 01:58:20,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12629.3, 300 sec: 12232.5). Total num frames: 29044736. Throughput: 0: 12847.9. Samples: 29025452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:58:20,769][304334] Avg episode reward: [(0, '4634.619')] [2023-03-08 01:58:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000056728_29044736.pth... [2023-03-08 01:58:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000055968_28655616.pth [2023-03-08 01:58:23,587][304623] Updated weights for policy 0, policy_version 56800 (0.0005) [2023-03-08 01:58:25,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12629.3, 300 sec: 12232.5). Total num frames: 29106176. Throughput: 0: 12790.3. Samples: 29099284. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:58:25,769][304334] Avg episode reward: [(0, '4642.997')] [2023-03-08 01:58:26,915][304623] Updated weights for policy 0, policy_version 56880 (0.0005) [2023-03-08 01:58:30,455][304623] Updated weights for policy 0, policy_version 56960 (0.0005) [2023-03-08 01:58:30,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12629.3, 300 sec: 12232.5). Total num frames: 29163520. Throughput: 0: 12764.7. Samples: 29134920. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:58:30,769][304334] Avg episode reward: [(0, '4694.958')] [2023-03-08 01:58:34,011][304623] Updated weights for policy 0, policy_version 57040 (0.0005) [2023-03-08 01:58:35,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12629.3, 300 sec: 12246.3). Total num frames: 29224960. Throughput: 0: 12622.2. Samples: 29204480. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:58:35,769][304334] Avg episode reward: [(0, '4691.455')] [2023-03-08 01:58:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000057080_29224960.pth... [2023-03-08 01:58:35,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000056360_28856320.pth [2023-03-08 01:58:37,311][304623] Updated weights for policy 0, policy_version 57120 (0.0004) [2023-03-08 01:58:40,556][304623] Updated weights for policy 0, policy_version 57200 (0.0003) [2023-03-08 01:58:40,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12629.3, 300 sec: 12246.3). Total num frames: 29286400. Throughput: 0: 12566.5. Samples: 29278868. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:58:40,769][304334] Avg episode reward: [(0, '4677.276')] [2023-03-08 01:58:43,642][304623] Updated weights for policy 0, policy_version 57280 (0.0003) [2023-03-08 01:58:45,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12274.1). Total num frames: 29351936. Throughput: 0: 12548.0. Samples: 29318720. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:58:45,769][304334] Avg episode reward: [(0, '4685.002')] [2023-03-08 01:58:46,842][304623] Updated weights for policy 0, policy_version 57360 (0.0004) [2023-03-08 01:58:49,930][304623] Updated weights for policy 0, policy_version 57440 (0.0005) [2023-03-08 01:58:50,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12697.6, 300 sec: 12288.0). Total num frames: 29417472. Throughput: 0: 12497.7. Samples: 29396688. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:58:50,769][304334] Avg episode reward: [(0, '4617.359')] [2023-03-08 01:58:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000057456_29417472.pth... [2023-03-08 01:58:50,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000056728_29044736.pth [2023-03-08 01:58:53,295][304623] Updated weights for policy 0, policy_version 57520 (0.0005) [2023-03-08 01:58:55,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12301.9). Total num frames: 29478912. Throughput: 0: 12445.8. Samples: 29471000. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 01:58:55,769][304334] Avg episode reward: [(0, '4675.255')] [2023-03-08 01:58:56,625][304623] Updated weights for policy 0, policy_version 57600 (0.0005) [2023-03-08 01:58:59,772][304623] Updated weights for policy 0, policy_version 57680 (0.0003) [2023-03-08 01:59:00,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12561.1, 300 sec: 12329.7). Total num frames: 29544448. Throughput: 0: 12384.4. Samples: 29507900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:59:00,769][304334] Avg episode reward: [(0, '4669.326')] [2023-03-08 01:59:02,965][304623] Updated weights for policy 0, policy_version 57760 (0.0003) [2023-03-08 01:59:05,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12492.8, 300 sec: 12329.7). Total num frames: 29605888. Throughput: 0: 12450.0. Samples: 29585700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:59:05,769][304334] Avg episode reward: [(0, '4659.071')] [2023-03-08 01:59:05,802][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000057832_29609984.pth... [2023-03-08 01:59:05,804][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000057080_29224960.pth [2023-03-08 01:59:06,129][304623] Updated weights for policy 0, policy_version 57840 (0.0004) [2023-03-08 01:59:09,339][304623] Updated weights for policy 0, policy_version 57920 (0.0005) [2023-03-08 01:59:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12343.5). Total num frames: 29671424. Throughput: 0: 12532.4. Samples: 29663240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:59:10,769][304334] Avg episode reward: [(0, '4698.980')] [2023-03-08 01:59:12,680][304623] Updated weights for policy 0, policy_version 58000 (0.0005) [2023-03-08 01:59:15,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12329.7). Total num frames: 29728768. Throughput: 0: 12559.5. Samples: 29700096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:59:15,769][304334] Avg episode reward: [(0, '4695.775')] [2023-03-08 01:59:16,118][304623] Updated weights for policy 0, policy_version 58080 (0.0005) [2023-03-08 01:59:19,531][304623] Updated weights for policy 0, policy_version 58160 (0.0005) [2023-03-08 01:59:20,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12424.6, 300 sec: 12315.8). Total num frames: 29790208. Throughput: 0: 12592.3. Samples: 29771132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:59:20,769][304334] Avg episode reward: [(0, '4681.782')] [2023-03-08 01:59:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000058184_29790208.pth... [2023-03-08 01:59:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000057456_29417472.pth [2023-03-08 01:59:22,815][304623] Updated weights for policy 0, policy_version 58240 (0.0005) [2023-03-08 01:59:25,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 12301.9). Total num frames: 29851648. Throughput: 0: 12561.6. Samples: 29844140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:59:25,769][304334] Avg episode reward: [(0, '4660.017')] [2023-03-08 01:59:26,233][304623] Updated weights for policy 0, policy_version 58320 (0.0005) [2023-03-08 01:59:29,678][304623] Updated weights for policy 0, policy_version 58400 (0.0005) [2023-03-08 01:59:30,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12492.8, 300 sec: 12288.0). Total num frames: 29913088. Throughput: 0: 12480.3. Samples: 29880332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:59:30,769][304334] Avg episode reward: [(0, '4674.303')] [2023-03-08 01:59:33,179][304623] Updated weights for policy 0, policy_version 58480 (0.0005) [2023-03-08 01:59:35,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 12260.2). Total num frames: 29970432. Throughput: 0: 12318.4. Samples: 29951016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:59:35,769][304334] Avg episode reward: [(0, '4639.667')] [2023-03-08 01:59:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000058536_29970432.pth... [2023-03-08 01:59:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000057832_29609984.pth [2023-03-08 01:59:36,645][304623] Updated weights for policy 0, policy_version 58560 (0.0005) [2023-03-08 01:59:40,014][304623] Updated weights for policy 0, policy_version 58640 (0.0005) [2023-03-08 01:59:40,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 12260.2). Total num frames: 30031872. Throughput: 0: 12281.8. Samples: 30023680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:59:40,769][304334] Avg episode reward: [(0, '4658.347')] [2023-03-08 01:59:43,382][304623] Updated weights for policy 0, policy_version 58720 (0.0005) [2023-03-08 01:59:45,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12274.1). Total num frames: 30093312. Throughput: 0: 12266.1. Samples: 30059876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:59:45,769][304334] Avg episode reward: [(0, '4681.158')] [2023-03-08 01:59:46,782][304623] Updated weights for policy 0, policy_version 58800 (0.0005) [2023-03-08 01:59:49,883][304623] Updated weights for policy 0, policy_version 58880 (0.0004) [2023-03-08 01:59:50,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 12274.1). Total num frames: 30154752. Throughput: 0: 12200.4. Samples: 30134720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:59:50,769][304334] Avg episode reward: [(0, '4680.800')] [2023-03-08 01:59:50,771][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000058896_30154752.pth... [2023-03-08 01:59:50,773][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000058184_29790208.pth [2023-03-08 01:59:53,067][304623] Updated weights for policy 0, policy_version 58960 (0.0004) [2023-03-08 01:59:55,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12356.3, 300 sec: 12301.9). Total num frames: 30220288. Throughput: 0: 12198.2. Samples: 30212160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 01:59:55,769][304334] Avg episode reward: [(0, '4667.747')] [2023-03-08 01:59:56,215][304623] Updated weights for policy 0, policy_version 59040 (0.0003) [2023-03-08 01:59:59,342][304623] Updated weights for policy 0, policy_version 59120 (0.0005) [2023-03-08 02:00:00,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12356.3, 300 sec: 12329.7). Total num frames: 30285824. Throughput: 0: 12252.8. Samples: 30251472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:00:00,769][304334] Avg episode reward: [(0, '4682.674')] [2023-03-08 02:00:02,428][304623] Updated weights for policy 0, policy_version 59200 (0.0004) [2023-03-08 02:00:05,471][304623] Updated weights for policy 0, policy_version 59280 (0.0004) [2023-03-08 02:00:05,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12492.8, 300 sec: 12357.4). Total num frames: 30355456. Throughput: 0: 12440.3. Samples: 30330944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:00:05,769][304334] Avg episode reward: [(0, '4696.521')] [2023-03-08 02:00:05,771][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000059288_30355456.pth... [2023-03-08 02:00:05,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000058536_29970432.pth [2023-03-08 02:00:08,578][304623] Updated weights for policy 0, policy_version 59360 (0.0005) [2023-03-08 02:00:10,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12424.5, 300 sec: 12371.3). Total num frames: 30416896. Throughput: 0: 12571.6. Samples: 30409864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:00:10,769][304334] Avg episode reward: [(0, '4693.050')] [2023-03-08 02:00:11,704][304623] Updated weights for policy 0, policy_version 59440 (0.0005) [2023-03-08 02:00:14,772][304623] Updated weights for policy 0, policy_version 59520 (0.0004) [2023-03-08 02:00:15,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12629.3, 300 sec: 12399.1). Total num frames: 30486528. Throughput: 0: 12671.4. Samples: 30450544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:00:15,769][304334] Avg episode reward: [(0, '4688.103')] [2023-03-08 02:00:17,934][304623] Updated weights for policy 0, policy_version 59600 (0.0004) [2023-03-08 02:00:20,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12629.3, 300 sec: 12385.2). Total num frames: 30547968. Throughput: 0: 12823.9. Samples: 30528092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:00:20,769][304334] Avg episode reward: [(0, '4692.376')] [2023-03-08 02:00:20,778][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000059672_30552064.pth... [2023-03-08 02:00:20,780][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000058896_30154752.pth [2023-03-08 02:00:21,073][304623] Updated weights for policy 0, policy_version 59680 (0.0004) [2023-03-08 02:00:24,212][304623] Updated weights for policy 0, policy_version 59760 (0.0004) [2023-03-08 02:00:25,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12765.9, 300 sec: 12399.1). Total num frames: 30617600. Throughput: 0: 12962.2. Samples: 30606980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:00:25,769][304334] Avg episode reward: [(0, '4668.664')] [2023-03-08 02:00:27,388][304623] Updated weights for policy 0, policy_version 59840 (0.0004) [2023-03-08 02:00:30,587][304623] Updated weights for policy 0, policy_version 59920 (0.0004) [2023-03-08 02:00:30,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12765.9, 300 sec: 12385.2). Total num frames: 30679040. Throughput: 0: 13019.0. Samples: 30645732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:00:30,769][304334] Avg episode reward: [(0, '4685.821')] [2023-03-08 02:00:33,722][304623] Updated weights for policy 0, policy_version 60000 (0.0005) [2023-03-08 02:00:35,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12902.4, 300 sec: 12385.2). Total num frames: 30744576. Throughput: 0: 13084.6. Samples: 30723528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:00:35,769][304334] Avg episode reward: [(0, '4656.347')] [2023-03-08 02:00:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000060048_30744576.pth... [2023-03-08 02:00:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000059288_30355456.pth [2023-03-08 02:00:36,871][304623] Updated weights for policy 0, policy_version 60080 (0.0004) [2023-03-08 02:00:39,864][304623] Updated weights for policy 0, policy_version 60160 (0.0004) [2023-03-08 02:00:40,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12970.7, 300 sec: 12385.2). Total num frames: 30810112. Throughput: 0: 13135.3. Samples: 30803248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:00:40,769][304334] Avg episode reward: [(0, '4658.048')] [2023-03-08 02:00:43,076][304623] Updated weights for policy 0, policy_version 60240 (0.0005) [2023-03-08 02:00:45,769][304334] Fps is (10 sec: 13107.3, 60 sec: 13038.9, 300 sec: 12385.2). Total num frames: 30875648. Throughput: 0: 13108.9. Samples: 30841372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:00:45,769][304334] Avg episode reward: [(0, '4622.123')] [2023-03-08 02:00:46,263][304623] Updated weights for policy 0, policy_version 60320 (0.0005) [2023-03-08 02:00:49,705][304623] Updated weights for policy 0, policy_version 60400 (0.0005) [2023-03-08 02:00:50,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13038.9, 300 sec: 12371.3). Total num frames: 30937088. Throughput: 0: 13014.7. Samples: 30916608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:00:50,769][304334] Avg episode reward: [(0, '4610.963')] [2023-03-08 02:00:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000060424_30937088.pth... [2023-03-08 02:00:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000059672_30552064.pth [2023-03-08 02:00:53,098][304623] Updated weights for policy 0, policy_version 60480 (0.0005) [2023-03-08 02:00:55,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12902.4, 300 sec: 12357.4). Total num frames: 30994432. Throughput: 0: 12864.1. Samples: 30988748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:00:55,769][304334] Avg episode reward: [(0, '4649.798')] [2023-03-08 02:00:56,442][304623] Updated weights for policy 0, policy_version 60560 (0.0005) [2023-03-08 02:00:59,855][304623] Updated weights for policy 0, policy_version 60640 (0.0005) [2023-03-08 02:01:00,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12834.1, 300 sec: 12371.3). Total num frames: 31055872. Throughput: 0: 12769.2. Samples: 31025156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:01:00,769][304334] Avg episode reward: [(0, '4496.548')] [2023-03-08 02:01:03,223][304623] Updated weights for policy 0, policy_version 60720 (0.0005) [2023-03-08 02:01:05,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12697.6, 300 sec: 12385.2). Total num frames: 31117312. Throughput: 0: 12642.4. Samples: 31097000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:01:05,769][304334] Avg episode reward: [(0, '4545.347')] [2023-03-08 02:01:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000060776_31117312.pth... [2023-03-08 02:01:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000060048_30744576.pth [2023-03-08 02:01:06,726][304623] Updated weights for policy 0, policy_version 60800 (0.0005) [2023-03-08 02:01:10,104][304623] Updated weights for policy 0, policy_version 60880 (0.0005) [2023-03-08 02:01:10,769][304334] Fps is (10 sec: 12287.8, 60 sec: 12697.6, 300 sec: 12385.2). Total num frames: 31178752. Throughput: 0: 12485.5. Samples: 31168828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:01:10,769][304334] Avg episode reward: [(0, '4461.078')] [2023-03-08 02:01:13,350][304623] Updated weights for policy 0, policy_version 60960 (0.0005) [2023-03-08 02:01:15,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12561.1, 300 sec: 12413.0). Total num frames: 31240192. Throughput: 0: 12482.1. Samples: 31207424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:01:15,769][304334] Avg episode reward: [(0, '4508.610')] [2023-03-08 02:01:16,602][304623] Updated weights for policy 0, policy_version 61040 (0.0005) [2023-03-08 02:01:19,617][304623] Updated weights for policy 0, policy_version 61120 (0.0004) [2023-03-08 02:01:20,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12440.7). Total num frames: 31305728. Throughput: 0: 12476.5. Samples: 31284972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:01:20,769][304334] Avg episode reward: [(0, '4672.750')] [2023-03-08 02:01:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000061144_31305728.pth... [2023-03-08 02:01:20,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000060424_30937088.pth [2023-03-08 02:01:22,676][304623] Updated weights for policy 0, policy_version 61200 (0.0005) [2023-03-08 02:01:25,635][304623] Updated weights for policy 0, policy_version 61280 (0.0004) [2023-03-08 02:01:25,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12629.3, 300 sec: 12468.5). Total num frames: 31375360. Throughput: 0: 12512.1. Samples: 31366292. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:01:25,769][304334] Avg episode reward: [(0, '4629.154')] [2023-03-08 02:01:28,571][304623] Updated weights for policy 0, policy_version 61360 (0.0004) [2023-03-08 02:01:30,769][304334] Fps is (10 sec: 13926.5, 60 sec: 12765.9, 300 sec: 12510.2). Total num frames: 31444992. Throughput: 0: 12596.0. Samples: 31408192. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:01:30,769][304334] Avg episode reward: [(0, '4682.109')] [2023-03-08 02:01:31,621][304623] Updated weights for policy 0, policy_version 61440 (0.0005) [2023-03-08 02:01:34,971][304623] Updated weights for policy 0, policy_version 61520 (0.0005) [2023-03-08 02:01:35,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12697.6, 300 sec: 12524.0). Total num frames: 31506432. Throughput: 0: 12654.5. Samples: 31486060. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:01:35,769][304334] Avg episode reward: [(0, '4699.835')] [2023-03-08 02:01:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000061536_31506432.pth... [2023-03-08 02:01:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000060776_31117312.pth [2023-03-08 02:01:38,418][304623] Updated weights for policy 0, policy_version 61600 (0.0005) [2023-03-08 02:01:40,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12561.1, 300 sec: 12524.0). Total num frames: 31563776. Throughput: 0: 12644.7. Samples: 31557760. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:01:40,769][304334] Avg episode reward: [(0, '4663.414')] [2023-03-08 02:01:41,784][304623] Updated weights for policy 0, policy_version 61680 (0.0005) [2023-03-08 02:01:45,123][304623] Updated weights for policy 0, policy_version 61760 (0.0005) [2023-03-08 02:01:45,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12551.8). Total num frames: 31629312. Throughput: 0: 12646.4. Samples: 31594244. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:01:45,769][304334] Avg episode reward: [(0, '4684.752')] [2023-03-08 02:01:48,258][304623] Updated weights for policy 0, policy_version 61840 (0.0005) [2023-03-08 02:01:50,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12629.3, 300 sec: 12579.6). Total num frames: 31694848. Throughput: 0: 12754.6. Samples: 31670956. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:01:50,769][304334] Avg episode reward: [(0, '4692.311')] [2023-03-08 02:01:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000061904_31694848.pth... [2023-03-08 02:01:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000061144_31305728.pth [2023-03-08 02:01:51,256][304623] Updated weights for policy 0, policy_version 61920 (0.0004) [2023-03-08 02:01:54,595][304623] Updated weights for policy 0, policy_version 62000 (0.0005) [2023-03-08 02:01:55,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 12593.5). Total num frames: 31756288. Throughput: 0: 12875.0. Samples: 31748200. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:01:55,769][304334] Avg episode reward: [(0, '4653.186')] [2023-03-08 02:01:57,962][304623] Updated weights for policy 0, policy_version 62080 (0.0005) [2023-03-08 02:02:00,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12697.6, 300 sec: 12593.5). Total num frames: 31817728. Throughput: 0: 12835.5. Samples: 31785024. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:02:00,769][304334] Avg episode reward: [(0, '4674.492')] [2023-03-08 02:02:01,359][304623] Updated weights for policy 0, policy_version 62160 (0.0005) [2023-03-08 02:02:04,764][304623] Updated weights for policy 0, policy_version 62240 (0.0005) [2023-03-08 02:02:05,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12629.3, 300 sec: 12579.6). Total num frames: 31875072. Throughput: 0: 12710.8. Samples: 31856960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:02:05,769][304334] Avg episode reward: [(0, '4686.987')] [2023-03-08 02:02:05,775][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000062264_31879168.pth... [2023-03-08 02:02:05,777][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000061536_31506432.pth [2023-03-08 02:02:08,199][304623] Updated weights for policy 0, policy_version 62320 (0.0005) [2023-03-08 02:02:10,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12629.3, 300 sec: 12593.5). Total num frames: 31936512. Throughput: 0: 12512.3. Samples: 31929348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:02:10,769][304334] Avg episode reward: [(0, '4679.038')] [2023-03-08 02:02:11,581][304623] Updated weights for policy 0, policy_version 62400 (0.0005) [2023-03-08 02:02:14,819][304623] Updated weights for policy 0, policy_version 62480 (0.0005) [2023-03-08 02:02:15,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 12593.5). Total num frames: 32002048. Throughput: 0: 12379.2. Samples: 31965256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:02:15,770][304334] Avg episode reward: [(0, '4691.061')] [2023-03-08 02:02:17,964][304623] Updated weights for policy 0, policy_version 62560 (0.0005) [2023-03-08 02:02:20,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12629.3, 300 sec: 12593.5). Total num frames: 32063488. Throughput: 0: 12391.2. Samples: 32043664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:02:20,769][304334] Avg episode reward: [(0, '4690.709')] [2023-03-08 02:02:20,774][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000062632_32067584.pth... [2023-03-08 02:02:20,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000061904_31694848.pth [2023-03-08 02:02:21,088][304623] Updated weights for policy 0, policy_version 62640 (0.0005) [2023-03-08 02:02:24,222][304623] Updated weights for policy 0, policy_version 62720 (0.0005) [2023-03-08 02:02:25,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12561.1, 300 sec: 12621.2). Total num frames: 32129024. Throughput: 0: 12550.0. Samples: 32122512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:02:25,769][304334] Avg episode reward: [(0, '4688.991')] [2023-03-08 02:02:27,279][304623] Updated weights for policy 0, policy_version 62800 (0.0004) [2023-03-08 02:02:30,483][304623] Updated weights for policy 0, policy_version 62880 (0.0005) [2023-03-08 02:02:30,769][304334] Fps is (10 sec: 13107.3, 60 sec: 12492.8, 300 sec: 12635.1). Total num frames: 32194560. Throughput: 0: 12621.7. Samples: 32162220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:02:30,769][304334] Avg episode reward: [(0, '4692.887')] [2023-03-08 02:02:33,991][304623] Updated weights for policy 0, policy_version 62960 (0.0006) [2023-03-08 02:02:35,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12635.1). Total num frames: 32256000. Throughput: 0: 12546.3. Samples: 32235540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:02:35,769][304334] Avg episode reward: [(0, '4615.552')] [2023-03-08 02:02:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000063000_32256000.pth... [2023-03-08 02:02:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000062264_31879168.pth [2023-03-08 02:02:37,415][304623] Updated weights for policy 0, policy_version 63040 (0.0005) [2023-03-08 02:02:40,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12492.8, 300 sec: 12607.3). Total num frames: 32313344. Throughput: 0: 12411.7. Samples: 32306728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:02:40,769][304334] Avg episode reward: [(0, '4646.212')] [2023-03-08 02:02:40,911][304623] Updated weights for policy 0, policy_version 63120 (0.0005) [2023-03-08 02:02:44,136][304623] Updated weights for policy 0, policy_version 63200 (0.0004) [2023-03-08 02:02:45,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12621.2). Total num frames: 32378880. Throughput: 0: 12407.2. Samples: 32343348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:02:45,769][304334] Avg episode reward: [(0, '4676.460')] [2023-03-08 02:02:47,284][304623] Updated weights for policy 0, policy_version 63280 (0.0004) [2023-03-08 02:02:50,416][304623] Updated weights for policy 0, policy_version 63360 (0.0005) [2023-03-08 02:02:50,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12492.8, 300 sec: 12621.2). Total num frames: 32444416. Throughput: 0: 12546.2. Samples: 32421540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:02:50,769][304334] Avg episode reward: [(0, '4690.935')] [2023-03-08 02:02:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000063368_32444416.pth... [2023-03-08 02:02:50,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000062632_32067584.pth [2023-03-08 02:02:53,591][304623] Updated weights for policy 0, policy_version 63440 (0.0004) [2023-03-08 02:02:55,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12561.1, 300 sec: 12607.3). Total num frames: 32509952. Throughput: 0: 12692.3. Samples: 32500500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:02:55,769][304334] Avg episode reward: [(0, '4690.835')] [2023-03-08 02:02:56,546][304623] Updated weights for policy 0, policy_version 63520 (0.0003) [2023-03-08 02:03:00,031][304623] Updated weights for policy 0, policy_version 63600 (0.0005) [2023-03-08 02:03:00,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12561.1, 300 sec: 12593.5). Total num frames: 32571392. Throughput: 0: 12741.7. Samples: 32538632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:03:00,769][304334] Avg episode reward: [(0, '4691.612')] [2023-03-08 02:03:03,510][304623] Updated weights for policy 0, policy_version 63680 (0.0005) [2023-03-08 02:03:05,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12629.3, 300 sec: 12579.6). Total num frames: 32632832. Throughput: 0: 12575.5. Samples: 32609560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:03:05,769][304334] Avg episode reward: [(0, '4690.945')] [2023-03-08 02:03:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000063736_32632832.pth... [2023-03-08 02:03:05,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000063000_32256000.pth [2023-03-08 02:03:06,763][304623] Updated weights for policy 0, policy_version 63760 (0.0004) [2023-03-08 02:03:10,118][304623] Updated weights for policy 0, policy_version 63840 (0.0005) [2023-03-08 02:03:10,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12561.1, 300 sec: 12565.7). Total num frames: 32690176. Throughput: 0: 12485.6. Samples: 32684364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:03:10,769][304334] Avg episode reward: [(0, '4686.955')] [2023-03-08 02:03:13,582][304623] Updated weights for policy 0, policy_version 63920 (0.0005) [2023-03-08 02:03:15,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12492.8, 300 sec: 12565.7). Total num frames: 32751616. Throughput: 0: 12389.0. Samples: 32719728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:03:15,769][304334] Avg episode reward: [(0, '4684.664')] [2023-03-08 02:03:17,045][304623] Updated weights for policy 0, policy_version 64000 (0.0005) [2023-03-08 02:03:20,419][304623] Updated weights for policy 0, policy_version 64080 (0.0005) [2023-03-08 02:03:20,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12492.8, 300 sec: 12565.7). Total num frames: 32813056. Throughput: 0: 12342.5. Samples: 32790952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:03:20,769][304334] Avg episode reward: [(0, '4702.204')] [2023-03-08 02:03:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000064088_32813056.pth... [2023-03-08 02:03:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000063368_32444416.pth [2023-03-08 02:03:23,534][304623] Updated weights for policy 0, policy_version 64160 (0.0004) [2023-03-08 02:03:25,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12593.5). Total num frames: 32878592. Throughput: 0: 12514.9. Samples: 32869900. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:03:25,769][304334] Avg episode reward: [(0, '4692.734')] [2023-03-08 02:03:26,633][304623] Updated weights for policy 0, policy_version 64240 (0.0004) [2023-03-08 02:03:29,755][304623] Updated weights for policy 0, policy_version 64320 (0.0004) [2023-03-08 02:03:30,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12492.8, 300 sec: 12607.3). Total num frames: 32944128. Throughput: 0: 12546.0. Samples: 32907920. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:03:30,769][304334] Avg episode reward: [(0, '4696.687')] [2023-03-08 02:03:33,148][304623] Updated weights for policy 0, policy_version 64400 (0.0005) [2023-03-08 02:03:35,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12492.8, 300 sec: 12607.3). Total num frames: 33005568. Throughput: 0: 12485.1. Samples: 32983372. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:03:35,769][304334] Avg episode reward: [(0, '4678.540')] [2023-03-08 02:03:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000064464_33005568.pth... [2023-03-08 02:03:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000063736_32632832.pth [2023-03-08 02:03:36,353][304623] Updated weights for policy 0, policy_version 64480 (0.0004) [2023-03-08 02:03:39,558][304623] Updated weights for policy 0, policy_version 64560 (0.0004) [2023-03-08 02:03:40,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12561.1, 300 sec: 12593.5). Total num frames: 33067008. Throughput: 0: 12431.9. Samples: 33059936. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:03:40,769][304334] Avg episode reward: [(0, '4692.953')] [2023-03-08 02:03:42,793][304623] Updated weights for policy 0, policy_version 64640 (0.0005) [2023-03-08 02:03:45,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12561.1, 300 sec: 12593.5). Total num frames: 33132544. Throughput: 0: 12435.5. Samples: 33098228. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:03:45,769][304334] Avg episode reward: [(0, '4692.664')] [2023-03-08 02:03:45,943][304623] Updated weights for policy 0, policy_version 64720 (0.0005) [2023-03-08 02:03:49,108][304623] Updated weights for policy 0, policy_version 64800 (0.0004) [2023-03-08 02:03:50,769][304334] Fps is (10 sec: 13107.0, 60 sec: 12561.0, 300 sec: 12607.3). Total num frames: 33198080. Throughput: 0: 12590.0. Samples: 33176112. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:03:50,769][304334] Avg episode reward: [(0, '4692.944')] [2023-03-08 02:03:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000064840_33198080.pth... [2023-03-08 02:03:50,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000064088_32813056.pth [2023-03-08 02:03:52,269][304623] Updated weights for policy 0, policy_version 64880 (0.0004) [2023-03-08 02:03:55,487][304623] Updated weights for policy 0, policy_version 64960 (0.0005) [2023-03-08 02:03:55,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12492.8, 300 sec: 12593.5). Total num frames: 33259520. Throughput: 0: 12633.6. Samples: 33252876. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:03:55,769][304334] Avg episode reward: [(0, '4683.857')] [2023-03-08 02:03:58,646][304623] Updated weights for policy 0, policy_version 65040 (0.0005) [2023-03-08 02:04:00,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12561.1, 300 sec: 12607.3). Total num frames: 33325056. Throughput: 0: 12723.7. Samples: 33292296. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:04:00,769][304334] Avg episode reward: [(0, '4687.113')] [2023-03-08 02:04:02,034][304623] Updated weights for policy 0, policy_version 65120 (0.0005) [2023-03-08 02:04:05,253][304623] Updated weights for policy 0, policy_version 65200 (0.0005) [2023-03-08 02:04:05,769][304334] Fps is (10 sec: 12697.4, 60 sec: 12561.1, 300 sec: 12593.5). Total num frames: 33386496. Throughput: 0: 12779.5. Samples: 33366028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:04:05,769][304334] Avg episode reward: [(0, '4704.848')] [2023-03-08 02:04:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000065208_33386496.pth... [2023-03-08 02:04:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000064464_33005568.pth [2023-03-08 02:04:08,434][304623] Updated weights for policy 0, policy_version 65280 (0.0004) [2023-03-08 02:04:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 12621.2). Total num frames: 33452032. Throughput: 0: 12717.4. Samples: 33442184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:04:10,769][304334] Avg episode reward: [(0, '4691.754')] [2023-03-08 02:04:11,687][304623] Updated weights for policy 0, policy_version 65360 (0.0005) [2023-03-08 02:04:14,980][304623] Updated weights for policy 0, policy_version 65440 (0.0005) [2023-03-08 02:04:15,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 12621.2). Total num frames: 33513472. Throughput: 0: 12730.0. Samples: 33480768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:04:15,769][304334] Avg episode reward: [(0, '4706.012')] [2023-03-08 02:04:18,039][304623] Updated weights for policy 0, policy_version 65520 (0.0004) [2023-03-08 02:04:20,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12765.9, 300 sec: 12635.1). Total num frames: 33579008. Throughput: 0: 12782.7. Samples: 33558592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:04:20,769][304334] Avg episode reward: [(0, '4697.662')] [2023-03-08 02:04:20,771][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000065584_33579008.pth... [2023-03-08 02:04:20,773][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000064840_33198080.pth [2023-03-08 02:04:21,145][304623] Updated weights for policy 0, policy_version 65600 (0.0005) [2023-03-08 02:04:24,353][304623] Updated weights for policy 0, policy_version 65680 (0.0005) [2023-03-08 02:04:25,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12765.9, 300 sec: 12649.0). Total num frames: 33644544. Throughput: 0: 12809.2. Samples: 33636352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:04:25,769][304334] Avg episode reward: [(0, '4703.284')] [2023-03-08 02:04:27,479][304623] Updated weights for policy 0, policy_version 65760 (0.0004) [2023-03-08 02:04:30,452][304623] Updated weights for policy 0, policy_version 65840 (0.0004) [2023-03-08 02:04:30,769][304334] Fps is (10 sec: 13516.9, 60 sec: 12834.1, 300 sec: 12690.7). Total num frames: 33714176. Throughput: 0: 12840.7. Samples: 33676060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:04:30,769][304334] Avg episode reward: [(0, '4697.449')] [2023-03-08 02:04:33,566][304623] Updated weights for policy 0, policy_version 65920 (0.0005) [2023-03-08 02:04:35,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12834.1, 300 sec: 12690.7). Total num frames: 33775616. Throughput: 0: 12887.3. Samples: 33756040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:04:35,769][304334] Avg episode reward: [(0, '4693.288')] [2023-03-08 02:04:35,809][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000065976_33779712.pth... [2023-03-08 02:04:35,813][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000065208_33386496.pth [2023-03-08 02:04:36,754][304623] Updated weights for policy 0, policy_version 66000 (0.0004) [2023-03-08 02:04:40,034][304623] Updated weights for policy 0, policy_version 66080 (0.0004) [2023-03-08 02:04:40,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12902.4, 300 sec: 12704.5). Total num frames: 33841152. Throughput: 0: 12884.5. Samples: 33832680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:04:40,780][304334] Avg episode reward: [(0, '4697.107')] [2023-03-08 02:04:43,460][304623] Updated weights for policy 0, policy_version 66160 (0.0006) [2023-03-08 02:04:45,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12765.9, 300 sec: 12690.7). Total num frames: 33898496. Throughput: 0: 12797.0. Samples: 33868160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:04:45,770][304334] Avg episode reward: [(0, '4683.275')] [2023-03-08 02:04:46,790][304623] Updated weights for policy 0, policy_version 66240 (0.0005) [2023-03-08 02:04:49,957][304623] Updated weights for policy 0, policy_version 66320 (0.0004) [2023-03-08 02:04:50,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12765.9, 300 sec: 12690.7). Total num frames: 33964032. Throughput: 0: 12835.3. Samples: 33943616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:04:50,780][304334] Avg episode reward: [(0, '4684.261')] [2023-03-08 02:04:50,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000066336_33964032.pth... [2023-03-08 02:04:50,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000065584_33579008.pth [2023-03-08 02:04:52,998][304623] Updated weights for policy 0, policy_version 66400 (0.0004) [2023-03-08 02:04:55,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12834.1, 300 sec: 12690.7). Total num frames: 34029568. Throughput: 0: 12872.5. Samples: 34021448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:04:55,780][304334] Avg episode reward: [(0, '4687.851')] [2023-03-08 02:04:56,281][304623] Updated weights for policy 0, policy_version 66480 (0.0005) [2023-03-08 02:04:59,431][304623] Updated weights for policy 0, policy_version 66560 (0.0004) [2023-03-08 02:05:00,769][304334] Fps is (10 sec: 13107.3, 60 sec: 12834.1, 300 sec: 12676.8). Total num frames: 34095104. Throughput: 0: 12843.6. Samples: 34058732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:05:00,769][304334] Avg episode reward: [(0, '4674.989')] [2023-03-08 02:05:02,505][304623] Updated weights for policy 0, policy_version 66640 (0.0004) [2023-03-08 02:05:05,532][304623] Updated weights for policy 0, policy_version 66720 (0.0004) [2023-03-08 02:05:05,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12902.4, 300 sec: 12690.7). Total num frames: 34160640. Throughput: 0: 12901.3. Samples: 34139148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:05:05,780][304334] Avg episode reward: [(0, '4700.509')] [2023-03-08 02:05:05,782][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000066720_34160640.pth... [2023-03-08 02:05:05,784][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000065976_33779712.pth [2023-03-08 02:05:08,594][304623] Updated weights for policy 0, policy_version 66800 (0.0005) [2023-03-08 02:05:10,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12970.7, 300 sec: 12690.7). Total num frames: 34230272. Throughput: 0: 12977.2. Samples: 34220324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:05:10,780][304334] Avg episode reward: [(0, '4681.554')] [2023-03-08 02:05:11,614][304623] Updated weights for policy 0, policy_version 66880 (0.0004) [2023-03-08 02:05:14,671][304623] Updated weights for policy 0, policy_version 66960 (0.0004) [2023-03-08 02:05:15,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13038.9, 300 sec: 12704.5). Total num frames: 34295808. Throughput: 0: 12998.5. Samples: 34260992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:05:15,769][304334] Avg episode reward: [(0, '4654.046')] [2023-03-08 02:05:17,645][304623] Updated weights for policy 0, policy_version 67040 (0.0004) [2023-03-08 02:05:20,701][304623] Updated weights for policy 0, policy_version 67120 (0.0005) [2023-03-08 02:05:20,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13107.2, 300 sec: 12704.5). Total num frames: 34365440. Throughput: 0: 13020.6. Samples: 34341968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:05:20,778][304334] Avg episode reward: [(0, '4664.896')] [2023-03-08 02:05:20,781][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000067120_34365440.pth... [2023-03-08 02:05:20,784][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000066336_33964032.pth [2023-03-08 02:05:23,785][304623] Updated weights for policy 0, policy_version 67200 (0.0005) [2023-03-08 02:05:25,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13107.2, 300 sec: 12718.4). Total num frames: 34430976. Throughput: 0: 13113.3. Samples: 34422780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:05:25,769][304334] Avg episode reward: [(0, '4651.777')] [2023-03-08 02:05:26,768][304623] Updated weights for policy 0, policy_version 67280 (0.0004) [2023-03-08 02:05:29,967][304623] Updated weights for policy 0, policy_version 67360 (0.0004) [2023-03-08 02:05:30,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13038.9, 300 sec: 12718.4). Total num frames: 34496512. Throughput: 0: 13225.3. Samples: 34463300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:05:30,769][304334] Avg episode reward: [(0, '4695.634')] [2023-03-08 02:05:32,985][304623] Updated weights for policy 0, policy_version 67440 (0.0003) [2023-03-08 02:05:35,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13107.2, 300 sec: 12718.4). Total num frames: 34562048. Throughput: 0: 13289.4. Samples: 34541640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:05:35,769][304334] Avg episode reward: [(0, '4687.597')] [2023-03-08 02:05:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000067504_34562048.pth... [2023-03-08 02:05:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000066720_34160640.pth [2023-03-08 02:05:36,275][304623] Updated weights for policy 0, policy_version 67520 (0.0004) [2023-03-08 02:05:39,512][304623] Updated weights for policy 0, policy_version 67600 (0.0005) [2023-03-08 02:05:40,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13038.9, 300 sec: 12704.5). Total num frames: 34623488. Throughput: 0: 13234.9. Samples: 34617020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:05:40,769][304334] Avg episode reward: [(0, '4696.231')] [2023-03-08 02:05:42,776][304623] Updated weights for policy 0, policy_version 67680 (0.0005) [2023-03-08 02:05:45,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13175.4, 300 sec: 12718.4). Total num frames: 34689024. Throughput: 0: 13250.1. Samples: 34654988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:05:45,769][304334] Avg episode reward: [(0, '4679.952')] [2023-03-08 02:05:45,985][304623] Updated weights for policy 0, policy_version 67760 (0.0005) [2023-03-08 02:05:49,099][304623] Updated weights for policy 0, policy_version 67840 (0.0004) [2023-03-08 02:05:50,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13175.5, 300 sec: 12746.2). Total num frames: 34754560. Throughput: 0: 13182.4. Samples: 34732356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:05:50,769][304334] Avg episode reward: [(0, '4687.338')] [2023-03-08 02:05:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000067880_34754560.pth... [2023-03-08 02:05:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000067120_34365440.pth [2023-03-08 02:05:52,259][304623] Updated weights for policy 0, policy_version 67920 (0.0004) [2023-03-08 02:05:55,587][304623] Updated weights for policy 0, policy_version 68000 (0.0005) [2023-03-08 02:05:55,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13107.2, 300 sec: 12746.2). Total num frames: 34816000. Throughput: 0: 13055.4. Samples: 34807816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:05:55,769][304334] Avg episode reward: [(0, '4678.322')] [2023-03-08 02:05:58,982][304623] Updated weights for policy 0, policy_version 68080 (0.0005) [2023-03-08 02:06:00,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13038.9, 300 sec: 12746.2). Total num frames: 34877440. Throughput: 0: 12972.3. Samples: 34844744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:06:00,769][304334] Avg episode reward: [(0, '4701.893')] [2023-03-08 02:06:02,448][304623] Updated weights for policy 0, policy_version 68160 (0.0005) [2023-03-08 02:06:05,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12902.4, 300 sec: 12732.3). Total num frames: 34934784. Throughput: 0: 12780.2. Samples: 34917076. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:06:05,769][304334] Avg episode reward: [(0, '4684.441')] [2023-03-08 02:06:05,806][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000068240_34938880.pth... [2023-03-08 02:06:05,807][304623] Updated weights for policy 0, policy_version 68240 (0.0005) [2023-03-08 02:06:05,807][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000067504_34562048.pth [2023-03-08 02:06:09,246][304623] Updated weights for policy 0, policy_version 68320 (0.0005) [2023-03-08 02:06:10,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12765.9, 300 sec: 12732.3). Total num frames: 34996224. Throughput: 0: 12562.8. Samples: 34988104. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:06:10,769][304334] Avg episode reward: [(0, '4683.638')] [2023-03-08 02:06:12,646][304623] Updated weights for policy 0, policy_version 68400 (0.0005) [2023-03-08 02:06:15,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12697.6, 300 sec: 12718.4). Total num frames: 35057664. Throughput: 0: 12480.1. Samples: 35024904. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:06:15,769][304334] Avg episode reward: [(0, '4656.163')] [2023-03-08 02:06:15,996][304623] Updated weights for policy 0, policy_version 68480 (0.0005) [2023-03-08 02:06:19,407][304623] Updated weights for policy 0, policy_version 68560 (0.0005) [2023-03-08 02:06:20,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12690.7). Total num frames: 35119104. Throughput: 0: 12354.1. Samples: 35097576. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:06:20,769][304334] Avg episode reward: [(0, '4623.164')] [2023-03-08 02:06:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000068592_35119104.pth... [2023-03-08 02:06:20,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000067880_34754560.pth [2023-03-08 02:06:22,557][304623] Updated weights for policy 0, policy_version 68640 (0.0004) [2023-03-08 02:06:25,690][304623] Updated weights for policy 0, policy_version 68720 (0.0004) [2023-03-08 02:06:25,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12676.8). Total num frames: 35184640. Throughput: 0: 12431.0. Samples: 35176416. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:06:25,769][304334] Avg episode reward: [(0, '4654.548')] [2023-03-08 02:06:28,914][304623] Updated weights for policy 0, policy_version 68800 (0.0004) [2023-03-08 02:06:30,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12676.8). Total num frames: 35246080. Throughput: 0: 12407.6. Samples: 35213328. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:06:30,769][304334] Avg episode reward: [(0, '4682.087')] [2023-03-08 02:06:32,288][304623] Updated weights for policy 0, policy_version 68880 (0.0005) [2023-03-08 02:06:35,688][304623] Updated weights for policy 0, policy_version 68960 (0.0006) [2023-03-08 02:06:35,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 12690.7). Total num frames: 35307520. Throughput: 0: 12327.7. Samples: 35287104. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:06:35,769][304334] Avg episode reward: [(0, '4690.352')] [2023-03-08 02:06:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000068960_35307520.pth... [2023-03-08 02:06:35,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000068240_34938880.pth [2023-03-08 02:06:39,042][304623] Updated weights for policy 0, policy_version 69040 (0.0004) [2023-03-08 02:06:40,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12676.8). Total num frames: 35368960. Throughput: 0: 12289.4. Samples: 35360840. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:06:40,769][304334] Avg episode reward: [(0, '4686.051')] [2023-03-08 02:06:42,091][304623] Updated weights for policy 0, policy_version 69120 (0.0003) [2023-03-08 02:06:45,399][304623] Updated weights for policy 0, policy_version 69200 (0.0005) [2023-03-08 02:06:45,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12424.5, 300 sec: 12676.8). Total num frames: 35434496. Throughput: 0: 12364.1. Samples: 35401128. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:06:45,769][304334] Avg episode reward: [(0, '4689.646')] [2023-03-08 02:06:48,611][304623] Updated weights for policy 0, policy_version 69280 (0.0004) [2023-03-08 02:06:50,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12356.3, 300 sec: 12676.8). Total num frames: 35495936. Throughput: 0: 12410.6. Samples: 35475552. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:06:50,769][304334] Avg episode reward: [(0, '4685.767')] [2023-03-08 02:06:50,788][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000069336_35500032.pth... [2023-03-08 02:06:50,790][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000068592_35119104.pth [2023-03-08 02:06:51,701][304623] Updated weights for policy 0, policy_version 69360 (0.0003) [2023-03-08 02:06:54,750][304623] Updated weights for policy 0, policy_version 69440 (0.0004) [2023-03-08 02:06:55,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12492.8, 300 sec: 12704.5). Total num frames: 35565568. Throughput: 0: 12628.3. Samples: 35556376. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:06:55,769][304334] Avg episode reward: [(0, '4686.072')] [2023-03-08 02:06:58,104][304623] Updated weights for policy 0, policy_version 69520 (0.0005) [2023-03-08 02:07:00,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12424.5, 300 sec: 12704.5). Total num frames: 35622912. Throughput: 0: 12625.2. Samples: 35593040. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:07:00,769][304334] Avg episode reward: [(0, '4674.473')] [2023-03-08 02:07:01,521][304623] Updated weights for policy 0, policy_version 69600 (0.0005) [2023-03-08 02:07:05,003][304623] Updated weights for policy 0, policy_version 69680 (0.0005) [2023-03-08 02:07:05,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12492.8, 300 sec: 12704.5). Total num frames: 35684352. Throughput: 0: 12584.7. Samples: 35663888. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:07:05,769][304334] Avg episode reward: [(0, '4682.248')] [2023-03-08 02:07:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000069696_35684352.pth... [2023-03-08 02:07:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000068960_35307520.pth [2023-03-08 02:07:08,396][304623] Updated weights for policy 0, policy_version 69760 (0.0005) [2023-03-08 02:07:10,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12424.6, 300 sec: 12676.8). Total num frames: 35741696. Throughput: 0: 12444.3. Samples: 35736408. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:07:10,769][304334] Avg episode reward: [(0, '4685.663')] [2023-03-08 02:07:11,792][304623] Updated weights for policy 0, policy_version 69840 (0.0005) [2023-03-08 02:07:15,139][304623] Updated weights for policy 0, policy_version 69920 (0.0005) [2023-03-08 02:07:15,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 12676.8). Total num frames: 35803136. Throughput: 0: 12429.9. Samples: 35772676. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:07:15,769][304334] Avg episode reward: [(0, '4686.295')] [2023-03-08 02:07:18,540][304623] Updated weights for policy 0, policy_version 70000 (0.0005) [2023-03-08 02:07:20,769][304334] Fps is (10 sec: 12287.8, 60 sec: 12424.5, 300 sec: 12662.9). Total num frames: 35864576. Throughput: 0: 12405.9. Samples: 35845368. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:07:20,769][304334] Avg episode reward: [(0, '4684.988')] [2023-03-08 02:07:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000070048_35864576.pth... [2023-03-08 02:07:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000069336_35500032.pth [2023-03-08 02:07:22,005][304623] Updated weights for policy 0, policy_version 70080 (0.0005) [2023-03-08 02:07:25,362][304623] Updated weights for policy 0, policy_version 70160 (0.0005) [2023-03-08 02:07:25,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 12649.0). Total num frames: 35926016. Throughput: 0: 12345.7. Samples: 35916396. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:07:25,769][304334] Avg episode reward: [(0, '4703.758')] [2023-03-08 02:07:28,479][304623] Updated weights for policy 0, policy_version 70240 (0.0004) [2023-03-08 02:07:30,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 12649.0). Total num frames: 35987456. Throughput: 0: 12361.7. Samples: 35957404. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:07:30,769][304334] Avg episode reward: [(0, '4709.323')] [2023-03-08 02:07:31,987][304623] Updated weights for policy 0, policy_version 70320 (0.0005) [2023-03-08 02:07:35,507][304623] Updated weights for policy 0, policy_version 70400 (0.0005) [2023-03-08 02:07:35,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 12649.0). Total num frames: 36044800. Throughput: 0: 12270.8. Samples: 36027736. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:07:35,769][304334] Avg episode reward: [(0, '4691.851')] [2023-03-08 02:07:35,771][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000070400_36044800.pth... [2023-03-08 02:07:35,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000069696_35684352.pth [2023-03-08 02:07:38,840][304623] Updated weights for policy 0, policy_version 70480 (0.0005) [2023-03-08 02:07:40,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 12635.1). Total num frames: 36106240. Throughput: 0: 12065.2. Samples: 36099308. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:07:40,769][304334] Avg episode reward: [(0, '4701.349')] [2023-03-08 02:07:42,272][304623] Updated weights for policy 0, policy_version 70560 (0.0005) [2023-03-08 02:07:45,751][304623] Updated weights for policy 0, policy_version 70640 (0.0005) [2023-03-08 02:07:45,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12621.2). Total num frames: 36167680. Throughput: 0: 12043.0. Samples: 36134976. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:07:45,769][304334] Avg episode reward: [(0, '4695.802')] [2023-03-08 02:07:49,103][304623] Updated weights for policy 0, policy_version 70720 (0.0005) [2023-03-08 02:07:50,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12593.5). Total num frames: 36225024. Throughput: 0: 12084.2. Samples: 36207676. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:07:50,769][304334] Avg episode reward: [(0, '4698.762')] [2023-03-08 02:07:50,810][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000070760_36229120.pth... [2023-03-08 02:07:50,812][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000070048_35864576.pth [2023-03-08 02:07:52,431][304623] Updated weights for policy 0, policy_version 70800 (0.0005) [2023-03-08 02:07:55,426][304623] Updated weights for policy 0, policy_version 70880 (0.0004) [2023-03-08 02:07:55,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12151.5, 300 sec: 12621.2). Total num frames: 36294656. Throughput: 0: 12174.9. Samples: 36284280. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:07:55,769][304334] Avg episode reward: [(0, '4682.963')] [2023-03-08 02:07:58,403][304623] Updated weights for policy 0, policy_version 70960 (0.0004) [2023-03-08 02:08:00,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12288.0, 300 sec: 12635.1). Total num frames: 36360192. Throughput: 0: 12295.8. Samples: 36325984. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:08:00,769][304334] Avg episode reward: [(0, '4694.700')] [2023-03-08 02:08:01,563][304623] Updated weights for policy 0, policy_version 71040 (0.0005) [2023-03-08 02:08:04,877][304623] Updated weights for policy 0, policy_version 71120 (0.0005) [2023-03-08 02:08:05,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 12649.0). Total num frames: 36421632. Throughput: 0: 12382.6. Samples: 36402584. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:08:05,769][304334] Avg episode reward: [(0, '4672.769')] [2023-03-08 02:08:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000071136_36421632.pth... [2023-03-08 02:08:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000070400_36044800.pth [2023-03-08 02:08:08,095][304623] Updated weights for policy 0, policy_version 71200 (0.0005) [2023-03-08 02:08:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 12662.9). Total num frames: 36487168. Throughput: 0: 12525.2. Samples: 36480032. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:08:10,769][304334] Avg episode reward: [(0, '4668.280')] [2023-03-08 02:08:11,080][304623] Updated weights for policy 0, policy_version 71280 (0.0004) [2023-03-08 02:08:14,342][304623] Updated weights for policy 0, policy_version 71360 (0.0005) [2023-03-08 02:08:15,769][304334] Fps is (10 sec: 13107.3, 60 sec: 12492.8, 300 sec: 12676.8). Total num frames: 36552704. Throughput: 0: 12500.7. Samples: 36519936. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:08:15,769][304334] Avg episode reward: [(0, '4680.047')] [2023-03-08 02:08:17,720][304623] Updated weights for policy 0, policy_version 71440 (0.0005) [2023-03-08 02:08:20,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 12649.0). Total num frames: 36610048. Throughput: 0: 12548.1. Samples: 36592404. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:08:20,769][304334] Avg episode reward: [(0, '4671.267')] [2023-03-08 02:08:20,779][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000071512_36614144.pth... [2023-03-08 02:08:20,781][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000070760_36229120.pth [2023-03-08 02:08:21,092][304623] Updated weights for policy 0, policy_version 71520 (0.0005) [2023-03-08 02:08:24,220][304623] Updated weights for policy 0, policy_version 71600 (0.0005) [2023-03-08 02:08:25,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12561.1, 300 sec: 12662.9). Total num frames: 36679680. Throughput: 0: 12657.1. Samples: 36668876. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:08:25,769][304334] Avg episode reward: [(0, '4658.046')] [2023-03-08 02:08:27,283][304623] Updated weights for policy 0, policy_version 71680 (0.0005) [2023-03-08 02:08:30,271][304623] Updated weights for policy 0, policy_version 71760 (0.0005) [2023-03-08 02:08:30,769][304334] Fps is (10 sec: 13516.9, 60 sec: 12629.3, 300 sec: 12676.8). Total num frames: 36745216. Throughput: 0: 12767.1. Samples: 36709496. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:08:30,769][304334] Avg episode reward: [(0, '4690.375')] [2023-03-08 02:08:33,227][304623] Updated weights for policy 0, policy_version 71840 (0.0004) [2023-03-08 02:08:35,769][304334] Fps is (10 sec: 13107.0, 60 sec: 12765.8, 300 sec: 12690.7). Total num frames: 36810752. Throughput: 0: 12966.5. Samples: 36791168. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:08:35,769][304334] Avg episode reward: [(0, '4688.064')] [2023-03-08 02:08:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000071896_36810752.pth... [2023-03-08 02:08:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000071136_36421632.pth [2023-03-08 02:08:36,587][304623] Updated weights for policy 0, policy_version 71920 (0.0005) [2023-03-08 02:08:39,926][304623] Updated weights for policy 0, policy_version 72000 (0.0005) [2023-03-08 02:08:40,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12765.9, 300 sec: 12676.8). Total num frames: 36872192. Throughput: 0: 12888.2. Samples: 36864248. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:08:40,769][304334] Avg episode reward: [(0, '4686.953')] [2023-03-08 02:08:43,338][304623] Updated weights for policy 0, policy_version 72080 (0.0005) [2023-03-08 02:08:45,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12765.9, 300 sec: 12662.9). Total num frames: 36933632. Throughput: 0: 12775.1. Samples: 36900864. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:08:45,769][304334] Avg episode reward: [(0, '4698.176')] [2023-03-08 02:08:46,583][304623] Updated weights for policy 0, policy_version 72160 (0.0004) [2023-03-08 02:08:49,496][304623] Updated weights for policy 0, policy_version 72240 (0.0003) [2023-03-08 02:08:50,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12970.7, 300 sec: 12690.7). Total num frames: 37003264. Throughput: 0: 12821.1. Samples: 36979532. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:08:50,769][304334] Avg episode reward: [(0, '4667.965')] [2023-03-08 02:08:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000072272_37003264.pth... [2023-03-08 02:08:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000071512_36614144.pth [2023-03-08 02:08:52,560][304623] Updated weights for policy 0, policy_version 72320 (0.0003) [2023-03-08 02:08:55,668][304623] Updated weights for policy 0, policy_version 72400 (0.0003) [2023-03-08 02:08:55,769][304334] Fps is (10 sec: 13516.7, 60 sec: 12902.4, 300 sec: 12690.7). Total num frames: 37068800. Throughput: 0: 12893.2. Samples: 37060228. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:08:55,769][304334] Avg episode reward: [(0, '4659.531')] [2023-03-08 02:08:58,687][304623] Updated weights for policy 0, policy_version 72480 (0.0003) [2023-03-08 02:09:00,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12902.4, 300 sec: 12704.5). Total num frames: 37134336. Throughput: 0: 12908.4. Samples: 37100816. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:09:00,769][304334] Avg episode reward: [(0, '4697.230')] [2023-03-08 02:09:01,700][304623] Updated weights for policy 0, policy_version 72560 (0.0003) [2023-03-08 02:09:04,722][304623] Updated weights for policy 0, policy_version 72640 (0.0003) [2023-03-08 02:09:05,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13038.9, 300 sec: 12718.4). Total num frames: 37203968. Throughput: 0: 13087.7. Samples: 37181348. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:09:05,769][304334] Avg episode reward: [(0, '4680.337')] [2023-03-08 02:09:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000072664_37203968.pth... [2023-03-08 02:09:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000071896_36810752.pth [2023-03-08 02:09:07,719][304623] Updated weights for policy 0, policy_version 72720 (0.0003) [2023-03-08 02:09:10,736][304623] Updated weights for policy 0, policy_version 72800 (0.0003) [2023-03-08 02:09:10,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13107.2, 300 sec: 12746.2). Total num frames: 37273600. Throughput: 0: 13224.6. Samples: 37263984. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:09:10,769][304334] Avg episode reward: [(0, '4658.762')] [2023-03-08 02:09:13,791][304623] Updated weights for policy 0, policy_version 72880 (0.0003) [2023-03-08 02:09:15,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13107.2, 300 sec: 12746.2). Total num frames: 37339136. Throughput: 0: 13199.3. Samples: 37303464. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:09:15,769][304334] Avg episode reward: [(0, '4652.872')] [2023-03-08 02:09:16,836][304623] Updated weights for policy 0, policy_version 72960 (0.0003) [2023-03-08 02:09:19,866][304623] Updated weights for policy 0, policy_version 73040 (0.0004) [2023-03-08 02:09:20,769][304334] Fps is (10 sec: 13107.1, 60 sec: 13243.7, 300 sec: 12746.2). Total num frames: 37404672. Throughput: 0: 13179.7. Samples: 37384256. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:09:20,769][304334] Avg episode reward: [(0, '4688.560')] [2023-03-08 02:09:20,787][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000073064_37408768.pth... [2023-03-08 02:09:20,789][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000072272_37003264.pth [2023-03-08 02:09:22,884][304623] Updated weights for policy 0, policy_version 73120 (0.0005) [2023-03-08 02:09:25,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13243.7, 300 sec: 12746.2). Total num frames: 37474304. Throughput: 0: 13376.4. Samples: 37466184. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:09:25,769][304334] Avg episode reward: [(0, '4692.108')] [2023-03-08 02:09:25,819][304623] Updated weights for policy 0, policy_version 73200 (0.0004) [2023-03-08 02:09:28,813][304623] Updated weights for policy 0, policy_version 73280 (0.0004) [2023-03-08 02:09:30,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13312.0, 300 sec: 12774.0). Total num frames: 37543936. Throughput: 0: 13472.9. Samples: 37507144. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:09:30,769][304334] Avg episode reward: [(0, '4689.525')] [2023-03-08 02:09:31,810][304623] Updated weights for policy 0, policy_version 73360 (0.0004) [2023-03-08 02:09:34,854][304623] Updated weights for policy 0, policy_version 73440 (0.0005) [2023-03-08 02:09:35,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13312.0, 300 sec: 12774.0). Total num frames: 37609472. Throughput: 0: 13545.0. Samples: 37589056. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:09:35,769][304334] Avg episode reward: [(0, '4666.541')] [2023-03-08 02:09:35,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000073464_37613568.pth... [2023-03-08 02:09:35,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000072664_37203968.pth [2023-03-08 02:09:37,818][304623] Updated weights for policy 0, policy_version 73520 (0.0004) [2023-03-08 02:09:40,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 12815.6). Total num frames: 37679104. Throughput: 0: 13569.2. Samples: 37670840. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:09:40,769][304334] Avg episode reward: [(0, '4696.461')] [2023-03-08 02:09:40,943][304623] Updated weights for policy 0, policy_version 73600 (0.0005) [2023-03-08 02:09:44,012][304623] Updated weights for policy 0, policy_version 73680 (0.0005) [2023-03-08 02:09:45,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 12815.6). Total num frames: 37744640. Throughput: 0: 13534.7. Samples: 37709876. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:09:45,769][304334] Avg episode reward: [(0, '4677.546')] [2023-03-08 02:09:47,099][304623] Updated weights for policy 0, policy_version 73760 (0.0005) [2023-03-08 02:09:50,112][304623] Updated weights for policy 0, policy_version 73840 (0.0005) [2023-03-08 02:09:50,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 12829.5). Total num frames: 37814272. Throughput: 0: 13533.7. Samples: 37790364. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:09:50,769][304334] Avg episode reward: [(0, '4697.112')] [2023-03-08 02:09:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000073856_37814272.pth... [2023-03-08 02:09:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000073064_37408768.pth [2023-03-08 02:09:53,035][304623] Updated weights for policy 0, policy_version 73920 (0.0004) [2023-03-08 02:09:55,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13585.1, 300 sec: 12843.4). Total num frames: 37883904. Throughput: 0: 13533.6. Samples: 37872996. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:09:55,769][304334] Avg episode reward: [(0, '4710.598')] [2023-03-08 02:09:56,000][304623] Updated weights for policy 0, policy_version 74000 (0.0004) [2023-03-08 02:09:59,088][304623] Updated weights for policy 0, policy_version 74080 (0.0005) [2023-03-08 02:10:00,769][304334] Fps is (10 sec: 13107.3, 60 sec: 13516.8, 300 sec: 12829.5). Total num frames: 37945344. Throughput: 0: 13611.7. Samples: 37915992. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:10:00,769][304334] Avg episode reward: [(0, '4700.869')] [2023-03-08 02:10:02,530][304623] Updated weights for policy 0, policy_version 74160 (0.0005) [2023-03-08 02:10:05,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13380.3, 300 sec: 12801.7). Total num frames: 38006784. Throughput: 0: 13393.3. Samples: 37986956. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:10:05,769][304334] Avg episode reward: [(0, '4695.513')] [2023-03-08 02:10:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000074232_38006784.pth... [2023-03-08 02:10:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000073464_37613568.pth [2023-03-08 02:10:05,911][304623] Updated weights for policy 0, policy_version 74240 (0.0005) [2023-03-08 02:10:09,358][304623] Updated weights for policy 0, policy_version 74320 (0.0005) [2023-03-08 02:10:10,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13243.7, 300 sec: 12787.9). Total num frames: 38068224. Throughput: 0: 13196.6. Samples: 38060032. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:10:10,769][304334] Avg episode reward: [(0, '4692.362')] [2023-03-08 02:10:12,714][304623] Updated weights for policy 0, policy_version 74400 (0.0005) [2023-03-08 02:10:15,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13175.5, 300 sec: 12760.1). Total num frames: 38129664. Throughput: 0: 13099.4. Samples: 38096616. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:10:15,769][304334] Avg episode reward: [(0, '4687.132')] [2023-03-08 02:10:16,064][304623] Updated weights for policy 0, policy_version 74480 (0.0005) [2023-03-08 02:10:19,441][304623] Updated weights for policy 0, policy_version 74560 (0.0005) [2023-03-08 02:10:20,769][304334] Fps is (10 sec: 11878.4, 60 sec: 13038.9, 300 sec: 12732.3). Total num frames: 38187008. Throughput: 0: 12896.1. Samples: 38169380. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:10:20,769][304334] Avg episode reward: [(0, '4698.622')] [2023-03-08 02:10:20,806][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000074592_38191104.pth... [2023-03-08 02:10:20,807][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000073856_37814272.pth [2023-03-08 02:10:22,794][304623] Updated weights for policy 0, policy_version 74640 (0.0005) [2023-03-08 02:10:25,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12970.7, 300 sec: 12732.3). Total num frames: 38252544. Throughput: 0: 12723.1. Samples: 38243380. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:10:25,769][304334] Avg episode reward: [(0, '4688.023')] [2023-03-08 02:10:26,086][304623] Updated weights for policy 0, policy_version 74720 (0.0005) [2023-03-08 02:10:29,138][304623] Updated weights for policy 0, policy_version 74800 (0.0005) [2023-03-08 02:10:30,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12902.4, 300 sec: 12732.3). Total num frames: 38318080. Throughput: 0: 12691.5. Samples: 38280996. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:10:30,769][304334] Avg episode reward: [(0, '4692.670')] [2023-03-08 02:10:32,365][304623] Updated weights for policy 0, policy_version 74880 (0.0005) [2023-03-08 02:10:35,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12765.9, 300 sec: 12718.4). Total num frames: 38375424. Throughput: 0: 12608.7. Samples: 38357752. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:10:35,769][304334] Avg episode reward: [(0, '4690.504')] [2023-03-08 02:10:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000074952_38375424.pth... [2023-03-08 02:10:35,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000074232_38006784.pth [2023-03-08 02:10:35,856][304623] Updated weights for policy 0, policy_version 74960 (0.0005) [2023-03-08 02:10:39,243][304623] Updated weights for policy 0, policy_version 75040 (0.0005) [2023-03-08 02:10:40,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12629.3, 300 sec: 12704.5). Total num frames: 38436864. Throughput: 0: 12356.5. Samples: 38429036. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:10:40,769][304334] Avg episode reward: [(0, '4702.519')] [2023-03-08 02:10:42,771][304623] Updated weights for policy 0, policy_version 75120 (0.0005) [2023-03-08 02:10:45,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12492.8, 300 sec: 12676.8). Total num frames: 38494208. Throughput: 0: 12178.7. Samples: 38464032. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:10:45,769][304334] Avg episode reward: [(0, '4699.057')] [2023-03-08 02:10:46,211][304623] Updated weights for policy 0, policy_version 75200 (0.0005) [2023-03-08 02:10:49,579][304623] Updated weights for policy 0, policy_version 75280 (0.0005) [2023-03-08 02:10:50,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12356.3, 300 sec: 12676.8). Total num frames: 38555648. Throughput: 0: 12184.2. Samples: 38535244. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:10:50,769][304334] Avg episode reward: [(0, '4695.236')] [2023-03-08 02:10:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000075304_38555648.pth... [2023-03-08 02:10:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000074592_38191104.pth [2023-03-08 02:10:52,902][304623] Updated weights for policy 0, policy_version 75360 (0.0005) [2023-03-08 02:10:55,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12676.8). Total num frames: 38617088. Throughput: 0: 12219.3. Samples: 38609900. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:10:55,769][304334] Avg episode reward: [(0, '4666.058')] [2023-03-08 02:10:56,232][304623] Updated weights for policy 0, policy_version 75440 (0.0005) [2023-03-08 02:10:59,572][304623] Updated weights for policy 0, policy_version 75520 (0.0005) [2023-03-08 02:11:00,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12219.7, 300 sec: 12690.7). Total num frames: 38678528. Throughput: 0: 12216.0. Samples: 38646336. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:11:00,769][304334] Avg episode reward: [(0, '4689.961')] [2023-03-08 02:11:02,867][304623] Updated weights for policy 0, policy_version 75600 (0.0005) [2023-03-08 02:11:05,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12288.0, 300 sec: 12704.5). Total num frames: 38744064. Throughput: 0: 12242.0. Samples: 38720272. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:11:05,769][304334] Avg episode reward: [(0, '4685.320')] [2023-03-08 02:11:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000075672_38744064.pth... [2023-03-08 02:11:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000074952_38375424.pth [2023-03-08 02:11:06,033][304623] Updated weights for policy 0, policy_version 75680 (0.0004) [2023-03-08 02:11:09,058][304623] Updated weights for policy 0, policy_version 75760 (0.0003) [2023-03-08 02:11:10,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12356.3, 300 sec: 12718.4). Total num frames: 38809600. Throughput: 0: 12402.0. Samples: 38801472. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:11:10,769][304334] Avg episode reward: [(0, '4684.037')] [2023-03-08 02:11:12,085][304623] Updated weights for policy 0, policy_version 75840 (0.0003) [2023-03-08 02:11:15,072][304623] Updated weights for policy 0, policy_version 75920 (0.0003) [2023-03-08 02:11:15,769][304334] Fps is (10 sec: 13516.9, 60 sec: 12492.8, 300 sec: 12746.2). Total num frames: 38879232. Throughput: 0: 12465.8. Samples: 38841956. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:11:15,769][304334] Avg episode reward: [(0, '4694.709')] [2023-03-08 02:11:18,061][304623] Updated weights for policy 0, policy_version 76000 (0.0003) [2023-03-08 02:11:20,769][304334] Fps is (10 sec: 13516.7, 60 sec: 12629.3, 300 sec: 12746.2). Total num frames: 38944768. Throughput: 0: 12589.7. Samples: 38924288. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:11:20,769][304334] Avg episode reward: [(0, '4686.868')] [2023-03-08 02:11:20,788][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000076072_38948864.pth... [2023-03-08 02:11:20,790][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000075304_38555648.pth [2023-03-08 02:11:21,107][304623] Updated weights for policy 0, policy_version 76080 (0.0003) [2023-03-08 02:11:24,039][304623] Updated weights for policy 0, policy_version 76160 (0.0003) [2023-03-08 02:11:25,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12697.6, 300 sec: 12774.0). Total num frames: 39014400. Throughput: 0: 12829.0. Samples: 39006340. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:11:25,769][304334] Avg episode reward: [(0, '4673.531')] [2023-03-08 02:11:27,052][304623] Updated weights for policy 0, policy_version 76240 (0.0003) [2023-03-08 02:11:30,330][304623] Updated weights for policy 0, policy_version 76320 (0.0005) [2023-03-08 02:11:30,769][304334] Fps is (10 sec: 13516.9, 60 sec: 12697.6, 300 sec: 12787.9). Total num frames: 39079936. Throughput: 0: 12950.8. Samples: 39046816. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:11:30,769][304334] Avg episode reward: [(0, '4700.103')] [2023-03-08 02:11:33,695][304623] Updated weights for policy 0, policy_version 76400 (0.0005) [2023-03-08 02:11:35,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12765.8, 300 sec: 12787.8). Total num frames: 39141376. Throughput: 0: 13012.9. Samples: 39120824. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:11:35,769][304334] Avg episode reward: [(0, '4663.689')] [2023-03-08 02:11:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000076448_39141376.pth... [2023-03-08 02:11:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000075672_38744064.pth [2023-03-08 02:11:36,867][304623] Updated weights for policy 0, policy_version 76480 (0.0004) [2023-03-08 02:11:40,080][304623] Updated weights for policy 0, policy_version 76560 (0.0005) [2023-03-08 02:11:40,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12834.1, 300 sec: 12787.8). Total num frames: 39206912. Throughput: 0: 13060.2. Samples: 39197608. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:11:40,769][304334] Avg episode reward: [(0, '4685.993')] [2023-03-08 02:11:43,444][304623] Updated weights for policy 0, policy_version 76640 (0.0005) [2023-03-08 02:11:45,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12834.1, 300 sec: 12774.0). Total num frames: 39264256. Throughput: 0: 13078.7. Samples: 39234876. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:11:45,769][304334] Avg episode reward: [(0, '4660.295')] [2023-03-08 02:11:46,814][304623] Updated weights for policy 0, policy_version 76720 (0.0005) [2023-03-08 02:11:50,072][304623] Updated weights for policy 0, policy_version 76800 (0.0005) [2023-03-08 02:11:50,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12902.4, 300 sec: 12760.1). Total num frames: 39329792. Throughput: 0: 13071.3. Samples: 39308480. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:11:50,769][304334] Avg episode reward: [(0, '4694.774')] [2023-03-08 02:11:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000076816_39329792.pth... [2023-03-08 02:11:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000076072_38948864.pth [2023-03-08 02:11:53,402][304623] Updated weights for policy 0, policy_version 76880 (0.0005) [2023-03-08 02:11:55,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12902.4, 300 sec: 12774.0). Total num frames: 39391232. Throughput: 0: 12923.8. Samples: 39383040. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:11:55,769][304334] Avg episode reward: [(0, '4659.842')] [2023-03-08 02:11:56,732][304623] Updated weights for policy 0, policy_version 76960 (0.0004) [2023-03-08 02:12:00,048][304623] Updated weights for policy 0, policy_version 77040 (0.0005) [2023-03-08 02:12:00,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12902.4, 300 sec: 12774.0). Total num frames: 39452672. Throughput: 0: 12835.1. Samples: 39419536. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:12:00,769][304334] Avg episode reward: [(0, '4668.206')] [2023-03-08 02:12:03,406][304623] Updated weights for policy 0, policy_version 77120 (0.0005) [2023-03-08 02:12:05,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12834.1, 300 sec: 12787.8). Total num frames: 39514112. Throughput: 0: 12630.1. Samples: 39492644. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:12:05,769][304334] Avg episode reward: [(0, '4677.623')] [2023-03-08 02:12:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000077176_39514112.pth... [2023-03-08 02:12:05,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000076448_39141376.pth [2023-03-08 02:12:06,785][304623] Updated weights for policy 0, policy_version 77200 (0.0005) [2023-03-08 02:12:10,120][304623] Updated weights for policy 0, policy_version 77280 (0.0005) [2023-03-08 02:12:10,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12697.6, 300 sec: 12774.0). Total num frames: 39571456. Throughput: 0: 12436.9. Samples: 39566000. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:12:10,770][304334] Avg episode reward: [(0, '4679.350')] [2023-03-08 02:12:13,538][304623] Updated weights for policy 0, policy_version 77360 (0.0005) [2023-03-08 02:12:15,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12561.1, 300 sec: 12774.0). Total num frames: 39632896. Throughput: 0: 12335.8. Samples: 39601928. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:12:15,769][304334] Avg episode reward: [(0, '4669.432')] [2023-03-08 02:12:16,852][304623] Updated weights for policy 0, policy_version 77440 (0.0005) [2023-03-08 02:12:20,155][304623] Updated weights for policy 0, policy_version 77520 (0.0005) [2023-03-08 02:12:20,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12492.8, 300 sec: 12774.0). Total num frames: 39694336. Throughput: 0: 12324.4. Samples: 39675420. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:12:20,769][304334] Avg episode reward: [(0, '4662.743')] [2023-03-08 02:12:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000077528_39694336.pth... [2023-03-08 02:12:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000076816_39329792.pth [2023-03-08 02:12:23,487][304623] Updated weights for policy 0, policy_version 77600 (0.0005) [2023-03-08 02:12:25,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12356.2, 300 sec: 12774.0). Total num frames: 39755776. Throughput: 0: 12251.1. Samples: 39748908. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:12:25,770][304334] Avg episode reward: [(0, '4706.596')] [2023-03-08 02:12:26,867][304623] Updated weights for policy 0, policy_version 77680 (0.0005) [2023-03-08 02:12:30,078][304623] Updated weights for policy 0, policy_version 77760 (0.0005) [2023-03-08 02:12:30,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12356.3, 300 sec: 12801.7). Total num frames: 39821312. Throughput: 0: 12224.6. Samples: 39784984. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:12:30,769][304334] Avg episode reward: [(0, '4701.938')] [2023-03-08 02:12:33,092][304623] Updated weights for policy 0, policy_version 77840 (0.0004) [2023-03-08 02:12:35,769][304334] Fps is (10 sec: 13107.3, 60 sec: 12424.5, 300 sec: 12815.6). Total num frames: 39886848. Throughput: 0: 12397.7. Samples: 39866376. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:12:35,769][304334] Avg episode reward: [(0, '4678.906')] [2023-03-08 02:12:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000077904_39886848.pth... [2023-03-08 02:12:35,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000077176_39514112.pth [2023-03-08 02:12:36,139][304623] Updated weights for policy 0, policy_version 77920 (0.0004) [2023-03-08 02:12:39,183][304623] Updated weights for policy 0, policy_version 78000 (0.0005) [2023-03-08 02:12:40,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12492.8, 300 sec: 12843.4). Total num frames: 39956480. Throughput: 0: 12533.7. Samples: 39947060. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:12:40,769][304334] Avg episode reward: [(0, '4682.285')] [2023-03-08 02:12:42,223][304623] Updated weights for policy 0, policy_version 78080 (0.0005) [2023-03-08 02:12:45,139][304623] Updated weights for policy 0, policy_version 78160 (0.0004) [2023-03-08 02:12:45,769][304334] Fps is (10 sec: 13926.5, 60 sec: 12697.6, 300 sec: 12885.0). Total num frames: 40026112. Throughput: 0: 12613.2. Samples: 39987128. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:12:45,769][304334] Avg episode reward: [(0, '4655.031')] [2023-03-08 02:12:48,111][304623] Updated weights for policy 0, policy_version 78240 (0.0004) [2023-03-08 02:12:50,769][304334] Fps is (10 sec: 13516.7, 60 sec: 12697.6, 300 sec: 12871.2). Total num frames: 40091648. Throughput: 0: 12845.7. Samples: 40070700. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:12:50,774][304334] Avg episode reward: [(0, '4615.190')] [2023-03-08 02:12:50,804][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000078312_40095744.pth... [2023-03-08 02:12:50,805][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000077528_39694336.pth [2023-03-08 02:12:51,113][304623] Updated weights for policy 0, policy_version 78320 (0.0004) [2023-03-08 02:12:54,274][304623] Updated weights for policy 0, policy_version 78400 (0.0005) [2023-03-08 02:12:55,769][304334] Fps is (10 sec: 13107.3, 60 sec: 12765.9, 300 sec: 12871.2). Total num frames: 40157184. Throughput: 0: 12959.4. Samples: 40149172. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:12:55,769][304334] Avg episode reward: [(0, '4671.336')] [2023-03-08 02:12:57,660][304623] Updated weights for policy 0, policy_version 78480 (0.0005) [2023-03-08 02:13:00,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12765.9, 300 sec: 12871.2). Total num frames: 40218624. Throughput: 0: 12976.4. Samples: 40185868. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:13:00,769][304334] Avg episode reward: [(0, '4640.745')] [2023-03-08 02:13:01,075][304623] Updated weights for policy 0, policy_version 78560 (0.0005) [2023-03-08 02:13:04,320][304623] Updated weights for policy 0, policy_version 78640 (0.0005) [2023-03-08 02:13:05,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12765.9, 300 sec: 12857.3). Total num frames: 40280064. Throughput: 0: 12981.6. Samples: 40259592. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:13:05,769][304334] Avg episode reward: [(0, '4670.962')] [2023-03-08 02:13:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000078672_40280064.pth... [2023-03-08 02:13:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000077904_39886848.pth [2023-03-08 02:13:07,539][304623] Updated weights for policy 0, policy_version 78720 (0.0005) [2023-03-08 02:13:10,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12834.2, 300 sec: 12843.4). Total num frames: 40341504. Throughput: 0: 13035.5. Samples: 40335504. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:13:10,769][304334] Avg episode reward: [(0, '4670.965')] [2023-03-08 02:13:10,828][304623] Updated weights for policy 0, policy_version 78800 (0.0005) [2023-03-08 02:13:14,228][304623] Updated weights for policy 0, policy_version 78880 (0.0005) [2023-03-08 02:13:15,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12834.1, 300 sec: 12857.3). Total num frames: 40402944. Throughput: 0: 13016.9. Samples: 40370744. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:13:15,769][304334] Avg episode reward: [(0, '4680.890')] [2023-03-08 02:13:17,653][304623] Updated weights for policy 0, policy_version 78960 (0.0005) [2023-03-08 02:13:20,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12834.1, 300 sec: 12829.5). Total num frames: 40464384. Throughput: 0: 12834.0. Samples: 40443904. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:13:20,769][304334] Avg episode reward: [(0, '4660.042')] [2023-03-08 02:13:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000079032_40464384.pth... [2023-03-08 02:13:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000078312_40095744.pth [2023-03-08 02:13:21,023][304623] Updated weights for policy 0, policy_version 79040 (0.0005) [2023-03-08 02:13:24,343][304623] Updated weights for policy 0, policy_version 79120 (0.0005) [2023-03-08 02:13:25,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12834.2, 300 sec: 12815.6). Total num frames: 40525824. Throughput: 0: 12680.8. Samples: 40517696. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:13:25,769][304334] Avg episode reward: [(0, '4622.498')] [2023-03-08 02:13:27,301][304623] Updated weights for policy 0, policy_version 79200 (0.0004) [2023-03-08 02:13:30,347][304623] Updated weights for policy 0, policy_version 79280 (0.0004) [2023-03-08 02:13:30,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12902.4, 300 sec: 12829.5). Total num frames: 40595456. Throughput: 0: 12720.5. Samples: 40559552. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:13:30,769][304334] Avg episode reward: [(0, '4679.536')] [2023-03-08 02:13:33,341][304623] Updated weights for policy 0, policy_version 79360 (0.0004) [2023-03-08 02:13:35,769][304334] Fps is (10 sec: 13926.4, 60 sec: 12970.7, 300 sec: 12857.3). Total num frames: 40665088. Throughput: 0: 12664.1. Samples: 40640584. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:13:35,769][304334] Avg episode reward: [(0, '4648.900')] [2023-03-08 02:13:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000079424_40665088.pth... [2023-03-08 02:13:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000078672_40280064.pth [2023-03-08 02:13:36,300][304623] Updated weights for policy 0, policy_version 79440 (0.0004) [2023-03-08 02:13:39,495][304623] Updated weights for policy 0, policy_version 79520 (0.0004) [2023-03-08 02:13:40,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12902.4, 300 sec: 12871.2). Total num frames: 40730624. Throughput: 0: 12689.8. Samples: 40720216. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:13:40,769][304334] Avg episode reward: [(0, '4650.175')] [2023-03-08 02:13:42,588][304623] Updated weights for policy 0, policy_version 79600 (0.0003) [2023-03-08 02:13:45,686][304623] Updated weights for policy 0, policy_version 79680 (0.0003) [2023-03-08 02:13:45,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12834.1, 300 sec: 12857.3). Total num frames: 40796160. Throughput: 0: 12754.7. Samples: 40759828. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:13:45,769][304334] Avg episode reward: [(0, '4654.289')] [2023-03-08 02:13:48,691][304623] Updated weights for policy 0, policy_version 79760 (0.0003) [2023-03-08 02:13:50,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12834.1, 300 sec: 12857.3). Total num frames: 40861696. Throughput: 0: 12925.0. Samples: 40841216. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:13:50,769][304334] Avg episode reward: [(0, '4611.130')] [2023-03-08 02:13:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000079808_40861696.pth... [2023-03-08 02:13:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000079032_40464384.pth [2023-03-08 02:13:51,713][304623] Updated weights for policy 0, policy_version 79840 (0.0003) [2023-03-08 02:13:54,734][304623] Updated weights for policy 0, policy_version 79920 (0.0003) [2023-03-08 02:13:55,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12902.4, 300 sec: 12871.2). Total num frames: 40931328. Throughput: 0: 13043.9. Samples: 40922480. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:13:55,769][304334] Avg episode reward: [(0, '4684.870')] [2023-03-08 02:13:57,764][304623] Updated weights for policy 0, policy_version 80000 (0.0004) [2023-03-08 02:14:00,769][304334] Fps is (10 sec: 13107.4, 60 sec: 12902.4, 300 sec: 12843.4). Total num frames: 40992768. Throughput: 0: 13164.4. Samples: 40963140. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:14:00,769][304334] Avg episode reward: [(0, '4697.560')] [2023-03-08 02:14:01,178][304623] Updated weights for policy 0, policy_version 80080 (0.0005) [2023-03-08 02:14:04,479][304623] Updated weights for policy 0, policy_version 80160 (0.0005) [2023-03-08 02:14:05,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12970.6, 300 sec: 12829.5). Total num frames: 41058304. Throughput: 0: 13144.8. Samples: 41035420. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:14:05,769][304334] Avg episode reward: [(0, '4676.678')] [2023-03-08 02:14:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000080192_41058304.pth... [2023-03-08 02:14:05,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000079424_40665088.pth [2023-03-08 02:14:07,742][304623] Updated weights for policy 0, policy_version 80240 (0.0005) [2023-03-08 02:14:10,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12902.4, 300 sec: 12801.7). Total num frames: 41115648. Throughput: 0: 13155.0. Samples: 41109668. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:14:10,769][304334] Avg episode reward: [(0, '4671.255')] [2023-03-08 02:14:11,176][304623] Updated weights for policy 0, policy_version 80320 (0.0005) [2023-03-08 02:14:14,398][304623] Updated weights for policy 0, policy_version 80400 (0.0005) [2023-03-08 02:14:15,769][304334] Fps is (10 sec: 12288.2, 60 sec: 12970.7, 300 sec: 12801.7). Total num frames: 41181184. Throughput: 0: 13063.6. Samples: 41147412. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:14:15,769][304334] Avg episode reward: [(0, '4687.429')] [2023-03-08 02:14:17,675][304623] Updated weights for policy 0, policy_version 80480 (0.0005) [2023-03-08 02:14:20,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12970.7, 300 sec: 12774.0). Total num frames: 41242624. Throughput: 0: 12923.6. Samples: 41222144. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:14:20,769][304334] Avg episode reward: [(0, '4669.865')] [2023-03-08 02:14:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000080552_41242624.pth... [2023-03-08 02:14:20,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000079808_40861696.pth [2023-03-08 02:14:21,039][304623] Updated weights for policy 0, policy_version 80560 (0.0005) [2023-03-08 02:14:24,109][304623] Updated weights for policy 0, policy_version 80640 (0.0003) [2023-03-08 02:14:25,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13038.9, 300 sec: 12760.1). Total num frames: 41308160. Throughput: 0: 12873.2. Samples: 41299508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:14:25,769][304334] Avg episode reward: [(0, '4671.131')] [2023-03-08 02:14:27,222][304623] Updated weights for policy 0, policy_version 80720 (0.0003) [2023-03-08 02:14:30,155][304623] Updated weights for policy 0, policy_version 80800 (0.0003) [2023-03-08 02:14:30,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13038.9, 300 sec: 12774.0). Total num frames: 41377792. Throughput: 0: 12866.0. Samples: 41338796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:14:30,769][304334] Avg episode reward: [(0, '4689.285')] [2023-03-08 02:14:33,240][304623] Updated weights for policy 0, policy_version 80880 (0.0003) [2023-03-08 02:14:35,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12970.7, 300 sec: 12760.1). Total num frames: 41443328. Throughput: 0: 12868.5. Samples: 41420296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:14:35,769][304334] Avg episode reward: [(0, '4666.365')] [2023-03-08 02:14:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000080944_41443328.pth... [2023-03-08 02:14:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000080192_41058304.pth [2023-03-08 02:14:36,241][304623] Updated weights for policy 0, policy_version 80960 (0.0003) [2023-03-08 02:14:39,260][304623] Updated weights for policy 0, policy_version 81040 (0.0003) [2023-03-08 02:14:40,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12970.7, 300 sec: 12760.1). Total num frames: 41508864. Throughput: 0: 12879.2. Samples: 41502044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:14:40,769][304334] Avg episode reward: [(0, '4693.971')] [2023-03-08 02:14:42,283][304623] Updated weights for policy 0, policy_version 81120 (0.0003) [2023-03-08 02:14:45,247][304623] Updated weights for policy 0, policy_version 81200 (0.0003) [2023-03-08 02:14:45,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13038.9, 300 sec: 12760.1). Total num frames: 41578496. Throughput: 0: 12892.1. Samples: 41543284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:14:45,769][304334] Avg episode reward: [(0, '4659.839')] [2023-03-08 02:14:48,243][304623] Updated weights for policy 0, policy_version 81280 (0.0003) [2023-03-08 02:14:50,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13107.2, 300 sec: 12760.1). Total num frames: 41648128. Throughput: 0: 13104.4. Samples: 41625116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:14:50,769][304334] Avg episode reward: [(0, '4691.875')] [2023-03-08 02:14:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000081344_41648128.pth... [2023-03-08 02:14:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000080552_41242624.pth [2023-03-08 02:14:51,236][304623] Updated weights for policy 0, policy_version 81360 (0.0003) [2023-03-08 02:14:54,241][304623] Updated weights for policy 0, policy_version 81440 (0.0003) [2023-03-08 02:14:55,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13107.2, 300 sec: 12787.9). Total num frames: 41717760. Throughput: 0: 13286.8. Samples: 41707576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:14:55,769][304334] Avg episode reward: [(0, '4689.345')] [2023-03-08 02:14:57,225][304623] Updated weights for policy 0, policy_version 81520 (0.0004) [2023-03-08 02:15:00,233][304623] Updated weights for policy 0, policy_version 81600 (0.0004) [2023-03-08 02:15:00,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13175.4, 300 sec: 12801.7). Total num frames: 41783296. Throughput: 0: 13348.3. Samples: 41748084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:15:00,769][304334] Avg episode reward: [(0, '4696.966')] [2023-03-08 02:15:03,203][304623] Updated weights for policy 0, policy_version 81680 (0.0004) [2023-03-08 02:15:05,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13243.8, 300 sec: 12829.5). Total num frames: 41852928. Throughput: 0: 13510.3. Samples: 41830108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:15:05,769][304334] Avg episode reward: [(0, '4697.588')] [2023-03-08 02:15:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000081744_41852928.pth... [2023-03-08 02:15:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000080944_41443328.pth [2023-03-08 02:15:06,233][304623] Updated weights for policy 0, policy_version 81760 (0.0003) [2023-03-08 02:15:09,250][304623] Updated weights for policy 0, policy_version 81840 (0.0003) [2023-03-08 02:15:10,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13448.5, 300 sec: 12857.3). Total num frames: 41922560. Throughput: 0: 13613.1. Samples: 41912100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:15:10,769][304334] Avg episode reward: [(0, '4694.705')] [2023-03-08 02:15:12,173][304623] Updated weights for policy 0, policy_version 81920 (0.0004) [2023-03-08 02:15:15,135][304623] Updated weights for policy 0, policy_version 82000 (0.0004) [2023-03-08 02:15:15,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13516.8, 300 sec: 12898.9). Total num frames: 41992192. Throughput: 0: 13686.3. Samples: 41954680. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:15:15,769][304334] Avg episode reward: [(0, '4696.802')] [2023-03-08 02:15:18,010][304623] Updated weights for policy 0, policy_version 82080 (0.0003) [2023-03-08 02:15:20,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13653.3, 300 sec: 12912.8). Total num frames: 42061824. Throughput: 0: 13723.6. Samples: 42037860. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:15:20,769][304334] Avg episode reward: [(0, '4684.008')] [2023-03-08 02:15:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000082152_42061824.pth... [2023-03-08 02:15:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000081344_41648128.pth [2023-03-08 02:15:21,033][304623] Updated weights for policy 0, policy_version 82160 (0.0003) [2023-03-08 02:15:23,966][304623] Updated weights for policy 0, policy_version 82240 (0.0003) [2023-03-08 02:15:25,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 12912.8). Total num frames: 42127360. Throughput: 0: 13734.4. Samples: 42120092. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:15:25,769][304334] Avg episode reward: [(0, '4675.542')] [2023-03-08 02:15:26,996][304623] Updated weights for policy 0, policy_version 82320 (0.0003) [2023-03-08 02:15:30,092][304623] Updated weights for policy 0, policy_version 82400 (0.0003) [2023-03-08 02:15:30,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 12954.5). Total num frames: 42196992. Throughput: 0: 13709.2. Samples: 42160200. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:15:30,780][304334] Avg episode reward: [(0, '4654.105')] [2023-03-08 02:15:33,146][304623] Updated weights for policy 0, policy_version 82480 (0.0003) [2023-03-08 02:15:35,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13653.3, 300 sec: 12968.3). Total num frames: 42262528. Throughput: 0: 13703.3. Samples: 42241764. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:15:35,780][304334] Avg episode reward: [(0, '4643.916')] [2023-03-08 02:15:35,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000082544_42262528.pth... [2023-03-08 02:15:35,784][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000081744_41852928.pth [2023-03-08 02:15:36,159][304623] Updated weights for policy 0, policy_version 82560 (0.0003) [2023-03-08 02:15:39,126][304623] Updated weights for policy 0, policy_version 82640 (0.0003) [2023-03-08 02:15:40,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13721.6, 300 sec: 13010.0). Total num frames: 42332160. Throughput: 0: 13699.0. Samples: 42324032. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:15:40,780][304334] Avg episode reward: [(0, '4675.238')] [2023-03-08 02:15:42,063][304623] Updated weights for policy 0, policy_version 82720 (0.0003) [2023-03-08 02:15:45,095][304623] Updated weights for policy 0, policy_version 82800 (0.0003) [2023-03-08 02:15:45,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13721.6, 300 sec: 13037.8). Total num frames: 42401792. Throughput: 0: 13709.3. Samples: 42365000. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:15:45,780][304334] Avg episode reward: [(0, '4680.357')] [2023-03-08 02:15:48,076][304623] Updated weights for policy 0, policy_version 82880 (0.0003) [2023-03-08 02:15:50,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13653.3, 300 sec: 13051.7). Total num frames: 42467328. Throughput: 0: 13706.8. Samples: 42446912. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:15:50,769][304334] Avg episode reward: [(0, '4637.488')] [2023-03-08 02:15:50,782][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000082952_42471424.pth... [2023-03-08 02:15:50,784][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000082152_42061824.pth [2023-03-08 02:15:51,103][304623] Updated weights for policy 0, policy_version 82960 (0.0003) [2023-03-08 02:15:54,024][304623] Updated weights for policy 0, policy_version 83040 (0.0003) [2023-03-08 02:15:55,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13653.3, 300 sec: 13079.4). Total num frames: 42536960. Throughput: 0: 13727.4. Samples: 42529832. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:15:55,769][304334] Avg episode reward: [(0, '4652.466')] [2023-03-08 02:15:57,003][304623] Updated weights for policy 0, policy_version 83120 (0.0003) [2023-03-08 02:16:00,021][304623] Updated weights for policy 0, policy_version 83200 (0.0003) [2023-03-08 02:16:00,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13721.6, 300 sec: 13093.3). Total num frames: 42606592. Throughput: 0: 13689.1. Samples: 42570688. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:16:00,769][304334] Avg episode reward: [(0, '4683.889')] [2023-03-08 02:16:03,053][304623] Updated weights for policy 0, policy_version 83280 (0.0004) [2023-03-08 02:16:05,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13721.6, 300 sec: 13107.2). Total num frames: 42676224. Throughput: 0: 13646.1. Samples: 42651936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:16:05,769][304334] Avg episode reward: [(0, '4664.168')] [2023-03-08 02:16:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000083352_42676224.pth... [2023-03-08 02:16:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000082544_42262528.pth [2023-03-08 02:16:05,979][304623] Updated weights for policy 0, policy_version 83360 (0.0004) [2023-03-08 02:16:08,924][304623] Updated weights for policy 0, policy_version 83440 (0.0004) [2023-03-08 02:16:10,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13721.6, 300 sec: 13107.2). Total num frames: 42745856. Throughput: 0: 13677.2. Samples: 42735568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:16:10,769][304334] Avg episode reward: [(0, '4700.019')] [2023-03-08 02:16:11,969][304623] Updated weights for policy 0, policy_version 83520 (0.0005) [2023-03-08 02:16:14,951][304623] Updated weights for policy 0, policy_version 83600 (0.0004) [2023-03-08 02:16:15,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13653.3, 300 sec: 13107.2). Total num frames: 42811392. Throughput: 0: 13666.5. Samples: 42775192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:16:15,769][304334] Avg episode reward: [(0, '4677.928')] [2023-03-08 02:16:17,986][304623] Updated weights for policy 0, policy_version 83680 (0.0005) [2023-03-08 02:16:20,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13107.2). Total num frames: 42881024. Throughput: 0: 13688.1. Samples: 42857728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:16:20,769][304334] Avg episode reward: [(0, '4697.492')] [2023-03-08 02:16:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000083752_42881024.pth... [2023-03-08 02:16:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000082952_42471424.pth [2023-03-08 02:16:20,912][304623] Updated weights for policy 0, policy_version 83760 (0.0004) [2023-03-08 02:16:23,887][304623] Updated weights for policy 0, policy_version 83840 (0.0004) [2023-03-08 02:16:25,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13653.3, 300 sec: 13107.2). Total num frames: 42946560. Throughput: 0: 13708.9. Samples: 42940932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:16:25,769][304334] Avg episode reward: [(0, '4690.619')] [2023-03-08 02:16:27,119][304623] Updated weights for policy 0, policy_version 83920 (0.0005) [2023-03-08 02:16:30,352][304623] Updated weights for policy 0, policy_version 84000 (0.0005) [2023-03-08 02:16:30,769][304334] Fps is (10 sec: 13107.3, 60 sec: 13585.1, 300 sec: 13121.1). Total num frames: 43012096. Throughput: 0: 13624.2. Samples: 42978088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:16:30,769][304334] Avg episode reward: [(0, '4685.668')] [2023-03-08 02:16:33,352][304623] Updated weights for policy 0, policy_version 84080 (0.0004) [2023-03-08 02:16:35,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13653.3, 300 sec: 13135.0). Total num frames: 43081728. Throughput: 0: 13562.3. Samples: 43057216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:16:35,769][304334] Avg episode reward: [(0, '4689.232')] [2023-03-08 02:16:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000084144_43081728.pth... [2023-03-08 02:16:35,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000083352_42676224.pth [2023-03-08 02:16:36,410][304623] Updated weights for policy 0, policy_version 84160 (0.0003) [2023-03-08 02:16:39,374][304623] Updated weights for policy 0, policy_version 84240 (0.0003) [2023-03-08 02:16:40,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13162.7). Total num frames: 43147264. Throughput: 0: 13539.0. Samples: 43139088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:16:40,769][304334] Avg episode reward: [(0, '4690.371')] [2023-03-08 02:16:42,455][304623] Updated weights for policy 0, policy_version 84320 (0.0003) [2023-03-08 02:16:45,484][304623] Updated weights for policy 0, policy_version 84400 (0.0003) [2023-03-08 02:16:45,769][304334] Fps is (10 sec: 13107.3, 60 sec: 13516.8, 300 sec: 13162.7). Total num frames: 43212800. Throughput: 0: 13520.7. Samples: 43179120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:16:45,769][304334] Avg episode reward: [(0, '4687.837')] [2023-03-08 02:16:48,495][304623] Updated weights for policy 0, policy_version 84480 (0.0003) [2023-03-08 02:16:50,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13585.0, 300 sec: 13190.5). Total num frames: 43282432. Throughput: 0: 13523.7. Samples: 43260504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:16:50,769][304334] Avg episode reward: [(0, '4698.998')] [2023-03-08 02:16:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000084536_43282432.pth... [2023-03-08 02:16:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000083752_42881024.pth [2023-03-08 02:16:51,495][304623] Updated weights for policy 0, policy_version 84560 (0.0004) [2023-03-08 02:16:54,678][304623] Updated weights for policy 0, policy_version 84640 (0.0004) [2023-03-08 02:16:55,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 13204.4). Total num frames: 43347968. Throughput: 0: 13427.0. Samples: 43339784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:16:55,769][304334] Avg episode reward: [(0, '4697.992')] [2023-03-08 02:16:57,695][304623] Updated weights for policy 0, policy_version 84720 (0.0003) [2023-03-08 02:17:00,667][304623] Updated weights for policy 0, policy_version 84800 (0.0003) [2023-03-08 02:17:00,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13232.2). Total num frames: 43417600. Throughput: 0: 13456.5. Samples: 43380736. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:17:00,769][304334] Avg episode reward: [(0, '4664.076')] [2023-03-08 02:17:03,658][304623] Updated weights for policy 0, policy_version 84880 (0.0003) [2023-03-08 02:17:05,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13259.9). Total num frames: 43483136. Throughput: 0: 13444.3. Samples: 43462720. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:17:05,769][304334] Avg episode reward: [(0, '4687.404')] [2023-03-08 02:17:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000084928_43483136.pth... [2023-03-08 02:17:05,773][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000084144_43081728.pth [2023-03-08 02:17:06,771][304623] Updated weights for policy 0, policy_version 84960 (0.0003) [2023-03-08 02:17:09,650][304623] Updated weights for policy 0, policy_version 85040 (0.0003) [2023-03-08 02:17:10,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13287.7). Total num frames: 43552768. Throughput: 0: 13418.5. Samples: 43544764. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:17:10,769][304334] Avg episode reward: [(0, '4687.955')] [2023-03-08 02:17:12,886][304623] Updated weights for policy 0, policy_version 85120 (0.0005) [2023-03-08 02:17:15,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13287.7). Total num frames: 43614208. Throughput: 0: 13425.6. Samples: 43582240. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:17:15,769][304334] Avg episode reward: [(0, '4672.708')] [2023-03-08 02:17:16,170][304623] Updated weights for policy 0, policy_version 85200 (0.0005) [2023-03-08 02:17:19,416][304623] Updated weights for policy 0, policy_version 85280 (0.0005) [2023-03-08 02:17:20,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13312.0, 300 sec: 13301.6). Total num frames: 43679744. Throughput: 0: 13343.4. Samples: 43657668. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:17:20,769][304334] Avg episode reward: [(0, '4691.282')] [2023-03-08 02:17:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000085312_43679744.pth... [2023-03-08 02:17:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000084536_43282432.pth [2023-03-08 02:17:22,648][304623] Updated weights for policy 0, policy_version 85360 (0.0005) [2023-03-08 02:17:25,769][304334] Fps is (10 sec: 12697.7, 60 sec: 13243.7, 300 sec: 13287.7). Total num frames: 43741184. Throughput: 0: 13201.9. Samples: 43733172. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:17:25,769][304334] Avg episode reward: [(0, '4699.343')] [2023-03-08 02:17:25,863][304623] Updated weights for policy 0, policy_version 85440 (0.0005) [2023-03-08 02:17:28,931][304623] Updated weights for policy 0, policy_version 85520 (0.0004) [2023-03-08 02:17:30,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13243.7, 300 sec: 13287.7). Total num frames: 43806720. Throughput: 0: 13218.9. Samples: 43773972. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:17:30,769][304334] Avg episode reward: [(0, '4687.063')] [2023-03-08 02:17:32,011][304623] Updated weights for policy 0, policy_version 85600 (0.0004) [2023-03-08 02:17:35,006][304623] Updated weights for policy 0, policy_version 85680 (0.0004) [2023-03-08 02:17:35,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13243.7, 300 sec: 13287.7). Total num frames: 43876352. Throughput: 0: 13213.0. Samples: 43855088. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:17:35,769][304334] Avg episode reward: [(0, '4686.411')] [2023-03-08 02:17:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000085696_43876352.pth... [2023-03-08 02:17:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000084928_43483136.pth [2023-03-08 02:17:37,914][304623] Updated weights for policy 0, policy_version 85760 (0.0004) [2023-03-08 02:17:40,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13312.0, 300 sec: 13287.7). Total num frames: 43945984. Throughput: 0: 13287.2. Samples: 43937708. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:17:40,769][304334] Avg episode reward: [(0, '4682.731')] [2023-03-08 02:17:40,929][304623] Updated weights for policy 0, policy_version 85840 (0.0003) [2023-03-08 02:17:43,928][304623] Updated weights for policy 0, policy_version 85920 (0.0003) [2023-03-08 02:17:45,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13380.3, 300 sec: 13301.6). Total num frames: 44015616. Throughput: 0: 13268.9. Samples: 43977836. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:17:45,769][304334] Avg episode reward: [(0, '4677.475')] [2023-03-08 02:17:46,998][304623] Updated weights for policy 0, policy_version 86000 (0.0004) [2023-03-08 02:17:50,326][304623] Updated weights for policy 0, policy_version 86080 (0.0006) [2023-03-08 02:17:50,769][304334] Fps is (10 sec: 13107.1, 60 sec: 13243.7, 300 sec: 13287.7). Total num frames: 44077056. Throughput: 0: 13198.2. Samples: 44056640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:17:50,769][304334] Avg episode reward: [(0, '4701.132')] [2023-03-08 02:17:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000086088_44077056.pth... [2023-03-08 02:17:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000085312_43679744.pth [2023-03-08 02:17:53,398][304623] Updated weights for policy 0, policy_version 86160 (0.0004) [2023-03-08 02:17:55,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13243.7, 300 sec: 13301.6). Total num frames: 44142592. Throughput: 0: 13127.0. Samples: 44135480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:17:55,769][304334] Avg episode reward: [(0, '4694.297')] [2023-03-08 02:17:56,376][304623] Updated weights for policy 0, policy_version 86240 (0.0004) [2023-03-08 02:17:59,333][304623] Updated weights for policy 0, policy_version 86320 (0.0004) [2023-03-08 02:18:00,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13243.7, 300 sec: 13329.4). Total num frames: 44212224. Throughput: 0: 13191.6. Samples: 44175860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:18:00,780][304334] Avg episode reward: [(0, '4636.015')] [2023-03-08 02:18:02,370][304623] Updated weights for policy 0, policy_version 86400 (0.0005) [2023-03-08 02:18:05,346][304623] Updated weights for policy 0, policy_version 86480 (0.0004) [2023-03-08 02:18:05,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13312.0, 300 sec: 13357.1). Total num frames: 44281856. Throughput: 0: 13352.1. Samples: 44258512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:18:05,780][304334] Avg episode reward: [(0, '4649.732')] [2023-03-08 02:18:05,784][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000086488_44281856.pth... [2023-03-08 02:18:05,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000085696_43876352.pth [2023-03-08 02:18:08,337][304623] Updated weights for policy 0, policy_version 86560 (0.0004) [2023-03-08 02:18:10,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13312.0, 300 sec: 13384.9). Total num frames: 44351488. Throughput: 0: 13512.3. Samples: 44341224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:18:10,780][304334] Avg episode reward: [(0, '4627.218')] [2023-03-08 02:18:11,321][304623] Updated weights for policy 0, policy_version 86640 (0.0004) [2023-03-08 02:18:14,308][304623] Updated weights for policy 0, policy_version 86720 (0.0004) [2023-03-08 02:18:15,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 44417024. Throughput: 0: 13533.1. Samples: 44382960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:18:15,780][304334] Avg episode reward: [(0, '4429.666')] [2023-03-08 02:18:17,242][304623] Updated weights for policy 0, policy_version 86800 (0.0004) [2023-03-08 02:18:20,225][304623] Updated weights for policy 0, policy_version 86880 (0.0004) [2023-03-08 02:18:20,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 44486656. Throughput: 0: 13567.6. Samples: 44465632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:18:20,780][304334] Avg episode reward: [(0, '4544.920')] [2023-03-08 02:18:20,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000086888_44486656.pth... [2023-03-08 02:18:20,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000086088_44077056.pth [2023-03-08 02:18:23,259][304623] Updated weights for policy 0, policy_version 86960 (0.0003) [2023-03-08 02:18:25,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13585.1, 300 sec: 13426.5). Total num frames: 44556288. Throughput: 0: 13548.8. Samples: 44547404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:18:25,780][304334] Avg episode reward: [(0, '4603.433')] [2023-03-08 02:18:26,308][304623] Updated weights for policy 0, policy_version 87040 (0.0003) [2023-03-08 02:18:29,449][304623] Updated weights for policy 0, policy_version 87120 (0.0003) [2023-03-08 02:18:30,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13585.1, 300 sec: 13412.7). Total num frames: 44621824. Throughput: 0: 13518.8. Samples: 44586180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:18:30,780][304334] Avg episode reward: [(0, '4586.130')] [2023-03-08 02:18:32,431][304623] Updated weights for policy 0, policy_version 87200 (0.0003) [2023-03-08 02:18:35,769][304334] Fps is (10 sec: 12697.7, 60 sec: 13448.6, 300 sec: 13398.8). Total num frames: 44683264. Throughput: 0: 13550.9. Samples: 44666428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:18:35,780][304334] Avg episode reward: [(0, '4588.514')] [2023-03-08 02:18:35,787][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000087280_44687360.pth... [2023-03-08 02:18:35,787][304623] Updated weights for policy 0, policy_version 87280 (0.0005) [2023-03-08 02:18:35,788][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000086488_44281856.pth [2023-03-08 02:18:39,131][304623] Updated weights for policy 0, policy_version 87360 (0.0005) [2023-03-08 02:18:40,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 44748800. Throughput: 0: 13412.2. Samples: 44739028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:18:40,780][304334] Avg episode reward: [(0, '4644.838')] [2023-03-08 02:18:42,342][304623] Updated weights for policy 0, policy_version 87440 (0.0004) [2023-03-08 02:18:45,455][304623] Updated weights for policy 0, policy_version 87520 (0.0004) [2023-03-08 02:18:45,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13243.7, 300 sec: 13384.9). Total num frames: 44810240. Throughput: 0: 13370.8. Samples: 44777544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:18:45,780][304334] Avg episode reward: [(0, '4646.484')] [2023-03-08 02:18:47,359][304573] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000008 [2023-03-08 02:18:48,549][304623] Updated weights for policy 0, policy_version 87600 (0.0004) [2023-03-08 02:18:50,769][304334] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 44879872. Throughput: 0: 13287.2. Samples: 44856436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:18:50,769][304334] Avg episode reward: [(0, '4625.317')] [2023-03-08 02:18:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000087656_44879872.pth... [2023-03-08 02:18:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000086888_44486656.pth [2023-03-08 02:18:51,508][304623] Updated weights for policy 0, policy_version 87680 (0.0003) [2023-03-08 02:18:54,536][304623] Updated weights for policy 0, policy_version 87760 (0.0004) [2023-03-08 02:18:55,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13398.8). Total num frames: 44945408. Throughput: 0: 13264.7. Samples: 44938136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:18:55,769][304334] Avg episode reward: [(0, '4633.651')] [2023-03-08 02:18:57,981][304623] Updated weights for policy 0, policy_version 87840 (0.0005) [2023-03-08 02:19:00,769][304334] Fps is (10 sec: 12697.7, 60 sec: 13243.7, 300 sec: 13384.9). Total num frames: 45006848. Throughput: 0: 13137.4. Samples: 44974144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:19:00,769][304334] Avg episode reward: [(0, '4613.706')] [2023-03-08 02:19:01,244][304623] Updated weights for policy 0, policy_version 87920 (0.0005) [2023-03-08 02:19:04,463][304623] Updated weights for policy 0, policy_version 88000 (0.0005) [2023-03-08 02:19:05,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13107.2, 300 sec: 13398.8). Total num frames: 45068288. Throughput: 0: 12978.6. Samples: 45049668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:19:05,769][304334] Avg episode reward: [(0, '4522.822')] [2023-03-08 02:19:05,788][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000088032_45072384.pth... [2023-03-08 02:19:05,789][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000087280_44687360.pth [2023-03-08 02:19:07,780][304623] Updated weights for policy 0, policy_version 88080 (0.0005) [2023-03-08 02:19:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13038.9, 300 sec: 13398.8). Total num frames: 45133824. Throughput: 0: 12833.2. Samples: 45124900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:19:10,769][304334] Avg episode reward: [(0, '4569.084')] [2023-03-08 02:19:11,042][304623] Updated weights for policy 0, policy_version 88160 (0.0005) [2023-03-08 02:19:14,320][304623] Updated weights for policy 0, policy_version 88240 (0.0005) [2023-03-08 02:19:15,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12970.7, 300 sec: 13398.8). Total num frames: 45195264. Throughput: 0: 12807.0. Samples: 45162496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:19:15,769][304334] Avg episode reward: [(0, '4649.539')] [2023-03-08 02:19:17,715][304623] Updated weights for policy 0, policy_version 88320 (0.0005) [2023-03-08 02:19:20,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12834.1, 300 sec: 13384.9). Total num frames: 45256704. Throughput: 0: 12661.3. Samples: 45236188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:19:20,769][304334] Avg episode reward: [(0, '4645.099')] [2023-03-08 02:19:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000088392_45256704.pth... [2023-03-08 02:19:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000087656_44879872.pth [2023-03-08 02:19:20,991][304623] Updated weights for policy 0, policy_version 88400 (0.0005) [2023-03-08 02:19:24,381][304623] Updated weights for policy 0, policy_version 88480 (0.0005) [2023-03-08 02:19:25,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12697.6, 300 sec: 13357.1). Total num frames: 45318144. Throughput: 0: 12673.7. Samples: 45309344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:19:25,769][304334] Avg episode reward: [(0, '4654.836')] [2023-03-08 02:19:27,759][304623] Updated weights for policy 0, policy_version 88560 (0.0005) [2023-03-08 02:19:30,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12629.3, 300 sec: 13343.2). Total num frames: 45379584. Throughput: 0: 12625.7. Samples: 45345700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:19:30,769][304334] Avg episode reward: [(0, '4635.379')] [2023-03-08 02:19:31,040][304623] Updated weights for policy 0, policy_version 88640 (0.0005) [2023-03-08 02:19:34,046][304623] Updated weights for policy 0, policy_version 88720 (0.0005) [2023-03-08 02:19:35,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 13343.2). Total num frames: 45445120. Throughput: 0: 12611.0. Samples: 45423928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:19:35,769][304334] Avg episode reward: [(0, '4660.224')] [2023-03-08 02:19:35,771][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000088760_45445120.pth... [2023-03-08 02:19:35,772][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000088032_45072384.pth [2023-03-08 02:19:36,981][304623] Updated weights for policy 0, policy_version 88800 (0.0004) [2023-03-08 02:19:40,086][304623] Updated weights for policy 0, policy_version 88880 (0.0005) [2023-03-08 02:19:40,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12765.9, 300 sec: 13343.2). Total num frames: 45514752. Throughput: 0: 12612.8. Samples: 45505712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:19:40,769][304334] Avg episode reward: [(0, '4666.357')] [2023-03-08 02:19:43,314][304623] Updated weights for policy 0, policy_version 88960 (0.0005) [2023-03-08 02:19:45,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12765.9, 300 sec: 13315.5). Total num frames: 45576192. Throughput: 0: 12650.7. Samples: 45543424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:19:45,769][304334] Avg episode reward: [(0, '4666.212')] [2023-03-08 02:19:46,554][304623] Updated weights for policy 0, policy_version 89040 (0.0005) [2023-03-08 02:19:49,783][304623] Updated weights for policy 0, policy_version 89120 (0.0005) [2023-03-08 02:19:50,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 13301.6). Total num frames: 45641728. Throughput: 0: 12662.5. Samples: 45619480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:19:50,769][304334] Avg episode reward: [(0, '4622.928')] [2023-03-08 02:19:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000089144_45641728.pth... [2023-03-08 02:19:50,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000088392_45256704.pth [2023-03-08 02:19:52,845][304623] Updated weights for policy 0, policy_version 89200 (0.0004) [2023-03-08 02:19:55,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12697.6, 300 sec: 13301.6). Total num frames: 45707264. Throughput: 0: 12760.8. Samples: 45699136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:19:55,769][304334] Avg episode reward: [(0, '4630.487')] [2023-03-08 02:19:55,880][304623] Updated weights for policy 0, policy_version 89280 (0.0003) [2023-03-08 02:19:58,916][304623] Updated weights for policy 0, policy_version 89360 (0.0003) [2023-03-08 02:20:00,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12834.1, 300 sec: 13301.6). Total num frames: 45776896. Throughput: 0: 12835.6. Samples: 45740096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:20:00,769][304334] Avg episode reward: [(0, '4620.406')] [2023-03-08 02:20:01,851][304623] Updated weights for policy 0, policy_version 89440 (0.0004) [2023-03-08 02:20:04,749][304623] Updated weights for policy 0, policy_version 89520 (0.0004) [2023-03-08 02:20:05,769][304334] Fps is (10 sec: 13926.3, 60 sec: 12970.6, 300 sec: 13301.6). Total num frames: 45846528. Throughput: 0: 13041.5. Samples: 45823056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:20:05,769][304334] Avg episode reward: [(0, '4650.007')] [2023-03-08 02:20:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000089544_45846528.pth... [2023-03-08 02:20:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000088760_45445120.pth [2023-03-08 02:20:07,652][304623] Updated weights for policy 0, policy_version 89600 (0.0003) [2023-03-08 02:20:10,555][304623] Updated weights for policy 0, policy_version 89680 (0.0003) [2023-03-08 02:20:10,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13038.9, 300 sec: 13301.6). Total num frames: 45916160. Throughput: 0: 13304.4. Samples: 45908040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:20:10,769][304334] Avg episode reward: [(0, '4655.543')] [2023-03-08 02:20:13,539][304623] Updated weights for policy 0, policy_version 89760 (0.0003) [2023-03-08 02:20:15,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13175.5, 300 sec: 13301.6). Total num frames: 45985792. Throughput: 0: 13406.7. Samples: 45949000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:20:15,769][304334] Avg episode reward: [(0, '4648.297')] [2023-03-08 02:20:16,495][304623] Updated weights for policy 0, policy_version 89840 (0.0003) [2023-03-08 02:20:19,464][304623] Updated weights for policy 0, policy_version 89920 (0.0004) [2023-03-08 02:20:20,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13312.0, 300 sec: 13315.5). Total num frames: 46055424. Throughput: 0: 13502.8. Samples: 46031556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:20:20,769][304334] Avg episode reward: [(0, '4672.707')] [2023-03-08 02:20:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000089952_46055424.pth... [2023-03-08 02:20:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000089144_45641728.pth [2023-03-08 02:20:22,349][304623] Updated weights for policy 0, policy_version 90000 (0.0004) [2023-03-08 02:20:25,336][304623] Updated weights for policy 0, policy_version 90080 (0.0003) [2023-03-08 02:20:25,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13448.5, 300 sec: 13315.5). Total num frames: 46125056. Throughput: 0: 13578.1. Samples: 46116724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:20:25,769][304334] Avg episode reward: [(0, '4641.655')] [2023-03-08 02:20:28,332][304623] Updated weights for policy 0, policy_version 90160 (0.0003) [2023-03-08 02:20:30,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13585.1, 300 sec: 13329.4). Total num frames: 46194688. Throughput: 0: 13635.4. Samples: 46157016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:20:30,769][304334] Avg episode reward: [(0, '4664.448')] [2023-03-08 02:20:31,374][304623] Updated weights for policy 0, policy_version 90240 (0.0004) [2023-03-08 02:20:34,741][304623] Updated weights for policy 0, policy_version 90320 (0.0005) [2023-03-08 02:20:35,769][304334] Fps is (10 sec: 13106.9, 60 sec: 13516.8, 300 sec: 13301.6). Total num frames: 46256128. Throughput: 0: 13691.9. Samples: 46235620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:20:35,770][304334] Avg episode reward: [(0, '4602.327')] [2023-03-08 02:20:35,774][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000090344_46256128.pth... [2023-03-08 02:20:35,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000089544_45846528.pth [2023-03-08 02:20:38,034][304623] Updated weights for policy 0, policy_version 90400 (0.0005) [2023-03-08 02:20:40,769][304334] Fps is (10 sec: 12287.9, 60 sec: 13380.3, 300 sec: 13273.8). Total num frames: 46317568. Throughput: 0: 13543.9. Samples: 46308612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:20:40,769][304334] Avg episode reward: [(0, '4572.180')] [2023-03-08 02:20:41,412][304623] Updated weights for policy 0, policy_version 90480 (0.0005) [2023-03-08 02:20:44,698][304623] Updated weights for policy 0, policy_version 90560 (0.0005) [2023-03-08 02:20:45,769][304334] Fps is (10 sec: 12288.1, 60 sec: 13380.2, 300 sec: 13259.9). Total num frames: 46379008. Throughput: 0: 13469.3. Samples: 46346216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:20:45,770][304334] Avg episode reward: [(0, '4601.603')] [2023-03-08 02:20:47,995][304623] Updated weights for policy 0, policy_version 90640 (0.0005) [2023-03-08 02:20:50,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13312.0, 300 sec: 13232.2). Total num frames: 46440448. Throughput: 0: 13265.2. Samples: 46419992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:20:50,769][304334] Avg episode reward: [(0, '4637.573')] [2023-03-08 02:20:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000090704_46440448.pth... [2023-03-08 02:20:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000089952_46055424.pth [2023-03-08 02:20:51,339][304623] Updated weights for policy 0, policy_version 90720 (0.0005) [2023-03-08 02:20:54,537][304623] Updated weights for policy 0, policy_version 90800 (0.0005) [2023-03-08 02:20:55,769][304334] Fps is (10 sec: 12288.1, 60 sec: 13243.7, 300 sec: 13204.4). Total num frames: 46501888. Throughput: 0: 13052.1. Samples: 46495384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:20:55,769][304334] Avg episode reward: [(0, '4604.335')] [2023-03-08 02:20:57,531][304623] Updated weights for policy 0, policy_version 90880 (0.0005) [2023-03-08 02:21:00,514][304623] Updated weights for policy 0, policy_version 90960 (0.0004) [2023-03-08 02:21:00,769][304334] Fps is (10 sec: 13107.4, 60 sec: 13243.8, 300 sec: 13204.4). Total num frames: 46571520. Throughput: 0: 13058.2. Samples: 46536616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:21:00,769][304334] Avg episode reward: [(0, '4638.513')] [2023-03-08 02:21:03,503][304623] Updated weights for policy 0, policy_version 91040 (0.0005) [2023-03-08 02:21:05,769][304334] Fps is (10 sec: 13516.6, 60 sec: 13175.4, 300 sec: 13190.5). Total num frames: 46637056. Throughput: 0: 13051.4. Samples: 46618872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:21:05,769][304334] Avg episode reward: [(0, '4661.934')] [2023-03-08 02:21:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000091096_46641152.pth... [2023-03-08 02:21:05,773][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000090344_46256128.pth [2023-03-08 02:21:06,696][304623] Updated weights for policy 0, policy_version 91120 (0.0005) [2023-03-08 02:21:09,649][304623] Updated weights for policy 0, policy_version 91200 (0.0004) [2023-03-08 02:21:10,769][304334] Fps is (10 sec: 13516.6, 60 sec: 13175.5, 300 sec: 13204.4). Total num frames: 46706688. Throughput: 0: 12932.4. Samples: 46698684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:21:10,769][304334] Avg episode reward: [(0, '4662.518')] [2023-03-08 02:21:12,816][304623] Updated weights for policy 0, policy_version 91280 (0.0005) [2023-03-08 02:21:15,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13107.2, 300 sec: 13190.5). Total num frames: 46772224. Throughput: 0: 12895.8. Samples: 46737328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:21:15,769][304334] Avg episode reward: [(0, '4619.482')] [2023-03-08 02:21:16,072][304623] Updated weights for policy 0, policy_version 91360 (0.0005) [2023-03-08 02:21:19,345][304623] Updated weights for policy 0, policy_version 91440 (0.0005) [2023-03-08 02:21:20,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12970.7, 300 sec: 13176.6). Total num frames: 46833664. Throughput: 0: 12830.4. Samples: 46812988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:21:20,769][304334] Avg episode reward: [(0, '4658.135')] [2023-03-08 02:21:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000091472_46833664.pth... [2023-03-08 02:21:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000090704_46440448.pth [2023-03-08 02:21:22,579][304623] Updated weights for policy 0, policy_version 91520 (0.0005) [2023-03-08 02:21:25,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12834.1, 300 sec: 13162.7). Total num frames: 46895104. Throughput: 0: 12870.5. Samples: 46887784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:21:25,769][304334] Avg episode reward: [(0, '4662.835')] [2023-03-08 02:21:25,826][304623] Updated weights for policy 0, policy_version 91600 (0.0005) [2023-03-08 02:21:29,043][304623] Updated weights for policy 0, policy_version 91680 (0.0006) [2023-03-08 02:21:30,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12765.9, 300 sec: 13148.9). Total num frames: 46960640. Throughput: 0: 12908.4. Samples: 46927092. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:21:30,769][304334] Avg episode reward: [(0, '4674.899')] [2023-03-08 02:21:32,295][304623] Updated weights for policy 0, policy_version 91760 (0.0005) [2023-03-08 02:21:35,562][304623] Updated weights for policy 0, policy_version 91840 (0.0005) [2023-03-08 02:21:35,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12765.9, 300 sec: 13135.0). Total num frames: 47022080. Throughput: 0: 12926.2. Samples: 47001672. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:21:35,780][304334] Avg episode reward: [(0, '4632.336')] [2023-03-08 02:21:35,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000091840_47022080.pth... [2023-03-08 02:21:35,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000091096_46641152.pth [2023-03-08 02:21:38,823][304623] Updated weights for policy 0, policy_version 91920 (0.0005) [2023-03-08 02:21:40,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12834.1, 300 sec: 13135.0). Total num frames: 47087616. Throughput: 0: 12941.8. Samples: 47077768. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:21:40,780][304334] Avg episode reward: [(0, '4673.615')] [2023-03-08 02:21:41,995][304623] Updated weights for policy 0, policy_version 92000 (0.0005) [2023-03-08 02:21:45,320][304623] Updated weights for policy 0, policy_version 92080 (0.0005) [2023-03-08 02:21:45,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12834.1, 300 sec: 13107.2). Total num frames: 47149056. Throughput: 0: 12881.7. Samples: 47116296. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:21:45,769][304334] Avg episode reward: [(0, '4682.333')] [2023-03-08 02:21:48,636][304623] Updated weights for policy 0, policy_version 92160 (0.0006) [2023-03-08 02:21:50,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12834.1, 300 sec: 13093.3). Total num frames: 47210496. Throughput: 0: 12693.5. Samples: 47190080. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:21:50,780][304334] Avg episode reward: [(0, '4655.228')] [2023-03-08 02:21:50,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000092208_47210496.pth... [2023-03-08 02:21:50,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000091472_46833664.pth [2023-03-08 02:21:51,876][304623] Updated weights for policy 0, policy_version 92240 (0.0005) [2023-03-08 02:21:55,040][304623] Updated weights for policy 0, policy_version 92320 (0.0005) [2023-03-08 02:21:55,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12902.4, 300 sec: 13079.4). Total num frames: 47276032. Throughput: 0: 12638.0. Samples: 47267392. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:21:55,780][304334] Avg episode reward: [(0, '4653.295')] [2023-03-08 02:21:58,340][304623] Updated weights for policy 0, policy_version 92400 (0.0005) [2023-03-08 02:22:00,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12765.8, 300 sec: 13065.5). Total num frames: 47337472. Throughput: 0: 12607.0. Samples: 47304640. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:22:00,780][304334] Avg episode reward: [(0, '4589.142')] [2023-03-08 02:22:01,639][304623] Updated weights for policy 0, policy_version 92480 (0.0005) [2023-03-08 02:22:04,922][304623] Updated weights for policy 0, policy_version 92560 (0.0005) [2023-03-08 02:22:05,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12697.6, 300 sec: 13037.8). Total num frames: 47398912. Throughput: 0: 12573.1. Samples: 47378776. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:22:05,769][304334] Avg episode reward: [(0, '4391.518')] [2023-03-08 02:22:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000092576_47398912.pth... [2023-03-08 02:22:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000091840_47022080.pth [2023-03-08 02:22:08,180][304623] Updated weights for policy 0, policy_version 92640 (0.0005) [2023-03-08 02:22:10,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 13037.8). Total num frames: 47460352. Throughput: 0: 12577.4. Samples: 47453768. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:22:10,769][304334] Avg episode reward: [(0, '4483.547')] [2023-03-08 02:22:11,451][304623] Updated weights for policy 0, policy_version 92720 (0.0005) [2023-03-08 02:22:14,690][304623] Updated weights for policy 0, policy_version 92800 (0.0005) [2023-03-08 02:22:15,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12561.1, 300 sec: 13037.8). Total num frames: 47525888. Throughput: 0: 12540.1. Samples: 47491396. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:22:15,769][304334] Avg episode reward: [(0, '4530.492')] [2023-03-08 02:22:17,823][304623] Updated weights for policy 0, policy_version 92880 (0.0005) [2023-03-08 02:22:20,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12629.4, 300 sec: 13051.7). Total num frames: 47591424. Throughput: 0: 12649.5. Samples: 47570896. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 02:22:20,769][304334] Avg episode reward: [(0, '4563.635')] [2023-03-08 02:22:20,771][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000092952_47591424.pth... [2023-03-08 02:22:20,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000092208_47210496.pth [2023-03-08 02:22:20,820][304623] Updated weights for policy 0, policy_version 92960 (0.0004) [2023-03-08 02:22:23,743][304623] Updated weights for policy 0, policy_version 93040 (0.0004) [2023-03-08 02:22:25,769][304334] Fps is (10 sec: 13516.7, 60 sec: 12765.9, 300 sec: 13065.5). Total num frames: 47661056. Throughput: 0: 12781.4. Samples: 47652928. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:22:25,769][304334] Avg episode reward: [(0, '4571.816')] [2023-03-08 02:22:26,955][304623] Updated weights for policy 0, policy_version 93120 (0.0004) [2023-03-08 02:22:30,228][304623] Updated weights for policy 0, policy_version 93200 (0.0005) [2023-03-08 02:22:30,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12697.6, 300 sec: 13037.8). Total num frames: 47722496. Throughput: 0: 12753.0. Samples: 47690180. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:22:30,769][304334] Avg episode reward: [(0, '4587.574')] [2023-03-08 02:22:33,530][304623] Updated weights for policy 0, policy_version 93280 (0.0005) [2023-03-08 02:22:35,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12765.9, 300 sec: 13023.9). Total num frames: 47788032. Throughput: 0: 12776.3. Samples: 47765012. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:22:35,769][304334] Avg episode reward: [(0, '4605.012')] [2023-03-08 02:22:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000093336_47788032.pth... [2023-03-08 02:22:35,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000092576_47398912.pth [2023-03-08 02:22:36,747][304623] Updated weights for policy 0, policy_version 93360 (0.0005) [2023-03-08 02:22:40,060][304623] Updated weights for policy 0, policy_version 93440 (0.0005) [2023-03-08 02:22:40,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 12996.1). Total num frames: 47849472. Throughput: 0: 12742.7. Samples: 47840812. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:22:40,769][304334] Avg episode reward: [(0, '4644.100')] [2023-03-08 02:22:43,366][304623] Updated weights for policy 0, policy_version 93520 (0.0005) [2023-03-08 02:22:45,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12697.6, 300 sec: 12996.1). Total num frames: 47910912. Throughput: 0: 12744.5. Samples: 47878144. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:22:45,769][304334] Avg episode reward: [(0, '4657.168')] [2023-03-08 02:22:46,583][304623] Updated weights for policy 0, policy_version 93600 (0.0005) [2023-03-08 02:22:49,821][304623] Updated weights for policy 0, policy_version 93680 (0.0005) [2023-03-08 02:22:50,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12697.6, 300 sec: 12982.2). Total num frames: 47972352. Throughput: 0: 12773.3. Samples: 47953572. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:22:50,769][304334] Avg episode reward: [(0, '4697.033')] [2023-03-08 02:22:50,786][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000093704_47976448.pth... [2023-03-08 02:22:50,787][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000092952_47591424.pth [2023-03-08 02:22:53,099][304623] Updated weights for policy 0, policy_version 93760 (0.0006) [2023-03-08 02:22:55,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 12968.4). Total num frames: 48037888. Throughput: 0: 12797.2. Samples: 48029644. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:22:55,769][304334] Avg episode reward: [(0, '4638.835')] [2023-03-08 02:22:56,387][304623] Updated weights for policy 0, policy_version 93840 (0.0005) [2023-03-08 02:22:59,610][304623] Updated weights for policy 0, policy_version 93920 (0.0005) [2023-03-08 02:23:00,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12697.6, 300 sec: 12940.6). Total num frames: 48099328. Throughput: 0: 12782.0. Samples: 48066584. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:23:00,769][304334] Avg episode reward: [(0, '4682.340')] [2023-03-08 02:23:02,675][304623] Updated weights for policy 0, policy_version 94000 (0.0004) [2023-03-08 02:23:05,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12765.9, 300 sec: 12926.7). Total num frames: 48164864. Throughput: 0: 12745.8. Samples: 48144456. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:23:05,769][304334] Avg episode reward: [(0, '4695.095')] [2023-03-08 02:23:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000094072_48164864.pth... [2023-03-08 02:23:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000093336_47788032.pth [2023-03-08 02:23:05,941][304623] Updated weights for policy 0, policy_version 94080 (0.0006) [2023-03-08 02:23:09,207][304623] Updated weights for policy 0, policy_version 94160 (0.0006) [2023-03-08 02:23:10,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12765.9, 300 sec: 12912.8). Total num frames: 48226304. Throughput: 0: 12585.1. Samples: 48219256. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:23:10,769][304334] Avg episode reward: [(0, '4668.894')] [2023-03-08 02:23:12,499][304623] Updated weights for policy 0, policy_version 94240 (0.0005) [2023-03-08 02:23:15,480][304623] Updated weights for policy 0, policy_version 94320 (0.0004) [2023-03-08 02:23:15,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12765.9, 300 sec: 12898.9). Total num frames: 48291840. Throughput: 0: 12605.8. Samples: 48257440. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:23:15,769][304334] Avg episode reward: [(0, '4609.063')] [2023-03-08 02:23:18,467][304623] Updated weights for policy 0, policy_version 94400 (0.0004) [2023-03-08 02:23:20,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12834.1, 300 sec: 12898.9). Total num frames: 48361472. Throughput: 0: 12771.6. Samples: 48339732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:23:20,769][304334] Avg episode reward: [(0, '4689.398')] [2023-03-08 02:23:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000094456_48361472.pth... [2023-03-08 02:23:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000093704_47976448.pth [2023-03-08 02:23:21,646][304623] Updated weights for policy 0, policy_version 94480 (0.0005) [2023-03-08 02:23:25,026][304623] Updated weights for policy 0, policy_version 94560 (0.0005) [2023-03-08 02:23:25,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12697.6, 300 sec: 12885.0). Total num frames: 48422912. Throughput: 0: 12750.1. Samples: 48414564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:23:25,769][304334] Avg episode reward: [(0, '4678.431')] [2023-03-08 02:23:28,208][304623] Updated weights for policy 0, policy_version 94640 (0.0005) [2023-03-08 02:23:30,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12765.9, 300 sec: 12898.9). Total num frames: 48488448. Throughput: 0: 12760.4. Samples: 48452364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:23:30,769][304334] Avg episode reward: [(0, '4688.828')] [2023-03-08 02:23:31,327][304623] Updated weights for policy 0, policy_version 94720 (0.0005) [2023-03-08 02:23:34,611][304623] Updated weights for policy 0, policy_version 94800 (0.0005) [2023-03-08 02:23:35,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12697.6, 300 sec: 12885.0). Total num frames: 48549888. Throughput: 0: 12797.8. Samples: 48529472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:23:35,769][304334] Avg episode reward: [(0, '4666.355')] [2023-03-08 02:23:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000094824_48549888.pth... [2023-03-08 02:23:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000094072_48164864.pth [2023-03-08 02:23:37,835][304623] Updated weights for policy 0, policy_version 94880 (0.0005) [2023-03-08 02:23:40,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12765.9, 300 sec: 12898.9). Total num frames: 48615424. Throughput: 0: 12835.7. Samples: 48607252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:23:40,769][304334] Avg episode reward: [(0, '4691.851')] [2023-03-08 02:23:40,907][304623] Updated weights for policy 0, policy_version 94960 (0.0005) [2023-03-08 02:23:43,825][304623] Updated weights for policy 0, policy_version 95040 (0.0004) [2023-03-08 02:23:45,769][304334] Fps is (10 sec: 13516.9, 60 sec: 12902.4, 300 sec: 12898.9). Total num frames: 48685056. Throughput: 0: 12926.0. Samples: 48648256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:23:45,769][304334] Avg episode reward: [(0, '4695.737')] [2023-03-08 02:23:46,777][304623] Updated weights for policy 0, policy_version 95120 (0.0004) [2023-03-08 02:23:49,907][304623] Updated weights for policy 0, policy_version 95200 (0.0004) [2023-03-08 02:23:50,769][304334] Fps is (10 sec: 13516.7, 60 sec: 12970.6, 300 sec: 12898.9). Total num frames: 48750592. Throughput: 0: 13035.5. Samples: 48731052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:23:50,769][304334] Avg episode reward: [(0, '4654.549')] [2023-03-08 02:23:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000095216_48750592.pth... [2023-03-08 02:23:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000094456_48361472.pth [2023-03-08 02:23:53,179][304623] Updated weights for policy 0, policy_version 95280 (0.0005) [2023-03-08 02:23:55,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12902.4, 300 sec: 12898.9). Total num frames: 48812032. Throughput: 0: 13029.8. Samples: 48805596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:23:55,769][304334] Avg episode reward: [(0, '4677.085')] [2023-03-08 02:23:56,558][304623] Updated weights for policy 0, policy_version 95360 (0.0005) [2023-03-08 02:23:59,840][304623] Updated weights for policy 0, policy_version 95440 (0.0005) [2023-03-08 02:24:00,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12902.4, 300 sec: 12898.9). Total num frames: 48873472. Throughput: 0: 12985.4. Samples: 48841784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:24:00,769][304334] Avg episode reward: [(0, '4673.574')] [2023-03-08 02:24:03,198][304623] Updated weights for policy 0, policy_version 95520 (0.0005) [2023-03-08 02:24:05,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12834.1, 300 sec: 12885.0). Total num frames: 48934912. Throughput: 0: 12784.3. Samples: 48915024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:24:05,769][304334] Avg episode reward: [(0, '4544.948')] [2023-03-08 02:24:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000095576_48934912.pth... [2023-03-08 02:24:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000094824_48549888.pth [2023-03-08 02:24:06,656][304623] Updated weights for policy 0, policy_version 95600 (0.0005) [2023-03-08 02:24:09,924][304623] Updated weights for policy 0, policy_version 95680 (0.0005) [2023-03-08 02:24:10,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12834.1, 300 sec: 12885.0). Total num frames: 48996352. Throughput: 0: 12752.7. Samples: 48988436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:24:10,769][304334] Avg episode reward: [(0, '4666.016')] [2023-03-08 02:24:13,251][304623] Updated weights for policy 0, policy_version 95760 (0.0005) [2023-03-08 02:24:15,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12765.9, 300 sec: 12885.0). Total num frames: 49057792. Throughput: 0: 12739.0. Samples: 49025616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:24:15,769][304334] Avg episode reward: [(0, '4613.493')] [2023-03-08 02:24:16,588][304623] Updated weights for policy 0, policy_version 95840 (0.0005) [2023-03-08 02:24:19,594][304623] Updated weights for policy 0, policy_version 95920 (0.0004) [2023-03-08 02:24:20,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 12898.9). Total num frames: 49123328. Throughput: 0: 12743.1. Samples: 49102912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:24:20,769][304334] Avg episode reward: [(0, '4550.086')] [2023-03-08 02:24:20,804][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000095952_49127424.pth... [2023-03-08 02:24:20,805][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000095216_48750592.pth [2023-03-08 02:24:22,655][304623] Updated weights for policy 0, policy_version 96000 (0.0005) [2023-03-08 02:24:25,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12765.9, 300 sec: 12912.8). Total num frames: 49188864. Throughput: 0: 12744.3. Samples: 49180744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:24:25,769][304334] Avg episode reward: [(0, '4624.688')] [2023-03-08 02:24:25,962][304623] Updated weights for policy 0, policy_version 96080 (0.0005) [2023-03-08 02:24:29,243][304623] Updated weights for policy 0, policy_version 96160 (0.0005) [2023-03-08 02:24:30,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 12898.9). Total num frames: 49250304. Throughput: 0: 12652.4. Samples: 49217616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:24:30,769][304334] Avg episode reward: [(0, '4622.600')] [2023-03-08 02:24:32,587][304623] Updated weights for policy 0, policy_version 96240 (0.0005) [2023-03-08 02:24:35,676][304623] Updated weights for policy 0, policy_version 96320 (0.0003) [2023-03-08 02:24:35,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12765.9, 300 sec: 12885.0). Total num frames: 49315840. Throughput: 0: 12491.8. Samples: 49293184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:24:35,769][304334] Avg episode reward: [(0, '4651.007')] [2023-03-08 02:24:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000096320_49315840.pth... [2023-03-08 02:24:35,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000095576_48934912.pth [2023-03-08 02:24:39,058][304623] Updated weights for policy 0, policy_version 96400 (0.0005) [2023-03-08 02:24:40,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12697.6, 300 sec: 12885.0). Total num frames: 49377280. Throughput: 0: 12508.7. Samples: 49368492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:24:40,770][304334] Avg episode reward: [(0, '4616.571')] [2023-03-08 02:24:42,374][304623] Updated weights for policy 0, policy_version 96480 (0.0005) [2023-03-08 02:24:45,719][304623] Updated weights for policy 0, policy_version 96560 (0.0005) [2023-03-08 02:24:45,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12561.1, 300 sec: 12871.2). Total num frames: 49438720. Throughput: 0: 12527.7. Samples: 49405532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:24:45,769][304334] Avg episode reward: [(0, '4611.083')] [2023-03-08 02:24:49,051][304623] Updated weights for policy 0, policy_version 96640 (0.0005) [2023-03-08 02:24:50,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 12843.4). Total num frames: 49496064. Throughput: 0: 12545.9. Samples: 49479588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:24:50,769][304334] Avg episode reward: [(0, '4606.868')] [2023-03-08 02:24:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000096680_49500160.pth... [2023-03-08 02:24:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000095952_49127424.pth [2023-03-08 02:24:52,426][304623] Updated weights for policy 0, policy_version 96720 (0.0006) [2023-03-08 02:24:55,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12424.5, 300 sec: 12815.6). Total num frames: 49557504. Throughput: 0: 12513.0. Samples: 49551524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:24:55,770][304334] Avg episode reward: [(0, '4555.619')] [2023-03-08 02:24:55,823][304623] Updated weights for policy 0, policy_version 96800 (0.0005) [2023-03-08 02:24:59,187][304623] Updated weights for policy 0, policy_version 96880 (0.0005) [2023-03-08 02:25:00,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12787.9). Total num frames: 49618944. Throughput: 0: 12488.5. Samples: 49587600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:25:00,769][304334] Avg episode reward: [(0, '4609.751')] [2023-03-08 02:25:02,491][304623] Updated weights for policy 0, policy_version 96960 (0.0005) [2023-03-08 02:25:05,718][304623] Updated weights for policy 0, policy_version 97040 (0.0005) [2023-03-08 02:25:05,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12492.8, 300 sec: 12774.0). Total num frames: 49684480. Throughput: 0: 12452.2. Samples: 49663260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:25:05,769][304334] Avg episode reward: [(0, '4612.183')] [2023-03-08 02:25:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000097040_49684480.pth... [2023-03-08 02:25:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000096320_49315840.pth [2023-03-08 02:25:09,028][304623] Updated weights for policy 0, policy_version 97120 (0.0005) [2023-03-08 02:25:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12746.2). Total num frames: 49745920. Throughput: 0: 12361.0. Samples: 49736988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:25:10,769][304334] Avg episode reward: [(0, '4651.476')] [2023-03-08 02:25:12,430][304623] Updated weights for policy 0, policy_version 97200 (0.0005) [2023-03-08 02:25:15,730][304623] Updated weights for policy 0, policy_version 97280 (0.0005) [2023-03-08 02:25:15,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12718.4). Total num frames: 49807360. Throughput: 0: 12356.6. Samples: 49773664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:25:15,769][304334] Avg episode reward: [(0, '4644.212')] [2023-03-08 02:25:19,136][304623] Updated weights for policy 0, policy_version 97360 (0.0005) [2023-03-08 02:25:20,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12356.3, 300 sec: 12676.8). Total num frames: 49864704. Throughput: 0: 12303.5. Samples: 49846840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:25:20,769][304334] Avg episode reward: [(0, '4670.475')] [2023-03-08 02:25:20,835][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000097400_49868800.pth... [2023-03-08 02:25:20,836][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000096680_49500160.pth [2023-03-08 02:25:22,532][304623] Updated weights for policy 0, policy_version 97440 (0.0005) [2023-03-08 02:25:25,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12288.0, 300 sec: 12649.0). Total num frames: 49926144. Throughput: 0: 12255.4. Samples: 49919984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:25:25,769][304334] Avg episode reward: [(0, '4621.807')] [2023-03-08 02:25:25,808][304623] Updated weights for policy 0, policy_version 97520 (0.0005) [2023-03-08 02:25:29,176][304623] Updated weights for policy 0, policy_version 97600 (0.0005) [2023-03-08 02:25:30,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 12649.0). Total num frames: 49987584. Throughput: 0: 12249.2. Samples: 49956748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:25:30,769][304334] Avg episode reward: [(0, '4591.931')] [2023-03-08 02:25:32,548][304623] Updated weights for policy 0, policy_version 97680 (0.0005) [2023-03-08 02:25:35,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12219.7, 300 sec: 12649.0). Total num frames: 50049024. Throughput: 0: 12220.8. Samples: 50029524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:25:35,769][304334] Avg episode reward: [(0, '4547.995')] [2023-03-08 02:25:35,816][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000097760_50053120.pth... [2023-03-08 02:25:35,816][304623] Updated weights for policy 0, policy_version 97760 (0.0005) [2023-03-08 02:25:35,818][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000097040_49684480.pth [2023-03-08 02:25:39,066][304623] Updated weights for policy 0, policy_version 97840 (0.0004) [2023-03-08 02:25:40,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12288.0, 300 sec: 12662.9). Total num frames: 50114560. Throughput: 0: 12315.7. Samples: 50105728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:25:40,769][304334] Avg episode reward: [(0, '4581.847')] [2023-03-08 02:25:42,356][304623] Updated weights for policy 0, policy_version 97920 (0.0004) [2023-03-08 02:25:45,668][304623] Updated weights for policy 0, policy_version 98000 (0.0005) [2023-03-08 02:25:45,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 12662.9). Total num frames: 50176000. Throughput: 0: 12344.7. Samples: 50143112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:25:45,769][304334] Avg episode reward: [(0, '4677.052')] [2023-03-08 02:25:48,943][304623] Updated weights for policy 0, policy_version 98080 (0.0005) [2023-03-08 02:25:50,769][304334] Fps is (10 sec: 12287.8, 60 sec: 12356.3, 300 sec: 12662.9). Total num frames: 50237440. Throughput: 0: 12306.0. Samples: 50217032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:25:50,769][304334] Avg episode reward: [(0, '4674.099')] [2023-03-08 02:25:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000098120_50237440.pth... [2023-03-08 02:25:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000097400_49868800.pth [2023-03-08 02:25:52,149][304623] Updated weights for policy 0, policy_version 98160 (0.0004) [2023-03-08 02:25:55,163][304623] Updated weights for policy 0, policy_version 98240 (0.0004) [2023-03-08 02:25:55,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12492.8, 300 sec: 12662.9). Total num frames: 50307072. Throughput: 0: 12418.8. Samples: 50295832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:25:55,769][304334] Avg episode reward: [(0, '4613.927')] [2023-03-08 02:25:58,193][304623] Updated weights for policy 0, policy_version 98320 (0.0004) [2023-03-08 02:26:00,769][304334] Fps is (10 sec: 13516.9, 60 sec: 12561.1, 300 sec: 12662.9). Total num frames: 50372608. Throughput: 0: 12512.7. Samples: 50336736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:26:00,769][304334] Avg episode reward: [(0, '4612.845')] [2023-03-08 02:26:01,125][304623] Updated weights for policy 0, policy_version 98400 (0.0003) [2023-03-08 02:26:04,111][304623] Updated weights for policy 0, policy_version 98480 (0.0004) [2023-03-08 02:26:05,769][304334] Fps is (10 sec: 13516.7, 60 sec: 12629.3, 300 sec: 12662.9). Total num frames: 50442240. Throughput: 0: 12729.6. Samples: 50419672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:26:05,769][304334] Avg episode reward: [(0, '4640.407')] [2023-03-08 02:26:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000098520_50442240.pth... [2023-03-08 02:26:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000097760_50053120.pth [2023-03-08 02:26:07,223][304623] Updated weights for policy 0, policy_version 98560 (0.0004) [2023-03-08 02:26:10,559][304623] Updated weights for policy 0, policy_version 98640 (0.0005) [2023-03-08 02:26:10,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12629.3, 300 sec: 12649.0). Total num frames: 50503680. Throughput: 0: 12798.9. Samples: 50495932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:26:10,769][304334] Avg episode reward: [(0, '4646.243')] [2023-03-08 02:26:13,852][304623] Updated weights for policy 0, policy_version 98720 (0.0005) [2023-03-08 02:26:15,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12629.3, 300 sec: 12649.0). Total num frames: 50565120. Throughput: 0: 12830.7. Samples: 50534128. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:26:15,769][304334] Avg episode reward: [(0, '4675.119')] [2023-03-08 02:26:17,142][304623] Updated weights for policy 0, policy_version 98800 (0.0005) [2023-03-08 02:26:20,286][304623] Updated weights for policy 0, policy_version 98880 (0.0004) [2023-03-08 02:26:20,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12765.9, 300 sec: 12662.9). Total num frames: 50630656. Throughput: 0: 12855.3. Samples: 50608012. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:26:20,769][304334] Avg episode reward: [(0, '4676.100')] [2023-03-08 02:26:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000098888_50630656.pth... [2023-03-08 02:26:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000098120_50237440.pth [2023-03-08 02:26:23,491][304623] Updated weights for policy 0, policy_version 98960 (0.0005) [2023-03-08 02:26:25,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12765.9, 300 sec: 12649.0). Total num frames: 50692096. Throughput: 0: 12909.7. Samples: 50686664. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:26:25,769][304334] Avg episode reward: [(0, '4699.960')] [2023-03-08 02:26:26,791][304623] Updated weights for policy 0, policy_version 99040 (0.0005) [2023-03-08 02:26:30,132][304623] Updated weights for policy 0, policy_version 99120 (0.0005) [2023-03-08 02:26:30,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12765.9, 300 sec: 12649.0). Total num frames: 50753536. Throughput: 0: 12891.2. Samples: 50723216. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:26:30,769][304334] Avg episode reward: [(0, '4700.396')] [2023-03-08 02:26:33,386][304623] Updated weights for policy 0, policy_version 99200 (0.0005) [2023-03-08 02:26:35,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12834.1, 300 sec: 12649.0). Total num frames: 50819072. Throughput: 0: 12923.3. Samples: 50798580. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:26:35,769][304334] Avg episode reward: [(0, '4682.100')] [2023-03-08 02:26:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000099256_50819072.pth... [2023-03-08 02:26:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000098520_50442240.pth [2023-03-08 02:26:36,590][304623] Updated weights for policy 0, policy_version 99280 (0.0003) [2023-03-08 02:26:39,732][304623] Updated weights for policy 0, policy_version 99360 (0.0004) [2023-03-08 02:26:40,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12834.1, 300 sec: 12662.9). Total num frames: 50884608. Throughput: 0: 12891.0. Samples: 50875928. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:26:40,769][304334] Avg episode reward: [(0, '4672.347')] [2023-03-08 02:26:42,713][304623] Updated weights for policy 0, policy_version 99440 (0.0004) [2023-03-08 02:26:45,641][304623] Updated weights for policy 0, policy_version 99520 (0.0003) [2023-03-08 02:26:45,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12970.7, 300 sec: 12690.7). Total num frames: 50954240. Throughput: 0: 12896.7. Samples: 50917088. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:26:45,769][304334] Avg episode reward: [(0, '4698.235')] [2023-03-08 02:26:48,616][304623] Updated weights for policy 0, policy_version 99600 (0.0004) [2023-03-08 02:26:50,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13038.9, 300 sec: 12690.7). Total num frames: 51019776. Throughput: 0: 12887.0. Samples: 50999588. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:26:50,769][304334] Avg episode reward: [(0, '4701.292')] [2023-03-08 02:26:50,788][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000099656_51023872.pth... [2023-03-08 02:26:50,790][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000098888_50630656.pth [2023-03-08 02:26:51,700][304623] Updated weights for policy 0, policy_version 99680 (0.0004) [2023-03-08 02:26:54,658][304623] Updated weights for policy 0, policy_version 99760 (0.0004) [2023-03-08 02:26:55,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13038.9, 300 sec: 12718.4). Total num frames: 51089408. Throughput: 0: 13007.9. Samples: 51081288. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:26:55,769][304334] Avg episode reward: [(0, '4647.332')] [2023-03-08 02:26:57,624][304623] Updated weights for policy 0, policy_version 99840 (0.0004) [2023-03-08 02:27:00,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13038.9, 300 sec: 12732.3). Total num frames: 51154944. Throughput: 0: 13070.7. Samples: 51122312. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:27:00,769][304334] Avg episode reward: [(0, '4703.679')] [2023-03-08 02:27:00,874][304623] Updated weights for policy 0, policy_version 99920 (0.0004) [2023-03-08 02:27:04,127][304623] Updated weights for policy 0, policy_version 100000 (0.0005) [2023-03-08 02:27:05,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12970.7, 300 sec: 12746.2). Total num frames: 51220480. Throughput: 0: 13116.4. Samples: 51198248. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:27:05,769][304334] Avg episode reward: [(0, '4690.137')] [2023-03-08 02:27:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000100040_51220480.pth... [2023-03-08 02:27:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000099256_50819072.pth [2023-03-08 02:27:07,383][304623] Updated weights for policy 0, policy_version 100080 (0.0005) [2023-03-08 02:27:10,627][304623] Updated weights for policy 0, policy_version 100160 (0.0004) [2023-03-08 02:27:10,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12970.7, 300 sec: 12732.3). Total num frames: 51281920. Throughput: 0: 13047.6. Samples: 51273808. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:27:10,769][304334] Avg episode reward: [(0, '4667.574')] [2023-03-08 02:27:13,983][304623] Updated weights for policy 0, policy_version 100240 (0.0005) [2023-03-08 02:27:15,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12970.7, 300 sec: 12718.4). Total num frames: 51343360. Throughput: 0: 13054.4. Samples: 51310664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:27:15,769][304334] Avg episode reward: [(0, '4693.038')] [2023-03-08 02:27:17,338][304623] Updated weights for policy 0, policy_version 100320 (0.0004) [2023-03-08 02:27:20,669][304623] Updated weights for policy 0, policy_version 100400 (0.0005) [2023-03-08 02:27:20,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12902.4, 300 sec: 12690.7). Total num frames: 51404800. Throughput: 0: 13016.7. Samples: 51384332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:27:20,769][304334] Avg episode reward: [(0, '4699.848')] [2023-03-08 02:27:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000100400_51404800.pth... [2023-03-08 02:27:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000099656_51023872.pth [2023-03-08 02:27:23,904][304623] Updated weights for policy 0, policy_version 100480 (0.0004) [2023-03-08 02:27:25,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12902.4, 300 sec: 12690.7). Total num frames: 51466240. Throughput: 0: 12967.5. Samples: 51459464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:27:25,769][304334] Avg episode reward: [(0, '4703.682')] [2023-03-08 02:27:27,163][304623] Updated weights for policy 0, policy_version 100560 (0.0005) [2023-03-08 02:27:30,491][304623] Updated weights for policy 0, policy_version 100640 (0.0005) [2023-03-08 02:27:30,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12902.4, 300 sec: 12676.8). Total num frames: 51527680. Throughput: 0: 12869.7. Samples: 51496224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:27:30,769][304334] Avg episode reward: [(0, '4690.336')] [2023-03-08 02:27:33,801][304623] Updated weights for policy 0, policy_version 100720 (0.0005) [2023-03-08 02:27:35,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12834.1, 300 sec: 12676.8). Total num frames: 51589120. Throughput: 0: 12701.0. Samples: 51571132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:27:35,769][304334] Avg episode reward: [(0, '4706.595')] [2023-03-08 02:27:35,771][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000100768_51593216.pth... [2023-03-08 02:27:35,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000100040_51220480.pth [2023-03-08 02:27:37,079][304623] Updated weights for policy 0, policy_version 100800 (0.0005) [2023-03-08 02:27:40,366][304623] Updated weights for policy 0, policy_version 100880 (0.0005) [2023-03-08 02:27:40,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12834.1, 300 sec: 12690.7). Total num frames: 51654656. Throughput: 0: 12553.9. Samples: 51646212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:27:40,769][304334] Avg episode reward: [(0, '4704.359')] [2023-03-08 02:27:43,624][304623] Updated weights for policy 0, policy_version 100960 (0.0005) [2023-03-08 02:27:45,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 12690.7). Total num frames: 51716096. Throughput: 0: 12468.4. Samples: 51683392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:27:45,769][304334] Avg episode reward: [(0, '4674.979')] [2023-03-08 02:27:46,948][304623] Updated weights for policy 0, policy_version 101040 (0.0005) [2023-03-08 02:27:50,266][304623] Updated weights for policy 0, policy_version 101120 (0.0005) [2023-03-08 02:27:50,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12629.3, 300 sec: 12676.8). Total num frames: 51777536. Throughput: 0: 12418.2. Samples: 51757068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:27:50,769][304334] Avg episode reward: [(0, '4687.616')] [2023-03-08 02:27:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000101128_51777536.pth... [2023-03-08 02:27:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000100400_51404800.pth [2023-03-08 02:27:53,512][304623] Updated weights for policy 0, policy_version 101200 (0.0005) [2023-03-08 02:27:55,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12492.8, 300 sec: 12676.8). Total num frames: 51838976. Throughput: 0: 12417.5. Samples: 51832596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:27:55,769][304334] Avg episode reward: [(0, '4707.619')] [2023-03-08 02:27:56,803][304623] Updated weights for policy 0, policy_version 101280 (0.0004) [2023-03-08 02:28:00,047][304623] Updated weights for policy 0, policy_version 101360 (0.0004) [2023-03-08 02:28:00,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12676.8). Total num frames: 51904512. Throughput: 0: 12436.8. Samples: 51870320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:28:00,769][304334] Avg episode reward: [(0, '4690.586')] [2023-03-08 02:28:03,379][304623] Updated weights for policy 0, policy_version 101440 (0.0005) [2023-03-08 02:28:05,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 12676.8). Total num frames: 51965952. Throughput: 0: 12469.8. Samples: 51945472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:28:05,769][304334] Avg episode reward: [(0, '4702.681')] [2023-03-08 02:28:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000101496_51965952.pth... [2023-03-08 02:28:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000100768_51593216.pth [2023-03-08 02:28:06,660][304623] Updated weights for policy 0, policy_version 101520 (0.0005) [2023-03-08 02:28:09,903][304623] Updated weights for policy 0, policy_version 101600 (0.0005) [2023-03-08 02:28:10,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12662.9). Total num frames: 52027392. Throughput: 0: 12450.6. Samples: 52019740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:28:10,769][304334] Avg episode reward: [(0, '4717.298')] [2023-03-08 02:28:10,770][304573] Saving new best policy, reward=4717.298! [2023-03-08 02:28:13,133][304623] Updated weights for policy 0, policy_version 101680 (0.0005) [2023-03-08 02:28:15,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12635.1). Total num frames: 52088832. Throughput: 0: 12489.4. Samples: 52058248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:28:15,769][304334] Avg episode reward: [(0, '4702.464')] [2023-03-08 02:28:16,459][304623] Updated weights for policy 0, policy_version 101760 (0.0005) [2023-03-08 02:28:19,709][304623] Updated weights for policy 0, policy_version 101840 (0.0005) [2023-03-08 02:28:20,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12649.0). Total num frames: 52154368. Throughput: 0: 12502.8. Samples: 52133756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:28:20,769][304334] Avg episode reward: [(0, '4668.446')] [2023-03-08 02:28:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000101864_52154368.pth... [2023-03-08 02:28:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000101128_51777536.pth [2023-03-08 02:28:23,040][304623] Updated weights for policy 0, policy_version 101920 (0.0005) [2023-03-08 02:28:25,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12492.8, 300 sec: 12635.1). Total num frames: 52215808. Throughput: 0: 12475.9. Samples: 52207628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:28:25,769][304334] Avg episode reward: [(0, '4640.124')] [2023-03-08 02:28:26,254][304623] Updated weights for policy 0, policy_version 102000 (0.0005) [2023-03-08 02:28:29,490][304623] Updated weights for policy 0, policy_version 102080 (0.0005) [2023-03-08 02:28:30,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12635.1). Total num frames: 52277248. Throughput: 0: 12485.3. Samples: 52245228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:28:30,769][304334] Avg episode reward: [(0, '4655.253')] [2023-03-08 02:28:32,666][304623] Updated weights for policy 0, policy_version 102160 (0.0004) [2023-03-08 02:28:35,543][304623] Updated weights for policy 0, policy_version 102240 (0.0004) [2023-03-08 02:28:35,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12629.3, 300 sec: 12649.0). Total num frames: 52346880. Throughput: 0: 12609.0. Samples: 52324472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:28:35,769][304334] Avg episode reward: [(0, '4672.550')] [2023-03-08 02:28:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000102240_52346880.pth... [2023-03-08 02:28:35,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000101496_51965952.pth [2023-03-08 02:28:38,646][304623] Updated weights for policy 0, policy_version 102320 (0.0004) [2023-03-08 02:28:40,769][304334] Fps is (10 sec: 13516.7, 60 sec: 12629.3, 300 sec: 12635.1). Total num frames: 52412416. Throughput: 0: 12717.3. Samples: 52404872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:28:40,780][304334] Avg episode reward: [(0, '4705.766')] [2023-03-08 02:28:41,847][304623] Updated weights for policy 0, policy_version 102400 (0.0005) [2023-03-08 02:28:45,230][304623] Updated weights for policy 0, policy_version 102480 (0.0005) [2023-03-08 02:28:45,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12621.2). Total num frames: 52473856. Throughput: 0: 12706.0. Samples: 52442092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:28:45,780][304334] Avg episode reward: [(0, '4695.584')] [2023-03-08 02:28:48,368][304623] Updated weights for policy 0, policy_version 102560 (0.0004) [2023-03-08 02:28:50,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12765.9, 300 sec: 12649.0). Total num frames: 52543488. Throughput: 0: 12744.6. Samples: 52518976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:28:50,780][304334] Avg episode reward: [(0, '4697.431')] [2023-03-08 02:28:50,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000102624_52543488.pth... [2023-03-08 02:28:50,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000101864_52154368.pth [2023-03-08 02:28:51,352][304623] Updated weights for policy 0, policy_version 102640 (0.0004) [2023-03-08 02:28:54,319][304623] Updated weights for policy 0, policy_version 102720 (0.0004) [2023-03-08 02:28:55,769][304334] Fps is (10 sec: 13926.4, 60 sec: 12902.4, 300 sec: 12676.8). Total num frames: 52613120. Throughput: 0: 12936.2. Samples: 52601868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:28:55,780][304334] Avg episode reward: [(0, '4703.886')] [2023-03-08 02:28:57,172][304623] Updated weights for policy 0, policy_version 102800 (0.0003) [2023-03-08 02:29:00,102][304623] Updated weights for policy 0, policy_version 102880 (0.0003) [2023-03-08 02:29:00,769][304334] Fps is (10 sec: 13926.5, 60 sec: 12970.7, 300 sec: 12704.5). Total num frames: 52682752. Throughput: 0: 13031.6. Samples: 52644668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:29:00,780][304334] Avg episode reward: [(0, '4680.169')] [2023-03-08 02:29:03,103][304623] Updated weights for policy 0, policy_version 102960 (0.0004) [2023-03-08 02:29:05,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13039.0, 300 sec: 12718.4). Total num frames: 52748288. Throughput: 0: 13201.3. Samples: 52727816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:29:05,779][304334] Avg episode reward: [(0, '4695.325')] [2023-03-08 02:29:05,782][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000103032_52752384.pth... [2023-03-08 02:29:05,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000102240_52346880.pth [2023-03-08 02:29:06,062][304623] Updated weights for policy 0, policy_version 103040 (0.0004) [2023-03-08 02:29:09,099][304623] Updated weights for policy 0, policy_version 103120 (0.0003) [2023-03-08 02:29:10,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13175.5, 300 sec: 12746.2). Total num frames: 52817920. Throughput: 0: 13379.5. Samples: 52809704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:29:10,780][304334] Avg episode reward: [(0, '4676.701')] [2023-03-08 02:29:12,096][304623] Updated weights for policy 0, policy_version 103200 (0.0003) [2023-03-08 02:29:15,050][304623] Updated weights for policy 0, policy_version 103280 (0.0003) [2023-03-08 02:29:15,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13312.0, 300 sec: 12760.1). Total num frames: 52887552. Throughput: 0: 13454.1. Samples: 52850664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:29:15,780][304334] Avg episode reward: [(0, '4705.003')] [2023-03-08 02:29:18,044][304623] Updated weights for policy 0, policy_version 103360 (0.0003) [2023-03-08 02:29:20,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13312.0, 300 sec: 12760.1). Total num frames: 52953088. Throughput: 0: 13507.5. Samples: 52932312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:29:20,780][304334] Avg episode reward: [(0, '4699.365')] [2023-03-08 02:29:20,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000103424_52953088.pth... [2023-03-08 02:29:20,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000102624_52543488.pth [2023-03-08 02:29:21,387][304623] Updated weights for policy 0, policy_version 103440 (0.0005) [2023-03-08 02:29:24,771][304623] Updated weights for policy 0, policy_version 103520 (0.0005) [2023-03-08 02:29:25,769][304334] Fps is (10 sec: 12697.5, 60 sec: 13312.0, 300 sec: 12760.1). Total num frames: 53014528. Throughput: 0: 13333.8. Samples: 53004892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:29:25,780][304334] Avg episode reward: [(0, '4708.495')] [2023-03-08 02:29:28,199][304623] Updated weights for policy 0, policy_version 103600 (0.0005) [2023-03-08 02:29:30,769][304334] Fps is (10 sec: 11878.4, 60 sec: 13243.7, 300 sec: 12732.3). Total num frames: 53071872. Throughput: 0: 13285.0. Samples: 53039916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:29:30,780][304334] Avg episode reward: [(0, '4692.000')] [2023-03-08 02:29:31,574][304623] Updated weights for policy 0, policy_version 103680 (0.0005) [2023-03-08 02:29:34,908][304623] Updated weights for policy 0, policy_version 103760 (0.0005) [2023-03-08 02:29:35,769][304334] Fps is (10 sec: 11878.3, 60 sec: 13107.2, 300 sec: 12732.3). Total num frames: 53133312. Throughput: 0: 13215.5. Samples: 53113672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:29:35,780][304334] Avg episode reward: [(0, '4709.138')] [2023-03-08 02:29:35,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000103776_53133312.pth... [2023-03-08 02:29:35,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000103032_52752384.pth [2023-03-08 02:29:38,301][304623] Updated weights for policy 0, policy_version 103840 (0.0005) [2023-03-08 02:29:40,769][304334] Fps is (10 sec: 12288.1, 60 sec: 13038.9, 300 sec: 12732.3). Total num frames: 53194752. Throughput: 0: 12993.4. Samples: 53186572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:29:40,780][304334] Avg episode reward: [(0, '4716.954')] [2023-03-08 02:29:41,655][304623] Updated weights for policy 0, policy_version 103920 (0.0005) [2023-03-08 02:29:44,990][304623] Updated weights for policy 0, policy_version 104000 (0.0005) [2023-03-08 02:29:45,769][304334] Fps is (10 sec: 12288.1, 60 sec: 13038.9, 300 sec: 12746.2). Total num frames: 53256192. Throughput: 0: 12861.2. Samples: 53223424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:29:45,769][304334] Avg episode reward: [(0, '4684.901')] [2023-03-08 02:29:48,255][304623] Updated weights for policy 0, policy_version 104080 (0.0005) [2023-03-08 02:29:50,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12902.4, 300 sec: 12746.2). Total num frames: 53317632. Throughput: 0: 12671.4. Samples: 53298032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:29:50,769][304334] Avg episode reward: [(0, '4702.266')] [2023-03-08 02:29:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000104136_53317632.pth... [2023-03-08 02:29:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000103424_52953088.pth [2023-03-08 02:29:51,471][304623] Updated weights for policy 0, policy_version 104160 (0.0005) [2023-03-08 02:29:54,627][304623] Updated weights for policy 0, policy_version 104240 (0.0005) [2023-03-08 02:29:55,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12834.1, 300 sec: 12760.1). Total num frames: 53383168. Throughput: 0: 12563.0. Samples: 53375040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:29:55,769][304334] Avg episode reward: [(0, '4684.062')] [2023-03-08 02:29:58,005][304623] Updated weights for policy 0, policy_version 104320 (0.0005) [2023-03-08 02:30:00,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12697.6, 300 sec: 12746.2). Total num frames: 53444608. Throughput: 0: 12470.8. Samples: 53411852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:30:00,769][304334] Avg episode reward: [(0, '4677.716')] [2023-03-08 02:30:01,323][304623] Updated weights for policy 0, policy_version 104400 (0.0005) [2023-03-08 02:30:04,663][304623] Updated weights for policy 0, policy_version 104480 (0.0005) [2023-03-08 02:30:05,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12629.3, 300 sec: 12746.2). Total num frames: 53506048. Throughput: 0: 12294.6. Samples: 53485568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:30:05,769][304334] Avg episode reward: [(0, '4683.144')] [2023-03-08 02:30:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000104504_53506048.pth... [2023-03-08 02:30:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000103776_53133312.pth [2023-03-08 02:30:07,947][304623] Updated weights for policy 0, policy_version 104560 (0.0005) [2023-03-08 02:30:10,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12492.8, 300 sec: 12746.2). Total num frames: 53567488. Throughput: 0: 12331.9. Samples: 53559828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:30:10,769][304334] Avg episode reward: [(0, '4685.912')] [2023-03-08 02:30:11,195][304623] Updated weights for policy 0, policy_version 104640 (0.0005) [2023-03-08 02:30:14,533][304623] Updated weights for policy 0, policy_version 104720 (0.0005) [2023-03-08 02:30:15,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12356.2, 300 sec: 12760.1). Total num frames: 53628928. Throughput: 0: 12398.0. Samples: 53597828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:30:15,770][304334] Avg episode reward: [(0, '4697.044')] [2023-03-08 02:30:17,608][304623] Updated weights for policy 0, policy_version 104800 (0.0005) [2023-03-08 02:30:20,508][304623] Updated weights for policy 0, policy_version 104880 (0.0004) [2023-03-08 02:30:20,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12424.5, 300 sec: 12787.9). Total num frames: 53698560. Throughput: 0: 12510.0. Samples: 53676624. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:30:20,769][304334] Avg episode reward: [(0, '4680.849')] [2023-03-08 02:30:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000104880_53698560.pth... [2023-03-08 02:30:20,773][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000104136_53317632.pth [2023-03-08 02:30:23,488][304623] Updated weights for policy 0, policy_version 104960 (0.0004) [2023-03-08 02:30:25,769][304334] Fps is (10 sec: 13926.5, 60 sec: 12561.1, 300 sec: 12815.6). Total num frames: 53768192. Throughput: 0: 12744.4. Samples: 53760072. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:30:25,769][304334] Avg episode reward: [(0, '4685.798')] [2023-03-08 02:30:26,403][304623] Updated weights for policy 0, policy_version 105040 (0.0004) [2023-03-08 02:30:29,347][304623] Updated weights for policy 0, policy_version 105120 (0.0004) [2023-03-08 02:30:30,769][304334] Fps is (10 sec: 13926.4, 60 sec: 12765.9, 300 sec: 12843.4). Total num frames: 53837824. Throughput: 0: 12861.9. Samples: 53802212. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:30:30,769][304334] Avg episode reward: [(0, '4698.693')] [2023-03-08 02:30:32,354][304623] Updated weights for policy 0, policy_version 105200 (0.0004) [2023-03-08 02:30:35,290][304623] Updated weights for policy 0, policy_version 105280 (0.0004) [2023-03-08 02:30:35,769][304334] Fps is (10 sec: 13926.3, 60 sec: 12902.4, 300 sec: 12857.3). Total num frames: 53907456. Throughput: 0: 13041.6. Samples: 53884904. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:30:35,769][304334] Avg episode reward: [(0, '4677.496')] [2023-03-08 02:30:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000105288_53907456.pth... [2023-03-08 02:30:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000104504_53506048.pth [2023-03-08 02:30:38,280][304623] Updated weights for policy 0, policy_version 105360 (0.0004) [2023-03-08 02:30:40,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13038.9, 300 sec: 12885.0). Total num frames: 53977088. Throughput: 0: 13177.6. Samples: 53968032. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:30:40,769][304334] Avg episode reward: [(0, '4642.278')] [2023-03-08 02:30:41,229][304623] Updated weights for policy 0, policy_version 105440 (0.0004) [2023-03-08 02:30:44,200][304623] Updated weights for policy 0, policy_version 105520 (0.0004) [2023-03-08 02:30:45,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13175.5, 300 sec: 12912.8). Total num frames: 54046720. Throughput: 0: 13284.2. Samples: 54009640. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:30:45,769][304334] Avg episode reward: [(0, '4679.164')] [2023-03-08 02:30:47,102][304623] Updated weights for policy 0, policy_version 105600 (0.0004) [2023-03-08 02:30:50,024][304623] Updated weights for policy 0, policy_version 105680 (0.0004) [2023-03-08 02:30:50,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13312.0, 300 sec: 12912.8). Total num frames: 54116352. Throughput: 0: 13512.3. Samples: 54093620. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:30:50,769][304334] Avg episode reward: [(0, '4674.174')] [2023-03-08 02:30:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000105696_54116352.pth... [2023-03-08 02:30:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000104880_53698560.pth [2023-03-08 02:30:52,974][304623] Updated weights for policy 0, policy_version 105760 (0.0004) [2023-03-08 02:30:55,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13380.3, 300 sec: 12926.7). Total num frames: 54185984. Throughput: 0: 13721.8. Samples: 54177308. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:30:55,769][304334] Avg episode reward: [(0, '4692.861')] [2023-03-08 02:30:55,890][304623] Updated weights for policy 0, policy_version 105840 (0.0004) [2023-03-08 02:30:58,888][304623] Updated weights for policy 0, policy_version 105920 (0.0004) [2023-03-08 02:31:00,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13516.8, 300 sec: 12926.7). Total num frames: 54255616. Throughput: 0: 13786.9. Samples: 54218236. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:31:00,769][304334] Avg episode reward: [(0, '4714.664')] [2023-03-08 02:31:01,836][304623] Updated weights for policy 0, policy_version 106000 (0.0004) [2023-03-08 02:31:04,734][304623] Updated weights for policy 0, policy_version 106080 (0.0004) [2023-03-08 02:31:05,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13653.3, 300 sec: 12954.5). Total num frames: 54325248. Throughput: 0: 13898.0. Samples: 54302032. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:31:05,769][304334] Avg episode reward: [(0, '4699.767')] [2023-03-08 02:31:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000106104_54325248.pth... [2023-03-08 02:31:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000105288_53907456.pth [2023-03-08 02:31:07,701][304623] Updated weights for policy 0, policy_version 106160 (0.0004) [2023-03-08 02:31:10,647][304623] Updated weights for policy 0, policy_version 106240 (0.0004) [2023-03-08 02:31:10,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 12982.2). Total num frames: 54394880. Throughput: 0: 13897.7. Samples: 54385468. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:31:10,769][304334] Avg episode reward: [(0, '4671.195')] [2023-03-08 02:31:13,659][304623] Updated weights for policy 0, policy_version 106320 (0.0004) [2023-03-08 02:31:15,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13926.4, 300 sec: 12996.1). Total num frames: 54464512. Throughput: 0: 13878.9. Samples: 54426764. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 02:31:15,769][304334] Avg episode reward: [(0, '4685.010')] [2023-03-08 02:31:16,676][304623] Updated weights for policy 0, policy_version 106400 (0.0005) [2023-03-08 02:31:19,611][304623] Updated weights for policy 0, policy_version 106480 (0.0004) [2023-03-08 02:31:20,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13010.0). Total num frames: 54530048. Throughput: 0: 13856.8. Samples: 54508460. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:31:20,769][304334] Avg episode reward: [(0, '4696.418')] [2023-03-08 02:31:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000106504_54530048.pth... [2023-03-08 02:31:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000105696_54116352.pth [2023-03-08 02:31:22,703][304623] Updated weights for policy 0, policy_version 106560 (0.0005) [2023-03-08 02:31:25,769][304334] Fps is (10 sec: 13107.3, 60 sec: 13789.9, 300 sec: 13023.9). Total num frames: 54595584. Throughput: 0: 13758.3. Samples: 54587156. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:31:25,769][304334] Avg episode reward: [(0, '4694.998')] [2023-03-08 02:31:26,032][304623] Updated weights for policy 0, policy_version 106640 (0.0005) [2023-03-08 02:31:29,047][304623] Updated weights for policy 0, policy_version 106720 (0.0004) [2023-03-08 02:31:30,769][304334] Fps is (10 sec: 13107.3, 60 sec: 13721.6, 300 sec: 13023.9). Total num frames: 54661120. Throughput: 0: 13678.8. Samples: 54625184. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:31:30,769][304334] Avg episode reward: [(0, '4693.713')] [2023-03-08 02:31:32,059][304623] Updated weights for policy 0, policy_version 106800 (0.0004) [2023-03-08 02:31:35,002][304623] Updated weights for policy 0, policy_version 106880 (0.0004) [2023-03-08 02:31:35,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13721.6, 300 sec: 13037.8). Total num frames: 54730752. Throughput: 0: 13654.0. Samples: 54708048. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:31:35,769][304334] Avg episode reward: [(0, '4660.607')] [2023-03-08 02:31:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000106896_54730752.pth... [2023-03-08 02:31:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000106104_54325248.pth [2023-03-08 02:31:38,062][304623] Updated weights for policy 0, policy_version 106960 (0.0004) [2023-03-08 02:31:40,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13023.9). Total num frames: 54796288. Throughput: 0: 13609.1. Samples: 54789716. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:31:40,769][304334] Avg episode reward: [(0, '4713.312')] [2023-03-08 02:31:41,085][304623] Updated weights for policy 0, policy_version 107040 (0.0004) [2023-03-08 02:31:43,935][304623] Updated weights for policy 0, policy_version 107120 (0.0004) [2023-03-08 02:31:45,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13721.6, 300 sec: 13051.7). Total num frames: 54870016. Throughput: 0: 13626.3. Samples: 54831420. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:31:45,769][304334] Avg episode reward: [(0, '4687.624')] [2023-03-08 02:31:46,945][304623] Updated weights for policy 0, policy_version 107200 (0.0005) [2023-03-08 02:31:49,954][304623] Updated weights for policy 0, policy_version 107280 (0.0004) [2023-03-08 02:31:50,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13653.3, 300 sec: 13037.8). Total num frames: 54935552. Throughput: 0: 13598.0. Samples: 54913940. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:31:50,769][304334] Avg episode reward: [(0, '4678.116')] [2023-03-08 02:31:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000107296_54935552.pth... [2023-03-08 02:31:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000106504_54530048.pth [2023-03-08 02:31:52,948][304623] Updated weights for policy 0, policy_version 107360 (0.0003) [2023-03-08 02:31:55,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13051.7). Total num frames: 55005184. Throughput: 0: 13589.7. Samples: 54997004. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:31:55,769][304334] Avg episode reward: [(0, '4671.704')] [2023-03-08 02:31:55,927][304623] Updated weights for policy 0, policy_version 107440 (0.0003) [2023-03-08 02:31:58,914][304623] Updated weights for policy 0, policy_version 107520 (0.0003) [2023-03-08 02:32:00,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13653.3, 300 sec: 13065.5). Total num frames: 55074816. Throughput: 0: 13570.7. Samples: 55037444. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:32:00,769][304334] Avg episode reward: [(0, '4695.792')] [2023-03-08 02:32:01,936][304623] Updated weights for policy 0, policy_version 107600 (0.0003) [2023-03-08 02:32:05,074][304623] Updated weights for policy 0, policy_version 107680 (0.0005) [2023-03-08 02:32:05,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13585.1, 300 sec: 13079.4). Total num frames: 55140352. Throughput: 0: 13582.8. Samples: 55119688. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:32:05,769][304334] Avg episode reward: [(0, '4687.608')] [2023-03-08 02:32:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000107696_55140352.pth... [2023-03-08 02:32:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000106896_54730752.pth [2023-03-08 02:32:08,404][304623] Updated weights for policy 0, policy_version 107760 (0.0005) [2023-03-08 02:32:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13448.5, 300 sec: 13079.4). Total num frames: 55201792. Throughput: 0: 13459.1. Samples: 55192816. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:32:10,769][304334] Avg episode reward: [(0, '4634.978')] [2023-03-08 02:32:11,762][304623] Updated weights for policy 0, policy_version 107840 (0.0005) [2023-03-08 02:32:15,012][304623] Updated weights for policy 0, policy_version 107920 (0.0005) [2023-03-08 02:32:15,769][304334] Fps is (10 sec: 12288.1, 60 sec: 13312.0, 300 sec: 13079.4). Total num frames: 55263232. Throughput: 0: 13432.7. Samples: 55229656. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:32:15,769][304334] Avg episode reward: [(0, '4700.209')] [2023-03-08 02:32:18,250][304623] Updated weights for policy 0, policy_version 108000 (0.0005) [2023-03-08 02:32:20,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13243.7, 300 sec: 13079.4). Total num frames: 55324672. Throughput: 0: 13273.3. Samples: 55305348. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:32:20,769][304334] Avg episode reward: [(0, '4705.891')] [2023-03-08 02:32:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000108056_55324672.pth... [2023-03-08 02:32:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000107296_54935552.pth [2023-03-08 02:32:21,594][304623] Updated weights for policy 0, policy_version 108080 (0.0005) [2023-03-08 02:32:24,920][304623] Updated weights for policy 0, policy_version 108160 (0.0005) [2023-03-08 02:32:25,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13175.5, 300 sec: 13079.4). Total num frames: 55386112. Throughput: 0: 13078.7. Samples: 55378256. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:32:25,769][304334] Avg episode reward: [(0, '4662.125')] [2023-03-08 02:32:28,278][304623] Updated weights for policy 0, policy_version 108240 (0.0005) [2023-03-08 02:32:30,769][304334] Fps is (10 sec: 12697.8, 60 sec: 13175.5, 300 sec: 13093.3). Total num frames: 55451648. Throughput: 0: 12965.1. Samples: 55414848. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:32:30,769][304334] Avg episode reward: [(0, '4672.941')] [2023-03-08 02:32:31,430][304623] Updated weights for policy 0, policy_version 108320 (0.0004) [2023-03-08 02:32:34,432][304623] Updated weights for policy 0, policy_version 108400 (0.0003) [2023-03-08 02:32:35,769][304334] Fps is (10 sec: 13107.1, 60 sec: 13107.2, 300 sec: 13093.3). Total num frames: 55517184. Throughput: 0: 12898.6. Samples: 55494376. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:32:35,769][304334] Avg episode reward: [(0, '4678.338')] [2023-03-08 02:32:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000108432_55517184.pth... [2023-03-08 02:32:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000107696_55140352.pth [2023-03-08 02:32:37,486][304623] Updated weights for policy 0, policy_version 108480 (0.0003) [2023-03-08 02:32:40,639][304623] Updated weights for policy 0, policy_version 108560 (0.0004) [2023-03-08 02:32:40,769][304334] Fps is (10 sec: 13107.1, 60 sec: 13107.2, 300 sec: 13107.2). Total num frames: 55582720. Throughput: 0: 12833.9. Samples: 55574528. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:32:40,769][304334] Avg episode reward: [(0, '4699.205')] [2023-03-08 02:32:43,772][304623] Updated weights for policy 0, policy_version 108640 (0.0003) [2023-03-08 02:32:45,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12970.7, 300 sec: 13121.1). Total num frames: 55648256. Throughput: 0: 12787.3. Samples: 55612872. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:32:45,769][304334] Avg episode reward: [(0, '4672.885')] [2023-03-08 02:32:46,996][304623] Updated weights for policy 0, policy_version 108720 (0.0004) [2023-03-08 02:32:50,331][304623] Updated weights for policy 0, policy_version 108800 (0.0005) [2023-03-08 02:32:50,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12902.4, 300 sec: 13121.1). Total num frames: 55709696. Throughput: 0: 12657.6. Samples: 55689280. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:32:50,769][304334] Avg episode reward: [(0, '4686.284')] [2023-03-08 02:32:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000108808_55709696.pth... [2023-03-08 02:32:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000108056_55324672.pth [2023-03-08 02:32:53,690][304623] Updated weights for policy 0, policy_version 108880 (0.0005) [2023-03-08 02:32:55,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12765.9, 300 sec: 13107.2). Total num frames: 55771136. Throughput: 0: 12655.0. Samples: 55762292. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:32:55,769][304334] Avg episode reward: [(0, '4705.489')] [2023-03-08 02:32:57,059][304623] Updated weights for policy 0, policy_version 108960 (0.0005) [2023-03-08 02:33:00,370][304623] Updated weights for policy 0, policy_version 109040 (0.0005) [2023-03-08 02:33:00,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12629.3, 300 sec: 13107.2). Total num frames: 55832576. Throughput: 0: 12665.9. Samples: 55799620. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:33:00,769][304334] Avg episode reward: [(0, '4671.716')] [2023-03-08 02:33:03,671][304623] Updated weights for policy 0, policy_version 109120 (0.0005) [2023-03-08 02:33:05,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12561.1, 300 sec: 13107.2). Total num frames: 55894016. Throughput: 0: 12626.4. Samples: 55873536. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:33:05,769][304334] Avg episode reward: [(0, '4622.694')] [2023-03-08 02:33:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000109168_55894016.pth... [2023-03-08 02:33:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000108432_55517184.pth [2023-03-08 02:33:07,028][304623] Updated weights for policy 0, policy_version 109200 (0.0005) [2023-03-08 02:33:10,351][304623] Updated weights for policy 0, policy_version 109280 (0.0005) [2023-03-08 02:33:10,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 13107.2). Total num frames: 55955456. Throughput: 0: 12644.9. Samples: 55947276. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:33:10,769][304334] Avg episode reward: [(0, '4653.234')] [2023-03-08 02:33:13,655][304623] Updated weights for policy 0, policy_version 109360 (0.0005) [2023-03-08 02:33:15,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 13093.3). Total num frames: 56016896. Throughput: 0: 12651.0. Samples: 55984144. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:33:15,769][304334] Avg episode reward: [(0, '4647.745')] [2023-03-08 02:33:16,872][304623] Updated weights for policy 0, policy_version 109440 (0.0005) [2023-03-08 02:33:20,168][304623] Updated weights for policy 0, policy_version 109520 (0.0005) [2023-03-08 02:33:20,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 13093.3). Total num frames: 56078336. Throughput: 0: 12574.7. Samples: 56060236. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:33:20,769][304334] Avg episode reward: [(0, '4499.310')] [2023-03-08 02:33:20,771][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000109528_56078336.pth... [2023-03-08 02:33:20,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000108808_55709696.pth [2023-03-08 02:33:23,543][304623] Updated weights for policy 0, policy_version 109600 (0.0006) [2023-03-08 02:33:25,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 13107.2). Total num frames: 56143872. Throughput: 0: 12464.5. Samples: 56135432. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:33:25,769][304334] Avg episode reward: [(0, '4627.792')] [2023-03-08 02:33:26,575][304623] Updated weights for policy 0, policy_version 109680 (0.0004) [2023-03-08 02:33:29,646][304623] Updated weights for policy 0, policy_version 109760 (0.0005) [2023-03-08 02:33:30,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12629.3, 300 sec: 13093.3). Total num frames: 56209408. Throughput: 0: 12499.5. Samples: 56175348. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:33:30,769][304334] Avg episode reward: [(0, '4616.539')] [2023-03-08 02:33:32,565][304623] Updated weights for policy 0, policy_version 109840 (0.0004) [2023-03-08 02:33:35,727][304623] Updated weights for policy 0, policy_version 109920 (0.0005) [2023-03-08 02:33:35,769][304334] Fps is (10 sec: 13516.7, 60 sec: 12697.6, 300 sec: 13107.2). Total num frames: 56279040. Throughput: 0: 12614.2. Samples: 56256920. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:33:35,769][304334] Avg episode reward: [(0, '4684.282')] [2023-03-08 02:33:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000109920_56279040.pth... [2023-03-08 02:33:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000109168_55894016.pth [2023-03-08 02:33:38,987][304623] Updated weights for policy 0, policy_version 110000 (0.0005) [2023-03-08 02:33:40,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12629.3, 300 sec: 13107.2). Total num frames: 56340480. Throughput: 0: 12668.2. Samples: 56332360. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:33:40,769][304334] Avg episode reward: [(0, '4691.320')] [2023-03-08 02:33:42,125][304623] Updated weights for policy 0, policy_version 110080 (0.0005) [2023-03-08 02:33:45,198][304623] Updated weights for policy 0, policy_version 110160 (0.0005) [2023-03-08 02:33:45,769][304334] Fps is (10 sec: 12697.8, 60 sec: 12629.3, 300 sec: 13093.3). Total num frames: 56406016. Throughput: 0: 12728.4. Samples: 56372396. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:33:45,769][304334] Avg episode reward: [(0, '4638.384')] [2023-03-08 02:33:48,232][304623] Updated weights for policy 0, policy_version 110240 (0.0005) [2023-03-08 02:33:50,769][304334] Fps is (10 sec: 13516.7, 60 sec: 12765.9, 300 sec: 13093.3). Total num frames: 56475648. Throughput: 0: 12871.1. Samples: 56452736. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:33:50,769][304334] Avg episode reward: [(0, '4681.676')] [2023-03-08 02:33:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000110304_56475648.pth... [2023-03-08 02:33:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000109528_56078336.pth [2023-03-08 02:33:51,278][304623] Updated weights for policy 0, policy_version 110320 (0.0004) [2023-03-08 02:33:54,544][304623] Updated weights for policy 0, policy_version 110400 (0.0005) [2023-03-08 02:33:55,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12765.9, 300 sec: 13065.5). Total num frames: 56537088. Throughput: 0: 12954.1. Samples: 56530208. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:33:55,769][304334] Avg episode reward: [(0, '4677.325')] [2023-03-08 02:33:57,588][304623] Updated weights for policy 0, policy_version 110480 (0.0005) [2023-03-08 02:34:00,640][304623] Updated weights for policy 0, policy_version 110560 (0.0004) [2023-03-08 02:34:00,769][304334] Fps is (10 sec: 13107.3, 60 sec: 12902.4, 300 sec: 13079.4). Total num frames: 56606720. Throughput: 0: 13044.1. Samples: 56571128. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:34:00,769][304334] Avg episode reward: [(0, '4700.335')] [2023-03-08 02:34:03,661][304623] Updated weights for policy 0, policy_version 110640 (0.0004) [2023-03-08 02:34:05,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12970.7, 300 sec: 13065.5). Total num frames: 56672256. Throughput: 0: 13146.8. Samples: 56651840. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:34:05,769][304334] Avg episode reward: [(0, '4723.562')] [2023-03-08 02:34:05,771][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000110688_56672256.pth... [2023-03-08 02:34:05,773][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000109920_56279040.pth [2023-03-08 02:34:05,773][304573] Saving new best policy, reward=4723.562! [2023-03-08 02:34:06,711][304623] Updated weights for policy 0, policy_version 110720 (0.0005) [2023-03-08 02:34:09,560][304623] Updated weights for policy 0, policy_version 110800 (0.0003) [2023-03-08 02:34:10,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13175.5, 300 sec: 13079.4). Total num frames: 56745984. Throughput: 0: 13333.3. Samples: 56735428. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:34:10,769][304334] Avg episode reward: [(0, '4721.376')] [2023-03-08 02:34:12,510][304623] Updated weights for policy 0, policy_version 110880 (0.0004) [2023-03-08 02:34:15,526][304623] Updated weights for policy 0, policy_version 110960 (0.0004) [2023-03-08 02:34:15,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13243.7, 300 sec: 13079.4). Total num frames: 56811520. Throughput: 0: 13358.8. Samples: 56776492. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:34:15,769][304334] Avg episode reward: [(0, '4711.094')] [2023-03-08 02:34:18,512][304623] Updated weights for policy 0, policy_version 111040 (0.0004) [2023-03-08 02:34:20,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13107.2). Total num frames: 56881152. Throughput: 0: 13375.2. Samples: 56858804. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:34:20,769][304334] Avg episode reward: [(0, '4718.521')] [2023-03-08 02:34:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000111096_56881152.pth... [2023-03-08 02:34:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000110304_56475648.pth [2023-03-08 02:34:21,533][304623] Updated weights for policy 0, policy_version 111120 (0.0004) [2023-03-08 02:34:24,608][304623] Updated weights for policy 0, policy_version 111200 (0.0004) [2023-03-08 02:34:25,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13135.0). Total num frames: 56946688. Throughput: 0: 13471.3. Samples: 56938568. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:34:25,769][304334] Avg episode reward: [(0, '4712.519')] [2023-03-08 02:34:27,850][304623] Updated weights for policy 0, policy_version 111280 (0.0005) [2023-03-08 02:34:30,769][304334] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13148.9). Total num frames: 57012224. Throughput: 0: 13429.6. Samples: 56976728. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:34:30,769][304334] Avg episode reward: [(0, '4719.841')] [2023-03-08 02:34:30,801][304623] Updated weights for policy 0, policy_version 111360 (0.0004) [2023-03-08 02:34:33,777][304623] Updated weights for policy 0, policy_version 111440 (0.0004) [2023-03-08 02:34:35,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13176.6). Total num frames: 57081856. Throughput: 0: 13493.6. Samples: 57059948. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:34:35,769][304334] Avg episode reward: [(0, '4704.059')] [2023-03-08 02:34:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000111488_57081856.pth... [2023-03-08 02:34:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000110688_56672256.pth [2023-03-08 02:34:36,732][304623] Updated weights for policy 0, policy_version 111520 (0.0004) [2023-03-08 02:34:39,693][304623] Updated weights for policy 0, policy_version 111600 (0.0004) [2023-03-08 02:34:40,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13516.8, 300 sec: 13204.4). Total num frames: 57151488. Throughput: 0: 13624.3. Samples: 57143304. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:34:40,769][304334] Avg episode reward: [(0, '4717.572')] [2023-03-08 02:34:42,718][304623] Updated weights for policy 0, policy_version 111680 (0.0004) [2023-03-08 02:34:45,702][304623] Updated weights for policy 0, policy_version 111760 (0.0004) [2023-03-08 02:34:45,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13585.1, 300 sec: 13232.2). Total num frames: 57221120. Throughput: 0: 13619.7. Samples: 57184016. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:34:45,769][304334] Avg episode reward: [(0, '4710.306')] [2023-03-08 02:34:48,703][304623] Updated weights for policy 0, policy_version 111840 (0.0004) [2023-03-08 02:34:50,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13232.2). Total num frames: 57286656. Throughput: 0: 13650.4. Samples: 57266108. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:34:50,769][304334] Avg episode reward: [(0, '4696.919')] [2023-03-08 02:34:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000111888_57286656.pth... [2023-03-08 02:34:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000111096_56881152.pth [2023-03-08 02:34:51,706][304623] Updated weights for policy 0, policy_version 111920 (0.0004) [2023-03-08 02:34:54,679][304623] Updated weights for policy 0, policy_version 112000 (0.0004) [2023-03-08 02:34:55,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13259.9). Total num frames: 57356288. Throughput: 0: 13616.3. Samples: 57348160. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:34:55,769][304334] Avg episode reward: [(0, '4692.555')] [2023-03-08 02:34:57,636][304623] Updated weights for policy 0, policy_version 112080 (0.0004) [2023-03-08 02:35:00,628][304623] Updated weights for policy 0, policy_version 112160 (0.0004) [2023-03-08 02:35:00,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13653.3, 300 sec: 13287.7). Total num frames: 57425920. Throughput: 0: 13620.6. Samples: 57389420. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:35:00,769][304334] Avg episode reward: [(0, '4694.017')] [2023-03-08 02:35:03,591][304623] Updated weights for policy 0, policy_version 112240 (0.0003) [2023-03-08 02:35:05,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13721.6, 300 sec: 13315.5). Total num frames: 57495552. Throughput: 0: 13627.3. Samples: 57472032. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:35:05,769][304334] Avg episode reward: [(0, '4716.753')] [2023-03-08 02:35:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000112296_57495552.pth... [2023-03-08 02:35:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000111488_57081856.pth [2023-03-08 02:35:06,572][304623] Updated weights for policy 0, policy_version 112320 (0.0004) [2023-03-08 02:35:09,658][304623] Updated weights for policy 0, policy_version 112400 (0.0004) [2023-03-08 02:35:10,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13329.4). Total num frames: 57561088. Throughput: 0: 13653.3. Samples: 57552968. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:35:10,769][304334] Avg episode reward: [(0, '4700.597')] [2023-03-08 02:35:12,628][304623] Updated weights for policy 0, policy_version 112480 (0.0003) [2023-03-08 02:35:15,618][304623] Updated weights for policy 0, policy_version 112560 (0.0004) [2023-03-08 02:35:15,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13329.4). Total num frames: 57630720. Throughput: 0: 13715.5. Samples: 57593928. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 02:35:15,769][304334] Avg episode reward: [(0, '4698.142')] [2023-03-08 02:35:18,553][304623] Updated weights for policy 0, policy_version 112640 (0.0003) [2023-03-08 02:35:20,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13653.3, 300 sec: 13329.4). Total num frames: 57700352. Throughput: 0: 13717.0. Samples: 57677212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:35:20,769][304334] Avg episode reward: [(0, '4714.967')] [2023-03-08 02:35:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000112696_57700352.pth... [2023-03-08 02:35:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000111888_57286656.pth [2023-03-08 02:35:21,480][304623] Updated weights for policy 0, policy_version 112720 (0.0004) [2023-03-08 02:35:24,492][304623] Updated weights for policy 0, policy_version 112800 (0.0004) [2023-03-08 02:35:25,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13315.5). Total num frames: 57765888. Throughput: 0: 13708.8. Samples: 57760200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:35:25,769][304334] Avg episode reward: [(0, '4699.483')] [2023-03-08 02:35:27,829][304623] Updated weights for policy 0, policy_version 112880 (0.0005) [2023-03-08 02:35:30,769][304334] Fps is (10 sec: 12697.7, 60 sec: 13585.1, 300 sec: 13287.7). Total num frames: 57827328. Throughput: 0: 13604.0. Samples: 57796196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:35:30,769][304334] Avg episode reward: [(0, '4695.094')] [2023-03-08 02:35:31,123][304623] Updated weights for policy 0, policy_version 112960 (0.0005) [2023-03-08 02:35:34,420][304623] Updated weights for policy 0, policy_version 113040 (0.0005) [2023-03-08 02:35:35,769][304334] Fps is (10 sec: 12697.4, 60 sec: 13516.8, 300 sec: 13273.8). Total num frames: 57892864. Throughput: 0: 13452.0. Samples: 57871452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:35:35,770][304334] Avg episode reward: [(0, '4726.118')] [2023-03-08 02:35:35,774][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000113072_57892864.pth... [2023-03-08 02:35:35,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000112296_57495552.pth [2023-03-08 02:35:35,776][304573] Saving new best policy, reward=4726.118! [2023-03-08 02:35:37,729][304623] Updated weights for policy 0, policy_version 113120 (0.0005) [2023-03-08 02:35:40,769][304334] Fps is (10 sec: 12697.5, 60 sec: 13380.3, 300 sec: 13246.0). Total num frames: 57954304. Throughput: 0: 13288.0. Samples: 57946120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:35:40,769][304334] Avg episode reward: [(0, '4708.620')] [2023-03-08 02:35:40,955][304623] Updated weights for policy 0, policy_version 113200 (0.0004) [2023-03-08 02:35:44,094][304623] Updated weights for policy 0, policy_version 113280 (0.0004) [2023-03-08 02:35:45,769][304334] Fps is (10 sec: 12288.3, 60 sec: 13243.7, 300 sec: 13218.3). Total num frames: 58015744. Throughput: 0: 13238.3. Samples: 57985144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:35:45,769][304334] Avg episode reward: [(0, '4687.426')] [2023-03-08 02:35:47,479][304623] Updated weights for policy 0, policy_version 113360 (0.0005) [2023-03-08 02:35:50,690][304623] Updated weights for policy 0, policy_version 113440 (0.0005) [2023-03-08 02:35:50,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13243.7, 300 sec: 13204.4). Total num frames: 58081280. Throughput: 0: 13037.2. Samples: 58058708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:35:50,769][304334] Avg episode reward: [(0, '4693.266')] [2023-03-08 02:35:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000113440_58081280.pth... [2023-03-08 02:35:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000112696_57700352.pth [2023-03-08 02:35:53,954][304623] Updated weights for policy 0, policy_version 113520 (0.0004) [2023-03-08 02:35:55,769][304334] Fps is (10 sec: 12697.5, 60 sec: 13107.2, 300 sec: 13176.6). Total num frames: 58142720. Throughput: 0: 12925.0. Samples: 58134592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:35:55,769][304334] Avg episode reward: [(0, '4711.531')] [2023-03-08 02:35:57,038][304623] Updated weights for policy 0, policy_version 113600 (0.0003) [2023-03-08 02:36:00,076][304623] Updated weights for policy 0, policy_version 113680 (0.0004) [2023-03-08 02:36:00,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13107.2, 300 sec: 13176.6). Total num frames: 58212352. Throughput: 0: 12929.4. Samples: 58175752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:36:00,769][304334] Avg episode reward: [(0, '4698.948')] [2023-03-08 02:36:02,941][304623] Updated weights for policy 0, policy_version 113760 (0.0003) [2023-03-08 02:36:05,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13107.2, 300 sec: 13176.6). Total num frames: 58281984. Throughput: 0: 12936.3. Samples: 58259344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:36:05,769][304334] Avg episode reward: [(0, '4718.098')] [2023-03-08 02:36:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000113832_58281984.pth... [2023-03-08 02:36:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000113072_57892864.pth [2023-03-08 02:36:05,931][304623] Updated weights for policy 0, policy_version 113840 (0.0004) [2023-03-08 02:36:08,910][304623] Updated weights for policy 0, policy_version 113920 (0.0004) [2023-03-08 02:36:10,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13175.5, 300 sec: 13176.6). Total num frames: 58351616. Throughput: 0: 12915.6. Samples: 58341404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:36:10,769][304334] Avg episode reward: [(0, '4722.436')] [2023-03-08 02:36:11,899][304623] Updated weights for policy 0, policy_version 114000 (0.0004) [2023-03-08 02:36:14,900][304623] Updated weights for policy 0, policy_version 114080 (0.0004) [2023-03-08 02:36:15,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13175.5, 300 sec: 13190.5). Total num frames: 58421248. Throughput: 0: 13033.7. Samples: 58382712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:36:15,769][304334] Avg episode reward: [(0, '4693.414')] [2023-03-08 02:36:17,850][304623] Updated weights for policy 0, policy_version 114160 (0.0003) [2023-03-08 02:36:20,727][304623] Updated weights for policy 0, policy_version 114240 (0.0004) [2023-03-08 02:36:20,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13175.5, 300 sec: 13204.4). Total num frames: 58490880. Throughput: 0: 13202.7. Samples: 58465572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:36:20,769][304334] Avg episode reward: [(0, '4697.416')] [2023-03-08 02:36:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000114240_58490880.pth... [2023-03-08 02:36:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000113440_58081280.pth [2023-03-08 02:36:23,676][304623] Updated weights for policy 0, policy_version 114320 (0.0004) [2023-03-08 02:36:25,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13175.5, 300 sec: 13204.4). Total num frames: 58556416. Throughput: 0: 13388.9. Samples: 58548620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:36:25,769][304334] Avg episode reward: [(0, '4723.493')] [2023-03-08 02:36:26,928][304623] Updated weights for policy 0, policy_version 114400 (0.0005) [2023-03-08 02:36:29,960][304623] Updated weights for policy 0, policy_version 114480 (0.0004) [2023-03-08 02:36:30,769][304334] Fps is (10 sec: 13107.3, 60 sec: 13243.7, 300 sec: 13190.5). Total num frames: 58621952. Throughput: 0: 13354.2. Samples: 58586084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:36:30,769][304334] Avg episode reward: [(0, '4710.226')] [2023-03-08 02:36:32,930][304623] Updated weights for policy 0, policy_version 114560 (0.0004) [2023-03-08 02:36:35,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13312.0, 300 sec: 13204.4). Total num frames: 58691584. Throughput: 0: 13569.0. Samples: 58669312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:36:35,769][304334] Avg episode reward: [(0, '4714.576')] [2023-03-08 02:36:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000114632_58691584.pth... [2023-03-08 02:36:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000113832_58281984.pth [2023-03-08 02:36:35,875][304623] Updated weights for policy 0, policy_version 114640 (0.0004) [2023-03-08 02:36:38,885][304623] Updated weights for policy 0, policy_version 114720 (0.0004) [2023-03-08 02:36:40,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13176.6). Total num frames: 58757120. Throughput: 0: 13704.4. Samples: 58751288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:36:40,769][304334] Avg episode reward: [(0, '4707.844')] [2023-03-08 02:36:42,066][304623] Updated weights for policy 0, policy_version 114800 (0.0005) [2023-03-08 02:36:45,347][304623] Updated weights for policy 0, policy_version 114880 (0.0005) [2023-03-08 02:36:45,769][304334] Fps is (10 sec: 13107.3, 60 sec: 13448.5, 300 sec: 13176.6). Total num frames: 58822656. Throughput: 0: 13638.0. Samples: 58789460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:36:45,769][304334] Avg episode reward: [(0, '4705.058')] [2023-03-08 02:36:48,736][304623] Updated weights for policy 0, policy_version 114960 (0.0005) [2023-03-08 02:36:50,769][304334] Fps is (10 sec: 12697.5, 60 sec: 13380.3, 300 sec: 13148.9). Total num frames: 58884096. Throughput: 0: 13419.4. Samples: 58863216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:36:50,769][304334] Avg episode reward: [(0, '4710.297')] [2023-03-08 02:36:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000115008_58884096.pth... [2023-03-08 02:36:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000114240_58490880.pth [2023-03-08 02:36:51,855][304623] Updated weights for policy 0, policy_version 115040 (0.0005) [2023-03-08 02:36:54,855][304623] Updated weights for policy 0, policy_version 115120 (0.0004) [2023-03-08 02:36:55,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13516.8, 300 sec: 13148.9). Total num frames: 58953728. Throughput: 0: 13367.7. Samples: 58942948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:36:55,769][304334] Avg episode reward: [(0, '4711.054')] [2023-03-08 02:36:57,841][304623] Updated weights for policy 0, policy_version 115200 (0.0004) [2023-03-08 02:37:00,767][304623] Updated weights for policy 0, policy_version 115280 (0.0003) [2023-03-08 02:37:00,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13516.8, 300 sec: 13162.7). Total num frames: 59023360. Throughput: 0: 13360.4. Samples: 58983928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:37:00,769][304334] Avg episode reward: [(0, '4703.169')] [2023-03-08 02:37:03,820][304623] Updated weights for policy 0, policy_version 115360 (0.0004) [2023-03-08 02:37:05,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13176.6). Total num frames: 59088896. Throughput: 0: 13354.1. Samples: 59066504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:37:05,769][304334] Avg episode reward: [(0, '4714.889')] [2023-03-08 02:37:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000115408_59088896.pth... [2023-03-08 02:37:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000114632_58691584.pth [2023-03-08 02:37:06,727][304623] Updated weights for policy 0, policy_version 115440 (0.0004) [2023-03-08 02:37:09,701][304623] Updated weights for policy 0, policy_version 115520 (0.0004) [2023-03-08 02:37:10,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13204.4). Total num frames: 59158528. Throughput: 0: 13371.5. Samples: 59150336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:37:10,769][304334] Avg episode reward: [(0, '4715.305')] [2023-03-08 02:37:12,691][304623] Updated weights for policy 0, policy_version 115600 (0.0004) [2023-03-08 02:37:15,675][304623] Updated weights for policy 0, policy_version 115680 (0.0004) [2023-03-08 02:37:15,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13448.5, 300 sec: 13232.2). Total num frames: 59228160. Throughput: 0: 13449.3. Samples: 59191304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:37:15,769][304334] Avg episode reward: [(0, '4718.133')] [2023-03-08 02:37:18,797][304623] Updated weights for policy 0, policy_version 115760 (0.0004) [2023-03-08 02:37:20,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13380.3, 300 sec: 13246.0). Total num frames: 59293696. Throughput: 0: 13381.6. Samples: 59271484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:37:20,769][304334] Avg episode reward: [(0, '4715.229')] [2023-03-08 02:37:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000115808_59293696.pth... [2023-03-08 02:37:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000115008_58884096.pth [2023-03-08 02:37:21,769][304623] Updated weights for policy 0, policy_version 115840 (0.0003) [2023-03-08 02:37:24,715][304623] Updated weights for policy 0, policy_version 115920 (0.0004) [2023-03-08 02:37:25,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13259.9). Total num frames: 59363328. Throughput: 0: 13412.8. Samples: 59354864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:37:25,769][304334] Avg episode reward: [(0, '4711.334')] [2023-03-08 02:37:27,668][304623] Updated weights for policy 0, policy_version 116000 (0.0004) [2023-03-08 02:37:30,704][304623] Updated weights for policy 0, policy_version 116080 (0.0004) [2023-03-08 02:37:30,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13516.8, 300 sec: 13273.8). Total num frames: 59432960. Throughput: 0: 13482.2. Samples: 59396160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:37:30,769][304334] Avg episode reward: [(0, '4705.327')] [2023-03-08 02:37:33,797][304623] Updated weights for policy 0, policy_version 116160 (0.0004) [2023-03-08 02:37:35,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13273.8). Total num frames: 59498496. Throughput: 0: 13621.3. Samples: 59476176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:37:35,769][304334] Avg episode reward: [(0, '4690.850')] [2023-03-08 02:37:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000116208_59498496.pth... [2023-03-08 02:37:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000115408_59088896.pth [2023-03-08 02:37:36,742][304623] Updated weights for policy 0, policy_version 116240 (0.0004) [2023-03-08 02:37:39,793][304623] Updated weights for policy 0, policy_version 116320 (0.0004) [2023-03-08 02:37:40,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13287.7). Total num frames: 59568128. Throughput: 0: 13678.5. Samples: 59558480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:37:40,769][304334] Avg episode reward: [(0, '4700.153')] [2023-03-08 02:37:42,847][304623] Updated weights for policy 0, policy_version 116400 (0.0004) [2023-03-08 02:37:45,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13301.6). Total num frames: 59633664. Throughput: 0: 13656.2. Samples: 59598456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:37:45,769][304334] Avg episode reward: [(0, '4686.901')] [2023-03-08 02:37:45,877][304623] Updated weights for policy 0, policy_version 116480 (0.0004) [2023-03-08 02:37:48,915][304623] Updated weights for policy 0, policy_version 116560 (0.0004) [2023-03-08 02:37:50,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13653.3, 300 sec: 13329.4). Total num frames: 59703296. Throughput: 0: 13614.3. Samples: 59679148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:37:50,769][304334] Avg episode reward: [(0, '4661.648')] [2023-03-08 02:37:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000116608_59703296.pth... [2023-03-08 02:37:50,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000115808_59293696.pth [2023-03-08 02:37:51,920][304623] Updated weights for policy 0, policy_version 116640 (0.0003) [2023-03-08 02:37:54,918][304623] Updated weights for policy 0, policy_version 116720 (0.0004) [2023-03-08 02:37:55,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13585.1, 300 sec: 13343.2). Total num frames: 59768832. Throughput: 0: 13570.8. Samples: 59761020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:37:55,769][304334] Avg episode reward: [(0, '4669.462')] [2023-03-08 02:37:58,175][304623] Updated weights for policy 0, policy_version 116800 (0.0004) [2023-03-08 02:38:00,769][304334] Fps is (10 sec: 12697.8, 60 sec: 13448.5, 300 sec: 13343.2). Total num frames: 59830272. Throughput: 0: 13505.8. Samples: 59799064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:38:00,769][304334] Avg episode reward: [(0, '4667.327')] [2023-03-08 02:38:01,488][304623] Updated weights for policy 0, policy_version 116880 (0.0005) [2023-03-08 02:38:04,806][304623] Updated weights for policy 0, policy_version 116960 (0.0005) [2023-03-08 02:38:05,769][304334] Fps is (10 sec: 12697.5, 60 sec: 13448.5, 300 sec: 13357.1). Total num frames: 59895808. Throughput: 0: 13387.5. Samples: 59873920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:38:05,769][304334] Avg episode reward: [(0, '4679.787')] [2023-03-08 02:38:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000116984_59895808.pth... [2023-03-08 02:38:05,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000116208_59498496.pth [2023-03-08 02:38:08,032][304623] Updated weights for policy 0, policy_version 117040 (0.0005) [2023-03-08 02:38:10,769][304334] Fps is (10 sec: 12697.5, 60 sec: 13312.0, 300 sec: 13357.1). Total num frames: 59957248. Throughput: 0: 13190.4. Samples: 59948432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:38:10,769][304334] Avg episode reward: [(0, '4677.330')] [2023-03-08 02:38:11,395][304623] Updated weights for policy 0, policy_version 117120 (0.0005) [2023-03-08 02:38:14,764][304623] Updated weights for policy 0, policy_version 117200 (0.0005) [2023-03-08 02:38:15,769][304334] Fps is (10 sec: 12287.9, 60 sec: 13175.4, 300 sec: 13357.1). Total num frames: 60018688. Throughput: 0: 13088.3. Samples: 59985136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:38:15,769][304334] Avg episode reward: [(0, '4705.553')] [2023-03-08 02:38:17,982][304623] Updated weights for policy 0, policy_version 117280 (0.0005) [2023-03-08 02:38:20,769][304334] Fps is (10 sec: 12287.9, 60 sec: 13107.2, 300 sec: 13343.2). Total num frames: 60080128. Throughput: 0: 12966.2. Samples: 60059656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:38:20,769][304334] Avg episode reward: [(0, '4708.854')] [2023-03-08 02:38:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000117344_60080128.pth... [2023-03-08 02:38:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000116608_59703296.pth [2023-03-08 02:38:21,292][304623] Updated weights for policy 0, policy_version 117360 (0.0004) [2023-03-08 02:38:24,283][304623] Updated weights for policy 0, policy_version 117440 (0.0004) [2023-03-08 02:38:25,769][304334] Fps is (10 sec: 12697.8, 60 sec: 13039.0, 300 sec: 13343.2). Total num frames: 60145664. Throughput: 0: 12892.0. Samples: 60138620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:38:25,779][304334] Avg episode reward: [(0, '4693.992')] [2023-03-08 02:38:27,371][304623] Updated weights for policy 0, policy_version 117520 (0.0004) [2023-03-08 02:38:30,361][304623] Updated weights for policy 0, policy_version 117600 (0.0004) [2023-03-08 02:38:30,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13038.9, 300 sec: 13343.2). Total num frames: 60215296. Throughput: 0: 12888.7. Samples: 60178448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:38:30,780][304334] Avg episode reward: [(0, '4659.426')] [2023-03-08 02:38:33,465][304623] Updated weights for policy 0, policy_version 117680 (0.0004) [2023-03-08 02:38:35,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13038.9, 300 sec: 13357.1). Total num frames: 60280832. Throughput: 0: 12884.4. Samples: 60258944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:38:35,780][304334] Avg episode reward: [(0, '4661.764')] [2023-03-08 02:38:35,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000117736_60280832.pth... [2023-03-08 02:38:35,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000116984_59895808.pth [2023-03-08 02:38:36,500][304623] Updated weights for policy 0, policy_version 117760 (0.0004) [2023-03-08 02:38:39,622][304623] Updated weights for policy 0, policy_version 117840 (0.0004) [2023-03-08 02:38:40,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12970.7, 300 sec: 13357.1). Total num frames: 60346368. Throughput: 0: 12833.9. Samples: 60338548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:38:40,780][304334] Avg episode reward: [(0, '4634.190')] [2023-03-08 02:38:42,706][304623] Updated weights for policy 0, policy_version 117920 (0.0004) [2023-03-08 02:38:45,687][304623] Updated weights for policy 0, policy_version 118000 (0.0004) [2023-03-08 02:38:45,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13038.9, 300 sec: 13357.1). Total num frames: 60416000. Throughput: 0: 12885.5. Samples: 60378912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:38:45,780][304334] Avg episode reward: [(0, '4652.744')] [2023-03-08 02:38:48,779][304623] Updated weights for policy 0, policy_version 118080 (0.0004) [2023-03-08 02:38:50,769][304334] Fps is (10 sec: 13516.7, 60 sec: 12970.7, 300 sec: 13371.0). Total num frames: 60481536. Throughput: 0: 13014.7. Samples: 60459580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:38:50,780][304334] Avg episode reward: [(0, '4567.805')] [2023-03-08 02:38:50,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000118128_60481536.pth... [2023-03-08 02:38:50,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000117344_60080128.pth [2023-03-08 02:38:51,858][304623] Updated weights for policy 0, policy_version 118160 (0.0004) [2023-03-08 02:38:54,957][304623] Updated weights for policy 0, policy_version 118240 (0.0004) [2023-03-08 02:38:55,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12970.7, 300 sec: 13357.1). Total num frames: 60547072. Throughput: 0: 13122.5. Samples: 60538944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:38:55,780][304334] Avg episode reward: [(0, '4592.033')] [2023-03-08 02:38:58,015][304623] Updated weights for policy 0, policy_version 118320 (0.0004) [2023-03-08 02:39:00,769][304334] Fps is (10 sec: 13107.3, 60 sec: 13038.9, 300 sec: 13357.1). Total num frames: 60612608. Throughput: 0: 13213.3. Samples: 60579732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:39:00,779][304334] Avg episode reward: [(0, '4574.452')] [2023-03-08 02:39:01,154][304623] Updated weights for policy 0, policy_version 118400 (0.0004) [2023-03-08 02:39:04,312][304623] Updated weights for policy 0, policy_version 118480 (0.0004) [2023-03-08 02:39:05,769][304334] Fps is (10 sec: 13107.1, 60 sec: 13038.9, 300 sec: 13329.4). Total num frames: 60678144. Throughput: 0: 13289.3. Samples: 60657676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:39:05,769][304334] Avg episode reward: [(0, '4618.035')] [2023-03-08 02:39:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000118512_60678144.pth... [2023-03-08 02:39:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000117736_60280832.pth [2023-03-08 02:39:07,604][304623] Updated weights for policy 0, policy_version 118560 (0.0004) [2023-03-08 02:39:10,769][304334] Fps is (10 sec: 12697.5, 60 sec: 13038.9, 300 sec: 13315.5). Total num frames: 60739584. Throughput: 0: 13182.8. Samples: 60731848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:39:10,769][304334] Avg episode reward: [(0, '4567.573')] [2023-03-08 02:39:10,910][304623] Updated weights for policy 0, policy_version 118640 (0.0005) [2023-03-08 02:39:14,247][304623] Updated weights for policy 0, policy_version 118720 (0.0005) [2023-03-08 02:39:15,769][304334] Fps is (10 sec: 12288.1, 60 sec: 13039.0, 300 sec: 13287.7). Total num frames: 60801024. Throughput: 0: 13121.0. Samples: 60768892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:39:15,769][304334] Avg episode reward: [(0, '4534.624')] [2023-03-08 02:39:17,580][304623] Updated weights for policy 0, policy_version 118800 (0.0005) [2023-03-08 02:39:20,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13038.9, 300 sec: 13273.8). Total num frames: 60862464. Throughput: 0: 12957.9. Samples: 60842048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:39:20,769][304334] Avg episode reward: [(0, '4475.188')] [2023-03-08 02:39:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000118872_60862464.pth... [2023-03-08 02:39:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000118128_60481536.pth [2023-03-08 02:39:20,882][304623] Updated weights for policy 0, policy_version 118880 (0.0005) [2023-03-08 02:39:24,177][304623] Updated weights for policy 0, policy_version 118960 (0.0005) [2023-03-08 02:39:25,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12970.7, 300 sec: 13259.9). Total num frames: 60923904. Throughput: 0: 12867.0. Samples: 60917560. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:39:25,769][304334] Avg episode reward: [(0, '4551.605')] [2023-03-08 02:39:27,425][304623] Updated weights for policy 0, policy_version 119040 (0.0005) [2023-03-08 02:39:30,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12834.1, 300 sec: 13232.2). Total num frames: 60985344. Throughput: 0: 12814.3. Samples: 60955556. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:39:30,769][304334] Avg episode reward: [(0, '4612.882')] [2023-03-08 02:39:30,881][304623] Updated weights for policy 0, policy_version 119120 (0.0005) [2023-03-08 02:39:34,215][304623] Updated weights for policy 0, policy_version 119200 (0.0005) [2023-03-08 02:39:35,769][304334] Fps is (10 sec: 12287.8, 60 sec: 12765.9, 300 sec: 13204.4). Total num frames: 61046784. Throughput: 0: 12611.3. Samples: 61027088. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:39:35,769][304334] Avg episode reward: [(0, '4590.804')] [2023-03-08 02:39:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000119232_61046784.pth... [2023-03-08 02:39:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000118512_60678144.pth [2023-03-08 02:39:37,596][304623] Updated weights for policy 0, policy_version 119280 (0.0005) [2023-03-08 02:39:40,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12697.6, 300 sec: 13176.6). Total num frames: 61108224. Throughput: 0: 12470.0. Samples: 61100096. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:39:40,769][304334] Avg episode reward: [(0, '4627.518')] [2023-03-08 02:39:40,939][304623] Updated weights for policy 0, policy_version 119360 (0.0005) [2023-03-08 02:39:44,415][304623] Updated weights for policy 0, policy_version 119440 (0.0005) [2023-03-08 02:39:45,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 13162.7). Total num frames: 61169664. Throughput: 0: 12381.4. Samples: 61136896. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:39:45,769][304334] Avg episode reward: [(0, '4589.029')] [2023-03-08 02:39:47,800][304623] Updated weights for policy 0, policy_version 119520 (0.0005) [2023-03-08 02:39:50,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 13121.1). Total num frames: 61227008. Throughput: 0: 12243.0. Samples: 61208612. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:39:50,769][304334] Avg episode reward: [(0, '4627.895')] [2023-03-08 02:39:50,820][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000119592_61231104.pth... [2023-03-08 02:39:50,821][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000118872_60862464.pth [2023-03-08 02:39:51,151][304623] Updated weights for policy 0, policy_version 119600 (0.0005) [2023-03-08 02:39:54,554][304623] Updated weights for policy 0, policy_version 119680 (0.0005) [2023-03-08 02:39:55,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12356.3, 300 sec: 13093.3). Total num frames: 61288448. Throughput: 0: 12199.2. Samples: 61280812. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:39:55,769][304334] Avg episode reward: [(0, '4604.215')] [2023-03-08 02:39:57,906][304623] Updated weights for policy 0, policy_version 119760 (0.0005) [2023-03-08 02:40:00,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 13065.5). Total num frames: 61349888. Throughput: 0: 12194.2. Samples: 61317632. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:40:00,769][304334] Avg episode reward: [(0, '4634.096')] [2023-03-08 02:40:01,324][304623] Updated weights for policy 0, policy_version 119840 (0.0005) [2023-03-08 02:40:04,647][304623] Updated weights for policy 0, policy_version 119920 (0.0004) [2023-03-08 02:40:05,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12219.7, 300 sec: 13051.7). Total num frames: 61411328. Throughput: 0: 12197.0. Samples: 61390912. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:40:05,769][304334] Avg episode reward: [(0, '4650.605')] [2023-03-08 02:40:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000119944_61411328.pth... [2023-03-08 02:40:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000119232_61046784.pth [2023-03-08 02:40:07,863][304623] Updated weights for policy 0, policy_version 120000 (0.0005) [2023-03-08 02:40:10,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12288.0, 300 sec: 13037.8). Total num frames: 61476864. Throughput: 0: 12247.1. Samples: 61468680. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:40:10,769][304334] Avg episode reward: [(0, '4607.811')] [2023-03-08 02:40:10,914][304623] Updated weights for policy 0, policy_version 120080 (0.0004) [2023-03-08 02:40:14,043][304623] Updated weights for policy 0, policy_version 120160 (0.0004) [2023-03-08 02:40:15,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12356.3, 300 sec: 13023.9). Total num frames: 61542400. Throughput: 0: 12298.9. Samples: 61509008. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:40:15,769][304334] Avg episode reward: [(0, '4583.269')] [2023-03-08 02:40:17,315][304623] Updated weights for policy 0, policy_version 120240 (0.0004) [2023-03-08 02:40:20,671][304623] Updated weights for policy 0, policy_version 120320 (0.0005) [2023-03-08 02:40:20,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12356.3, 300 sec: 13010.0). Total num frames: 61603840. Throughput: 0: 12363.2. Samples: 61583432. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:40:20,769][304334] Avg episode reward: [(0, '4584.385')] [2023-03-08 02:40:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000120320_61603840.pth... [2023-03-08 02:40:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000119592_61231104.pth [2023-03-08 02:40:24,062][304623] Updated weights for policy 0, policy_version 120400 (0.0005) [2023-03-08 02:40:25,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 13010.0). Total num frames: 61665280. Throughput: 0: 12374.4. Samples: 61656944. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 02:40:25,769][304334] Avg episode reward: [(0, '4640.157')] [2023-03-08 02:40:27,435][304623] Updated weights for policy 0, policy_version 120480 (0.0005) [2023-03-08 02:40:30,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12288.0, 300 sec: 12982.2). Total num frames: 61722624. Throughput: 0: 12335.0. Samples: 61691972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:40:30,769][304334] Avg episode reward: [(0, '4600.695')] [2023-03-08 02:40:30,880][304623] Updated weights for policy 0, policy_version 120560 (0.0005) [2023-03-08 02:40:34,216][304623] Updated weights for policy 0, policy_version 120640 (0.0005) [2023-03-08 02:40:35,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 12982.2). Total num frames: 61784064. Throughput: 0: 12347.3. Samples: 61764240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:40:35,769][304334] Avg episode reward: [(0, '4590.534')] [2023-03-08 02:40:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000120672_61784064.pth... [2023-03-08 02:40:35,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000119944_61411328.pth [2023-03-08 02:40:37,494][304623] Updated weights for policy 0, policy_version 120720 (0.0005) [2023-03-08 02:40:40,767][304623] Updated weights for policy 0, policy_version 120800 (0.0005) [2023-03-08 02:40:40,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12356.3, 300 sec: 12996.1). Total num frames: 61849600. Throughput: 0: 12429.8. Samples: 61840152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:40:40,769][304334] Avg episode reward: [(0, '4601.042')] [2023-03-08 02:40:44,163][304623] Updated weights for policy 0, policy_version 120880 (0.0005) [2023-03-08 02:40:45,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12968.4). Total num frames: 61906944. Throughput: 0: 12412.4. Samples: 61876192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:40:45,769][304334] Avg episode reward: [(0, '4608.953')] [2023-03-08 02:40:47,543][304623] Updated weights for policy 0, policy_version 120960 (0.0005) [2023-03-08 02:40:50,769][304334] Fps is (10 sec: 11878.2, 60 sec: 12356.3, 300 sec: 12968.3). Total num frames: 61968384. Throughput: 0: 12387.3. Samples: 61948340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:40:50,769][304334] Avg episode reward: [(0, '4578.758')] [2023-03-08 02:40:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000121032_61968384.pth... [2023-03-08 02:40:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000120320_61603840.pth [2023-03-08 02:40:50,971][304623] Updated weights for policy 0, policy_version 121040 (0.0005) [2023-03-08 02:40:54,224][304623] Updated weights for policy 0, policy_version 121120 (0.0005) [2023-03-08 02:40:55,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12940.6). Total num frames: 62029824. Throughput: 0: 12321.5. Samples: 62023148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:40:55,769][304334] Avg episode reward: [(0, '4647.038')] [2023-03-08 02:40:57,559][304623] Updated weights for policy 0, policy_version 121200 (0.0005) [2023-03-08 02:41:00,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 12912.8). Total num frames: 62091264. Throughput: 0: 12234.9. Samples: 62059576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:41:00,769][304334] Avg episode reward: [(0, '4668.222')] [2023-03-08 02:41:00,775][304623] Updated weights for policy 0, policy_version 121280 (0.0005) [2023-03-08 02:41:03,778][304623] Updated weights for policy 0, policy_version 121360 (0.0004) [2023-03-08 02:41:05,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12492.8, 300 sec: 12912.8). Total num frames: 62160896. Throughput: 0: 12350.4. Samples: 62139200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:41:05,769][304334] Avg episode reward: [(0, '4615.605')] [2023-03-08 02:41:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000121408_62160896.pth... [2023-03-08 02:41:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000120672_61784064.pth [2023-03-08 02:41:06,832][304623] Updated weights for policy 0, policy_version 121440 (0.0004) [2023-03-08 02:41:09,772][304623] Updated weights for policy 0, policy_version 121520 (0.0003) [2023-03-08 02:41:10,769][304334] Fps is (10 sec: 13926.4, 60 sec: 12561.1, 300 sec: 12912.8). Total num frames: 62230528. Throughput: 0: 12534.2. Samples: 62220984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:41:10,769][304334] Avg episode reward: [(0, '4655.748')] [2023-03-08 02:41:12,745][304623] Updated weights for policy 0, policy_version 121600 (0.0004) [2023-03-08 02:41:15,769][304334] Fps is (10 sec: 13516.9, 60 sec: 12561.1, 300 sec: 12898.9). Total num frames: 62296064. Throughput: 0: 12677.6. Samples: 62262464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:41:15,769][304334] Avg episode reward: [(0, '4644.801')] [2023-03-08 02:41:15,775][304623] Updated weights for policy 0, policy_version 121680 (0.0004) [2023-03-08 02:41:18,785][304623] Updated weights for policy 0, policy_version 121760 (0.0004) [2023-03-08 02:41:20,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12697.6, 300 sec: 12912.8). Total num frames: 62365696. Throughput: 0: 12874.6. Samples: 62343596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:41:20,769][304334] Avg episode reward: [(0, '4611.947')] [2023-03-08 02:41:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000121808_62365696.pth... [2023-03-08 02:41:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000121032_61968384.pth [2023-03-08 02:41:21,775][304623] Updated weights for policy 0, policy_version 121840 (0.0003) [2023-03-08 02:41:24,721][304623] Updated weights for policy 0, policy_version 121920 (0.0003) [2023-03-08 02:41:25,769][304334] Fps is (10 sec: 13926.4, 60 sec: 12834.1, 300 sec: 12926.7). Total num frames: 62435328. Throughput: 0: 13035.1. Samples: 62426732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:41:25,769][304334] Avg episode reward: [(0, '4574.717')] [2023-03-08 02:41:27,714][304623] Updated weights for policy 0, policy_version 122000 (0.0004) [2023-03-08 02:41:30,602][304623] Updated weights for policy 0, policy_version 122080 (0.0003) [2023-03-08 02:41:30,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13038.9, 300 sec: 12926.7). Total num frames: 62504960. Throughput: 0: 13145.6. Samples: 62467744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:41:30,769][304334] Avg episode reward: [(0, '4608.895')] [2023-03-08 02:41:33,692][304623] Updated weights for policy 0, policy_version 122160 (0.0004) [2023-03-08 02:41:35,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13107.2, 300 sec: 12926.7). Total num frames: 62570496. Throughput: 0: 13370.3. Samples: 62550004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:41:35,769][304334] Avg episode reward: [(0, '4597.530')] [2023-03-08 02:41:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000122208_62570496.pth... [2023-03-08 02:41:35,773][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000121408_62160896.pth [2023-03-08 02:41:36,714][304623] Updated weights for policy 0, policy_version 122240 (0.0004) [2023-03-08 02:41:39,702][304623] Updated weights for policy 0, policy_version 122320 (0.0003) [2023-03-08 02:41:40,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13175.5, 300 sec: 12940.6). Total num frames: 62640128. Throughput: 0: 13525.9. Samples: 62631812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:41:40,769][304334] Avg episode reward: [(0, '4643.762')] [2023-03-08 02:41:42,732][304623] Updated weights for policy 0, policy_version 122400 (0.0004) [2023-03-08 02:41:45,707][304623] Updated weights for policy 0, policy_version 122480 (0.0004) [2023-03-08 02:41:45,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13380.3, 300 sec: 12968.4). Total num frames: 62709760. Throughput: 0: 13615.0. Samples: 62672252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:41:45,769][304334] Avg episode reward: [(0, '4662.632')] [2023-03-08 02:41:48,749][304623] Updated weights for policy 0, policy_version 122560 (0.0004) [2023-03-08 02:41:50,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 12954.5). Total num frames: 62775296. Throughput: 0: 13660.0. Samples: 62753900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:41:50,769][304334] Avg episode reward: [(0, '4637.417')] [2023-03-08 02:41:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000122608_62775296.pth... [2023-03-08 02:41:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000121808_62365696.pth [2023-03-08 02:41:51,817][304623] Updated weights for policy 0, policy_version 122640 (0.0004) [2023-03-08 02:41:54,843][304623] Updated weights for policy 0, policy_version 122720 (0.0004) [2023-03-08 02:41:55,769][304334] Fps is (10 sec: 13107.1, 60 sec: 13516.8, 300 sec: 12940.6). Total num frames: 62840832. Throughput: 0: 13630.5. Samples: 62834356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:41:55,769][304334] Avg episode reward: [(0, '4616.583')] [2023-03-08 02:41:57,928][304623] Updated weights for policy 0, policy_version 122800 (0.0005) [2023-03-08 02:42:00,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 12954.5). Total num frames: 62910464. Throughput: 0: 13585.2. Samples: 62873800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:42:00,769][304334] Avg episode reward: [(0, '4676.624')] [2023-03-08 02:42:00,905][304623] Updated weights for policy 0, policy_version 122880 (0.0004) [2023-03-08 02:42:03,866][304623] Updated weights for policy 0, policy_version 122960 (0.0004) [2023-03-08 02:42:05,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13653.3, 300 sec: 12954.5). Total num frames: 62980096. Throughput: 0: 13627.3. Samples: 62956824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:42:05,769][304334] Avg episode reward: [(0, '4578.282')] [2023-03-08 02:42:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000123008_62980096.pth... [2023-03-08 02:42:05,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000122208_62570496.pth [2023-03-08 02:42:06,841][304623] Updated weights for policy 0, policy_version 123040 (0.0005) [2023-03-08 02:42:09,839][304623] Updated weights for policy 0, policy_version 123120 (0.0004) [2023-03-08 02:42:10,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13653.3, 300 sec: 12954.5). Total num frames: 63049728. Throughput: 0: 13609.9. Samples: 63039180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:42:10,774][304334] Avg episode reward: [(0, '4646.018')] [2023-03-08 02:42:12,887][304623] Updated weights for policy 0, policy_version 123200 (0.0004) [2023-03-08 02:42:15,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13721.6, 300 sec: 12968.4). Total num frames: 63119360. Throughput: 0: 13591.6. Samples: 63079364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:42:15,769][304623] Updated weights for policy 0, policy_version 123280 (0.0004) [2023-03-08 02:42:15,780][304334] Avg episode reward: [(0, '4649.757')] [2023-03-08 02:42:18,855][304623] Updated weights for policy 0, policy_version 123360 (0.0004) [2023-03-08 02:42:20,769][304334] Fps is (10 sec: 13107.1, 60 sec: 13585.1, 300 sec: 12940.6). Total num frames: 63180800. Throughput: 0: 13595.9. Samples: 63161820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:42:20,780][304334] Avg episode reward: [(0, '4615.137')] [2023-03-08 02:42:20,834][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000123408_63184896.pth... [2023-03-08 02:42:20,837][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000122608_62775296.pth [2023-03-08 02:42:22,176][304623] Updated weights for policy 0, policy_version 123440 (0.0005) [2023-03-08 02:42:25,298][304623] Updated weights for policy 0, policy_version 123520 (0.0005) [2023-03-08 02:42:25,769][304334] Fps is (10 sec: 12697.5, 60 sec: 13516.8, 300 sec: 12926.7). Total num frames: 63246336. Throughput: 0: 13474.3. Samples: 63238156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:42:25,780][304334] Avg episode reward: [(0, '4619.328')] [2023-03-08 02:42:28,412][304623] Updated weights for policy 0, policy_version 123600 (0.0004) [2023-03-08 02:42:30,769][304334] Fps is (10 sec: 13107.3, 60 sec: 13448.5, 300 sec: 12926.7). Total num frames: 63311872. Throughput: 0: 13451.7. Samples: 63277580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:42:30,780][304334] Avg episode reward: [(0, '4577.616')] [2023-03-08 02:42:31,514][304623] Updated weights for policy 0, policy_version 123680 (0.0005) [2023-03-08 02:42:34,491][304623] Updated weights for policy 0, policy_version 123760 (0.0004) [2023-03-08 02:42:35,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 12926.7). Total num frames: 63381504. Throughput: 0: 13414.2. Samples: 63357540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:42:35,780][304334] Avg episode reward: [(0, '4663.316')] [2023-03-08 02:42:35,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000123792_63381504.pth... [2023-03-08 02:42:35,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000123008_62980096.pth [2023-03-08 02:42:37,530][304623] Updated weights for policy 0, policy_version 123840 (0.0004) [2023-03-08 02:42:40,650][304623] Updated weights for policy 0, policy_version 123920 (0.0005) [2023-03-08 02:42:40,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 12926.7). Total num frames: 63447040. Throughput: 0: 13418.9. Samples: 63438208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:42:40,780][304334] Avg episode reward: [(0, '4638.065')] [2023-03-08 02:42:43,656][304623] Updated weights for policy 0, policy_version 124000 (0.0004) [2023-03-08 02:42:45,769][304334] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 12912.8). Total num frames: 63512576. Throughput: 0: 13446.0. Samples: 63478872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:42:45,780][304334] Avg episode reward: [(0, '4646.242')] [2023-03-08 02:42:46,701][304623] Updated weights for policy 0, policy_version 124080 (0.0004) [2023-03-08 02:42:49,751][304623] Updated weights for policy 0, policy_version 124160 (0.0004) [2023-03-08 02:42:50,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 12926.7). Total num frames: 63582208. Throughput: 0: 13389.0. Samples: 63559328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:42:50,780][304334] Avg episode reward: [(0, '4585.117')] [2023-03-08 02:42:50,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000124184_63582208.pth... [2023-03-08 02:42:50,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000123408_63184896.pth [2023-03-08 02:42:52,737][304623] Updated weights for policy 0, policy_version 124240 (0.0004) [2023-03-08 02:42:55,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 12940.6). Total num frames: 63647744. Throughput: 0: 13352.9. Samples: 63640060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:42:55,780][304334] Avg episode reward: [(0, '4629.378')] [2023-03-08 02:42:55,821][304623] Updated weights for policy 0, policy_version 124320 (0.0004) [2023-03-08 02:42:58,986][304623] Updated weights for policy 0, policy_version 124400 (0.0005) [2023-03-08 02:43:00,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 12940.6). Total num frames: 63713280. Throughput: 0: 13343.3. Samples: 63679812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:43:00,780][304334] Avg episode reward: [(0, '4629.770')] [2023-03-08 02:43:02,044][304623] Updated weights for policy 0, policy_version 124480 (0.0004) [2023-03-08 02:43:05,183][304623] Updated weights for policy 0, policy_version 124560 (0.0004) [2023-03-08 02:43:05,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13312.0, 300 sec: 12954.5). Total num frames: 63778816. Throughput: 0: 13282.4. Samples: 63759528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:43:05,780][304334] Avg episode reward: [(0, '4648.893')] [2023-03-08 02:43:05,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000124568_63778816.pth... [2023-03-08 02:43:05,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000123792_63381504.pth [2023-03-08 02:43:08,414][304623] Updated weights for policy 0, policy_version 124640 (0.0004) [2023-03-08 02:43:10,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13243.7, 300 sec: 12968.4). Total num frames: 63844352. Throughput: 0: 13290.4. Samples: 63836224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:43:10,769][304334] Avg episode reward: [(0, '4625.534')] [2023-03-08 02:43:11,521][304623] Updated weights for policy 0, policy_version 124720 (0.0004) [2023-03-08 02:43:14,593][304623] Updated weights for policy 0, policy_version 124800 (0.0004) [2023-03-08 02:43:15,769][304334] Fps is (10 sec: 13107.1, 60 sec: 13175.4, 300 sec: 12982.2). Total num frames: 63909888. Throughput: 0: 13304.3. Samples: 63876272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:43:15,769][304334] Avg episode reward: [(0, '4593.379')] [2023-03-08 02:43:17,637][304623] Updated weights for policy 0, policy_version 124880 (0.0004) [2023-03-08 02:43:20,769][304334] Fps is (10 sec: 13107.4, 60 sec: 13243.8, 300 sec: 12982.2). Total num frames: 63975424. Throughput: 0: 13310.6. Samples: 63956516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:43:20,769][304334] Avg episode reward: [(0, '4627.260')] [2023-03-08 02:43:20,771][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000124952_63975424.pth... [2023-03-08 02:43:20,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000124184_63582208.pth [2023-03-08 02:43:20,864][304623] Updated weights for policy 0, policy_version 124960 (0.0004) [2023-03-08 02:43:24,249][304623] Updated weights for policy 0, policy_version 125040 (0.0005) [2023-03-08 02:43:25,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13175.5, 300 sec: 12954.5). Total num frames: 64036864. Throughput: 0: 13122.8. Samples: 64028736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:43:25,769][304334] Avg episode reward: [(0, '4598.308')] [2023-03-08 02:43:27,618][304623] Updated weights for policy 0, policy_version 125120 (0.0005) [2023-03-08 02:43:30,769][304334] Fps is (10 sec: 12287.8, 60 sec: 13107.2, 300 sec: 12940.6). Total num frames: 64098304. Throughput: 0: 13038.4. Samples: 64065600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:43:30,769][304334] Avg episode reward: [(0, '4644.271')] [2023-03-08 02:43:31,093][304623] Updated weights for policy 0, policy_version 125200 (0.0005) [2023-03-08 02:43:34,444][304623] Updated weights for policy 0, policy_version 125280 (0.0005) [2023-03-08 02:43:35,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12902.4, 300 sec: 12912.8). Total num frames: 64155648. Throughput: 0: 12855.8. Samples: 64137840. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:43:35,769][304334] Avg episode reward: [(0, '4619.618')] [2023-03-08 02:43:35,807][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000125312_64159744.pth... [2023-03-08 02:43:35,808][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000124568_63778816.pth [2023-03-08 02:43:37,832][304623] Updated weights for policy 0, policy_version 125360 (0.0005) [2023-03-08 02:43:40,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12834.1, 300 sec: 12885.0). Total num frames: 64217088. Throughput: 0: 12656.2. Samples: 64209588. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:43:40,769][304334] Avg episode reward: [(0, '4684.293')] [2023-03-08 02:43:41,270][304623] Updated weights for policy 0, policy_version 125440 (0.0005) [2023-03-08 02:43:44,668][304623] Updated weights for policy 0, policy_version 125520 (0.0005) [2023-03-08 02:43:45,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12765.9, 300 sec: 12871.2). Total num frames: 64278528. Throughput: 0: 12578.2. Samples: 64245832. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:43:45,769][304334] Avg episode reward: [(0, '4661.822')] [2023-03-08 02:43:47,985][304623] Updated weights for policy 0, policy_version 125600 (0.0005) [2023-03-08 02:43:50,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12629.3, 300 sec: 12857.3). Total num frames: 64339968. Throughput: 0: 12443.7. Samples: 64319496. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:43:50,769][304334] Avg episode reward: [(0, '4645.474')] [2023-03-08 02:43:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000125664_64339968.pth... [2023-03-08 02:43:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000124952_63975424.pth [2023-03-08 02:43:51,332][304623] Updated weights for policy 0, policy_version 125680 (0.0005) [2023-03-08 02:43:54,585][304623] Updated weights for policy 0, policy_version 125760 (0.0003) [2023-03-08 02:43:55,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12843.4). Total num frames: 64401408. Throughput: 0: 12400.3. Samples: 64394236. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:43:55,769][304334] Avg episode reward: [(0, '4649.013')] [2023-03-08 02:43:57,540][304623] Updated weights for policy 0, policy_version 125840 (0.0003) [2023-03-08 02:44:00,571][304623] Updated weights for policy 0, policy_version 125920 (0.0004) [2023-03-08 02:44:00,769][304334] Fps is (10 sec: 13107.3, 60 sec: 12629.3, 300 sec: 12857.3). Total num frames: 64471040. Throughput: 0: 12432.1. Samples: 64435716. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:44:00,769][304334] Avg episode reward: [(0, '4675.145')] [2023-03-08 02:44:03,587][304623] Updated weights for policy 0, policy_version 126000 (0.0004) [2023-03-08 02:44:05,769][304334] Fps is (10 sec: 13926.4, 60 sec: 12697.6, 300 sec: 12885.0). Total num frames: 64540672. Throughput: 0: 12461.7. Samples: 64517292. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:44:05,769][304334] Avg episode reward: [(0, '4707.013')] [2023-03-08 02:44:05,771][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000126056_64540672.pth... [2023-03-08 02:44:05,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000125312_64159744.pth [2023-03-08 02:44:06,568][304623] Updated weights for policy 0, policy_version 126080 (0.0004) [2023-03-08 02:44:09,593][304623] Updated weights for policy 0, policy_version 126160 (0.0004) [2023-03-08 02:44:10,769][304334] Fps is (10 sec: 13926.4, 60 sec: 12765.9, 300 sec: 12912.8). Total num frames: 64610304. Throughput: 0: 12671.9. Samples: 64598972. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:44:10,769][304334] Avg episode reward: [(0, '4700.407')] [2023-03-08 02:44:12,569][304623] Updated weights for policy 0, policy_version 126240 (0.0004) [2023-03-08 02:44:15,633][304623] Updated weights for policy 0, policy_version 126320 (0.0004) [2023-03-08 02:44:15,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12765.9, 300 sec: 12926.7). Total num frames: 64675840. Throughput: 0: 12765.0. Samples: 64640024. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:44:15,769][304334] Avg episode reward: [(0, '4680.101')] [2023-03-08 02:44:18,644][304623] Updated weights for policy 0, policy_version 126400 (0.0004) [2023-03-08 02:44:20,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12765.8, 300 sec: 12940.6). Total num frames: 64741376. Throughput: 0: 12958.2. Samples: 64720960. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:44:20,769][304334] Avg episode reward: [(0, '4677.067')] [2023-03-08 02:44:20,788][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000126456_64745472.pth... [2023-03-08 02:44:20,790][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000125664_64339968.pth [2023-03-08 02:44:21,694][304623] Updated weights for policy 0, policy_version 126480 (0.0004) [2023-03-08 02:44:24,724][304623] Updated weights for policy 0, policy_version 126560 (0.0004) [2023-03-08 02:44:25,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12902.4, 300 sec: 12968.4). Total num frames: 64811008. Throughput: 0: 13171.8. Samples: 64802320. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:44:25,769][304334] Avg episode reward: [(0, '4703.180')] [2023-03-08 02:44:27,863][304623] Updated weights for policy 0, policy_version 126640 (0.0005) [2023-03-08 02:44:30,769][304334] Fps is (10 sec: 13516.9, 60 sec: 12970.7, 300 sec: 12982.2). Total num frames: 64876544. Throughput: 0: 13227.6. Samples: 64841072. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:44:30,769][304334] Avg episode reward: [(0, '4688.248')] [2023-03-08 02:44:30,868][304623] Updated weights for policy 0, policy_version 126720 (0.0004) [2023-03-08 02:44:34,119][304623] Updated weights for policy 0, policy_version 126800 (0.0004) [2023-03-08 02:44:35,769][304334] Fps is (10 sec: 12697.5, 60 sec: 13038.9, 300 sec: 12982.2). Total num frames: 64937984. Throughput: 0: 13348.9. Samples: 64920196. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:44:35,769][304334] Avg episode reward: [(0, '4709.985')] [2023-03-08 02:44:35,818][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000126840_64942080.pth... [2023-03-08 02:44:35,820][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000126056_64540672.pth [2023-03-08 02:44:37,518][304623] Updated weights for policy 0, policy_version 126880 (0.0005) [2023-03-08 02:44:40,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13038.9, 300 sec: 12982.2). Total num frames: 64999424. Throughput: 0: 13295.2. Samples: 64992520. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:44:40,769][304334] Avg episode reward: [(0, '4690.101')] [2023-03-08 02:44:40,878][304623] Updated weights for policy 0, policy_version 126960 (0.0005) [2023-03-08 02:44:44,157][304623] Updated weights for policy 0, policy_version 127040 (0.0005) [2023-03-08 02:44:45,769][304334] Fps is (10 sec: 12697.7, 60 sec: 13107.2, 300 sec: 13010.0). Total num frames: 65064960. Throughput: 0: 13194.1. Samples: 65029452. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:44:45,769][304334] Avg episode reward: [(0, '4699.191')] [2023-03-08 02:44:47,172][304623] Updated weights for policy 0, policy_version 127120 (0.0004) [2023-03-08 02:44:50,194][304623] Updated weights for policy 0, policy_version 127200 (0.0004) [2023-03-08 02:44:50,769][304334] Fps is (10 sec: 13107.1, 60 sec: 13175.5, 300 sec: 13023.9). Total num frames: 65130496. Throughput: 0: 13173.1. Samples: 65110080. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:44:50,769][304334] Avg episode reward: [(0, '4699.024')] [2023-03-08 02:44:50,771][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000127208_65130496.pth... [2023-03-08 02:44:50,773][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000126456_64745472.pth [2023-03-08 02:44:53,239][304623] Updated weights for policy 0, policy_version 127280 (0.0004) [2023-03-08 02:44:55,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13312.0, 300 sec: 13051.7). Total num frames: 65200128. Throughput: 0: 13133.5. Samples: 65189980. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:44:55,769][304334] Avg episode reward: [(0, '4694.914')] [2023-03-08 02:44:56,245][304623] Updated weights for policy 0, policy_version 127360 (0.0004) [2023-03-08 02:44:59,343][304623] Updated weights for policy 0, policy_version 127440 (0.0004) [2023-03-08 02:45:00,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13243.7, 300 sec: 13065.5). Total num frames: 65265664. Throughput: 0: 13128.1. Samples: 65230788. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:45:00,769][304334] Avg episode reward: [(0, '4701.115')] [2023-03-08 02:45:02,389][304623] Updated weights for policy 0, policy_version 127520 (0.0004) [2023-03-08 02:45:05,418][304623] Updated weights for policy 0, policy_version 127600 (0.0004) [2023-03-08 02:45:05,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13243.7, 300 sec: 13079.4). Total num frames: 65335296. Throughput: 0: 13118.1. Samples: 65311276. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:45:05,769][304334] Avg episode reward: [(0, '4713.805')] [2023-03-08 02:45:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000127608_65335296.pth... [2023-03-08 02:45:05,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000126840_64942080.pth [2023-03-08 02:45:08,497][304623] Updated weights for policy 0, policy_version 127680 (0.0004) [2023-03-08 02:45:10,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13175.5, 300 sec: 13079.4). Total num frames: 65400832. Throughput: 0: 13104.8. Samples: 65392036. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:45:10,769][304334] Avg episode reward: [(0, '4688.701')] [2023-03-08 02:45:11,528][304623] Updated weights for policy 0, policy_version 127760 (0.0004) [2023-03-08 02:45:14,587][304623] Updated weights for policy 0, policy_version 127840 (0.0004) [2023-03-08 02:45:15,769][304334] Fps is (10 sec: 13107.3, 60 sec: 13175.5, 300 sec: 13093.3). Total num frames: 65466368. Throughput: 0: 13157.7. Samples: 65433168. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:45:15,769][304334] Avg episode reward: [(0, '4700.163')] [2023-03-08 02:45:17,826][304623] Updated weights for policy 0, policy_version 127920 (0.0005) [2023-03-08 02:45:20,769][304334] Fps is (10 sec: 12697.7, 60 sec: 13107.2, 300 sec: 13093.3). Total num frames: 65527808. Throughput: 0: 13087.3. Samples: 65509124. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:45:20,769][304334] Avg episode reward: [(0, '4649.067')] [2023-03-08 02:45:20,807][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000127992_65531904.pth... [2023-03-08 02:45:20,809][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000127208_65130496.pth [2023-03-08 02:45:21,144][304623] Updated weights for policy 0, policy_version 128000 (0.0005) [2023-03-08 02:45:24,435][304623] Updated weights for policy 0, policy_version 128080 (0.0005) [2023-03-08 02:45:25,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12970.7, 300 sec: 13107.2). Total num frames: 65589248. Throughput: 0: 13136.6. Samples: 65583668. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:45:25,769][304334] Avg episode reward: [(0, '4691.799')] [2023-03-08 02:45:27,822][304623] Updated weights for policy 0, policy_version 128160 (0.0005) [2023-03-08 02:45:30,769][304334] Fps is (10 sec: 12287.8, 60 sec: 12902.4, 300 sec: 13107.2). Total num frames: 65650688. Throughput: 0: 13117.9. Samples: 65619756. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:45:30,769][304334] Avg episode reward: [(0, '4686.284')] [2023-03-08 02:45:31,193][304623] Updated weights for policy 0, policy_version 128240 (0.0005) [2023-03-08 02:45:34,616][304623] Updated weights for policy 0, policy_version 128320 (0.0005) [2023-03-08 02:45:35,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12902.4, 300 sec: 13093.3). Total num frames: 65712128. Throughput: 0: 12929.9. Samples: 65691928. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 02:45:35,769][304334] Avg episode reward: [(0, '4703.024')] [2023-03-08 02:45:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000128344_65712128.pth... [2023-03-08 02:45:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000127608_65335296.pth [2023-03-08 02:45:37,918][304623] Updated weights for policy 0, policy_version 128400 (0.0005) [2023-03-08 02:45:40,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12902.4, 300 sec: 13107.2). Total num frames: 65773568. Throughput: 0: 12788.0. Samples: 65765440. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:45:40,769][304334] Avg episode reward: [(0, '4709.873')] [2023-03-08 02:45:41,311][304623] Updated weights for policy 0, policy_version 128480 (0.0005) [2023-03-08 02:45:44,687][304623] Updated weights for policy 0, policy_version 128560 (0.0005) [2023-03-08 02:45:45,769][304334] Fps is (10 sec: 12288.2, 60 sec: 12834.1, 300 sec: 13107.2). Total num frames: 65835008. Throughput: 0: 12699.0. Samples: 65802240. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:45:45,769][304334] Avg episode reward: [(0, '4704.543')] [2023-03-08 02:45:48,061][304623] Updated weights for policy 0, policy_version 128640 (0.0005) [2023-03-08 02:45:50,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12765.9, 300 sec: 13107.2). Total num frames: 65896448. Throughput: 0: 12538.1. Samples: 65875492. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:45:50,769][304334] Avg episode reward: [(0, '4709.033')] [2023-03-08 02:45:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000128704_65896448.pth... [2023-03-08 02:45:50,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000127992_65531904.pth [2023-03-08 02:45:51,205][304623] Updated weights for policy 0, policy_version 128720 (0.0005) [2023-03-08 02:45:54,219][304623] Updated weights for policy 0, policy_version 128800 (0.0004) [2023-03-08 02:45:55,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12765.9, 300 sec: 13135.0). Total num frames: 65966080. Throughput: 0: 12526.8. Samples: 65955744. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:45:55,769][304334] Avg episode reward: [(0, '4692.785')] [2023-03-08 02:45:57,186][304623] Updated weights for policy 0, policy_version 128880 (0.0004) [2023-03-08 02:46:00,239][304623] Updated weights for policy 0, policy_version 128960 (0.0004) [2023-03-08 02:46:00,769][304334] Fps is (10 sec: 13516.9, 60 sec: 12765.9, 300 sec: 13121.1). Total num frames: 66031616. Throughput: 0: 12527.3. Samples: 65996896. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:46:00,769][304334] Avg episode reward: [(0, '4699.492')] [2023-03-08 02:46:03,226][304623] Updated weights for policy 0, policy_version 129040 (0.0005) [2023-03-08 02:46:05,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12697.6, 300 sec: 13107.2). Total num frames: 66097152. Throughput: 0: 12628.6. Samples: 66077412. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:46:05,769][304334] Avg episode reward: [(0, '4688.679')] [2023-03-08 02:46:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000129096_66097152.pth... [2023-03-08 02:46:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000128344_65712128.pth [2023-03-08 02:46:06,619][304623] Updated weights for policy 0, policy_version 129120 (0.0005) [2023-03-08 02:46:09,712][304623] Updated weights for policy 0, policy_version 129200 (0.0004) [2023-03-08 02:46:10,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12697.6, 300 sec: 13107.2). Total num frames: 66162688. Throughput: 0: 12677.7. Samples: 66154164. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:46:10,769][304334] Avg episode reward: [(0, '4690.069')] [2023-03-08 02:46:12,701][304623] Updated weights for policy 0, policy_version 129280 (0.0004) [2023-03-08 02:46:15,769][304334] Fps is (10 sec: 13107.3, 60 sec: 12697.6, 300 sec: 13093.3). Total num frames: 66228224. Throughput: 0: 12790.5. Samples: 66195328. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:46:15,769][304334] Avg episode reward: [(0, '4678.902')] [2023-03-08 02:46:15,836][304623] Updated weights for policy 0, policy_version 129360 (0.0005) [2023-03-08 02:46:18,911][304623] Updated weights for policy 0, policy_version 129440 (0.0004) [2023-03-08 02:46:20,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12834.1, 300 sec: 13093.3). Total num frames: 66297856. Throughput: 0: 12930.0. Samples: 66273776. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:46:20,769][304334] Avg episode reward: [(0, '4649.687')] [2023-03-08 02:46:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000129488_66297856.pth... [2023-03-08 02:46:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000128704_65896448.pth [2023-03-08 02:46:21,897][304623] Updated weights for policy 0, policy_version 129520 (0.0004) [2023-03-08 02:46:24,966][304623] Updated weights for policy 0, policy_version 129600 (0.0004) [2023-03-08 02:46:25,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12902.4, 300 sec: 13079.4). Total num frames: 66363392. Throughput: 0: 13107.2. Samples: 66355264. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:46:25,769][304334] Avg episode reward: [(0, '4670.359')] [2023-03-08 02:46:27,885][304623] Updated weights for policy 0, policy_version 129680 (0.0003) [2023-03-08 02:46:30,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13039.0, 300 sec: 13093.3). Total num frames: 66433024. Throughput: 0: 13219.9. Samples: 66397136. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:46:30,769][304334] Avg episode reward: [(0, '4706.030')] [2023-03-08 02:46:30,810][304623] Updated weights for policy 0, policy_version 129760 (0.0003) [2023-03-08 02:46:33,955][304623] Updated weights for policy 0, policy_version 129840 (0.0004) [2023-03-08 02:46:35,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13107.2, 300 sec: 13079.4). Total num frames: 66498560. Throughput: 0: 13392.3. Samples: 66478144. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:46:35,769][304334] Avg episode reward: [(0, '4689.020')] [2023-03-08 02:46:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000129880_66498560.pth... [2023-03-08 02:46:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000129096_66097152.pth [2023-03-08 02:46:37,363][304623] Updated weights for policy 0, policy_version 129920 (0.0005) [2023-03-08 02:46:40,708][304623] Updated weights for policy 0, policy_version 130000 (0.0005) [2023-03-08 02:46:40,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13107.2, 300 sec: 13051.7). Total num frames: 66560000. Throughput: 0: 13231.2. Samples: 66551148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:46:40,769][304334] Avg episode reward: [(0, '4676.403')] [2023-03-08 02:46:44,139][304623] Updated weights for policy 0, policy_version 130080 (0.0005) [2023-03-08 02:46:45,769][304334] Fps is (10 sec: 11878.5, 60 sec: 13038.9, 300 sec: 13023.9). Total num frames: 66617344. Throughput: 0: 13129.5. Samples: 66587724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:46:45,769][304334] Avg episode reward: [(0, '4657.139')] [2023-03-08 02:46:47,495][304623] Updated weights for policy 0, policy_version 130160 (0.0005) [2023-03-08 02:46:50,769][304334] Fps is (10 sec: 11878.4, 60 sec: 13039.0, 300 sec: 13010.0). Total num frames: 66678784. Throughput: 0: 12957.7. Samples: 66660508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:46:50,769][304334] Avg episode reward: [(0, '4688.183')] [2023-03-08 02:46:50,771][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000130232_66678784.pth... [2023-03-08 02:46:50,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000129488_66297856.pth [2023-03-08 02:46:50,841][304623] Updated weights for policy 0, policy_version 130240 (0.0005) [2023-03-08 02:46:54,114][304623] Updated weights for policy 0, policy_version 130320 (0.0005) [2023-03-08 02:46:55,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12902.4, 300 sec: 12982.2). Total num frames: 66740224. Throughput: 0: 12898.1. Samples: 66734576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:46:55,769][304334] Avg episode reward: [(0, '4712.770')] [2023-03-08 02:46:57,480][304623] Updated weights for policy 0, policy_version 130400 (0.0005) [2023-03-08 02:47:00,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12834.1, 300 sec: 12954.5). Total num frames: 66801664. Throughput: 0: 12799.8. Samples: 66771320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:47:00,769][304334] Avg episode reward: [(0, '4707.633')] [2023-03-08 02:47:00,770][304623] Updated weights for policy 0, policy_version 130480 (0.0005) [2023-03-08 02:47:04,124][304623] Updated weights for policy 0, policy_version 130560 (0.0005) [2023-03-08 02:47:05,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12765.9, 300 sec: 12926.7). Total num frames: 66863104. Throughput: 0: 12698.1. Samples: 66845192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:47:05,769][304334] Avg episode reward: [(0, '4686.179')] [2023-03-08 02:47:05,786][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000130600_66867200.pth... [2023-03-08 02:47:05,788][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000129880_66498560.pth [2023-03-08 02:47:07,512][304623] Updated weights for policy 0, policy_version 130640 (0.0005) [2023-03-08 02:47:10,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12697.6, 300 sec: 12898.9). Total num frames: 66924544. Throughput: 0: 12517.7. Samples: 66918560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:47:10,769][304334] Avg episode reward: [(0, '4665.049')] [2023-03-08 02:47:10,831][304623] Updated weights for policy 0, policy_version 130720 (0.0005) [2023-03-08 02:47:14,278][304623] Updated weights for policy 0, policy_version 130800 (0.0005) [2023-03-08 02:47:15,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12629.3, 300 sec: 12898.9). Total num frames: 66985984. Throughput: 0: 12366.3. Samples: 66953620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:47:15,769][304334] Avg episode reward: [(0, '4678.676')] [2023-03-08 02:47:17,618][304623] Updated weights for policy 0, policy_version 130880 (0.0005) [2023-03-08 02:47:20,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12492.8, 300 sec: 12885.0). Total num frames: 67047424. Throughput: 0: 12213.4. Samples: 67027744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:47:20,769][304334] Avg episode reward: [(0, '4699.149')] [2023-03-08 02:47:20,826][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000130960_67051520.pth... [2023-03-08 02:47:20,827][304623] Updated weights for policy 0, policy_version 130960 (0.0005) [2023-03-08 02:47:20,828][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000130232_66678784.pth [2023-03-08 02:47:24,097][304623] Updated weights for policy 0, policy_version 131040 (0.0005) [2023-03-08 02:47:25,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12885.0). Total num frames: 67112960. Throughput: 0: 12302.7. Samples: 67104768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:47:25,769][304334] Avg episode reward: [(0, '4698.645')] [2023-03-08 02:47:27,196][304623] Updated weights for policy 0, policy_version 131120 (0.0004) [2023-03-08 02:47:30,350][304623] Updated weights for policy 0, policy_version 131200 (0.0004) [2023-03-08 02:47:30,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12424.5, 300 sec: 12871.2). Total num frames: 67178496. Throughput: 0: 12362.8. Samples: 67144052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:47:30,769][304334] Avg episode reward: [(0, '4696.339')] [2023-03-08 02:47:33,678][304623] Updated weights for policy 0, policy_version 131280 (0.0005) [2023-03-08 02:47:35,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12356.3, 300 sec: 12857.3). Total num frames: 67239936. Throughput: 0: 12421.1. Samples: 67219456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:47:35,769][304334] Avg episode reward: [(0, '4694.013')] [2023-03-08 02:47:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000131328_67239936.pth... [2023-03-08 02:47:35,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000130600_66867200.pth [2023-03-08 02:47:37,032][304623] Updated weights for policy 0, policy_version 131360 (0.0005) [2023-03-08 02:47:40,372][304623] Updated weights for policy 0, policy_version 131440 (0.0005) [2023-03-08 02:47:40,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12843.4). Total num frames: 67301376. Throughput: 0: 12410.4. Samples: 67293044. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:47:40,769][304334] Avg episode reward: [(0, '4696.368')] [2023-03-08 02:47:43,646][304623] Updated weights for policy 0, policy_version 131520 (0.0005) [2023-03-08 02:47:45,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12815.6). Total num frames: 67362816. Throughput: 0: 12417.6. Samples: 67330112. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:47:45,769][304334] Avg episode reward: [(0, '4705.687')] [2023-03-08 02:47:46,907][304623] Updated weights for policy 0, policy_version 131600 (0.0005) [2023-03-08 02:47:50,180][304623] Updated weights for policy 0, policy_version 131680 (0.0005) [2023-03-08 02:47:50,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12801.7). Total num frames: 67424256. Throughput: 0: 12435.6. Samples: 67404796. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:47:50,769][304334] Avg episode reward: [(0, '4702.346')] [2023-03-08 02:47:50,771][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000131688_67424256.pth... [2023-03-08 02:47:50,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000130960_67051520.pth [2023-03-08 02:47:53,668][304623] Updated weights for policy 0, policy_version 131760 (0.0005) [2023-03-08 02:47:55,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12356.2, 300 sec: 12774.0). Total num frames: 67481600. Throughput: 0: 12409.3. Samples: 67476980. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:47:55,769][304334] Avg episode reward: [(0, '4702.605')] [2023-03-08 02:47:57,153][304623] Updated weights for policy 0, policy_version 131840 (0.0005) [2023-03-08 02:48:00,411][304623] Updated weights for policy 0, policy_version 131920 (0.0005) [2023-03-08 02:48:00,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12774.0). Total num frames: 67547136. Throughput: 0: 12424.8. Samples: 67512736. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:48:00,769][304334] Avg episode reward: [(0, '4693.486')] [2023-03-08 02:48:03,734][304623] Updated weights for policy 0, policy_version 132000 (0.0005) [2023-03-08 02:48:05,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12424.5, 300 sec: 12760.1). Total num frames: 67608576. Throughput: 0: 12437.7. Samples: 67587440. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:48:05,769][304334] Avg episode reward: [(0, '4686.455')] [2023-03-08 02:48:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000132048_67608576.pth... [2023-03-08 02:48:05,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000131328_67239936.pth [2023-03-08 02:48:06,927][304623] Updated weights for policy 0, policy_version 132080 (0.0004) [2023-03-08 02:48:09,885][304623] Updated weights for policy 0, policy_version 132160 (0.0004) [2023-03-08 02:48:10,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12561.1, 300 sec: 12774.0). Total num frames: 67678208. Throughput: 0: 12491.5. Samples: 67666888. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:48:10,769][304334] Avg episode reward: [(0, '4691.505')] [2023-03-08 02:48:12,835][304623] Updated weights for policy 0, policy_version 132240 (0.0003) [2023-03-08 02:48:15,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12629.3, 300 sec: 12774.0). Total num frames: 67743744. Throughput: 0: 12542.9. Samples: 67708484. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:48:15,769][304334] Avg episode reward: [(0, '4699.756')] [2023-03-08 02:48:15,877][304623] Updated weights for policy 0, policy_version 132320 (0.0004) [2023-03-08 02:48:19,127][304623] Updated weights for policy 0, policy_version 132400 (0.0005) [2023-03-08 02:48:20,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12629.3, 300 sec: 12774.0). Total num frames: 67805184. Throughput: 0: 12612.2. Samples: 67787008. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:48:20,769][304334] Avg episode reward: [(0, '4703.991')] [2023-03-08 02:48:20,774][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000132440_67809280.pth... [2023-03-08 02:48:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000131688_67424256.pth [2023-03-08 02:48:22,432][304623] Updated weights for policy 0, policy_version 132480 (0.0005) [2023-03-08 02:48:25,702][304623] Updated weights for policy 0, policy_version 132560 (0.0005) [2023-03-08 02:48:25,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12787.9). Total num frames: 67870720. Throughput: 0: 12643.4. Samples: 67861996. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:48:25,769][304334] Avg episode reward: [(0, '4705.269')] [2023-03-08 02:48:28,992][304623] Updated weights for policy 0, policy_version 132640 (0.0005) [2023-03-08 02:48:30,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12561.1, 300 sec: 12801.7). Total num frames: 67932160. Throughput: 0: 12650.6. Samples: 67899392. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:48:30,769][304334] Avg episode reward: [(0, '4713.637')] [2023-03-08 02:48:32,260][304623] Updated weights for policy 0, policy_version 132720 (0.0005) [2023-03-08 02:48:35,507][304623] Updated weights for policy 0, policy_version 132800 (0.0005) [2023-03-08 02:48:35,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12801.7). Total num frames: 67993600. Throughput: 0: 12650.5. Samples: 67974068. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:48:35,769][304334] Avg episode reward: [(0, '4689.228')] [2023-03-08 02:48:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000132800_67993600.pth... [2023-03-08 02:48:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000132048_67608576.pth [2023-03-08 02:48:38,839][304623] Updated weights for policy 0, policy_version 132880 (0.0005) [2023-03-08 02:48:40,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12801.7). Total num frames: 68055040. Throughput: 0: 12696.1. Samples: 68048304. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:48:40,769][304334] Avg episode reward: [(0, '4712.031')] [2023-03-08 02:48:42,080][304623] Updated weights for policy 0, policy_version 132960 (0.0005) [2023-03-08 02:48:45,053][304623] Updated weights for policy 0, policy_version 133040 (0.0004) [2023-03-08 02:48:45,769][304334] Fps is (10 sec: 13107.3, 60 sec: 12697.6, 300 sec: 12829.5). Total num frames: 68124672. Throughput: 0: 12779.7. Samples: 68087824. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:48:45,769][304334] Avg episode reward: [(0, '4709.902')] [2023-03-08 02:48:48,068][304623] Updated weights for policy 0, policy_version 133120 (0.0004) [2023-03-08 02:48:50,769][304334] Fps is (10 sec: 13926.4, 60 sec: 12834.1, 300 sec: 12857.3). Total num frames: 68194304. Throughput: 0: 12945.6. Samples: 68169992. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:48:50,769][304334] Avg episode reward: [(0, '4707.516')] [2023-03-08 02:48:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000133192_68194304.pth... [2023-03-08 02:48:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000132440_67809280.pth [2023-03-08 02:48:50,977][304623] Updated weights for policy 0, policy_version 133200 (0.0003) [2023-03-08 02:48:53,994][304623] Updated weights for policy 0, policy_version 133280 (0.0004) [2023-03-08 02:48:55,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12970.7, 300 sec: 12843.4). Total num frames: 68259840. Throughput: 0: 12996.3. Samples: 68251720. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:48:55,769][304334] Avg episode reward: [(0, '4693.557')] [2023-03-08 02:48:57,286][304623] Updated weights for policy 0, policy_version 133360 (0.0004) [2023-03-08 02:49:00,349][304623] Updated weights for policy 0, policy_version 133440 (0.0004) [2023-03-08 02:49:00,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12970.6, 300 sec: 12829.5). Total num frames: 68325376. Throughput: 0: 12899.5. Samples: 68288964. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:49:00,769][304334] Avg episode reward: [(0, '4693.779')] [2023-03-08 02:49:03,390][304623] Updated weights for policy 0, policy_version 133520 (0.0004) [2023-03-08 02:49:05,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13107.2, 300 sec: 12829.5). Total num frames: 68395008. Throughput: 0: 12965.0. Samples: 68370432. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:49:05,769][304334] Avg episode reward: [(0, '4707.298')] [2023-03-08 02:49:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000133584_68395008.pth... [2023-03-08 02:49:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000132800_67993600.pth [2023-03-08 02:49:06,365][304623] Updated weights for policy 0, policy_version 133600 (0.0003) [2023-03-08 02:49:09,361][304623] Updated weights for policy 0, policy_version 133680 (0.0004) [2023-03-08 02:49:10,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13038.9, 300 sec: 12829.5). Total num frames: 68460544. Throughput: 0: 13119.2. Samples: 68452360. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:49:10,769][304334] Avg episode reward: [(0, '4699.825')] [2023-03-08 02:49:12,425][304623] Updated weights for policy 0, policy_version 133760 (0.0004) [2023-03-08 02:49:15,470][304623] Updated weights for policy 0, policy_version 133840 (0.0004) [2023-03-08 02:49:15,769][304334] Fps is (10 sec: 13107.3, 60 sec: 13038.9, 300 sec: 12829.5). Total num frames: 68526080. Throughput: 0: 13190.8. Samples: 68492976. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:49:15,769][304334] Avg episode reward: [(0, '4691.217')] [2023-03-08 02:49:18,442][304623] Updated weights for policy 0, policy_version 133920 (0.0004) [2023-03-08 02:49:20,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13175.5, 300 sec: 12829.5). Total num frames: 68595712. Throughput: 0: 13347.2. Samples: 68574692. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:49:20,769][304334] Avg episode reward: [(0, '4703.587')] [2023-03-08 02:49:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000133976_68595712.pth... [2023-03-08 02:49:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000133192_68194304.pth [2023-03-08 02:49:21,433][304623] Updated weights for policy 0, policy_version 134000 (0.0004) [2023-03-08 02:49:24,358][304623] Updated weights for policy 0, policy_version 134080 (0.0004) [2023-03-08 02:49:25,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13243.7, 300 sec: 12843.4). Total num frames: 68665344. Throughput: 0: 13531.4. Samples: 68657216. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:49:25,769][304334] Avg episode reward: [(0, '4702.988')] [2023-03-08 02:49:27,327][304623] Updated weights for policy 0, policy_version 134160 (0.0003) [2023-03-08 02:49:30,288][304623] Updated weights for policy 0, policy_version 134240 (0.0003) [2023-03-08 02:49:30,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13380.3, 300 sec: 12871.2). Total num frames: 68734976. Throughput: 0: 13567.9. Samples: 68698376. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:49:30,769][304334] Avg episode reward: [(0, '4691.755')] [2023-03-08 02:49:33,332][304623] Updated weights for policy 0, policy_version 134320 (0.0004) [2023-03-08 02:49:35,769][304334] Fps is (10 sec: 13926.2, 60 sec: 13516.8, 300 sec: 12898.9). Total num frames: 68804608. Throughput: 0: 13572.1. Samples: 68780736. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:49:35,769][304334] Avg episode reward: [(0, '4701.926')] [2023-03-08 02:49:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000134384_68804608.pth... [2023-03-08 02:49:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000133584_68395008.pth [2023-03-08 02:49:36,324][304623] Updated weights for policy 0, policy_version 134400 (0.0003) [2023-03-08 02:49:39,632][304623] Updated weights for policy 0, policy_version 134480 (0.0003) [2023-03-08 02:49:40,769][304334] Fps is (10 sec: 13107.1, 60 sec: 13516.8, 300 sec: 12885.0). Total num frames: 68866048. Throughput: 0: 13471.3. Samples: 68857928. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 02:49:40,769][304334] Avg episode reward: [(0, '4696.793')] [2023-03-08 02:49:42,935][304623] Updated weights for policy 0, policy_version 134560 (0.0005) [2023-03-08 02:49:45,769][304334] Fps is (10 sec: 12288.1, 60 sec: 13380.3, 300 sec: 12871.2). Total num frames: 68927488. Throughput: 0: 13463.1. Samples: 68894804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:49:45,769][304334] Avg episode reward: [(0, '4702.628')] [2023-03-08 02:49:46,289][304623] Updated weights for policy 0, policy_version 134640 (0.0005) [2023-03-08 02:49:49,615][304623] Updated weights for policy 0, policy_version 134720 (0.0005) [2023-03-08 02:49:50,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13243.7, 300 sec: 12843.4). Total num frames: 68988928. Throughput: 0: 13290.7. Samples: 68968512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:49:50,769][304334] Avg episode reward: [(0, '4705.697')] [2023-03-08 02:49:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000134744_68988928.pth... [2023-03-08 02:49:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000133976_68595712.pth [2023-03-08 02:49:52,927][304623] Updated weights for policy 0, policy_version 134800 (0.0005) [2023-03-08 02:49:55,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13243.8, 300 sec: 12843.4). Total num frames: 69054464. Throughput: 0: 13135.9. Samples: 69043476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:49:55,769][304334] Avg episode reward: [(0, '4701.051')] [2023-03-08 02:49:56,024][304623] Updated weights for policy 0, policy_version 134880 (0.0004) [2023-03-08 02:49:59,033][304623] Updated weights for policy 0, policy_version 134960 (0.0003) [2023-03-08 02:50:00,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13243.7, 300 sec: 12829.5). Total num frames: 69120000. Throughput: 0: 13175.2. Samples: 69085864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:50:00,769][304334] Avg episode reward: [(0, '4684.462')] [2023-03-08 02:50:01,945][304623] Updated weights for policy 0, policy_version 135040 (0.0004) [2023-03-08 02:50:04,854][304623] Updated weights for policy 0, policy_version 135120 (0.0003) [2023-03-08 02:50:05,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13312.0, 300 sec: 12857.3). Total num frames: 69193728. Throughput: 0: 13210.4. Samples: 69169160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:50:05,769][304334] Avg episode reward: [(0, '4688.754')] [2023-03-08 02:50:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000135144_69193728.pth... [2023-03-08 02:50:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000134384_68804608.pth [2023-03-08 02:50:07,780][304623] Updated weights for policy 0, policy_version 135200 (0.0003) [2023-03-08 02:50:10,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13243.7, 300 sec: 12843.4). Total num frames: 69255168. Throughput: 0: 13141.1. Samples: 69248568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:50:10,769][304334] Avg episode reward: [(0, '4704.323')] [2023-03-08 02:50:11,184][304623] Updated weights for policy 0, policy_version 135280 (0.0005) [2023-03-08 02:50:14,412][304623] Updated weights for policy 0, policy_version 135360 (0.0005) [2023-03-08 02:50:15,769][304334] Fps is (10 sec: 12697.5, 60 sec: 13243.7, 300 sec: 12857.3). Total num frames: 69320704. Throughput: 0: 13051.1. Samples: 69285680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:50:15,770][304334] Avg episode reward: [(0, '4668.786')] [2023-03-08 02:50:17,697][304623] Updated weights for policy 0, policy_version 135440 (0.0005) [2023-03-08 02:50:20,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13107.2, 300 sec: 12857.3). Total num frames: 69382144. Throughput: 0: 12904.0. Samples: 69361416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:50:20,769][304334] Avg episode reward: [(0, '4677.911')] [2023-03-08 02:50:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000135512_69382144.pth... [2023-03-08 02:50:20,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000134744_68988928.pth [2023-03-08 02:50:21,052][304623] Updated weights for policy 0, policy_version 135520 (0.0005) [2023-03-08 02:50:24,368][304623] Updated weights for policy 0, policy_version 135600 (0.0005) [2023-03-08 02:50:25,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12970.7, 300 sec: 12857.3). Total num frames: 69443584. Throughput: 0: 12825.5. Samples: 69435076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:50:25,769][304334] Avg episode reward: [(0, '4687.191')] [2023-03-08 02:50:27,715][304623] Updated weights for policy 0, policy_version 135680 (0.0005) [2023-03-08 02:50:30,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12834.1, 300 sec: 12857.3). Total num frames: 69505024. Throughput: 0: 12827.0. Samples: 69472020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:50:30,769][304334] Avg episode reward: [(0, '4694.459')] [2023-03-08 02:50:30,931][304623] Updated weights for policy 0, policy_version 135760 (0.0005) [2023-03-08 02:50:34,212][304623] Updated weights for policy 0, policy_version 135840 (0.0005) [2023-03-08 02:50:35,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12697.6, 300 sec: 12857.3). Total num frames: 69566464. Throughput: 0: 12850.4. Samples: 69546780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:50:35,769][304334] Avg episode reward: [(0, '4687.697')] [2023-03-08 02:50:35,828][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000135880_69570560.pth... [2023-03-08 02:50:35,830][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000135144_69193728.pth [2023-03-08 02:50:37,535][304623] Updated weights for policy 0, policy_version 135920 (0.0005) [2023-03-08 02:50:40,754][304623] Updated weights for policy 0, policy_version 136000 (0.0005) [2023-03-08 02:50:40,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12765.9, 300 sec: 12871.2). Total num frames: 69632000. Throughput: 0: 12853.5. Samples: 69621884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:50:40,769][304334] Avg episode reward: [(0, '4694.918')] [2023-03-08 02:50:44,056][304623] Updated weights for policy 0, policy_version 136080 (0.0005) [2023-03-08 02:50:45,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12765.9, 300 sec: 12871.2). Total num frames: 69693440. Throughput: 0: 12756.4. Samples: 69659900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:50:45,769][304334] Avg episode reward: [(0, '4613.694')] [2023-03-08 02:50:47,102][304623] Updated weights for policy 0, policy_version 136160 (0.0004) [2023-03-08 02:50:50,047][304623] Updated weights for policy 0, policy_version 136240 (0.0003) [2023-03-08 02:50:50,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12902.4, 300 sec: 12871.2). Total num frames: 69763072. Throughput: 0: 12675.9. Samples: 69739576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:50:50,769][304334] Avg episode reward: [(0, '4677.691')] [2023-03-08 02:50:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000136256_69763072.pth... [2023-03-08 02:50:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000135512_69382144.pth [2023-03-08 02:50:53,027][304623] Updated weights for policy 0, policy_version 136320 (0.0004) [2023-03-08 02:50:55,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12902.4, 300 sec: 12871.2). Total num frames: 69828608. Throughput: 0: 12707.7. Samples: 69820416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:50:55,769][304334] Avg episode reward: [(0, '4690.260')] [2023-03-08 02:50:56,334][304623] Updated weights for policy 0, policy_version 136400 (0.0005) [2023-03-08 02:50:59,546][304623] Updated weights for policy 0, policy_version 136480 (0.0004) [2023-03-08 02:51:00,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12834.1, 300 sec: 12857.3). Total num frames: 69890048. Throughput: 0: 12703.9. Samples: 69857352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:51:00,769][304334] Avg episode reward: [(0, '4695.862')] [2023-03-08 02:51:02,855][304623] Updated weights for policy 0, policy_version 136560 (0.0005) [2023-03-08 02:51:05,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12629.3, 300 sec: 12843.4). Total num frames: 69951488. Throughput: 0: 12674.0. Samples: 69931748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:51:05,769][304334] Avg episode reward: [(0, '4703.836')] [2023-03-08 02:51:05,774][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000136624_69951488.pth... [2023-03-08 02:51:05,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000135880_69570560.pth [2023-03-08 02:51:06,211][304623] Updated weights for policy 0, policy_version 136640 (0.0005) [2023-03-08 02:51:09,499][304623] Updated weights for policy 0, policy_version 136720 (0.0005) [2023-03-08 02:51:10,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12629.3, 300 sec: 12829.5). Total num frames: 70012928. Throughput: 0: 12703.0. Samples: 70006712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:51:10,780][304334] Avg episode reward: [(0, '4700.848')] [2023-03-08 02:51:12,746][304623] Updated weights for policy 0, policy_version 136800 (0.0005) [2023-03-08 02:51:15,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12629.4, 300 sec: 12815.6). Total num frames: 70078464. Throughput: 0: 12729.1. Samples: 70044828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:51:15,780][304334] Avg episode reward: [(0, '4693.054')] [2023-03-08 02:51:16,038][304623] Updated weights for policy 0, policy_version 136880 (0.0005) [2023-03-08 02:51:19,415][304623] Updated weights for policy 0, policy_version 136960 (0.0005) [2023-03-08 02:51:20,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12629.3, 300 sec: 12801.7). Total num frames: 70139904. Throughput: 0: 12705.5. Samples: 70118528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:51:20,780][304334] Avg episode reward: [(0, '4659.988')] [2023-03-08 02:51:20,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000136992_70139904.pth... [2023-03-08 02:51:20,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000136256_69763072.pth [2023-03-08 02:51:22,672][304623] Updated weights for policy 0, policy_version 137040 (0.0005) [2023-03-08 02:51:25,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12629.3, 300 sec: 12774.0). Total num frames: 70201344. Throughput: 0: 12696.2. Samples: 70193216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:51:25,780][304334] Avg episode reward: [(0, '4702.944')] [2023-03-08 02:51:25,934][304623] Updated weights for policy 0, policy_version 137120 (0.0005) [2023-03-08 02:51:29,247][304623] Updated weights for policy 0, policy_version 137200 (0.0005) [2023-03-08 02:51:30,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12629.3, 300 sec: 12760.1). Total num frames: 70262784. Throughput: 0: 12674.3. Samples: 70230244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:51:30,780][304334] Avg episode reward: [(0, '4713.207')] [2023-03-08 02:51:32,462][304623] Updated weights for policy 0, policy_version 137280 (0.0005) [2023-03-08 02:51:35,706][304623] Updated weights for policy 0, policy_version 137360 (0.0005) [2023-03-08 02:51:35,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 12774.0). Total num frames: 70328320. Throughput: 0: 12608.9. Samples: 70306976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:51:35,780][304334] Avg episode reward: [(0, '4711.152')] [2023-03-08 02:51:35,782][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000137360_70328320.pth... [2023-03-08 02:51:35,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000136624_69951488.pth [2023-03-08 02:51:39,106][304623] Updated weights for policy 0, policy_version 137440 (0.0005) [2023-03-08 02:51:40,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12629.3, 300 sec: 12787.8). Total num frames: 70389760. Throughput: 0: 12429.3. Samples: 70379732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:51:40,769][304334] Avg episode reward: [(0, '4712.179')] [2023-03-08 02:51:42,390][304623] Updated weights for policy 0, policy_version 137520 (0.0005) [2023-03-08 02:51:45,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12561.1, 300 sec: 12774.0). Total num frames: 70447104. Throughput: 0: 12460.4. Samples: 70418068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:51:45,769][304334] Avg episode reward: [(0, '4591.230')] [2023-03-08 02:51:45,788][304623] Updated weights for policy 0, policy_version 137600 (0.0005) [2023-03-08 02:51:49,095][304623] Updated weights for policy 0, policy_version 137680 (0.0005) [2023-03-08 02:51:50,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12787.8). Total num frames: 70512640. Throughput: 0: 12437.8. Samples: 70491448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:51:50,769][304334] Avg episode reward: [(0, '4678.659')] [2023-03-08 02:51:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000137720_70512640.pth... [2023-03-08 02:51:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000136992_70139904.pth [2023-03-08 02:51:52,338][304623] Updated weights for policy 0, policy_version 137760 (0.0005) [2023-03-08 02:51:55,681][304623] Updated weights for policy 0, policy_version 137840 (0.0005) [2023-03-08 02:51:55,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12424.5, 300 sec: 12787.8). Total num frames: 70574080. Throughput: 0: 12426.1. Samples: 70565888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:51:55,769][304334] Avg episode reward: [(0, '4701.170')] [2023-03-08 02:51:58,955][304623] Updated weights for policy 0, policy_version 137920 (0.0005) [2023-03-08 02:52:00,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12787.9). Total num frames: 70635520. Throughput: 0: 12398.5. Samples: 70602760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:52:00,769][304334] Avg episode reward: [(0, '4694.168')] [2023-03-08 02:52:02,258][304623] Updated weights for policy 0, policy_version 138000 (0.0005) [2023-03-08 02:52:05,610][304623] Updated weights for policy 0, policy_version 138080 (0.0005) [2023-03-08 02:52:05,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12787.8). Total num frames: 70696960. Throughput: 0: 12405.4. Samples: 70676772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:52:05,780][304334] Avg episode reward: [(0, '4668.624')] [2023-03-08 02:52:05,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000138080_70696960.pth... [2023-03-08 02:52:05,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000137360_70328320.pth [2023-03-08 02:52:08,875][304623] Updated weights for policy 0, policy_version 138160 (0.0004) [2023-03-08 02:52:10,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12424.5, 300 sec: 12787.9). Total num frames: 70758400. Throughput: 0: 12421.3. Samples: 70752172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:52:10,779][304334] Avg episode reward: [(0, '4696.046')] [2023-03-08 02:52:12,191][304623] Updated weights for policy 0, policy_version 138240 (0.0005) [2023-03-08 02:52:15,502][304623] Updated weights for policy 0, policy_version 138320 (0.0005) [2023-03-08 02:52:15,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 12787.9). Total num frames: 70819840. Throughput: 0: 12402.6. Samples: 70788360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:52:15,779][304334] Avg episode reward: [(0, '4705.260')] [2023-03-08 02:52:18,875][304623] Updated weights for policy 0, policy_version 138400 (0.0005) [2023-03-08 02:52:20,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12356.3, 300 sec: 12774.0). Total num frames: 70881280. Throughput: 0: 12332.8. Samples: 70861952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:52:20,780][304334] Avg episode reward: [(0, '4688.314')] [2023-03-08 02:52:20,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000138440_70881280.pth... [2023-03-08 02:52:20,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000137720_70512640.pth [2023-03-08 02:52:22,208][304623] Updated weights for policy 0, policy_version 138480 (0.0005) [2023-03-08 02:52:25,568][304623] Updated weights for policy 0, policy_version 138560 (0.0005) [2023-03-08 02:52:25,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12760.1). Total num frames: 70942720. Throughput: 0: 12344.4. Samples: 70935228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:52:25,780][304334] Avg episode reward: [(0, '4697.626')] [2023-03-08 02:52:28,732][304623] Updated weights for policy 0, policy_version 138640 (0.0004) [2023-03-08 02:52:30,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12492.8, 300 sec: 12787.9). Total num frames: 71012352. Throughput: 0: 12346.8. Samples: 70973676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:52:30,780][304334] Avg episode reward: [(0, '4696.722')] [2023-03-08 02:52:31,600][304623] Updated weights for policy 0, policy_version 138720 (0.0003) [2023-03-08 02:52:34,530][304623] Updated weights for policy 0, policy_version 138800 (0.0003) [2023-03-08 02:52:35,769][304334] Fps is (10 sec: 13926.3, 60 sec: 12561.1, 300 sec: 12815.6). Total num frames: 71081984. Throughput: 0: 12578.5. Samples: 71057480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:52:35,780][304334] Avg episode reward: [(0, '4710.413')] [2023-03-08 02:52:35,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000138832_71081984.pth... [2023-03-08 02:52:35,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000138080_70696960.pth [2023-03-08 02:52:37,476][304623] Updated weights for policy 0, policy_version 138880 (0.0003) [2023-03-08 02:52:40,446][304623] Updated weights for policy 0, policy_version 138960 (0.0004) [2023-03-08 02:52:40,769][304334] Fps is (10 sec: 13926.4, 60 sec: 12697.6, 300 sec: 12843.4). Total num frames: 71151616. Throughput: 0: 12778.7. Samples: 71140928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:52:40,780][304334] Avg episode reward: [(0, '4711.028')] [2023-03-08 02:52:43,389][304623] Updated weights for policy 0, policy_version 139040 (0.0004) [2023-03-08 02:52:45,769][304334] Fps is (10 sec: 13516.9, 60 sec: 12834.1, 300 sec: 12857.3). Total num frames: 71217152. Throughput: 0: 12880.7. Samples: 71182392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:52:45,780][304334] Avg episode reward: [(0, '4713.544')] [2023-03-08 02:52:46,352][304623] Updated weights for policy 0, policy_version 139120 (0.0003) [2023-03-08 02:52:49,465][304623] Updated weights for policy 0, policy_version 139200 (0.0004) [2023-03-08 02:52:50,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12834.1, 300 sec: 12885.0). Total num frames: 71282688. Throughput: 0: 13043.1. Samples: 71263712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:52:50,780][304334] Avg episode reward: [(0, '4713.534')] [2023-03-08 02:52:50,845][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000139232_71286784.pth... [2023-03-08 02:52:50,847][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000138440_70881280.pth [2023-03-08 02:52:52,794][304623] Updated weights for policy 0, policy_version 139280 (0.0005) [2023-03-08 02:52:55,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12902.4, 300 sec: 12885.0). Total num frames: 71348224. Throughput: 0: 13040.7. Samples: 71339004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:52:55,769][304334] Avg episode reward: [(0, '4716.367')] [2023-03-08 02:52:56,089][304623] Updated weights for policy 0, policy_version 139360 (0.0005) [2023-03-08 02:52:59,424][304623] Updated weights for policy 0, policy_version 139440 (0.0005) [2023-03-08 02:53:00,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12902.4, 300 sec: 12885.0). Total num frames: 71409664. Throughput: 0: 13051.4. Samples: 71375676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:53:00,769][304334] Avg episode reward: [(0, '4719.973')] [2023-03-08 02:53:02,604][304623] Updated weights for policy 0, policy_version 139520 (0.0004) [2023-03-08 02:53:05,769][304623] Updated weights for policy 0, policy_version 139600 (0.0005) [2023-03-08 02:53:05,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12970.7, 300 sec: 12871.2). Total num frames: 71475200. Throughput: 0: 13105.9. Samples: 71451716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:53:05,769][304334] Avg episode reward: [(0, '4687.004')] [2023-03-08 02:53:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000139600_71475200.pth... [2023-03-08 02:53:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000138832_71081984.pth [2023-03-08 02:53:09,075][304623] Updated weights for policy 0, policy_version 139680 (0.0005) [2023-03-08 02:53:10,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12970.6, 300 sec: 12857.3). Total num frames: 71536640. Throughput: 0: 13160.9. Samples: 71527472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:53:10,769][304334] Avg episode reward: [(0, '4709.791')] [2023-03-08 02:53:12,398][304623] Updated weights for policy 0, policy_version 139760 (0.0005) [2023-03-08 02:53:15,646][304623] Updated weights for policy 0, policy_version 139840 (0.0005) [2023-03-08 02:53:15,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12970.6, 300 sec: 12857.3). Total num frames: 71598080. Throughput: 0: 13138.3. Samples: 71564900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:53:15,780][304334] Avg episode reward: [(0, '4704.912')] [2023-03-08 02:53:18,782][304623] Updated weights for policy 0, policy_version 139920 (0.0004) [2023-03-08 02:53:20,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12970.7, 300 sec: 12843.4). Total num frames: 71659520. Throughput: 0: 12981.2. Samples: 71641636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:53:20,769][304334] Avg episode reward: [(0, '4690.631')] [2023-03-08 02:53:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000139968_71663616.pth... [2023-03-08 02:53:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000139232_71286784.pth [2023-03-08 02:53:22,067][304623] Updated weights for policy 0, policy_version 140000 (0.0005) [2023-03-08 02:53:25,339][304623] Updated weights for policy 0, policy_version 140080 (0.0005) [2023-03-08 02:53:25,769][304334] Fps is (10 sec: 12697.7, 60 sec: 13038.9, 300 sec: 12857.3). Total num frames: 71725056. Throughput: 0: 12798.8. Samples: 71716872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:53:25,780][304334] Avg episode reward: [(0, '4592.940')] [2023-03-08 02:53:28,668][304623] Updated weights for policy 0, policy_version 140160 (0.0005) [2023-03-08 02:53:30,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12902.4, 300 sec: 12857.3). Total num frames: 71786496. Throughput: 0: 12696.5. Samples: 71753736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:53:30,780][304334] Avg episode reward: [(0, '4696.335')] [2023-03-08 02:53:32,006][304623] Updated weights for policy 0, policy_version 140240 (0.0005) [2023-03-08 02:53:35,401][304623] Updated weights for policy 0, policy_version 140320 (0.0005) [2023-03-08 02:53:35,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12765.9, 300 sec: 12857.3). Total num frames: 71847936. Throughput: 0: 12524.6. Samples: 71827320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:53:35,780][304334] Avg episode reward: [(0, '4682.571')] [2023-03-08 02:53:35,784][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000140328_71847936.pth... [2023-03-08 02:53:35,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000139600_71475200.pth [2023-03-08 02:53:38,659][304623] Updated weights for policy 0, policy_version 140400 (0.0005) [2023-03-08 02:53:40,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12629.3, 300 sec: 12829.5). Total num frames: 71909376. Throughput: 0: 12493.1. Samples: 71901192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:53:40,780][304334] Avg episode reward: [(0, '4671.808')] [2023-03-08 02:53:41,984][304623] Updated weights for policy 0, policy_version 140480 (0.0005) [2023-03-08 02:53:45,347][304623] Updated weights for policy 0, policy_version 140560 (0.0005) [2023-03-08 02:53:45,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12801.7). Total num frames: 71970816. Throughput: 0: 12497.3. Samples: 71938056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:53:45,780][304334] Avg episode reward: [(0, '4683.228')] [2023-03-08 02:53:48,594][304623] Updated weights for policy 0, policy_version 140640 (0.0005) [2023-03-08 02:53:50,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12787.9). Total num frames: 72032256. Throughput: 0: 12458.5. Samples: 72012348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:53:50,780][304334] Avg episode reward: [(0, '4674.188')] [2023-03-08 02:53:50,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000140688_72032256.pth... [2023-03-08 02:53:50,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000139968_71663616.pth [2023-03-08 02:53:51,823][304623] Updated weights for policy 0, policy_version 140720 (0.0005) [2023-03-08 02:53:55,092][304623] Updated weights for policy 0, policy_version 140800 (0.0005) [2023-03-08 02:53:55,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12492.8, 300 sec: 12787.9). Total num frames: 72097792. Throughput: 0: 12468.7. Samples: 72088560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:53:55,780][304334] Avg episode reward: [(0, '4699.888')] [2023-03-08 02:53:58,424][304623] Updated weights for policy 0, policy_version 140880 (0.0005) [2023-03-08 02:54:00,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12760.1). Total num frames: 72159232. Throughput: 0: 12454.3. Samples: 72125344. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:54:00,780][304334] Avg episode reward: [(0, '4711.694')] [2023-03-08 02:54:01,658][304623] Updated weights for policy 0, policy_version 140960 (0.0005) [2023-03-08 02:54:04,939][304623] Updated weights for policy 0, policy_version 141040 (0.0005) [2023-03-08 02:54:05,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 12746.2). Total num frames: 72220672. Throughput: 0: 12414.0. Samples: 72200264. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:54:05,780][304334] Avg episode reward: [(0, '4698.883')] [2023-03-08 02:54:05,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000141056_72220672.pth... [2023-03-08 02:54:05,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000140328_71847936.pth [2023-03-08 02:54:08,238][304623] Updated weights for policy 0, policy_version 141120 (0.0005) [2023-03-08 02:54:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12746.2). Total num frames: 72286208. Throughput: 0: 12458.0. Samples: 72277484. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:54:10,769][304334] Avg episode reward: [(0, '4678.259')] [2023-03-08 02:54:11,239][304623] Updated weights for policy 0, policy_version 141200 (0.0003) [2023-03-08 02:54:14,236][304623] Updated weights for policy 0, policy_version 141280 (0.0003) [2023-03-08 02:54:15,769][304334] Fps is (10 sec: 13516.9, 60 sec: 12629.3, 300 sec: 12746.2). Total num frames: 72355840. Throughput: 0: 12544.8. Samples: 72318252. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:54:15,769][304334] Avg episode reward: [(0, '4706.437')] [2023-03-08 02:54:17,290][304623] Updated weights for policy 0, policy_version 141360 (0.0004) [2023-03-08 02:54:20,280][304623] Updated weights for policy 0, policy_version 141440 (0.0004) [2023-03-08 02:54:20,769][304334] Fps is (10 sec: 13516.7, 60 sec: 12697.6, 300 sec: 12732.3). Total num frames: 72421376. Throughput: 0: 12710.6. Samples: 72399296. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:54:20,769][304334] Avg episode reward: [(0, '4702.591')] [2023-03-08 02:54:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000141448_72421376.pth... [2023-03-08 02:54:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000140688_72032256.pth [2023-03-08 02:54:23,247][304623] Updated weights for policy 0, policy_version 141520 (0.0004) [2023-03-08 02:54:25,769][304334] Fps is (10 sec: 13516.9, 60 sec: 12765.9, 300 sec: 12732.3). Total num frames: 72491008. Throughput: 0: 12925.3. Samples: 72482828. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:54:25,769][304334] Avg episode reward: [(0, '4685.576')] [2023-03-08 02:54:26,221][304623] Updated weights for policy 0, policy_version 141600 (0.0003) [2023-03-08 02:54:29,226][304623] Updated weights for policy 0, policy_version 141680 (0.0003) [2023-03-08 02:54:30,769][304334] Fps is (10 sec: 13926.5, 60 sec: 12902.4, 300 sec: 12732.3). Total num frames: 72560640. Throughput: 0: 13011.5. Samples: 72523572. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:54:30,769][304334] Avg episode reward: [(0, '4664.537')] [2023-03-08 02:54:32,126][304623] Updated weights for policy 0, policy_version 141760 (0.0003) [2023-03-08 02:54:35,231][304623] Updated weights for policy 0, policy_version 141840 (0.0003) [2023-03-08 02:54:35,769][304334] Fps is (10 sec: 13516.7, 60 sec: 12970.7, 300 sec: 12746.2). Total num frames: 72626176. Throughput: 0: 13182.7. Samples: 72605572. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:54:35,769][304334] Avg episode reward: [(0, '4682.096')] [2023-03-08 02:54:35,797][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000141856_72630272.pth... [2023-03-08 02:54:35,800][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000141056_72220672.pth [2023-03-08 02:54:38,207][304623] Updated weights for policy 0, policy_version 141920 (0.0003) [2023-03-08 02:54:40,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13107.2, 300 sec: 12774.0). Total num frames: 72695808. Throughput: 0: 13312.5. Samples: 72687624. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:54:40,769][304334] Avg episode reward: [(0, '4708.996')] [2023-03-08 02:54:41,140][304623] Updated weights for policy 0, policy_version 142000 (0.0003) [2023-03-08 02:54:44,191][304623] Updated weights for policy 0, policy_version 142080 (0.0003) [2023-03-08 02:54:45,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13175.5, 300 sec: 12787.9). Total num frames: 72761344. Throughput: 0: 13406.8. Samples: 72728648. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:54:45,769][304334] Avg episode reward: [(0, '4702.320')] [2023-03-08 02:54:47,362][304623] Updated weights for policy 0, policy_version 142160 (0.0005) [2023-03-08 02:54:50,714][304623] Updated weights for policy 0, policy_version 142240 (0.0005) [2023-03-08 02:54:50,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13243.7, 300 sec: 12787.8). Total num frames: 72826880. Throughput: 0: 13469.4. Samples: 72806388. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:54:50,769][304334] Avg episode reward: [(0, '4715.342')] [2023-03-08 02:54:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000142240_72826880.pth... [2023-03-08 02:54:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000141448_72421376.pth [2023-03-08 02:54:54,007][304623] Updated weights for policy 0, policy_version 142320 (0.0005) [2023-03-08 02:54:55,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13175.5, 300 sec: 12774.0). Total num frames: 72888320. Throughput: 0: 13392.1. Samples: 72880128. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 02:54:55,769][304334] Avg episode reward: [(0, '4693.681')] [2023-03-08 02:54:57,342][304623] Updated weights for policy 0, policy_version 142400 (0.0005) [2023-03-08 02:55:00,692][304623] Updated weights for policy 0, policy_version 142480 (0.0005) [2023-03-08 02:55:00,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13175.5, 300 sec: 12732.3). Total num frames: 72949760. Throughput: 0: 13305.3. Samples: 72916992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:55:00,769][304334] Avg episode reward: [(0, '4696.442')] [2023-03-08 02:55:04,083][304623] Updated weights for policy 0, policy_version 142560 (0.0005) [2023-03-08 02:55:05,769][304334] Fps is (10 sec: 12288.1, 60 sec: 13175.5, 300 sec: 12732.3). Total num frames: 73011200. Throughput: 0: 13114.4. Samples: 72989444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:55:05,769][304334] Avg episode reward: [(0, '4698.472')] [2023-03-08 02:55:05,771][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000142600_73011200.pth... [2023-03-08 02:55:05,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000141856_72630272.pth [2023-03-08 02:55:07,330][304623] Updated weights for policy 0, policy_version 142640 (0.0005) [2023-03-08 02:55:10,309][304623] Updated weights for policy 0, policy_version 142720 (0.0003) [2023-03-08 02:55:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13175.5, 300 sec: 12732.3). Total num frames: 73076736. Throughput: 0: 13000.9. Samples: 73067868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:55:10,769][304334] Avg episode reward: [(0, '4712.043')] [2023-03-08 02:55:13,288][304623] Updated weights for policy 0, policy_version 142800 (0.0003) [2023-03-08 02:55:15,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13175.5, 300 sec: 12760.1). Total num frames: 73146368. Throughput: 0: 13022.1. Samples: 73109568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:55:15,769][304334] Avg episode reward: [(0, '4683.097')] [2023-03-08 02:55:16,226][304623] Updated weights for policy 0, policy_version 142880 (0.0003) [2023-03-08 02:55:19,267][304623] Updated weights for policy 0, policy_version 142960 (0.0003) [2023-03-08 02:55:20,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13243.7, 300 sec: 12787.8). Total num frames: 73216000. Throughput: 0: 13020.5. Samples: 73191496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:55:20,769][304334] Avg episode reward: [(0, '4711.191')] [2023-03-08 02:55:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000143000_73216000.pth... [2023-03-08 02:55:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000142240_72826880.pth [2023-03-08 02:55:22,181][304623] Updated weights for policy 0, policy_version 143040 (0.0003) [2023-03-08 02:55:25,436][304623] Updated weights for policy 0, policy_version 143120 (0.0005) [2023-03-08 02:55:25,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13107.2, 300 sec: 12787.8). Total num frames: 73277440. Throughput: 0: 12980.0. Samples: 73271724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:55:25,769][304334] Avg episode reward: [(0, '4713.125')] [2023-03-08 02:55:28,799][304623] Updated weights for policy 0, policy_version 143200 (0.0005) [2023-03-08 02:55:30,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12970.7, 300 sec: 12787.8). Total num frames: 73338880. Throughput: 0: 12895.2. Samples: 73308932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:55:30,769][304334] Avg episode reward: [(0, '4708.078')] [2023-03-08 02:55:32,122][304623] Updated weights for policy 0, policy_version 143280 (0.0005) [2023-03-08 02:55:35,511][304623] Updated weights for policy 0, policy_version 143360 (0.0005) [2023-03-08 02:55:35,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12902.4, 300 sec: 12774.0). Total num frames: 73400320. Throughput: 0: 12800.9. Samples: 73382428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:55:35,769][304334] Avg episode reward: [(0, '4715.735')] [2023-03-08 02:55:35,827][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000143368_73404416.pth... [2023-03-08 02:55:35,829][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000142600_73011200.pth [2023-03-08 02:55:38,796][304623] Updated weights for policy 0, policy_version 143440 (0.0005) [2023-03-08 02:55:40,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12834.1, 300 sec: 12787.9). Total num frames: 73465856. Throughput: 0: 12807.6. Samples: 73456472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:55:40,769][304334] Avg episode reward: [(0, '4701.779')] [2023-03-08 02:55:42,068][304623] Updated weights for policy 0, policy_version 143520 (0.0005) [2023-03-08 02:55:45,342][304623] Updated weights for policy 0, policy_version 143600 (0.0005) [2023-03-08 02:55:45,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12765.9, 300 sec: 12760.1). Total num frames: 73527296. Throughput: 0: 12834.1. Samples: 73494528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:55:45,769][304334] Avg episode reward: [(0, '4707.892')] [2023-03-08 02:55:48,622][304623] Updated weights for policy 0, policy_version 143680 (0.0005) [2023-03-08 02:55:50,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12697.6, 300 sec: 12746.2). Total num frames: 73588736. Throughput: 0: 12863.9. Samples: 73568320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:55:50,769][304334] Avg episode reward: [(0, '4711.099')] [2023-03-08 02:55:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000143728_73588736.pth... [2023-03-08 02:55:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000143000_73216000.pth [2023-03-08 02:55:51,981][304623] Updated weights for policy 0, policy_version 143760 (0.0005) [2023-03-08 02:55:55,334][304623] Updated weights for policy 0, policy_version 143840 (0.0005) [2023-03-08 02:55:55,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12697.6, 300 sec: 12746.2). Total num frames: 73650176. Throughput: 0: 12758.0. Samples: 73641976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:55:55,769][304334] Avg episode reward: [(0, '4710.784')] [2023-03-08 02:55:58,626][304623] Updated weights for policy 0, policy_version 143920 (0.0005) [2023-03-08 02:56:00,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12697.6, 300 sec: 12746.2). Total num frames: 73711616. Throughput: 0: 12652.1. Samples: 73678912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:56:00,769][304334] Avg episode reward: [(0, '4697.398')] [2023-03-08 02:56:01,934][304623] Updated weights for policy 0, policy_version 144000 (0.0005) [2023-03-08 02:56:05,291][304623] Updated weights for policy 0, policy_version 144080 (0.0005) [2023-03-08 02:56:05,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12697.6, 300 sec: 12746.2). Total num frames: 73773056. Throughput: 0: 12470.1. Samples: 73752648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:56:05,769][304334] Avg episode reward: [(0, '4701.897')] [2023-03-08 02:56:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000144088_73773056.pth... [2023-03-08 02:56:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000143368_73404416.pth [2023-03-08 02:56:08,672][304623] Updated weights for policy 0, policy_version 144160 (0.0005) [2023-03-08 02:56:10,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12629.3, 300 sec: 12732.3). Total num frames: 73834496. Throughput: 0: 12325.4. Samples: 73826368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:56:10,769][304334] Avg episode reward: [(0, '4677.813')] [2023-03-08 02:56:11,928][304623] Updated weights for policy 0, policy_version 144240 (0.0005) [2023-03-08 02:56:15,223][304623] Updated weights for policy 0, policy_version 144320 (0.0005) [2023-03-08 02:56:15,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12492.8, 300 sec: 12732.3). Total num frames: 73895936. Throughput: 0: 12332.7. Samples: 73863904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:56:15,769][304334] Avg episode reward: [(0, '4712.364')] [2023-03-08 02:56:18,568][304623] Updated weights for policy 0, policy_version 144400 (0.0005) [2023-03-08 02:56:20,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12424.5, 300 sec: 12746.2). Total num frames: 73961472. Throughput: 0: 12345.8. Samples: 73937988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:56:20,769][304334] Avg episode reward: [(0, '4671.909')] [2023-03-08 02:56:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000144456_73961472.pth... [2023-03-08 02:56:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000143728_73588736.pth [2023-03-08 02:56:21,661][304623] Updated weights for policy 0, policy_version 144480 (0.0004) [2023-03-08 02:56:24,655][304623] Updated weights for policy 0, policy_version 144560 (0.0003) [2023-03-08 02:56:25,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12492.8, 300 sec: 12760.1). Total num frames: 74027008. Throughput: 0: 12498.0. Samples: 74018880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:56:25,769][304334] Avg episode reward: [(0, '4687.004')] [2023-03-08 02:56:27,704][304623] Updated weights for policy 0, policy_version 144640 (0.0003) [2023-03-08 02:56:30,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12561.1, 300 sec: 12760.1). Total num frames: 74092544. Throughput: 0: 12558.4. Samples: 74059656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:56:30,769][304334] Avg episode reward: [(0, '4677.662')] [2023-03-08 02:56:30,813][304623] Updated weights for policy 0, policy_version 144720 (0.0003) [2023-03-08 02:56:33,981][304623] Updated weights for policy 0, policy_version 144800 (0.0004) [2023-03-08 02:56:35,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12629.3, 300 sec: 12774.0). Total num frames: 74158080. Throughput: 0: 12652.1. Samples: 74137664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:56:35,769][304334] Avg episode reward: [(0, '4679.778')] [2023-03-08 02:56:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000144840_74158080.pth... [2023-03-08 02:56:35,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000144088_73773056.pth [2023-03-08 02:56:37,006][304623] Updated weights for policy 0, policy_version 144880 (0.0003) [2023-03-08 02:56:40,051][304623] Updated weights for policy 0, policy_version 144960 (0.0003) [2023-03-08 02:56:40,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12697.6, 300 sec: 12815.6). Total num frames: 74227712. Throughput: 0: 12827.5. Samples: 74219216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:56:40,769][304334] Avg episode reward: [(0, '4659.119')] [2023-03-08 02:56:42,951][304623] Updated weights for policy 0, policy_version 145040 (0.0003) [2023-03-08 02:56:45,769][304334] Fps is (10 sec: 13926.5, 60 sec: 12834.1, 300 sec: 12829.5). Total num frames: 74297344. Throughput: 0: 12925.3. Samples: 74260552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:56:45,769][304334] Avg episode reward: [(0, '4703.698')] [2023-03-08 02:56:45,993][304623] Updated weights for policy 0, policy_version 145120 (0.0003) [2023-03-08 02:56:48,972][304623] Updated weights for policy 0, policy_version 145200 (0.0003) [2023-03-08 02:56:50,769][304334] Fps is (10 sec: 13926.3, 60 sec: 12970.7, 300 sec: 12857.3). Total num frames: 74366976. Throughput: 0: 13107.0. Samples: 74342464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:56:50,769][304334] Avg episode reward: [(0, '4674.457')] [2023-03-08 02:56:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000145248_74366976.pth... [2023-03-08 02:56:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000144456_73961472.pth [2023-03-08 02:56:52,039][304623] Updated weights for policy 0, policy_version 145280 (0.0004) [2023-03-08 02:56:55,391][304623] Updated weights for policy 0, policy_version 145360 (0.0005) [2023-03-08 02:56:55,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12970.7, 300 sec: 12857.3). Total num frames: 74428416. Throughput: 0: 13185.9. Samples: 74419732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:56:55,769][304334] Avg episode reward: [(0, '4665.256')] [2023-03-08 02:56:58,428][304623] Updated weights for policy 0, policy_version 145440 (0.0004) [2023-03-08 02:57:00,769][304334] Fps is (10 sec: 13107.3, 60 sec: 13107.2, 300 sec: 12885.0). Total num frames: 74498048. Throughput: 0: 13213.7. Samples: 74458520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:57:00,769][304334] Avg episode reward: [(0, '4665.922')] [2023-03-08 02:57:01,349][304623] Updated weights for policy 0, policy_version 145520 (0.0003) [2023-03-08 02:57:04,205][304623] Updated weights for policy 0, policy_version 145600 (0.0003) [2023-03-08 02:57:05,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13243.7, 300 sec: 12912.8). Total num frames: 74567680. Throughput: 0: 13453.7. Samples: 74543404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:57:05,769][304334] Avg episode reward: [(0, '4607.794')] [2023-03-08 02:57:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000145640_74567680.pth... [2023-03-08 02:57:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000144840_74158080.pth [2023-03-08 02:57:07,108][304623] Updated weights for policy 0, policy_version 145680 (0.0003) [2023-03-08 02:57:10,027][304623] Updated weights for policy 0, policy_version 145760 (0.0003) [2023-03-08 02:57:10,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13380.3, 300 sec: 12940.6). Total num frames: 74637312. Throughput: 0: 13544.2. Samples: 74628368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:57:10,769][304334] Avg episode reward: [(0, '4688.457')] [2023-03-08 02:57:12,981][304623] Updated weights for policy 0, policy_version 145840 (0.0003) [2023-03-08 02:57:15,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13516.8, 300 sec: 12968.4). Total num frames: 74706944. Throughput: 0: 13565.2. Samples: 74670088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:57:15,769][304334] Avg episode reward: [(0, '4713.903')] [2023-03-08 02:57:15,894][304623] Updated weights for policy 0, policy_version 145920 (0.0003) [2023-03-08 02:57:18,800][304623] Updated weights for policy 0, policy_version 146000 (0.0003) [2023-03-08 02:57:20,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13585.1, 300 sec: 12996.1). Total num frames: 74776576. Throughput: 0: 13707.8. Samples: 74754516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:57:20,769][304334] Avg episode reward: [(0, '4701.779')] [2023-03-08 02:57:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000146048_74776576.pth... [2023-03-08 02:57:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000145248_74366976.pth [2023-03-08 02:57:21,844][304623] Updated weights for policy 0, policy_version 146080 (0.0003) [2023-03-08 02:57:24,863][304623] Updated weights for policy 0, policy_version 146160 (0.0003) [2023-03-08 02:57:25,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13653.3, 300 sec: 12996.1). Total num frames: 74846208. Throughput: 0: 13691.0. Samples: 74835312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:57:25,769][304334] Avg episode reward: [(0, '4708.344')] [2023-03-08 02:57:27,811][304623] Updated weights for policy 0, policy_version 146240 (0.0003) [2023-03-08 02:57:30,759][304623] Updated weights for policy 0, policy_version 146320 (0.0003) [2023-03-08 02:57:30,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13721.6, 300 sec: 12996.1). Total num frames: 74915840. Throughput: 0: 13697.6. Samples: 74876944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:57:30,769][304334] Avg episode reward: [(0, '4704.521')] [2023-03-08 02:57:33,634][304623] Updated weights for policy 0, policy_version 146400 (0.0003) [2023-03-08 02:57:35,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 12996.1). Total num frames: 74985472. Throughput: 0: 13752.1. Samples: 74961308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:57:35,769][304334] Avg episode reward: [(0, '4699.203')] [2023-03-08 02:57:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000146456_74985472.pth... [2023-03-08 02:57:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000145640_74567680.pth [2023-03-08 02:57:36,573][304623] Updated weights for policy 0, policy_version 146480 (0.0003) [2023-03-08 02:57:39,493][304623] Updated weights for policy 0, policy_version 146560 (0.0003) [2023-03-08 02:57:40,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13010.0). Total num frames: 75055104. Throughput: 0: 13895.9. Samples: 75045048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:57:40,769][304334] Avg episode reward: [(0, '4707.492')] [2023-03-08 02:57:42,430][304623] Updated weights for policy 0, policy_version 146640 (0.0003) [2023-03-08 02:57:45,411][304623] Updated weights for policy 0, policy_version 146720 (0.0003) [2023-03-08 02:57:45,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13023.9). Total num frames: 75124736. Throughput: 0: 13981.3. Samples: 75087680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:57:45,769][304334] Avg episode reward: [(0, '4700.398')] [2023-03-08 02:57:48,445][304623] Updated weights for policy 0, policy_version 146800 (0.0003) [2023-03-08 02:57:50,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13721.6, 300 sec: 13023.9). Total num frames: 75190272. Throughput: 0: 13899.8. Samples: 75168896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:57:50,769][304334] Avg episode reward: [(0, '4711.783')] [2023-03-08 02:57:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000146856_75190272.pth... [2023-03-08 02:57:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000146048_74776576.pth [2023-03-08 02:57:51,451][304623] Updated weights for policy 0, policy_version 146880 (0.0003) [2023-03-08 02:57:54,413][304623] Updated weights for policy 0, policy_version 146960 (0.0003) [2023-03-08 02:57:55,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13858.1, 300 sec: 13051.7). Total num frames: 75259904. Throughput: 0: 13845.5. Samples: 75251416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:57:55,786][304334] Avg episode reward: [(0, '4706.946')] [2023-03-08 02:57:57,309][304623] Updated weights for policy 0, policy_version 147040 (0.0003) [2023-03-08 02:58:00,610][304623] Updated weights for policy 0, policy_version 147120 (0.0005) [2023-03-08 02:58:00,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13789.9, 300 sec: 13051.7). Total num frames: 75325440. Throughput: 0: 13838.8. Samples: 75292832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:58:00,780][304334] Avg episode reward: [(0, '4708.060')] [2023-03-08 02:58:03,881][304623] Updated weights for policy 0, policy_version 147200 (0.0005) [2023-03-08 02:58:05,769][304334] Fps is (10 sec: 12697.5, 60 sec: 13653.3, 300 sec: 13051.7). Total num frames: 75386880. Throughput: 0: 13620.5. Samples: 75367436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:58:05,780][304334] Avg episode reward: [(0, '4672.239')] [2023-03-08 02:58:05,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000147240_75386880.pth... [2023-03-08 02:58:05,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000146456_74985472.pth [2023-03-08 02:58:07,222][304623] Updated weights for policy 0, policy_version 147280 (0.0005) [2023-03-08 02:58:10,554][304623] Updated weights for policy 0, policy_version 147360 (0.0005) [2023-03-08 02:58:10,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13516.8, 300 sec: 13051.7). Total num frames: 75448320. Throughput: 0: 13462.8. Samples: 75441136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:58:10,780][304334] Avg episode reward: [(0, '4678.662')] [2023-03-08 02:58:13,851][304623] Updated weights for policy 0, policy_version 147440 (0.0005) [2023-03-08 02:58:15,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13380.3, 300 sec: 13051.7). Total num frames: 75509760. Throughput: 0: 13361.3. Samples: 75478200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:58:15,780][304334] Avg episode reward: [(0, '4710.744')] [2023-03-08 02:58:17,194][304623] Updated weights for policy 0, policy_version 147520 (0.0005) [2023-03-08 02:58:20,504][304623] Updated weights for policy 0, policy_version 147600 (0.0005) [2023-03-08 02:58:20,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13243.8, 300 sec: 13037.8). Total num frames: 75571200. Throughput: 0: 13123.1. Samples: 75551844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:58:20,780][304334] Avg episode reward: [(0, '4691.985')] [2023-03-08 02:58:20,841][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000147608_75575296.pth... [2023-03-08 02:58:20,844][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000146856_75190272.pth [2023-03-08 02:58:23,890][304623] Updated weights for policy 0, policy_version 147680 (0.0005) [2023-03-08 02:58:25,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13107.2, 300 sec: 13037.8). Total num frames: 75632640. Throughput: 0: 12904.1. Samples: 75625732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:58:25,780][304334] Avg episode reward: [(0, '4691.522')] [2023-03-08 02:58:27,095][304623] Updated weights for policy 0, policy_version 147760 (0.0005) [2023-03-08 02:58:30,344][304623] Updated weights for policy 0, policy_version 147840 (0.0005) [2023-03-08 02:58:30,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13038.9, 300 sec: 13051.7). Total num frames: 75698176. Throughput: 0: 12802.9. Samples: 75663808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:58:30,780][304334] Avg episode reward: [(0, '4680.203')] [2023-03-08 02:58:33,526][304623] Updated weights for policy 0, policy_version 147920 (0.0005) [2023-03-08 02:58:35,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12902.4, 300 sec: 13051.7). Total num frames: 75759616. Throughput: 0: 12709.0. Samples: 75740800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:58:35,780][304334] Avg episode reward: [(0, '4708.276')] [2023-03-08 02:58:35,844][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000147976_75763712.pth... [2023-03-08 02:58:35,845][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000147240_75386880.pth [2023-03-08 02:58:36,791][304623] Updated weights for policy 0, policy_version 148000 (0.0005) [2023-03-08 02:58:39,977][304623] Updated weights for policy 0, policy_version 148080 (0.0005) [2023-03-08 02:58:40,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12834.1, 300 sec: 13065.5). Total num frames: 75825152. Throughput: 0: 12569.0. Samples: 75817024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:58:40,780][304334] Avg episode reward: [(0, '4687.428')] [2023-03-08 02:58:43,258][304623] Updated weights for policy 0, policy_version 148160 (0.0004) [2023-03-08 02:58:45,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 13065.5). Total num frames: 75886592. Throughput: 0: 12473.1. Samples: 75854120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:58:45,780][304334] Avg episode reward: [(0, '4688.798')] [2023-03-08 02:58:46,667][304623] Updated weights for policy 0, policy_version 148240 (0.0005) [2023-03-08 02:58:49,958][304623] Updated weights for policy 0, policy_version 148320 (0.0004) [2023-03-08 02:58:50,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12629.3, 300 sec: 13051.7). Total num frames: 75948032. Throughput: 0: 12448.9. Samples: 75927636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:58:50,780][304334] Avg episode reward: [(0, '4709.422')] [2023-03-08 02:58:50,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000148336_75948032.pth... [2023-03-08 02:58:50,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000147608_75575296.pth [2023-03-08 02:58:53,244][304623] Updated weights for policy 0, policy_version 148400 (0.0005) [2023-03-08 02:58:55,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 13051.7). Total num frames: 76009472. Throughput: 0: 12464.1. Samples: 76002020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:58:55,780][304334] Avg episode reward: [(0, '4702.762')] [2023-03-08 02:58:56,604][304623] Updated weights for policy 0, policy_version 148480 (0.0005) [2023-03-08 02:58:59,950][304623] Updated weights for policy 0, policy_version 148560 (0.0005) [2023-03-08 02:59:00,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 13051.7). Total num frames: 76070912. Throughput: 0: 12452.0. Samples: 76038540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:59:00,769][304334] Avg episode reward: [(0, '4712.926')] [2023-03-08 02:59:03,258][304623] Updated weights for policy 0, policy_version 148640 (0.0004) [2023-03-08 02:59:05,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 13037.8). Total num frames: 76132352. Throughput: 0: 12452.4. Samples: 76112204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:59:05,769][304334] Avg episode reward: [(0, '4708.031')] [2023-03-08 02:59:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000148696_76132352.pth... [2023-03-08 02:59:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000147976_75763712.pth [2023-03-08 02:59:06,575][304623] Updated weights for policy 0, policy_version 148720 (0.0005) [2023-03-08 02:59:09,732][304623] Updated weights for policy 0, policy_version 148800 (0.0005) [2023-03-08 02:59:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 13023.9). Total num frames: 76197888. Throughput: 0: 12518.8. Samples: 76189080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:59:10,783][304334] Avg episode reward: [(0, '4693.986')] [2023-03-08 02:59:12,991][304623] Updated weights for policy 0, policy_version 148880 (0.0005) [2023-03-08 02:59:15,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 13010.0). Total num frames: 76259328. Throughput: 0: 12505.9. Samples: 76226576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:59:15,769][304334] Avg episode reward: [(0, '4683.417')] [2023-03-08 02:59:16,348][304623] Updated weights for policy 0, policy_version 148960 (0.0005) [2023-03-08 02:59:19,607][304623] Updated weights for policy 0, policy_version 149040 (0.0005) [2023-03-08 02:59:20,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12982.2). Total num frames: 76320768. Throughput: 0: 12434.8. Samples: 76300368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:59:20,780][304334] Avg episode reward: [(0, '4710.515')] [2023-03-08 02:59:20,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000149064_76320768.pth... [2023-03-08 02:59:20,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000148336_75948032.pth [2023-03-08 02:59:22,764][304623] Updated weights for policy 0, policy_version 149120 (0.0005) [2023-03-08 02:59:25,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12561.1, 300 sec: 12968.4). Total num frames: 76386304. Throughput: 0: 12468.6. Samples: 76378112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:59:25,780][304334] Avg episode reward: [(0, '4703.851')] [2023-03-08 02:59:26,015][304623] Updated weights for policy 0, policy_version 149200 (0.0005) [2023-03-08 02:59:29,282][304623] Updated weights for policy 0, policy_version 149280 (0.0005) [2023-03-08 02:59:30,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12954.5). Total num frames: 76447744. Throughput: 0: 12464.9. Samples: 76415040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:59:30,780][304334] Avg episode reward: [(0, '4631.779')] [2023-03-08 02:59:32,708][304623] Updated weights for policy 0, policy_version 149360 (0.0005) [2023-03-08 02:59:35,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12492.8, 300 sec: 12926.7). Total num frames: 76509184. Throughput: 0: 12468.6. Samples: 76488724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:59:35,780][304334] Avg episode reward: [(0, '4680.129')] [2023-03-08 02:59:35,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000149432_76509184.pth... [2023-03-08 02:59:35,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000148696_76132352.pth [2023-03-08 02:59:36,019][304623] Updated weights for policy 0, policy_version 149440 (0.0005) [2023-03-08 02:59:39,402][304623] Updated weights for policy 0, policy_version 149520 (0.0005) [2023-03-08 02:59:40,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.6, 300 sec: 12912.8). Total num frames: 76570624. Throughput: 0: 12451.4. Samples: 76562332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:59:40,780][304334] Avg episode reward: [(0, '4696.882')] [2023-03-08 02:59:42,373][304623] Updated weights for policy 0, policy_version 149600 (0.0004) [2023-03-08 02:59:45,365][304623] Updated weights for policy 0, policy_version 149680 (0.0004) [2023-03-08 02:59:45,769][304334] Fps is (10 sec: 13107.3, 60 sec: 12561.1, 300 sec: 12926.7). Total num frames: 76640256. Throughput: 0: 12552.5. Samples: 76603400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:59:45,780][304334] Avg episode reward: [(0, '4663.842')] [2023-03-08 02:59:48,359][304623] Updated weights for policy 0, policy_version 149760 (0.0004) [2023-03-08 02:59:50,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12629.3, 300 sec: 12940.6). Total num frames: 76705792. Throughput: 0: 12736.0. Samples: 76685324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:59:50,780][304334] Avg episode reward: [(0, '4645.870')] [2023-03-08 02:59:50,782][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000149816_76705792.pth... [2023-03-08 02:59:50,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000149064_76320768.pth [2023-03-08 02:59:51,476][304623] Updated weights for policy 0, policy_version 149840 (0.0005) [2023-03-08 02:59:54,480][304623] Updated weights for policy 0, policy_version 149920 (0.0004) [2023-03-08 02:59:55,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12765.9, 300 sec: 12968.4). Total num frames: 76775424. Throughput: 0: 12821.5. Samples: 76766048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 02:59:55,780][304334] Avg episode reward: [(0, '4613.407')] [2023-03-08 02:59:57,401][304623] Updated weights for policy 0, policy_version 150000 (0.0004) [2023-03-08 03:00:00,337][304623] Updated weights for policy 0, policy_version 150080 (0.0004) [2023-03-08 03:00:00,769][304334] Fps is (10 sec: 13926.3, 60 sec: 12902.4, 300 sec: 12996.1). Total num frames: 76845056. Throughput: 0: 12925.1. Samples: 76808204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:00:00,780][304334] Avg episode reward: [(0, '4665.098')] [2023-03-08 03:00:03,307][304623] Updated weights for policy 0, policy_version 150160 (0.0004) [2023-03-08 03:00:05,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13038.9, 300 sec: 13010.0). Total num frames: 76914688. Throughput: 0: 13122.1. Samples: 76890864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:00:05,780][304334] Avg episode reward: [(0, '4675.044')] [2023-03-08 03:00:05,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000150224_76914688.pth... [2023-03-08 03:00:05,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000149432_76509184.pth [2023-03-08 03:00:06,252][304623] Updated weights for policy 0, policy_version 150240 (0.0004) [2023-03-08 03:00:09,297][304623] Updated weights for policy 0, policy_version 150320 (0.0005) [2023-03-08 03:00:10,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13107.2, 300 sec: 13010.0). Total num frames: 76984320. Throughput: 0: 13227.8. Samples: 76973364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:00:10,780][304334] Avg episode reward: [(0, '4641.317')] [2023-03-08 03:00:12,232][304623] Updated weights for policy 0, policy_version 150400 (0.0004) [2023-03-08 03:00:15,185][304623] Updated weights for policy 0, policy_version 150480 (0.0004) [2023-03-08 03:00:15,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13175.5, 300 sec: 12996.1). Total num frames: 77049856. Throughput: 0: 13330.9. Samples: 77014932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:00:15,769][304334] Avg episode reward: [(0, '4693.707')] [2023-03-08 03:00:18,199][304623] Updated weights for policy 0, policy_version 150560 (0.0005) [2023-03-08 03:00:20,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13312.0, 300 sec: 13023.9). Total num frames: 77119488. Throughput: 0: 13521.0. Samples: 77097168. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:00:20,769][304334] Avg episode reward: [(0, '4688.579')] [2023-03-08 03:00:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000150624_77119488.pth... [2023-03-08 03:00:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000149816_76705792.pth [2023-03-08 03:00:21,174][304623] Updated weights for policy 0, policy_version 150640 (0.0004) [2023-03-08 03:00:24,101][304623] Updated weights for policy 0, policy_version 150720 (0.0004) [2023-03-08 03:00:25,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13380.3, 300 sec: 13051.7). Total num frames: 77189120. Throughput: 0: 13737.7. Samples: 77180528. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:00:25,769][304334] Avg episode reward: [(0, '4712.856')] [2023-03-08 03:00:27,145][304623] Updated weights for policy 0, policy_version 150800 (0.0005) [2023-03-08 03:00:30,392][304623] Updated weights for policy 0, policy_version 150880 (0.0005) [2023-03-08 03:00:30,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13065.5). Total num frames: 77254656. Throughput: 0: 13717.6. Samples: 77220692. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:00:30,769][304334] Avg episode reward: [(0, '4655.508')] [2023-03-08 03:00:33,688][304623] Updated weights for policy 0, policy_version 150960 (0.0005) [2023-03-08 03:00:35,769][304334] Fps is (10 sec: 12697.5, 60 sec: 13448.5, 300 sec: 13051.7). Total num frames: 77316096. Throughput: 0: 13562.0. Samples: 77295616. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:00:35,769][304334] Avg episode reward: [(0, '4654.786')] [2023-03-08 03:00:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000151008_77316096.pth... [2023-03-08 03:00:35,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000150224_76914688.pth [2023-03-08 03:00:36,954][304623] Updated weights for policy 0, policy_version 151040 (0.0005) [2023-03-08 03:00:40,022][304623] Updated weights for policy 0, policy_version 151120 (0.0005) [2023-03-08 03:00:40,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13516.8, 300 sec: 13065.5). Total num frames: 77381632. Throughput: 0: 13492.3. Samples: 77373204. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:00:40,769][304334] Avg episode reward: [(0, '4693.390')] [2023-03-08 03:00:42,996][304623] Updated weights for policy 0, policy_version 151200 (0.0004) [2023-03-08 03:00:45,769][304334] Fps is (10 sec: 13107.3, 60 sec: 13448.5, 300 sec: 13079.4). Total num frames: 77447168. Throughput: 0: 13471.3. Samples: 77414412. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:00:45,769][304334] Avg episode reward: [(0, '4684.384')] [2023-03-08 03:00:46,292][304623] Updated weights for policy 0, policy_version 151280 (0.0005) [2023-03-08 03:00:49,456][304623] Updated weights for policy 0, policy_version 151360 (0.0005) [2023-03-08 03:00:50,769][304334] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 13093.3). Total num frames: 77512704. Throughput: 0: 13304.3. Samples: 77489556. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:00:50,769][304334] Avg episode reward: [(0, '4657.464')] [2023-03-08 03:00:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000151392_77512704.pth... [2023-03-08 03:00:50,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000150624_77119488.pth [2023-03-08 03:00:52,437][304623] Updated weights for policy 0, policy_version 151440 (0.0004) [2023-03-08 03:00:55,418][304623] Updated weights for policy 0, policy_version 151520 (0.0004) [2023-03-08 03:00:55,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13121.1). Total num frames: 77582336. Throughput: 0: 13308.1. Samples: 77572228. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:00:55,769][304334] Avg episode reward: [(0, '4685.563')] [2023-03-08 03:00:58,445][304623] Updated weights for policy 0, policy_version 151600 (0.0004) [2023-03-08 03:01:00,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13135.0). Total num frames: 77647872. Throughput: 0: 13277.6. Samples: 77612424. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:01:00,769][304334] Avg episode reward: [(0, '4672.221')] [2023-03-08 03:01:01,487][304623] Updated weights for policy 0, policy_version 151680 (0.0005) [2023-03-08 03:01:04,595][304623] Updated weights for policy 0, policy_version 151760 (0.0005) [2023-03-08 03:01:05,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13312.0, 300 sec: 13148.9). Total num frames: 77713408. Throughput: 0: 13244.2. Samples: 77693156. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:01:05,769][304334] Avg episode reward: [(0, '4702.233')] [2023-03-08 03:01:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000151784_77713408.pth... [2023-03-08 03:01:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000151008_77316096.pth [2023-03-08 03:01:07,802][304623] Updated weights for policy 0, policy_version 151840 (0.0005) [2023-03-08 03:01:10,766][304623] Updated weights for policy 0, policy_version 151920 (0.0004) [2023-03-08 03:01:10,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13312.0, 300 sec: 13176.6). Total num frames: 77783040. Throughput: 0: 13134.4. Samples: 77771576. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:01:10,769][304334] Avg episode reward: [(0, '4649.633')] [2023-03-08 03:01:13,766][304623] Updated weights for policy 0, policy_version 152000 (0.0004) [2023-03-08 03:01:15,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13312.0, 300 sec: 13176.6). Total num frames: 77848576. Throughput: 0: 13145.4. Samples: 77812236. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:01:15,769][304334] Avg episode reward: [(0, '4675.377')] [2023-03-08 03:01:16,832][304623] Updated weights for policy 0, policy_version 152080 (0.0004) [2023-03-08 03:01:19,811][304623] Updated weights for policy 0, policy_version 152160 (0.0004) [2023-03-08 03:01:20,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13312.0, 300 sec: 13190.5). Total num frames: 77918208. Throughput: 0: 13302.3. Samples: 77894220. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:01:20,769][304334] Avg episode reward: [(0, '4688.837')] [2023-03-08 03:01:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000152184_77918208.pth... [2023-03-08 03:01:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000151392_77512704.pth [2023-03-08 03:01:22,847][304623] Updated weights for policy 0, policy_version 152240 (0.0005) [2023-03-08 03:01:25,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13243.7, 300 sec: 13190.5). Total num frames: 77983744. Throughput: 0: 13380.8. Samples: 77975340. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:01:25,769][304334] Avg episode reward: [(0, '4660.276')] [2023-03-08 03:01:25,943][304623] Updated weights for policy 0, policy_version 152320 (0.0005) [2023-03-08 03:01:28,818][304623] Updated weights for policy 0, policy_version 152400 (0.0004) [2023-03-08 03:01:30,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13312.0, 300 sec: 13204.4). Total num frames: 78053376. Throughput: 0: 13381.4. Samples: 78016576. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:01:30,769][304334] Avg episode reward: [(0, '4705.604')] [2023-03-08 03:01:31,781][304623] Updated weights for policy 0, policy_version 152480 (0.0004) [2023-03-08 03:01:34,707][304623] Updated weights for policy 0, policy_version 152560 (0.0004) [2023-03-08 03:01:35,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13448.5, 300 sec: 13204.4). Total num frames: 78123008. Throughput: 0: 13559.6. Samples: 78099736. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:01:35,769][304334] Avg episode reward: [(0, '4674.571')] [2023-03-08 03:01:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000152584_78123008.pth... [2023-03-08 03:01:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000151784_77713408.pth [2023-03-08 03:01:37,650][304623] Updated weights for policy 0, policy_version 152640 (0.0004) [2023-03-08 03:01:40,636][304623] Updated weights for policy 0, policy_version 152720 (0.0004) [2023-03-08 03:01:40,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13516.8, 300 sec: 13204.4). Total num frames: 78192640. Throughput: 0: 13579.7. Samples: 78183312. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:01:40,769][304334] Avg episode reward: [(0, '4671.441')] [2023-03-08 03:01:43,641][304623] Updated weights for policy 0, policy_version 152800 (0.0004) [2023-03-08 03:01:45,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13585.1, 300 sec: 13204.4). Total num frames: 78262272. Throughput: 0: 13603.2. Samples: 78224568. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:01:45,769][304334] Avg episode reward: [(0, '4664.449')] [2023-03-08 03:01:46,606][304623] Updated weights for policy 0, policy_version 152880 (0.0003) [2023-03-08 03:01:49,676][304623] Updated weights for policy 0, policy_version 152960 (0.0003) [2023-03-08 03:01:50,769][304334] Fps is (10 sec: 13516.5, 60 sec: 13585.1, 300 sec: 13218.3). Total num frames: 78327808. Throughput: 0: 13648.2. Samples: 78307328. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:01:50,769][304334] Avg episode reward: [(0, '4627.425')] [2023-03-08 03:01:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000152984_78327808.pth... [2023-03-08 03:01:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000152184_77918208.pth [2023-03-08 03:01:52,661][304623] Updated weights for policy 0, policy_version 153040 (0.0004) [2023-03-08 03:01:55,640][304623] Updated weights for policy 0, policy_version 153120 (0.0003) [2023-03-08 03:01:55,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13218.3). Total num frames: 78397440. Throughput: 0: 13692.4. Samples: 78387736. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:01:55,769][304334] Avg episode reward: [(0, '4616.878')] [2023-03-08 03:01:58,688][304623] Updated weights for policy 0, policy_version 153200 (0.0004) [2023-03-08 03:02:00,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13585.1, 300 sec: 13204.4). Total num frames: 78462976. Throughput: 0: 13702.0. Samples: 78428828. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:02:00,769][304334] Avg episode reward: [(0, '4645.703')] [2023-03-08 03:02:01,725][304623] Updated weights for policy 0, policy_version 153280 (0.0004) [2023-03-08 03:02:04,725][304623] Updated weights for policy 0, policy_version 153360 (0.0004) [2023-03-08 03:02:05,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13653.3, 300 sec: 13204.4). Total num frames: 78532608. Throughput: 0: 13671.3. Samples: 78509428. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:02:05,769][304334] Avg episode reward: [(0, '4691.656')] [2023-03-08 03:02:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000153384_78532608.pth... [2023-03-08 03:02:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000152584_78123008.pth [2023-03-08 03:02:07,696][304623] Updated weights for policy 0, policy_version 153440 (0.0004) [2023-03-08 03:02:10,628][304623] Updated weights for policy 0, policy_version 153520 (0.0004) [2023-03-08 03:02:10,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13653.3, 300 sec: 13204.4). Total num frames: 78602240. Throughput: 0: 13744.9. Samples: 78593860. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:02:10,769][304334] Avg episode reward: [(0, '4683.694')] [2023-03-08 03:02:13,614][304623] Updated weights for policy 0, policy_version 153600 (0.0004) [2023-03-08 03:02:15,769][304334] Fps is (10 sec: 13926.6, 60 sec: 13721.6, 300 sec: 13204.4). Total num frames: 78671872. Throughput: 0: 13734.1. Samples: 78634612. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:02:15,769][304334] Avg episode reward: [(0, '4690.264')] [2023-03-08 03:02:16,565][304623] Updated weights for policy 0, policy_version 153680 (0.0004) [2023-03-08 03:02:19,524][304623] Updated weights for policy 0, policy_version 153760 (0.0004) [2023-03-08 03:02:20,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13653.4, 300 sec: 13190.5). Total num frames: 78737408. Throughput: 0: 13723.6. Samples: 78717296. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:02:20,769][304334] Avg episode reward: [(0, '4693.490')] [2023-03-08 03:02:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000153792_78741504.pth... [2023-03-08 03:02:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000152984_78327808.pth [2023-03-08 03:02:22,545][304623] Updated weights for policy 0, policy_version 153840 (0.0005) [2023-03-08 03:02:25,767][304623] Updated weights for policy 0, policy_version 153920 (0.0005) [2023-03-08 03:02:25,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13721.6, 300 sec: 13190.5). Total num frames: 78807040. Throughput: 0: 13641.1. Samples: 78797160. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:02:25,769][304334] Avg episode reward: [(0, '4681.136')] [2023-03-08 03:02:28,876][304623] Updated weights for policy 0, policy_version 154000 (0.0005) [2023-03-08 03:02:30,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13176.6). Total num frames: 78872576. Throughput: 0: 13580.8. Samples: 78835704. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:02:30,769][304334] Avg episode reward: [(0, '4641.508')] [2023-03-08 03:02:32,034][304623] Updated weights for policy 0, policy_version 154080 (0.0005) [2023-03-08 03:02:35,405][304623] Updated weights for policy 0, policy_version 154160 (0.0005) [2023-03-08 03:02:35,769][304334] Fps is (10 sec: 12697.4, 60 sec: 13516.8, 300 sec: 13148.9). Total num frames: 78934016. Throughput: 0: 13455.3. Samples: 78912816. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:02:35,769][304334] Avg episode reward: [(0, '4671.515')] [2023-03-08 03:02:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000154168_78934016.pth... [2023-03-08 03:02:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000153384_78532608.pth [2023-03-08 03:02:38,656][304623] Updated weights for policy 0, policy_version 154240 (0.0005) [2023-03-08 03:02:40,769][304334] Fps is (10 sec: 12287.9, 60 sec: 13380.2, 300 sec: 13121.1). Total num frames: 78995456. Throughput: 0: 13324.4. Samples: 78987336. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:02:40,769][304334] Avg episode reward: [(0, '4694.991')] [2023-03-08 03:02:41,974][304623] Updated weights for policy 0, policy_version 154320 (0.0005) [2023-03-08 03:02:45,347][304623] Updated weights for policy 0, policy_version 154400 (0.0005) [2023-03-08 03:02:45,769][304334] Fps is (10 sec: 12288.1, 60 sec: 13243.7, 300 sec: 13107.2). Total num frames: 79056896. Throughput: 0: 13229.2. Samples: 79024140. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:02:45,769][304334] Avg episode reward: [(0, '4660.008')] [2023-03-08 03:02:48,638][304623] Updated weights for policy 0, policy_version 154480 (0.0005) [2023-03-08 03:02:50,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13175.5, 300 sec: 13079.4). Total num frames: 79118336. Throughput: 0: 13077.6. Samples: 79097920. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:02:50,769][304334] Avg episode reward: [(0, '4679.157')] [2023-03-08 03:02:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000154528_79118336.pth... [2023-03-08 03:02:50,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000153792_78741504.pth [2023-03-08 03:02:51,947][304623] Updated weights for policy 0, policy_version 154560 (0.0005) [2023-03-08 03:02:55,195][304623] Updated weights for policy 0, policy_version 154640 (0.0005) [2023-03-08 03:02:55,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13038.9, 300 sec: 13065.5). Total num frames: 79179776. Throughput: 0: 12863.8. Samples: 79172732. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:02:55,769][304334] Avg episode reward: [(0, '4686.096')] [2023-03-08 03:02:58,488][304623] Updated weights for policy 0, policy_version 154720 (0.0005) [2023-03-08 03:03:00,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12970.7, 300 sec: 13065.5). Total num frames: 79241216. Throughput: 0: 12786.0. Samples: 79209984. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:03:00,769][304334] Avg episode reward: [(0, '4641.966')] [2023-03-08 03:03:01,842][304623] Updated weights for policy 0, policy_version 154800 (0.0005) [2023-03-08 03:03:05,110][304623] Updated weights for policy 0, policy_version 154880 (0.0005) [2023-03-08 03:03:05,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12834.1, 300 sec: 13065.5). Total num frames: 79302656. Throughput: 0: 12611.1. Samples: 79284796. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:03:05,769][304334] Avg episode reward: [(0, '4690.221')] [2023-03-08 03:03:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000154896_79306752.pth... [2023-03-08 03:03:05,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000154168_78934016.pth [2023-03-08 03:03:08,442][304623] Updated weights for policy 0, policy_version 154960 (0.0005) [2023-03-08 03:03:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12765.9, 300 sec: 13079.4). Total num frames: 79368192. Throughput: 0: 12502.5. Samples: 79359776. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:03:10,769][304334] Avg episode reward: [(0, '4653.462')] [2023-03-08 03:03:11,663][304623] Updated weights for policy 0, policy_version 155040 (0.0005) [2023-03-08 03:03:14,960][304623] Updated weights for policy 0, policy_version 155120 (0.0005) [2023-03-08 03:03:15,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12629.3, 300 sec: 13079.4). Total num frames: 79429632. Throughput: 0: 12471.8. Samples: 79396936. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:03:15,769][304334] Avg episode reward: [(0, '4694.552')] [2023-03-08 03:03:18,262][304623] Updated weights for policy 0, policy_version 155200 (0.0005) [2023-03-08 03:03:20,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12561.0, 300 sec: 13079.4). Total num frames: 79491072. Throughput: 0: 12403.6. Samples: 79470976. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:03:20,769][304334] Avg episode reward: [(0, '4687.511')] [2023-03-08 03:03:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000155256_79491072.pth... [2023-03-08 03:03:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000154528_79118336.pth [2023-03-08 03:03:21,581][304623] Updated weights for policy 0, policy_version 155280 (0.0005) [2023-03-08 03:03:24,967][304623] Updated weights for policy 0, policy_version 155360 (0.0005) [2023-03-08 03:03:25,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12424.5, 300 sec: 13065.5). Total num frames: 79552512. Throughput: 0: 12378.9. Samples: 79544384. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:03:25,769][304334] Avg episode reward: [(0, '4691.523')] [2023-03-08 03:03:28,293][304623] Updated weights for policy 0, policy_version 155440 (0.0005) [2023-03-08 03:03:30,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 13065.5). Total num frames: 79613952. Throughput: 0: 12380.2. Samples: 79581248. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:03:30,769][304334] Avg episode reward: [(0, '4698.909')] [2023-03-08 03:03:31,624][304623] Updated weights for policy 0, policy_version 155520 (0.0005) [2023-03-08 03:03:34,877][304623] Updated weights for policy 0, policy_version 155600 (0.0005) [2023-03-08 03:03:35,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12356.3, 300 sec: 13051.7). Total num frames: 79675392. Throughput: 0: 12390.3. Samples: 79655484. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:03:35,769][304334] Avg episode reward: [(0, '4686.681')] [2023-03-08 03:03:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000155616_79675392.pth... [2023-03-08 03:03:35,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000154896_79306752.pth [2023-03-08 03:03:38,212][304623] Updated weights for policy 0, policy_version 155680 (0.0005) [2023-03-08 03:03:40,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 13051.7). Total num frames: 79736832. Throughput: 0: 12355.8. Samples: 79728744. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:03:40,769][304334] Avg episode reward: [(0, '4678.765')] [2023-03-08 03:03:41,589][304623] Updated weights for policy 0, policy_version 155760 (0.0005) [2023-03-08 03:03:44,832][304623] Updated weights for policy 0, policy_version 155840 (0.0005) [2023-03-08 03:03:45,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 13051.7). Total num frames: 79798272. Throughput: 0: 12374.9. Samples: 79766856. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:03:45,769][304334] Avg episode reward: [(0, '4710.753')] [2023-03-08 03:03:48,143][304623] Updated weights for policy 0, policy_version 155920 (0.0005) [2023-03-08 03:03:50,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 13051.7). Total num frames: 79859712. Throughput: 0: 12363.4. Samples: 79841148. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:03:50,769][304334] Avg episode reward: [(0, '4688.309')] [2023-03-08 03:03:50,788][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000155984_79863808.pth... [2023-03-08 03:03:50,790][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000155256_79491072.pth [2023-03-08 03:03:51,453][304623] Updated weights for policy 0, policy_version 156000 (0.0005) [2023-03-08 03:03:54,583][304623] Updated weights for policy 0, policy_version 156080 (0.0005) [2023-03-08 03:03:55,769][304334] Fps is (10 sec: 13107.3, 60 sec: 12492.8, 300 sec: 13079.4). Total num frames: 79929344. Throughput: 0: 12404.0. Samples: 79917956. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:03:55,769][304334] Avg episode reward: [(0, '4701.554')] [2023-03-08 03:03:57,558][304623] Updated weights for policy 0, policy_version 156160 (0.0004) [2023-03-08 03:04:00,536][304623] Updated weights for policy 0, policy_version 156240 (0.0004) [2023-03-08 03:04:00,769][304334] Fps is (10 sec: 13516.9, 60 sec: 12561.1, 300 sec: 13093.3). Total num frames: 79994880. Throughput: 0: 12492.8. Samples: 79959112. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:04:00,769][304334] Avg episode reward: [(0, '4634.608')] [2023-03-08 03:04:03,544][304623] Updated weights for policy 0, policy_version 156320 (0.0004) [2023-03-08 03:04:05,769][304334] Fps is (10 sec: 13516.7, 60 sec: 12697.6, 300 sec: 13107.2). Total num frames: 80064512. Throughput: 0: 12677.9. Samples: 80041480. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:04:05,769][304334] Avg episode reward: [(0, '4650.092')] [2023-03-08 03:04:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000156376_80064512.pth... [2023-03-08 03:04:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000155616_79675392.pth [2023-03-08 03:04:06,519][304623] Updated weights for policy 0, policy_version 156400 (0.0004) [2023-03-08 03:04:09,463][304623] Updated weights for policy 0, policy_version 156480 (0.0004) [2023-03-08 03:04:10,769][304334] Fps is (10 sec: 13926.4, 60 sec: 12765.9, 300 sec: 13135.0). Total num frames: 80134144. Throughput: 0: 12893.9. Samples: 80124608. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:04:10,769][304334] Avg episode reward: [(0, '4708.386')] [2023-03-08 03:04:12,493][304623] Updated weights for policy 0, policy_version 156560 (0.0004) [2023-03-08 03:04:15,461][304623] Updated weights for policy 0, policy_version 156640 (0.0004) [2023-03-08 03:04:15,769][304334] Fps is (10 sec: 13926.5, 60 sec: 12902.4, 300 sec: 13162.7). Total num frames: 80203776. Throughput: 0: 12975.1. Samples: 80165128. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:04:15,769][304334] Avg episode reward: [(0, '4702.778')] [2023-03-08 03:04:18,391][304623] Updated weights for policy 0, policy_version 156720 (0.0004) [2023-03-08 03:04:20,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12970.7, 300 sec: 13162.7). Total num frames: 80269312. Throughput: 0: 13185.1. Samples: 80248812. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:04:20,769][304334] Avg episode reward: [(0, '4653.259')] [2023-03-08 03:04:20,802][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000156784_80273408.pth... [2023-03-08 03:04:20,803][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000155984_79863808.pth [2023-03-08 03:04:21,434][304623] Updated weights for policy 0, policy_version 156800 (0.0004) [2023-03-08 03:04:24,354][304623] Updated weights for policy 0, policy_version 156880 (0.0004) [2023-03-08 03:04:25,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13107.2, 300 sec: 13190.5). Total num frames: 80338944. Throughput: 0: 13379.4. Samples: 80330816. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:04:25,769][304334] Avg episode reward: [(0, '4656.053')] [2023-03-08 03:04:27,398][304623] Updated weights for policy 0, policy_version 156960 (0.0005) [2023-03-08 03:04:30,362][304623] Updated weights for policy 0, policy_version 157040 (0.0004) [2023-03-08 03:04:30,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13243.7, 300 sec: 13218.3). Total num frames: 80408576. Throughput: 0: 13440.7. Samples: 80371688. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:04:30,780][304334] Avg episode reward: [(0, '4620.337')] [2023-03-08 03:04:33,350][304623] Updated weights for policy 0, policy_version 157120 (0.0004) [2023-03-08 03:04:35,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13380.3, 300 sec: 13246.0). Total num frames: 80478208. Throughput: 0: 13612.2. Samples: 80453696. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:04:35,780][304334] Avg episode reward: [(0, '4654.126')] [2023-03-08 03:04:35,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000157184_80478208.pth... [2023-03-08 03:04:35,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000156376_80064512.pth [2023-03-08 03:04:36,293][304623] Updated weights for policy 0, policy_version 157200 (0.0004) [2023-03-08 03:04:39,238][304623] Updated weights for policy 0, policy_version 157280 (0.0004) [2023-03-08 03:04:40,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13516.8, 300 sec: 13246.0). Total num frames: 80547840. Throughput: 0: 13763.5. Samples: 80537312. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:04:40,780][304334] Avg episode reward: [(0, '4629.382')] [2023-03-08 03:04:42,242][304623] Updated weights for policy 0, policy_version 157360 (0.0004) [2023-03-08 03:04:45,227][304623] Updated weights for policy 0, policy_version 157440 (0.0004) [2023-03-08 03:04:45,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13246.0). Total num frames: 80613376. Throughput: 0: 13752.4. Samples: 80577972. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:04:45,780][304334] Avg episode reward: [(0, '4626.825')] [2023-03-08 03:04:48,239][304623] Updated weights for policy 0, policy_version 157520 (0.0004) [2023-03-08 03:04:50,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13721.6, 300 sec: 13246.0). Total num frames: 80683008. Throughput: 0: 13738.5. Samples: 80659712. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:04:50,780][304334] Avg episode reward: [(0, '4695.740')] [2023-03-08 03:04:50,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000157584_80683008.pth... [2023-03-08 03:04:50,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000156784_80273408.pth [2023-03-08 03:04:51,192][304623] Updated weights for policy 0, policy_version 157600 (0.0004) [2023-03-08 03:04:54,238][304623] Updated weights for policy 0, policy_version 157680 (0.0005) [2023-03-08 03:04:55,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13721.6, 300 sec: 13246.1). Total num frames: 80752640. Throughput: 0: 13721.1. Samples: 80742056. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:04:55,780][304334] Avg episode reward: [(0, '4697.395')] [2023-03-08 03:04:57,226][304623] Updated weights for policy 0, policy_version 157760 (0.0004) [2023-03-08 03:05:00,228][304623] Updated weights for policy 0, policy_version 157840 (0.0004) [2023-03-08 03:05:00,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13721.6, 300 sec: 13232.2). Total num frames: 80818176. Throughput: 0: 13741.6. Samples: 80783500. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:05:00,780][304334] Avg episode reward: [(0, '4624.184')] [2023-03-08 03:05:03,200][304623] Updated weights for policy 0, policy_version 157920 (0.0004) [2023-03-08 03:05:05,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13721.6, 300 sec: 13232.2). Total num frames: 80887808. Throughput: 0: 13717.3. Samples: 80866092. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:05:05,780][304334] Avg episode reward: [(0, '4539.169')] [2023-03-08 03:05:05,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000157984_80887808.pth... [2023-03-08 03:05:05,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000157184_80478208.pth [2023-03-08 03:05:06,141][304623] Updated weights for policy 0, policy_version 158000 (0.0004) [2023-03-08 03:05:09,138][304623] Updated weights for policy 0, policy_version 158080 (0.0004) [2023-03-08 03:05:10,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13721.6, 300 sec: 13246.0). Total num frames: 80957440. Throughput: 0: 13735.1. Samples: 80948896. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:05:10,769][304334] Avg episode reward: [(0, '4625.531')] [2023-03-08 03:05:12,117][304623] Updated weights for policy 0, policy_version 158160 (0.0004) [2023-03-08 03:05:15,082][304623] Updated weights for policy 0, policy_version 158240 (0.0004) [2023-03-08 03:05:15,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13721.6, 300 sec: 13246.0). Total num frames: 81027072. Throughput: 0: 13729.6. Samples: 80989520. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:05:15,769][304334] Avg episode reward: [(0, '4717.677')] [2023-03-08 03:05:18,085][304623] Updated weights for policy 0, policy_version 158320 (0.0004) [2023-03-08 03:05:20,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13721.6, 300 sec: 13232.2). Total num frames: 81092608. Throughput: 0: 13744.3. Samples: 81072192. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:05:20,769][304334] Avg episode reward: [(0, '4587.686')] [2023-03-08 03:05:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000158392_81096704.pth... [2023-03-08 03:05:20,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000157584_80683008.pth [2023-03-08 03:05:21,055][304623] Updated weights for policy 0, policy_version 158400 (0.0004) [2023-03-08 03:05:24,087][304623] Updated weights for policy 0, policy_version 158480 (0.0004) [2023-03-08 03:05:25,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13721.6, 300 sec: 13246.0). Total num frames: 81162240. Throughput: 0: 13705.2. Samples: 81154048. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:05:25,769][304334] Avg episode reward: [(0, '4618.086')] [2023-03-08 03:05:27,083][304623] Updated weights for policy 0, policy_version 158560 (0.0004) [2023-03-08 03:05:30,125][304623] Updated weights for policy 0, policy_version 158640 (0.0004) [2023-03-08 03:05:30,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13721.6, 300 sec: 13273.8). Total num frames: 81231872. Throughput: 0: 13707.8. Samples: 81194824. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 03:05:30,769][304334] Avg episode reward: [(0, '4604.233')] [2023-03-08 03:05:33,121][304623] Updated weights for policy 0, policy_version 158720 (0.0004) [2023-03-08 03:05:35,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13273.8). Total num frames: 81297408. Throughput: 0: 13707.3. Samples: 81276540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:05:35,769][304334] Avg episode reward: [(0, '4633.114')] [2023-03-08 03:05:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000158784_81297408.pth... [2023-03-08 03:05:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000157984_80887808.pth [2023-03-08 03:05:36,376][304623] Updated weights for policy 0, policy_version 158800 (0.0005) [2023-03-08 03:05:39,658][304623] Updated weights for policy 0, policy_version 158880 (0.0005) [2023-03-08 03:05:40,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13516.8, 300 sec: 13259.9). Total num frames: 81358848. Throughput: 0: 13524.6. Samples: 81350664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:05:40,769][304334] Avg episode reward: [(0, '4670.908')] [2023-03-08 03:05:42,915][304623] Updated weights for policy 0, policy_version 158960 (0.0005) [2023-03-08 03:05:45,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13448.5, 300 sec: 13246.0). Total num frames: 81420288. Throughput: 0: 13431.7. Samples: 81387928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:05:45,769][304334] Avg episode reward: [(0, '4632.334')] [2023-03-08 03:05:46,192][304623] Updated weights for policy 0, policy_version 159040 (0.0005) [2023-03-08 03:05:49,507][304623] Updated weights for policy 0, policy_version 159120 (0.0005) [2023-03-08 03:05:50,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13312.0, 300 sec: 13218.3). Total num frames: 81481728. Throughput: 0: 13248.8. Samples: 81462288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:05:50,769][304334] Avg episode reward: [(0, '4684.403')] [2023-03-08 03:05:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000159144_81481728.pth... [2023-03-08 03:05:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000158392_81096704.pth [2023-03-08 03:05:52,927][304623] Updated weights for policy 0, policy_version 159200 (0.0005) [2023-03-08 03:05:55,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13243.7, 300 sec: 13218.3). Total num frames: 81547264. Throughput: 0: 13115.3. Samples: 81539084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:05:55,769][304334] Avg episode reward: [(0, '4643.911')] [2023-03-08 03:05:55,914][304623] Updated weights for policy 0, policy_version 159280 (0.0004) [2023-03-08 03:05:58,918][304623] Updated weights for policy 0, policy_version 159360 (0.0004) [2023-03-08 03:06:00,769][304334] Fps is (10 sec: 13107.3, 60 sec: 13243.7, 300 sec: 13218.3). Total num frames: 81612800. Throughput: 0: 13115.0. Samples: 81579696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:06:00,769][304334] Avg episode reward: [(0, '4681.954')] [2023-03-08 03:06:02,231][304623] Updated weights for policy 0, policy_version 159440 (0.0005) [2023-03-08 03:06:05,370][304623] Updated weights for policy 0, policy_version 159520 (0.0004) [2023-03-08 03:06:05,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13175.5, 300 sec: 13204.4). Total num frames: 81678336. Throughput: 0: 12953.2. Samples: 81655084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:06:05,769][304334] Avg episode reward: [(0, '4689.798')] [2023-03-08 03:06:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000159528_81678336.pth... [2023-03-08 03:06:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000158784_81297408.pth [2023-03-08 03:06:08,350][304623] Updated weights for policy 0, policy_version 159600 (0.0004) [2023-03-08 03:06:10,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13107.2, 300 sec: 13204.4). Total num frames: 81743872. Throughput: 0: 12925.5. Samples: 81735696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:06:10,769][304334] Avg episode reward: [(0, '4675.351')] [2023-03-08 03:06:11,641][304623] Updated weights for policy 0, policy_version 159680 (0.0005) [2023-03-08 03:06:15,002][304623] Updated weights for policy 0, policy_version 159760 (0.0005) [2023-03-08 03:06:15,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12970.7, 300 sec: 13176.6). Total num frames: 81805312. Throughput: 0: 12839.8. Samples: 81772616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:06:15,769][304334] Avg episode reward: [(0, '4691.655')] [2023-03-08 03:06:18,323][304623] Updated weights for policy 0, policy_version 159840 (0.0005) [2023-03-08 03:06:20,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12902.4, 300 sec: 13162.7). Total num frames: 81866752. Throughput: 0: 12662.1. Samples: 81846336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:06:20,769][304334] Avg episode reward: [(0, '4677.243')] [2023-03-08 03:06:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000159896_81866752.pth... [2023-03-08 03:06:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000159144_81481728.pth [2023-03-08 03:06:21,622][304623] Updated weights for policy 0, policy_version 159920 (0.0005) [2023-03-08 03:06:24,835][304623] Updated weights for policy 0, policy_version 160000 (0.0005) [2023-03-08 03:06:25,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12765.9, 300 sec: 13135.0). Total num frames: 81928192. Throughput: 0: 12693.4. Samples: 81921868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:06:25,769][304334] Avg episode reward: [(0, '4701.063')] [2023-03-08 03:06:28,165][304623] Updated weights for policy 0, policy_version 160080 (0.0005) [2023-03-08 03:06:30,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12629.3, 300 sec: 13107.2). Total num frames: 81989632. Throughput: 0: 12688.2. Samples: 81958896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:06:30,769][304334] Avg episode reward: [(0, '4665.522')] [2023-03-08 03:06:31,542][304623] Updated weights for policy 0, policy_version 160160 (0.0005) [2023-03-08 03:06:34,783][304623] Updated weights for policy 0, policy_version 160240 (0.0005) [2023-03-08 03:06:35,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 13079.4). Total num frames: 82051072. Throughput: 0: 12678.1. Samples: 82032804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:06:35,769][304334] Avg episode reward: [(0, '4701.078')] [2023-03-08 03:06:35,818][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000160264_82055168.pth... [2023-03-08 03:06:35,820][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000159528_81678336.pth [2023-03-08 03:06:38,122][304623] Updated weights for policy 0, policy_version 160320 (0.0005) [2023-03-08 03:06:40,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 13065.5). Total num frames: 82116608. Throughput: 0: 12636.2. Samples: 82107712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:06:40,769][304334] Avg episode reward: [(0, '4679.432')] [2023-03-08 03:06:41,256][304623] Updated weights for policy 0, policy_version 160400 (0.0005) [2023-03-08 03:06:44,206][304623] Updated weights for policy 0, policy_version 160480 (0.0004) [2023-03-08 03:06:45,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12765.9, 300 sec: 13079.4). Total num frames: 82186240. Throughput: 0: 12648.1. Samples: 82148860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:06:45,769][304334] Avg episode reward: [(0, '4701.002')] [2023-03-08 03:06:47,121][304623] Updated weights for policy 0, policy_version 160560 (0.0004) [2023-03-08 03:06:50,112][304623] Updated weights for policy 0, policy_version 160640 (0.0004) [2023-03-08 03:06:50,769][304334] Fps is (10 sec: 13926.4, 60 sec: 12902.4, 300 sec: 13079.4). Total num frames: 82255872. Throughput: 0: 12813.9. Samples: 82231712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:06:50,769][304334] Avg episode reward: [(0, '4704.346')] [2023-03-08 03:06:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000160656_82255872.pth... [2023-03-08 03:06:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000159896_81866752.pth [2023-03-08 03:06:53,029][304623] Updated weights for policy 0, policy_version 160720 (0.0004) [2023-03-08 03:06:55,769][304334] Fps is (10 sec: 13926.4, 60 sec: 12970.7, 300 sec: 13093.3). Total num frames: 82325504. Throughput: 0: 12885.9. Samples: 82315560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:06:55,769][304334] Avg episode reward: [(0, '4666.408')] [2023-03-08 03:06:56,019][304623] Updated weights for policy 0, policy_version 160800 (0.0004) [2023-03-08 03:06:59,042][304623] Updated weights for policy 0, policy_version 160880 (0.0004) [2023-03-08 03:07:00,769][304334] Fps is (10 sec: 13516.9, 60 sec: 12970.7, 300 sec: 13079.4). Total num frames: 82391040. Throughput: 0: 12958.3. Samples: 82355740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:07:00,769][304334] Avg episode reward: [(0, '4475.275')] [2023-03-08 03:07:01,996][304623] Updated weights for policy 0, policy_version 160960 (0.0004) [2023-03-08 03:07:04,979][304623] Updated weights for policy 0, policy_version 161040 (0.0004) [2023-03-08 03:07:05,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13038.9, 300 sec: 13079.4). Total num frames: 82460672. Throughput: 0: 13162.8. Samples: 82438660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:07:05,769][304334] Avg episode reward: [(0, '4695.888')] [2023-03-08 03:07:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000161056_82460672.pth... [2023-03-08 03:07:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000160264_82055168.pth [2023-03-08 03:07:08,000][304623] Updated weights for policy 0, policy_version 161120 (0.0003) [2023-03-08 03:07:10,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13107.2, 300 sec: 13079.4). Total num frames: 82530304. Throughput: 0: 13292.6. Samples: 82520036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:07:10,769][304334] Avg episode reward: [(0, '4658.757')] [2023-03-08 03:07:11,016][304623] Updated weights for policy 0, policy_version 161200 (0.0003) [2023-03-08 03:07:13,914][304623] Updated weights for policy 0, policy_version 161280 (0.0003) [2023-03-08 03:07:15,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13243.7, 300 sec: 13093.3). Total num frames: 82599936. Throughput: 0: 13404.2. Samples: 82562084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:07:15,769][304334] Avg episode reward: [(0, '4697.446')] [2023-03-08 03:07:16,924][304623] Updated weights for policy 0, policy_version 161360 (0.0003) [2023-03-08 03:07:19,859][304623] Updated weights for policy 0, policy_version 161440 (0.0003) [2023-03-08 03:07:20,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13380.3, 300 sec: 13093.3). Total num frames: 82669568. Throughput: 0: 13605.8. Samples: 82645064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:07:20,769][304334] Avg episode reward: [(0, '4692.887')] [2023-03-08 03:07:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000161464_82669568.pth... [2023-03-08 03:07:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000160656_82255872.pth [2023-03-08 03:07:22,851][304623] Updated weights for policy 0, policy_version 161520 (0.0004) [2023-03-08 03:07:25,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13093.3). Total num frames: 82735104. Throughput: 0: 13772.7. Samples: 82727484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:07:25,769][304334] Avg episode reward: [(0, '4659.189')] [2023-03-08 03:07:25,777][304623] Updated weights for policy 0, policy_version 161600 (0.0003) [2023-03-08 03:07:28,839][304623] Updated weights for policy 0, policy_version 161680 (0.0003) [2023-03-08 03:07:30,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 13121.1). Total num frames: 82804736. Throughput: 0: 13758.0. Samples: 82767968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:07:30,769][304334] Avg episode reward: [(0, '4692.026')] [2023-03-08 03:07:31,862][304623] Updated weights for policy 0, policy_version 161760 (0.0003) [2023-03-08 03:07:34,908][304623] Updated weights for policy 0, policy_version 161840 (0.0003) [2023-03-08 03:07:35,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13653.3, 300 sec: 13135.0). Total num frames: 82870272. Throughput: 0: 13735.4. Samples: 82849804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:07:35,769][304334] Avg episode reward: [(0, '4681.653')] [2023-03-08 03:07:35,808][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000161864_82874368.pth... [2023-03-08 03:07:35,810][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000161056_82460672.pth [2023-03-08 03:07:37,860][304623] Updated weights for policy 0, policy_version 161920 (0.0003) [2023-03-08 03:07:40,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13721.6, 300 sec: 13162.7). Total num frames: 82939904. Throughput: 0: 13689.4. Samples: 82931584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:07:40,769][304334] Avg episode reward: [(0, '4700.071')] [2023-03-08 03:07:40,901][304623] Updated weights for policy 0, policy_version 162000 (0.0003) [2023-03-08 03:07:43,841][304623] Updated weights for policy 0, policy_version 162080 (0.0003) [2023-03-08 03:07:45,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13721.6, 300 sec: 13190.5). Total num frames: 83009536. Throughput: 0: 13711.2. Samples: 82972744. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:07:45,769][304334] Avg episode reward: [(0, '4709.626')] [2023-03-08 03:07:46,931][304623] Updated weights for policy 0, policy_version 162160 (0.0003) [2023-03-08 03:07:49,875][304623] Updated weights for policy 0, policy_version 162240 (0.0003) [2023-03-08 03:07:50,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13204.4). Total num frames: 83075072. Throughput: 0: 13688.8. Samples: 83054656. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:07:50,769][304334] Avg episode reward: [(0, '4689.481')] [2023-03-08 03:07:50,793][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000162264_83079168.pth... [2023-03-08 03:07:50,796][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000161464_82669568.pth [2023-03-08 03:07:52,912][304623] Updated weights for policy 0, policy_version 162320 (0.0003) [2023-03-08 03:07:55,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13232.2). Total num frames: 83144704. Throughput: 0: 13691.0. Samples: 83136132. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:07:55,769][304334] Avg episode reward: [(0, '4663.764')] [2023-03-08 03:07:55,962][304623] Updated weights for policy 0, policy_version 162400 (0.0003) [2023-03-08 03:07:58,931][304623] Updated weights for policy 0, policy_version 162480 (0.0003) [2023-03-08 03:08:00,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13721.6, 300 sec: 13259.9). Total num frames: 83214336. Throughput: 0: 13641.7. Samples: 83175960. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:08:00,769][304334] Avg episode reward: [(0, '4689.083')] [2023-03-08 03:08:01,947][304623] Updated weights for policy 0, policy_version 162560 (0.0003) [2023-03-08 03:08:05,048][304623] Updated weights for policy 0, policy_version 162640 (0.0004) [2023-03-08 03:08:05,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13259.9). Total num frames: 83279872. Throughput: 0: 13633.2. Samples: 83258556. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:08:05,769][304334] Avg episode reward: [(0, '4671.605')] [2023-03-08 03:08:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000162656_83279872.pth... [2023-03-08 03:08:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000161864_82874368.pth [2023-03-08 03:08:08,464][304623] Updated weights for policy 0, policy_version 162720 (0.0005) [2023-03-08 03:08:10,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13448.5, 300 sec: 13246.0). Total num frames: 83337216. Throughput: 0: 13412.6. Samples: 83331052. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:08:10,769][304334] Avg episode reward: [(0, '4709.914')] [2023-03-08 03:08:11,822][304623] Updated weights for policy 0, policy_version 162800 (0.0005) [2023-03-08 03:08:15,159][304623] Updated weights for policy 0, policy_version 162880 (0.0005) [2023-03-08 03:08:15,769][304334] Fps is (10 sec: 11878.5, 60 sec: 13312.0, 300 sec: 13246.1). Total num frames: 83398656. Throughput: 0: 13338.3. Samples: 83368192. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:08:15,769][304334] Avg episode reward: [(0, '4701.291')] [2023-03-08 03:08:18,510][304623] Updated weights for policy 0, policy_version 162960 (0.0005) [2023-03-08 03:08:20,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13175.5, 300 sec: 13246.0). Total num frames: 83460096. Throughput: 0: 13143.4. Samples: 83441256. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:08:20,769][304334] Avg episode reward: [(0, '4706.727')] [2023-03-08 03:08:20,790][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000163016_83464192.pth... [2023-03-08 03:08:20,792][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000162264_83079168.pth [2023-03-08 03:08:21,779][304623] Updated weights for policy 0, policy_version 163040 (0.0005) [2023-03-08 03:08:25,083][304623] Updated weights for policy 0, policy_version 163120 (0.0005) [2023-03-08 03:08:25,769][304334] Fps is (10 sec: 12697.7, 60 sec: 13175.5, 300 sec: 13259.9). Total num frames: 83525632. Throughput: 0: 12989.2. Samples: 83516096. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:08:25,769][304334] Avg episode reward: [(0, '4675.735')] [2023-03-08 03:08:28,450][304623] Updated weights for policy 0, policy_version 163200 (0.0005) [2023-03-08 03:08:30,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13038.9, 300 sec: 13259.9). Total num frames: 83587072. Throughput: 0: 12887.4. Samples: 83552676. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:08:30,769][304334] Avg episode reward: [(0, '4702.350')] [2023-03-08 03:08:31,710][304623] Updated weights for policy 0, policy_version 163280 (0.0005) [2023-03-08 03:08:35,116][304623] Updated weights for policy 0, policy_version 163360 (0.0005) [2023-03-08 03:08:35,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12970.7, 300 sec: 13259.9). Total num frames: 83648512. Throughput: 0: 12703.2. Samples: 83626300. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:08:35,769][304334] Avg episode reward: [(0, '4695.728')] [2023-03-08 03:08:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000163376_83648512.pth... [2023-03-08 03:08:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000162656_83279872.pth [2023-03-08 03:08:38,356][304623] Updated weights for policy 0, policy_version 163440 (0.0005) [2023-03-08 03:08:40,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12834.1, 300 sec: 13259.9). Total num frames: 83709952. Throughput: 0: 12569.5. Samples: 83701760. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:08:40,769][304334] Avg episode reward: [(0, '4686.914')] [2023-03-08 03:08:41,701][304623] Updated weights for policy 0, policy_version 163520 (0.0005) [2023-03-08 03:08:45,011][304623] Updated weights for policy 0, policy_version 163600 (0.0005) [2023-03-08 03:08:45,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12697.6, 300 sec: 13259.9). Total num frames: 83771392. Throughput: 0: 12503.6. Samples: 83738624. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:08:45,769][304334] Avg episode reward: [(0, '4692.900')] [2023-03-08 03:08:48,280][304623] Updated weights for policy 0, policy_version 163680 (0.0005) [2023-03-08 03:08:50,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12629.3, 300 sec: 13232.2). Total num frames: 83832832. Throughput: 0: 12308.2. Samples: 83812424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:08:50,769][304334] Avg episode reward: [(0, '4704.468')] [2023-03-08 03:08:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000163736_83832832.pth... [2023-03-08 03:08:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000163016_83464192.pth [2023-03-08 03:08:51,587][304623] Updated weights for policy 0, policy_version 163760 (0.0005) [2023-03-08 03:08:54,854][304623] Updated weights for policy 0, policy_version 163840 (0.0005) [2023-03-08 03:08:55,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 13218.3). Total num frames: 83894272. Throughput: 0: 12367.7. Samples: 83887600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:08:55,769][304334] Avg episode reward: [(0, '4685.011')] [2023-03-08 03:08:58,146][304623] Updated weights for policy 0, policy_version 163920 (0.0005) [2023-03-08 03:09:00,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 13204.4). Total num frames: 83959808. Throughput: 0: 12367.3. Samples: 83924720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:09:00,769][304334] Avg episode reward: [(0, '4687.985')] [2023-03-08 03:09:01,375][304623] Updated weights for policy 0, policy_version 164000 (0.0005) [2023-03-08 03:09:04,611][304623] Updated weights for policy 0, policy_version 164080 (0.0005) [2023-03-08 03:09:05,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12356.3, 300 sec: 13176.6). Total num frames: 84021248. Throughput: 0: 12433.9. Samples: 84000780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:09:05,769][304334] Avg episode reward: [(0, '4703.152')] [2023-03-08 03:09:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000164104_84021248.pth... [2023-03-08 03:09:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000163376_83648512.pth [2023-03-08 03:09:07,830][304623] Updated weights for policy 0, policy_version 164160 (0.0005) [2023-03-08 03:09:10,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12424.5, 300 sec: 13148.9). Total num frames: 84082688. Throughput: 0: 12438.7. Samples: 84075840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:09:10,769][304334] Avg episode reward: [(0, '4713.632')] [2023-03-08 03:09:11,171][304623] Updated weights for policy 0, policy_version 164240 (0.0005) [2023-03-08 03:09:14,490][304623] Updated weights for policy 0, policy_version 164320 (0.0005) [2023-03-08 03:09:15,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 13148.9). Total num frames: 84148224. Throughput: 0: 12431.8. Samples: 84112108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:09:15,769][304334] Avg episode reward: [(0, '4689.454')] [2023-03-08 03:09:17,724][304623] Updated weights for policy 0, policy_version 164400 (0.0005) [2023-03-08 03:09:20,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12492.8, 300 sec: 13121.1). Total num frames: 84209664. Throughput: 0: 12490.6. Samples: 84188376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:09:20,769][304334] Avg episode reward: [(0, '4692.318')] [2023-03-08 03:09:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000164472_84209664.pth... [2023-03-08 03:09:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000163736_83832832.pth [2023-03-08 03:09:21,064][304623] Updated weights for policy 0, policy_version 164480 (0.0005) [2023-03-08 03:09:24,342][304623] Updated weights for policy 0, policy_version 164560 (0.0005) [2023-03-08 03:09:25,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 13093.3). Total num frames: 84271104. Throughput: 0: 12470.0. Samples: 84262912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:09:25,769][304334] Avg episode reward: [(0, '4714.877')] [2023-03-08 03:09:27,758][304623] Updated weights for policy 0, policy_version 164640 (0.0005) [2023-03-08 03:09:30,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12424.5, 300 sec: 13065.5). Total num frames: 84332544. Throughput: 0: 12450.2. Samples: 84298884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:09:30,769][304334] Avg episode reward: [(0, '4644.100')] [2023-03-08 03:09:31,060][304623] Updated weights for policy 0, policy_version 164720 (0.0005) [2023-03-08 03:09:34,350][304623] Updated weights for policy 0, policy_version 164800 (0.0005) [2023-03-08 03:09:35,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 13037.8). Total num frames: 84393984. Throughput: 0: 12468.5. Samples: 84373504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:09:35,769][304334] Avg episode reward: [(0, '4689.912')] [2023-03-08 03:09:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000164832_84393984.pth... [2023-03-08 03:09:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000164104_84021248.pth [2023-03-08 03:09:37,608][304623] Updated weights for policy 0, policy_version 164880 (0.0005) [2023-03-08 03:09:40,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12424.6, 300 sec: 13023.9). Total num frames: 84455424. Throughput: 0: 12461.0. Samples: 84448344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:09:40,769][304334] Avg episode reward: [(0, '4694.157')] [2023-03-08 03:09:40,852][304623] Updated weights for policy 0, policy_version 164960 (0.0005) [2023-03-08 03:09:44,063][304623] Updated weights for policy 0, policy_version 165040 (0.0005) [2023-03-08 03:09:45,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 13010.0). Total num frames: 84520960. Throughput: 0: 12492.4. Samples: 84486876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:09:45,769][304334] Avg episode reward: [(0, '4696.543')] [2023-03-08 03:09:47,344][304623] Updated weights for policy 0, policy_version 165120 (0.0005) [2023-03-08 03:09:50,595][304623] Updated weights for policy 0, policy_version 165200 (0.0005) [2023-03-08 03:09:50,769][304334] Fps is (10 sec: 12697.4, 60 sec: 12492.8, 300 sec: 12982.2). Total num frames: 84582400. Throughput: 0: 12471.2. Samples: 84561984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:09:50,769][304334] Avg episode reward: [(0, '4710.627')] [2023-03-08 03:09:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000165200_84582400.pth... [2023-03-08 03:09:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000164472_84209664.pth [2023-03-08 03:09:53,848][304623] Updated weights for policy 0, policy_version 165280 (0.0005) [2023-03-08 03:09:55,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12982.2). Total num frames: 84647936. Throughput: 0: 12501.0. Samples: 84638384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:09:55,769][304334] Avg episode reward: [(0, '4698.174')] [2023-03-08 03:09:56,916][304623] Updated weights for policy 0, policy_version 165360 (0.0003) [2023-03-08 03:09:59,917][304623] Updated weights for policy 0, policy_version 165440 (0.0003) [2023-03-08 03:10:00,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12561.1, 300 sec: 12968.4). Total num frames: 84713472. Throughput: 0: 12595.2. Samples: 84678892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:10:00,769][304334] Avg episode reward: [(0, '4703.184')] [2023-03-08 03:10:02,927][304623] Updated weights for policy 0, policy_version 165520 (0.0003) [2023-03-08 03:10:05,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12697.6, 300 sec: 12968.4). Total num frames: 84783104. Throughput: 0: 12721.6. Samples: 84760848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:10:05,769][304334] Avg episode reward: [(0, '4697.346')] [2023-03-08 03:10:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000165592_84783104.pth... [2023-03-08 03:10:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000164832_84393984.pth [2023-03-08 03:10:05,852][304623] Updated weights for policy 0, policy_version 165600 (0.0003) [2023-03-08 03:10:08,948][304623] Updated weights for policy 0, policy_version 165680 (0.0003) [2023-03-08 03:10:10,769][304334] Fps is (10 sec: 13926.5, 60 sec: 12834.1, 300 sec: 12968.4). Total num frames: 84852736. Throughput: 0: 12869.3. Samples: 84842028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:10:10,769][304334] Avg episode reward: [(0, '4712.691')] [2023-03-08 03:10:11,895][304623] Updated weights for policy 0, policy_version 165760 (0.0003) [2023-03-08 03:10:14,819][304623] Updated weights for policy 0, policy_version 165840 (0.0003) [2023-03-08 03:10:15,769][304334] Fps is (10 sec: 13926.5, 60 sec: 12902.4, 300 sec: 12982.2). Total num frames: 84922368. Throughput: 0: 12996.7. Samples: 84883736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:10:15,769][304334] Avg episode reward: [(0, '4718.559')] [2023-03-08 03:10:17,803][304623] Updated weights for policy 0, policy_version 165920 (0.0003) [2023-03-08 03:10:20,710][304623] Updated weights for policy 0, policy_version 166000 (0.0003) [2023-03-08 03:10:20,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13038.9, 300 sec: 12982.2). Total num frames: 84992000. Throughput: 0: 13199.6. Samples: 84967488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:10:20,769][304334] Avg episode reward: [(0, '4690.448')] [2023-03-08 03:10:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000166000_84992000.pth... [2023-03-08 03:10:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000165200_84582400.pth [2023-03-08 03:10:23,683][304623] Updated weights for policy 0, policy_version 166080 (0.0003) [2023-03-08 03:10:25,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13107.2, 300 sec: 12968.4). Total num frames: 85057536. Throughput: 0: 13386.9. Samples: 85050756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:10:25,769][304334] Avg episode reward: [(0, '4712.600')] [2023-03-08 03:10:26,668][304623] Updated weights for policy 0, policy_version 166160 (0.0003) [2023-03-08 03:10:29,737][304623] Updated weights for policy 0, policy_version 166240 (0.0003) [2023-03-08 03:10:30,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13243.7, 300 sec: 12982.2). Total num frames: 85127168. Throughput: 0: 13423.6. Samples: 85090940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:10:30,769][304334] Avg episode reward: [(0, '4710.319')] [2023-03-08 03:10:32,777][304623] Updated weights for policy 0, policy_version 166320 (0.0003) [2023-03-08 03:10:35,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13312.0, 300 sec: 12996.1). Total num frames: 85192704. Throughput: 0: 13550.0. Samples: 85171736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:10:35,769][304334] Avg episode reward: [(0, '4708.238')] [2023-03-08 03:10:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000166392_85192704.pth... [2023-03-08 03:10:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000165592_84783104.pth [2023-03-08 03:10:35,820][304623] Updated weights for policy 0, policy_version 166400 (0.0003) [2023-03-08 03:10:38,867][304623] Updated weights for policy 0, policy_version 166480 (0.0004) [2023-03-08 03:10:40,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13023.9). Total num frames: 85262336. Throughput: 0: 13648.7. Samples: 85252576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:10:40,769][304334] Avg episode reward: [(0, '4713.997')] [2023-03-08 03:10:41,893][304623] Updated weights for policy 0, policy_version 166560 (0.0003) [2023-03-08 03:10:44,944][304623] Updated weights for policy 0, policy_version 166640 (0.0003) [2023-03-08 03:10:45,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13037.8). Total num frames: 85327872. Throughput: 0: 13660.1. Samples: 85293596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:10:45,769][304334] Avg episode reward: [(0, '4705.591')] [2023-03-08 03:10:48,306][304623] Updated weights for policy 0, policy_version 166720 (0.0005) [2023-03-08 03:10:50,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13448.5, 300 sec: 13023.9). Total num frames: 85389312. Throughput: 0: 13512.4. Samples: 85368904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:10:50,769][304334] Avg episode reward: [(0, '4705.383')] [2023-03-08 03:10:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000166776_85389312.pth... [2023-03-08 03:10:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000166000_84992000.pth [2023-03-08 03:10:51,607][304623] Updated weights for policy 0, policy_version 166800 (0.0005) [2023-03-08 03:10:54,997][304623] Updated weights for policy 0, policy_version 166880 (0.0005) [2023-03-08 03:10:55,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13380.3, 300 sec: 13010.0). Total num frames: 85450752. Throughput: 0: 13345.6. Samples: 85442580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:10:55,769][304334] Avg episode reward: [(0, '4700.622')] [2023-03-08 03:10:58,310][304623] Updated weights for policy 0, policy_version 166960 (0.0005) [2023-03-08 03:11:00,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13312.0, 300 sec: 12996.1). Total num frames: 85512192. Throughput: 0: 13238.9. Samples: 85479488. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:11:00,769][304334] Avg episode reward: [(0, '4707.907')] [2023-03-08 03:11:01,594][304623] Updated weights for policy 0, policy_version 167040 (0.0005) [2023-03-08 03:11:04,992][304623] Updated weights for policy 0, policy_version 167120 (0.0005) [2023-03-08 03:11:05,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13175.5, 300 sec: 12982.2). Total num frames: 85573632. Throughput: 0: 13016.2. Samples: 85553216. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:11:05,769][304334] Avg episode reward: [(0, '4688.940')] [2023-03-08 03:11:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000167136_85573632.pth... [2023-03-08 03:11:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000166392_85192704.pth [2023-03-08 03:11:08,336][304623] Updated weights for policy 0, policy_version 167200 (0.0005) [2023-03-08 03:11:10,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13038.9, 300 sec: 12982.2). Total num frames: 85635072. Throughput: 0: 12802.8. Samples: 85626880. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:11:10,769][304334] Avg episode reward: [(0, '4697.877')] [2023-03-08 03:11:11,696][304623] Updated weights for policy 0, policy_version 167280 (0.0005) [2023-03-08 03:11:15,041][304623] Updated weights for policy 0, policy_version 167360 (0.0005) [2023-03-08 03:11:15,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12902.4, 300 sec: 12982.2). Total num frames: 85696512. Throughput: 0: 12729.3. Samples: 85663760. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:11:15,769][304334] Avg episode reward: [(0, '4712.939')] [2023-03-08 03:11:18,418][304623] Updated weights for policy 0, policy_version 167440 (0.0005) [2023-03-08 03:11:20,769][304334] Fps is (10 sec: 11878.5, 60 sec: 12697.6, 300 sec: 12968.4). Total num frames: 85753856. Throughput: 0: 12543.7. Samples: 85736200. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:11:20,769][304334] Avg episode reward: [(0, '4709.089')] [2023-03-08 03:11:20,775][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000167496_85757952.pth... [2023-03-08 03:11:20,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000166776_85389312.pth [2023-03-08 03:11:21,794][304623] Updated weights for policy 0, policy_version 167520 (0.0005) [2023-03-08 03:11:25,194][304623] Updated weights for policy 0, policy_version 167600 (0.0005) [2023-03-08 03:11:25,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12629.3, 300 sec: 12968.4). Total num frames: 85815296. Throughput: 0: 12352.0. Samples: 85808416. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:11:25,769][304334] Avg episode reward: [(0, '4694.446')] [2023-03-08 03:11:28,550][304623] Updated weights for policy 0, policy_version 167680 (0.0005) [2023-03-08 03:11:30,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12492.8, 300 sec: 12968.4). Total num frames: 85876736. Throughput: 0: 12259.8. Samples: 85845288. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:11:30,769][304334] Avg episode reward: [(0, '4712.446')] [2023-03-08 03:11:31,860][304623] Updated weights for policy 0, policy_version 167760 (0.0005) [2023-03-08 03:11:35,072][304623] Updated weights for policy 0, policy_version 167840 (0.0005) [2023-03-08 03:11:35,769][304334] Fps is (10 sec: 12697.4, 60 sec: 12492.8, 300 sec: 12968.3). Total num frames: 85942272. Throughput: 0: 12261.3. Samples: 85920664. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:11:35,770][304334] Avg episode reward: [(0, '4699.226')] [2023-03-08 03:11:35,774][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000167856_85942272.pth... [2023-03-08 03:11:35,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000167136_85573632.pth [2023-03-08 03:11:38,402][304623] Updated weights for policy 0, policy_version 167920 (0.0005) [2023-03-08 03:11:40,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12356.3, 300 sec: 12940.6). Total num frames: 86003712. Throughput: 0: 12262.5. Samples: 85994392. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:11:40,769][304334] Avg episode reward: [(0, '4687.378')] [2023-03-08 03:11:41,694][304623] Updated weights for policy 0, policy_version 168000 (0.0005) [2023-03-08 03:11:45,018][304623] Updated weights for policy 0, policy_version 168080 (0.0005) [2023-03-08 03:11:45,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 12912.8). Total num frames: 86065152. Throughput: 0: 12275.1. Samples: 86031868. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:11:45,769][304334] Avg episode reward: [(0, '4656.487')] [2023-03-08 03:11:48,387][304623] Updated weights for policy 0, policy_version 168160 (0.0005) [2023-03-08 03:11:50,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 12885.0). Total num frames: 86126592. Throughput: 0: 12271.0. Samples: 86105412. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:11:50,770][304334] Avg episode reward: [(0, '4667.098')] [2023-03-08 03:11:50,774][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000168216_86126592.pth... [2023-03-08 03:11:50,777][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000167496_85757952.pth [2023-03-08 03:11:51,763][304623] Updated weights for policy 0, policy_version 168240 (0.0005) [2023-03-08 03:11:55,122][304623] Updated weights for policy 0, policy_version 168320 (0.0005) [2023-03-08 03:11:55,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12857.3). Total num frames: 86183936. Throughput: 0: 12254.9. Samples: 86178352. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:11:55,769][304334] Avg episode reward: [(0, '4654.026')] [2023-03-08 03:11:58,404][304623] Updated weights for policy 0, policy_version 168400 (0.0005) [2023-03-08 03:12:00,769][304334] Fps is (10 sec: 12288.2, 60 sec: 12288.0, 300 sec: 12843.4). Total num frames: 86249472. Throughput: 0: 12274.7. Samples: 86216120. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:12:00,769][304334] Avg episode reward: [(0, '4681.272')] [2023-03-08 03:12:01,683][304623] Updated weights for policy 0, policy_version 168480 (0.0005) [2023-03-08 03:12:05,054][304623] Updated weights for policy 0, policy_version 168560 (0.0005) [2023-03-08 03:12:05,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12288.0, 300 sec: 12815.6). Total num frames: 86310912. Throughput: 0: 12315.3. Samples: 86290392. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:12:05,769][304334] Avg episode reward: [(0, '4692.699')] [2023-03-08 03:12:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000168576_86310912.pth... [2023-03-08 03:12:05,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000167856_85942272.pth [2023-03-08 03:12:08,350][304623] Updated weights for policy 0, policy_version 168640 (0.0005) [2023-03-08 03:12:10,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12787.9). Total num frames: 86372352. Throughput: 0: 12351.3. Samples: 86364224. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:12:10,769][304334] Avg episode reward: [(0, '4706.043')] [2023-03-08 03:12:11,614][304623] Updated weights for policy 0, policy_version 168720 (0.0005) [2023-03-08 03:12:14,982][304623] Updated weights for policy 0, policy_version 168800 (0.0005) [2023-03-08 03:12:15,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 12760.1). Total num frames: 86433792. Throughput: 0: 12350.0. Samples: 86401040. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:12:15,769][304334] Avg episode reward: [(0, '4691.600')] [2023-03-08 03:12:18,324][304623] Updated weights for policy 0, policy_version 168880 (0.0005) [2023-03-08 03:12:20,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12746.2). Total num frames: 86495232. Throughput: 0: 12313.1. Samples: 86474752. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:12:20,769][304334] Avg episode reward: [(0, '4683.616')] [2023-03-08 03:12:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000168936_86495232.pth... [2023-03-08 03:12:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000168216_86126592.pth [2023-03-08 03:12:21,677][304623] Updated weights for policy 0, policy_version 168960 (0.0005) [2023-03-08 03:12:24,945][304623] Updated weights for policy 0, policy_version 169040 (0.0005) [2023-03-08 03:12:25,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12718.4). Total num frames: 86556672. Throughput: 0: 12314.7. Samples: 86548552. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:12:25,769][304334] Avg episode reward: [(0, '4688.900')] [2023-03-08 03:12:28,217][304623] Updated weights for policy 0, policy_version 169120 (0.0005) [2023-03-08 03:12:30,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 12704.5). Total num frames: 86618112. Throughput: 0: 12314.6. Samples: 86586024. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:12:30,769][304334] Avg episode reward: [(0, '4695.783')] [2023-03-08 03:12:31,630][304623] Updated weights for policy 0, policy_version 169200 (0.0005) [2023-03-08 03:12:34,780][304623] Updated weights for policy 0, policy_version 169280 (0.0005) [2023-03-08 03:12:35,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12356.3, 300 sec: 12690.7). Total num frames: 86683648. Throughput: 0: 12313.5. Samples: 86659516. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:12:35,769][304334] Avg episode reward: [(0, '4690.059')] [2023-03-08 03:12:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000169304_86683648.pth... [2023-03-08 03:12:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000168576_86310912.pth [2023-03-08 03:12:37,794][304623] Updated weights for policy 0, policy_version 169360 (0.0003) [2023-03-08 03:12:40,761][304623] Updated weights for policy 0, policy_version 169440 (0.0003) [2023-03-08 03:12:40,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12492.8, 300 sec: 12690.7). Total num frames: 86753280. Throughput: 0: 12516.6. Samples: 86741600. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:12:40,769][304334] Avg episode reward: [(0, '4719.558')] [2023-03-08 03:12:43,772][304623] Updated weights for policy 0, policy_version 169520 (0.0003) [2023-03-08 03:12:45,769][304334] Fps is (10 sec: 13516.9, 60 sec: 12561.1, 300 sec: 12690.7). Total num frames: 86818816. Throughput: 0: 12606.4. Samples: 86783408. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:12:45,769][304334] Avg episode reward: [(0, '4701.040')] [2023-03-08 03:12:46,752][304623] Updated weights for policy 0, policy_version 169600 (0.0003) [2023-03-08 03:12:49,864][304623] Updated weights for policy 0, policy_version 169680 (0.0003) [2023-03-08 03:12:50,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12697.6, 300 sec: 12690.7). Total num frames: 86888448. Throughput: 0: 12759.0. Samples: 86864548. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:12:50,769][304334] Avg episode reward: [(0, '4698.328')] [2023-03-08 03:12:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000169704_86888448.pth... [2023-03-08 03:12:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000168936_86495232.pth [2023-03-08 03:12:52,828][304623] Updated weights for policy 0, policy_version 169760 (0.0003) [2023-03-08 03:12:55,756][304623] Updated weights for policy 0, policy_version 169840 (0.0004) [2023-03-08 03:12:55,769][304334] Fps is (10 sec: 13926.4, 60 sec: 12902.4, 300 sec: 12690.7). Total num frames: 86958080. Throughput: 0: 12951.5. Samples: 86947040. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:12:55,769][304334] Avg episode reward: [(0, '4693.380')] [2023-03-08 03:12:58,783][304623] Updated weights for policy 0, policy_version 169920 (0.0003) [2023-03-08 03:13:00,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12902.4, 300 sec: 12690.7). Total num frames: 87023616. Throughput: 0: 13035.4. Samples: 86987632. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:13:00,769][304334] Avg episode reward: [(0, '4688.613')] [2023-03-08 03:13:01,741][304623] Updated weights for policy 0, policy_version 170000 (0.0003) [2023-03-08 03:13:04,727][304623] Updated weights for policy 0, policy_version 170080 (0.0003) [2023-03-08 03:13:05,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13038.9, 300 sec: 12732.3). Total num frames: 87093248. Throughput: 0: 13262.8. Samples: 87071576. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 03:13:05,769][304334] Avg episode reward: [(0, '4649.221')] [2023-03-08 03:13:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000170104_87093248.pth... [2023-03-08 03:13:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000169304_86683648.pth [2023-03-08 03:13:07,715][304623] Updated weights for policy 0, policy_version 170160 (0.0003) [2023-03-08 03:13:10,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13107.2, 300 sec: 12746.2). Total num frames: 87158784. Throughput: 0: 13410.2. Samples: 87152008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:13:10,769][304334] Avg episode reward: [(0, '4684.715')] [2023-03-08 03:13:10,788][304623] Updated weights for policy 0, policy_version 170240 (0.0003) [2023-03-08 03:13:13,730][304623] Updated weights for policy 0, policy_version 170320 (0.0003) [2023-03-08 03:13:15,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13243.7, 300 sec: 12774.0). Total num frames: 87228416. Throughput: 0: 13492.2. Samples: 87193172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:13:15,769][304334] Avg episode reward: [(0, '4662.035')] [2023-03-08 03:13:16,755][304623] Updated weights for policy 0, policy_version 170400 (0.0003) [2023-03-08 03:13:19,811][304623] Updated weights for policy 0, policy_version 170480 (0.0003) [2023-03-08 03:13:20,769][304334] Fps is (10 sec: 13926.2, 60 sec: 13380.3, 300 sec: 12787.8). Total num frames: 87298048. Throughput: 0: 13664.8. Samples: 87274432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:13:20,769][304334] Avg episode reward: [(0, '4681.703')] [2023-03-08 03:13:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000170504_87298048.pth... [2023-03-08 03:13:20,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000169704_86888448.pth [2023-03-08 03:13:22,816][304623] Updated weights for policy 0, policy_version 170560 (0.0003) [2023-03-08 03:13:25,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 12801.7). Total num frames: 87363584. Throughput: 0: 13640.0. Samples: 87355400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:13:25,769][304334] Avg episode reward: [(0, '4664.456')] [2023-03-08 03:13:25,867][304623] Updated weights for policy 0, policy_version 170640 (0.0003) [2023-03-08 03:13:28,845][304623] Updated weights for policy 0, policy_version 170720 (0.0003) [2023-03-08 03:13:30,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13585.1, 300 sec: 12829.5). Total num frames: 87433216. Throughput: 0: 13622.4. Samples: 87396416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:13:30,769][304334] Avg episode reward: [(0, '4674.477')] [2023-03-08 03:13:31,865][304623] Updated weights for policy 0, policy_version 170800 (0.0003) [2023-03-08 03:13:34,830][304623] Updated weights for policy 0, policy_version 170880 (0.0003) [2023-03-08 03:13:35,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13653.3, 300 sec: 12857.3). Total num frames: 87502848. Throughput: 0: 13639.7. Samples: 87478336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:13:35,769][304334] Avg episode reward: [(0, '4641.175')] [2023-03-08 03:13:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000170904_87502848.pth... [2023-03-08 03:13:35,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000170104_87093248.pth [2023-03-08 03:13:37,913][304623] Updated weights for policy 0, policy_version 170960 (0.0003) [2023-03-08 03:13:40,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 12871.2). Total num frames: 87568384. Throughput: 0: 13624.8. Samples: 87560156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:13:40,769][304334] Avg episode reward: [(0, '4685.532')] [2023-03-08 03:13:40,858][304623] Updated weights for policy 0, policy_version 171040 (0.0003) [2023-03-08 03:13:43,834][304623] Updated weights for policy 0, policy_version 171120 (0.0003) [2023-03-08 03:13:45,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 12898.9). Total num frames: 87638016. Throughput: 0: 13635.5. Samples: 87601228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:13:45,769][304334] Avg episode reward: [(0, '4712.147')] [2023-03-08 03:13:46,880][304623] Updated weights for policy 0, policy_version 171200 (0.0003) [2023-03-08 03:13:49,860][304623] Updated weights for policy 0, policy_version 171280 (0.0003) [2023-03-08 03:13:50,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13585.1, 300 sec: 12912.8). Total num frames: 87703552. Throughput: 0: 13590.2. Samples: 87683136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:13:50,769][304334] Avg episode reward: [(0, '4675.885')] [2023-03-08 03:13:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000171296_87703552.pth... [2023-03-08 03:13:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000170504_87298048.pth [2023-03-08 03:13:53,095][304623] Updated weights for policy 0, policy_version 171360 (0.0005) [2023-03-08 03:13:55,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13516.8, 300 sec: 12912.8). Total num frames: 87769088. Throughput: 0: 13504.7. Samples: 87759720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:13:55,769][304334] Avg episode reward: [(0, '4692.372')] [2023-03-08 03:13:56,430][304623] Updated weights for policy 0, policy_version 171440 (0.0005) [2023-03-08 03:13:59,743][304623] Updated weights for policy 0, policy_version 171520 (0.0005) [2023-03-08 03:14:00,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13448.5, 300 sec: 12912.8). Total num frames: 87830528. Throughput: 0: 13423.7. Samples: 87797240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:14:00,769][304334] Avg episode reward: [(0, '4692.074')] [2023-03-08 03:14:03,062][304623] Updated weights for policy 0, policy_version 171600 (0.0005) [2023-03-08 03:14:05,769][304334] Fps is (10 sec: 12287.9, 60 sec: 13312.0, 300 sec: 12912.8). Total num frames: 87891968. Throughput: 0: 13258.4. Samples: 87871060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:14:05,769][304334] Avg episode reward: [(0, '4707.001')] [2023-03-08 03:14:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000171664_87891968.pth... [2023-03-08 03:14:05,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000170904_87502848.pth [2023-03-08 03:14:06,295][304623] Updated weights for policy 0, policy_version 171680 (0.0005) [2023-03-08 03:14:09,644][304623] Updated weights for policy 0, policy_version 171760 (0.0005) [2023-03-08 03:14:10,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13243.7, 300 sec: 12898.9). Total num frames: 87953408. Throughput: 0: 13108.4. Samples: 87945280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:14:10,769][304334] Avg episode reward: [(0, '4655.935')] [2023-03-08 03:14:12,963][304623] Updated weights for policy 0, policy_version 171840 (0.0005) [2023-03-08 03:14:15,769][304334] Fps is (10 sec: 12288.1, 60 sec: 13107.2, 300 sec: 12898.9). Total num frames: 88014848. Throughput: 0: 13016.2. Samples: 87982144. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:14:15,769][304334] Avg episode reward: [(0, '4686.047')] [2023-03-08 03:14:16,299][304623] Updated weights for policy 0, policy_version 171920 (0.0005) [2023-03-08 03:14:19,510][304623] Updated weights for policy 0, policy_version 172000 (0.0005) [2023-03-08 03:14:20,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12970.7, 300 sec: 12898.9). Total num frames: 88076288. Throughput: 0: 12860.9. Samples: 88057076. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:14:20,769][304334] Avg episode reward: [(0, '4703.503')] [2023-03-08 03:14:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000172024_88076288.pth... [2023-03-08 03:14:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000171296_87703552.pth [2023-03-08 03:14:22,764][304623] Updated weights for policy 0, policy_version 172080 (0.0005) [2023-03-08 03:14:25,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12970.7, 300 sec: 12912.8). Total num frames: 88141824. Throughput: 0: 12723.5. Samples: 88132712. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:14:25,769][304334] Avg episode reward: [(0, '4689.892')] [2023-03-08 03:14:26,041][304623] Updated weights for policy 0, policy_version 172160 (0.0005) [2023-03-08 03:14:29,290][304623] Updated weights for policy 0, policy_version 172240 (0.0005) [2023-03-08 03:14:30,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12834.1, 300 sec: 12912.8). Total num frames: 88203264. Throughput: 0: 12651.8. Samples: 88170560. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:14:30,769][304334] Avg episode reward: [(0, '4693.939')] [2023-03-08 03:14:32,650][304623] Updated weights for policy 0, policy_version 172320 (0.0005) [2023-03-08 03:14:35,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12697.6, 300 sec: 12912.8). Total num frames: 88264704. Throughput: 0: 12470.2. Samples: 88244296. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:14:35,769][304334] Avg episode reward: [(0, '4690.697')] [2023-03-08 03:14:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000172392_88264704.pth... [2023-03-08 03:14:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000171664_87891968.pth [2023-03-08 03:14:35,944][304623] Updated weights for policy 0, policy_version 172400 (0.0005) [2023-03-08 03:14:39,226][304623] Updated weights for policy 0, policy_version 172480 (0.0005) [2023-03-08 03:14:40,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12629.3, 300 sec: 12898.9). Total num frames: 88326144. Throughput: 0: 12435.0. Samples: 88319296. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:14:40,769][304334] Avg episode reward: [(0, '4657.037')] [2023-03-08 03:14:42,372][304623] Updated weights for policy 0, policy_version 172560 (0.0005) [2023-03-08 03:14:45,404][304623] Updated weights for policy 0, policy_version 172640 (0.0004) [2023-03-08 03:14:45,769][304334] Fps is (10 sec: 13107.3, 60 sec: 12629.3, 300 sec: 12926.7). Total num frames: 88395776. Throughput: 0: 12481.6. Samples: 88358912. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:14:45,769][304334] Avg episode reward: [(0, '4605.647')] [2023-03-08 03:14:48,335][304623] Updated weights for policy 0, policy_version 172720 (0.0004) [2023-03-08 03:14:50,769][304334] Fps is (10 sec: 13516.9, 60 sec: 12629.4, 300 sec: 12926.7). Total num frames: 88461312. Throughput: 0: 12663.1. Samples: 88440896. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:14:50,769][304334] Avg episode reward: [(0, '4655.492')] [2023-03-08 03:14:50,798][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000172784_88465408.pth... [2023-03-08 03:14:50,800][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000172024_88076288.pth [2023-03-08 03:14:51,418][304623] Updated weights for policy 0, policy_version 172800 (0.0005) [2023-03-08 03:14:54,337][304623] Updated weights for policy 0, policy_version 172880 (0.0004) [2023-03-08 03:14:55,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12697.6, 300 sec: 12940.6). Total num frames: 88530944. Throughput: 0: 12834.3. Samples: 88522824. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:14:55,769][304334] Avg episode reward: [(0, '4650.856')] [2023-03-08 03:14:57,342][304623] Updated weights for policy 0, policy_version 172960 (0.0004) [2023-03-08 03:15:00,221][304623] Updated weights for policy 0, policy_version 173040 (0.0004) [2023-03-08 03:15:00,769][304334] Fps is (10 sec: 13926.3, 60 sec: 12834.1, 300 sec: 12940.6). Total num frames: 88600576. Throughput: 0: 12933.4. Samples: 88564148. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:15:00,769][304334] Avg episode reward: [(0, '4667.594')] [2023-03-08 03:15:03,226][304623] Updated weights for policy 0, policy_version 173120 (0.0004) [2023-03-08 03:15:05,769][304334] Fps is (10 sec: 13926.3, 60 sec: 12970.7, 300 sec: 12940.6). Total num frames: 88670208. Throughput: 0: 13120.1. Samples: 88647480. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:15:05,769][304334] Avg episode reward: [(0, '4690.598')] [2023-03-08 03:15:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000173184_88670208.pth... [2023-03-08 03:15:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000172392_88264704.pth [2023-03-08 03:15:06,198][304623] Updated weights for policy 0, policy_version 173200 (0.0004) [2023-03-08 03:15:09,185][304623] Updated weights for policy 0, policy_version 173280 (0.0004) [2023-03-08 03:15:10,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13107.2, 300 sec: 12940.6). Total num frames: 88739840. Throughput: 0: 13266.3. Samples: 88729696. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:15:10,769][304334] Avg episode reward: [(0, '4697.034')] [2023-03-08 03:15:12,123][304623] Updated weights for policy 0, policy_version 173360 (0.0004) [2023-03-08 03:15:15,126][304623] Updated weights for policy 0, policy_version 173440 (0.0004) [2023-03-08 03:15:15,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13243.7, 300 sec: 12940.6). Total num frames: 88809472. Throughput: 0: 13369.7. Samples: 88772196. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:15:15,769][304334] Avg episode reward: [(0, '4690.563')] [2023-03-08 03:15:18,016][304623] Updated weights for policy 0, policy_version 173520 (0.0004) [2023-03-08 03:15:20,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13380.3, 300 sec: 12954.5). Total num frames: 88879104. Throughput: 0: 13589.5. Samples: 88855824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:15:20,769][304334] Avg episode reward: [(0, '4689.814')] [2023-03-08 03:15:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000173592_88879104.pth... [2023-03-08 03:15:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000172784_88465408.pth [2023-03-08 03:15:20,971][304623] Updated weights for policy 0, policy_version 173600 (0.0004) [2023-03-08 03:15:23,951][304623] Updated weights for policy 0, policy_version 173680 (0.0005) [2023-03-08 03:15:25,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 12940.6). Total num frames: 88944640. Throughput: 0: 13738.7. Samples: 88937536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:15:25,769][304334] Avg episode reward: [(0, '4698.827')] [2023-03-08 03:15:26,958][304623] Updated weights for policy 0, policy_version 173760 (0.0004) [2023-03-08 03:15:29,960][304623] Updated weights for policy 0, policy_version 173840 (0.0004) [2023-03-08 03:15:30,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 12954.5). Total num frames: 89014272. Throughput: 0: 13781.7. Samples: 88979088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:15:30,769][304334] Avg episode reward: [(0, '4711.575')] [2023-03-08 03:15:32,931][304623] Updated weights for policy 0, policy_version 173920 (0.0004) [2023-03-08 03:15:35,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13653.3, 300 sec: 12954.5). Total num frames: 89083904. Throughput: 0: 13771.8. Samples: 89060628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:15:35,769][304334] Avg episode reward: [(0, '4703.515')] [2023-03-08 03:15:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000173992_89083904.pth... [2023-03-08 03:15:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000173184_88670208.pth [2023-03-08 03:15:35,915][304623] Updated weights for policy 0, policy_version 174000 (0.0005) [2023-03-08 03:15:38,847][304623] Updated weights for policy 0, policy_version 174080 (0.0004) [2023-03-08 03:15:40,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 12968.4). Total num frames: 89153536. Throughput: 0: 13825.7. Samples: 89144980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:15:40,769][304334] Avg episode reward: [(0, '4685.033')] [2023-03-08 03:15:41,838][304623] Updated weights for policy 0, policy_version 174160 (0.0004) [2023-03-08 03:15:44,823][304623] Updated weights for policy 0, policy_version 174240 (0.0004) [2023-03-08 03:15:45,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 12996.1). Total num frames: 89223168. Throughput: 0: 13822.6. Samples: 89186164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:15:45,769][304334] Avg episode reward: [(0, '4689.205')] [2023-03-08 03:15:47,755][304623] Updated weights for policy 0, policy_version 174320 (0.0004) [2023-03-08 03:15:50,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13789.8, 300 sec: 13010.0). Total num frames: 89288704. Throughput: 0: 13794.6. Samples: 89268236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:15:50,769][304334] Avg episode reward: [(0, '4687.148')] [2023-03-08 03:15:50,831][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000174400_89292800.pth... [2023-03-08 03:15:50,832][304623] Updated weights for policy 0, policy_version 174400 (0.0005) [2023-03-08 03:15:50,833][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000173592_88879104.pth [2023-03-08 03:15:53,748][304623] Updated weights for policy 0, policy_version 174480 (0.0004) [2023-03-08 03:15:55,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13789.8, 300 sec: 13037.8). Total num frames: 89358336. Throughput: 0: 13789.1. Samples: 89350208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:15:55,769][304334] Avg episode reward: [(0, '4702.678')] [2023-03-08 03:15:56,718][304623] Updated weights for policy 0, policy_version 174560 (0.0004) [2023-03-08 03:15:59,689][304623] Updated weights for policy 0, policy_version 174640 (0.0004) [2023-03-08 03:16:00,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13065.5). Total num frames: 89427968. Throughput: 0: 13763.6. Samples: 89391560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:16:00,769][304334] Avg episode reward: [(0, '4717.458')] [2023-03-08 03:16:02,693][304623] Updated weights for policy 0, policy_version 174720 (0.0005) [2023-03-08 03:16:05,665][304623] Updated weights for policy 0, policy_version 174800 (0.0004) [2023-03-08 03:16:05,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13093.3). Total num frames: 89497600. Throughput: 0: 13727.9. Samples: 89473580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:16:05,769][304334] Avg episode reward: [(0, '4687.790')] [2023-03-08 03:16:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000174800_89497600.pth... [2023-03-08 03:16:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000173992_89083904.pth [2023-03-08 03:16:08,618][304623] Updated weights for policy 0, policy_version 174880 (0.0004) [2023-03-08 03:16:10,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13789.8, 300 sec: 13121.1). Total num frames: 89567232. Throughput: 0: 13756.1. Samples: 89556564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:16:10,769][304334] Avg episode reward: [(0, '4703.107')] [2023-03-08 03:16:11,662][304623] Updated weights for policy 0, policy_version 174960 (0.0004) [2023-03-08 03:16:14,633][304623] Updated weights for policy 0, policy_version 175040 (0.0004) [2023-03-08 03:16:15,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13721.6, 300 sec: 13148.9). Total num frames: 89632768. Throughput: 0: 13739.4. Samples: 89597360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:16:15,769][304334] Avg episode reward: [(0, '4696.411')] [2023-03-08 03:16:17,649][304623] Updated weights for policy 0, policy_version 175120 (0.0004) [2023-03-08 03:16:20,633][304623] Updated weights for policy 0, policy_version 175200 (0.0004) [2023-03-08 03:16:20,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13721.6, 300 sec: 13176.6). Total num frames: 89702400. Throughput: 0: 13744.5. Samples: 89679132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:16:20,769][304334] Avg episode reward: [(0, '4715.413')] [2023-03-08 03:16:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000175200_89702400.pth... [2023-03-08 03:16:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000174400_89292800.pth [2023-03-08 03:16:23,672][304623] Updated weights for policy 0, policy_version 175280 (0.0005) [2023-03-08 03:16:25,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13789.8, 300 sec: 13204.4). Total num frames: 89772032. Throughput: 0: 13694.3. Samples: 89761224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:16:25,769][304334] Avg episode reward: [(0, '4692.671')] [2023-03-08 03:16:26,659][304623] Updated weights for policy 0, policy_version 175360 (0.0004) [2023-03-08 03:16:29,553][304623] Updated weights for policy 0, policy_version 175440 (0.0004) [2023-03-08 03:16:30,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13218.3). Total num frames: 89841664. Throughput: 0: 13708.5. Samples: 89803048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:16:30,769][304334] Avg episode reward: [(0, '4725.547')] [2023-03-08 03:16:32,513][304623] Updated weights for policy 0, policy_version 175520 (0.0004) [2023-03-08 03:16:35,408][304623] Updated weights for policy 0, policy_version 175600 (0.0004) [2023-03-08 03:16:35,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13246.0). Total num frames: 89911296. Throughput: 0: 13745.5. Samples: 89886784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:16:35,769][304334] Avg episode reward: [(0, '4702.389')] [2023-03-08 03:16:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000175608_89911296.pth... [2023-03-08 03:16:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000174800_89497600.pth [2023-03-08 03:16:38,428][304623] Updated weights for policy 0, policy_version 175680 (0.0005) [2023-03-08 03:16:40,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13721.6, 300 sec: 13259.9). Total num frames: 89976832. Throughput: 0: 13744.3. Samples: 89968704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:16:40,769][304334] Avg episode reward: [(0, '4694.843')] [2023-03-08 03:16:41,488][304623] Updated weights for policy 0, policy_version 175760 (0.0005) [2023-03-08 03:16:44,474][304623] Updated weights for policy 0, policy_version 175840 (0.0004) [2023-03-08 03:16:45,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13721.6, 300 sec: 13287.7). Total num frames: 90046464. Throughput: 0: 13735.6. Samples: 90009664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:16:45,769][304334] Avg episode reward: [(0, '4697.205')] [2023-03-08 03:16:47,465][304623] Updated weights for policy 0, policy_version 175920 (0.0004) [2023-03-08 03:16:50,463][304623] Updated weights for policy 0, policy_version 176000 (0.0005) [2023-03-08 03:16:50,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13721.6, 300 sec: 13315.5). Total num frames: 90112000. Throughput: 0: 13732.0. Samples: 90091520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:16:50,769][304334] Avg episode reward: [(0, '4677.235')] [2023-03-08 03:16:50,771][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000176008_90116096.pth... [2023-03-08 03:16:50,773][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000175200_89702400.pth [2023-03-08 03:16:53,421][304623] Updated weights for policy 0, policy_version 176080 (0.0004) [2023-03-08 03:16:55,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13721.6, 300 sec: 13329.4). Total num frames: 90181632. Throughput: 0: 13712.9. Samples: 90173644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:16:55,769][304334] Avg episode reward: [(0, '4672.418')] [2023-03-08 03:16:56,381][304623] Updated weights for policy 0, policy_version 176160 (0.0004) [2023-03-08 03:16:59,394][304623] Updated weights for policy 0, policy_version 176240 (0.0004) [2023-03-08 03:17:00,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13721.6, 300 sec: 13357.1). Total num frames: 90251264. Throughput: 0: 13728.1. Samples: 90215124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:17:00,769][304334] Avg episode reward: [(0, '4676.294')] [2023-03-08 03:17:02,333][304623] Updated weights for policy 0, policy_version 176320 (0.0004) [2023-03-08 03:17:05,297][304623] Updated weights for policy 0, policy_version 176400 (0.0004) [2023-03-08 03:17:05,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13721.6, 300 sec: 13384.9). Total num frames: 90320896. Throughput: 0: 13776.0. Samples: 90299052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:17:05,769][304334] Avg episode reward: [(0, '4658.996')] [2023-03-08 03:17:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000176408_90320896.pth... [2023-03-08 03:17:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000175608_89911296.pth [2023-03-08 03:17:08,334][304623] Updated weights for policy 0, policy_version 176480 (0.0004) [2023-03-08 03:17:10,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13721.6, 300 sec: 13412.7). Total num frames: 90390528. Throughput: 0: 13743.6. Samples: 90379684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:17:10,769][304334] Avg episode reward: [(0, '4693.076')] [2023-03-08 03:17:11,340][304623] Updated weights for policy 0, policy_version 176560 (0.0004) [2023-03-08 03:17:14,361][304623] Updated weights for policy 0, policy_version 176640 (0.0003) [2023-03-08 03:17:15,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13721.6, 300 sec: 13426.6). Total num frames: 90456064. Throughput: 0: 13739.0. Samples: 90421304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:17:15,769][304334] Avg episode reward: [(0, '4707.237')] [2023-03-08 03:17:17,405][304623] Updated weights for policy 0, policy_version 176720 (0.0003) [2023-03-08 03:17:20,332][304623] Updated weights for policy 0, policy_version 176800 (0.0003) [2023-03-08 03:17:20,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13721.6, 300 sec: 13454.3). Total num frames: 90525696. Throughput: 0: 13681.2. Samples: 90502440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:17:20,769][304334] Avg episode reward: [(0, '4704.156')] [2023-03-08 03:17:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000176808_90525696.pth... [2023-03-08 03:17:20,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000176008_90116096.pth [2023-03-08 03:17:23,313][304623] Updated weights for policy 0, policy_version 176880 (0.0003) [2023-03-08 03:17:25,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13468.2). Total num frames: 90591232. Throughput: 0: 13669.6. Samples: 90583836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:17:25,769][304334] Avg episode reward: [(0, '4683.885')] [2023-03-08 03:17:26,406][304623] Updated weights for policy 0, policy_version 176960 (0.0003) [2023-03-08 03:17:29,347][304623] Updated weights for policy 0, policy_version 177040 (0.0003) [2023-03-08 03:17:30,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13482.1). Total num frames: 90660864. Throughput: 0: 13692.6. Samples: 90625832. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:17:30,769][304334] Avg episode reward: [(0, '4716.524')] [2023-03-08 03:17:32,351][304623] Updated weights for policy 0, policy_version 177120 (0.0004) [2023-03-08 03:17:35,576][304623] Updated weights for policy 0, policy_version 177200 (0.0004) [2023-03-08 03:17:35,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13585.1, 300 sec: 13468.2). Total num frames: 90726400. Throughput: 0: 13682.3. Samples: 90707224. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:17:35,769][304334] Avg episode reward: [(0, '4700.555')] [2023-03-08 03:17:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000177200_90726400.pth... [2023-03-08 03:17:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000176408_90320896.pth [2023-03-08 03:17:38,898][304623] Updated weights for policy 0, policy_version 177280 (0.0005) [2023-03-08 03:17:40,769][304334] Fps is (10 sec: 12697.7, 60 sec: 13516.8, 300 sec: 13454.3). Total num frames: 90787840. Throughput: 0: 13500.7. Samples: 90781176. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:17:40,769][304334] Avg episode reward: [(0, '4693.722')] [2023-03-08 03:17:42,190][304623] Updated weights for policy 0, policy_version 177360 (0.0004) [2023-03-08 03:17:45,436][304623] Updated weights for policy 0, policy_version 177440 (0.0005) [2023-03-08 03:17:45,769][304334] Fps is (10 sec: 12697.7, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 90853376. Throughput: 0: 13391.1. Samples: 90817724. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:17:45,769][304334] Avg episode reward: [(0, '4708.772')] [2023-03-08 03:17:48,409][304623] Updated weights for policy 0, policy_version 177520 (0.0003) [2023-03-08 03:17:50,769][304334] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 90918912. Throughput: 0: 13314.0. Samples: 90898184. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:17:50,769][304334] Avg episode reward: [(0, '4699.241')] [2023-03-08 03:17:50,795][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000177584_90923008.pth... [2023-03-08 03:17:50,797][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000176808_90525696.pth [2023-03-08 03:17:51,390][304623] Updated weights for policy 0, policy_version 177600 (0.0004) [2023-03-08 03:17:54,487][304623] Updated weights for policy 0, policy_version 177680 (0.0005) [2023-03-08 03:17:55,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 90988544. Throughput: 0: 13312.5. Samples: 90978748. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:17:55,769][304334] Avg episode reward: [(0, '4668.823')] [2023-03-08 03:17:57,484][304623] Updated weights for policy 0, policy_version 177760 (0.0004) [2023-03-08 03:18:00,472][304623] Updated weights for policy 0, policy_version 177840 (0.0004) [2023-03-08 03:18:00,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 91058176. Throughput: 0: 13307.6. Samples: 91020144. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:18:00,769][304334] Avg episode reward: [(0, '4717.895')] [2023-03-08 03:18:03,416][304623] Updated weights for policy 0, policy_version 177920 (0.0003) [2023-03-08 03:18:05,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 91123712. Throughput: 0: 13351.0. Samples: 91103232. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:18:05,769][304334] Avg episode reward: [(0, '4717.874')] [2023-03-08 03:18:05,780][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000177984_91127808.pth... [2023-03-08 03:18:05,782][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000177200_90726400.pth [2023-03-08 03:18:06,373][304623] Updated weights for policy 0, policy_version 178000 (0.0004) [2023-03-08 03:18:09,433][304623] Updated weights for policy 0, policy_version 178080 (0.0004) [2023-03-08 03:18:10,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 91193344. Throughput: 0: 13355.4. Samples: 91184828. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:18:10,769][304334] Avg episode reward: [(0, '4704.360')] [2023-03-08 03:18:12,366][304623] Updated weights for policy 0, policy_version 178160 (0.0004) [2023-03-08 03:18:15,371][304623] Updated weights for policy 0, policy_version 178240 (0.0004) [2023-03-08 03:18:15,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 91262976. Throughput: 0: 13339.7. Samples: 91226120. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:18:15,769][304334] Avg episode reward: [(0, '4692.284')] [2023-03-08 03:18:18,333][304623] Updated weights for policy 0, policy_version 178320 (0.0003) [2023-03-08 03:18:20,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 91328512. Throughput: 0: 13352.7. Samples: 91308096. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:18:20,769][304334] Avg episode reward: [(0, '4696.417')] [2023-03-08 03:18:20,793][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000178384_91332608.pth... [2023-03-08 03:18:20,794][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000177584_90923008.pth [2023-03-08 03:18:21,421][304623] Updated weights for policy 0, policy_version 178400 (0.0004) [2023-03-08 03:18:24,473][304623] Updated weights for policy 0, policy_version 178480 (0.0004) [2023-03-08 03:18:25,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 91398144. Throughput: 0: 13503.8. Samples: 91388848. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:18:25,769][304334] Avg episode reward: [(0, '4657.995')] [2023-03-08 03:18:27,422][304623] Updated weights for policy 0, policy_version 178560 (0.0003) [2023-03-08 03:18:30,375][304623] Updated weights for policy 0, policy_version 178640 (0.0003) [2023-03-08 03:18:30,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 91467776. Throughput: 0: 13613.2. Samples: 91430316. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:18:30,769][304334] Avg episode reward: [(0, '4703.335')] [2023-03-08 03:18:33,417][304623] Updated weights for policy 0, policy_version 178720 (0.0004) [2023-03-08 03:18:35,769][304334] Fps is (10 sec: 13516.6, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 91533312. Throughput: 0: 13646.4. Samples: 91512272. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:18:35,769][304334] Avg episode reward: [(0, '4685.606')] [2023-03-08 03:18:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000178776_91533312.pth... [2023-03-08 03:18:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000177984_91127808.pth [2023-03-08 03:18:36,478][304623] Updated weights for policy 0, policy_version 178800 (0.0004) [2023-03-08 03:18:39,441][304623] Updated weights for policy 0, policy_version 178880 (0.0004) [2023-03-08 03:18:40,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13585.0, 300 sec: 13440.4). Total num frames: 91602944. Throughput: 0: 13670.2. Samples: 91593908. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:18:40,769][304334] Avg episode reward: [(0, '4719.564')] [2023-03-08 03:18:42,440][304623] Updated weights for policy 0, policy_version 178960 (0.0004) [2023-03-08 03:18:45,470][304623] Updated weights for policy 0, policy_version 179040 (0.0004) [2023-03-08 03:18:45,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13653.3, 300 sec: 13454.3). Total num frames: 91672576. Throughput: 0: 13659.0. Samples: 91634800. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:18:45,769][304334] Avg episode reward: [(0, '4674.029')] [2023-03-08 03:18:48,471][304623] Updated weights for policy 0, policy_version 179120 (0.0004) [2023-03-08 03:18:50,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13454.3). Total num frames: 91738112. Throughput: 0: 13622.2. Samples: 91716232. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:18:50,769][304334] Avg episode reward: [(0, '4685.175')] [2023-03-08 03:18:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000179176_91738112.pth... [2023-03-08 03:18:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000178384_91332608.pth [2023-03-08 03:18:51,490][304623] Updated weights for policy 0, policy_version 179200 (0.0004) [2023-03-08 03:18:54,448][304623] Updated weights for policy 0, policy_version 179280 (0.0004) [2023-03-08 03:18:55,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13482.1). Total num frames: 91807744. Throughput: 0: 13636.4. Samples: 91798468. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:18:55,769][304334] Avg episode reward: [(0, '4682.978')] [2023-03-08 03:18:57,428][304623] Updated weights for policy 0, policy_version 179360 (0.0004) [2023-03-08 03:19:00,442][304623] Updated weights for policy 0, policy_version 179440 (0.0004) [2023-03-08 03:19:00,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13653.3, 300 sec: 13509.9). Total num frames: 91877376. Throughput: 0: 13645.1. Samples: 91840148. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:19:00,769][304334] Avg episode reward: [(0, '4697.142')] [2023-03-08 03:19:03,492][304623] Updated weights for policy 0, policy_version 179520 (0.0004) [2023-03-08 03:19:05,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13653.3, 300 sec: 13523.7). Total num frames: 91942912. Throughput: 0: 13621.2. Samples: 91921052. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:19:05,769][304334] Avg episode reward: [(0, '4700.236')] [2023-03-08 03:19:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000179576_91942912.pth... [2023-03-08 03:19:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000178776_91533312.pth [2023-03-08 03:19:06,546][304623] Updated weights for policy 0, policy_version 179600 (0.0004) [2023-03-08 03:19:09,787][304623] Updated weights for policy 0, policy_version 179680 (0.0005) [2023-03-08 03:19:10,769][304334] Fps is (10 sec: 12697.7, 60 sec: 13516.8, 300 sec: 13523.7). Total num frames: 92004352. Throughput: 0: 13556.9. Samples: 91998908. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:19:10,769][304334] Avg episode reward: [(0, '4712.745')] [2023-03-08 03:19:13,103][304623] Updated weights for policy 0, policy_version 179760 (0.0005) [2023-03-08 03:19:15,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13448.5, 300 sec: 13537.6). Total num frames: 92069888. Throughput: 0: 13448.4. Samples: 92035496. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:19:15,769][304334] Avg episode reward: [(0, '4688.436')] [2023-03-08 03:19:16,377][304623] Updated weights for policy 0, policy_version 179840 (0.0005) [2023-03-08 03:19:19,609][304623] Updated weights for policy 0, policy_version 179920 (0.0005) [2023-03-08 03:19:20,769][304334] Fps is (10 sec: 12697.4, 60 sec: 13380.2, 300 sec: 13523.7). Total num frames: 92131328. Throughput: 0: 13303.1. Samples: 92110912. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:19:20,769][304334] Avg episode reward: [(0, '4709.307')] [2023-03-08 03:19:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000179944_92131328.pth... [2023-03-08 03:19:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000179176_91738112.pth [2023-03-08 03:19:22,985][304623] Updated weights for policy 0, policy_version 180000 (0.0005) [2023-03-08 03:19:25,769][304334] Fps is (10 sec: 12288.1, 60 sec: 13243.7, 300 sec: 13523.7). Total num frames: 92192768. Throughput: 0: 13126.0. Samples: 92184576. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:19:25,769][304334] Avg episode reward: [(0, '4693.232')] [2023-03-08 03:19:26,387][304623] Updated weights for policy 0, policy_version 180080 (0.0005) [2023-03-08 03:19:29,785][304623] Updated weights for policy 0, policy_version 180160 (0.0005) [2023-03-08 03:19:30,769][304334] Fps is (10 sec: 11878.5, 60 sec: 13038.9, 300 sec: 13509.9). Total num frames: 92250112. Throughput: 0: 13006.6. Samples: 92220096. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:19:30,769][304334] Avg episode reward: [(0, '4681.938')] [2023-03-08 03:19:33,164][304623] Updated weights for policy 0, policy_version 180240 (0.0005) [2023-03-08 03:19:35,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12970.7, 300 sec: 13509.9). Total num frames: 92311552. Throughput: 0: 12800.7. Samples: 92292264. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:19:35,769][304334] Avg episode reward: [(0, '4705.436')] [2023-03-08 03:19:35,826][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000180304_92315648.pth... [2023-03-08 03:19:35,827][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000179576_91942912.pth [2023-03-08 03:19:36,498][304623] Updated weights for policy 0, policy_version 180320 (0.0005) [2023-03-08 03:19:39,873][304623] Updated weights for policy 0, policy_version 180400 (0.0005) [2023-03-08 03:19:40,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12834.1, 300 sec: 13482.1). Total num frames: 92372992. Throughput: 0: 12611.9. Samples: 92366004. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:19:40,769][304334] Avg episode reward: [(0, '4687.849')] [2023-03-08 03:19:43,240][304623] Updated weights for policy 0, policy_version 180480 (0.0005) [2023-03-08 03:19:45,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12697.6, 300 sec: 13468.2). Total num frames: 92434432. Throughput: 0: 12484.7. Samples: 92401960. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:19:45,769][304334] Avg episode reward: [(0, '4718.033')] [2023-03-08 03:19:46,499][304623] Updated weights for policy 0, policy_version 180560 (0.0005) [2023-03-08 03:19:49,859][304623] Updated weights for policy 0, policy_version 180640 (0.0005) [2023-03-08 03:19:50,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12629.3, 300 sec: 13440.4). Total num frames: 92495872. Throughput: 0: 12347.9. Samples: 92476708. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:19:50,769][304334] Avg episode reward: [(0, '4719.062')] [2023-03-08 03:19:50,811][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000180664_92499968.pth... [2023-03-08 03:19:50,812][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000179944_92131328.pth [2023-03-08 03:19:53,076][304623] Updated weights for policy 0, policy_version 180720 (0.0005) [2023-03-08 03:19:55,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12561.1, 300 sec: 13426.5). Total num frames: 92561408. Throughput: 0: 12310.3. Samples: 92552872. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:19:55,769][304334] Avg episode reward: [(0, '4701.626')] [2023-03-08 03:19:56,350][304623] Updated weights for policy 0, policy_version 180800 (0.0005) [2023-03-08 03:19:59,751][304623] Updated weights for policy 0, policy_version 180880 (0.0005) [2023-03-08 03:20:00,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 13398.8). Total num frames: 92622848. Throughput: 0: 12306.9. Samples: 92589304. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:20:00,769][304334] Avg episode reward: [(0, '4710.348')] [2023-03-08 03:20:02,987][304623] Updated weights for policy 0, policy_version 180960 (0.0005) [2023-03-08 03:20:05,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 13371.0). Total num frames: 92684288. Throughput: 0: 12288.0. Samples: 92663872. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:20:05,769][304334] Avg episode reward: [(0, '4706.686')] [2023-03-08 03:20:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000181024_92684288.pth... [2023-03-08 03:20:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000180304_92315648.pth [2023-03-08 03:20:06,201][304623] Updated weights for policy 0, policy_version 181040 (0.0005) [2023-03-08 03:20:09,490][304623] Updated weights for policy 0, policy_version 181120 (0.0005) [2023-03-08 03:20:10,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12356.2, 300 sec: 13343.2). Total num frames: 92745728. Throughput: 0: 12328.8. Samples: 92739372. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:20:10,769][304334] Avg episode reward: [(0, '4703.862')] [2023-03-08 03:20:12,726][304623] Updated weights for policy 0, policy_version 181200 (0.0005) [2023-03-08 03:20:15,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12356.3, 300 sec: 13329.4). Total num frames: 92811264. Throughput: 0: 12396.4. Samples: 92777932. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:20:15,769][304334] Avg episode reward: [(0, '4693.822')] [2023-03-08 03:20:15,995][304623] Updated weights for policy 0, policy_version 181280 (0.0005) [2023-03-08 03:20:19,291][304623] Updated weights for policy 0, policy_version 181360 (0.0005) [2023-03-08 03:20:20,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12356.3, 300 sec: 13315.5). Total num frames: 92872704. Throughput: 0: 12445.1. Samples: 92852296. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:20:20,769][304334] Avg episode reward: [(0, '4716.535')] [2023-03-08 03:20:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000181392_92872704.pth... [2023-03-08 03:20:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000180664_92499968.pth [2023-03-08 03:20:22,467][304623] Updated weights for policy 0, policy_version 181440 (0.0004) [2023-03-08 03:20:25,441][304623] Updated weights for policy 0, policy_version 181520 (0.0003) [2023-03-08 03:20:25,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12492.8, 300 sec: 13315.5). Total num frames: 92942336. Throughput: 0: 12566.1. Samples: 92931480. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:20:25,769][304334] Avg episode reward: [(0, '4703.058')] [2023-03-08 03:20:28,727][304623] Updated weights for policy 0, policy_version 181600 (0.0005) [2023-03-08 03:20:30,769][304334] Fps is (10 sec: 13107.3, 60 sec: 12561.1, 300 sec: 13287.7). Total num frames: 93003776. Throughput: 0: 12640.9. Samples: 92970800. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:20:30,769][304334] Avg episode reward: [(0, '4706.924')] [2023-03-08 03:20:32,007][304623] Updated weights for policy 0, policy_version 181680 (0.0004) [2023-03-08 03:20:34,951][304623] Updated weights for policy 0, policy_version 181760 (0.0003) [2023-03-08 03:20:35,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 13273.8). Total num frames: 93069312. Throughput: 0: 12687.9. Samples: 93047664. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:20:35,769][304334] Avg episode reward: [(0, '4682.281')] [2023-03-08 03:20:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000181776_93069312.pth... [2023-03-08 03:20:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000181024_92684288.pth [2023-03-08 03:20:37,978][304623] Updated weights for policy 0, policy_version 181840 (0.0004) [2023-03-08 03:20:40,769][304334] Fps is (10 sec: 13516.7, 60 sec: 12765.9, 300 sec: 13273.8). Total num frames: 93138944. Throughput: 0: 12801.5. Samples: 93128940. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 03:20:40,769][304334] Avg episode reward: [(0, '4669.812')] [2023-03-08 03:20:41,061][304623] Updated weights for policy 0, policy_version 181920 (0.0004) [2023-03-08 03:20:44,319][304623] Updated weights for policy 0, policy_version 182000 (0.0005) [2023-03-08 03:20:45,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12765.9, 300 sec: 13259.9). Total num frames: 93200384. Throughput: 0: 12851.4. Samples: 93167616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:20:45,769][304334] Avg episode reward: [(0, '4680.077')] [2023-03-08 03:20:47,706][304623] Updated weights for policy 0, policy_version 182080 (0.0005) [2023-03-08 03:20:50,769][304334] Fps is (10 sec: 11878.3, 60 sec: 12697.6, 300 sec: 13218.3). Total num frames: 93257728. Throughput: 0: 12816.3. Samples: 93240608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:20:50,769][304334] Avg episode reward: [(0, '4683.999')] [2023-03-08 03:20:50,780][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000182152_93261824.pth... [2023-03-08 03:20:50,781][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000181392_92872704.pth [2023-03-08 03:20:51,126][304623] Updated weights for policy 0, policy_version 182160 (0.0005) [2023-03-08 03:20:54,198][304623] Updated weights for policy 0, policy_version 182240 (0.0004) [2023-03-08 03:20:55,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12765.9, 300 sec: 13218.3). Total num frames: 93327360. Throughput: 0: 12844.9. Samples: 93317392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:20:55,769][304334] Avg episode reward: [(0, '4696.357')] [2023-03-08 03:20:57,245][304623] Updated weights for policy 0, policy_version 182320 (0.0004) [2023-03-08 03:21:00,225][304623] Updated weights for policy 0, policy_version 182400 (0.0003) [2023-03-08 03:21:00,769][304334] Fps is (10 sec: 13517.0, 60 sec: 12834.1, 300 sec: 13204.4). Total num frames: 93392896. Throughput: 0: 12881.2. Samples: 93357584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:21:00,769][304334] Avg episode reward: [(0, '4688.778')] [2023-03-08 03:21:03,195][304623] Updated weights for policy 0, policy_version 182480 (0.0004) [2023-03-08 03:21:05,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12970.7, 300 sec: 13204.4). Total num frames: 93462528. Throughput: 0: 13061.0. Samples: 93440040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:21:05,769][304334] Avg episode reward: [(0, '4716.039')] [2023-03-08 03:21:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000182544_93462528.pth... [2023-03-08 03:21:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000181776_93069312.pth [2023-03-08 03:21:06,201][304623] Updated weights for policy 0, policy_version 182560 (0.0003) [2023-03-08 03:21:09,143][304623] Updated weights for policy 0, policy_version 182640 (0.0003) [2023-03-08 03:21:10,769][304334] Fps is (10 sec: 13926.3, 60 sec: 13107.2, 300 sec: 13218.3). Total num frames: 93532160. Throughput: 0: 13155.9. Samples: 93523496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:21:10,780][304334] Avg episode reward: [(0, '4710.603')] [2023-03-08 03:21:12,216][304623] Updated weights for policy 0, policy_version 182720 (0.0004) [2023-03-08 03:21:15,463][304623] Updated weights for policy 0, policy_version 182800 (0.0005) [2023-03-08 03:21:15,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13038.9, 300 sec: 13190.5). Total num frames: 93593600. Throughput: 0: 13121.7. Samples: 93561276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:21:15,780][304334] Avg episode reward: [(0, '4710.645')] [2023-03-08 03:21:18,792][304623] Updated weights for policy 0, policy_version 182880 (0.0005) [2023-03-08 03:21:20,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13107.2, 300 sec: 13176.6). Total num frames: 93659136. Throughput: 0: 13093.1. Samples: 93636856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:21:20,780][304334] Avg episode reward: [(0, '4706.935')] [2023-03-08 03:21:20,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000182928_93659136.pth... [2023-03-08 03:21:20,785][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000182152_93261824.pth [2023-03-08 03:21:22,046][304623] Updated weights for policy 0, policy_version 182960 (0.0005) [2023-03-08 03:21:25,310][304623] Updated weights for policy 0, policy_version 183040 (0.0005) [2023-03-08 03:21:25,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12970.7, 300 sec: 13148.9). Total num frames: 93720576. Throughput: 0: 12966.8. Samples: 93712448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:21:25,780][304334] Avg episode reward: [(0, '4705.370')] [2023-03-08 03:21:28,642][304623] Updated weights for policy 0, policy_version 183120 (0.0005) [2023-03-08 03:21:30,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12970.7, 300 sec: 13121.1). Total num frames: 93782016. Throughput: 0: 12925.3. Samples: 93749256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:21:30,780][304334] Avg episode reward: [(0, '4716.472')] [2023-03-08 03:21:31,883][304623] Updated weights for policy 0, policy_version 183200 (0.0005) [2023-03-08 03:21:35,228][304623] Updated weights for policy 0, policy_version 183280 (0.0005) [2023-03-08 03:21:35,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12902.4, 300 sec: 13107.2). Total num frames: 93843456. Throughput: 0: 12950.6. Samples: 93823384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:21:35,780][304334] Avg episode reward: [(0, '4693.511')] [2023-03-08 03:21:35,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000183288_93843456.pth... [2023-03-08 03:21:35,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000182544_93462528.pth [2023-03-08 03:21:38,528][304623] Updated weights for policy 0, policy_version 183360 (0.0005) [2023-03-08 03:21:40,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12765.9, 300 sec: 13079.4). Total num frames: 93904896. Throughput: 0: 12898.4. Samples: 93897820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:21:40,779][304334] Avg episode reward: [(0, '4698.977')] [2023-03-08 03:21:41,911][304623] Updated weights for policy 0, policy_version 183440 (0.0005) [2023-03-08 03:21:45,159][304623] Updated weights for policy 0, policy_version 183520 (0.0004) [2023-03-08 03:21:45,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12765.8, 300 sec: 13065.5). Total num frames: 93966336. Throughput: 0: 12813.3. Samples: 93934184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:21:45,770][304334] Avg episode reward: [(0, '4717.462')] [2023-03-08 03:21:48,385][304623] Updated weights for policy 0, policy_version 183600 (0.0005) [2023-03-08 03:21:50,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12902.4, 300 sec: 13051.7). Total num frames: 94031872. Throughput: 0: 12695.7. Samples: 94011348. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 03:21:50,779][304334] Avg episode reward: [(0, '4704.079')] [2023-03-08 03:21:50,782][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000183656_94031872.pth... [2023-03-08 03:21:50,784][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000182928_93659136.pth [2023-03-08 03:21:51,712][304623] Updated weights for policy 0, policy_version 183680 (0.0005) [2023-03-08 03:21:55,045][304623] Updated weights for policy 0, policy_version 183760 (0.0004) [2023-03-08 03:21:55,769][304334] Fps is (10 sec: 12697.8, 60 sec: 12765.9, 300 sec: 13023.9). Total num frames: 94093312. Throughput: 0: 12479.5. Samples: 94085072. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 03:21:55,780][304334] Avg episode reward: [(0, '4708.566')] [2023-03-08 03:21:58,326][304623] Updated weights for policy 0, policy_version 183840 (0.0005) [2023-03-08 03:22:00,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12697.6, 300 sec: 12996.1). Total num frames: 94154752. Throughput: 0: 12460.4. Samples: 94121992. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 03:22:00,780][304334] Avg episode reward: [(0, '4702.975')] [2023-03-08 03:22:01,718][304623] Updated weights for policy 0, policy_version 183920 (0.0005) [2023-03-08 03:22:04,991][304623] Updated weights for policy 0, policy_version 184000 (0.0005) [2023-03-08 03:22:05,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12561.1, 300 sec: 12968.4). Total num frames: 94216192. Throughput: 0: 12419.0. Samples: 94195712. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 03:22:05,780][304334] Avg episode reward: [(0, '4715.740')] [2023-03-08 03:22:05,783][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000184016_94216192.pth... [2023-03-08 03:22:05,786][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000183288_93843456.pth [2023-03-08 03:22:08,226][304623] Updated weights for policy 0, policy_version 184080 (0.0005) [2023-03-08 03:22:10,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 12954.5). Total num frames: 94277632. Throughput: 0: 12399.4. Samples: 94270420. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 03:22:10,780][304334] Avg episode reward: [(0, '4707.182')] [2023-03-08 03:22:11,556][304623] Updated weights for policy 0, policy_version 184160 (0.0005) [2023-03-08 03:22:14,823][304623] Updated weights for policy 0, policy_version 184240 (0.0005) [2023-03-08 03:22:15,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12926.7). Total num frames: 94339072. Throughput: 0: 12402.8. Samples: 94307384. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 03:22:15,769][304334] Avg episode reward: [(0, '4718.697')] [2023-03-08 03:22:18,027][304623] Updated weights for policy 0, policy_version 184320 (0.0004) [2023-03-08 03:22:20,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 12926.7). Total num frames: 94404608. Throughput: 0: 12461.0. Samples: 94384128. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 03:22:20,769][304334] Avg episode reward: [(0, '4714.785')] [2023-03-08 03:22:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000184384_94404608.pth... [2023-03-08 03:22:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000183656_94031872.pth [2023-03-08 03:22:21,387][304623] Updated weights for policy 0, policy_version 184400 (0.0005) [2023-03-08 03:22:24,599][304623] Updated weights for policy 0, policy_version 184480 (0.0005) [2023-03-08 03:22:25,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 12898.9). Total num frames: 94466048. Throughput: 0: 12450.6. Samples: 94458096. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 03:22:25,769][304334] Avg episode reward: [(0, '4720.130')] [2023-03-08 03:22:27,875][304623] Updated weights for policy 0, policy_version 184560 (0.0005) [2023-03-08 03:22:30,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12424.5, 300 sec: 12885.0). Total num frames: 94527488. Throughput: 0: 12482.0. Samples: 94495872. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 03:22:30,769][304334] Avg episode reward: [(0, '4711.473')] [2023-03-08 03:22:31,156][304623] Updated weights for policy 0, policy_version 184640 (0.0005) [2023-03-08 03:22:34,486][304623] Updated weights for policy 0, policy_version 184720 (0.0005) [2023-03-08 03:22:35,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12885.0). Total num frames: 94588928. Throughput: 0: 12436.1. Samples: 94570972. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 03:22:35,769][304334] Avg episode reward: [(0, '4708.011')] [2023-03-08 03:22:35,814][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000184752_94593024.pth... [2023-03-08 03:22:35,816][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000184016_94216192.pth [2023-03-08 03:22:37,759][304623] Updated weights for policy 0, policy_version 184800 (0.0005) [2023-03-08 03:22:40,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12885.0). Total num frames: 94654464. Throughput: 0: 12457.5. Samples: 94645660. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 03:22:40,769][304334] Avg episode reward: [(0, '4717.447')] [2023-03-08 03:22:41,028][304623] Updated weights for policy 0, policy_version 184880 (0.0005) [2023-03-08 03:22:44,249][304623] Updated weights for policy 0, policy_version 184960 (0.0005) [2023-03-08 03:22:45,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12871.2). Total num frames: 94715904. Throughput: 0: 12470.0. Samples: 94683144. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 03:22:45,769][304334] Avg episode reward: [(0, '4721.112')] [2023-03-08 03:22:47,523][304623] Updated weights for policy 0, policy_version 185040 (0.0005) [2023-03-08 03:22:50,576][304623] Updated weights for policy 0, policy_version 185120 (0.0003) [2023-03-08 03:22:50,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12492.8, 300 sec: 12857.3). Total num frames: 94781440. Throughput: 0: 12527.8. Samples: 94759464. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 03:22:50,769][304334] Avg episode reward: [(0, '4703.824')] [2023-03-08 03:22:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000185120_94781440.pth... [2023-03-08 03:22:50,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000184384_94404608.pth [2023-03-08 03:22:53,790][304623] Updated weights for policy 0, policy_version 185200 (0.0005) [2023-03-08 03:22:55,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12829.5). Total num frames: 94842880. Throughput: 0: 12599.6. Samples: 94837400. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 03:22:55,769][304334] Avg episode reward: [(0, '4695.445')] [2023-03-08 03:22:57,126][304623] Updated weights for policy 0, policy_version 185280 (0.0005) [2023-03-08 03:23:00,415][304623] Updated weights for policy 0, policy_version 185360 (0.0005) [2023-03-08 03:23:00,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12561.1, 300 sec: 12829.5). Total num frames: 94908416. Throughput: 0: 12580.4. Samples: 94873500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:23:00,769][304334] Avg episode reward: [(0, '4711.226')] [2023-03-08 03:23:03,606][304623] Updated weights for policy 0, policy_version 185440 (0.0005) [2023-03-08 03:23:05,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12801.7). Total num frames: 94969856. Throughput: 0: 12562.7. Samples: 94949448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:23:05,769][304334] Avg episode reward: [(0, '4703.771')] [2023-03-08 03:23:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000185488_94969856.pth... [2023-03-08 03:23:05,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000184752_94593024.pth [2023-03-08 03:23:06,920][304623] Updated weights for policy 0, policy_version 185520 (0.0005) [2023-03-08 03:23:09,920][304623] Updated weights for policy 0, policy_version 185600 (0.0004) [2023-03-08 03:23:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12787.8). Total num frames: 95035392. Throughput: 0: 12654.8. Samples: 95027560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:23:10,780][304334] Avg episode reward: [(0, '4704.410')] [2023-03-08 03:23:12,941][304623] Updated weights for policy 0, policy_version 185680 (0.0004) [2023-03-08 03:23:15,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12765.9, 300 sec: 12801.7). Total num frames: 95105024. Throughput: 0: 12719.1. Samples: 95068232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:23:15,780][304334] Avg episode reward: [(0, '4696.325')] [2023-03-08 03:23:15,886][304623] Updated weights for policy 0, policy_version 185760 (0.0004) [2023-03-08 03:23:19,063][304623] Updated weights for policy 0, policy_version 185840 (0.0005) [2023-03-08 03:23:20,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12765.9, 300 sec: 12787.8). Total num frames: 95170560. Throughput: 0: 12858.5. Samples: 95149604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:23:20,780][304334] Avg episode reward: [(0, '4707.490')] [2023-03-08 03:23:20,784][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000185880_95170560.pth... [2023-03-08 03:23:20,787][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000185120_94781440.pth [2023-03-08 03:23:22,359][304623] Updated weights for policy 0, policy_version 185920 (0.0005) [2023-03-08 03:23:25,332][304623] Updated weights for policy 0, policy_version 186000 (0.0005) [2023-03-08 03:23:25,769][304334] Fps is (10 sec: 13107.1, 60 sec: 12834.1, 300 sec: 12774.0). Total num frames: 95236096. Throughput: 0: 12917.8. Samples: 95226964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:23:25,780][304334] Avg episode reward: [(0, '4723.090')] [2023-03-08 03:23:28,307][304623] Updated weights for policy 0, policy_version 186080 (0.0004) [2023-03-08 03:23:30,769][304334] Fps is (10 sec: 13516.9, 60 sec: 12970.7, 300 sec: 12787.9). Total num frames: 95305728. Throughput: 0: 13016.2. Samples: 95268872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:23:30,769][304334] Avg episode reward: [(0, '4725.479')] [2023-03-08 03:23:31,320][304623] Updated weights for policy 0, policy_version 186160 (0.0005) [2023-03-08 03:23:34,324][304623] Updated weights for policy 0, policy_version 186240 (0.0004) [2023-03-08 03:23:35,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13038.9, 300 sec: 12774.0). Total num frames: 95371264. Throughput: 0: 13127.2. Samples: 95350188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:23:35,769][304334] Avg episode reward: [(0, '4725.512')] [2023-03-08 03:23:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000186272_95371264.pth... [2023-03-08 03:23:35,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000185488_94969856.pth [2023-03-08 03:23:37,315][304623] Updated weights for policy 0, policy_version 186320 (0.0004) [2023-03-08 03:23:40,331][304623] Updated weights for policy 0, policy_version 186400 (0.0005) [2023-03-08 03:23:40,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13107.2, 300 sec: 12774.0). Total num frames: 95440896. Throughput: 0: 13211.8. Samples: 95431932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:23:40,769][304334] Avg episode reward: [(0, '4720.832')] [2023-03-08 03:23:43,357][304623] Updated weights for policy 0, policy_version 186480 (0.0005) [2023-03-08 03:23:45,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13243.7, 300 sec: 12787.9). Total num frames: 95510528. Throughput: 0: 13320.6. Samples: 95472928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:23:45,769][304334] Avg episode reward: [(0, '4717.572')] [2023-03-08 03:23:46,323][304623] Updated weights for policy 0, policy_version 186560 (0.0004) [2023-03-08 03:23:49,334][304623] Updated weights for policy 0, policy_version 186640 (0.0004) [2023-03-08 03:23:50,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13243.7, 300 sec: 12774.0). Total num frames: 95576064. Throughput: 0: 13448.4. Samples: 95554624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:23:50,769][304334] Avg episode reward: [(0, '4715.515')] [2023-03-08 03:23:50,796][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000186680_95580160.pth... [2023-03-08 03:23:50,798][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000185880_95170560.pth [2023-03-08 03:23:52,268][304623] Updated weights for policy 0, policy_version 186720 (0.0004) [2023-03-08 03:23:55,244][304623] Updated weights for policy 0, policy_version 186800 (0.0004) [2023-03-08 03:23:55,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 12774.0). Total num frames: 95645696. Throughput: 0: 13555.7. Samples: 95637568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:23:55,769][304334] Avg episode reward: [(0, '4705.959')] [2023-03-08 03:23:58,161][304623] Updated weights for policy 0, policy_version 186880 (0.0004) [2023-03-08 03:24:00,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13448.5, 300 sec: 12787.9). Total num frames: 95715328. Throughput: 0: 13586.0. Samples: 95679604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:24:00,769][304334] Avg episode reward: [(0, '4718.192')] [2023-03-08 03:24:01,171][304623] Updated weights for policy 0, policy_version 186960 (0.0005) [2023-03-08 03:24:04,078][304623] Updated weights for policy 0, policy_version 187040 (0.0004) [2023-03-08 03:24:05,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13585.1, 300 sec: 12815.6). Total num frames: 95784960. Throughput: 0: 13634.2. Samples: 95763144. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:24:05,769][304334] Avg episode reward: [(0, '4718.744')] [2023-03-08 03:24:05,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000187080_95784960.pth... [2023-03-08 03:24:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000186272_95371264.pth [2023-03-08 03:24:07,092][304623] Updated weights for policy 0, policy_version 187120 (0.0004) [2023-03-08 03:24:10,114][304623] Updated weights for policy 0, policy_version 187200 (0.0004) [2023-03-08 03:24:10,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13653.3, 300 sec: 12829.5). Total num frames: 95854592. Throughput: 0: 13724.1. Samples: 95844548. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:24:10,769][304334] Avg episode reward: [(0, '4699.511')] [2023-03-08 03:24:13,319][304623] Updated weights for policy 0, policy_version 187280 (0.0004) [2023-03-08 03:24:15,769][304334] Fps is (10 sec: 13107.2, 60 sec: 13516.8, 300 sec: 12829.5). Total num frames: 95916032. Throughput: 0: 13647.3. Samples: 95883000. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:24:15,769][304334] Avg episode reward: [(0, '4713.476')] [2023-03-08 03:24:16,560][304623] Updated weights for policy 0, policy_version 187360 (0.0005) [2023-03-08 03:24:19,812][304623] Updated weights for policy 0, policy_version 187440 (0.0004) [2023-03-08 03:24:20,769][304334] Fps is (10 sec: 12288.1, 60 sec: 13448.6, 300 sec: 12829.5). Total num frames: 95977472. Throughput: 0: 13525.0. Samples: 95958812. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:24:20,769][304334] Avg episode reward: [(0, '4710.148')] [2023-03-08 03:24:20,801][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000187464_95981568.pth... [2023-03-08 03:24:20,803][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000186680_95580160.pth [2023-03-08 03:24:23,116][304623] Updated weights for policy 0, policy_version 187520 (0.0005) [2023-03-08 03:24:25,769][304334] Fps is (10 sec: 12288.1, 60 sec: 13380.3, 300 sec: 12843.4). Total num frames: 96038912. Throughput: 0: 13370.0. Samples: 96033580. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:24:25,769][304334] Avg episode reward: [(0, '4716.575')] [2023-03-08 03:24:26,468][304623] Updated weights for policy 0, policy_version 187600 (0.0005) [2023-03-08 03:24:29,846][304623] Updated weights for policy 0, policy_version 187680 (0.0005) [2023-03-08 03:24:30,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13243.8, 300 sec: 12843.4). Total num frames: 96100352. Throughput: 0: 13250.2. Samples: 96069184. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:24:30,769][304334] Avg episode reward: [(0, '4706.712')] [2023-03-08 03:24:33,167][304623] Updated weights for policy 0, policy_version 187760 (0.0005) [2023-03-08 03:24:35,769][304334] Fps is (10 sec: 12697.5, 60 sec: 13243.8, 300 sec: 12857.3). Total num frames: 96165888. Throughput: 0: 13069.6. Samples: 96142756. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:24:35,769][304334] Avg episode reward: [(0, '4715.658')] [2023-03-08 03:24:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000187824_96165888.pth... [2023-03-08 03:24:35,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000187080_95784960.pth [2023-03-08 03:24:36,383][304623] Updated weights for policy 0, policy_version 187840 (0.0004) [2023-03-08 03:24:39,603][304623] Updated weights for policy 0, policy_version 187920 (0.0005) [2023-03-08 03:24:40,769][304334] Fps is (10 sec: 12697.5, 60 sec: 13107.2, 300 sec: 12857.3). Total num frames: 96227328. Throughput: 0: 12925.5. Samples: 96219216. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:24:40,769][304334] Avg episode reward: [(0, '4720.672')] [2023-03-08 03:24:42,913][304623] Updated weights for policy 0, policy_version 188000 (0.0005) [2023-03-08 03:24:45,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12970.7, 300 sec: 12857.3). Total num frames: 96288768. Throughput: 0: 12820.0. Samples: 96256504. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:24:45,769][304334] Avg episode reward: [(0, '4712.253')] [2023-03-08 03:24:46,120][304623] Updated weights for policy 0, policy_version 188080 (0.0004) [2023-03-08 03:24:49,434][304623] Updated weights for policy 0, policy_version 188160 (0.0005) [2023-03-08 03:24:50,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12970.7, 300 sec: 12857.3). Total num frames: 96354304. Throughput: 0: 12651.6. Samples: 96332468. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:24:50,769][304334] Avg episode reward: [(0, '4715.547')] [2023-03-08 03:24:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000188192_96354304.pth... [2023-03-08 03:24:50,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000187464_95981568.pth [2023-03-08 03:24:52,767][304623] Updated weights for policy 0, policy_version 188240 (0.0005) [2023-03-08 03:24:55,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12834.1, 300 sec: 12857.3). Total num frames: 96415744. Throughput: 0: 12498.3. Samples: 96406972. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:24:55,769][304334] Avg episode reward: [(0, '4714.379')] [2023-03-08 03:24:56,079][304623] Updated weights for policy 0, policy_version 188320 (0.0005) [2023-03-08 03:24:59,503][304623] Updated weights for policy 0, policy_version 188400 (0.0005) [2023-03-08 03:25:00,769][304334] Fps is (10 sec: 11878.4, 60 sec: 12629.3, 300 sec: 12843.4). Total num frames: 96473088. Throughput: 0: 12431.2. Samples: 96442404. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:25:00,769][304334] Avg episode reward: [(0, '4687.840')] [2023-03-08 03:25:02,782][304623] Updated weights for policy 0, policy_version 188480 (0.0005) [2023-03-08 03:25:05,769][304334] Fps is (10 sec: 12287.9, 60 sec: 12561.1, 300 sec: 12857.3). Total num frames: 96538624. Throughput: 0: 12388.4. Samples: 96516292. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:25:05,769][304334] Avg episode reward: [(0, '4710.954')] [2023-03-08 03:25:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000188552_96538624.pth... [2023-03-08 03:25:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000187824_96165888.pth [2023-03-08 03:25:06,048][304623] Updated weights for policy 0, policy_version 188560 (0.0005) [2023-03-08 03:25:09,359][304623] Updated weights for policy 0, policy_version 188640 (0.0005) [2023-03-08 03:25:10,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 12843.4). Total num frames: 96600064. Throughput: 0: 12406.6. Samples: 96591880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:25:10,769][304334] Avg episode reward: [(0, '4721.345')] [2023-03-08 03:25:12,644][304623] Updated weights for policy 0, policy_version 188720 (0.0005) [2023-03-08 03:25:15,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12843.4). Total num frames: 96661504. Throughput: 0: 12435.9. Samples: 96628800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:25:15,769][304334] Avg episode reward: [(0, '4718.364')] [2023-03-08 03:25:15,882][304623] Updated weights for policy 0, policy_version 188800 (0.0005) [2023-03-08 03:25:19,152][304623] Updated weights for policy 0, policy_version 188880 (0.0005) [2023-03-08 03:25:20,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12815.6). Total num frames: 96722944. Throughput: 0: 12474.9. Samples: 96704128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:25:20,769][304334] Avg episode reward: [(0, '4709.104')] [2023-03-08 03:25:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000188912_96722944.pth... [2023-03-08 03:25:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000188192_96354304.pth [2023-03-08 03:25:22,513][304623] Updated weights for policy 0, policy_version 188960 (0.0005) [2023-03-08 03:25:25,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12815.6). Total num frames: 96784384. Throughput: 0: 12443.0. Samples: 96779152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:25:25,769][304334] Avg episode reward: [(0, '4723.194')] [2023-03-08 03:25:25,771][304623] Updated weights for policy 0, policy_version 189040 (0.0005) [2023-03-08 03:25:29,027][304623] Updated weights for policy 0, policy_version 189120 (0.0005) [2023-03-08 03:25:30,769][304334] Fps is (10 sec: 12697.7, 60 sec: 12492.8, 300 sec: 12815.6). Total num frames: 96849920. Throughput: 0: 12458.9. Samples: 96817152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:25:30,769][304334] Avg episode reward: [(0, '4719.993')] [2023-03-08 03:25:32,351][304623] Updated weights for policy 0, policy_version 189200 (0.0005) [2023-03-08 03:25:35,707][304623] Updated weights for policy 0, policy_version 189280 (0.0005) [2023-03-08 03:25:35,769][304334] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 12787.8). Total num frames: 96911360. Throughput: 0: 12398.3. Samples: 96890392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:25:35,769][304334] Avg episode reward: [(0, '4709.463')] [2023-03-08 03:25:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000189280_96911360.pth... [2023-03-08 03:25:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000188552_96538624.pth [2023-03-08 03:25:38,794][304623] Updated weights for policy 0, policy_version 189360 (0.0004) [2023-03-08 03:25:40,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12787.8). Total num frames: 96972800. Throughput: 0: 12441.0. Samples: 96966816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:25:40,769][304334] Avg episode reward: [(0, '4710.487')] [2023-03-08 03:25:42,105][304623] Updated weights for policy 0, policy_version 189440 (0.0005) [2023-03-08 03:25:45,075][304623] Updated weights for policy 0, policy_version 189520 (0.0003) [2023-03-08 03:25:45,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12561.1, 300 sec: 12829.5). Total num frames: 97042432. Throughput: 0: 12516.2. Samples: 97005632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:25:45,769][304334] Avg episode reward: [(0, '4703.169')] [2023-03-08 03:25:48,463][304623] Updated weights for policy 0, policy_version 189600 (0.0005) [2023-03-08 03:25:50,769][304334] Fps is (10 sec: 12697.5, 60 sec: 12424.5, 300 sec: 12787.8). Total num frames: 97099776. Throughput: 0: 12578.8. Samples: 97082340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:25:50,769][304334] Avg episode reward: [(0, '4699.066')] [2023-03-08 03:25:50,793][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000189656_97103872.pth... [2023-03-08 03:25:50,795][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000188912_96722944.pth [2023-03-08 03:25:51,786][304623] Updated weights for policy 0, policy_version 189680 (0.0005) [2023-03-08 03:25:55,063][304623] Updated weights for policy 0, policy_version 189760 (0.0005) [2023-03-08 03:25:55,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12787.8). Total num frames: 97165312. Throughput: 0: 12540.3. Samples: 97156192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:25:55,769][304334] Avg episode reward: [(0, '4715.670')] [2023-03-08 03:25:58,079][304623] Updated weights for policy 0, policy_version 189840 (0.0004) [2023-03-08 03:26:00,769][304334] Fps is (10 sec: 13107.3, 60 sec: 12629.3, 300 sec: 12774.0). Total num frames: 97230848. Throughput: 0: 12623.2. Samples: 97196844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:26:00,769][304334] Avg episode reward: [(0, '4718.520')] [2023-03-08 03:26:01,167][304623] Updated weights for policy 0, policy_version 189920 (0.0004) [2023-03-08 03:26:04,114][304623] Updated weights for policy 0, policy_version 190000 (0.0004) [2023-03-08 03:26:05,769][304334] Fps is (10 sec: 13516.8, 60 sec: 12697.6, 300 sec: 12774.0). Total num frames: 97300480. Throughput: 0: 12751.5. Samples: 97277944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:26:05,769][304334] Avg episode reward: [(0, '4708.504')] [2023-03-08 03:26:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000190040_97300480.pth... [2023-03-08 03:26:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000189280_96911360.pth [2023-03-08 03:26:07,152][304623] Updated weights for policy 0, policy_version 190080 (0.0004) [2023-03-08 03:26:10,487][304623] Updated weights for policy 0, policy_version 190160 (0.0005) [2023-03-08 03:26:10,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12697.6, 300 sec: 12774.0). Total num frames: 97361920. Throughput: 0: 12802.2. Samples: 97355252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 03:26:10,769][304334] Avg episode reward: [(0, '4722.439')] [2023-03-08 03:26:13,554][304623] Updated weights for policy 0, policy_version 190240 (0.0004) [2023-03-08 03:26:15,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12834.1, 300 sec: 12787.9). Total num frames: 97431552. Throughput: 0: 12832.1. Samples: 97394596. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:26:15,769][304334] Avg episode reward: [(0, '4711.069')] [2023-03-08 03:26:16,585][304623] Updated weights for policy 0, policy_version 190320 (0.0004) [2023-03-08 03:26:19,586][304623] Updated weights for policy 0, policy_version 190400 (0.0004) [2023-03-08 03:26:20,769][304334] Fps is (10 sec: 13926.4, 60 sec: 12970.7, 300 sec: 12815.6). Total num frames: 97501184. Throughput: 0: 13027.2. Samples: 97476616. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:26:20,769][304334] Avg episode reward: [(0, '4705.469')] [2023-03-08 03:26:20,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000190432_97501184.pth... [2023-03-08 03:26:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000189656_97103872.pth [2023-03-08 03:26:22,565][304623] Updated weights for policy 0, policy_version 190480 (0.0004) [2023-03-08 03:26:25,588][304623] Updated weights for policy 0, policy_version 190560 (0.0004) [2023-03-08 03:26:25,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13038.9, 300 sec: 12829.5). Total num frames: 97566720. Throughput: 0: 13150.6. Samples: 97558592. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:26:25,769][304334] Avg episode reward: [(0, '4706.606')] [2023-03-08 03:26:28,627][304623] Updated weights for policy 0, policy_version 190640 (0.0003) [2023-03-08 03:26:30,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13107.2, 300 sec: 12857.3). Total num frames: 97636352. Throughput: 0: 13190.8. Samples: 97599220. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:26:30,769][304334] Avg episode reward: [(0, '4689.114')] [2023-03-08 03:26:31,627][304623] Updated weights for policy 0, policy_version 190720 (0.0003) [2023-03-08 03:26:34,698][304623] Updated weights for policy 0, policy_version 190800 (0.0003) [2023-03-08 03:26:35,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13175.5, 300 sec: 12871.2). Total num frames: 97701888. Throughput: 0: 13287.0. Samples: 97680252. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:26:35,769][304334] Avg episode reward: [(0, '4699.421')] [2023-03-08 03:26:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000190824_97701888.pth... [2023-03-08 03:26:35,776][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000190040_97300480.pth [2023-03-08 03:26:37,734][304623] Updated weights for policy 0, policy_version 190880 (0.0003) [2023-03-08 03:26:40,767][304623] Updated weights for policy 0, policy_version 190960 (0.0003) [2023-03-08 03:26:40,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13312.0, 300 sec: 12898.9). Total num frames: 97771520. Throughput: 0: 13441.6. Samples: 97761064. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:26:40,769][304334] Avg episode reward: [(0, '4713.686')] [2023-03-08 03:26:43,818][304623] Updated weights for policy 0, policy_version 191040 (0.0003) [2023-03-08 03:26:45,769][304334] Fps is (10 sec: 13516.9, 60 sec: 13243.7, 300 sec: 12898.9). Total num frames: 97837056. Throughput: 0: 13441.7. Samples: 97801720. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:26:45,769][304334] Avg episode reward: [(0, '4711.514')] [2023-03-08 03:26:46,844][304623] Updated weights for policy 0, policy_version 191120 (0.0003) [2023-03-08 03:26:49,959][304623] Updated weights for policy 0, policy_version 191200 (0.0004) [2023-03-08 03:26:50,769][304334] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 12912.8). Total num frames: 97902592. Throughput: 0: 13427.4. Samples: 97882176. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:26:50,769][304334] Avg episode reward: [(0, '4721.098')] [2023-03-08 03:26:50,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000191216_97902592.pth... [2023-03-08 03:26:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000190432_97501184.pth [2023-03-08 03:26:53,296][304623] Updated weights for policy 0, policy_version 191280 (0.0005) [2023-03-08 03:26:55,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13312.0, 300 sec: 12912.8). Total num frames: 97964032. Throughput: 0: 13348.0. Samples: 97955912. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:26:55,769][304334] Avg episode reward: [(0, '4720.364')] [2023-03-08 03:26:56,584][304623] Updated weights for policy 0, policy_version 191360 (0.0005) [2023-03-08 03:26:59,894][304623] Updated weights for policy 0, policy_version 191440 (0.0005) [2023-03-08 03:27:00,769][304334] Fps is (10 sec: 12288.1, 60 sec: 13243.7, 300 sec: 12912.8). Total num frames: 98025472. Throughput: 0: 13292.9. Samples: 97992776. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:27:00,769][304334] Avg episode reward: [(0, '4720.931')] [2023-03-08 03:27:03,159][304623] Updated weights for policy 0, policy_version 191520 (0.0005) [2023-03-08 03:27:05,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13107.2, 300 sec: 12912.8). Total num frames: 98086912. Throughput: 0: 13160.5. Samples: 98068836. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:27:05,769][304334] Avg episode reward: [(0, '4711.230')] [2023-03-08 03:27:05,806][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000191584_98091008.pth... [2023-03-08 03:27:05,807][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000190824_97701888.pth [2023-03-08 03:27:06,503][304623] Updated weights for policy 0, policy_version 191600 (0.0005) [2023-03-08 03:27:09,772][304623] Updated weights for policy 0, policy_version 191680 (0.0005) [2023-03-08 03:27:10,769][304334] Fps is (10 sec: 12288.1, 60 sec: 13107.2, 300 sec: 12912.8). Total num frames: 98148352. Throughput: 0: 12988.5. Samples: 98143072. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:27:10,769][304334] Avg episode reward: [(0, '4708.148')] [2023-03-08 03:27:13,155][304623] Updated weights for policy 0, policy_version 191760 (0.0005) [2023-03-08 03:27:15,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13038.9, 300 sec: 12912.8). Total num frames: 98213888. Throughput: 0: 12888.8. Samples: 98179216. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 03:27:15,769][304334] Avg episode reward: [(0, '4720.550')] [2023-03-08 03:27:16,393][304623] Updated weights for policy 0, policy_version 191840 (0.0005) [2023-03-08 03:27:19,710][304623] Updated weights for policy 0, policy_version 191920 (0.0005) [2023-03-08 03:27:20,769][304334] Fps is (10 sec: 12697.4, 60 sec: 12902.4, 300 sec: 12912.8). Total num frames: 98275328. Throughput: 0: 12768.8. Samples: 98254848. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:27:20,769][304334] Avg episode reward: [(0, '4708.741')] [2023-03-08 03:27:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000191944_98275328.pth... [2023-03-08 03:27:20,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000191216_97902592.pth [2023-03-08 03:27:22,983][304623] Updated weights for policy 0, policy_version 192000 (0.0005) [2023-03-08 03:27:25,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12834.1, 300 sec: 12912.8). Total num frames: 98336768. Throughput: 0: 12611.4. Samples: 98328576. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:27:25,769][304334] Avg episode reward: [(0, '4717.048')] [2023-03-08 03:27:26,306][304623] Updated weights for policy 0, policy_version 192080 (0.0005) [2023-03-08 03:27:29,632][304623] Updated weights for policy 0, policy_version 192160 (0.0005) [2023-03-08 03:27:30,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12697.6, 300 sec: 12912.8). Total num frames: 98398208. Throughput: 0: 12528.5. Samples: 98365504. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:27:30,769][304334] Avg episode reward: [(0, '4720.500')] [2023-03-08 03:27:33,056][304623] Updated weights for policy 0, policy_version 192240 (0.0005) [2023-03-08 03:27:35,769][304334] Fps is (10 sec: 12287.8, 60 sec: 12629.3, 300 sec: 12898.9). Total num frames: 98459648. Throughput: 0: 12359.9. Samples: 98438372. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:27:35,769][304334] Avg episode reward: [(0, '4718.160')] [2023-03-08 03:27:35,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000192304_98459648.pth... [2023-03-08 03:27:35,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000191584_98091008.pth [2023-03-08 03:27:36,370][304623] Updated weights for policy 0, policy_version 192320 (0.0005) [2023-03-08 03:27:39,729][304623] Updated weights for policy 0, policy_version 192400 (0.0005) [2023-03-08 03:27:40,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12898.9). Total num frames: 98521088. Throughput: 0: 12362.4. Samples: 98512220. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:27:40,769][304334] Avg episode reward: [(0, '4712.167')] [2023-03-08 03:27:43,091][304623] Updated weights for policy 0, policy_version 192480 (0.0005) [2023-03-08 03:27:45,769][304334] Fps is (10 sec: 12288.1, 60 sec: 12424.5, 300 sec: 12885.0). Total num frames: 98582528. Throughput: 0: 12348.9. Samples: 98548476. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:27:45,769][304334] Avg episode reward: [(0, '4719.586')] [2023-03-08 03:27:46,404][304623] Updated weights for policy 0, policy_version 192560 (0.0005) [2023-03-08 03:27:49,627][304623] Updated weights for policy 0, policy_version 192640 (0.0005) [2023-03-08 03:27:50,769][304334] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12885.0). Total num frames: 98643968. Throughput: 0: 12325.8. Samples: 98623496. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:27:50,769][304334] Avg episode reward: [(0, '4714.397')] [2023-03-08 03:27:50,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000192664_98643968.pth... [2023-03-08 03:27:50,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000191944_98275328.pth [2023-03-08 03:27:52,647][304623] Updated weights for policy 0, policy_version 192720 (0.0004) [2023-03-08 03:27:55,560][304623] Updated weights for policy 0, policy_version 192800 (0.0003) [2023-03-08 03:27:55,769][304334] Fps is (10 sec: 13107.2, 60 sec: 12492.8, 300 sec: 12898.9). Total num frames: 98713600. Throughput: 0: 12497.7. Samples: 98705472. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:27:55,769][304334] Avg episode reward: [(0, '4713.897')] [2023-03-08 03:27:58,485][304623] Updated weights for policy 0, policy_version 192880 (0.0004) [2023-03-08 03:28:00,769][304334] Fps is (10 sec: 13926.4, 60 sec: 12629.3, 300 sec: 12926.7). Total num frames: 98783232. Throughput: 0: 12622.4. Samples: 98747224. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:28:00,769][304334] Avg episode reward: [(0, '4712.958')] [2023-03-08 03:28:01,511][304623] Updated weights for policy 0, policy_version 192960 (0.0004) [2023-03-08 03:28:04,431][304623] Updated weights for policy 0, policy_version 193040 (0.0004) [2023-03-08 03:28:05,769][304334] Fps is (10 sec: 13926.4, 60 sec: 12765.8, 300 sec: 12940.6). Total num frames: 98852864. Throughput: 0: 12783.4. Samples: 98830100. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:28:05,769][304334] Avg episode reward: [(0, '4715.521')] [2023-03-08 03:28:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000193072_98852864.pth... [2023-03-08 03:28:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000192304_98459648.pth [2023-03-08 03:28:07,455][304623] Updated weights for policy 0, policy_version 193120 (0.0004) [2023-03-08 03:28:10,445][304623] Updated weights for policy 0, policy_version 193200 (0.0004) [2023-03-08 03:28:10,769][304334] Fps is (10 sec: 13926.4, 60 sec: 12902.4, 300 sec: 12940.6). Total num frames: 98922496. Throughput: 0: 12949.8. Samples: 98911316. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:28:10,769][304334] Avg episode reward: [(0, '4701.398')] [2023-03-08 03:28:13,449][304623] Updated weights for policy 0, policy_version 193280 (0.0004) [2023-03-08 03:28:15,769][304334] Fps is (10 sec: 13516.9, 60 sec: 12902.4, 300 sec: 12940.6). Total num frames: 98988032. Throughput: 0: 13052.4. Samples: 98952860. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:28:15,769][304334] Avg episode reward: [(0, '4721.435')] [2023-03-08 03:28:16,465][304623] Updated weights for policy 0, policy_version 193360 (0.0004) [2023-03-08 03:28:19,350][304623] Updated weights for policy 0, policy_version 193440 (0.0003) [2023-03-08 03:28:20,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13038.9, 300 sec: 12954.5). Total num frames: 99057664. Throughput: 0: 13277.5. Samples: 99035860. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:28:20,769][304334] Avg episode reward: [(0, '4716.348')] [2023-03-08 03:28:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000193472_99057664.pth... [2023-03-08 03:28:20,774][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000192664_98643968.pth [2023-03-08 03:28:22,309][304623] Updated weights for policy 0, policy_version 193520 (0.0004) [2023-03-08 03:28:25,289][304623] Updated weights for policy 0, policy_version 193600 (0.0004) [2023-03-08 03:28:25,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13175.5, 300 sec: 12954.5). Total num frames: 99127296. Throughput: 0: 13485.3. Samples: 99119060. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 03:28:25,769][304334] Avg episode reward: [(0, '4724.931')] [2023-03-08 03:28:28,427][304623] Updated weights for policy 0, policy_version 193680 (0.0004) [2023-03-08 03:28:30,769][304334] Fps is (10 sec: 13107.3, 60 sec: 13175.5, 300 sec: 12940.6). Total num frames: 99188736. Throughput: 0: 13562.0. Samples: 99158768. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:28:30,769][304334] Avg episode reward: [(0, '4714.051')] [2023-03-08 03:28:31,727][304623] Updated weights for policy 0, policy_version 193760 (0.0005) [2023-03-08 03:28:35,044][304623] Updated weights for policy 0, policy_version 193840 (0.0005) [2023-03-08 03:28:35,769][304334] Fps is (10 sec: 12697.6, 60 sec: 13243.8, 300 sec: 12926.7). Total num frames: 99254272. Throughput: 0: 13547.2. Samples: 99233120. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:28:35,769][304334] Avg episode reward: [(0, '4719.274')] [2023-03-08 03:28:35,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000193856_99254272.pth... [2023-03-08 03:28:35,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000193072_98852864.pth [2023-03-08 03:28:38,285][304623] Updated weights for policy 0, policy_version 193920 (0.0005) [2023-03-08 03:28:40,769][304334] Fps is (10 sec: 13107.3, 60 sec: 13312.0, 300 sec: 12912.8). Total num frames: 99319808. Throughput: 0: 13433.5. Samples: 99309980. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:28:40,769][304334] Avg episode reward: [(0, '4709.497')] [2023-03-08 03:28:41,254][304623] Updated weights for policy 0, policy_version 194000 (0.0005) [2023-03-08 03:28:44,526][304623] Updated weights for policy 0, policy_version 194080 (0.0005) [2023-03-08 03:28:45,769][304334] Fps is (10 sec: 12697.7, 60 sec: 13312.0, 300 sec: 12898.9). Total num frames: 99381248. Throughput: 0: 13367.9. Samples: 99348776. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:28:45,769][304334] Avg episode reward: [(0, '4720.096')] [2023-03-08 03:28:47,878][304623] Updated weights for policy 0, policy_version 194160 (0.0005) [2023-03-08 03:28:50,769][304334] Fps is (10 sec: 12288.0, 60 sec: 13312.0, 300 sec: 12871.2). Total num frames: 99442688. Throughput: 0: 13187.1. Samples: 99423516. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:28:50,769][304334] Avg episode reward: [(0, '4715.294')] [2023-03-08 03:28:50,782][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000194232_99446784.pth... [2023-03-08 03:28:50,784][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000193472_99057664.pth [2023-03-08 03:28:51,105][304623] Updated weights for policy 0, policy_version 194240 (0.0005) [2023-03-08 03:28:54,330][304623] Updated weights for policy 0, policy_version 194320 (0.0005) [2023-03-08 03:28:55,769][304334] Fps is (10 sec: 12697.5, 60 sec: 13243.7, 300 sec: 12857.3). Total num frames: 99508224. Throughput: 0: 13084.0. Samples: 99500096. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:28:55,769][304334] Avg episode reward: [(0, '4724.593')] [2023-03-08 03:28:57,390][304623] Updated weights for policy 0, policy_version 194400 (0.0004) [2023-03-08 03:29:00,307][304623] Updated weights for policy 0, policy_version 194480 (0.0003) [2023-03-08 03:29:00,769][304334] Fps is (10 sec: 13516.7, 60 sec: 13243.7, 300 sec: 12857.3). Total num frames: 99577856. Throughput: 0: 13071.0. Samples: 99541056. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:29:00,769][304334] Avg episode reward: [(0, '4717.490')] [2023-03-08 03:29:03,270][304623] Updated weights for policy 0, policy_version 194560 (0.0004) [2023-03-08 03:29:05,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13243.7, 300 sec: 12857.3). Total num frames: 99647488. Throughput: 0: 13069.5. Samples: 99623988. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:29:05,769][304334] Avg episode reward: [(0, '4706.251')] [2023-03-08 03:29:05,773][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000194624_99647488.pth... [2023-03-08 03:29:05,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000193856_99254272.pth [2023-03-08 03:29:06,264][304623] Updated weights for policy 0, policy_version 194640 (0.0004) [2023-03-08 03:29:09,201][304623] Updated weights for policy 0, policy_version 194720 (0.0003) [2023-03-08 03:29:10,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13243.7, 300 sec: 12885.0). Total num frames: 99717120. Throughput: 0: 13073.9. Samples: 99707384. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:29:10,769][304334] Avg episode reward: [(0, '4709.049')] [2023-03-08 03:29:12,179][304623] Updated weights for policy 0, policy_version 194800 (0.0003) [2023-03-08 03:29:15,127][304623] Updated weights for policy 0, policy_version 194880 (0.0003) [2023-03-08 03:29:15,769][304334] Fps is (10 sec: 13926.5, 60 sec: 13312.0, 300 sec: 12912.8). Total num frames: 99786752. Throughput: 0: 13098.9. Samples: 99748216. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:29:15,769][304334] Avg episode reward: [(0, '4703.210')] [2023-03-08 03:29:18,220][304623] Updated weights for policy 0, policy_version 194960 (0.0004) [2023-03-08 03:29:20,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13243.8, 300 sec: 12926.7). Total num frames: 99852288. Throughput: 0: 13272.5. Samples: 99830384. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:29:20,769][304334] Avg episode reward: [(0, '4703.656')] [2023-03-08 03:29:20,772][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000195024_99852288.pth... [2023-03-08 03:29:20,775][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000194232_99446784.pth [2023-03-08 03:29:21,140][304623] Updated weights for policy 0, policy_version 195040 (0.0004) [2023-03-08 03:29:24,216][304623] Updated weights for policy 0, policy_version 195120 (0.0004) [2023-03-08 03:29:25,769][304334] Fps is (10 sec: 13516.8, 60 sec: 13243.7, 300 sec: 12954.5). Total num frames: 99921920. Throughput: 0: 13367.3. Samples: 99911508. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:29:25,769][304334] Avg episode reward: [(0, '4709.847')] [2023-03-08 03:29:27,176][304623] Updated weights for policy 0, policy_version 195200 (0.0003) [2023-03-08 03:29:30,098][304623] Updated weights for policy 0, policy_version 195280 (0.0003) [2023-03-08 03:29:30,769][304334] Fps is (10 sec: 13926.4, 60 sec: 13380.3, 300 sec: 12968.4). Total num frames: 99991552. Throughput: 0: 13445.4. Samples: 99953820. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 03:29:30,769][304334] Avg episode reward: [(0, '4721.935')] [2023-03-08 03:29:31,642][304573] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000000 [2023-03-08 03:29:31,957][304573] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000000 [2023-03-08 03:29:31,958][304627] Stopping RolloutWorker_w6... [2023-03-08 03:29:31,958][304621] Stopping RolloutWorker_w3... [2023-03-08 03:29:31,958][304630] Stopping RolloutWorker_w4... [2023-03-08 03:29:31,958][304624] Stopping RolloutWorker_w2... [2023-03-08 03:29:31,958][304627] Loop rollout_proc6_evt_loop terminating... [2023-03-08 03:29:31,958][304625] Stopping RolloutWorker_w1... [2023-03-08 03:29:31,958][304621] Loop rollout_proc3_evt_loop terminating... [2023-03-08 03:29:31,958][304630] Loop rollout_proc4_evt_loop terminating... [2023-03-08 03:29:31,958][304622] Stopping RolloutWorker_w0... [2023-03-08 03:29:31,958][304628] Stopping RolloutWorker_w7... [2023-03-08 03:29:31,958][304626] Stopping RolloutWorker_w5... [2023-03-08 03:29:31,958][304624] Loop rollout_proc2_evt_loop terminating... [2023-03-08 03:29:31,958][304625] Loop rollout_proc1_evt_loop terminating... [2023-03-08 03:29:31,958][304622] Loop rollout_proc0_evt_loop terminating... [2023-03-08 03:29:31,958][304628] Loop rollout_proc7_evt_loop terminating... [2023-03-08 03:29:31,958][304626] Loop rollout_proc5_evt_loop terminating... [2023-03-08 03:29:31,958][304334] Component RolloutWorker_w6 stopped! [2023-03-08 03:29:31,958][304573] Stopping Batcher_0... [2023-03-08 03:29:31,959][304334] Component RolloutWorker_w3 stopped! [2023-03-08 03:29:31,959][304334] Component RolloutWorker_w4 stopped! [2023-03-08 03:29:31,959][304573] Loop batcher_evt_loop terminating... [2023-03-08 03:29:31,959][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000195328_100007936.pth... [2023-03-08 03:29:31,959][304334] Component RolloutWorker_w1 stopped! [2023-03-08 03:29:31,960][304334] Component RolloutWorker_w2 stopped! [2023-03-08 03:29:31,960][304334] Component RolloutWorker_w5 stopped! [2023-03-08 03:29:31,960][304334] Component RolloutWorker_w7 stopped! [2023-03-08 03:29:31,960][304334] Component RolloutWorker_w0 stopped! [2023-03-08 03:29:31,960][304334] Component Batcher_0 stopped! [2023-03-08 03:29:31,961][304573] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000194624_99647488.pth [2023-03-08 03:29:31,962][304573] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/door-unlock-v2/checkpoint_p0/checkpoint_000195328_100007936.pth... [2023-03-08 03:29:31,964][304573] Stopping LearnerWorker_p0... [2023-03-08 03:29:31,964][304573] Loop learner_proc0_evt_loop terminating... [2023-03-08 03:29:31,964][304334] Component LearnerWorker_p0 stopped! [2023-03-08 03:29:32,018][304623] Weights refcount: 2 0 [2023-03-08 03:29:32,018][304623] Stopping InferenceWorker_p0-w0... [2023-03-08 03:29:32,019][304623] Loop inference_proc0-0_evt_loop terminating... [2023-03-08 03:29:32,019][304334] Component InferenceWorker_p0-w0 stopped! [2023-03-08 03:29:32,019][304334] Waiting for process learner_proc0 to stop... [2023-03-08 03:29:32,386][304334] Waiting for process inference_proc0-0 to join... [2023-03-08 03:29:32,415][304334] Waiting for process rollout_proc0 to join... [2023-03-08 03:29:32,415][304334] Waiting for process rollout_proc1 to join... [2023-03-08 03:29:32,415][304334] Waiting for process rollout_proc2 to join... [2023-03-08 03:29:32,416][304334] Waiting for process rollout_proc3 to join... [2023-03-08 03:29:32,416][304334] Waiting for process rollout_proc4 to join... [2023-03-08 03:29:32,416][304334] Waiting for process rollout_proc5 to join... [2023-03-08 03:29:32,416][304334] Waiting for process rollout_proc6 to join... [2023-03-08 03:29:32,416][304334] Waiting for process rollout_proc7 to join... [2023-03-08 03:29:32,417][304334] Batcher 0 profile tree view: batching: 17.7117, releasing_batches: 15.2612 [2023-03-08 03:29:32,417][304334] InferenceWorker_p0-w0 profile tree view: wait_policy: 0.0051 wait_policy_total: 2583.5772 update_model: 91.8221 weight_update: 0.0004 one_step: 0.0005 handle_policy_step: 4615.5428 deserialize: 194.8565, stack: 48.7372, obs_to_device_normalize: 818.8233, forward: 2274.6338, send_messages: 351.0179 prepare_outputs: 525.3433 to_cpu: 81.4870 [2023-03-08 03:29:32,417][304334] Learner 0 profile tree view: misc: 0.0978, prepare_batch: 86.1314 train: 1124.0587 epoch_init: 0.3925, minibatch_init: 11.3535, losses_postprocess: 11.5136, kl_divergence: 4.0454, after_optimizer: 4.7151 calculate_losses: 461.3339 losses_init: 0.4089, forward_head: 228.9122, bptt_initial: 1.1913, bptt: 1.3220, tail: 108.0294, advantages_returns: 8.3891, losses: 99.5708 update: 615.6474 clip: 54.4133 [2023-03-08 03:29:32,417][304334] RolloutWorker_w0 profile tree view: wait_for_trajectories: 2.6212, enqueue_policy_requests: 122.7859, env_step: 5012.9069, overhead: 307.1621, complete_rollouts: 3.2948 save_policy_outputs: 323.2604 split_output_tensors: 160.3565 [2023-03-08 03:29:32,417][304334] RolloutWorker_w7 profile tree view: wait_for_trajectories: 2.6292, enqueue_policy_requests: 124.3133, env_step: 5018.3198, overhead: 304.5590, complete_rollouts: 3.1099 save_policy_outputs: 320.0691 split_output_tensors: 158.0784 [2023-03-08 03:29:32,418][304334] Loop Runner_EvtLoop terminating... [2023-03-08 03:29:32,418][304334] Runner profile tree view: main_loop: 7854.3738 [2023-03-08 03:29:32,418][304334] Collected {0: 100007936}, FPS: 12732.8