[2023-03-11 23:18:27,779][106151] Saving configuration to /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/config.json... [2023-03-11 23:18:27,793][106151] Rollout worker 0 uses device cpu [2023-03-11 23:18:27,794][106151] Rollout worker 1 uses device cpu [2023-03-11 23:18:27,794][106151] Rollout worker 2 uses device cpu [2023-03-11 23:18:27,794][106151] Rollout worker 3 uses device cpu [2023-03-11 23:18:27,794][106151] Rollout worker 4 uses device cpu [2023-03-11 23:18:27,794][106151] Rollout worker 5 uses device cpu [2023-03-11 23:18:27,794][106151] Rollout worker 6 uses device cpu [2023-03-11 23:18:27,794][106151] Rollout worker 7 uses device cpu [2023-03-11 23:18:27,795][106151] In synchronous mode, we only accumulate one batch. Setting num_batches_to_accumulate to 1 [2023-03-11 23:18:27,805][106151] InferenceWorker_p0-w0: min num requests: 2 [2023-03-11 23:18:27,820][106151] Starting all processes... [2023-03-11 23:18:27,821][106151] Starting process learner_proc0 [2023-03-11 23:18:27,870][106151] Starting all processes... [2023-03-11 23:18:27,914][106151] Starting process inference_proc0-0 [2023-03-11 23:18:27,922][106151] Starting process rollout_proc0 [2023-03-11 23:18:27,922][106151] Starting process rollout_proc1 [2023-03-11 23:18:27,922][106151] Starting process rollout_proc2 [2023-03-11 23:18:27,923][106151] Starting process rollout_proc3 [2023-03-11 23:18:27,923][106151] Starting process rollout_proc4 [2023-03-11 23:18:27,923][106151] Starting process rollout_proc5 [2023-03-11 23:18:27,923][106151] Starting process rollout_proc6 [2023-03-11 23:18:27,923][106151] Starting process rollout_proc7 [2023-03-11 23:18:29,311][106390] Starting seed is not provided [2023-03-11 23:18:29,311][106390] Initializing actor-critic model on device cpu [2023-03-11 23:18:29,312][106390] RunningMeanStd input shape: (39,) [2023-03-11 23:18:29,312][106390] RunningMeanStd input shape: (1,) [2023-03-11 23:18:29,392][106435] Worker 1 uses CPU cores [4, 5, 6, 7] [2023-03-11 23:18:29,394][106390] Created Actor Critic model with architecture: [2023-03-11 23:18:29,394][106390] ActorCriticSharedWeights( (obs_normalizer): ObservationNormalizer( (running_mean_std): RunningMeanStdDictInPlace( (running_mean_std): ModuleDict( (obs): RunningMeanStdInPlace() ) ) ) (returns_normalizer): RecursiveScriptModule(original_name=RunningMeanStdInPlace) (encoder): MultiInputEncoder( (encoders): ModuleDict( (obs): MlpEncoder( (mlp_head): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Linear) (1): RecursiveScriptModule(original_name=Tanh) (2): RecursiveScriptModule(original_name=Linear) (3): RecursiveScriptModule(original_name=Tanh) ) ) ) ) (core): ModelCoreIdentity() (decoder): MlpDecoder( (mlp): Identity() ) (critic_linear): Linear(in_features=64, out_features=1, bias=True) (action_parameterization): ActionParameterizationContinuousNonAdaptiveStddev( (distribution_linear): Linear(in_features=64, out_features=4, bias=True) ) ) [2023-03-11 23:18:29,646][106504] Worker 7 uses CPU cores [28, 29, 30, 31] [2023-03-11 23:18:29,708][106439] Worker 4 uses CPU cores [16, 17, 18, 19] [2023-03-11 23:18:29,712][106440] Worker 5 uses CPU cores [20, 21, 22, 23] [2023-03-11 23:18:29,721][106390] Using optimizer [2023-03-11 23:18:29,722][106390] No checkpoints found [2023-03-11 23:18:29,722][106390] Did not load from checkpoint, starting from scratch! [2023-03-11 23:18:29,723][106390] Initialized policy 0 weights for model version 0 [2023-03-11 23:18:29,724][106390] LearnerWorker_p0 finished initialization! [2023-03-11 23:18:29,725][106434] RunningMeanStd input shape: (39,) [2023-03-11 23:18:29,726][106434] RunningMeanStd input shape: (1,) [2023-03-11 23:18:29,789][106151] Inference worker 0-0 is ready! [2023-03-11 23:18:29,790][106151] All inference workers are ready! Signal rollout workers to start! [2023-03-11 23:18:29,801][106437] Worker 0 uses CPU cores [0, 1, 2, 3] [2023-03-11 23:18:29,959][106436] Worker 2 uses CPU cores [8, 9, 10, 11] [2023-03-11 23:18:30,007][106438] Worker 3 uses CPU cores [12, 13, 14, 15] [2023-03-11 23:18:30,163][106441] Worker 6 uses CPU cores [24, 25, 26, 27] [2023-03-11 23:18:30,661][106151] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 0. Throughput: 0: nan. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-11 23:18:33,607][106440] Decorrelating experience for 0 frames... [2023-03-11 23:18:33,611][106435] Decorrelating experience for 0 frames... [2023-03-11 23:18:33,612][106439] Decorrelating experience for 0 frames... [2023-03-11 23:18:33,620][106440] Decorrelating experience for 64 frames... [2023-03-11 23:18:33,621][106504] Decorrelating experience for 0 frames... [2023-03-11 23:18:33,625][106435] Decorrelating experience for 64 frames... [2023-03-11 23:18:33,625][106439] Decorrelating experience for 64 frames... [2023-03-11 23:18:33,633][106504] Decorrelating experience for 64 frames... [2023-03-11 23:18:33,647][106437] Decorrelating experience for 0 frames... [2023-03-11 23:18:33,659][106440] Decorrelating experience for 128 frames... [2023-03-11 23:18:33,660][106437] Decorrelating experience for 64 frames... [2023-03-11 23:18:33,664][106435] Decorrelating experience for 128 frames... [2023-03-11 23:18:33,664][106439] Decorrelating experience for 128 frames... [2023-03-11 23:18:33,673][106504] Decorrelating experience for 128 frames... [2023-03-11 23:18:33,699][106437] Decorrelating experience for 128 frames... [2023-03-11 23:18:33,724][106440] Decorrelating experience for 192 frames... [2023-03-11 23:18:33,728][106439] Decorrelating experience for 192 frames... [2023-03-11 23:18:33,729][106435] Decorrelating experience for 192 frames... [2023-03-11 23:18:33,737][106504] Decorrelating experience for 192 frames... [2023-03-11 23:18:33,763][106437] Decorrelating experience for 192 frames... [2023-03-11 23:18:33,822][106436] Decorrelating experience for 0 frames... [2023-03-11 23:18:33,835][106436] Decorrelating experience for 64 frames... [2023-03-11 23:18:33,874][106436] Decorrelating experience for 128 frames... [2023-03-11 23:18:33,891][106438] Decorrelating experience for 0 frames... [2023-03-11 23:18:33,904][106438] Decorrelating experience for 64 frames... [2023-03-11 23:18:33,939][106436] Decorrelating experience for 192 frames... [2023-03-11 23:18:33,944][106438] Decorrelating experience for 128 frames... [2023-03-11 23:18:34,008][106438] Decorrelating experience for 192 frames... [2023-03-11 23:18:34,029][106441] Decorrelating experience for 0 frames... [2023-03-11 23:18:34,042][106441] Decorrelating experience for 64 frames... [2023-03-11 23:18:34,081][106441] Decorrelating experience for 128 frames... [2023-03-11 23:18:34,146][106441] Decorrelating experience for 192 frames... [2023-03-11 23:18:35,661][106151] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-11 23:18:37,541][106440] Decorrelating experience for 256 frames... [2023-03-11 23:18:37,560][106504] Decorrelating experience for 256 frames... [2023-03-11 23:18:37,565][106435] Decorrelating experience for 256 frames... [2023-03-11 23:18:37,568][106439] Decorrelating experience for 256 frames... [2023-03-11 23:18:37,578][106437] Decorrelating experience for 256 frames... [2023-03-11 23:18:37,657][106440] Decorrelating experience for 320 frames... [2023-03-11 23:18:37,676][106504] Decorrelating experience for 320 frames... [2023-03-11 23:18:37,682][106435] Decorrelating experience for 320 frames... [2023-03-11 23:18:37,685][106439] Decorrelating experience for 320 frames... [2023-03-11 23:18:37,694][106437] Decorrelating experience for 320 frames... [2023-03-11 23:18:37,752][106436] Decorrelating experience for 256 frames... [2023-03-11 23:18:37,799][106440] Decorrelating experience for 384 frames... [2023-03-11 23:18:37,818][106504] Decorrelating experience for 384 frames... [2023-03-11 23:18:37,824][106435] Decorrelating experience for 384 frames... [2023-03-11 23:18:37,827][106439] Decorrelating experience for 384 frames... [2023-03-11 23:18:37,835][106437] Decorrelating experience for 384 frames... [2023-03-11 23:18:37,837][106438] Decorrelating experience for 256 frames... [2023-03-11 23:18:37,868][106436] Decorrelating experience for 320 frames... [2023-03-11 23:18:37,953][106438] Decorrelating experience for 320 frames... [2023-03-11 23:18:37,968][106440] Decorrelating experience for 448 frames... [2023-03-11 23:18:37,979][106441] Decorrelating experience for 256 frames... [2023-03-11 23:18:37,986][106504] Decorrelating experience for 448 frames... [2023-03-11 23:18:37,992][106435] Decorrelating experience for 448 frames... [2023-03-11 23:18:37,994][106439] Decorrelating experience for 448 frames... [2023-03-11 23:18:38,005][106437] Decorrelating experience for 448 frames... [2023-03-11 23:18:38,009][106436] Decorrelating experience for 384 frames... [2023-03-11 23:18:38,094][106438] Decorrelating experience for 384 frames... [2023-03-11 23:18:38,095][106441] Decorrelating experience for 320 frames... [2023-03-11 23:18:38,177][106436] Decorrelating experience for 448 frames... [2023-03-11 23:18:38,236][106441] Decorrelating experience for 384 frames... [2023-03-11 23:18:38,261][106438] Decorrelating experience for 448 frames... [2023-03-11 23:18:38,403][106441] Decorrelating experience for 448 frames... [2023-03-11 23:18:40,661][106151] Fps is (10 sec: 2048.0, 60 sec: 2048.0, 300 sec: 2048.0). Total num frames: 20480. Throughput: 0: 403.2. Samples: 4032. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:18:40,662][106151] Avg episode reward: [(0, '19.641')] [2023-03-11 23:18:40,663][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000000040_20480.pth... [2023-03-11 23:18:42,351][106434] Updated weights for policy 0, policy_version 80 (0.0005) [2023-03-11 23:18:45,661][106151] Fps is (10 sec: 7782.5, 60 sec: 5188.3, 300 sec: 5188.3). Total num frames: 77824. Throughput: 0: 4771.8. Samples: 71576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:18:45,661][106151] Avg episode reward: [(0, '127.112')] [2023-03-11 23:18:45,693][106434] Updated weights for policy 0, policy_version 160 (0.0005) [2023-03-11 23:18:47,801][106151] Heartbeat connected on Batcher_0 [2023-03-11 23:18:47,803][106151] Heartbeat connected on LearnerWorker_p0 [2023-03-11 23:18:47,805][106151] Heartbeat connected on InferenceWorker_p0-w0 [2023-03-11 23:18:47,811][106151] Heartbeat connected on RolloutWorker_w0 [2023-03-11 23:18:47,813][106151] Heartbeat connected on RolloutWorker_w1 [2023-03-11 23:18:47,813][106151] Heartbeat connected on RolloutWorker_w2 [2023-03-11 23:18:47,815][106151] Heartbeat connected on RolloutWorker_w3 [2023-03-11 23:18:47,817][106151] Heartbeat connected on RolloutWorker_w4 [2023-03-11 23:18:47,820][106151] Heartbeat connected on RolloutWorker_w5 [2023-03-11 23:18:47,821][106151] Heartbeat connected on RolloutWorker_w6 [2023-03-11 23:18:47,823][106151] Heartbeat connected on RolloutWorker_w7 [2023-03-11 23:18:49,091][106434] Updated weights for policy 0, policy_version 240 (0.0005) [2023-03-11 23:18:50,661][106151] Fps is (10 sec: 11878.4, 60 sec: 6963.2, 300 sec: 6963.2). Total num frames: 139264. Throughput: 0: 5379.0. Samples: 107580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:18:50,661][106151] Avg episode reward: [(0, '362.480')] [2023-03-11 23:18:50,662][106390] Saving new best policy, reward=362.480! [2023-03-11 23:18:52,695][106434] Updated weights for policy 0, policy_version 320 (0.0005) [2023-03-11 23:18:55,661][106151] Fps is (10 sec: 11878.3, 60 sec: 7864.3, 300 sec: 7864.3). Total num frames: 196608. Throughput: 0: 7061.4. Samples: 176536. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:18:55,661][106151] Avg episode reward: [(0, '486.602')] [2023-03-11 23:18:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000000384_196608.pth... [2023-03-11 23:18:55,669][106390] Saving new best policy, reward=486.602! [2023-03-11 23:18:56,249][106434] Updated weights for policy 0, policy_version 400 (0.0005) [2023-03-11 23:18:59,710][106434] Updated weights for policy 0, policy_version 480 (0.0004) [2023-03-11 23:19:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 8465.1, 300 sec: 8465.1). Total num frames: 253952. Throughput: 0: 8235.3. Samples: 247060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:19:00,661][106151] Avg episode reward: [(0, '549.066')] [2023-03-11 23:19:00,662][106390] Saving new best policy, reward=549.066! [2023-03-11 23:19:03,168][106434] Updated weights for policy 0, policy_version 560 (0.0005) [2023-03-11 23:19:05,661][106151] Fps is (10 sec: 11878.6, 60 sec: 9011.2, 300 sec: 9011.2). Total num frames: 315392. Throughput: 0: 8076.8. Samples: 282688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:19:05,661][106151] Avg episode reward: [(0, '608.368')] [2023-03-11 23:19:05,662][106390] Saving new best policy, reward=608.368! [2023-03-11 23:19:06,681][106434] Updated weights for policy 0, policy_version 640 (0.0005) [2023-03-11 23:19:10,185][106434] Updated weights for policy 0, policy_version 720 (0.0004) [2023-03-11 23:19:10,661][106151] Fps is (10 sec: 11878.4, 60 sec: 9318.4, 300 sec: 9318.4). Total num frames: 372736. Throughput: 0: 8811.4. Samples: 352456. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:19:10,662][106151] Avg episode reward: [(0, '495.141')] [2023-03-11 23:19:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000000728_372736.pth... [2023-03-11 23:19:10,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000000040_20480.pth [2023-03-11 23:19:13,698][106434] Updated weights for policy 0, policy_version 800 (0.0005) [2023-03-11 23:19:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 9557.3, 300 sec: 9557.3). Total num frames: 430080. Throughput: 0: 9382.8. Samples: 422224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:19:15,661][106151] Avg episode reward: [(0, '756.373')] [2023-03-11 23:19:15,662][106390] Saving new best policy, reward=756.373! [2023-03-11 23:19:17,171][106434] Updated weights for policy 0, policy_version 880 (0.0004) [2023-03-11 23:19:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 9748.5, 300 sec: 9748.5). Total num frames: 487424. Throughput: 0: 10194.5. Samples: 458752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:19:20,661][106151] Avg episode reward: [(0, '565.310')] [2023-03-11 23:19:20,709][106434] Updated weights for policy 0, policy_version 960 (0.0005) [2023-03-11 23:19:24,192][106434] Updated weights for policy 0, policy_version 1040 (0.0005) [2023-03-11 23:19:25,661][106151] Fps is (10 sec: 11878.3, 60 sec: 9979.3, 300 sec: 9979.3). Total num frames: 548864. Throughput: 0: 11652.4. Samples: 528392. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 23:19:25,661][106151] Avg episode reward: [(0, '546.859')] [2023-03-11 23:19:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000001072_548864.pth... [2023-03-11 23:19:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000000384_196608.pth [2023-03-11 23:19:27,652][106434] Updated weights for policy 0, policy_version 1120 (0.0005) [2023-03-11 23:19:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 10103.5, 300 sec: 10103.5). Total num frames: 606208. Throughput: 0: 11728.7. Samples: 599368. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 23:19:30,661][106151] Avg episode reward: [(0, '632.591')] [2023-03-11 23:19:31,073][106434] Updated weights for policy 0, policy_version 1200 (0.0005) [2023-03-11 23:19:34,523][106434] Updated weights for policy 0, policy_version 1280 (0.0005) [2023-03-11 23:19:35,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11127.5, 300 sec: 10271.5). Total num frames: 667648. Throughput: 0: 11719.4. Samples: 634952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:19:35,661][106151] Avg episode reward: [(0, '322.128')] [2023-03-11 23:19:37,974][106434] Updated weights for policy 0, policy_version 1360 (0.0005) [2023-03-11 23:19:40,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11741.9, 300 sec: 10357.0). Total num frames: 724992. Throughput: 0: 11775.0. Samples: 706412. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:19:40,661][106151] Avg episode reward: [(0, '624.427')] [2023-03-11 23:19:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000001416_724992.pth... [2023-03-11 23:19:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000000728_372736.pth [2023-03-11 23:19:41,436][106434] Updated weights for policy 0, policy_version 1440 (0.0004) [2023-03-11 23:19:44,981][106434] Updated weights for policy 0, policy_version 1520 (0.0005) [2023-03-11 23:19:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 10431.2). Total num frames: 782336. Throughput: 0: 11758.1. Samples: 776176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:19:45,661][106151] Avg episode reward: [(0, '652.458')] [2023-03-11 23:19:48,347][106434] Updated weights for policy 0, policy_version 1600 (0.0004) [2023-03-11 23:19:50,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11741.9, 300 sec: 10547.2). Total num frames: 843776. Throughput: 0: 11770.9. Samples: 812380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:19:50,661][106151] Avg episode reward: [(0, '715.424')] [2023-03-11 23:19:51,710][106434] Updated weights for policy 0, policy_version 1680 (0.0005) [2023-03-11 23:19:55,192][106434] Updated weights for policy 0, policy_version 1760 (0.0005) [2023-03-11 23:19:55,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11810.1, 300 sec: 10649.6). Total num frames: 905216. Throughput: 0: 11829.9. Samples: 884800. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:19:55,662][106151] Avg episode reward: [(0, '1307.282')] [2023-03-11 23:19:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000001768_905216.pth... [2023-03-11 23:19:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000001072_548864.pth [2023-03-11 23:19:55,668][106390] Saving new best policy, reward=1307.282! [2023-03-11 23:19:58,710][106434] Updated weights for policy 0, policy_version 1840 (0.0005) [2023-03-11 23:20:00,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 10695.1). Total num frames: 962560. Throughput: 0: 11853.8. Samples: 955644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:20:00,661][106151] Avg episode reward: [(0, '1589.986')] [2023-03-11 23:20:00,662][106390] Saving new best policy, reward=1589.986! [2023-03-11 23:20:02,181][106434] Updated weights for policy 0, policy_version 1920 (0.0005) [2023-03-11 23:20:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 10735.8). Total num frames: 1019904. Throughput: 0: 11831.5. Samples: 991172. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 23:20:05,662][106151] Avg episode reward: [(0, '1558.193')] [2023-03-11 23:20:05,688][106434] Updated weights for policy 0, policy_version 2000 (0.0005) [2023-03-11 23:20:09,261][106434] Updated weights for policy 0, policy_version 2080 (0.0006) [2023-03-11 23:20:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 10772.5). Total num frames: 1077248. Throughput: 0: 11832.7. Samples: 1060864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:20:10,661][106151] Avg episode reward: [(0, '1775.332')] [2023-03-11 23:20:10,683][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000002112_1081344.pth... [2023-03-11 23:20:10,685][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000001416_724992.pth [2023-03-11 23:20:10,685][106390] Saving new best policy, reward=1775.332! [2023-03-11 23:20:12,858][106434] Updated weights for policy 0, policy_version 2160 (0.0005) [2023-03-11 23:20:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 10844.7). Total num frames: 1138688. Throughput: 0: 11804.4. Samples: 1130568. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:20:15,661][106151] Avg episode reward: [(0, '2245.962')] [2023-03-11 23:20:15,662][106390] Saving new best policy, reward=2245.962! [2023-03-11 23:20:16,109][106434] Updated weights for policy 0, policy_version 2240 (0.0004) [2023-03-11 23:20:19,426][106434] Updated weights for policy 0, policy_version 2320 (0.0005) [2023-03-11 23:20:20,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 10910.3). Total num frames: 1200128. Throughput: 0: 11848.1. Samples: 1168116. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:20:20,662][106151] Avg episode reward: [(0, '2100.448')] [2023-03-11 23:20:22,701][106434] Updated weights for policy 0, policy_version 2400 (0.0005) [2023-03-11 23:20:25,664][106151] Fps is (10 sec: 12694.1, 60 sec: 11946.1, 300 sec: 11005.5). Total num frames: 1265664. Throughput: 0: 11926.9. Samples: 1243156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:20:25,665][106151] Avg episode reward: [(0, '2136.312')] [2023-03-11 23:20:25,668][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000002472_1265664.pth... [2023-03-11 23:20:25,670][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000001768_905216.pth [2023-03-11 23:20:25,984][106434] Updated weights for policy 0, policy_version 2480 (0.0005) [2023-03-11 23:20:29,513][106434] Updated weights for policy 0, policy_version 2560 (0.0005) [2023-03-11 23:20:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11025.1). Total num frames: 1323008. Throughput: 0: 11969.8. Samples: 1314816. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 23:20:30,662][106151] Avg episode reward: [(0, '1889.253')] [2023-03-11 23:20:33,189][106434] Updated weights for policy 0, policy_version 2640 (0.0005) [2023-03-11 23:20:35,661][106151] Fps is (10 sec: 11062.2, 60 sec: 11810.1, 300 sec: 11010.0). Total num frames: 1376256. Throughput: 0: 11893.6. Samples: 1347592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:20:35,662][106151] Avg episode reward: [(0, '1592.255')] [2023-03-11 23:20:36,831][106434] Updated weights for policy 0, policy_version 2720 (0.0005) [2023-03-11 23:20:40,117][106434] Updated weights for policy 0, policy_version 2800 (0.0004) [2023-03-11 23:20:40,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11878.4, 300 sec: 11059.2). Total num frames: 1437696. Throughput: 0: 11832.9. Samples: 1417280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:20:40,662][106151] Avg episode reward: [(0, '1947.888')] [2023-03-11 23:20:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000002808_1437696.pth... [2023-03-11 23:20:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000002112_1081344.pth [2023-03-11 23:20:43,416][106434] Updated weights for policy 0, policy_version 2880 (0.0004) [2023-03-11 23:20:45,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11104.7). Total num frames: 1499136. Throughput: 0: 11914.6. Samples: 1491800. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:20:45,662][106151] Avg episode reward: [(0, '1994.211')] [2023-03-11 23:20:46,674][106434] Updated weights for policy 0, policy_version 2960 (0.0005) [2023-03-11 23:20:49,973][106434] Updated weights for policy 0, policy_version 3040 (0.0005) [2023-03-11 23:20:50,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11176.2). Total num frames: 1564672. Throughput: 0: 11966.1. Samples: 1529648. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:20:50,661][106151] Avg episode reward: [(0, '1782.924')] [2023-03-11 23:20:53,359][106434] Updated weights for policy 0, policy_version 3120 (0.0005) [2023-03-11 23:20:55,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11186.3). Total num frames: 1622016. Throughput: 0: 12037.9. Samples: 1602572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:20:55,662][106151] Avg episode reward: [(0, '1866.436')] [2023-03-11 23:20:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000003168_1622016.pth... [2023-03-11 23:20:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000002472_1265664.pth [2023-03-11 23:20:56,780][106434] Updated weights for policy 0, policy_version 3200 (0.0005) [2023-03-11 23:20:59,993][106434] Updated weights for policy 0, policy_version 3280 (0.0004) [2023-03-11 23:21:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11223.0). Total num frames: 1683456. Throughput: 0: 12139.6. Samples: 1676848. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:21:00,661][106151] Avg episode reward: [(0, '1404.272')] [2023-03-11 23:21:03,308][106434] Updated weights for policy 0, policy_version 3360 (0.0005) [2023-03-11 23:21:05,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12151.5, 300 sec: 11283.8). Total num frames: 1748992. Throughput: 0: 12140.2. Samples: 1714424. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:21:05,661][106151] Avg episode reward: [(0, '1868.786')] [2023-03-11 23:21:06,601][106434] Updated weights for policy 0, policy_version 3440 (0.0005) [2023-03-11 23:21:09,820][106434] Updated weights for policy 0, policy_version 3520 (0.0004) [2023-03-11 23:21:10,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 11315.2). Total num frames: 1810432. Throughput: 0: 12145.9. Samples: 1789688. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:21:10,662][106151] Avg episode reward: [(0, '1831.929')] [2023-03-11 23:21:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000003536_1810432.pth... [2023-03-11 23:21:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000002808_1437696.pth [2023-03-11 23:21:13,015][106434] Updated weights for policy 0, policy_version 3600 (0.0004) [2023-03-11 23:21:15,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12219.7, 300 sec: 11344.7). Total num frames: 1871872. Throughput: 0: 12198.6. Samples: 1863752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:21:15,662][106151] Avg episode reward: [(0, '1740.975')] [2023-03-11 23:21:16,565][106434] Updated weights for policy 0, policy_version 3680 (0.0005) [2023-03-11 23:21:19,972][106434] Updated weights for policy 0, policy_version 3760 (0.0005) [2023-03-11 23:21:20,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12219.7, 300 sec: 11372.4). Total num frames: 1933312. Throughput: 0: 12258.1. Samples: 1899208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:21:20,661][106151] Avg episode reward: [(0, '1324.172')] [2023-03-11 23:21:23,314][106434] Updated weights for policy 0, policy_version 3840 (0.0005) [2023-03-11 23:21:25,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12083.7, 300 sec: 11375.2). Total num frames: 1990656. Throughput: 0: 12331.6. Samples: 1972204. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:21:25,662][106151] Avg episode reward: [(0, '1551.823')] [2023-03-11 23:21:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000003888_1990656.pth... [2023-03-11 23:21:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000003168_1622016.pth [2023-03-11 23:21:26,876][106434] Updated weights for policy 0, policy_version 3920 (0.0005) [2023-03-11 23:21:30,408][106434] Updated weights for policy 0, policy_version 4000 (0.0005) [2023-03-11 23:21:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 11377.8). Total num frames: 2048000. Throughput: 0: 12207.7. Samples: 2041148. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 23:21:30,661][106151] Avg episode reward: [(0, '677.952')] [2023-03-11 23:21:33,925][106434] Updated weights for policy 0, policy_version 4080 (0.0005) [2023-03-11 23:21:35,661][106151] Fps is (10 sec: 11469.0, 60 sec: 12151.5, 300 sec: 11380.2). Total num frames: 2105344. Throughput: 0: 12156.1. Samples: 2076672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:21:35,661][106151] Avg episode reward: [(0, '885.463')] [2023-03-11 23:21:37,471][106434] Updated weights for policy 0, policy_version 4160 (0.0005) [2023-03-11 23:21:40,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12151.5, 300 sec: 11404.1). Total num frames: 2166784. Throughput: 0: 12082.9. Samples: 2146304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:21:40,662][106151] Avg episode reward: [(0, '1401.582')] [2023-03-11 23:21:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000004232_2166784.pth... [2023-03-11 23:21:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000003536_1810432.pth [2023-03-11 23:21:40,948][106434] Updated weights for policy 0, policy_version 4240 (0.0005) [2023-03-11 23:21:44,175][106434] Updated weights for policy 0, policy_version 4320 (0.0004) [2023-03-11 23:21:45,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12151.5, 300 sec: 11426.8). Total num frames: 2228224. Throughput: 0: 12072.2. Samples: 2220096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:21:45,661][106151] Avg episode reward: [(0, '1491.814')] [2023-03-11 23:21:47,376][106434] Updated weights for policy 0, policy_version 4400 (0.0004) [2023-03-11 23:21:50,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12083.2, 300 sec: 11448.3). Total num frames: 2289664. Throughput: 0: 12083.4. Samples: 2258176. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 23:21:50,661][106151] Avg episode reward: [(0, '1053.113')] [2023-03-11 23:21:50,851][106434] Updated weights for policy 0, policy_version 4480 (0.0005) [2023-03-11 23:21:54,355][106434] Updated weights for policy 0, policy_version 4560 (0.0005) [2023-03-11 23:21:55,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 11448.8). Total num frames: 2347008. Throughput: 0: 11968.4. Samples: 2328268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:21:55,662][106151] Avg episode reward: [(0, '864.496')] [2023-03-11 23:21:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000004584_2347008.pth... [2023-03-11 23:21:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000003888_1990656.pth [2023-03-11 23:21:57,766][106434] Updated weights for policy 0, policy_version 4640 (0.0005) [2023-03-11 23:22:00,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 11488.3). Total num frames: 2412544. Throughput: 0: 11966.1. Samples: 2402224. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 23:22:00,661][106151] Avg episode reward: [(0, '1257.016')] [2023-03-11 23:22:00,989][106434] Updated weights for policy 0, policy_version 4720 (0.0004) [2023-03-11 23:22:04,290][106434] Updated weights for policy 0, policy_version 4800 (0.0005) [2023-03-11 23:22:05,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12083.2, 300 sec: 11506.9). Total num frames: 2473984. Throughput: 0: 12005.5. Samples: 2439456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:22:05,661][106151] Avg episode reward: [(0, '1597.234')] [2023-03-11 23:22:07,539][106434] Updated weights for policy 0, policy_version 4880 (0.0004) [2023-03-11 23:22:10,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11524.7). Total num frames: 2535424. Throughput: 0: 12060.5. Samples: 2514928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:22:10,661][106151] Avg episode reward: [(0, '2047.023')] [2023-03-11 23:22:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000004952_2535424.pth... [2023-03-11 23:22:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000004232_2166784.pth [2023-03-11 23:22:10,970][106434] Updated weights for policy 0, policy_version 4960 (0.0004) [2023-03-11 23:22:14,530][106434] Updated weights for policy 0, policy_version 5040 (0.0005) [2023-03-11 23:22:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11523.4). Total num frames: 2592768. Throughput: 0: 12073.8. Samples: 2584468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:22:15,661][106151] Avg episode reward: [(0, '2274.992')] [2023-03-11 23:22:15,662][106390] Saving new best policy, reward=2274.992! [2023-03-11 23:22:18,012][106434] Updated weights for policy 0, policy_version 5120 (0.0005) [2023-03-11 23:22:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11522.2). Total num frames: 2650112. Throughput: 0: 12058.4. Samples: 2619300. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:22:20,661][106151] Avg episode reward: [(0, '2007.240')] [2023-03-11 23:22:21,494][106434] Updated weights for policy 0, policy_version 5200 (0.0005) [2023-03-11 23:22:24,844][106434] Updated weights for policy 0, policy_version 5280 (0.0004) [2023-03-11 23:22:25,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11538.5). Total num frames: 2711552. Throughput: 0: 12104.6. Samples: 2691012. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:22:25,662][106151] Avg episode reward: [(0, '1965.295')] [2023-03-11 23:22:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000005296_2711552.pth... [2023-03-11 23:22:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000004584_2347008.pth [2023-03-11 23:22:28,070][106434] Updated weights for policy 0, policy_version 5360 (0.0003) [2023-03-11 23:22:30,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 11571.2). Total num frames: 2777088. Throughput: 0: 12149.8. Samples: 2766836. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 23:22:30,661][106151] Avg episode reward: [(0, '1796.112')] [2023-03-11 23:22:31,255][106434] Updated weights for policy 0, policy_version 5440 (0.0003) [2023-03-11 23:22:34,716][106434] Updated weights for policy 0, policy_version 5520 (0.0005) [2023-03-11 23:22:35,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 11569.1). Total num frames: 2834432. Throughput: 0: 12144.2. Samples: 2804664. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 23:22:35,661][106151] Avg episode reward: [(0, '1236.587')] [2023-03-11 23:22:38,196][106434] Updated weights for policy 0, policy_version 5600 (0.0005) [2023-03-11 23:22:40,661][106151] Fps is (10 sec: 11468.7, 60 sec: 12083.2, 300 sec: 11567.1). Total num frames: 2891776. Throughput: 0: 12144.8. Samples: 2874784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:22:40,662][106151] Avg episode reward: [(0, '1544.657')] [2023-03-11 23:22:40,697][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000005656_2895872.pth... [2023-03-11 23:22:40,698][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000004952_2535424.pth [2023-03-11 23:22:41,725][106434] Updated weights for policy 0, policy_version 5680 (0.0005) [2023-03-11 23:22:45,256][106434] Updated weights for policy 0, policy_version 5760 (0.0005) [2023-03-11 23:22:45,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11581.2). Total num frames: 2953216. Throughput: 0: 12045.9. Samples: 2944292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:22:45,661][106151] Avg episode reward: [(0, '956.196')] [2023-03-11 23:22:48,793][106434] Updated weights for policy 0, policy_version 5840 (0.0005) [2023-03-11 23:22:50,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12014.9, 300 sec: 11579.1). Total num frames: 3010560. Throughput: 0: 11985.3. Samples: 2978796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:22:50,661][106151] Avg episode reward: [(0, '668.348')] [2023-03-11 23:22:52,257][106434] Updated weights for policy 0, policy_version 5920 (0.0004) [2023-03-11 23:22:55,659][106434] Updated weights for policy 0, policy_version 6000 (0.0005) [2023-03-11 23:22:55,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11592.5). Total num frames: 3072000. Throughput: 0: 11898.0. Samples: 3050336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:22:55,661][106151] Avg episode reward: [(0, '611.623')] [2023-03-11 23:22:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000006000_3072000.pth... [2023-03-11 23:22:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000005296_2711552.pth [2023-03-11 23:22:59,231][106434] Updated weights for policy 0, policy_version 6080 (0.0005) [2023-03-11 23:23:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11590.2). Total num frames: 3129344. Throughput: 0: 11910.1. Samples: 3120420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:23:00,661][106151] Avg episode reward: [(0, '1494.351')] [2023-03-11 23:23:02,659][106434] Updated weights for policy 0, policy_version 6160 (0.0004) [2023-03-11 23:23:05,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11602.9). Total num frames: 3190784. Throughput: 0: 11923.5. Samples: 3155856. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 23:23:05,661][106151] Avg episode reward: [(0, '1700.813')] [2023-03-11 23:23:05,933][106434] Updated weights for policy 0, policy_version 6240 (0.0004) [2023-03-11 23:23:09,140][106434] Updated weights for policy 0, policy_version 6320 (0.0003) [2023-03-11 23:23:10,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 11615.1). Total num frames: 3252224. Throughput: 0: 12017.7. Samples: 3231808. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 23:23:10,662][106151] Avg episode reward: [(0, '2169.969')] [2023-03-11 23:23:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000006352_3252224.pth... [2023-03-11 23:23:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000005656_2895872.pth [2023-03-11 23:23:12,596][106434] Updated weights for policy 0, policy_version 6400 (0.0005) [2023-03-11 23:23:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11612.5). Total num frames: 3309568. Throughput: 0: 11885.1. Samples: 3301664. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 23:23:15,662][106151] Avg episode reward: [(0, '1910.780')] [2023-03-11 23:23:16,240][106434] Updated weights for policy 0, policy_version 6480 (0.0005) [2023-03-11 23:23:19,869][106434] Updated weights for policy 0, policy_version 6560 (0.0004) [2023-03-11 23:23:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11610.0). Total num frames: 3366912. Throughput: 0: 11787.6. Samples: 3335104. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:23:20,661][106151] Avg episode reward: [(0, '2067.253')] [2023-03-11 23:23:23,392][106434] Updated weights for policy 0, policy_version 6640 (0.0004) [2023-03-11 23:23:25,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11607.6). Total num frames: 3424256. Throughput: 0: 11768.8. Samples: 3404380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:23:25,661][106151] Avg episode reward: [(0, '2405.609')] [2023-03-11 23:23:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000006688_3424256.pth... [2023-03-11 23:23:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000006000_3072000.pth [2023-03-11 23:23:25,668][106390] Saving new best policy, reward=2405.609! [2023-03-11 23:23:26,965][106434] Updated weights for policy 0, policy_version 6720 (0.0005) [2023-03-11 23:23:30,537][106434] Updated weights for policy 0, policy_version 6800 (0.0005) [2023-03-11 23:23:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11802.0). Total num frames: 3481600. Throughput: 0: 11759.6. Samples: 3473472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:23:30,661][106151] Avg episode reward: [(0, '2705.490')] [2023-03-11 23:23:30,662][106390] Saving new best policy, reward=2705.490! [2023-03-11 23:23:34,044][106434] Updated weights for policy 0, policy_version 6880 (0.0005) [2023-03-11 23:23:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11927.0). Total num frames: 3538944. Throughput: 0: 11767.4. Samples: 3508328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:23:35,661][106151] Avg episode reward: [(0, '2593.848')] [2023-03-11 23:23:37,624][106434] Updated weights for policy 0, policy_version 6960 (0.0005) [2023-03-11 23:23:40,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11927.0). Total num frames: 3596288. Throughput: 0: 11722.7. Samples: 3577856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:23:40,661][106151] Avg episode reward: [(0, '2432.600')] [2023-03-11 23:23:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000007024_3596288.pth... [2023-03-11 23:23:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000006352_3252224.pth [2023-03-11 23:23:41,169][106434] Updated weights for policy 0, policy_version 7040 (0.0005) [2023-03-11 23:23:44,677][106434] Updated weights for policy 0, policy_version 7120 (0.0004) [2023-03-11 23:23:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11913.1). Total num frames: 3653632. Throughput: 0: 11707.1. Samples: 3647240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:23:45,661][106151] Avg episode reward: [(0, '2475.941')] [2023-03-11 23:23:48,031][106434] Updated weights for policy 0, policy_version 7200 (0.0004) [2023-03-11 23:23:50,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11927.0). Total num frames: 3715072. Throughput: 0: 11722.8. Samples: 3683384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:23:50,661][106151] Avg episode reward: [(0, '3238.981')] [2023-03-11 23:23:50,662][106390] Saving new best policy, reward=3238.981! [2023-03-11 23:23:51,425][106434] Updated weights for policy 0, policy_version 7280 (0.0004) [2023-03-11 23:23:54,995][106434] Updated weights for policy 0, policy_version 7360 (0.0005) [2023-03-11 23:23:55,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11927.0). Total num frames: 3772416. Throughput: 0: 11636.0. Samples: 3755428. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:23:55,661][106151] Avg episode reward: [(0, '3003.936')] [2023-03-11 23:23:55,680][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000007376_3776512.pth... [2023-03-11 23:23:55,682][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000006688_3424256.pth [2023-03-11 23:23:58,419][106434] Updated weights for policy 0, policy_version 7440 (0.0004) [2023-03-11 23:24:00,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11741.9, 300 sec: 11927.0). Total num frames: 3833856. Throughput: 0: 11645.9. Samples: 3825728. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:24:00,661][106151] Avg episode reward: [(0, '2889.939')] [2023-03-11 23:24:01,897][106434] Updated weights for policy 0, policy_version 7520 (0.0005) [2023-03-11 23:24:05,301][106434] Updated weights for policy 0, policy_version 7600 (0.0004) [2023-03-11 23:24:05,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11940.9). Total num frames: 3895296. Throughput: 0: 11690.6. Samples: 3861180. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:24:05,661][106151] Avg episode reward: [(0, '2339.330')] [2023-03-11 23:24:08,772][106434] Updated weights for policy 0, policy_version 7680 (0.0005) [2023-03-11 23:24:10,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11940.9). Total num frames: 3952640. Throughput: 0: 11735.0. Samples: 3932456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:24:10,662][106151] Avg episode reward: [(0, '2829.878')] [2023-03-11 23:24:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000007720_3952640.pth... [2023-03-11 23:24:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000007024_3596288.pth [2023-03-11 23:24:12,415][106434] Updated weights for policy 0, policy_version 7760 (0.0004) [2023-03-11 23:24:15,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11605.3, 300 sec: 11927.0). Total num frames: 4005888. Throughput: 0: 11714.3. Samples: 4000616. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 23:24:15,661][106151] Avg episode reward: [(0, '2523.223')] [2023-03-11 23:24:16,058][106434] Updated weights for policy 0, policy_version 7840 (0.0005) [2023-03-11 23:24:19,604][106434] Updated weights for policy 0, policy_version 7920 (0.0005) [2023-03-11 23:24:20,661][106151] Fps is (10 sec: 11059.3, 60 sec: 11605.3, 300 sec: 11913.1). Total num frames: 4063232. Throughput: 0: 11695.6. Samples: 4034632. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 23:24:20,661][106151] Avg episode reward: [(0, '2975.117')] [2023-03-11 23:24:23,165][106434] Updated weights for policy 0, policy_version 8000 (0.0005) [2023-03-11 23:24:25,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11913.1). Total num frames: 4120576. Throughput: 0: 11689.7. Samples: 4103892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:24:25,662][106151] Avg episode reward: [(0, '3231.196')] [2023-03-11 23:24:25,712][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000008056_4124672.pth... [2023-03-11 23:24:25,713][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000007376_3776512.pth [2023-03-11 23:24:26,769][106434] Updated weights for policy 0, policy_version 8080 (0.0005) [2023-03-11 23:24:30,289][106434] Updated weights for policy 0, policy_version 8160 (0.0005) [2023-03-11 23:24:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11913.1). Total num frames: 4182016. Throughput: 0: 11672.4. Samples: 4172496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:24:30,661][106151] Avg episode reward: [(0, '3143.436')] [2023-03-11 23:24:33,845][106434] Updated weights for policy 0, policy_version 8240 (0.0005) [2023-03-11 23:24:35,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 11913.1). Total num frames: 4239360. Throughput: 0: 11642.6. Samples: 4207300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:24:35,661][106151] Avg episode reward: [(0, '3684.364')] [2023-03-11 23:24:35,662][106390] Saving new best policy, reward=3684.364! [2023-03-11 23:24:37,359][106434] Updated weights for policy 0, policy_version 8320 (0.0005) [2023-03-11 23:24:40,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11913.1). Total num frames: 4296704. Throughput: 0: 11583.7. Samples: 4276696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:24:40,661][106151] Avg episode reward: [(0, '4180.721')] [2023-03-11 23:24:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000008392_4296704.pth... [2023-03-11 23:24:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000007720_3952640.pth [2023-03-11 23:24:40,668][106390] Saving new best policy, reward=4180.721! [2023-03-11 23:24:40,936][106434] Updated weights for policy 0, policy_version 8400 (0.0005) [2023-03-11 23:24:44,637][106434] Updated weights for policy 0, policy_version 8480 (0.0005) [2023-03-11 23:24:45,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11605.3, 300 sec: 11885.3). Total num frames: 4349952. Throughput: 0: 11516.5. Samples: 4343972. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:24:45,661][106151] Avg episode reward: [(0, '3857.571')] [2023-03-11 23:24:48,355][106434] Updated weights for policy 0, policy_version 8560 (0.0005) [2023-03-11 23:24:50,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11871.5). Total num frames: 4407296. Throughput: 0: 11460.1. Samples: 4376884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:24:50,662][106151] Avg episode reward: [(0, '3455.041')] [2023-03-11 23:24:52,119][106434] Updated weights for policy 0, policy_version 8640 (0.0005) [2023-03-11 23:24:55,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11468.8, 300 sec: 11857.6). Total num frames: 4460544. Throughput: 0: 11324.7. Samples: 4442068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:24:55,661][106151] Avg episode reward: [(0, '3997.693')] [2023-03-11 23:24:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000008712_4460544.pth... [2023-03-11 23:24:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000008056_4124672.pth [2023-03-11 23:24:55,872][106434] Updated weights for policy 0, policy_version 8720 (0.0005) [2023-03-11 23:24:59,593][106434] Updated weights for policy 0, policy_version 8800 (0.0005) [2023-03-11 23:25:00,661][106151] Fps is (10 sec: 10649.6, 60 sec: 11332.3, 300 sec: 11843.7). Total num frames: 4513792. Throughput: 0: 11283.6. Samples: 4508376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:25:00,661][106151] Avg episode reward: [(0, '3778.548')] [2023-03-11 23:25:03,368][106434] Updated weights for policy 0, policy_version 8880 (0.0005) [2023-03-11 23:25:05,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11264.0, 300 sec: 11843.7). Total num frames: 4571136. Throughput: 0: 11251.9. Samples: 4540968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:25:05,661][106151] Avg episode reward: [(0, '3366.112')] [2023-03-11 23:25:07,205][106434] Updated weights for policy 0, policy_version 8960 (0.0005) [2023-03-11 23:25:10,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11815.9). Total num frames: 4624384. Throughput: 0: 11140.2. Samples: 4605200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:25:10,661][106151] Avg episode reward: [(0, '3417.552')] [2023-03-11 23:25:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000009032_4624384.pth... [2023-03-11 23:25:10,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000008392_4296704.pth [2023-03-11 23:25:10,998][106434] Updated weights for policy 0, policy_version 9040 (0.0005) [2023-03-11 23:25:14,807][106434] Updated weights for policy 0, policy_version 9120 (0.0006) [2023-03-11 23:25:15,661][106151] Fps is (10 sec: 10649.6, 60 sec: 11195.7, 300 sec: 11788.2). Total num frames: 4677632. Throughput: 0: 11044.8. Samples: 4669512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:25:15,661][106151] Avg episode reward: [(0, '3469.160')] [2023-03-11 23:25:18,613][106434] Updated weights for policy 0, policy_version 9200 (0.0006) [2023-03-11 23:25:20,661][106151] Fps is (10 sec: 10649.6, 60 sec: 11127.5, 300 sec: 11746.6). Total num frames: 4730880. Throughput: 0: 10999.4. Samples: 4702272. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 23:25:20,661][106151] Avg episode reward: [(0, '3459.804')] [2023-03-11 23:25:22,199][106434] Updated weights for policy 0, policy_version 9280 (0.0004) [2023-03-11 23:25:25,661][106151] Fps is (10 sec: 11059.1, 60 sec: 11127.5, 300 sec: 11746.5). Total num frames: 4788224. Throughput: 0: 10936.9. Samples: 4768856. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 23:25:25,661][106151] Avg episode reward: [(0, '3495.983')] [2023-03-11 23:25:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000009352_4788224.pth... [2023-03-11 23:25:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000008712_4460544.pth [2023-03-11 23:25:26,012][106434] Updated weights for policy 0, policy_version 9360 (0.0005) [2023-03-11 23:25:29,740][106434] Updated weights for policy 0, policy_version 9440 (0.0005) [2023-03-11 23:25:30,661][106151] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 11746.5). Total num frames: 4841472. Throughput: 0: 10890.8. Samples: 4834060. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:25:30,672][106151] Avg episode reward: [(0, '3450.206')] [2023-03-11 23:25:33,393][106434] Updated weights for policy 0, policy_version 9520 (0.0005) [2023-03-11 23:25:35,661][106151] Fps is (10 sec: 11059.3, 60 sec: 10990.9, 300 sec: 11732.6). Total num frames: 4898816. Throughput: 0: 10907.7. Samples: 4867728. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:25:35,672][106151] Avg episode reward: [(0, '3351.317')] [2023-03-11 23:25:36,729][106434] Updated weights for policy 0, policy_version 9600 (0.0005) [2023-03-11 23:25:40,027][106434] Updated weights for policy 0, policy_version 9680 (0.0005) [2023-03-11 23:25:40,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11059.2, 300 sec: 11732.6). Total num frames: 4960256. Throughput: 0: 11096.9. Samples: 4941428. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:25:40,662][106151] Avg episode reward: [(0, '3633.387')] [2023-03-11 23:25:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000009688_4960256.pth... [2023-03-11 23:25:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000009032_4624384.pth [2023-03-11 23:25:43,538][106434] Updated weights for policy 0, policy_version 9760 (0.0005) [2023-03-11 23:25:45,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11195.7, 300 sec: 11718.7). Total num frames: 5021696. Throughput: 0: 11214.1. Samples: 5013008. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:25:45,661][106151] Avg episode reward: [(0, '3354.000')] [2023-03-11 23:25:46,966][106434] Updated weights for policy 0, policy_version 9840 (0.0005) [2023-03-11 23:25:50,181][106434] Updated weights for policy 0, policy_version 9920 (0.0004) [2023-03-11 23:25:50,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11264.0, 300 sec: 11732.6). Total num frames: 5083136. Throughput: 0: 11285.4. Samples: 5048812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:25:50,661][106151] Avg episode reward: [(0, '2860.741')] [2023-03-11 23:25:53,430][106434] Updated weights for policy 0, policy_version 10000 (0.0005) [2023-03-11 23:25:55,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11400.5, 300 sec: 11732.6). Total num frames: 5144576. Throughput: 0: 11538.9. Samples: 5124452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:25:55,662][106151] Avg episode reward: [(0, '3019.928')] [2023-03-11 23:25:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000010048_5144576.pth... [2023-03-11 23:25:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000009352_4788224.pth [2023-03-11 23:25:56,702][106434] Updated weights for policy 0, policy_version 10080 (0.0004) [2023-03-11 23:26:00,041][106434] Updated weights for policy 0, policy_version 10160 (0.0004) [2023-03-11 23:26:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11537.1, 300 sec: 11718.7). Total num frames: 5206016. Throughput: 0: 11769.2. Samples: 5199128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:26:00,661][106151] Avg episode reward: [(0, '2866.902')] [2023-03-11 23:26:03,231][106434] Updated weights for policy 0, policy_version 10240 (0.0004) [2023-03-11 23:26:05,661][106151] Fps is (10 sec: 12697.7, 60 sec: 11673.6, 300 sec: 11732.6). Total num frames: 5271552. Throughput: 0: 11899.4. Samples: 5237744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:26:05,662][106151] Avg episode reward: [(0, '3050.873')] [2023-03-11 23:26:06,483][106434] Updated weights for policy 0, policy_version 10320 (0.0004) [2023-03-11 23:26:09,939][106434] Updated weights for policy 0, policy_version 10400 (0.0005) [2023-03-11 23:26:10,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11741.9, 300 sec: 11718.7). Total num frames: 5328896. Throughput: 0: 12082.7. Samples: 5312576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:26:10,662][106151] Avg episode reward: [(0, '2862.522')] [2023-03-11 23:26:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000010416_5332992.pth... [2023-03-11 23:26:10,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000009688_4960256.pth [2023-03-11 23:26:13,659][106434] Updated weights for policy 0, policy_version 10480 (0.0006) [2023-03-11 23:26:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11704.8). Total num frames: 5386240. Throughput: 0: 12090.2. Samples: 5378120. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 23:26:15,661][106151] Avg episode reward: [(0, '3591.537')] [2023-03-11 23:26:17,462][106434] Updated weights for policy 0, policy_version 10560 (0.0005) [2023-03-11 23:26:20,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11810.1, 300 sec: 11691.0). Total num frames: 5439488. Throughput: 0: 12069.1. Samples: 5410836. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 23:26:20,661][106151] Avg episode reward: [(0, '3702.230')] [2023-03-11 23:26:21,080][106434] Updated weights for policy 0, policy_version 10640 (0.0004) [2023-03-11 23:26:24,498][106434] Updated weights for policy 0, policy_version 10720 (0.0003) [2023-03-11 23:26:25,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11704.8). Total num frames: 5500928. Throughput: 0: 11979.6. Samples: 5480512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:26:25,662][106151] Avg episode reward: [(0, '3827.074')] [2023-03-11 23:26:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000010744_5500928.pth... [2023-03-11 23:26:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000010048_5144576.pth [2023-03-11 23:26:27,739][106434] Updated weights for policy 0, policy_version 10800 (0.0004) [2023-03-11 23:26:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11718.7). Total num frames: 5562368. Throughput: 0: 12048.0. Samples: 5555168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:26:30,661][106151] Avg episode reward: [(0, '3950.275')] [2023-03-11 23:26:31,211][106434] Updated weights for policy 0, policy_version 10880 (0.0004) [2023-03-11 23:26:34,901][106434] Updated weights for policy 0, policy_version 10960 (0.0005) [2023-03-11 23:26:35,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11704.8). Total num frames: 5619712. Throughput: 0: 11996.2. Samples: 5588644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:26:35,661][106151] Avg episode reward: [(0, '3996.367')] [2023-03-11 23:26:38,519][106434] Updated weights for policy 0, policy_version 11040 (0.0005) [2023-03-11 23:26:40,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11878.4, 300 sec: 11677.1). Total num frames: 5672960. Throughput: 0: 11824.5. Samples: 5656556. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:26:40,662][106151] Avg episode reward: [(0, '4338.534')] [2023-03-11 23:26:40,703][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000011088_5677056.pth... [2023-03-11 23:26:40,705][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000010416_5332992.pth [2023-03-11 23:26:40,705][106390] Saving new best policy, reward=4338.534! [2023-03-11 23:26:42,135][106434] Updated weights for policy 0, policy_version 11120 (0.0005) [2023-03-11 23:26:45,661][106151] Fps is (10 sec: 11059.3, 60 sec: 11810.1, 300 sec: 11663.2). Total num frames: 5730304. Throughput: 0: 11683.2. Samples: 5724872. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:26:45,661][106151] Avg episode reward: [(0, '4405.708')] [2023-03-11 23:26:45,678][106390] Saving new best policy, reward=4405.708! [2023-03-11 23:26:45,680][106434] Updated weights for policy 0, policy_version 11200 (0.0005) [2023-03-11 23:26:49,303][106434] Updated weights for policy 0, policy_version 11280 (0.0005) [2023-03-11 23:26:50,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 11663.2). Total num frames: 5787648. Throughput: 0: 11582.9. Samples: 5758976. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 23:26:50,661][106151] Avg episode reward: [(0, '3680.442')] [2023-03-11 23:26:52,961][106434] Updated weights for policy 0, policy_version 11360 (0.0005) [2023-03-11 23:26:55,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 11635.4). Total num frames: 5844992. Throughput: 0: 11438.8. Samples: 5827320. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 23:26:55,661][106151] Avg episode reward: [(0, '4086.791')] [2023-03-11 23:26:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000011416_5844992.pth... [2023-03-11 23:26:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000010744_5500928.pth [2023-03-11 23:26:56,527][106434] Updated weights for policy 0, policy_version 11440 (0.0005) [2023-03-11 23:27:00,154][106434] Updated weights for policy 0, policy_version 11520 (0.0005) [2023-03-11 23:27:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11621.5). Total num frames: 5902336. Throughput: 0: 11468.6. Samples: 5894208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:27:00,661][106151] Avg episode reward: [(0, '4033.449')] [2023-03-11 23:27:03,687][106434] Updated weights for policy 0, policy_version 11600 (0.0005) [2023-03-11 23:27:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11607.6). Total num frames: 5959680. Throughput: 0: 11511.5. Samples: 5928852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:27:05,661][106151] Avg episode reward: [(0, '4037.974')] [2023-03-11 23:27:07,224][106434] Updated weights for policy 0, policy_version 11680 (0.0005) [2023-03-11 23:27:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11607.6). Total num frames: 6017024. Throughput: 0: 11524.1. Samples: 5999096. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:27:10,661][106151] Avg episode reward: [(0, '3944.389')] [2023-03-11 23:27:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000011752_6017024.pth... [2023-03-11 23:27:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000011088_5677056.pth [2023-03-11 23:27:10,844][106434] Updated weights for policy 0, policy_version 11760 (0.0005) [2023-03-11 23:27:14,462][106434] Updated weights for policy 0, policy_version 11840 (0.0005) [2023-03-11 23:27:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11607.6). Total num frames: 6074368. Throughput: 0: 11357.3. Samples: 6066248. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:27:15,661][106151] Avg episode reward: [(0, '3694.428')] [2023-03-11 23:27:18,014][106434] Updated weights for policy 0, policy_version 11920 (0.0005) [2023-03-11 23:27:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11593.8). Total num frames: 6131712. Throughput: 0: 11385.2. Samples: 6100976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:27:20,661][106151] Avg episode reward: [(0, '3917.630')] [2023-03-11 23:27:21,533][106434] Updated weights for policy 0, policy_version 12000 (0.0005) [2023-03-11 23:27:25,039][106434] Updated weights for policy 0, policy_version 12080 (0.0005) [2023-03-11 23:27:25,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11566.0). Total num frames: 6189056. Throughput: 0: 11448.5. Samples: 6171740. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:27:25,662][106151] Avg episode reward: [(0, '4117.961')] [2023-03-11 23:27:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000012088_6189056.pth... [2023-03-11 23:27:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000011416_5844992.pth [2023-03-11 23:27:28,448][106434] Updated weights for policy 0, policy_version 12160 (0.0005) [2023-03-11 23:27:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 11579.9). Total num frames: 6250496. Throughput: 0: 11485.1. Samples: 6241704. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:27:30,661][106151] Avg episode reward: [(0, '3647.529')] [2023-03-11 23:27:32,061][106434] Updated weights for policy 0, policy_version 12240 (0.0005) [2023-03-11 23:27:35,580][106434] Updated weights for policy 0, policy_version 12320 (0.0005) [2023-03-11 23:27:35,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11468.8, 300 sec: 11579.9). Total num frames: 6307840. Throughput: 0: 11481.9. Samples: 6275660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:27:35,661][106151] Avg episode reward: [(0, '3478.113')] [2023-03-11 23:27:39,076][106434] Updated weights for policy 0, policy_version 12400 (0.0005) [2023-03-11 23:27:40,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11566.0). Total num frames: 6365184. Throughput: 0: 11525.8. Samples: 6345980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:27:40,661][106151] Avg episode reward: [(0, '4084.273')] [2023-03-11 23:27:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000012432_6365184.pth... [2023-03-11 23:27:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000011752_6017024.pth [2023-03-11 23:27:42,612][106434] Updated weights for policy 0, policy_version 12480 (0.0005) [2023-03-11 23:27:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11566.0). Total num frames: 6422528. Throughput: 0: 11577.4. Samples: 6415192. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:27:45,672][106151] Avg episode reward: [(0, '3782.257')] [2023-03-11 23:27:46,078][106434] Updated weights for policy 0, policy_version 12560 (0.0005) [2023-03-11 23:27:49,604][106434] Updated weights for policy 0, policy_version 12640 (0.0005) [2023-03-11 23:27:50,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11566.0). Total num frames: 6483968. Throughput: 0: 11609.3. Samples: 6451272. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:27:50,672][106151] Avg episode reward: [(0, '3752.255')] [2023-03-11 23:27:53,097][106434] Updated weights for policy 0, policy_version 12720 (0.0005) [2023-03-11 23:27:55,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11566.0). Total num frames: 6541312. Throughput: 0: 11595.6. Samples: 6520896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:27:55,661][106151] Avg episode reward: [(0, '3955.485')] [2023-03-11 23:27:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000012776_6541312.pth... [2023-03-11 23:27:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000012088_6189056.pth [2023-03-11 23:27:56,711][106434] Updated weights for policy 0, policy_version 12800 (0.0005) [2023-03-11 23:28:00,243][106434] Updated weights for policy 0, policy_version 12880 (0.0005) [2023-03-11 23:28:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11552.1). Total num frames: 6598656. Throughput: 0: 11649.1. Samples: 6590456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:28:00,672][106151] Avg episode reward: [(0, '3439.081')] [2023-03-11 23:28:03,765][106434] Updated weights for policy 0, policy_version 12960 (0.0005) [2023-03-11 23:28:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11538.2). Total num frames: 6656000. Throughput: 0: 11623.4. Samples: 6624028. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:28:05,661][106151] Avg episode reward: [(0, '3728.391')] [2023-03-11 23:28:07,310][106434] Updated weights for policy 0, policy_version 13040 (0.0005) [2023-03-11 23:28:10,641][106434] Updated weights for policy 0, policy_version 13120 (0.0004) [2023-03-11 23:28:10,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11552.1). Total num frames: 6717440. Throughput: 0: 11606.5. Samples: 6694032. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:28:10,662][106151] Avg episode reward: [(0, '3334.502')] [2023-03-11 23:28:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000013120_6717440.pth... [2023-03-11 23:28:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000012432_6365184.pth [2023-03-11 23:28:14,067][106434] Updated weights for policy 0, policy_version 13200 (0.0004) [2023-03-11 23:28:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11552.1). Total num frames: 6774784. Throughput: 0: 11681.2. Samples: 6767356. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:28:15,672][106151] Avg episode reward: [(0, '3748.754')] [2023-03-11 23:28:17,512][106434] Updated weights for policy 0, policy_version 13280 (0.0005) [2023-03-11 23:28:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 11552.1). Total num frames: 6832128. Throughput: 0: 11728.8. Samples: 6803456. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:28:20,672][106151] Avg episode reward: [(0, '4112.716')] [2023-03-11 23:28:21,107][106434] Updated weights for policy 0, policy_version 13360 (0.0005) [2023-03-11 23:28:24,658][106434] Updated weights for policy 0, policy_version 13440 (0.0005) [2023-03-11 23:28:25,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11552.1). Total num frames: 6889472. Throughput: 0: 11685.8. Samples: 6871840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:28:25,661][106151] Avg episode reward: [(0, '3923.054')] [2023-03-11 23:28:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000013456_6889472.pth... [2023-03-11 23:28:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000012776_6541312.pth [2023-03-11 23:28:28,315][106434] Updated weights for policy 0, policy_version 13520 (0.0005) [2023-03-11 23:28:30,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11566.0). Total num frames: 6950912. Throughput: 0: 11670.0. Samples: 6940344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:28:30,662][106151] Avg episode reward: [(0, '3773.568')] [2023-03-11 23:28:31,604][106434] Updated weights for policy 0, policy_version 13600 (0.0004) [2023-03-11 23:28:35,142][106434] Updated weights for policy 0, policy_version 13680 (0.0005) [2023-03-11 23:28:35,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11566.0). Total num frames: 7008256. Throughput: 0: 11715.7. Samples: 6978480. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:28:35,661][106151] Avg episode reward: [(0, '4228.467')] [2023-03-11 23:28:38,512][106434] Updated weights for policy 0, policy_version 13760 (0.0003) [2023-03-11 23:28:40,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11579.9). Total num frames: 7069696. Throughput: 0: 11740.0. Samples: 7049196. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:28:40,661][106151] Avg episode reward: [(0, '4079.585')] [2023-03-11 23:28:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000013808_7069696.pth... [2023-03-11 23:28:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000013120_6717440.pth [2023-03-11 23:28:42,012][106434] Updated weights for policy 0, policy_version 13840 (0.0004) [2023-03-11 23:28:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11552.1). Total num frames: 7122944. Throughput: 0: 11695.2. Samples: 7116740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:28:45,661][106151] Avg episode reward: [(0, '2906.553')] [2023-03-11 23:28:45,793][106434] Updated weights for policy 0, policy_version 13920 (0.0006) [2023-03-11 23:28:49,549][106434] Updated weights for policy 0, policy_version 14000 (0.0005) [2023-03-11 23:28:50,661][106151] Fps is (10 sec: 11059.1, 60 sec: 11605.3, 300 sec: 11552.1). Total num frames: 7180288. Throughput: 0: 11677.6. Samples: 7149520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:28:50,662][106151] Avg episode reward: [(0, '3607.998')] [2023-03-11 23:28:53,244][106434] Updated weights for policy 0, policy_version 14080 (0.0006) [2023-03-11 23:28:55,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11524.3). Total num frames: 7233536. Throughput: 0: 11583.0. Samples: 7215264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:28:55,661][106151] Avg episode reward: [(0, '4261.759')] [2023-03-11 23:28:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000014128_7233536.pth... [2023-03-11 23:28:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000013456_6889472.pth [2023-03-11 23:28:56,975][106434] Updated weights for policy 0, policy_version 14160 (0.0005) [2023-03-11 23:29:00,661][106151] Fps is (10 sec: 10649.7, 60 sec: 11468.8, 300 sec: 11496.6). Total num frames: 7286784. Throughput: 0: 11439.7. Samples: 7282144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:29:00,672][106151] Avg episode reward: [(0, '4087.334')] [2023-03-11 23:29:00,673][106434] Updated weights for policy 0, policy_version 14240 (0.0005) [2023-03-11 23:29:04,119][106434] Updated weights for policy 0, policy_version 14320 (0.0005) [2023-03-11 23:29:05,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11510.5). Total num frames: 7348224. Throughput: 0: 11391.3. Samples: 7316064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:29:05,672][106151] Avg episode reward: [(0, '4148.771')] [2023-03-11 23:29:07,552][106434] Updated weights for policy 0, policy_version 14400 (0.0005) [2023-03-11 23:29:10,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11537.1, 300 sec: 11538.2). Total num frames: 7409664. Throughput: 0: 11476.9. Samples: 7388300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:29:10,661][106151] Avg episode reward: [(0, '4056.956')] [2023-03-11 23:29:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000014472_7409664.pth... [2023-03-11 23:29:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000013808_7069696.pth [2023-03-11 23:29:10,933][106434] Updated weights for policy 0, policy_version 14480 (0.0004) [2023-03-11 23:29:14,570][106434] Updated weights for policy 0, policy_version 14560 (0.0005) [2023-03-11 23:29:15,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11537.1, 300 sec: 11538.2). Total num frames: 7467008. Throughput: 0: 11503.4. Samples: 7457996. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 23:29:15,672][106151] Avg episode reward: [(0, '3606.094')] [2023-03-11 23:29:18,196][106434] Updated weights for policy 0, policy_version 14640 (0.0005) [2023-03-11 23:29:20,661][106151] Fps is (10 sec: 11059.3, 60 sec: 11468.8, 300 sec: 11524.3). Total num frames: 7520256. Throughput: 0: 11403.7. Samples: 7491648. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 23:29:20,672][106151] Avg episode reward: [(0, '4142.797')] [2023-03-11 23:29:21,857][106434] Updated weights for policy 0, policy_version 14720 (0.0005) [2023-03-11 23:29:25,507][106434] Updated weights for policy 0, policy_version 14800 (0.0005) [2023-03-11 23:29:25,661][106151] Fps is (10 sec: 11059.0, 60 sec: 11468.8, 300 sec: 11510.5). Total num frames: 7577600. Throughput: 0: 11314.9. Samples: 7558368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:29:25,662][106151] Avg episode reward: [(0, '4270.640')] [2023-03-11 23:29:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000014800_7577600.pth... [2023-03-11 23:29:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000014128_7233536.pth [2023-03-11 23:29:28,947][106434] Updated weights for policy 0, policy_version 14880 (0.0005) [2023-03-11 23:29:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 11524.3). Total num frames: 7639040. Throughput: 0: 11384.8. Samples: 7629056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:29:30,661][106151] Avg episode reward: [(0, '3438.399')] [2023-03-11 23:29:32,285][106434] Updated weights for policy 0, policy_version 14960 (0.0004) [2023-03-11 23:29:35,585][106434] Updated weights for policy 0, policy_version 15040 (0.0005) [2023-03-11 23:29:35,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11537.1, 300 sec: 11538.2). Total num frames: 7700480. Throughput: 0: 11479.8. Samples: 7666112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:29:35,672][106151] Avg episode reward: [(0, '3633.705')] [2023-03-11 23:29:39,333][106434] Updated weights for policy 0, policy_version 15120 (0.0005) [2023-03-11 23:29:40,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11538.2). Total num frames: 7753728. Throughput: 0: 11585.1. Samples: 7736596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:29:40,662][106151] Avg episode reward: [(0, '3767.542')] [2023-03-11 23:29:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000015144_7753728.pth... [2023-03-11 23:29:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000014472_7409664.pth [2023-03-11 23:29:43,044][106434] Updated weights for policy 0, policy_version 15200 (0.0005) [2023-03-11 23:29:45,661][106151] Fps is (10 sec: 11059.3, 60 sec: 11468.8, 300 sec: 11538.2). Total num frames: 7811072. Throughput: 0: 11569.5. Samples: 7802772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:29:45,672][106151] Avg episode reward: [(0, '4188.685')] [2023-03-11 23:29:46,705][106434] Updated weights for policy 0, policy_version 15280 (0.0005) [2023-03-11 23:29:50,274][106434] Updated weights for policy 0, policy_version 15360 (0.0005) [2023-03-11 23:29:50,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11552.1). Total num frames: 7868416. Throughput: 0: 11564.1. Samples: 7836448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:29:50,672][106151] Avg episode reward: [(0, '3449.277')] [2023-03-11 23:29:53,605][106434] Updated weights for policy 0, policy_version 15440 (0.0005) [2023-03-11 23:29:55,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 11579.9). Total num frames: 7929856. Throughput: 0: 11549.3. Samples: 7908020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:29:55,661][106151] Avg episode reward: [(0, '3370.131')] [2023-03-11 23:29:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000015488_7929856.pth... [2023-03-11 23:29:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000014800_7577600.pth [2023-03-11 23:29:56,919][106434] Updated weights for policy 0, policy_version 15520 (0.0005) [2023-03-11 23:30:00,139][106434] Updated weights for policy 0, policy_version 15600 (0.0005) [2023-03-11 23:30:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11593.8). Total num frames: 7991296. Throughput: 0: 11670.5. Samples: 7983168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:30:00,661][106151] Avg episode reward: [(0, '2930.257')] [2023-03-11 23:30:03,465][106434] Updated weights for policy 0, policy_version 15680 (0.0005) [2023-03-11 23:30:05,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11741.9, 300 sec: 11621.5). Total num frames: 8052736. Throughput: 0: 11742.1. Samples: 8020040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:30:05,661][106151] Avg episode reward: [(0, '2717.619')] [2023-03-11 23:30:06,752][106434] Updated weights for policy 0, policy_version 15760 (0.0004) [2023-03-11 23:30:10,082][106434] Updated weights for policy 0, policy_version 15840 (0.0004) [2023-03-11 23:30:10,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11649.3). Total num frames: 8114176. Throughput: 0: 11915.6. Samples: 8094568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:30:10,661][106151] Avg episode reward: [(0, '3608.915')] [2023-03-11 23:30:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000015848_8114176.pth... [2023-03-11 23:30:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000015144_7753728.pth [2023-03-11 23:30:13,630][106434] Updated weights for policy 0, policy_version 15920 (0.0005) [2023-03-11 23:30:15,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11741.8, 300 sec: 11663.2). Total num frames: 8171520. Throughput: 0: 11905.2. Samples: 8164788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:30:15,661][106151] Avg episode reward: [(0, '3848.524')] [2023-03-11 23:30:17,143][106434] Updated weights for policy 0, policy_version 16000 (0.0005) [2023-03-11 23:30:20,613][106434] Updated weights for policy 0, policy_version 16080 (0.0005) [2023-03-11 23:30:20,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11677.1). Total num frames: 8232960. Throughput: 0: 11868.6. Samples: 8200200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:30:20,661][106151] Avg episode reward: [(0, '2150.223')] [2023-03-11 23:30:23,890][106434] Updated weights for policy 0, policy_version 16160 (0.0004) [2023-03-11 23:30:25,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 11704.8). Total num frames: 8294400. Throughput: 0: 11928.3. Samples: 8273368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:30:25,662][106151] Avg episode reward: [(0, '3756.022')] [2023-03-11 23:30:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000016200_8294400.pth... [2023-03-11 23:30:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000015488_7929856.pth [2023-03-11 23:30:27,133][106434] Updated weights for policy 0, policy_version 16240 (0.0004) [2023-03-11 23:30:30,477][106434] Updated weights for policy 0, policy_version 16320 (0.0004) [2023-03-11 23:30:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11718.7). Total num frames: 8355840. Throughput: 0: 12109.8. Samples: 8347712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:30:30,666][106151] Avg episode reward: [(0, '3946.640')] [2023-03-11 23:30:33,786][106434] Updated weights for policy 0, policy_version 16400 (0.0004) [2023-03-11 23:30:35,661][106151] Fps is (10 sec: 12288.2, 60 sec: 11946.7, 300 sec: 11718.7). Total num frames: 8417280. Throughput: 0: 12180.6. Samples: 8384576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:30:35,672][106151] Avg episode reward: [(0, '4164.199')] [2023-03-11 23:30:37,057][106434] Updated weights for policy 0, policy_version 16480 (0.0003) [2023-03-11 23:30:40,338][106434] Updated weights for policy 0, policy_version 16560 (0.0004) [2023-03-11 23:30:40,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12151.5, 300 sec: 11732.6). Total num frames: 8482816. Throughput: 0: 12256.7. Samples: 8459572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:30:40,662][106151] Avg episode reward: [(0, '4320.364')] [2023-03-11 23:30:40,666][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000016568_8482816.pth... [2023-03-11 23:30:40,669][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000015848_8114176.pth [2023-03-11 23:30:43,649][106434] Updated weights for policy 0, policy_version 16640 (0.0004) [2023-03-11 23:30:45,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12219.7, 300 sec: 11732.6). Total num frames: 8544256. Throughput: 0: 12248.7. Samples: 8534360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:30:45,661][106151] Avg episode reward: [(0, '4317.913')] [2023-03-11 23:30:46,949][106434] Updated weights for policy 0, policy_version 16720 (0.0004) [2023-03-11 23:30:50,133][106434] Updated weights for policy 0, policy_version 16800 (0.0003) [2023-03-11 23:30:50,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 11732.6). Total num frames: 8605696. Throughput: 0: 12267.5. Samples: 8572076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:30:50,661][106151] Avg episode reward: [(0, '4322.846')] [2023-03-11 23:30:53,362][106434] Updated weights for policy 0, policy_version 16880 (0.0004) [2023-03-11 23:30:55,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 11732.6). Total num frames: 8667136. Throughput: 0: 12295.8. Samples: 8647880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:30:55,662][106151] Avg episode reward: [(0, '4334.926')] [2023-03-11 23:30:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000016936_8671232.pth... [2023-03-11 23:30:55,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000016200_8294400.pth [2023-03-11 23:30:56,647][106434] Updated weights for policy 0, policy_version 16960 (0.0004) [2023-03-11 23:30:59,925][106434] Updated weights for policy 0, policy_version 17040 (0.0004) [2023-03-11 23:31:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 11718.7). Total num frames: 8728576. Throughput: 0: 12424.7. Samples: 8723900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:31:00,661][106151] Avg episode reward: [(0, '4283.700')] [2023-03-11 23:31:03,564][106434] Updated weights for policy 0, policy_version 17120 (0.0005) [2023-03-11 23:31:05,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12219.7, 300 sec: 11718.7). Total num frames: 8785920. Throughput: 0: 12380.3. Samples: 8757312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:31:05,661][106151] Avg episode reward: [(0, '4371.078')] [2023-03-11 23:31:07,210][106434] Updated weights for policy 0, policy_version 17200 (0.0005) [2023-03-11 23:31:10,661][106151] Fps is (10 sec: 11468.7, 60 sec: 12151.5, 300 sec: 11718.7). Total num frames: 8843264. Throughput: 0: 12279.2. Samples: 8825932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:31:10,661][106151] Avg episode reward: [(0, '4433.795')] [2023-03-11 23:31:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000017272_8843264.pth... [2023-03-11 23:31:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000016568_8482816.pth [2023-03-11 23:31:10,668][106390] Saving new best policy, reward=4433.795! [2023-03-11 23:31:10,738][106434] Updated weights for policy 0, policy_version 17280 (0.0005) [2023-03-11 23:31:14,307][106434] Updated weights for policy 0, policy_version 17360 (0.0005) [2023-03-11 23:31:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 11732.6). Total num frames: 8900608. Throughput: 0: 12146.1. Samples: 8894288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:31:15,661][106151] Avg episode reward: [(0, '3885.858')] [2023-03-11 23:31:17,896][106434] Updated weights for policy 0, policy_version 17440 (0.0005) [2023-03-11 23:31:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 12083.2, 300 sec: 11718.7). Total num frames: 8957952. Throughput: 0: 12101.7. Samples: 8929152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:31:20,661][106151] Avg episode reward: [(0, '3421.628')] [2023-03-11 23:31:21,355][106434] Updated weights for policy 0, policy_version 17520 (0.0005) [2023-03-11 23:31:24,940][106434] Updated weights for policy 0, policy_version 17600 (0.0005) [2023-03-11 23:31:25,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11718.7). Total num frames: 9019392. Throughput: 0: 11985.3. Samples: 8998912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:31:25,661][106151] Avg episode reward: [(0, '3608.726')] [2023-03-11 23:31:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000017616_9019392.pth... [2023-03-11 23:31:25,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000016936_8671232.pth [2023-03-11 23:31:28,508][106434] Updated weights for policy 0, policy_version 17680 (0.0005) [2023-03-11 23:31:30,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11946.7, 300 sec: 11704.8). Total num frames: 9072640. Throughput: 0: 11852.7. Samples: 9067732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:31:30,662][106151] Avg episode reward: [(0, '3791.988')] [2023-03-11 23:31:32,112][106434] Updated weights for policy 0, policy_version 17760 (0.0005) [2023-03-11 23:31:35,560][106434] Updated weights for policy 0, policy_version 17840 (0.0005) [2023-03-11 23:31:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11732.6). Total num frames: 9134080. Throughput: 0: 11762.4. Samples: 9101384. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:31:35,662][106151] Avg episode reward: [(0, '1204.327')] [2023-03-11 23:31:39,105][106434] Updated weights for policy 0, policy_version 17920 (0.0004) [2023-03-11 23:31:40,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11732.6). Total num frames: 9191424. Throughput: 0: 11633.2. Samples: 9171372. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:31:40,662][106151] Avg episode reward: [(0, '3454.163')] [2023-03-11 23:31:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000017952_9191424.pth... [2023-03-11 23:31:40,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000017272_8843264.pth [2023-03-11 23:31:42,612][106434] Updated weights for policy 0, policy_version 18000 (0.0005) [2023-03-11 23:31:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11732.6). Total num frames: 9248768. Throughput: 0: 11498.5. Samples: 9241332. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:31:45,661][106151] Avg episode reward: [(0, '3730.813')] [2023-03-11 23:31:46,149][106434] Updated weights for policy 0, policy_version 18080 (0.0005) [2023-03-11 23:31:49,774][106434] Updated weights for policy 0, policy_version 18160 (0.0005) [2023-03-11 23:31:50,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 11732.6). Total num frames: 9306112. Throughput: 0: 11537.0. Samples: 9276476. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 23:31:50,661][106151] Avg episode reward: [(0, '3753.920')] [2023-03-11 23:31:53,404][106434] Updated weights for policy 0, policy_version 18240 (0.0005) [2023-03-11 23:31:55,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11732.6). Total num frames: 9363456. Throughput: 0: 11505.7. Samples: 9343688. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 23:31:55,661][106151] Avg episode reward: [(0, '3193.327')] [2023-03-11 23:31:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000018288_9363456.pth... [2023-03-11 23:31:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000017616_9019392.pth [2023-03-11 23:31:56,939][106434] Updated weights for policy 0, policy_version 18320 (0.0005) [2023-03-11 23:32:00,174][106434] Updated weights for policy 0, policy_version 18400 (0.0004) [2023-03-11 23:32:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 9424896. Throughput: 0: 11608.8. Samples: 9416684. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:32:00,661][106151] Avg episode reward: [(0, '3842.126')] [2023-03-11 23:32:03,708][106434] Updated weights for policy 0, policy_version 18480 (0.0004) [2023-03-11 23:32:05,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 9482240. Throughput: 0: 11609.4. Samples: 9451576. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:32:05,661][106151] Avg episode reward: [(0, '3624.386')] [2023-03-11 23:32:07,296][106434] Updated weights for policy 0, policy_version 18560 (0.0004) [2023-03-11 23:32:10,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 9539584. Throughput: 0: 11593.5. Samples: 9520620. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:32:10,662][106151] Avg episode reward: [(0, '4217.162')] [2023-03-11 23:32:10,666][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000018632_9539584.pth... [2023-03-11 23:32:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000017952_9191424.pth [2023-03-11 23:32:10,849][106434] Updated weights for policy 0, policy_version 18640 (0.0004) [2023-03-11 23:32:14,337][106434] Updated weights for policy 0, policy_version 18720 (0.0005) [2023-03-11 23:32:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 9596928. Throughput: 0: 11607.5. Samples: 9590068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:32:15,661][106151] Avg episode reward: [(0, '4108.674')] [2023-03-11 23:32:17,937][106434] Updated weights for policy 0, policy_version 18800 (0.0005) [2023-03-11 23:32:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 9654272. Throughput: 0: 11626.5. Samples: 9624576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:32:20,661][106151] Avg episode reward: [(0, '3760.392')] [2023-03-11 23:32:21,511][106434] Updated weights for policy 0, policy_version 18880 (0.0005) [2023-03-11 23:32:25,101][106434] Updated weights for policy 0, policy_version 18960 (0.0005) [2023-03-11 23:32:25,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 9711616. Throughput: 0: 11598.0. Samples: 9693280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:32:25,661][106151] Avg episode reward: [(0, '3255.748')] [2023-03-11 23:32:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000018968_9711616.pth... [2023-03-11 23:32:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000018288_9363456.pth [2023-03-11 23:32:28,430][106434] Updated weights for policy 0, policy_version 19040 (0.0005) [2023-03-11 23:32:30,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 11746.5). Total num frames: 9773056. Throughput: 0: 11636.3. Samples: 9764964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:32:30,661][106151] Avg episode reward: [(0, '2367.498')] [2023-03-11 23:32:31,787][106434] Updated weights for policy 0, policy_version 19120 (0.0005) [2023-03-11 23:32:35,171][106434] Updated weights for policy 0, policy_version 19200 (0.0005) [2023-03-11 23:32:35,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11673.6, 300 sec: 11760.4). Total num frames: 9834496. Throughput: 0: 11673.7. Samples: 9801792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:32:35,661][106151] Avg episode reward: [(0, '3366.351')] [2023-03-11 23:32:38,434][106434] Updated weights for policy 0, policy_version 19280 (0.0004) [2023-03-11 23:32:40,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11741.9, 300 sec: 11774.3). Total num frames: 9895936. Throughput: 0: 11821.4. Samples: 9875652. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 23:32:40,662][106151] Avg episode reward: [(0, '3636.801')] [2023-03-11 23:32:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000019328_9895936.pth... [2023-03-11 23:32:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000018632_9539584.pth [2023-03-11 23:32:41,734][106434] Updated weights for policy 0, policy_version 19360 (0.0004) [2023-03-11 23:32:45,018][106434] Updated weights for policy 0, policy_version 19440 (0.0003) [2023-03-11 23:32:45,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11810.1, 300 sec: 11774.3). Total num frames: 9957376. Throughput: 0: 11864.6. Samples: 9950592. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 23:32:45,661][106151] Avg episode reward: [(0, '3695.612')] [2023-03-11 23:32:48,392][106434] Updated weights for policy 0, policy_version 19520 (0.0004) [2023-03-11 23:32:50,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11878.4, 300 sec: 11788.1). Total num frames: 10018816. Throughput: 0: 11904.1. Samples: 9987260. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 23:32:50,661][106151] Avg episode reward: [(0, '4378.467')] [2023-03-11 23:32:51,851][106434] Updated weights for policy 0, policy_version 19600 (0.0005) [2023-03-11 23:32:55,412][106434] Updated weights for policy 0, policy_version 19680 (0.0005) [2023-03-11 23:32:55,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 11788.1). Total num frames: 10076160. Throughput: 0: 11950.4. Samples: 10058388. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:32:55,661][106151] Avg episode reward: [(0, '4286.246')] [2023-03-11 23:32:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000019680_10076160.pth... [2023-03-11 23:32:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000018968_9711616.pth [2023-03-11 23:32:59,064][106434] Updated weights for policy 0, policy_version 19760 (0.0005) [2023-03-11 23:33:00,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 11788.2). Total num frames: 10133504. Throughput: 0: 11898.4. Samples: 10125496. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:33:00,661][106151] Avg episode reward: [(0, '4391.522')] [2023-03-11 23:33:02,544][106434] Updated weights for policy 0, policy_version 19840 (0.0005) [2023-03-11 23:33:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11774.3). Total num frames: 10190848. Throughput: 0: 11938.1. Samples: 10161792. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:33:05,661][106151] Avg episode reward: [(0, '3962.679')] [2023-03-11 23:33:06,128][106434] Updated weights for policy 0, policy_version 19920 (0.0005) [2023-03-11 23:33:09,667][106434] Updated weights for policy 0, policy_version 20000 (0.0005) [2023-03-11 23:33:10,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 11774.3). Total num frames: 10248192. Throughput: 0: 11937.4. Samples: 10230464. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:33:10,661][106151] Avg episode reward: [(0, '3625.736')] [2023-03-11 23:33:10,729][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000020024_10252288.pth... [2023-03-11 23:33:10,730][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000019328_9895936.pth [2023-03-11 23:33:13,173][106434] Updated weights for policy 0, policy_version 20080 (0.0005) [2023-03-11 23:33:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11774.3). Total num frames: 10305536. Throughput: 0: 11872.1. Samples: 10299208. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:33:15,661][106151] Avg episode reward: [(0, '3538.086')] [2023-03-11 23:33:16,831][106434] Updated weights for policy 0, policy_version 20160 (0.0005) [2023-03-11 23:33:20,320][106434] Updated weights for policy 0, policy_version 20240 (0.0005) [2023-03-11 23:33:20,661][106151] Fps is (10 sec: 11878.6, 60 sec: 11878.4, 300 sec: 11788.2). Total num frames: 10366976. Throughput: 0: 11823.3. Samples: 10333840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:33:20,661][106151] Avg episode reward: [(0, '4153.925')] [2023-03-11 23:33:23,819][106434] Updated weights for policy 0, policy_version 20320 (0.0005) [2023-03-11 23:33:25,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 11774.3). Total num frames: 10424320. Throughput: 0: 11738.9. Samples: 10403904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:33:25,662][106151] Avg episode reward: [(0, '4402.265')] [2023-03-11 23:33:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000020360_10424320.pth... [2023-03-11 23:33:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000019680_10076160.pth [2023-03-11 23:33:27,391][106434] Updated weights for policy 0, policy_version 20400 (0.0004) [2023-03-11 23:33:30,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 11774.3). Total num frames: 10481664. Throughput: 0: 11621.0. Samples: 10473536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:33:30,662][106151] Avg episode reward: [(0, '4293.959')] [2023-03-11 23:33:30,880][106434] Updated weights for policy 0, policy_version 20480 (0.0005) [2023-03-11 23:33:34,423][106434] Updated weights for policy 0, policy_version 20560 (0.0005) [2023-03-11 23:33:35,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 11760.4). Total num frames: 10539008. Throughput: 0: 11574.4. Samples: 10508108. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:33:35,662][106151] Avg episode reward: [(0, '4389.511')] [2023-03-11 23:33:37,950][106434] Updated weights for policy 0, policy_version 20640 (0.0005) [2023-03-11 23:33:40,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11774.3). Total num frames: 10596352. Throughput: 0: 11540.5. Samples: 10577712. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:33:40,662][106151] Avg episode reward: [(0, '4447.859')] [2023-03-11 23:33:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000020696_10596352.pth... [2023-03-11 23:33:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000020024_10252288.pth [2023-03-11 23:33:40,668][106390] Saving new best policy, reward=4447.859! [2023-03-11 23:33:41,549][106434] Updated weights for policy 0, policy_version 20720 (0.0005) [2023-03-11 23:33:45,161][106434] Updated weights for policy 0, policy_version 20800 (0.0005) [2023-03-11 23:33:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11774.3). Total num frames: 10653696. Throughput: 0: 11557.3. Samples: 10645576. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:33:45,662][106151] Avg episode reward: [(0, '4047.846')] [2023-03-11 23:33:48,716][106434] Updated weights for policy 0, policy_version 20880 (0.0004) [2023-03-11 23:33:50,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11788.1). Total num frames: 10711040. Throughput: 0: 11522.8. Samples: 10680320. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:33:50,662][106151] Avg episode reward: [(0, '4415.655')] [2023-03-11 23:33:52,263][106434] Updated weights for policy 0, policy_version 20960 (0.0005) [2023-03-11 23:33:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11802.0). Total num frames: 10768384. Throughput: 0: 11550.2. Samples: 10750224. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:33:55,662][106151] Avg episode reward: [(0, '4214.496')] [2023-03-11 23:33:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000021032_10768384.pth... [2023-03-11 23:33:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000020360_10424320.pth [2023-03-11 23:33:55,789][106434] Updated weights for policy 0, policy_version 21040 (0.0005) [2023-03-11 23:33:59,361][106434] Updated weights for policy 0, policy_version 21120 (0.0005) [2023-03-11 23:34:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11788.1). Total num frames: 10825728. Throughput: 0: 11548.9. Samples: 10818908. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:34:00,661][106151] Avg episode reward: [(0, '4198.127')] [2023-03-11 23:34:02,888][106434] Updated weights for policy 0, policy_version 21200 (0.0005) [2023-03-11 23:34:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11774.3). Total num frames: 10883072. Throughput: 0: 11568.0. Samples: 10854400. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:34:05,661][106151] Avg episode reward: [(0, '4266.528')] [2023-03-11 23:34:06,496][106434] Updated weights for policy 0, policy_version 21280 (0.0005) [2023-03-11 23:34:10,007][106434] Updated weights for policy 0, policy_version 21360 (0.0005) [2023-03-11 23:34:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11774.3). Total num frames: 10940416. Throughput: 0: 11547.8. Samples: 10923556. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:34:10,662][106151] Avg episode reward: [(0, '4485.296')] [2023-03-11 23:34:10,725][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000021376_10944512.pth... [2023-03-11 23:34:10,727][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000020696_10596352.pth [2023-03-11 23:34:10,727][106390] Saving new best policy, reward=4485.296! [2023-03-11 23:34:13,527][106434] Updated weights for policy 0, policy_version 21440 (0.0005) [2023-03-11 23:34:15,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11788.1). Total num frames: 10997760. Throughput: 0: 11535.7. Samples: 10992644. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:34:15,661][106151] Avg episode reward: [(0, '4362.602')] [2023-03-11 23:34:17,022][106434] Updated weights for policy 0, policy_version 21520 (0.0004) [2023-03-11 23:34:20,311][106434] Updated weights for policy 0, policy_version 21600 (0.0004) [2023-03-11 23:34:20,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11605.3, 300 sec: 11815.9). Total num frames: 11063296. Throughput: 0: 11547.2. Samples: 11027732. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:34:20,661][106151] Avg episode reward: [(0, '4000.330')] [2023-03-11 23:34:23,563][106434] Updated weights for policy 0, policy_version 21680 (0.0005) [2023-03-11 23:34:25,661][106151] Fps is (10 sec: 12697.5, 60 sec: 11673.6, 300 sec: 11815.9). Total num frames: 11124736. Throughput: 0: 11690.6. Samples: 11103788. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:34:25,661][106151] Avg episode reward: [(0, '3990.605')] [2023-03-11 23:34:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000021728_11124736.pth... [2023-03-11 23:34:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000021032_10768384.pth [2023-03-11 23:34:26,864][106434] Updated weights for policy 0, policy_version 21760 (0.0005) [2023-03-11 23:34:30,165][106434] Updated weights for policy 0, policy_version 21840 (0.0005) [2023-03-11 23:34:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11815.9). Total num frames: 11186176. Throughput: 0: 11831.3. Samples: 11177984. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:34:30,661][106151] Avg episode reward: [(0, '4040.549')] [2023-03-11 23:34:33,636][106434] Updated weights for policy 0, policy_version 21920 (0.0005) [2023-03-11 23:34:35,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11829.8). Total num frames: 11243520. Throughput: 0: 11860.1. Samples: 11214024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:34:35,662][106151] Avg episode reward: [(0, '3830.138')] [2023-03-11 23:34:37,132][106434] Updated weights for policy 0, policy_version 22000 (0.0005) [2023-03-11 23:34:40,388][106434] Updated weights for policy 0, policy_version 22080 (0.0004) [2023-03-11 23:34:40,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11843.7). Total num frames: 11304960. Throughput: 0: 11874.0. Samples: 11284552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:34:40,661][106151] Avg episode reward: [(0, '4008.083')] [2023-03-11 23:34:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000022080_11304960.pth... [2023-03-11 23:34:40,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000021376_10944512.pth [2023-03-11 23:34:43,932][106434] Updated weights for policy 0, policy_version 22160 (0.0005) [2023-03-11 23:34:45,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11878.4, 300 sec: 11857.6). Total num frames: 11366400. Throughput: 0: 11962.5. Samples: 11357220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:34:45,661][106151] Avg episode reward: [(0, '3833.405')] [2023-03-11 23:34:47,269][106434] Updated weights for policy 0, policy_version 22240 (0.0003) [2023-03-11 23:34:50,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 11843.7). Total num frames: 11423744. Throughput: 0: 11982.2. Samples: 11393600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:34:50,661][106151] Avg episode reward: [(0, '4138.056')] [2023-03-11 23:34:50,787][106434] Updated weights for policy 0, policy_version 22320 (0.0005) [2023-03-11 23:34:54,380][106434] Updated weights for policy 0, policy_version 22400 (0.0005) [2023-03-11 23:34:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11829.8). Total num frames: 11481088. Throughput: 0: 11986.0. Samples: 11462924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:34:55,661][106151] Avg episode reward: [(0, '4240.411')] [2023-03-11 23:34:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000022424_11481088.pth... [2023-03-11 23:34:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000021728_11124736.pth [2023-03-11 23:34:57,977][106434] Updated weights for policy 0, policy_version 22480 (0.0005) [2023-03-11 23:35:00,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11878.4, 300 sec: 11815.9). Total num frames: 11538432. Throughput: 0: 11978.8. Samples: 11531692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:35:00,661][106151] Avg episode reward: [(0, '4237.083')] [2023-03-11 23:35:01,407][106434] Updated weights for policy 0, policy_version 22560 (0.0004) [2023-03-11 23:35:04,953][106434] Updated weights for policy 0, policy_version 22640 (0.0005) [2023-03-11 23:35:05,661][106151] Fps is (10 sec: 11469.0, 60 sec: 11878.4, 300 sec: 11802.0). Total num frames: 11595776. Throughput: 0: 11987.5. Samples: 11567168. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 23:35:05,661][106151] Avg episode reward: [(0, '4323.052')] [2023-03-11 23:35:08,473][106434] Updated weights for policy 0, policy_version 22720 (0.0005) [2023-03-11 23:35:10,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11815.9). Total num frames: 11657216. Throughput: 0: 11844.7. Samples: 11636800. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 23:35:10,661][106151] Avg episode reward: [(0, '3980.464')] [2023-03-11 23:35:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000022768_11657216.pth... [2023-03-11 23:35:10,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000022080_11304960.pth [2023-03-11 23:35:11,980][106434] Updated weights for policy 0, policy_version 22800 (0.0005) [2023-03-11 23:35:15,557][106434] Updated weights for policy 0, policy_version 22880 (0.0005) [2023-03-11 23:35:15,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11802.0). Total num frames: 11714560. Throughput: 0: 11743.5. Samples: 11706440. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 23:35:15,661][106151] Avg episode reward: [(0, '3927.714')] [2023-03-11 23:35:19,155][106434] Updated weights for policy 0, policy_version 22960 (0.0004) [2023-03-11 23:35:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 11788.2). Total num frames: 11771904. Throughput: 0: 11699.6. Samples: 11740504. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 23:35:20,661][106151] Avg episode reward: [(0, '4124.593')] [2023-03-11 23:35:22,668][106434] Updated weights for policy 0, policy_version 23040 (0.0005) [2023-03-11 23:35:25,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11774.3). Total num frames: 11829248. Throughput: 0: 11665.8. Samples: 11809512. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 23:35:25,661][106151] Avg episode reward: [(0, '4170.574')] [2023-03-11 23:35:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000023104_11829248.pth... [2023-03-11 23:35:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000022424_11481088.pth [2023-03-11 23:35:26,141][106434] Updated weights for policy 0, policy_version 23120 (0.0004) [2023-03-11 23:35:29,703][106434] Updated weights for policy 0, policy_version 23200 (0.0005) [2023-03-11 23:35:30,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 11760.4). Total num frames: 11886592. Throughput: 0: 11608.4. Samples: 11879596. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 23:35:30,661][106151] Avg episode reward: [(0, '4142.079')] [2023-03-11 23:35:33,143][106434] Updated weights for policy 0, policy_version 23280 (0.0005) [2023-03-11 23:35:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11732.6). Total num frames: 11943936. Throughput: 0: 11598.4. Samples: 11915528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:35:35,672][106151] Avg episode reward: [(0, '4368.344')] [2023-03-11 23:35:36,790][106434] Updated weights for policy 0, policy_version 23360 (0.0005) [2023-03-11 23:35:40,376][106434] Updated weights for policy 0, policy_version 23440 (0.0005) [2023-03-11 23:35:40,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.4, 300 sec: 11718.7). Total num frames: 12001280. Throughput: 0: 11579.1. Samples: 11983980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:35:40,661][106151] Avg episode reward: [(0, '4058.921')] [2023-03-11 23:35:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000023440_12001280.pth... [2023-03-11 23:35:40,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000022768_11657216.pth [2023-03-11 23:35:44,056][106434] Updated weights for policy 0, policy_version 23520 (0.0005) [2023-03-11 23:35:45,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11704.8). Total num frames: 12058624. Throughput: 0: 11529.2. Samples: 12050504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:35:45,661][106151] Avg episode reward: [(0, '4327.945')] [2023-03-11 23:35:47,576][106434] Updated weights for policy 0, policy_version 23600 (0.0005) [2023-03-11 23:35:50,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11691.0). Total num frames: 12115968. Throughput: 0: 11539.1. Samples: 12086428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:35:50,661][106151] Avg episode reward: [(0, '3927.091')] [2023-03-11 23:35:51,255][106434] Updated weights for policy 0, policy_version 23680 (0.0005) [2023-03-11 23:35:54,864][106434] Updated weights for policy 0, policy_version 23760 (0.0005) [2023-03-11 23:35:55,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11677.1). Total num frames: 12173312. Throughput: 0: 11476.6. Samples: 12153248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:35:55,661][106151] Avg episode reward: [(0, '3836.357')] [2023-03-11 23:35:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000023776_12173312.pth... [2023-03-11 23:35:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000023104_11829248.pth [2023-03-11 23:35:58,412][106434] Updated weights for policy 0, policy_version 23840 (0.0005) [2023-03-11 23:36:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11677.1). Total num frames: 12230656. Throughput: 0: 11468.6. Samples: 12222528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:36:00,661][106151] Avg episode reward: [(0, '4087.746')] [2023-03-11 23:36:01,852][106434] Updated weights for policy 0, policy_version 23920 (0.0004) [2023-03-11 23:36:04,966][106434] Updated weights for policy 0, policy_version 24000 (0.0004) [2023-03-11 23:36:05,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 11704.8). Total num frames: 12296192. Throughput: 0: 11530.8. Samples: 12259392. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 23:36:05,661][106151] Avg episode reward: [(0, '3422.382')] [2023-03-11 23:36:08,136][106434] Updated weights for policy 0, policy_version 24080 (0.0004) [2023-03-11 23:36:10,661][106151] Fps is (10 sec: 12697.5, 60 sec: 11673.6, 300 sec: 11718.7). Total num frames: 12357632. Throughput: 0: 11726.7. Samples: 12337216. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 23:36:10,662][106151] Avg episode reward: [(0, '3929.629')] [2023-03-11 23:36:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000024136_12357632.pth... [2023-03-11 23:36:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000023440_12001280.pth [2023-03-11 23:36:11,391][106434] Updated weights for policy 0, policy_version 24160 (0.0004) [2023-03-11 23:36:14,672][106434] Updated weights for policy 0, policy_version 24240 (0.0004) [2023-03-11 23:36:15,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11741.9, 300 sec: 11732.6). Total num frames: 12419072. Throughput: 0: 11845.2. Samples: 12412628. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 23:36:15,661][106151] Avg episode reward: [(0, '3699.433')] [2023-03-11 23:36:17,893][106434] Updated weights for policy 0, policy_version 24320 (0.0004) [2023-03-11 23:36:20,661][106151] Fps is (10 sec: 12697.7, 60 sec: 11878.4, 300 sec: 11746.5). Total num frames: 12484608. Throughput: 0: 11902.9. Samples: 12451160. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 23:36:20,661][106151] Avg episode reward: [(0, '3946.549')] [2023-03-11 23:36:21,055][106434] Updated weights for policy 0, policy_version 24400 (0.0004) [2023-03-11 23:36:24,283][106434] Updated weights for policy 0, policy_version 24480 (0.0004) [2023-03-11 23:36:25,661][106151] Fps is (10 sec: 12697.5, 60 sec: 11946.7, 300 sec: 11774.3). Total num frames: 12546048. Throughput: 0: 12093.5. Samples: 12528188. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 23:36:25,661][106151] Avg episode reward: [(0, '4123.499')] [2023-03-11 23:36:25,680][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000024512_12550144.pth... [2023-03-11 23:36:25,683][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000023776_12173312.pth [2023-03-11 23:36:27,796][106434] Updated weights for policy 0, policy_version 24560 (0.0005) [2023-03-11 23:36:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11774.3). Total num frames: 12607488. Throughput: 0: 12188.7. Samples: 12598996. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 23:36:30,661][106151] Avg episode reward: [(0, '3852.110')] [2023-03-11 23:36:31,288][106434] Updated weights for policy 0, policy_version 24640 (0.0005) [2023-03-11 23:36:34,766][106434] Updated weights for policy 0, policy_version 24720 (0.0005) [2023-03-11 23:36:35,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11774.3). Total num frames: 12664832. Throughput: 0: 12177.4. Samples: 12634412. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 23:36:35,661][106151] Avg episode reward: [(0, '3704.615')] [2023-03-11 23:36:38,185][106434] Updated weights for policy 0, policy_version 24800 (0.0005) [2023-03-11 23:36:40,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11788.1). Total num frames: 12726272. Throughput: 0: 12271.6. Samples: 12705472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:36:40,661][106151] Avg episode reward: [(0, '4139.326')] [2023-03-11 23:36:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000024856_12726272.pth... [2023-03-11 23:36:40,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000024136_12357632.pth [2023-03-11 23:36:41,574][106434] Updated weights for policy 0, policy_version 24880 (0.0004) [2023-03-11 23:36:45,096][106434] Updated weights for policy 0, policy_version 24960 (0.0005) [2023-03-11 23:36:45,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 11788.1). Total num frames: 12783616. Throughput: 0: 12305.6. Samples: 12776280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:36:45,661][106151] Avg episode reward: [(0, '3849.813')] [2023-03-11 23:36:48,541][106434] Updated weights for policy 0, policy_version 25040 (0.0005) [2023-03-11 23:36:50,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11802.0). Total num frames: 12845056. Throughput: 0: 12286.6. Samples: 12812288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:36:50,661][106151] Avg episode reward: [(0, '4045.090')] [2023-03-11 23:36:51,895][106434] Updated weights for policy 0, policy_version 25120 (0.0004) [2023-03-11 23:36:55,425][106434] Updated weights for policy 0, policy_version 25200 (0.0005) [2023-03-11 23:36:55,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12151.5, 300 sec: 11788.1). Total num frames: 12902400. Throughput: 0: 12132.1. Samples: 12883160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:36:55,661][106151] Avg episode reward: [(0, '4170.585')] [2023-03-11 23:36:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000025200_12902400.pth... [2023-03-11 23:36:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000024512_12550144.pth [2023-03-11 23:36:59,024][106434] Updated weights for policy 0, policy_version 25280 (0.0005) [2023-03-11 23:37:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 11788.1). Total num frames: 12959744. Throughput: 0: 12002.1. Samples: 12952724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:37:00,661][106151] Avg episode reward: [(0, '4141.799')] [2023-03-11 23:37:02,540][106434] Updated weights for policy 0, policy_version 25360 (0.0005) [2023-03-11 23:37:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 12014.9, 300 sec: 11788.2). Total num frames: 13017088. Throughput: 0: 11934.3. Samples: 12988204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:37:05,661][106151] Avg episode reward: [(0, '3272.359')] [2023-03-11 23:37:06,107][106434] Updated weights for policy 0, policy_version 25440 (0.0005) [2023-03-11 23:37:09,645][106434] Updated weights for policy 0, policy_version 25520 (0.0005) [2023-03-11 23:37:10,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11788.2). Total num frames: 13074432. Throughput: 0: 11742.8. Samples: 13056612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:37:10,661][106151] Avg episode reward: [(0, '3692.242')] [2023-03-11 23:37:10,683][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000025544_13078528.pth... [2023-03-11 23:37:10,685][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000024856_12726272.pth [2023-03-11 23:37:13,201][106434] Updated weights for policy 0, policy_version 25600 (0.0005) [2023-03-11 23:37:15,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11946.6, 300 sec: 11802.0). Total num frames: 13135872. Throughput: 0: 11726.7. Samples: 13126696. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:37:15,662][106151] Avg episode reward: [(0, '3872.525')] [2023-03-11 23:37:16,664][106434] Updated weights for policy 0, policy_version 25680 (0.0005) [2023-03-11 23:37:20,076][106434] Updated weights for policy 0, policy_version 25760 (0.0005) [2023-03-11 23:37:20,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11802.0). Total num frames: 13193216. Throughput: 0: 11731.4. Samples: 13162324. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:37:20,661][106151] Avg episode reward: [(0, '4123.686')] [2023-03-11 23:37:23,569][106434] Updated weights for policy 0, policy_version 25840 (0.0005) [2023-03-11 23:37:25,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 11788.1). Total num frames: 13250560. Throughput: 0: 11734.6. Samples: 13233528. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:37:25,661][106151] Avg episode reward: [(0, '3591.668')] [2023-03-11 23:37:25,668][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000025888_13254656.pth... [2023-03-11 23:37:25,670][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000025200_12902400.pth [2023-03-11 23:37:27,087][106434] Updated weights for policy 0, policy_version 25920 (0.0005) [2023-03-11 23:37:30,619][106434] Updated weights for policy 0, policy_version 26000 (0.0005) [2023-03-11 23:37:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11788.1). Total num frames: 13312000. Throughput: 0: 11709.6. Samples: 13303212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:37:30,661][106151] Avg episode reward: [(0, '4097.906')] [2023-03-11 23:37:34,223][106434] Updated weights for policy 0, policy_version 26080 (0.0004) [2023-03-11 23:37:35,661][106151] Fps is (10 sec: 11878.2, 60 sec: 11741.8, 300 sec: 11774.3). Total num frames: 13369344. Throughput: 0: 11652.4. Samples: 13336648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:37:35,662][106151] Avg episode reward: [(0, '3937.522')] [2023-03-11 23:37:37,743][106434] Updated weights for policy 0, policy_version 26160 (0.0005) [2023-03-11 23:37:40,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11760.4). Total num frames: 13426688. Throughput: 0: 11634.3. Samples: 13406704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:37:40,661][106151] Avg episode reward: [(0, '3056.560')] [2023-03-11 23:37:40,663][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000026224_13426688.pth... [2023-03-11 23:37:40,665][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000025544_13078528.pth [2023-03-11 23:37:41,016][106434] Updated weights for policy 0, policy_version 26240 (0.0004) [2023-03-11 23:37:44,165][106434] Updated weights for policy 0, policy_version 26320 (0.0003) [2023-03-11 23:37:45,661][106151] Fps is (10 sec: 12288.2, 60 sec: 11810.1, 300 sec: 11774.3). Total num frames: 13492224. Throughput: 0: 11807.0. Samples: 13484040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:37:45,661][106151] Avg episode reward: [(0, '3449.654')] [2023-03-11 23:37:47,373][106434] Updated weights for policy 0, policy_version 26400 (0.0004) [2023-03-11 23:37:50,628][106434] Updated weights for policy 0, policy_version 26480 (0.0004) [2023-03-11 23:37:50,661][106151] Fps is (10 sec: 13107.2, 60 sec: 11878.4, 300 sec: 11802.0). Total num frames: 13557760. Throughput: 0: 11877.8. Samples: 13522704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:37:50,661][106151] Avg episode reward: [(0, '3647.038')] [2023-03-11 23:37:53,812][106434] Updated weights for policy 0, policy_version 26560 (0.0004) [2023-03-11 23:37:55,661][106151] Fps is (10 sec: 12697.5, 60 sec: 11946.7, 300 sec: 11815.9). Total num frames: 13619200. Throughput: 0: 12048.2. Samples: 13598784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:37:55,661][106151] Avg episode reward: [(0, '3935.178')] [2023-03-11 23:37:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000026600_13619200.pth... [2023-03-11 23:37:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000025888_13254656.pth [2023-03-11 23:37:57,038][106434] Updated weights for policy 0, policy_version 26640 (0.0004) [2023-03-11 23:38:00,479][106434] Updated weights for policy 0, policy_version 26720 (0.0005) [2023-03-11 23:38:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11829.8). Total num frames: 13680640. Throughput: 0: 12145.8. Samples: 13673256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:38:00,661][106151] Avg episode reward: [(0, '4249.496')] [2023-03-11 23:38:03,760][106434] Updated weights for policy 0, policy_version 26800 (0.0004) [2023-03-11 23:38:05,661][106151] Fps is (10 sec: 12697.8, 60 sec: 12151.5, 300 sec: 11857.6). Total num frames: 13746176. Throughput: 0: 12156.7. Samples: 13709376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:38:05,661][106151] Avg episode reward: [(0, '3750.938')] [2023-03-11 23:38:06,952][106434] Updated weights for policy 0, policy_version 26880 (0.0003) [2023-03-11 23:38:10,192][106434] Updated weights for policy 0, policy_version 26960 (0.0004) [2023-03-11 23:38:10,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12219.7, 300 sec: 11871.5). Total num frames: 13807616. Throughput: 0: 12288.4. Samples: 13786508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:38:10,661][106151] Avg episode reward: [(0, '4212.305')] [2023-03-11 23:38:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000026968_13807616.pth... [2023-03-11 23:38:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000026224_13426688.pth [2023-03-11 23:38:13,382][106434] Updated weights for policy 0, policy_version 27040 (0.0004) [2023-03-11 23:38:15,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12219.7, 300 sec: 11871.5). Total num frames: 13869056. Throughput: 0: 12414.9. Samples: 13861884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:38:15,661][106151] Avg episode reward: [(0, '4005.745')] [2023-03-11 23:38:16,869][106434] Updated weights for policy 0, policy_version 27120 (0.0005) [2023-03-11 23:38:20,348][106434] Updated weights for policy 0, policy_version 27200 (0.0005) [2023-03-11 23:38:20,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12219.7, 300 sec: 11871.5). Total num frames: 13926400. Throughput: 0: 12456.9. Samples: 13897208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:38:20,661][106151] Avg episode reward: [(0, '3970.904')] [2023-03-11 23:38:23,658][106434] Updated weights for policy 0, policy_version 27280 (0.0005) [2023-03-11 23:38:25,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12356.2, 300 sec: 11899.2). Total num frames: 13991936. Throughput: 0: 12503.2. Samples: 13969348. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:38:25,661][106151] Avg episode reward: [(0, '3688.647')] [2023-03-11 23:38:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000027328_13991936.pth... [2023-03-11 23:38:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000026600_13619200.pth [2023-03-11 23:38:26,894][106434] Updated weights for policy 0, policy_version 27360 (0.0004) [2023-03-11 23:38:30,135][106434] Updated weights for policy 0, policy_version 27440 (0.0004) [2023-03-11 23:38:30,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12356.3, 300 sec: 11913.1). Total num frames: 14053376. Throughput: 0: 12471.5. Samples: 14045256. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:38:30,672][106151] Avg episode reward: [(0, '4247.297')] [2023-03-11 23:38:33,345][106434] Updated weights for policy 0, policy_version 27520 (0.0004) [2023-03-11 23:38:35,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 11940.9). Total num frames: 14118912. Throughput: 0: 12452.8. Samples: 14083080. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:38:35,672][106151] Avg episode reward: [(0, '3734.076')] [2023-03-11 23:38:36,643][106434] Updated weights for policy 0, policy_version 27600 (0.0004) [2023-03-11 23:38:40,210][106434] Updated weights for policy 0, policy_version 27680 (0.0005) [2023-03-11 23:38:40,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12492.8, 300 sec: 11940.9). Total num frames: 14176256. Throughput: 0: 12386.8. Samples: 14156192. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:38:40,662][106151] Avg episode reward: [(0, '4150.649')] [2023-03-11 23:38:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000027688_14176256.pth... [2023-03-11 23:38:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000026968_13807616.pth [2023-03-11 23:38:43,633][106434] Updated weights for policy 0, policy_version 27760 (0.0005) [2023-03-11 23:38:45,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 11954.8). Total num frames: 14237696. Throughput: 0: 12318.6. Samples: 14227592. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:38:45,672][106151] Avg episode reward: [(0, '4097.258')] [2023-03-11 23:38:46,925][106434] Updated weights for policy 0, policy_version 27840 (0.0004) [2023-03-11 23:38:50,081][106434] Updated weights for policy 0, policy_version 27920 (0.0003) [2023-03-11 23:38:50,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 11968.7). Total num frames: 14299136. Throughput: 0: 12372.4. Samples: 14266136. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:38:50,672][106151] Avg episode reward: [(0, '4212.856')] [2023-03-11 23:38:53,467][106434] Updated weights for policy 0, policy_version 28000 (0.0005) [2023-03-11 23:38:55,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 11982.5). Total num frames: 14360576. Throughput: 0: 12303.6. Samples: 14340172. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:38:55,662][106151] Avg episode reward: [(0, '3897.544')] [2023-03-11 23:38:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000028048_14360576.pth... [2023-03-11 23:38:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000027328_13991936.pth [2023-03-11 23:38:56,625][106434] Updated weights for policy 0, policy_version 28080 (0.0004) [2023-03-11 23:38:59,793][106434] Updated weights for policy 0, policy_version 28160 (0.0004) [2023-03-11 23:39:00,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 12010.3). Total num frames: 14426112. Throughput: 0: 12358.0. Samples: 14417992. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:39:00,672][106151] Avg episode reward: [(0, '3912.988')] [2023-03-11 23:39:03,058][106434] Updated weights for policy 0, policy_version 28240 (0.0005) [2023-03-11 23:39:05,661][106151] Fps is (10 sec: 13107.3, 60 sec: 12424.5, 300 sec: 12038.1). Total num frames: 14491648. Throughput: 0: 12414.0. Samples: 14455836. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:39:05,661][106151] Avg episode reward: [(0, '4026.731')] [2023-03-11 23:39:06,218][106434] Updated weights for policy 0, policy_version 28320 (0.0004) [2023-03-11 23:39:09,448][106434] Updated weights for policy 0, policy_version 28400 (0.0004) [2023-03-11 23:39:10,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 12052.0). Total num frames: 14553088. Throughput: 0: 12543.6. Samples: 14533812. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:39:10,662][106151] Avg episode reward: [(0, '4134.954')] [2023-03-11 23:39:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000028424_14553088.pth... [2023-03-11 23:39:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000027688_14176256.pth [2023-03-11 23:39:12,996][106434] Updated weights for policy 0, policy_version 28480 (0.0005) [2023-03-11 23:39:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 12024.2). Total num frames: 14610432. Throughput: 0: 12417.5. Samples: 14604044. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:39:15,661][106151] Avg episode reward: [(0, '3923.246')] [2023-03-11 23:39:16,424][106434] Updated weights for policy 0, policy_version 28560 (0.0005) [2023-03-11 23:39:19,965][106434] Updated weights for policy 0, policy_version 28640 (0.0005) [2023-03-11 23:39:20,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12424.5, 300 sec: 12024.2). Total num frames: 14671872. Throughput: 0: 12357.5. Samples: 14639168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:39:20,661][106151] Avg episode reward: [(0, '3512.496')] [2023-03-11 23:39:23,308][106434] Updated weights for policy 0, policy_version 28720 (0.0005) [2023-03-11 23:39:25,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12356.3, 300 sec: 12024.2). Total num frames: 14733312. Throughput: 0: 12341.0. Samples: 14711536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:39:25,662][106151] Avg episode reward: [(0, '3799.434')] [2023-03-11 23:39:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000028776_14733312.pth... [2023-03-11 23:39:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000028048_14360576.pth [2023-03-11 23:39:26,496][106434] Updated weights for policy 0, policy_version 28800 (0.0004) [2023-03-11 23:39:29,752][106434] Updated weights for policy 0, policy_version 28880 (0.0005) [2023-03-11 23:39:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12038.1). Total num frames: 14794752. Throughput: 0: 12435.3. Samples: 14787180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:39:30,661][106151] Avg episode reward: [(0, '4021.997')] [2023-03-11 23:39:32,904][106434] Updated weights for policy 0, policy_version 28960 (0.0004) [2023-03-11 23:39:35,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12356.3, 300 sec: 12052.0). Total num frames: 14860288. Throughput: 0: 12455.2. Samples: 14826620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:39:35,661][106151] Avg episode reward: [(0, '3852.417')] [2023-03-11 23:39:36,094][106434] Updated weights for policy 0, policy_version 29040 (0.0004) [2023-03-11 23:39:39,259][106434] Updated weights for policy 0, policy_version 29120 (0.0004) [2023-03-11 23:39:40,661][106151] Fps is (10 sec: 13107.2, 60 sec: 12492.8, 300 sec: 12065.8). Total num frames: 14925824. Throughput: 0: 12523.8. Samples: 14903744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:39:40,661][106151] Avg episode reward: [(0, '3599.975')] [2023-03-11 23:39:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000029152_14925824.pth... [2023-03-11 23:39:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000028424_14553088.pth [2023-03-11 23:39:42,526][106434] Updated weights for policy 0, policy_version 29200 (0.0004) [2023-03-11 23:39:45,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12492.8, 300 sec: 12079.7). Total num frames: 14987264. Throughput: 0: 12468.6. Samples: 14979080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:39:45,661][106151] Avg episode reward: [(0, '4026.398')] [2023-03-11 23:39:45,765][106434] Updated weights for policy 0, policy_version 29280 (0.0004) [2023-03-11 23:39:49,023][106434] Updated weights for policy 0, policy_version 29360 (0.0003) [2023-03-11 23:39:50,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12107.5). Total num frames: 15052800. Throughput: 0: 12477.1. Samples: 15017304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:39:50,661][106151] Avg episode reward: [(0, '4121.000')] [2023-03-11 23:39:52,209][106434] Updated weights for policy 0, policy_version 29440 (0.0004) [2023-03-11 23:39:55,384][106434] Updated weights for policy 0, policy_version 29520 (0.0004) [2023-03-11 23:39:55,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12121.4). Total num frames: 15114240. Throughput: 0: 12444.7. Samples: 15093824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:39:55,661][106151] Avg episode reward: [(0, '3826.120')] [2023-03-11 23:39:55,697][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000029528_15118336.pth... [2023-03-11 23:39:55,699][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000028776_14733312.pth [2023-03-11 23:39:58,796][106434] Updated weights for policy 0, policy_version 29600 (0.0004) [2023-03-11 23:40:00,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12492.8, 300 sec: 12135.3). Total num frames: 15175680. Throughput: 0: 12521.0. Samples: 15167488. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:40:00,661][106151] Avg episode reward: [(0, '3859.310')] [2023-03-11 23:40:02,357][106434] Updated weights for policy 0, policy_version 29680 (0.0005) [2023-03-11 23:40:05,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 12121.4). Total num frames: 15233024. Throughput: 0: 12502.2. Samples: 15201768. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:40:05,661][106151] Avg episode reward: [(0, '4092.323')] [2023-03-11 23:40:05,900][106434] Updated weights for policy 0, policy_version 29760 (0.0005) [2023-03-11 23:40:09,484][106434] Updated weights for policy 0, policy_version 29840 (0.0005) [2023-03-11 23:40:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12288.0, 300 sec: 12121.4). Total num frames: 15290368. Throughput: 0: 12413.7. Samples: 15270152. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:40:10,661][106151] Avg episode reward: [(0, '3965.096')] [2023-03-11 23:40:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000029864_15290368.pth... [2023-03-11 23:40:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000029152_14925824.pth [2023-03-11 23:40:13,045][106434] Updated weights for policy 0, policy_version 29920 (0.0005) [2023-03-11 23:40:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12288.0, 300 sec: 12121.4). Total num frames: 15347712. Throughput: 0: 12274.4. Samples: 15339528. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:40:15,661][106151] Avg episode reward: [(0, '4198.196')] [2023-03-11 23:40:16,556][106434] Updated weights for policy 0, policy_version 30000 (0.0005) [2023-03-11 23:40:20,164][106434] Updated weights for policy 0, policy_version 30080 (0.0005) [2023-03-11 23:40:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12219.7, 300 sec: 12121.4). Total num frames: 15405056. Throughput: 0: 12173.7. Samples: 15374436. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 23:40:20,661][106151] Avg episode reward: [(0, '4180.148')] [2023-03-11 23:40:23,748][106434] Updated weights for policy 0, policy_version 30160 (0.0005) [2023-03-11 23:40:25,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 12121.4). Total num frames: 15462400. Throughput: 0: 11974.7. Samples: 15442604. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 23:40:25,661][106151] Avg episode reward: [(0, '4000.669')] [2023-03-11 23:40:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000030200_15462400.pth... [2023-03-11 23:40:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000029528_15118336.pth [2023-03-11 23:40:27,319][106434] Updated weights for policy 0, policy_version 30240 (0.0005) [2023-03-11 23:40:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 12121.4). Total num frames: 15519744. Throughput: 0: 11834.1. Samples: 15511616. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 23:40:30,661][106151] Avg episode reward: [(0, '4157.610')] [2023-03-11 23:40:30,896][106434] Updated weights for policy 0, policy_version 30320 (0.0005) [2023-03-11 23:40:34,423][106434] Updated weights for policy 0, policy_version 30400 (0.0005) [2023-03-11 23:40:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 12121.4). Total num frames: 15577088. Throughput: 0: 11766.7. Samples: 15546804. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 23:40:35,661][106151] Avg episode reward: [(0, '4080.753')] [2023-03-11 23:40:37,988][106434] Updated weights for policy 0, policy_version 30480 (0.0005) [2023-03-11 23:40:40,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 12121.4). Total num frames: 15634432. Throughput: 0: 11589.6. Samples: 15615356. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:40:40,661][106151] Avg episode reward: [(0, '4413.270')] [2023-03-11 23:40:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000030536_15634432.pth... [2023-03-11 23:40:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000029864_15290368.pth [2023-03-11 23:40:41,489][106434] Updated weights for policy 0, policy_version 30560 (0.0005) [2023-03-11 23:40:45,052][106434] Updated weights for policy 0, policy_version 30640 (0.0005) [2023-03-11 23:40:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 12121.4). Total num frames: 15691776. Throughput: 0: 11500.5. Samples: 15685012. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:40:45,661][106151] Avg episode reward: [(0, '4176.038')] [2023-03-11 23:40:48,612][106434] Updated weights for policy 0, policy_version 30720 (0.0005) [2023-03-11 23:40:50,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12121.4). Total num frames: 15749120. Throughput: 0: 11519.6. Samples: 15720152. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:40:50,661][106151] Avg episode reward: [(0, '4148.086')] [2023-03-11 23:40:52,125][106434] Updated weights for policy 0, policy_version 30800 (0.0005) [2023-03-11 23:40:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 12121.4). Total num frames: 15806464. Throughput: 0: 11539.0. Samples: 15789408. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:40:55,661][106151] Avg episode reward: [(0, '4355.923')] [2023-03-11 23:40:55,684][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000030880_15810560.pth... [2023-03-11 23:40:55,685][106434] Updated weights for policy 0, policy_version 30880 (0.0005) [2023-03-11 23:40:55,685][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000030200_15462400.pth [2023-03-11 23:40:59,210][106434] Updated weights for policy 0, policy_version 30960 (0.0005) [2023-03-11 23:41:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 12107.5). Total num frames: 15867904. Throughput: 0: 11547.7. Samples: 15859176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:41:00,661][106151] Avg episode reward: [(0, '3513.153')] [2023-03-11 23:41:02,534][106434] Updated weights for policy 0, policy_version 31040 (0.0005) [2023-03-11 23:41:05,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11605.3, 300 sec: 12107.5). Total num frames: 15929344. Throughput: 0: 11600.2. Samples: 15896444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:41:05,661][106151] Avg episode reward: [(0, '3746.107')] [2023-03-11 23:41:05,765][106434] Updated weights for policy 0, policy_version 31120 (0.0004) [2023-03-11 23:41:08,945][106434] Updated weights for policy 0, policy_version 31200 (0.0004) [2023-03-11 23:41:10,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11741.9, 300 sec: 12121.4). Total num frames: 15994880. Throughput: 0: 11791.6. Samples: 15973228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:41:10,661][106151] Avg episode reward: [(0, '4052.052')] [2023-03-11 23:41:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000031240_15994880.pth... [2023-03-11 23:41:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000030536_15634432.pth [2023-03-11 23:41:12,136][106434] Updated weights for policy 0, policy_version 31280 (0.0004) [2023-03-11 23:41:15,338][106434] Updated weights for policy 0, policy_version 31360 (0.0004) [2023-03-11 23:41:15,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11810.1, 300 sec: 12107.5). Total num frames: 16056320. Throughput: 0: 11964.6. Samples: 16050024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:41:15,661][106151] Avg episode reward: [(0, '3948.884')] [2023-03-11 23:41:18,565][106434] Updated weights for policy 0, policy_version 31440 (0.0003) [2023-03-11 23:41:20,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11946.7, 300 sec: 12121.4). Total num frames: 16121856. Throughput: 0: 12027.2. Samples: 16088028. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:41:20,661][106151] Avg episode reward: [(0, '4058.454')] [2023-03-11 23:41:21,809][106434] Updated weights for policy 0, policy_version 31520 (0.0003) [2023-03-11 23:41:25,262][106434] Updated weights for policy 0, policy_version 31600 (0.0004) [2023-03-11 23:41:25,661][106151] Fps is (10 sec: 12697.4, 60 sec: 12014.9, 300 sec: 12121.4). Total num frames: 16183296. Throughput: 0: 12157.4. Samples: 16162440. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:41:25,662][106151] Avg episode reward: [(0, '3936.982')] [2023-03-11 23:41:25,666][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000031608_16183296.pth... [2023-03-11 23:41:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000030880_15810560.pth [2023-03-11 23:41:28,477][106434] Updated weights for policy 0, policy_version 31680 (0.0004) [2023-03-11 23:41:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 12135.3). Total num frames: 16244736. Throughput: 0: 12257.9. Samples: 16236616. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:41:30,661][106151] Avg episode reward: [(0, '4143.833')] [2023-03-11 23:41:31,875][106434] Updated weights for policy 0, policy_version 31760 (0.0004) [2023-03-11 23:41:35,423][106434] Updated weights for policy 0, policy_version 31840 (0.0005) [2023-03-11 23:41:35,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 12121.4). Total num frames: 16302080. Throughput: 0: 12276.8. Samples: 16272608. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:41:35,661][106151] Avg episode reward: [(0, '4039.611')] [2023-03-11 23:41:38,907][106434] Updated weights for policy 0, policy_version 31920 (0.0005) [2023-03-11 23:41:40,661][106151] Fps is (10 sec: 11468.7, 60 sec: 12083.2, 300 sec: 12121.4). Total num frames: 16359424. Throughput: 0: 12295.3. Samples: 16342696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:41:40,662][106151] Avg episode reward: [(0, '4127.322')] [2023-03-11 23:41:40,711][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000031960_16363520.pth... [2023-03-11 23:41:40,712][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000031240_15994880.pth [2023-03-11 23:41:42,454][106434] Updated weights for policy 0, policy_version 32000 (0.0005) [2023-03-11 23:41:45,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12121.4). Total num frames: 16420864. Throughput: 0: 12280.6. Samples: 16411804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:41:45,661][106151] Avg episode reward: [(0, '4337.252')] [2023-03-11 23:41:46,023][106434] Updated weights for policy 0, policy_version 32080 (0.0005) [2023-03-11 23:41:49,604][106434] Updated weights for policy 0, policy_version 32160 (0.0005) [2023-03-11 23:41:50,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 12107.5). Total num frames: 16474112. Throughput: 0: 12200.2. Samples: 16445452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:41:50,661][106151] Avg episode reward: [(0, '4206.232')] [2023-03-11 23:41:53,155][106434] Updated weights for policy 0, policy_version 32240 (0.0005) [2023-03-11 23:41:55,661][106151] Fps is (10 sec: 11468.7, 60 sec: 12151.5, 300 sec: 12121.4). Total num frames: 16535552. Throughput: 0: 12041.0. Samples: 16515072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:41:55,661][106151] Avg episode reward: [(0, '4241.314')] [2023-03-11 23:41:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000032296_16535552.pth... [2023-03-11 23:41:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000031608_16183296.pth [2023-03-11 23:41:56,641][106434] Updated weights for policy 0, policy_version 32320 (0.0005) [2023-03-11 23:42:00,193][106434] Updated weights for policy 0, policy_version 32400 (0.0005) [2023-03-11 23:42:00,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 12121.4). Total num frames: 16592896. Throughput: 0: 11881.9. Samples: 16584712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:42:00,661][106151] Avg episode reward: [(0, '4270.639')] [2023-03-11 23:42:03,788][106434] Updated weights for policy 0, policy_version 32480 (0.0005) [2023-03-11 23:42:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 12014.9, 300 sec: 12121.4). Total num frames: 16650240. Throughput: 0: 11792.2. Samples: 16618676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:42:05,661][106151] Avg episode reward: [(0, '4118.046')] [2023-03-11 23:42:07,349][106434] Updated weights for policy 0, policy_version 32560 (0.0005) [2023-03-11 23:42:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 12107.5). Total num frames: 16707584. Throughput: 0: 11671.9. Samples: 16687676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:42:10,661][106151] Avg episode reward: [(0, '4354.021')] [2023-03-11 23:42:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000032632_16707584.pth... [2023-03-11 23:42:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000031960_16363520.pth [2023-03-11 23:42:10,872][106434] Updated weights for policy 0, policy_version 32640 (0.0005) [2023-03-11 23:42:14,416][106434] Updated weights for policy 0, policy_version 32720 (0.0005) [2023-03-11 23:42:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 12107.5). Total num frames: 16764928. Throughput: 0: 11571.9. Samples: 16757352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:42:15,661][106151] Avg episode reward: [(0, '4067.421')] [2023-03-11 23:42:17,925][106434] Updated weights for policy 0, policy_version 32800 (0.0005) [2023-03-11 23:42:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12107.5). Total num frames: 16822272. Throughput: 0: 11559.5. Samples: 16792788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:42:20,661][106151] Avg episode reward: [(0, '3961.850')] [2023-03-11 23:42:21,483][106434] Updated weights for policy 0, policy_version 32880 (0.0004) [2023-03-11 23:42:25,030][106434] Updated weights for policy 0, policy_version 32960 (0.0005) [2023-03-11 23:42:25,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.4, 300 sec: 12093.6). Total num frames: 16879616. Throughput: 0: 11540.2. Samples: 16862004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:42:25,661][106151] Avg episode reward: [(0, '4111.885')] [2023-03-11 23:42:25,663][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000032968_16879616.pth... [2023-03-11 23:42:25,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000032296_16535552.pth [2023-03-11 23:42:28,541][106434] Updated weights for policy 0, policy_version 33040 (0.0005) [2023-03-11 23:42:30,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11605.4, 300 sec: 12107.5). Total num frames: 16941056. Throughput: 0: 11551.7. Samples: 16931628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:42:30,661][106151] Avg episode reward: [(0, '4107.858')] [2023-03-11 23:42:32,076][106434] Updated weights for policy 0, policy_version 33120 (0.0005) [2023-03-11 23:42:35,657][106434] Updated weights for policy 0, policy_version 33200 (0.0005) [2023-03-11 23:42:35,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 12107.5). Total num frames: 16998400. Throughput: 0: 11568.9. Samples: 16966052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:42:35,661][106151] Avg episode reward: [(0, '4257.493')] [2023-03-11 23:42:39,281][106434] Updated weights for policy 0, policy_version 33280 (0.0005) [2023-03-11 23:42:40,661][106151] Fps is (10 sec: 11058.9, 60 sec: 11537.1, 300 sec: 12065.8). Total num frames: 17051648. Throughput: 0: 11533.9. Samples: 17034100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:42:40,662][106151] Avg episode reward: [(0, '4134.057')] [2023-03-11 23:42:40,684][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000033312_17055744.pth... [2023-03-11 23:42:40,685][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000032632_16707584.pth [2023-03-11 23:42:42,842][106434] Updated weights for policy 0, policy_version 33360 (0.0005) [2023-03-11 23:42:45,661][106151] Fps is (10 sec: 11059.1, 60 sec: 11468.8, 300 sec: 12038.1). Total num frames: 17108992. Throughput: 0: 11522.6. Samples: 17103232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:42:45,662][106151] Avg episode reward: [(0, '4205.887')] [2023-03-11 23:42:46,456][106434] Updated weights for policy 0, policy_version 33440 (0.0005) [2023-03-11 23:42:50,107][106434] Updated weights for policy 0, policy_version 33520 (0.0005) [2023-03-11 23:42:50,661][106151] Fps is (10 sec: 11469.0, 60 sec: 11537.1, 300 sec: 12024.2). Total num frames: 17166336. Throughput: 0: 11518.0. Samples: 17136988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:42:50,661][106151] Avg episode reward: [(0, '4026.921')] [2023-03-11 23:42:53,704][106434] Updated weights for policy 0, policy_version 33600 (0.0005) [2023-03-11 23:42:55,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 12010.3). Total num frames: 17223680. Throughput: 0: 11482.3. Samples: 17204380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:42:55,661][106151] Avg episode reward: [(0, '3356.312')] [2023-03-11 23:42:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000033640_17223680.pth... [2023-03-11 23:42:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000032968_16879616.pth [2023-03-11 23:42:57,343][106434] Updated weights for policy 0, policy_version 33680 (0.0005) [2023-03-11 23:43:00,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11982.5). Total num frames: 17281024. Throughput: 0: 11475.5. Samples: 17273748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:43:00,661][106151] Avg episode reward: [(0, '3471.442')] [2023-03-11 23:43:00,809][106434] Updated weights for policy 0, policy_version 33760 (0.0005) [2023-03-11 23:43:04,392][106434] Updated weights for policy 0, policy_version 33840 (0.0005) [2023-03-11 23:43:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11968.7). Total num frames: 17338368. Throughput: 0: 11470.7. Samples: 17308968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:43:05,661][106151] Avg episode reward: [(0, '3848.241')] [2023-03-11 23:43:08,096][106434] Updated weights for policy 0, policy_version 33920 (0.0005) [2023-03-11 23:43:10,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11954.8). Total num frames: 17395712. Throughput: 0: 11406.7. Samples: 17375304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:43:10,661][106151] Avg episode reward: [(0, '3538.788')] [2023-03-11 23:43:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000033976_17395712.pth... [2023-03-11 23:43:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000033312_17055744.pth [2023-03-11 23:43:11,699][106434] Updated weights for policy 0, policy_version 34000 (0.0006) [2023-03-11 23:43:15,271][106434] Updated weights for policy 0, policy_version 34080 (0.0006) [2023-03-11 23:43:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11954.8). Total num frames: 17453056. Throughput: 0: 11390.7. Samples: 17444208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:43:15,661][106151] Avg episode reward: [(0, '3827.202')] [2023-03-11 23:43:18,848][106434] Updated weights for policy 0, policy_version 34160 (0.0006) [2023-03-11 23:43:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11927.0). Total num frames: 17510400. Throughput: 0: 11380.4. Samples: 17478168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:43:20,661][106151] Avg episode reward: [(0, '2758.783')] [2023-03-11 23:43:22,319][106434] Updated weights for policy 0, policy_version 34240 (0.0005) [2023-03-11 23:43:25,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11913.1). Total num frames: 17567744. Throughput: 0: 11470.5. Samples: 17550268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:43:25,661][106151] Avg episode reward: [(0, '3824.633')] [2023-03-11 23:43:25,663][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000034312_17567744.pth... [2023-03-11 23:43:25,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000033640_17223680.pth [2023-03-11 23:43:25,744][106434] Updated weights for policy 0, policy_version 34320 (0.0005) [2023-03-11 23:43:29,352][106434] Updated weights for policy 0, policy_version 34400 (0.0006) [2023-03-11 23:43:30,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11468.8, 300 sec: 11899.2). Total num frames: 17629184. Throughput: 0: 11459.8. Samples: 17618920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:43:30,661][106151] Avg episode reward: [(0, '3745.834')] [2023-03-11 23:43:32,605][106434] Updated weights for policy 0, policy_version 34480 (0.0004) [2023-03-11 23:43:35,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11537.1, 300 sec: 11913.1). Total num frames: 17690624. Throughput: 0: 11544.5. Samples: 17656492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:43:35,661][106151] Avg episode reward: [(0, '4080.523')] [2023-03-11 23:43:35,806][106434] Updated weights for policy 0, policy_version 34560 (0.0004) [2023-03-11 23:43:39,156][106434] Updated weights for policy 0, policy_version 34640 (0.0005) [2023-03-11 23:43:40,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11673.6, 300 sec: 11913.1). Total num frames: 17752064. Throughput: 0: 11712.5. Samples: 17731444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:43:40,661][106151] Avg episode reward: [(0, '4094.383')] [2023-03-11 23:43:40,666][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000034672_17752064.pth... [2023-03-11 23:43:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000033976_17395712.pth [2023-03-11 23:43:42,389][106434] Updated weights for policy 0, policy_version 34720 (0.0005) [2023-03-11 23:43:45,587][106434] Updated weights for policy 0, policy_version 34800 (0.0004) [2023-03-11 23:43:45,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11810.1, 300 sec: 11927.0). Total num frames: 17817600. Throughput: 0: 11869.9. Samples: 17807896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:43:45,661][106151] Avg episode reward: [(0, '4254.308')] [2023-03-11 23:43:48,713][106434] Updated weights for policy 0, policy_version 34880 (0.0004) [2023-03-11 23:43:50,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11878.4, 300 sec: 11927.0). Total num frames: 17879040. Throughput: 0: 11953.9. Samples: 17846896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:43:50,661][106151] Avg episode reward: [(0, '4015.488')] [2023-03-11 23:43:51,985][106434] Updated weights for policy 0, policy_version 34960 (0.0005) [2023-03-11 23:43:55,179][106434] Updated weights for policy 0, policy_version 35040 (0.0005) [2023-03-11 23:43:55,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11927.0). Total num frames: 17944576. Throughput: 0: 12179.6. Samples: 17923388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:43:55,661][106151] Avg episode reward: [(0, '4195.450')] [2023-03-11 23:43:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000035048_17944576.pth... [2023-03-11 23:43:55,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000034312_17567744.pth [2023-03-11 23:43:58,364][106434] Updated weights for policy 0, policy_version 35120 (0.0004) [2023-03-11 23:44:00,661][106151] Fps is (10 sec: 13107.2, 60 sec: 12151.5, 300 sec: 11927.0). Total num frames: 18010112. Throughput: 0: 12350.7. Samples: 17999992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:44:00,661][106151] Avg episode reward: [(0, '4261.441')] [2023-03-11 23:44:01,505][106434] Updated weights for policy 0, policy_version 35200 (0.0004) [2023-03-11 23:44:04,711][106434] Updated weights for policy 0, policy_version 35280 (0.0004) [2023-03-11 23:44:05,661][106151] Fps is (10 sec: 13107.2, 60 sec: 12288.0, 300 sec: 11940.9). Total num frames: 18075648. Throughput: 0: 12459.7. Samples: 18038856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:44:05,661][106151] Avg episode reward: [(0, '4331.111')] [2023-03-11 23:44:07,920][106434] Updated weights for policy 0, policy_version 35360 (0.0004) [2023-03-11 23:44:10,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12356.3, 300 sec: 11954.8). Total num frames: 18137088. Throughput: 0: 12579.7. Samples: 18116356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:44:10,661][106151] Avg episode reward: [(0, '4088.065')] [2023-03-11 23:44:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000035424_18137088.pth... [2023-03-11 23:44:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000034672_17752064.pth [2023-03-11 23:44:11,167][106434] Updated weights for policy 0, policy_version 35440 (0.0005) [2023-03-11 23:44:14,358][106434] Updated weights for policy 0, policy_version 35520 (0.0004) [2023-03-11 23:44:15,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 11968.7). Total num frames: 18202624. Throughput: 0: 12738.0. Samples: 18192132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:44:15,661][106151] Avg episode reward: [(0, '3914.010')] [2023-03-11 23:44:17,549][106434] Updated weights for policy 0, policy_version 35600 (0.0004) [2023-03-11 23:44:20,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 11954.8). Total num frames: 18259968. Throughput: 0: 12765.2. Samples: 18230928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:44:20,661][106151] Avg episode reward: [(0, '3979.967')] [2023-03-11 23:44:21,053][106434] Updated weights for policy 0, policy_version 35680 (0.0005) [2023-03-11 23:44:24,640][106434] Updated weights for policy 0, policy_version 35760 (0.0006) [2023-03-11 23:44:25,661][106151] Fps is (10 sec: 11468.5, 60 sec: 12492.7, 300 sec: 11940.9). Total num frames: 18317312. Throughput: 0: 12655.2. Samples: 18300928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:44:25,662][106151] Avg episode reward: [(0, '3828.536')] [2023-03-11 23:44:25,711][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000035784_18321408.pth... [2023-03-11 23:44:25,713][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000035048_17944576.pth [2023-03-11 23:44:28,164][106434] Updated weights for policy 0, policy_version 35840 (0.0005) [2023-03-11 23:44:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12492.8, 300 sec: 11927.0). Total num frames: 18378752. Throughput: 0: 12480.0. Samples: 18369496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:44:30,661][106151] Avg episode reward: [(0, '3779.516')] [2023-03-11 23:44:31,608][106390] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000002 [2023-03-11 23:44:31,609][106434] Updated weights for policy 0, policy_version 35920 (0.0005) [2023-03-11 23:44:34,971][106434] Updated weights for policy 0, policy_version 36000 (0.0004) [2023-03-11 23:44:35,661][106151] Fps is (10 sec: 11878.7, 60 sec: 12424.5, 300 sec: 11899.2). Total num frames: 18436096. Throughput: 0: 12427.7. Samples: 18406140. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:44:35,661][106151] Avg episode reward: [(0, '4112.658')] [2023-03-11 23:44:38,389][106434] Updated weights for policy 0, policy_version 36080 (0.0005) [2023-03-11 23:44:40,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12424.5, 300 sec: 11899.2). Total num frames: 18497536. Throughput: 0: 12337.8. Samples: 18478588. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:44:40,662][106151] Avg episode reward: [(0, '4043.765')] [2023-03-11 23:44:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000036128_18497536.pth... [2023-03-11 23:44:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000035424_18137088.pth [2023-03-11 23:44:41,796][106434] Updated weights for policy 0, policy_version 36160 (0.0005) [2023-03-11 23:44:45,271][106434] Updated weights for policy 0, policy_version 36240 (0.0005) [2023-03-11 23:44:45,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 11885.3). Total num frames: 18558976. Throughput: 0: 12216.5. Samples: 18549732. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:44:45,661][106151] Avg episode reward: [(0, '3783.616')] [2023-03-11 23:44:48,872][106434] Updated weights for policy 0, policy_version 36320 (0.0006) [2023-03-11 23:44:50,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12288.0, 300 sec: 11871.5). Total num frames: 18616320. Throughput: 0: 12105.9. Samples: 18583624. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:44:50,661][106151] Avg episode reward: [(0, '3619.167')] [2023-03-11 23:44:52,387][106434] Updated weights for policy 0, policy_version 36400 (0.0006) [2023-03-11 23:44:55,661][106151] Fps is (10 sec: 11468.7, 60 sec: 12151.5, 300 sec: 11857.6). Total num frames: 18673664. Throughput: 0: 11931.4. Samples: 18653272. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:44:55,661][106151] Avg episode reward: [(0, '3757.793')] [2023-03-11 23:44:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000036472_18673664.pth... [2023-03-11 23:44:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000035784_18321408.pth [2023-03-11 23:44:55,935][106434] Updated weights for policy 0, policy_version 36480 (0.0005) [2023-03-11 23:44:59,303][106434] Updated weights for policy 0, policy_version 36560 (0.0005) [2023-03-11 23:45:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11871.5). Total num frames: 18735104. Throughput: 0: 11852.0. Samples: 18725472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:45:00,672][106151] Avg episode reward: [(0, '3944.380')] [2023-03-11 23:45:02,495][106434] Updated weights for policy 0, policy_version 36640 (0.0004) [2023-03-11 23:45:05,661][106151] Fps is (10 sec: 12288.2, 60 sec: 12014.9, 300 sec: 11885.3). Total num frames: 18796544. Throughput: 0: 11842.5. Samples: 18763840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:45:05,661][106151] Avg episode reward: [(0, '4272.832')] [2023-03-11 23:45:05,695][106434] Updated weights for policy 0, policy_version 36720 (0.0004) [2023-03-11 23:45:08,927][106434] Updated weights for policy 0, policy_version 36800 (0.0004) [2023-03-11 23:45:10,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12014.9, 300 sec: 11899.2). Total num frames: 18857984. Throughput: 0: 11980.6. Samples: 18840052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:45:10,661][106151] Avg episode reward: [(0, '4123.289')] [2023-03-11 23:45:10,683][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000036840_18862080.pth... [2023-03-11 23:45:10,685][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000036128_18497536.pth [2023-03-11 23:45:12,403][106434] Updated weights for policy 0, policy_version 36880 (0.0005) [2023-03-11 23:45:15,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 11913.1). Total num frames: 18919424. Throughput: 0: 12056.2. Samples: 18912024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:45:15,672][106151] Avg episode reward: [(0, '4007.775')] [2023-03-11 23:45:15,797][106434] Updated weights for policy 0, policy_version 36960 (0.0005) [2023-03-11 23:45:19,201][106434] Updated weights for policy 0, policy_version 37040 (0.0006) [2023-03-11 23:45:20,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12014.9, 300 sec: 11927.0). Total num frames: 18980864. Throughput: 0: 12041.5. Samples: 18948008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:45:20,661][106151] Avg episode reward: [(0, '4151.527')] [2023-03-11 23:45:22,480][106434] Updated weights for policy 0, policy_version 37120 (0.0005) [2023-03-11 23:45:25,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11940.9). Total num frames: 19042304. Throughput: 0: 12073.5. Samples: 19021896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:45:25,662][106151] Avg episode reward: [(0, '3858.322')] [2023-03-11 23:45:25,666][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000037192_19042304.pth... [2023-03-11 23:45:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000036472_18673664.pth [2023-03-11 23:45:25,708][106434] Updated weights for policy 0, policy_version 37200 (0.0004) [2023-03-11 23:45:28,852][106434] Updated weights for policy 0, policy_version 37280 (0.0004) [2023-03-11 23:45:30,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12151.5, 300 sec: 11968.6). Total num frames: 19107840. Throughput: 0: 12221.8. Samples: 19099712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:45:30,661][106151] Avg episode reward: [(0, '4009.230')] [2023-03-11 23:45:32,093][106434] Updated weights for policy 0, policy_version 37360 (0.0004) [2023-03-11 23:45:35,292][106434] Updated weights for policy 0, policy_version 37440 (0.0004) [2023-03-11 23:45:35,661][106151] Fps is (10 sec: 13107.3, 60 sec: 12288.0, 300 sec: 11996.4). Total num frames: 19173376. Throughput: 0: 12295.8. Samples: 19136936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:45:35,661][106151] Avg episode reward: [(0, '4235.129')] [2023-03-11 23:45:38,466][106434] Updated weights for policy 0, policy_version 37520 (0.0004) [2023-03-11 23:45:40,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 12010.3). Total num frames: 19234816. Throughput: 0: 12474.5. Samples: 19214624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:45:40,662][106151] Avg episode reward: [(0, '4288.033')] [2023-03-11 23:45:40,698][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000037576_19238912.pth... [2023-03-11 23:45:40,699][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000036840_18862080.pth [2023-03-11 23:45:41,639][106434] Updated weights for policy 0, policy_version 37600 (0.0004) [2023-03-11 23:45:44,800][106434] Updated weights for policy 0, policy_version 37680 (0.0004) [2023-03-11 23:45:45,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12356.3, 300 sec: 12038.1). Total num frames: 19300352. Throughput: 0: 12594.7. Samples: 19292232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:45:45,672][106151] Avg episode reward: [(0, '4155.805')] [2023-03-11 23:45:48,015][106434] Updated weights for policy 0, policy_version 37760 (0.0004) [2023-03-11 23:45:50,661][106151] Fps is (10 sec: 13107.3, 60 sec: 12492.8, 300 sec: 12065.8). Total num frames: 19365888. Throughput: 0: 12589.7. Samples: 19330376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:45:50,672][106151] Avg episode reward: [(0, '4460.960')] [2023-03-11 23:45:51,311][106434] Updated weights for policy 0, policy_version 37840 (0.0005) [2023-03-11 23:45:54,520][106434] Updated weights for policy 0, policy_version 37920 (0.0004) [2023-03-11 23:45:55,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12561.1, 300 sec: 12065.8). Total num frames: 19427328. Throughput: 0: 12572.5. Samples: 19405816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:45:55,662][106151] Avg episode reward: [(0, '4286.390')] [2023-03-11 23:45:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000037944_19427328.pth... [2023-03-11 23:45:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000037192_19042304.pth [2023-03-11 23:45:57,759][106434] Updated weights for policy 0, policy_version 38000 (0.0005) [2023-03-11 23:46:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12065.8). Total num frames: 19488768. Throughput: 0: 12654.7. Samples: 19481488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:46:00,661][106151] Avg episode reward: [(0, '4272.736')] [2023-03-11 23:46:01,003][106434] Updated weights for policy 0, policy_version 38080 (0.0004) [2023-03-11 23:46:04,193][106434] Updated weights for policy 0, policy_version 38160 (0.0004) [2023-03-11 23:46:05,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12629.3, 300 sec: 12065.8). Total num frames: 19554304. Throughput: 0: 12727.3. Samples: 19520736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:46:05,661][106151] Avg episode reward: [(0, '4005.053')] [2023-03-11 23:46:07,396][106434] Updated weights for policy 0, policy_version 38240 (0.0004) [2023-03-11 23:46:10,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12065.8). Total num frames: 19615744. Throughput: 0: 12754.4. Samples: 19595844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:46:10,662][106151] Avg episode reward: [(0, '3914.940')] [2023-03-11 23:46:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000038312_19615744.pth... [2023-03-11 23:46:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000037576_19238912.pth [2023-03-11 23:46:10,857][106434] Updated weights for policy 0, policy_version 38320 (0.0004) [2023-03-11 23:46:14,460][106434] Updated weights for policy 0, policy_version 38400 (0.0005) [2023-03-11 23:46:15,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12561.1, 300 sec: 12038.1). Total num frames: 19673088. Throughput: 0: 12561.3. Samples: 19664968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:46:15,661][106151] Avg episode reward: [(0, '2963.951')] [2023-03-11 23:46:18,022][106434] Updated weights for policy 0, policy_version 38480 (0.0005) [2023-03-11 23:46:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 12492.8, 300 sec: 12024.2). Total num frames: 19730432. Throughput: 0: 12501.8. Samples: 19699516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:46:20,661][106151] Avg episode reward: [(0, '2933.015')] [2023-03-11 23:46:21,712][106434] Updated weights for policy 0, policy_version 38560 (0.0005) [2023-03-11 23:46:25,330][106434] Updated weights for policy 0, policy_version 38640 (0.0005) [2023-03-11 23:46:25,661][106151] Fps is (10 sec: 11059.2, 60 sec: 12356.3, 300 sec: 11996.4). Total num frames: 19783680. Throughput: 0: 12281.6. Samples: 19767296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:46:25,661][106151] Avg episode reward: [(0, '3261.239')] [2023-03-11 23:46:25,675][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000038648_19787776.pth... [2023-03-11 23:46:25,678][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000037944_19427328.pth [2023-03-11 23:46:28,925][106434] Updated weights for policy 0, policy_version 38720 (0.0005) [2023-03-11 23:46:30,661][106151] Fps is (10 sec: 11059.2, 60 sec: 12219.7, 300 sec: 11996.4). Total num frames: 19841024. Throughput: 0: 12058.8. Samples: 19834876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:46:30,661][106151] Avg episode reward: [(0, '3116.896')] [2023-03-11 23:46:32,503][106434] Updated weights for policy 0, policy_version 38800 (0.0005) [2023-03-11 23:46:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 11996.4). Total num frames: 19898368. Throughput: 0: 11984.9. Samples: 19869696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:46:35,661][106151] Avg episode reward: [(0, '2569.152')] [2023-03-11 23:46:36,106][106434] Updated weights for policy 0, policy_version 38880 (0.0005) [2023-03-11 23:46:39,688][106434] Updated weights for policy 0, policy_version 38960 (0.0005) [2023-03-11 23:46:40,661][106151] Fps is (10 sec: 11468.6, 60 sec: 12014.9, 300 sec: 11982.5). Total num frames: 19955712. Throughput: 0: 11820.0. Samples: 19937716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:46:40,662][106151] Avg episode reward: [(0, '3390.040')] [2023-03-11 23:46:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000038976_19955712.pth... [2023-03-11 23:46:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000038312_19615744.pth [2023-03-11 23:46:43,273][106434] Updated weights for policy 0, policy_version 39040 (0.0005) [2023-03-11 23:46:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11996.4). Total num frames: 20013056. Throughput: 0: 11675.7. Samples: 20006896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:46:45,661][106151] Avg episode reward: [(0, '3655.414')] [2023-03-11 23:46:46,787][106434] Updated weights for policy 0, policy_version 39120 (0.0005) [2023-03-11 23:46:50,235][106434] Updated weights for policy 0, policy_version 39200 (0.0004) [2023-03-11 23:46:50,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11810.1, 300 sec: 11996.4). Total num frames: 20074496. Throughput: 0: 11579.2. Samples: 20041800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:46:50,661][106151] Avg episode reward: [(0, '3653.417')] [2023-03-11 23:46:53,814][106434] Updated weights for policy 0, policy_version 39280 (0.0005) [2023-03-11 23:46:55,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11996.4). Total num frames: 20131840. Throughput: 0: 11457.3. Samples: 20111424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:46:55,661][106151] Avg episode reward: [(0, '3201.809')] [2023-03-11 23:46:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000039320_20131840.pth... [2023-03-11 23:46:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000038648_19787776.pth [2023-03-11 23:46:57,420][106434] Updated weights for policy 0, policy_version 39360 (0.0005) [2023-03-11 23:47:00,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11605.3, 300 sec: 11982.5). Total num frames: 20185088. Throughput: 0: 11452.9. Samples: 20180348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:47:00,661][106151] Avg episode reward: [(0, '3486.908')] [2023-03-11 23:47:01,046][106434] Updated weights for policy 0, policy_version 39440 (0.0005) [2023-03-11 23:47:04,573][106434] Updated weights for policy 0, policy_version 39520 (0.0005) [2023-03-11 23:47:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11996.4). Total num frames: 20246528. Throughput: 0: 11429.2. Samples: 20213832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:47:05,661][106151] Avg episode reward: [(0, '4387.441')] [2023-03-11 23:47:08,107][106434] Updated weights for policy 0, policy_version 39600 (0.0004) [2023-03-11 23:47:10,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 11996.4). Total num frames: 20303872. Throughput: 0: 11470.2. Samples: 20283456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:47:10,662][106151] Avg episode reward: [(0, '4303.145')] [2023-03-11 23:47:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000039656_20303872.pth... [2023-03-11 23:47:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000038976_19955712.pth [2023-03-11 23:47:11,764][106434] Updated weights for policy 0, policy_version 39680 (0.0005) [2023-03-11 23:47:15,340][106434] Updated weights for policy 0, policy_version 39760 (0.0005) [2023-03-11 23:47:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11996.4). Total num frames: 20361216. Throughput: 0: 11481.5. Samples: 20351544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:47:15,661][106151] Avg episode reward: [(0, '4234.655')] [2023-03-11 23:47:18,749][106434] Updated weights for policy 0, policy_version 39840 (0.0004) [2023-03-11 23:47:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11996.4). Total num frames: 20418560. Throughput: 0: 11482.5. Samples: 20386408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:47:20,661][106151] Avg episode reward: [(0, '4077.777')] [2023-03-11 23:47:21,960][106434] Updated weights for policy 0, policy_version 39920 (0.0004) [2023-03-11 23:47:25,534][106434] Updated weights for policy 0, policy_version 40000 (0.0005) [2023-03-11 23:47:25,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11996.4). Total num frames: 20480000. Throughput: 0: 11598.7. Samples: 20459656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:47:25,661][106151] Avg episode reward: [(0, '4192.222')] [2023-03-11 23:47:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000040000_20480000.pth... [2023-03-11 23:47:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000039320_20131840.pth [2023-03-11 23:47:28,951][106434] Updated weights for policy 0, policy_version 40080 (0.0005) [2023-03-11 23:47:30,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 11996.4). Total num frames: 20537344. Throughput: 0: 11647.8. Samples: 20531048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:47:30,662][106151] Avg episode reward: [(0, '4087.056')] [2023-03-11 23:47:32,442][106434] Updated weights for policy 0, policy_version 40160 (0.0005) [2023-03-11 23:47:35,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 12024.2). Total num frames: 20598784. Throughput: 0: 11653.7. Samples: 20566216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:47:35,661][106151] Avg episode reward: [(0, '4055.854')] [2023-03-11 23:47:35,907][106434] Updated weights for policy 0, policy_version 40240 (0.0004) [2023-03-11 23:47:39,147][106434] Updated weights for policy 0, policy_version 40320 (0.0004) [2023-03-11 23:47:40,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11741.9, 300 sec: 12038.1). Total num frames: 20660224. Throughput: 0: 11741.9. Samples: 20639808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:47:40,661][106151] Avg episode reward: [(0, '3932.871')] [2023-03-11 23:47:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000040352_20660224.pth... [2023-03-11 23:47:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000039656_20303872.pth [2023-03-11 23:47:42,354][106434] Updated weights for policy 0, policy_version 40400 (0.0004) [2023-03-11 23:47:45,470][106434] Updated weights for policy 0, policy_version 40480 (0.0003) [2023-03-11 23:47:45,661][106151] Fps is (10 sec: 12697.5, 60 sec: 11878.4, 300 sec: 12065.8). Total num frames: 20725760. Throughput: 0: 11932.2. Samples: 20717296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:47:45,661][106151] Avg episode reward: [(0, '2978.431')] [2023-03-11 23:47:48,682][106434] Updated weights for policy 0, policy_version 40560 (0.0004) [2023-03-11 23:47:50,667][106151] Fps is (10 sec: 13099.8, 60 sec: 11945.5, 300 sec: 12093.4). Total num frames: 20791296. Throughput: 0: 12040.6. Samples: 20755728. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:47:50,667][106151] Avg episode reward: [(0, '3317.248')] [2023-03-11 23:47:52,076][106434] Updated weights for policy 0, policy_version 40640 (0.0005) [2023-03-11 23:47:55,485][106434] Updated weights for policy 0, policy_version 40720 (0.0004) [2023-03-11 23:47:55,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 12093.6). Total num frames: 20848640. Throughput: 0: 12106.1. Samples: 20828232. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:47:55,662][106151] Avg episode reward: [(0, '3827.574')] [2023-03-11 23:47:55,666][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000040720_20848640.pth... [2023-03-11 23:47:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000040000_20480000.pth [2023-03-11 23:47:58,712][106434] Updated weights for policy 0, policy_version 40800 (0.0004) [2023-03-11 23:48:00,661][106151] Fps is (10 sec: 12295.0, 60 sec: 12151.5, 300 sec: 12121.4). Total num frames: 20914176. Throughput: 0: 12279.3. Samples: 20904112. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:48:00,661][106151] Avg episode reward: [(0, '3809.966')] [2023-03-11 23:48:01,929][106434] Updated weights for policy 0, policy_version 40880 (0.0004) [2023-03-11 23:48:05,118][106434] Updated weights for policy 0, policy_version 40960 (0.0004) [2023-03-11 23:48:05,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12151.5, 300 sec: 12135.3). Total num frames: 20975616. Throughput: 0: 12358.9. Samples: 20942560. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:48:05,661][106151] Avg episode reward: [(0, '4332.335')] [2023-03-11 23:48:08,307][106434] Updated weights for policy 0, policy_version 41040 (0.0004) [2023-03-11 23:48:10,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 12163.0). Total num frames: 21041152. Throughput: 0: 12438.4. Samples: 21019384. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:48:10,661][106151] Avg episode reward: [(0, '4411.217')] [2023-03-11 23:48:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000041096_21041152.pth... [2023-03-11 23:48:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000040352_20660224.pth [2023-03-11 23:48:11,429][106434] Updated weights for policy 0, policy_version 41120 (0.0003) [2023-03-11 23:48:14,645][106434] Updated weights for policy 0, policy_version 41200 (0.0004) [2023-03-11 23:48:15,661][106151] Fps is (10 sec: 13107.3, 60 sec: 12424.5, 300 sec: 12190.8). Total num frames: 21106688. Throughput: 0: 12566.9. Samples: 21096556. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:48:15,661][106151] Avg episode reward: [(0, '4168.186')] [2023-03-11 23:48:17,893][106434] Updated weights for policy 0, policy_version 41280 (0.0004) [2023-03-11 23:48:20,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12424.6, 300 sec: 12190.8). Total num frames: 21164032. Throughput: 0: 12639.9. Samples: 21135012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:48:20,661][106151] Avg episode reward: [(0, '4019.065')] [2023-03-11 23:48:21,392][106434] Updated weights for policy 0, policy_version 41360 (0.0005) [2023-03-11 23:48:24,921][106434] Updated weights for policy 0, policy_version 41440 (0.0005) [2023-03-11 23:48:25,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12424.5, 300 sec: 12190.8). Total num frames: 21225472. Throughput: 0: 12559.9. Samples: 21205004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:48:25,661][106151] Avg episode reward: [(0, '3938.402')] [2023-03-11 23:48:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000041456_21225472.pth... [2023-03-11 23:48:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000040720_20848640.pth [2023-03-11 23:48:28,432][106434] Updated weights for policy 0, policy_version 41520 (0.0004) [2023-03-11 23:48:30,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12424.6, 300 sec: 12176.9). Total num frames: 21282816. Throughput: 0: 12385.1. Samples: 21274624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:48:30,661][106151] Avg episode reward: [(0, '3890.336')] [2023-03-11 23:48:31,953][106434] Updated weights for policy 0, policy_version 41600 (0.0003) [2023-03-11 23:48:35,431][106434] Updated weights for policy 0, policy_version 41680 (0.0003) [2023-03-11 23:48:35,661][106151] Fps is (10 sec: 11468.9, 60 sec: 12356.3, 300 sec: 12163.0). Total num frames: 21340160. Throughput: 0: 12315.5. Samples: 21309856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:48:35,661][106151] Avg episode reward: [(0, '3805.815')] [2023-03-11 23:48:38,855][106434] Updated weights for policy 0, policy_version 41760 (0.0004) [2023-03-11 23:48:40,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 12149.2). Total num frames: 21401600. Throughput: 0: 12279.8. Samples: 21380820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:48:40,661][106151] Avg episode reward: [(0, '4166.889')] [2023-03-11 23:48:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000041800_21401600.pth... [2023-03-11 23:48:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000041096_21041152.pth [2023-03-11 23:48:42,144][106434] Updated weights for policy 0, policy_version 41840 (0.0004) [2023-03-11 23:48:45,399][106434] Updated weights for policy 0, policy_version 41920 (0.0004) [2023-03-11 23:48:45,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12149.2). Total num frames: 21463040. Throughput: 0: 12255.0. Samples: 21455588. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 23:48:45,661][106151] Avg episode reward: [(0, '4212.631')] [2023-03-11 23:48:48,590][106434] Updated weights for policy 0, policy_version 42000 (0.0004) [2023-03-11 23:48:50,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12289.2, 300 sec: 12149.2). Total num frames: 21528576. Throughput: 0: 12251.5. Samples: 21493876. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 23:48:50,661][106151] Avg episode reward: [(0, '4240.789')] [2023-03-11 23:48:51,793][106434] Updated weights for policy 0, policy_version 42080 (0.0004) [2023-03-11 23:48:55,041][106434] Updated weights for policy 0, policy_version 42160 (0.0004) [2023-03-11 23:48:55,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12356.3, 300 sec: 12135.3). Total num frames: 21590016. Throughput: 0: 12256.2. Samples: 21570912. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 23:48:55,661][106151] Avg episode reward: [(0, '4230.466')] [2023-03-11 23:48:55,705][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000042176_21594112.pth... [2023-03-11 23:48:55,706][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000041456_21225472.pth [2023-03-11 23:48:58,480][106434] Updated weights for policy 0, policy_version 42240 (0.0005) [2023-03-11 23:49:00,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 12121.4). Total num frames: 21651456. Throughput: 0: 12150.5. Samples: 21643328. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 23:49:00,661][106151] Avg episode reward: [(0, '3969.952')] [2023-03-11 23:49:01,863][106434] Updated weights for policy 0, policy_version 42320 (0.0005) [2023-03-11 23:49:05,416][106434] Updated weights for policy 0, policy_version 42400 (0.0005) [2023-03-11 23:49:05,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12107.5). Total num frames: 21708800. Throughput: 0: 12094.7. Samples: 21679276. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 23:49:05,661][106151] Avg episode reward: [(0, '3626.846')] [2023-03-11 23:49:08,921][106434] Updated weights for policy 0, policy_version 42480 (0.0005) [2023-03-11 23:49:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 12079.7). Total num frames: 21766144. Throughput: 0: 12097.8. Samples: 21749404. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:49:10,661][106151] Avg episode reward: [(0, '3330.047')] [2023-03-11 23:49:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000042512_21766144.pth... [2023-03-11 23:49:10,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000041800_21401600.pth [2023-03-11 23:49:12,545][106434] Updated weights for policy 0, policy_version 42560 (0.0005) [2023-03-11 23:49:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 12079.7). Total num frames: 21823488. Throughput: 0: 12042.9. Samples: 21816556. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:49:15,661][106151] Avg episode reward: [(0, '3881.808')] [2023-03-11 23:49:16,152][106434] Updated weights for policy 0, policy_version 42640 (0.0005) [2023-03-11 23:49:19,577][106434] Updated weights for policy 0, policy_version 42720 (0.0005) [2023-03-11 23:49:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11946.6, 300 sec: 12079.7). Total num frames: 21880832. Throughput: 0: 12051.2. Samples: 21852160. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:49:20,661][106151] Avg episode reward: [(0, '3638.763')] [2023-03-11 23:49:23,188][106434] Updated weights for policy 0, policy_version 42800 (0.0005) [2023-03-11 23:49:25,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12079.7). Total num frames: 21942272. Throughput: 0: 12006.7. Samples: 21921120. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:49:25,661][106151] Avg episode reward: [(0, '4164.644')] [2023-03-11 23:49:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000042856_21942272.pth... [2023-03-11 23:49:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000042176_21594112.pth [2023-03-11 23:49:26,719][106434] Updated weights for policy 0, policy_version 42880 (0.0005) [2023-03-11 23:49:30,118][106434] Updated weights for policy 0, policy_version 42960 (0.0005) [2023-03-11 23:49:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12079.7). Total num frames: 21999616. Throughput: 0: 11908.9. Samples: 21991488. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:49:30,672][106151] Avg episode reward: [(0, '3933.578')] [2023-03-11 23:49:33,631][106434] Updated weights for policy 0, policy_version 43040 (0.0004) [2023-03-11 23:49:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 12065.8). Total num frames: 22056960. Throughput: 0: 11865.0. Samples: 22027800. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:49:35,672][106151] Avg episode reward: [(0, '4022.748')] [2023-03-11 23:49:37,097][106434] Updated weights for policy 0, policy_version 43120 (0.0005) [2023-03-11 23:49:40,428][106434] Updated weights for policy 0, policy_version 43200 (0.0004) [2023-03-11 23:49:40,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12065.8). Total num frames: 22118400. Throughput: 0: 11712.9. Samples: 22097992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:49:40,661][106151] Avg episode reward: [(0, '3987.558')] [2023-03-11 23:49:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000043200_22118400.pth... [2023-03-11 23:49:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000042512_21766144.pth [2023-03-11 23:49:43,710][106434] Updated weights for policy 0, policy_version 43280 (0.0004) [2023-03-11 23:49:45,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 12093.6). Total num frames: 22183936. Throughput: 0: 11779.9. Samples: 22173424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:49:45,672][106151] Avg episode reward: [(0, '3540.249')] [2023-03-11 23:49:46,889][106434] Updated weights for policy 0, policy_version 43360 (0.0003) [2023-03-11 23:49:50,220][106434] Updated weights for policy 0, policy_version 43440 (0.0004) [2023-03-11 23:49:50,661][106151] Fps is (10 sec: 12697.7, 60 sec: 11946.7, 300 sec: 12107.5). Total num frames: 22245376. Throughput: 0: 11835.3. Samples: 22211864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:49:50,672][106151] Avg episode reward: [(0, '3301.350')] [2023-03-11 23:49:53,792][106434] Updated weights for policy 0, policy_version 43520 (0.0005) [2023-03-11 23:49:55,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 12093.6). Total num frames: 22302720. Throughput: 0: 11842.4. Samples: 22282312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:49:55,661][106151] Avg episode reward: [(0, '3926.898')] [2023-03-11 23:49:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000043560_22302720.pth... [2023-03-11 23:49:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000042856_21942272.pth [2023-03-11 23:49:57,278][106434] Updated weights for policy 0, policy_version 43600 (0.0005) [2023-03-11 23:50:00,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 12079.7). Total num frames: 22360064. Throughput: 0: 11897.5. Samples: 22351944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:50:00,661][106151] Avg episode reward: [(0, '3714.505')] [2023-03-11 23:50:00,885][106434] Updated weights for policy 0, policy_version 43680 (0.0005) [2023-03-11 23:50:04,380][106434] Updated weights for policy 0, policy_version 43760 (0.0005) [2023-03-11 23:50:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 12065.8). Total num frames: 22417408. Throughput: 0: 11897.0. Samples: 22387524. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:50:05,672][106151] Avg episode reward: [(0, '3545.016')] [2023-03-11 23:50:08,056][106434] Updated weights for policy 0, policy_version 43840 (0.0005) [2023-03-11 23:50:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 12052.0). Total num frames: 22474752. Throughput: 0: 11858.0. Samples: 22454728. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:50:10,662][106151] Avg episode reward: [(0, '3794.125')] [2023-03-11 23:50:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000043896_22474752.pth... [2023-03-11 23:50:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000043200_22118400.pth [2023-03-11 23:50:11,595][106434] Updated weights for policy 0, policy_version 43920 (0.0005) [2023-03-11 23:50:15,108][106434] Updated weights for policy 0, policy_version 44000 (0.0005) [2023-03-11 23:50:15,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 12038.1). Total num frames: 22532096. Throughput: 0: 11842.1. Samples: 22524384. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:50:15,672][106151] Avg episode reward: [(0, '4101.764')] [2023-03-11 23:50:18,615][106434] Updated weights for policy 0, policy_version 44080 (0.0005) [2023-03-11 23:50:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 12024.2). Total num frames: 22589440. Throughput: 0: 11843.7. Samples: 22560768. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:50:20,672][106151] Avg episode reward: [(0, '4127.316')] [2023-03-11 23:50:22,165][106434] Updated weights for policy 0, policy_version 44160 (0.0005) [2023-03-11 23:50:25,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11996.4). Total num frames: 22646784. Throughput: 0: 11806.9. Samples: 22629304. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:50:25,661][106151] Avg episode reward: [(0, '4248.620')] [2023-03-11 23:50:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000044232_22646784.pth... [2023-03-11 23:50:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000043560_22302720.pth [2023-03-11 23:50:25,740][106434] Updated weights for policy 0, policy_version 44240 (0.0005) [2023-03-11 23:50:29,375][106434] Updated weights for policy 0, policy_version 44320 (0.0005) [2023-03-11 23:50:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11968.7). Total num frames: 22704128. Throughput: 0: 11626.1. Samples: 22696600. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:50:30,661][106151] Avg episode reward: [(0, '3429.334')] [2023-03-11 23:50:33,046][106434] Updated weights for policy 0, policy_version 44400 (0.0005) [2023-03-11 23:50:35,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 11954.8). Total num frames: 22761472. Throughput: 0: 11527.8. Samples: 22730616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:50:35,661][106151] Avg episode reward: [(0, '3978.964')] [2023-03-11 23:50:36,640][106434] Updated weights for policy 0, policy_version 44480 (0.0005) [2023-03-11 23:50:40,187][106434] Updated weights for policy 0, policy_version 44560 (0.0005) [2023-03-11 23:50:40,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 11927.0). Total num frames: 22818816. Throughput: 0: 11477.6. Samples: 22798804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:50:40,662][106151] Avg episode reward: [(0, '3194.041')] [2023-03-11 23:50:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000044568_22818816.pth... [2023-03-11 23:50:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000043896_22474752.pth [2023-03-11 23:50:43,695][106434] Updated weights for policy 0, policy_version 44640 (0.0005) [2023-03-11 23:50:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11899.2). Total num frames: 22876160. Throughput: 0: 11473.9. Samples: 22868268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:50:45,662][106151] Avg episode reward: [(0, '3459.363')] [2023-03-11 23:50:47,108][106434] Updated weights for policy 0, policy_version 44720 (0.0004) [2023-03-11 23:50:50,360][106434] Updated weights for policy 0, policy_version 44800 (0.0004) [2023-03-11 23:50:50,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11537.1, 300 sec: 11899.2). Total num frames: 22937600. Throughput: 0: 11511.1. Samples: 22905524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:50:50,661][106151] Avg episode reward: [(0, '3535.481')] [2023-03-11 23:50:53,684][106434] Updated weights for policy 0, policy_version 44880 (0.0004) [2023-03-11 23:50:55,661][106151] Fps is (10 sec: 12697.5, 60 sec: 11673.6, 300 sec: 11913.1). Total num frames: 23003136. Throughput: 0: 11674.3. Samples: 22980072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:50:55,662][106151] Avg episode reward: [(0, '3440.622')] [2023-03-11 23:50:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000044928_23003136.pth... [2023-03-11 23:50:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000044232_22646784.pth [2023-03-11 23:50:56,993][106434] Updated weights for policy 0, policy_version 44960 (0.0004) [2023-03-11 23:51:00,213][106434] Updated weights for policy 0, policy_version 45040 (0.0004) [2023-03-11 23:51:00,661][106151] Fps is (10 sec: 12697.5, 60 sec: 11741.9, 300 sec: 11899.2). Total num frames: 23064576. Throughput: 0: 11808.0. Samples: 23055744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:51:00,662][106151] Avg episode reward: [(0, '3786.935')] [2023-03-11 23:51:03,552][106434] Updated weights for policy 0, policy_version 45120 (0.0004) [2023-03-11 23:51:05,661][106151] Fps is (10 sec: 11878.6, 60 sec: 11741.9, 300 sec: 11885.3). Total num frames: 23121920. Throughput: 0: 11833.1. Samples: 23093256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:51:05,661][106151] Avg episode reward: [(0, '4037.819')] [2023-03-11 23:51:07,171][106434] Updated weights for policy 0, policy_version 45200 (0.0005) [2023-03-11 23:51:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11885.3). Total num frames: 23179264. Throughput: 0: 11848.0. Samples: 23162464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:51:10,661][106151] Avg episode reward: [(0, '4238.027')] [2023-03-11 23:51:10,691][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000045280_23183360.pth... [2023-03-11 23:51:10,691][106434] Updated weights for policy 0, policy_version 45280 (0.0005) [2023-03-11 23:51:10,693][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000044568_22818816.pth [2023-03-11 23:51:14,359][106434] Updated weights for policy 0, policy_version 45360 (0.0005) [2023-03-11 23:51:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11885.3). Total num frames: 23236608. Throughput: 0: 11840.1. Samples: 23229404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:51:15,661][106151] Avg episode reward: [(0, '4220.867')] [2023-03-11 23:51:17,914][106434] Updated weights for policy 0, policy_version 45440 (0.0005) [2023-03-11 23:51:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11899.2). Total num frames: 23293952. Throughput: 0: 11872.7. Samples: 23264888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:51:20,661][106151] Avg episode reward: [(0, '3325.800')] [2023-03-11 23:51:21,477][106434] Updated weights for policy 0, policy_version 45520 (0.0005) [2023-03-11 23:51:24,985][106434] Updated weights for policy 0, policy_version 45600 (0.0005) [2023-03-11 23:51:25,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11741.9, 300 sec: 11899.2). Total num frames: 23351296. Throughput: 0: 11892.1. Samples: 23333948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:51:25,662][106151] Avg episode reward: [(0, '3692.845')] [2023-03-11 23:51:25,709][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000045616_23355392.pth... [2023-03-11 23:51:25,710][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000044928_23003136.pth [2023-03-11 23:51:28,549][106434] Updated weights for policy 0, policy_version 45680 (0.0005) [2023-03-11 23:51:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11913.1). Total num frames: 23412736. Throughput: 0: 11895.0. Samples: 23403544. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:51:30,661][106151] Avg episode reward: [(0, '4117.520')] [2023-03-11 23:51:32,057][106434] Updated weights for policy 0, policy_version 45760 (0.0004) [2023-03-11 23:51:35,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 11899.2). Total num frames: 23465984. Throughput: 0: 11820.1. Samples: 23437428. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:51:35,661][106151] Avg episode reward: [(0, '4272.630')] [2023-03-11 23:51:35,679][106434] Updated weights for policy 0, policy_version 45840 (0.0005) [2023-03-11 23:51:39,319][106434] Updated weights for policy 0, policy_version 45920 (0.0005) [2023-03-11 23:51:40,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11741.9, 300 sec: 11899.2). Total num frames: 23523328. Throughput: 0: 11691.0. Samples: 23506164. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:51:40,661][106151] Avg episode reward: [(0, '4454.688')] [2023-03-11 23:51:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000045944_23523328.pth... [2023-03-11 23:51:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000045280_23183360.pth [2023-03-11 23:51:42,836][106434] Updated weights for policy 0, policy_version 46000 (0.0005) [2023-03-11 23:51:45,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11899.2). Total num frames: 23584768. Throughput: 0: 11556.5. Samples: 23575788. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:51:45,661][106151] Avg episode reward: [(0, '4041.296')] [2023-03-11 23:51:46,339][106434] Updated weights for policy 0, policy_version 46080 (0.0005) [2023-03-11 23:51:49,905][106434] Updated weights for policy 0, policy_version 46160 (0.0005) [2023-03-11 23:51:50,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11899.2). Total num frames: 23642112. Throughput: 0: 11479.8. Samples: 23609848. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:51:50,661][106151] Avg episode reward: [(0, '4082.326')] [2023-03-11 23:51:53,480][106434] Updated weights for policy 0, policy_version 46240 (0.0005) [2023-03-11 23:51:55,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.4, 300 sec: 11913.1). Total num frames: 23699456. Throughput: 0: 11479.5. Samples: 23679040. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 23:51:55,661][106151] Avg episode reward: [(0, '4253.532')] [2023-03-11 23:51:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000046288_23699456.pth... [2023-03-11 23:51:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000045616_23355392.pth [2023-03-11 23:51:57,123][106434] Updated weights for policy 0, policy_version 46320 (0.0005) [2023-03-11 23:52:00,661][106151] Fps is (10 sec: 11059.3, 60 sec: 11468.8, 300 sec: 11885.3). Total num frames: 23752704. Throughput: 0: 11498.8. Samples: 23746848. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:52:00,661][106151] Avg episode reward: [(0, '4052.337')] [2023-03-11 23:52:00,725][106434] Updated weights for policy 0, policy_version 46400 (0.0005) [2023-03-11 23:52:04,213][106434] Updated weights for policy 0, policy_version 46480 (0.0005) [2023-03-11 23:52:05,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11899.2). Total num frames: 23814144. Throughput: 0: 11478.9. Samples: 23781440. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:52:05,661][106151] Avg episode reward: [(0, '4140.284')] [2023-03-11 23:52:07,700][106434] Updated weights for policy 0, policy_version 46560 (0.0005) [2023-03-11 23:52:10,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11537.1, 300 sec: 11899.2). Total num frames: 23871488. Throughput: 0: 11502.5. Samples: 23851560. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:52:10,661][106151] Avg episode reward: [(0, '4055.413')] [2023-03-11 23:52:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000046624_23871488.pth... [2023-03-11 23:52:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000045944_23523328.pth [2023-03-11 23:52:11,262][106434] Updated weights for policy 0, policy_version 46640 (0.0005) [2023-03-11 23:52:14,610][106434] Updated weights for policy 0, policy_version 46720 (0.0004) [2023-03-11 23:52:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11913.1). Total num frames: 23932928. Throughput: 0: 11555.0. Samples: 23923520. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:52:15,661][106151] Avg episode reward: [(0, '4301.377')] [2023-03-11 23:52:17,836][106434] Updated weights for policy 0, policy_version 46800 (0.0003) [2023-03-11 23:52:20,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 11913.1). Total num frames: 23994368. Throughput: 0: 11647.9. Samples: 23961584. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:52:20,661][106151] Avg episode reward: [(0, '3500.598')] [2023-03-11 23:52:21,152][106434] Updated weights for policy 0, policy_version 46880 (0.0004) [2023-03-11 23:52:24,483][106434] Updated weights for policy 0, policy_version 46960 (0.0004) [2023-03-11 23:52:25,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11741.9, 300 sec: 11927.0). Total num frames: 24055808. Throughput: 0: 11760.6. Samples: 24035392. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 23:52:25,661][106151] Avg episode reward: [(0, '3768.234')] [2023-03-11 23:52:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000046984_24055808.pth... [2023-03-11 23:52:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000046288_23699456.pth [2023-03-11 23:52:27,949][106434] Updated weights for policy 0, policy_version 47040 (0.0005) [2023-03-11 23:52:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11913.1). Total num frames: 24113152. Throughput: 0: 11762.0. Samples: 24105076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:52:30,661][106151] Avg episode reward: [(0, '3994.411')] [2023-03-11 23:52:31,500][106434] Updated weights for policy 0, policy_version 47120 (0.0005) [2023-03-11 23:52:35,027][106434] Updated weights for policy 0, policy_version 47200 (0.0005) [2023-03-11 23:52:35,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 11899.2). Total num frames: 24170496. Throughput: 0: 11815.7. Samples: 24141552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:52:35,661][106151] Avg episode reward: [(0, '4054.415')] [2023-03-11 23:52:38,535][106434] Updated weights for policy 0, policy_version 47280 (0.0005) [2023-03-11 23:52:40,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11885.3). Total num frames: 24231936. Throughput: 0: 11827.2. Samples: 24211264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:52:40,661][106151] Avg episode reward: [(0, '3976.116')] [2023-03-11 23:52:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000047328_24231936.pth... [2023-03-11 23:52:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000046624_23871488.pth [2023-03-11 23:52:41,800][106434] Updated weights for policy 0, policy_version 47360 (0.0004) [2023-03-11 23:52:45,063][106434] Updated weights for policy 0, policy_version 47440 (0.0003) [2023-03-11 23:52:45,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 11871.7). Total num frames: 24293376. Throughput: 0: 11985.4. Samples: 24286192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:52:45,661][106151] Avg episode reward: [(0, '4276.568')] [2023-03-11 23:52:48,310][106434] Updated weights for policy 0, policy_version 47520 (0.0003) [2023-03-11 23:52:50,661][106151] Fps is (10 sec: 12697.7, 60 sec: 11946.7, 300 sec: 11899.2). Total num frames: 24358912. Throughput: 0: 12053.9. Samples: 24323864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:52:50,661][106151] Avg episode reward: [(0, '3548.546')] [2023-03-11 23:52:51,547][106434] Updated weights for policy 0, policy_version 47600 (0.0004) [2023-03-11 23:52:54,828][106434] Updated weights for policy 0, policy_version 47680 (0.0004) [2023-03-11 23:52:55,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11885.3). Total num frames: 24420352. Throughput: 0: 12186.1. Samples: 24399936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:52:55,661][106151] Avg episode reward: [(0, '4005.558')] [2023-03-11 23:52:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000047696_24420352.pth... [2023-03-11 23:52:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000046984_24055808.pth [2023-03-11 23:52:58,096][106434] Updated weights for policy 0, policy_version 47760 (0.0004) [2023-03-11 23:53:00,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 11885.3). Total num frames: 24481792. Throughput: 0: 12261.0. Samples: 24475264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:53:00,661][106151] Avg episode reward: [(0, '4126.922')] [2023-03-11 23:53:01,388][106434] Updated weights for policy 0, policy_version 47840 (0.0004) [2023-03-11 23:53:04,716][106434] Updated weights for policy 0, policy_version 47920 (0.0005) [2023-03-11 23:53:05,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 11871.5). Total num frames: 24543232. Throughput: 0: 12218.2. Samples: 24511404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:53:05,661][106151] Avg episode reward: [(0, '4038.027')] [2023-03-11 23:53:07,999][106434] Updated weights for policy 0, policy_version 48000 (0.0005) [2023-03-11 23:53:10,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12288.0, 300 sec: 11871.5). Total num frames: 24608768. Throughput: 0: 12245.1. Samples: 24586420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:53:10,661][106151] Avg episode reward: [(0, '4091.936')] [2023-03-11 23:53:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000048064_24608768.pth... [2023-03-11 23:53:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000047328_24231936.pth [2023-03-11 23:53:11,258][106434] Updated weights for policy 0, policy_version 48080 (0.0004) [2023-03-11 23:53:14,595][106434] Updated weights for policy 0, policy_version 48160 (0.0005) [2023-03-11 23:53:15,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12288.0, 300 sec: 11885.3). Total num frames: 24670208. Throughput: 0: 12349.5. Samples: 24660804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:53:15,661][106151] Avg episode reward: [(0, '3858.137')] [2023-03-11 23:53:17,918][106434] Updated weights for policy 0, policy_version 48240 (0.0005) [2023-03-11 23:53:20,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 11885.3). Total num frames: 24731648. Throughput: 0: 12364.8. Samples: 24697968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:53:20,661][106151] Avg episode reward: [(0, '3832.105')] [2023-03-11 23:53:21,220][106434] Updated weights for policy 0, policy_version 48320 (0.0004) [2023-03-11 23:53:24,503][106434] Updated weights for policy 0, policy_version 48400 (0.0005) [2023-03-11 23:53:25,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 11899.2). Total num frames: 24793088. Throughput: 0: 12474.2. Samples: 24772604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:53:25,662][106151] Avg episode reward: [(0, '4160.771')] [2023-03-11 23:53:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000048424_24793088.pth... [2023-03-11 23:53:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000047696_24420352.pth [2023-03-11 23:53:27,800][106434] Updated weights for policy 0, policy_version 48480 (0.0005) [2023-03-11 23:53:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 11913.1). Total num frames: 24854528. Throughput: 0: 12453.4. Samples: 24846596. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 23:53:30,661][106151] Avg episode reward: [(0, '4127.019')] [2023-03-11 23:53:31,059][106434] Updated weights for policy 0, policy_version 48560 (0.0005) [2023-03-11 23:53:34,356][106434] Updated weights for policy 0, policy_version 48640 (0.0004) [2023-03-11 23:53:35,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12492.8, 300 sec: 11927.0). Total num frames: 24920064. Throughput: 0: 12449.9. Samples: 24884108. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 23:53:35,661][106151] Avg episode reward: [(0, '3769.336')] [2023-03-11 23:53:37,586][106434] Updated weights for policy 0, policy_version 48720 (0.0004) [2023-03-11 23:53:40,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 11927.0). Total num frames: 24981504. Throughput: 0: 12440.7. Samples: 24959768. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 23:53:40,662][106151] Avg episode reward: [(0, '3951.107')] [2023-03-11 23:53:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000048792_24981504.pth... [2023-03-11 23:53:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000048064_24608768.pth [2023-03-11 23:53:40,851][106434] Updated weights for policy 0, policy_version 48800 (0.0004) [2023-03-11 23:53:44,117][106434] Updated weights for policy 0, policy_version 48880 (0.0004) [2023-03-11 23:53:45,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 11913.1). Total num frames: 25042944. Throughput: 0: 12434.7. Samples: 25034824. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 23:53:45,662][106151] Avg episode reward: [(0, '3430.024')] [2023-03-11 23:53:47,370][106434] Updated weights for policy 0, policy_version 48960 (0.0004) [2023-03-11 23:53:50,645][106434] Updated weights for policy 0, policy_version 49040 (0.0005) [2023-03-11 23:53:50,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 11927.0). Total num frames: 25108480. Throughput: 0: 12478.3. Samples: 25072928. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 23:53:50,661][106151] Avg episode reward: [(0, '3663.197')] [2023-03-11 23:53:53,917][106434] Updated weights for policy 0, policy_version 49120 (0.0005) [2023-03-11 23:53:55,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12492.8, 300 sec: 11927.0). Total num frames: 25169920. Throughput: 0: 12492.4. Samples: 25148580. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 23:53:55,662][106151] Avg episode reward: [(0, '3542.207')] [2023-03-11 23:53:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000049160_25169920.pth... [2023-03-11 23:53:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000048424_24793088.pth [2023-03-11 23:53:57,187][106434] Updated weights for policy 0, policy_version 49200 (0.0004) [2023-03-11 23:54:00,503][106434] Updated weights for policy 0, policy_version 49280 (0.0004) [2023-03-11 23:54:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 11940.9). Total num frames: 25231360. Throughput: 0: 12498.4. Samples: 25223232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:54:00,661][106151] Avg episode reward: [(0, '3591.484')] [2023-03-11 23:54:03,813][106434] Updated weights for policy 0, policy_version 49360 (0.0004) [2023-03-11 23:54:05,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12492.8, 300 sec: 11954.8). Total num frames: 25292800. Throughput: 0: 12491.7. Samples: 25260096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:54:05,662][106151] Avg episode reward: [(0, '3448.264')] [2023-03-11 23:54:07,102][106434] Updated weights for policy 0, policy_version 49440 (0.0004) [2023-03-11 23:54:10,393][106434] Updated weights for policy 0, policy_version 49520 (0.0004) [2023-03-11 23:54:10,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 11968.6). Total num frames: 25354240. Throughput: 0: 12476.6. Samples: 25334052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:54:10,662][106151] Avg episode reward: [(0, '4137.197')] [2023-03-11 23:54:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000049520_25354240.pth... [2023-03-11 23:54:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000048792_24981504.pth [2023-03-11 23:54:13,664][106434] Updated weights for policy 0, policy_version 49600 (0.0004) [2023-03-11 23:54:15,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 11996.4). Total num frames: 25419776. Throughput: 0: 12520.1. Samples: 25410000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:54:15,661][106151] Avg episode reward: [(0, '3936.325')] [2023-03-11 23:54:16,916][106434] Updated weights for policy 0, policy_version 49680 (0.0004) [2023-03-11 23:54:20,185][106434] Updated weights for policy 0, policy_version 49760 (0.0004) [2023-03-11 23:54:20,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 11996.4). Total num frames: 25481216. Throughput: 0: 12528.6. Samples: 25447896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:54:20,662][106151] Avg episode reward: [(0, '4358.454')] [2023-03-11 23:54:23,457][106434] Updated weights for policy 0, policy_version 49840 (0.0004) [2023-03-11 23:54:25,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12492.8, 300 sec: 12010.3). Total num frames: 25542656. Throughput: 0: 12499.6. Samples: 25522252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:54:25,662][106151] Avg episode reward: [(0, '3930.123')] [2023-03-11 23:54:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000049888_25542656.pth... [2023-03-11 23:54:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000049160_25169920.pth [2023-03-11 23:54:26,791][106434] Updated weights for policy 0, policy_version 49920 (0.0004) [2023-03-11 23:54:30,047][106434] Updated weights for policy 0, policy_version 50000 (0.0005) [2023-03-11 23:54:30,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12492.8, 300 sec: 12024.2). Total num frames: 25604096. Throughput: 0: 12491.6. Samples: 25596944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:54:30,661][106151] Avg episode reward: [(0, '3619.999')] [2023-03-11 23:54:33,364][106434] Updated weights for policy 0, policy_version 50080 (0.0004) [2023-03-11 23:54:35,661][106151] Fps is (10 sec: 12288.2, 60 sec: 12424.5, 300 sec: 12024.2). Total num frames: 25665536. Throughput: 0: 12483.2. Samples: 25634672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:54:35,661][106151] Avg episode reward: [(0, '4006.050')] [2023-03-11 23:54:36,642][106434] Updated weights for policy 0, policy_version 50160 (0.0004) [2023-03-11 23:54:40,014][106434] Updated weights for policy 0, policy_version 50240 (0.0004) [2023-03-11 23:54:40,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12492.8, 300 sec: 12024.2). Total num frames: 25731072. Throughput: 0: 12445.8. Samples: 25708640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:54:40,661][106151] Avg episode reward: [(0, '3765.428')] [2023-03-11 23:54:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000050256_25731072.pth... [2023-03-11 23:54:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000049520_25354240.pth [2023-03-11 23:54:43,295][106434] Updated weights for policy 0, policy_version 50320 (0.0004) [2023-03-11 23:54:45,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 12010.3). Total num frames: 25788416. Throughput: 0: 12432.5. Samples: 25782696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:54:45,661][106151] Avg episode reward: [(0, '4335.736')] [2023-03-11 23:54:46,665][106434] Updated weights for policy 0, policy_version 50400 (0.0005) [2023-03-11 23:54:49,968][106434] Updated weights for policy 0, policy_version 50480 (0.0004) [2023-03-11 23:54:50,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12424.5, 300 sec: 12038.1). Total num frames: 25853952. Throughput: 0: 12429.7. Samples: 25819432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:54:50,661][106151] Avg episode reward: [(0, '4256.085')] [2023-03-11 23:54:53,284][106434] Updated weights for policy 0, policy_version 50560 (0.0004) [2023-03-11 23:54:55,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12424.5, 300 sec: 12052.0). Total num frames: 25915392. Throughput: 0: 12433.2. Samples: 25893544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:54:55,662][106151] Avg episode reward: [(0, '3975.127')] [2023-03-11 23:54:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000050616_25915392.pth... [2023-03-11 23:54:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000049888_25542656.pth [2023-03-11 23:54:56,647][106434] Updated weights for policy 0, policy_version 50640 (0.0005) [2023-03-11 23:54:59,943][106434] Updated weights for policy 0, policy_version 50720 (0.0004) [2023-03-11 23:55:00,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 12065.8). Total num frames: 25976832. Throughput: 0: 12381.7. Samples: 25967176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:55:00,662][106151] Avg episode reward: [(0, '3897.912')] [2023-03-11 23:55:03,297][106434] Updated weights for policy 0, policy_version 50800 (0.0005) [2023-03-11 23:55:05,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 12079.7). Total num frames: 26038272. Throughput: 0: 12352.5. Samples: 26003760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:55:05,662][106151] Avg episode reward: [(0, '3345.315')] [2023-03-11 23:55:06,648][106434] Updated weights for policy 0, policy_version 50880 (0.0005) [2023-03-11 23:55:09,983][106434] Updated weights for policy 0, policy_version 50960 (0.0005) [2023-03-11 23:55:10,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12093.6). Total num frames: 26099712. Throughput: 0: 12318.8. Samples: 26076596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:55:10,662][106151] Avg episode reward: [(0, '4216.737')] [2023-03-11 23:55:10,666][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000050976_26099712.pth... [2023-03-11 23:55:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000050256_25731072.pth [2023-03-11 23:55:13,303][106434] Updated weights for policy 0, policy_version 51040 (0.0005) [2023-03-11 23:55:15,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 12107.5). Total num frames: 26161152. Throughput: 0: 12307.6. Samples: 26150788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:55:15,661][106151] Avg episode reward: [(0, '3957.998')] [2023-03-11 23:55:16,661][106434] Updated weights for policy 0, policy_version 51120 (0.0005) [2023-03-11 23:55:19,979][106434] Updated weights for policy 0, policy_version 51200 (0.0004) [2023-03-11 23:55:20,661][106151] Fps is (10 sec: 12288.2, 60 sec: 12356.3, 300 sec: 12121.4). Total num frames: 26222592. Throughput: 0: 12289.7. Samples: 26187708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:55:20,661][106151] Avg episode reward: [(0, '3873.338')] [2023-03-11 23:55:23,316][106434] Updated weights for policy 0, policy_version 51280 (0.0005) [2023-03-11 23:55:25,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12356.3, 300 sec: 12135.3). Total num frames: 26284032. Throughput: 0: 12292.4. Samples: 26261800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:55:25,661][106151] Avg episode reward: [(0, '4000.885')] [2023-03-11 23:55:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000051336_26284032.pth... [2023-03-11 23:55:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000050616_25915392.pth [2023-03-11 23:55:26,663][106434] Updated weights for policy 0, policy_version 51360 (0.0004) [2023-03-11 23:55:30,253][106434] Updated weights for policy 0, policy_version 51440 (0.0005) [2023-03-11 23:55:30,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12288.0, 300 sec: 12135.3). Total num frames: 26341376. Throughput: 0: 12225.5. Samples: 26332844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:55:30,661][106151] Avg episode reward: [(0, '4191.722')] [2023-03-11 23:55:33,802][106434] Updated weights for policy 0, policy_version 51520 (0.0006) [2023-03-11 23:55:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12219.7, 300 sec: 12135.3). Total num frames: 26398720. Throughput: 0: 12166.2. Samples: 26366912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:55:35,661][106151] Avg episode reward: [(0, '4042.196')] [2023-03-11 23:55:37,391][106434] Updated weights for policy 0, policy_version 51600 (0.0005) [2023-03-11 23:55:40,661][106151] Fps is (10 sec: 11059.2, 60 sec: 12014.9, 300 sec: 12121.4). Total num frames: 26451968. Throughput: 0: 12045.5. Samples: 26435592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:55:40,661][106151] Avg episode reward: [(0, '3900.435')] [2023-03-11 23:55:40,716][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000051672_26456064.pth... [2023-03-11 23:55:40,718][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000050976_26099712.pth [2023-03-11 23:55:41,069][106434] Updated weights for policy 0, policy_version 51680 (0.0005) [2023-03-11 23:55:44,645][106434] Updated weights for policy 0, policy_version 51760 (0.0005) [2023-03-11 23:55:45,661][106151] Fps is (10 sec: 11059.3, 60 sec: 12014.9, 300 sec: 12107.5). Total num frames: 26509312. Throughput: 0: 11916.0. Samples: 26503396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:55:45,661][106151] Avg episode reward: [(0, '4077.758')] [2023-03-11 23:55:48,224][106434] Updated weights for policy 0, policy_version 51840 (0.0005) [2023-03-11 23:55:50,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11878.4, 300 sec: 12079.7). Total num frames: 26566656. Throughput: 0: 11870.0. Samples: 26537908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:55:50,661][106151] Avg episode reward: [(0, '3832.835')] [2023-03-11 23:55:51,816][106434] Updated weights for policy 0, policy_version 51920 (0.0005) [2023-03-11 23:55:55,234][106434] Updated weights for policy 0, policy_version 52000 (0.0005) [2023-03-11 23:55:55,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 12079.7). Total num frames: 26628096. Throughput: 0: 11790.6. Samples: 26607172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:55:55,661][106151] Avg episode reward: [(0, '3706.537')] [2023-03-11 23:55:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000052008_26628096.pth... [2023-03-11 23:55:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000051336_26284032.pth [2023-03-11 23:55:58,596][106434] Updated weights for policy 0, policy_version 52080 (0.0005) [2023-03-11 23:56:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 12093.6). Total num frames: 26689536. Throughput: 0: 11764.8. Samples: 26680204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:56:00,661][106151] Avg episode reward: [(0, '4397.117')] [2023-03-11 23:56:01,973][106434] Updated weights for policy 0, policy_version 52160 (0.0005) [2023-03-11 23:56:05,232][106434] Updated weights for policy 0, policy_version 52240 (0.0004) [2023-03-11 23:56:05,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11878.4, 300 sec: 12107.5). Total num frames: 26750976. Throughput: 0: 11753.7. Samples: 26716624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:56:05,661][106151] Avg episode reward: [(0, '4139.884')] [2023-03-11 23:56:08,535][106434] Updated weights for policy 0, policy_version 52320 (0.0005) [2023-03-11 23:56:10,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11878.4, 300 sec: 12121.4). Total num frames: 26812416. Throughput: 0: 11774.1. Samples: 26791632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:56:10,661][106151] Avg episode reward: [(0, '4306.228')] [2023-03-11 23:56:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000052368_26812416.pth... [2023-03-11 23:56:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000051672_26456064.pth [2023-03-11 23:56:11,827][106434] Updated weights for policy 0, policy_version 52400 (0.0004) [2023-03-11 23:56:15,139][106434] Updated weights for policy 0, policy_version 52480 (0.0004) [2023-03-11 23:56:15,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 12135.3). Total num frames: 26873856. Throughput: 0: 11842.0. Samples: 26865736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:56:15,661][106151] Avg episode reward: [(0, '3902.086')] [2023-03-11 23:56:18,509][106434] Updated weights for policy 0, policy_version 52560 (0.0003) [2023-03-11 23:56:20,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 12149.2). Total num frames: 26935296. Throughput: 0: 11902.9. Samples: 26902540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:56:20,662][106151] Avg episode reward: [(0, '4134.104')] [2023-03-11 23:56:21,917][106434] Updated weights for policy 0, policy_version 52640 (0.0003) [2023-03-11 23:56:25,369][106434] Updated weights for policy 0, policy_version 52720 (0.0004) [2023-03-11 23:56:25,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 12135.3). Total num frames: 26992640. Throughput: 0: 11981.9. Samples: 26974780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:56:25,662][106151] Avg episode reward: [(0, '3786.831')] [2023-03-11 23:56:25,692][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000052728_26996736.pth... [2023-03-11 23:56:25,695][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000052008_26628096.pth [2023-03-11 23:56:28,700][106434] Updated weights for policy 0, policy_version 52800 (0.0003) [2023-03-11 23:56:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 12163.0). Total num frames: 27054080. Throughput: 0: 12093.1. Samples: 27047588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:56:30,662][106151] Avg episode reward: [(0, '4011.410')] [2023-03-11 23:56:32,034][106434] Updated weights for policy 0, policy_version 52880 (0.0003) [2023-03-11 23:56:35,421][106434] Updated weights for policy 0, policy_version 52960 (0.0003) [2023-03-11 23:56:35,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 12176.9). Total num frames: 27115520. Throughput: 0: 12131.7. Samples: 27083836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:56:35,661][106151] Avg episode reward: [(0, '3919.258')] [2023-03-11 23:56:38,857][106434] Updated weights for policy 0, policy_version 53040 (0.0003) [2023-03-11 23:56:40,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 12176.9). Total num frames: 27176960. Throughput: 0: 12207.0. Samples: 27156488. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:56:40,662][106151] Avg episode reward: [(0, '4044.304')] [2023-03-11 23:56:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000053080_27176960.pth... [2023-03-11 23:56:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000052368_26812416.pth [2023-03-11 23:56:42,229][106434] Updated weights for policy 0, policy_version 53120 (0.0003) [2023-03-11 23:56:45,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 12176.9). Total num frames: 27234304. Throughput: 0: 12172.6. Samples: 27227968. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:56:45,661][106151] Avg episode reward: [(0, '4003.077')] [2023-03-11 23:56:45,685][106434] Updated weights for policy 0, policy_version 53200 (0.0003) [2023-03-11 23:56:49,167][106434] Updated weights for policy 0, policy_version 53280 (0.0003) [2023-03-11 23:56:50,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12151.5, 300 sec: 12190.8). Total num frames: 27295744. Throughput: 0: 12144.9. Samples: 27263144. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:56:50,661][106151] Avg episode reward: [(0, '4215.190')] [2023-03-11 23:56:52,499][106434] Updated weights for policy 0, policy_version 53360 (0.0003) [2023-03-11 23:56:55,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 12218.6). Total num frames: 27357184. Throughput: 0: 12120.0. Samples: 27337032. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:56:55,661][106151] Avg episode reward: [(0, '4193.088')] [2023-03-11 23:56:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000053432_27357184.pth... [2023-03-11 23:56:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000052728_26996736.pth [2023-03-11 23:56:55,787][106434] Updated weights for policy 0, policy_version 53440 (0.0003) [2023-03-11 23:56:59,136][106434] Updated weights for policy 0, policy_version 53520 (0.0003) [2023-03-11 23:57:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 12218.6). Total num frames: 27418624. Throughput: 0: 12104.5. Samples: 27410440. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:57:00,662][106151] Avg episode reward: [(0, '4339.825')] [2023-03-11 23:57:02,543][106434] Updated weights for policy 0, policy_version 53600 (0.0005) [2023-03-11 23:57:05,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 12218.6). Total num frames: 27475968. Throughput: 0: 12096.0. Samples: 27446860. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:57:05,671][106151] Avg episode reward: [(0, '4198.875')] [2023-03-11 23:57:06,251][106434] Updated weights for policy 0, policy_version 53680 (0.0005) [2023-03-11 23:57:09,877][106434] Updated weights for policy 0, policy_version 53760 (0.0005) [2023-03-11 23:57:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 12204.7). Total num frames: 27533312. Throughput: 0: 11958.3. Samples: 27512904. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 23:57:10,661][106151] Avg episode reward: [(0, '3946.989')] [2023-03-11 23:57:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000053776_27533312.pth... [2023-03-11 23:57:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000053080_27176960.pth [2023-03-11 23:57:13,456][106434] Updated weights for policy 0, policy_version 53840 (0.0005) [2023-03-11 23:57:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 12190.8). Total num frames: 27590656. Throughput: 0: 11879.6. Samples: 27582172. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:57:15,672][106151] Avg episode reward: [(0, '4393.981')] [2023-03-11 23:57:16,931][106434] Updated weights for policy 0, policy_version 53920 (0.0005) [2023-03-11 23:57:20,308][106434] Updated weights for policy 0, policy_version 54000 (0.0003) [2023-03-11 23:57:20,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12190.8). Total num frames: 27652096. Throughput: 0: 11864.1. Samples: 27617720. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:57:20,662][106151] Avg episode reward: [(0, '4095.283')] [2023-03-11 23:57:23,561][106434] Updated weights for policy 0, policy_version 54080 (0.0003) [2023-03-11 23:57:25,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12014.9, 300 sec: 12204.7). Total num frames: 27713536. Throughput: 0: 11907.1. Samples: 27692308. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:57:25,662][106151] Avg episode reward: [(0, '4320.642')] [2023-03-11 23:57:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000054128_27713536.pth... [2023-03-11 23:57:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000053432_27357184.pth [2023-03-11 23:57:27,017][106434] Updated weights for policy 0, policy_version 54160 (0.0003) [2023-03-11 23:57:30,360][106434] Updated weights for policy 0, policy_version 54240 (0.0003) [2023-03-11 23:57:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12204.7). Total num frames: 27770880. Throughput: 0: 11915.1. Samples: 27764148. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:57:30,661][106151] Avg episode reward: [(0, '4241.881')] [2023-03-11 23:57:33,806][106434] Updated weights for policy 0, policy_version 54320 (0.0004) [2023-03-11 23:57:35,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12204.7). Total num frames: 27832320. Throughput: 0: 11932.3. Samples: 27800100. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:57:35,661][106151] Avg episode reward: [(0, '4127.421')] [2023-03-11 23:57:37,133][106434] Updated weights for policy 0, policy_version 54400 (0.0005) [2023-03-11 23:57:40,442][106434] Updated weights for policy 0, policy_version 54480 (0.0004) [2023-03-11 23:57:40,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 12204.7). Total num frames: 27893760. Throughput: 0: 11918.2. Samples: 27873352. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:57:40,662][106151] Avg episode reward: [(0, '4154.608')] [2023-03-11 23:57:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000054480_27893760.pth... [2023-03-11 23:57:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000053776_27533312.pth [2023-03-11 23:57:43,807][106434] Updated weights for policy 0, policy_version 54560 (0.0003) [2023-03-11 23:57:45,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 12190.8). Total num frames: 27955200. Throughput: 0: 11916.0. Samples: 27946660. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 23:57:45,672][106151] Avg episode reward: [(0, '4050.614')] [2023-03-11 23:57:47,288][106434] Updated weights for policy 0, policy_version 54640 (0.0004) [2023-03-11 23:57:50,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 12176.9). Total num frames: 28012544. Throughput: 0: 11891.5. Samples: 27981976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:57:50,672][106151] Avg episode reward: [(0, '4309.223')] [2023-03-11 23:57:50,895][106434] Updated weights for policy 0, policy_version 54720 (0.0005) [2023-03-11 23:57:54,472][106434] Updated weights for policy 0, policy_version 54800 (0.0005) [2023-03-11 23:57:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 12163.0). Total num frames: 28069888. Throughput: 0: 11928.3. Samples: 28049676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:57:55,662][106151] Avg episode reward: [(0, '3857.941')] [2023-03-11 23:57:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000054824_28069888.pth... [2023-03-11 23:57:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000054128_27713536.pth [2023-03-11 23:57:58,081][106434] Updated weights for policy 0, policy_version 54880 (0.0005) [2023-03-11 23:58:00,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 12149.2). Total num frames: 28127232. Throughput: 0: 11930.3. Samples: 28119036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:58:00,672][106151] Avg episode reward: [(0, '3794.050')] [2023-03-11 23:58:01,692][106434] Updated weights for policy 0, policy_version 54960 (0.0005) [2023-03-11 23:58:05,184][106434] Updated weights for policy 0, policy_version 55040 (0.0005) [2023-03-11 23:58:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 12121.4). Total num frames: 28184576. Throughput: 0: 11888.4. Samples: 28152696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:58:05,672][106151] Avg episode reward: [(0, '3961.621')] [2023-03-11 23:58:08,739][106434] Updated weights for policy 0, policy_version 55120 (0.0005) [2023-03-11 23:58:10,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 12107.5). Total num frames: 28241920. Throughput: 0: 11776.7. Samples: 28222260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:58:10,661][106151] Avg episode reward: [(0, '4109.324')] [2023-03-11 23:58:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000055160_28241920.pth... [2023-03-11 23:58:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000054480_27893760.pth [2023-03-11 23:58:12,381][106434] Updated weights for policy 0, policy_version 55200 (0.0005) [2023-03-11 23:58:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 12093.6). Total num frames: 28299264. Throughput: 0: 11691.2. Samples: 28290252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:58:15,672][106151] Avg episode reward: [(0, '4040.920')] [2023-03-11 23:58:15,938][106434] Updated weights for policy 0, policy_version 55280 (0.0005) [2023-03-11 23:58:19,491][106434] Updated weights for policy 0, policy_version 55360 (0.0005) [2023-03-11 23:58:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 12079.7). Total num frames: 28356608. Throughput: 0: 11671.4. Samples: 28325312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:58:20,672][106151] Avg episode reward: [(0, '4144.232')] [2023-03-11 23:58:23,172][106434] Updated weights for policy 0, policy_version 55440 (0.0005) [2023-03-11 23:58:25,661][106151] Fps is (10 sec: 11059.1, 60 sec: 11605.3, 300 sec: 12052.0). Total num frames: 28409856. Throughput: 0: 11546.6. Samples: 28392948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:58:25,662][106151] Avg episode reward: [(0, '4091.497')] [2023-03-11 23:58:25,707][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000055496_28413952.pth... [2023-03-11 23:58:25,709][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000054824_28069888.pth [2023-03-11 23:58:26,770][106434] Updated weights for policy 0, policy_version 55520 (0.0005) [2023-03-11 23:58:30,389][106434] Updated weights for policy 0, policy_version 55600 (0.0005) [2023-03-11 23:58:30,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11605.3, 300 sec: 12024.2). Total num frames: 28467200. Throughput: 0: 11426.9. Samples: 28460872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:58:30,661][106151] Avg episode reward: [(0, '4051.223')] [2023-03-11 23:58:34,011][106434] Updated weights for policy 0, policy_version 55680 (0.0005) [2023-03-11 23:58:35,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 12010.3). Total num frames: 28524544. Throughput: 0: 11415.4. Samples: 28495668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:58:35,661][106151] Avg episode reward: [(0, '4097.811')] [2023-03-11 23:58:37,637][106434] Updated weights for policy 0, policy_version 55760 (0.0005) [2023-03-11 23:58:40,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11996.4). Total num frames: 28581888. Throughput: 0: 11395.5. Samples: 28562472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:58:40,661][106151] Avg episode reward: [(0, '4305.861')] [2023-03-11 23:58:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000055824_28581888.pth... [2023-03-11 23:58:40,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000055160_28241920.pth [2023-03-11 23:58:41,215][106434] Updated weights for policy 0, policy_version 55840 (0.0005) [2023-03-11 23:58:44,816][106434] Updated weights for policy 0, policy_version 55920 (0.0005) [2023-03-11 23:58:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11968.7). Total num frames: 28639232. Throughput: 0: 11379.3. Samples: 28631104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:58:45,661][106151] Avg episode reward: [(0, '4190.367')] [2023-03-11 23:58:48,410][106434] Updated weights for policy 0, policy_version 56000 (0.0005) [2023-03-11 23:58:50,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11400.5, 300 sec: 11954.8). Total num frames: 28696576. Throughput: 0: 11387.2. Samples: 28665120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:58:50,661][106151] Avg episode reward: [(0, '4313.532')] [2023-03-11 23:58:52,065][106434] Updated weights for policy 0, policy_version 56080 (0.0005) [2023-03-11 23:58:55,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 11927.0). Total num frames: 28749824. Throughput: 0: 11359.6. Samples: 28733440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:58:55,661][106151] Avg episode reward: [(0, '4268.128')] [2023-03-11 23:58:55,719][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000056160_28753920.pth... [2023-03-11 23:58:55,719][106434] Updated weights for policy 0, policy_version 56160 (0.0005) [2023-03-11 23:58:55,722][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000055496_28413952.pth [2023-03-11 23:58:59,275][106434] Updated weights for policy 0, policy_version 56240 (0.0005) [2023-03-11 23:59:00,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 11913.1). Total num frames: 28807168. Throughput: 0: 11351.2. Samples: 28801056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:59:00,661][106151] Avg episode reward: [(0, '3912.529')] [2023-03-11 23:59:02,917][106434] Updated weights for policy 0, policy_version 56320 (0.0005) [2023-03-11 23:59:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11899.2). Total num frames: 28864512. Throughput: 0: 11330.1. Samples: 28835168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:59:05,661][106151] Avg episode reward: [(0, '4301.912')] [2023-03-11 23:59:06,532][106434] Updated weights for policy 0, policy_version 56400 (0.0005) [2023-03-11 23:59:10,019][106434] Updated weights for policy 0, policy_version 56480 (0.0005) [2023-03-11 23:59:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11871.5). Total num frames: 28921856. Throughput: 0: 11369.3. Samples: 28904564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:59:10,661][106151] Avg episode reward: [(0, '4258.578')] [2023-03-11 23:59:10,679][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000056496_28925952.pth... [2023-03-11 23:59:10,680][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000055824_28581888.pth [2023-03-11 23:59:13,503][106434] Updated weights for policy 0, policy_version 56560 (0.0005) [2023-03-11 23:59:15,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11332.3, 300 sec: 11857.6). Total num frames: 28979200. Throughput: 0: 11394.8. Samples: 28973640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:59:15,661][106151] Avg episode reward: [(0, '4335.838')] [2023-03-11 23:59:17,068][106434] Updated weights for policy 0, policy_version 56640 (0.0005) [2023-03-11 23:59:20,328][106434] Updated weights for policy 0, policy_version 56720 (0.0004) [2023-03-11 23:59:20,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11400.5, 300 sec: 11857.6). Total num frames: 29040640. Throughput: 0: 11411.3. Samples: 29009176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:59:20,661][106151] Avg episode reward: [(0, '3991.603')] [2023-03-11 23:59:23,515][106434] Updated weights for policy 0, policy_version 56800 (0.0004) [2023-03-11 23:59:25,661][106151] Fps is (10 sec: 12697.5, 60 sec: 11605.3, 300 sec: 11871.5). Total num frames: 29106176. Throughput: 0: 11627.4. Samples: 29085704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:59:25,661][106151] Avg episode reward: [(0, '3729.798')] [2023-03-11 23:59:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000056848_29106176.pth... [2023-03-11 23:59:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000056160_28753920.pth [2023-03-11 23:59:26,801][106434] Updated weights for policy 0, policy_version 56880 (0.0004) [2023-03-11 23:59:30,066][106434] Updated weights for policy 0, policy_version 56960 (0.0004) [2023-03-11 23:59:30,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11673.6, 300 sec: 11871.5). Total num frames: 29167616. Throughput: 0: 11752.8. Samples: 29159980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:59:30,661][106151] Avg episode reward: [(0, '4163.270')] [2023-03-11 23:59:33,232][106434] Updated weights for policy 0, policy_version 57040 (0.0004) [2023-03-11 23:59:35,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11810.1, 300 sec: 11871.5). Total num frames: 29233152. Throughput: 0: 11877.2. Samples: 29199596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:59:35,661][106151] Avg episode reward: [(0, '3885.760')] [2023-03-11 23:59:36,574][106434] Updated weights for policy 0, policy_version 57120 (0.0004) [2023-03-11 23:59:39,859][106434] Updated weights for policy 0, policy_version 57200 (0.0004) [2023-03-11 23:59:40,661][106151] Fps is (10 sec: 12697.4, 60 sec: 11878.4, 300 sec: 11885.3). Total num frames: 29294592. Throughput: 0: 12005.2. Samples: 29273676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:59:40,662][106151] Avg episode reward: [(0, '3751.759')] [2023-03-11 23:59:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000057216_29294592.pth... [2023-03-11 23:59:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000056496_28925952.pth [2023-03-11 23:59:43,086][106434] Updated weights for policy 0, policy_version 57280 (0.0004) [2023-03-11 23:59:45,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11871.5). Total num frames: 29356032. Throughput: 0: 12185.2. Samples: 29349388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:59:45,661][106151] Avg episode reward: [(0, '4104.322')] [2023-03-11 23:59:46,353][106434] Updated weights for policy 0, policy_version 57360 (0.0004) [2023-03-11 23:59:49,546][106434] Updated weights for policy 0, policy_version 57440 (0.0004) [2023-03-11 23:59:50,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12083.2, 300 sec: 11885.3). Total num frames: 29421568. Throughput: 0: 12252.6. Samples: 29386536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:59:50,661][106151] Avg episode reward: [(0, '4318.192')] [2023-03-11 23:59:52,816][106434] Updated weights for policy 0, policy_version 57520 (0.0004) [2023-03-11 23:59:55,661][106151] Fps is (10 sec: 12697.4, 60 sec: 12219.7, 300 sec: 11885.3). Total num frames: 29483008. Throughput: 0: 12400.8. Samples: 29462600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 23:59:55,662][106151] Avg episode reward: [(0, '4119.302')] [2023-03-11 23:59:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000057584_29483008.pth... [2023-03-11 23:59:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000056848_29106176.pth [2023-03-11 23:59:56,048][106434] Updated weights for policy 0, policy_version 57600 (0.0004) [2023-03-11 23:59:59,403][106434] Updated weights for policy 0, policy_version 57680 (0.0005) [2023-03-12 00:00:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 11885.3). Total num frames: 29544448. Throughput: 0: 12530.2. Samples: 29537500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:00:00,661][106151] Avg episode reward: [(0, '4101.261')] [2023-03-12 00:00:02,617][106434] Updated weights for policy 0, policy_version 57760 (0.0004) [2023-03-12 00:00:05,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 11899.2). Total num frames: 29609984. Throughput: 0: 12589.0. Samples: 29575684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:00:05,662][106151] Avg episode reward: [(0, '4229.405')] [2023-03-12 00:00:05,869][106434] Updated weights for policy 0, policy_version 57840 (0.0004) [2023-03-12 00:00:09,169][106434] Updated weights for policy 0, policy_version 57920 (0.0004) [2023-03-12 00:00:10,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12492.8, 300 sec: 11899.2). Total num frames: 29671424. Throughput: 0: 12560.9. Samples: 29650944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:00:10,662][106151] Avg episode reward: [(0, '4279.276')] [2023-03-12 00:00:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000057952_29671424.pth... [2023-03-12 00:00:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000057216_29294592.pth [2023-03-12 00:00:12,451][106434] Updated weights for policy 0, policy_version 58000 (0.0005) [2023-03-12 00:00:15,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12561.1, 300 sec: 11899.2). Total num frames: 29732864. Throughput: 0: 12564.9. Samples: 29725400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:00:15,661][106151] Avg episode reward: [(0, '3847.282')] [2023-03-12 00:00:15,766][106434] Updated weights for policy 0, policy_version 58080 (0.0004) [2023-03-12 00:00:18,989][106434] Updated weights for policy 0, policy_version 58160 (0.0004) [2023-03-12 00:00:20,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12629.3, 300 sec: 11913.1). Total num frames: 29798400. Throughput: 0: 12522.3. Samples: 29763100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:00:20,661][106151] Avg episode reward: [(0, '4232.975')] [2023-03-12 00:00:22,280][106434] Updated weights for policy 0, policy_version 58240 (0.0004) [2023-03-12 00:00:25,533][106434] Updated weights for policy 0, policy_version 58320 (0.0004) [2023-03-12 00:00:25,661][106151] Fps is (10 sec: 12697.4, 60 sec: 12561.1, 300 sec: 11927.0). Total num frames: 29859840. Throughput: 0: 12549.2. Samples: 29838388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:00:25,662][106151] Avg episode reward: [(0, '4287.825')] [2023-03-12 00:00:25,666][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000058320_29859840.pth... [2023-03-12 00:00:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000057584_29483008.pth [2023-03-12 00:00:28,768][106434] Updated weights for policy 0, policy_version 58400 (0.0004) [2023-03-12 00:00:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 11940.9). Total num frames: 29921280. Throughput: 0: 12546.6. Samples: 29913984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:00:30,663][106151] Avg episode reward: [(0, '3702.714')] [2023-03-12 00:00:32,010][106434] Updated weights for policy 0, policy_version 58480 (0.0004) [2023-03-12 00:00:35,139][106434] Updated weights for policy 0, policy_version 58560 (0.0003) [2023-03-12 00:00:35,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12561.1, 300 sec: 11982.5). Total num frames: 29986816. Throughput: 0: 12574.3. Samples: 29952380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:00:35,661][106151] Avg episode reward: [(0, '3903.897')] [2023-03-12 00:00:38,367][106434] Updated weights for policy 0, policy_version 58640 (0.0004) [2023-03-12 00:00:40,661][106151] Fps is (10 sec: 13107.1, 60 sec: 12629.3, 300 sec: 12010.3). Total num frames: 30052352. Throughput: 0: 12591.0. Samples: 30029196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:00:40,662][106151] Avg episode reward: [(0, '4167.113')] [2023-03-12 00:00:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000058696_30052352.pth... [2023-03-12 00:00:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000057952_29671424.pth [2023-03-12 00:00:41,600][106434] Updated weights for policy 0, policy_version 58720 (0.0004) [2023-03-12 00:00:44,859][106434] Updated weights for policy 0, policy_version 58800 (0.0004) [2023-03-12 00:00:45,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12024.2). Total num frames: 30113792. Throughput: 0: 12619.8. Samples: 30105392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:00:45,661][106151] Avg episode reward: [(0, '3672.191')] [2023-03-12 00:00:48,116][106434] Updated weights for policy 0, policy_version 58880 (0.0004) [2023-03-12 00:00:50,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12024.2). Total num frames: 30175232. Throughput: 0: 12599.0. Samples: 30142640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:00:50,662][106151] Avg episode reward: [(0, '3734.875')] [2023-03-12 00:00:51,370][106434] Updated weights for policy 0, policy_version 58960 (0.0004) [2023-03-12 00:00:54,631][106434] Updated weights for policy 0, policy_version 59040 (0.0004) [2023-03-12 00:00:55,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12629.3, 300 sec: 12038.1). Total num frames: 30240768. Throughput: 0: 12605.8. Samples: 30218204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:00:55,662][106151] Avg episode reward: [(0, '3924.729')] [2023-03-12 00:00:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000059064_30240768.pth... [2023-03-12 00:00:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000058320_29859840.pth [2023-03-12 00:00:57,913][106434] Updated weights for policy 0, policy_version 59120 (0.0004) [2023-03-12 00:01:00,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12629.3, 300 sec: 12038.1). Total num frames: 30302208. Throughput: 0: 12630.9. Samples: 30293792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:01:00,661][106151] Avg episode reward: [(0, '3836.769')] [2023-03-12 00:01:01,146][106434] Updated weights for policy 0, policy_version 59200 (0.0004) [2023-03-12 00:01:04,472][106434] Updated weights for policy 0, policy_version 59280 (0.0004) [2023-03-12 00:01:05,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12561.1, 300 sec: 12038.1). Total num frames: 30363648. Throughput: 0: 12618.8. Samples: 30330944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:01:05,661][106151] Avg episode reward: [(0, '3935.582')] [2023-03-12 00:01:07,702][106434] Updated weights for policy 0, policy_version 59360 (0.0004) [2023-03-12 00:01:10,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12629.3, 300 sec: 12052.0). Total num frames: 30429184. Throughput: 0: 12617.5. Samples: 30406176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:01:10,662][106151] Avg episode reward: [(0, '3856.169')] [2023-03-12 00:01:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000059432_30429184.pth... [2023-03-12 00:01:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000058696_30052352.pth [2023-03-12 00:01:10,989][106434] Updated weights for policy 0, policy_version 59440 (0.0004) [2023-03-12 00:01:14,277][106434] Updated weights for policy 0, policy_version 59520 (0.0004) [2023-03-12 00:01:15,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12052.0). Total num frames: 30490624. Throughput: 0: 12598.7. Samples: 30480924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:01:15,661][106151] Avg episode reward: [(0, '4168.041')] [2023-03-12 00:01:17,468][106434] Updated weights for policy 0, policy_version 59600 (0.0003) [2023-03-12 00:01:20,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12561.1, 300 sec: 12065.8). Total num frames: 30552064. Throughput: 0: 12599.6. Samples: 30519360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:01:20,661][106151] Avg episode reward: [(0, '4326.039')] [2023-03-12 00:01:20,700][106434] Updated weights for policy 0, policy_version 59680 (0.0004) [2023-03-12 00:01:23,985][106434] Updated weights for policy 0, policy_version 59760 (0.0004) [2023-03-12 00:01:25,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12079.7). Total num frames: 30617600. Throughput: 0: 12580.7. Samples: 30595328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:01:25,661][106151] Avg episode reward: [(0, '4177.541')] [2023-03-12 00:01:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000059800_30617600.pth... [2023-03-12 00:01:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000059064_30240768.pth [2023-03-12 00:01:27,212][106434] Updated weights for policy 0, policy_version 59840 (0.0004) [2023-03-12 00:01:30,397][106434] Updated weights for policy 0, policy_version 59920 (0.0004) [2023-03-12 00:01:30,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12079.7). Total num frames: 30679040. Throughput: 0: 12578.7. Samples: 30671432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:01:30,661][106151] Avg episode reward: [(0, '3881.362')] [2023-03-12 00:01:33,564][106434] Updated weights for policy 0, policy_version 60000 (0.0004) [2023-03-12 00:01:35,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12093.6). Total num frames: 30744576. Throughput: 0: 12622.8. Samples: 30710664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:01:35,661][106151] Avg episode reward: [(0, '4169.740')] [2023-03-12 00:01:36,758][106434] Updated weights for policy 0, policy_version 60080 (0.0004) [2023-03-12 00:01:39,965][106434] Updated weights for policy 0, policy_version 60160 (0.0004) [2023-03-12 00:01:40,661][106151] Fps is (10 sec: 13107.2, 60 sec: 12629.3, 300 sec: 12121.4). Total num frames: 30810112. Throughput: 0: 12649.2. Samples: 30787416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:01:40,661][106151] Avg episode reward: [(0, '4061.132')] [2023-03-12 00:01:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000060176_30810112.pth... [2023-03-12 00:01:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000059432_30429184.pth [2023-03-12 00:01:43,211][106434] Updated weights for policy 0, policy_version 60240 (0.0004) [2023-03-12 00:01:45,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12121.4). Total num frames: 30871552. Throughput: 0: 12661.8. Samples: 30863572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:01:45,661][106151] Avg episode reward: [(0, '3989.117')] [2023-03-12 00:01:46,353][106434] Updated weights for policy 0, policy_version 60320 (0.0004) [2023-03-12 00:01:49,480][106434] Updated weights for policy 0, policy_version 60400 (0.0004) [2023-03-12 00:01:50,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12697.6, 300 sec: 12135.3). Total num frames: 30937088. Throughput: 0: 12715.8. Samples: 30903156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:01:50,661][106151] Avg episode reward: [(0, '4325.729')] [2023-03-12 00:01:52,735][106434] Updated weights for policy 0, policy_version 60480 (0.0004) [2023-03-12 00:01:55,661][106151] Fps is (10 sec: 13107.1, 60 sec: 12697.6, 300 sec: 12149.2). Total num frames: 31002624. Throughput: 0: 12734.1. Samples: 30979212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:01:55,661][106151] Avg episode reward: [(0, '4075.459')] [2023-03-12 00:01:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000060552_31002624.pth... [2023-03-12 00:01:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000059800_30617600.pth [2023-03-12 00:01:55,947][106434] Updated weights for policy 0, policy_version 60560 (0.0004) [2023-03-12 00:01:59,161][106434] Updated weights for policy 0, policy_version 60640 (0.0004) [2023-03-12 00:02:00,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 12163.0). Total num frames: 31064064. Throughput: 0: 12779.6. Samples: 31056004. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:02:00,661][106151] Avg episode reward: [(0, '4177.542')] [2023-03-12 00:02:02,365][106434] Updated weights for policy 0, policy_version 60720 (0.0004) [2023-03-12 00:02:05,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12697.6, 300 sec: 12176.9). Total num frames: 31125504. Throughput: 0: 12781.3. Samples: 31094516. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:02:05,661][106151] Avg episode reward: [(0, '4195.890')] [2023-03-12 00:02:05,673][106434] Updated weights for policy 0, policy_version 60800 (0.0005) [2023-03-12 00:02:08,881][106434] Updated weights for policy 0, policy_version 60880 (0.0004) [2023-03-12 00:02:10,661][106151] Fps is (10 sec: 12697.4, 60 sec: 12697.6, 300 sec: 12204.7). Total num frames: 31191040. Throughput: 0: 12766.0. Samples: 31169800. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:02:10,662][106151] Avg episode reward: [(0, '4419.701')] [2023-03-12 00:02:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000060920_31191040.pth... [2023-03-12 00:02:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000060176_30810112.pth [2023-03-12 00:02:12,088][106434] Updated weights for policy 0, policy_version 60960 (0.0004) [2023-03-12 00:02:15,304][106434] Updated weights for policy 0, policy_version 61040 (0.0005) [2023-03-12 00:02:15,661][106151] Fps is (10 sec: 13107.2, 60 sec: 12765.9, 300 sec: 12218.6). Total num frames: 31256576. Throughput: 0: 12777.2. Samples: 31246408. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:02:15,661][106151] Avg episode reward: [(0, '4339.107')] [2023-03-12 00:02:18,490][106434] Updated weights for policy 0, policy_version 61120 (0.0004) [2023-03-12 00:02:20,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12765.9, 300 sec: 12218.6). Total num frames: 31318016. Throughput: 0: 12768.7. Samples: 31285256. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:02:20,661][106151] Avg episode reward: [(0, '3924.312')] [2023-03-12 00:02:21,710][106434] Updated weights for policy 0, policy_version 61200 (0.0003) [2023-03-12 00:02:24,903][106434] Updated weights for policy 0, policy_version 61280 (0.0004) [2023-03-12 00:02:25,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12765.9, 300 sec: 12246.3). Total num frames: 31383552. Throughput: 0: 12760.7. Samples: 31361648. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:02:25,661][106151] Avg episode reward: [(0, '3728.253')] [2023-03-12 00:02:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000061296_31383552.pth... [2023-03-12 00:02:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000060552_31002624.pth [2023-03-12 00:02:28,288][106434] Updated weights for policy 0, policy_version 61360 (0.0004) [2023-03-12 00:02:30,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12697.6, 300 sec: 12232.5). Total num frames: 31440896. Throughput: 0: 12695.8. Samples: 31434884. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:02:30,661][106151] Avg episode reward: [(0, '3513.145')] [2023-03-12 00:02:31,743][106434] Updated weights for policy 0, policy_version 61440 (0.0005) [2023-03-12 00:02:35,259][106434] Updated weights for policy 0, policy_version 61520 (0.0005) [2023-03-12 00:02:35,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12629.3, 300 sec: 12232.5). Total num frames: 31502336. Throughput: 0: 12588.5. Samples: 31469640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:02:35,661][106151] Avg episode reward: [(0, '2362.305')] [2023-03-12 00:02:38,431][106434] Updated weights for policy 0, policy_version 61600 (0.0004) [2023-03-12 00:02:40,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12232.5). Total num frames: 31563776. Throughput: 0: 12550.5. Samples: 31543984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:02:40,661][106151] Avg episode reward: [(0, '2667.565')] [2023-03-12 00:02:40,679][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000061656_31567872.pth... [2023-03-12 00:02:40,681][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000060920_31191040.pth [2023-03-12 00:02:41,654][106434] Updated weights for policy 0, policy_version 61680 (0.0004) [2023-03-12 00:02:44,991][106434] Updated weights for policy 0, policy_version 61760 (0.0003) [2023-03-12 00:02:45,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12629.3, 300 sec: 12260.2). Total num frames: 31629312. Throughput: 0: 12519.0. Samples: 31619360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:02:45,661][106151] Avg episode reward: [(0, '2680.568')] [2023-03-12 00:02:48,236][106434] Updated weights for policy 0, policy_version 61840 (0.0003) [2023-03-12 00:02:50,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12274.1). Total num frames: 31690752. Throughput: 0: 12505.0. Samples: 31657240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:02:50,672][106151] Avg episode reward: [(0, '3046.645')] [2023-03-12 00:02:51,532][106434] Updated weights for policy 0, policy_version 61920 (0.0003) [2023-03-12 00:02:54,791][106434] Updated weights for policy 0, policy_version 62000 (0.0003) [2023-03-12 00:02:55,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12288.0). Total num frames: 31752192. Throughput: 0: 12488.4. Samples: 31731776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:02:55,661][106151] Avg episode reward: [(0, '3670.418')] [2023-03-12 00:02:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000062016_31752192.pth... [2023-03-12 00:02:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000061296_31383552.pth [2023-03-12 00:02:58,044][106434] Updated weights for policy 0, policy_version 62080 (0.0003) [2023-03-12 00:03:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12301.9). Total num frames: 31813632. Throughput: 0: 12444.7. Samples: 31806420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:03:00,672][106151] Avg episode reward: [(0, '4128.401')] [2023-03-12 00:03:01,479][106434] Updated weights for policy 0, policy_version 62160 (0.0004) [2023-03-12 00:03:04,956][106434] Updated weights for policy 0, policy_version 62240 (0.0005) [2023-03-12 00:03:05,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 12301.9). Total num frames: 31870976. Throughput: 0: 12379.0. Samples: 31842312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:03:05,672][106151] Avg episode reward: [(0, '3573.926')] [2023-03-12 00:03:08,517][106434] Updated weights for policy 0, policy_version 62320 (0.0005) [2023-03-12 00:03:10,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12356.3, 300 sec: 12315.8). Total num frames: 31932416. Throughput: 0: 12228.6. Samples: 31911936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:03:10,662][106151] Avg episode reward: [(0, '4066.713')] [2023-03-12 00:03:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000062368_31932416.pth... [2023-03-12 00:03:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000061656_31567872.pth [2023-03-12 00:03:11,955][106434] Updated weights for policy 0, policy_version 62400 (0.0005) [2023-03-12 00:03:15,537][106434] Updated weights for policy 0, policy_version 62480 (0.0005) [2023-03-12 00:03:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12315.8). Total num frames: 31989760. Throughput: 0: 12150.0. Samples: 31981632. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:03:15,661][106151] Avg episode reward: [(0, '4169.130')] [2023-03-12 00:03:19,035][106434] Updated weights for policy 0, policy_version 62560 (0.0004) [2023-03-12 00:03:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 12151.5, 300 sec: 12329.7). Total num frames: 32047104. Throughput: 0: 12173.1. Samples: 32017428. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:03:20,661][106151] Avg episode reward: [(0, '3807.998')] [2023-03-12 00:03:22,605][106434] Updated weights for policy 0, policy_version 62640 (0.0005) [2023-03-12 00:03:25,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 12329.7). Total num frames: 32104448. Throughput: 0: 12053.2. Samples: 32086380. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:03:25,661][106151] Avg episode reward: [(0, '4147.973')] [2023-03-12 00:03:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000062704_32104448.pth... [2023-03-12 00:03:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000062016_31752192.pth [2023-03-12 00:03:26,144][106434] Updated weights for policy 0, policy_version 62720 (0.0005) [2023-03-12 00:03:29,711][106434] Updated weights for policy 0, policy_version 62800 (0.0005) [2023-03-12 00:03:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 12329.7). Total num frames: 32161792. Throughput: 0: 11900.5. Samples: 32154884. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:03:30,661][106151] Avg episode reward: [(0, '3707.465')] [2023-03-12 00:03:33,263][106434] Updated weights for policy 0, policy_version 62880 (0.0005) [2023-03-12 00:03:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 12329.7). Total num frames: 32219136. Throughput: 0: 11828.6. Samples: 32189528. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:03:35,661][106151] Avg episode reward: [(0, '3987.625')] [2023-03-12 00:03:36,805][106434] Updated weights for policy 0, policy_version 62960 (0.0005) [2023-03-12 00:03:40,286][106434] Updated weights for policy 0, policy_version 63040 (0.0005) [2023-03-12 00:03:40,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 12343.5). Total num frames: 32280576. Throughput: 0: 11736.0. Samples: 32259896. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:03:40,662][106151] Avg episode reward: [(0, '4214.171')] [2023-03-12 00:03:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000063048_32280576.pth... [2023-03-12 00:03:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000062368_31932416.pth [2023-03-12 00:03:43,793][106434] Updated weights for policy 0, policy_version 63120 (0.0005) [2023-03-12 00:03:45,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 12343.5). Total num frames: 32337920. Throughput: 0: 11629.0. Samples: 32329728. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:03:45,662][106151] Avg episode reward: [(0, '4424.002')] [2023-03-12 00:03:47,273][106434] Updated weights for policy 0, policy_version 63200 (0.0005) [2023-03-12 00:03:50,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 12357.4). Total num frames: 32395264. Throughput: 0: 11618.5. Samples: 32365144. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:03:50,661][106151] Avg episode reward: [(0, '4425.876')] [2023-03-12 00:03:50,828][106434] Updated weights for policy 0, policy_version 63280 (0.0005) [2023-03-12 00:03:54,376][106434] Updated weights for policy 0, policy_version 63360 (0.0005) [2023-03-12 00:03:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12357.4). Total num frames: 32452608. Throughput: 0: 11573.3. Samples: 32432736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:03:55,662][106151] Avg episode reward: [(0, '4309.254')] [2023-03-12 00:03:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000063384_32452608.pth... [2023-03-12 00:03:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000062704_32104448.pth [2023-03-12 00:03:57,859][106434] Updated weights for policy 0, policy_version 63440 (0.0005) [2023-03-12 00:04:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 12371.3). Total num frames: 32514048. Throughput: 0: 11631.4. Samples: 32505044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:04:00,661][106151] Avg episode reward: [(0, '2797.321')] [2023-03-12 00:04:01,327][106434] Updated weights for policy 0, policy_version 63520 (0.0005) [2023-03-12 00:04:04,880][106434] Updated weights for policy 0, policy_version 63600 (0.0005) [2023-03-12 00:04:05,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 12371.3). Total num frames: 32571392. Throughput: 0: 11603.4. Samples: 32539580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:04:05,661][106151] Avg episode reward: [(0, '2666.836')] [2023-03-12 00:04:08,405][106434] Updated weights for policy 0, policy_version 63680 (0.0005) [2023-03-12 00:04:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.4, 300 sec: 12371.3). Total num frames: 32628736. Throughput: 0: 11604.8. Samples: 32608596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:04:10,661][106151] Avg episode reward: [(0, '3829.200')] [2023-03-12 00:04:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000063728_32628736.pth... [2023-03-12 00:04:10,665][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000063048_32280576.pth [2023-03-12 00:04:11,984][106434] Updated weights for policy 0, policy_version 63760 (0.0005) [2023-03-12 00:04:15,539][106434] Updated weights for policy 0, policy_version 63840 (0.0005) [2023-03-12 00:04:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12357.4). Total num frames: 32686080. Throughput: 0: 11623.7. Samples: 32677952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:04:15,661][106151] Avg episode reward: [(0, '3186.852')] [2023-03-12 00:04:19,007][106434] Updated weights for policy 0, policy_version 63920 (0.0005) [2023-03-12 00:04:20,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 12329.7). Total num frames: 32743424. Throughput: 0: 11639.7. Samples: 32713316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:04:20,661][106151] Avg episode reward: [(0, '3868.813')] [2023-03-12 00:04:22,587][106434] Updated weights for policy 0, policy_version 64000 (0.0005) [2023-03-12 00:04:25,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 12315.8). Total num frames: 32800768. Throughput: 0: 11618.7. Samples: 32782736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:04:25,661][106151] Avg episode reward: [(0, '3849.639')] [2023-03-12 00:04:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000064064_32800768.pth... [2023-03-12 00:04:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000063384_32452608.pth [2023-03-12 00:04:26,117][106434] Updated weights for policy 0, policy_version 64080 (0.0005) [2023-03-12 00:04:29,617][106434] Updated weights for policy 0, policy_version 64160 (0.0005) [2023-03-12 00:04:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12288.0). Total num frames: 32858112. Throughput: 0: 11617.4. Samples: 32852512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:04:30,661][106151] Avg episode reward: [(0, '3583.979')] [2023-03-12 00:04:32,963][106434] Updated weights for policy 0, policy_version 64240 (0.0005) [2023-03-12 00:04:35,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11741.9, 300 sec: 12301.9). Total num frames: 32923648. Throughput: 0: 11637.9. Samples: 32888848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:04:35,661][106151] Avg episode reward: [(0, '3908.085')] [2023-03-12 00:04:36,262][106434] Updated weights for policy 0, policy_version 64320 (0.0005) [2023-03-12 00:04:39,478][106434] Updated weights for policy 0, policy_version 64400 (0.0004) [2023-03-12 00:04:40,661][106151] Fps is (10 sec: 12697.5, 60 sec: 11741.9, 300 sec: 12301.9). Total num frames: 32985088. Throughput: 0: 11817.3. Samples: 32964516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:04:40,662][106151] Avg episode reward: [(0, '4276.865')] [2023-03-12 00:04:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000064424_32985088.pth... [2023-03-12 00:04:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000063728_32628736.pth [2023-03-12 00:04:42,795][106434] Updated weights for policy 0, policy_version 64480 (0.0005) [2023-03-12 00:04:45,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11810.1, 300 sec: 12288.0). Total num frames: 33046528. Throughput: 0: 11877.3. Samples: 33039524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:04:45,662][106151] Avg episode reward: [(0, '4323.187')] [2023-03-12 00:04:46,012][106434] Updated weights for policy 0, policy_version 64560 (0.0004) [2023-03-12 00:04:49,367][106434] Updated weights for policy 0, policy_version 64640 (0.0005) [2023-03-12 00:04:50,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 12288.0). Total num frames: 33107968. Throughput: 0: 11959.9. Samples: 33077776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:04:50,661][106151] Avg episode reward: [(0, '3954.164')] [2023-03-12 00:04:52,656][106434] Updated weights for policy 0, policy_version 64720 (0.0005) [2023-03-12 00:04:55,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 12301.9). Total num frames: 33173504. Throughput: 0: 12068.1. Samples: 33151664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:04:55,662][106151] Avg episode reward: [(0, '3875.907')] [2023-03-12 00:04:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000064792_33173504.pth... [2023-03-12 00:04:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000064064_32800768.pth [2023-03-12 00:04:55,870][106434] Updated weights for policy 0, policy_version 64800 (0.0004) [2023-03-12 00:04:59,356][106434] Updated weights for policy 0, policy_version 64880 (0.0005) [2023-03-12 00:05:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 12274.1). Total num frames: 33230848. Throughput: 0: 12123.5. Samples: 33223512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:05:00,661][106151] Avg episode reward: [(0, '3167.885')] [2023-03-12 00:05:02,908][106434] Updated weights for policy 0, policy_version 64960 (0.0005) [2023-03-12 00:05:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 12260.2). Total num frames: 33288192. Throughput: 0: 12126.1. Samples: 33258992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:05:05,661][106151] Avg episode reward: [(0, '3482.918')] [2023-03-12 00:05:06,405][106434] Updated weights for policy 0, policy_version 65040 (0.0005) [2023-03-12 00:05:09,860][106434] Updated weights for policy 0, policy_version 65120 (0.0005) [2023-03-12 00:05:10,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 12260.2). Total num frames: 33349632. Throughput: 0: 12144.2. Samples: 33329224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:05:10,661][106151] Avg episode reward: [(0, '3420.224')] [2023-03-12 00:05:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000065136_33349632.pth... [2023-03-12 00:05:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000064424_32985088.pth [2023-03-12 00:05:13,259][106434] Updated weights for policy 0, policy_version 65200 (0.0005) [2023-03-12 00:05:15,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 12246.3). Total num frames: 33411072. Throughput: 0: 12230.6. Samples: 33402888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:05:15,661][106151] Avg episode reward: [(0, '3196.622')] [2023-03-12 00:05:16,628][106434] Updated weights for policy 0, policy_version 65280 (0.0005) [2023-03-12 00:05:20,220][106434] Updated weights for policy 0, policy_version 65360 (0.0005) [2023-03-12 00:05:20,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 12232.5). Total num frames: 33468416. Throughput: 0: 12179.0. Samples: 33436904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:05:20,661][106151] Avg episode reward: [(0, '3309.282')] [2023-03-12 00:05:23,794][106434] Updated weights for policy 0, policy_version 65440 (0.0005) [2023-03-12 00:05:25,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 12218.6). Total num frames: 33525760. Throughput: 0: 12018.6. Samples: 33505352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:05:25,661][106151] Avg episode reward: [(0, '3336.849')] [2023-03-12 00:05:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000065480_33525760.pth... [2023-03-12 00:05:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000064792_33173504.pth [2023-03-12 00:05:27,371][106434] Updated weights for policy 0, policy_version 65520 (0.0005) [2023-03-12 00:05:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 12190.8). Total num frames: 33583104. Throughput: 0: 11897.5. Samples: 33574912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:05:30,661][106151] Avg episode reward: [(0, '3702.383')] [2023-03-12 00:05:30,940][106434] Updated weights for policy 0, policy_version 65600 (0.0005) [2023-03-12 00:05:34,515][106434] Updated weights for policy 0, policy_version 65680 (0.0005) [2023-03-12 00:05:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 12163.0). Total num frames: 33640448. Throughput: 0: 11781.9. Samples: 33607960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:05:35,661][106151] Avg episode reward: [(0, '3621.961')] [2023-03-12 00:05:38,112][106434] Updated weights for policy 0, policy_version 65760 (0.0005) [2023-03-12 00:05:40,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 12149.2). Total num frames: 33697792. Throughput: 0: 11682.7. Samples: 33677384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:05:40,661][106151] Avg episode reward: [(0, '3662.871')] [2023-03-12 00:05:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000065816_33697792.pth... [2023-03-12 00:05:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000065136_33349632.pth [2023-03-12 00:05:41,537][106434] Updated weights for policy 0, policy_version 65840 (0.0005) [2023-03-12 00:05:45,005][106434] Updated weights for policy 0, policy_version 65920 (0.0005) [2023-03-12 00:05:45,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 12149.2). Total num frames: 33759232. Throughput: 0: 11672.0. Samples: 33748752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:05:45,661][106151] Avg episode reward: [(0, '4139.978')] [2023-03-12 00:05:48,360][106434] Updated weights for policy 0, policy_version 66000 (0.0005) [2023-03-12 00:05:50,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11810.1, 300 sec: 12121.4). Total num frames: 33816576. Throughput: 0: 11702.2. Samples: 33785592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:05:50,661][106151] Avg episode reward: [(0, '4016.731')] [2023-03-12 00:05:51,824][106434] Updated weights for policy 0, policy_version 66080 (0.0005) [2023-03-12 00:05:55,381][106434] Updated weights for policy 0, policy_version 66160 (0.0005) [2023-03-12 00:05:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12107.5). Total num frames: 33873920. Throughput: 0: 11711.8. Samples: 33856256. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:05:55,661][106151] Avg episode reward: [(0, '3886.336')] [2023-03-12 00:05:55,716][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000066168_33878016.pth... [2023-03-12 00:05:55,719][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000065480_33525760.pth [2023-03-12 00:05:58,907][106434] Updated weights for policy 0, policy_version 66240 (0.0005) [2023-03-12 00:06:00,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11741.9, 300 sec: 12107.5). Total num frames: 33935360. Throughput: 0: 11621.4. Samples: 33925852. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:06:00,661][106151] Avg episode reward: [(0, '4063.783')] [2023-03-12 00:06:02,395][106434] Updated weights for policy 0, policy_version 66320 (0.0005) [2023-03-12 00:06:05,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 12079.7). Total num frames: 33992704. Throughput: 0: 11634.3. Samples: 33960448. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:06:05,661][106151] Avg episode reward: [(0, '3975.031')] [2023-03-12 00:06:05,887][106434] Updated weights for policy 0, policy_version 66400 (0.0005) [2023-03-12 00:06:09,333][106434] Updated weights for policy 0, policy_version 66480 (0.0005) [2023-03-12 00:06:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12065.8). Total num frames: 34050048. Throughput: 0: 11704.5. Samples: 34032056. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:06:10,661][106151] Avg episode reward: [(0, '4147.391')] [2023-03-12 00:06:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000066504_34050048.pth... [2023-03-12 00:06:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000065816_33697792.pth [2023-03-12 00:06:12,852][106434] Updated weights for policy 0, policy_version 66560 (0.0005) [2023-03-12 00:06:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 12065.8). Total num frames: 34111488. Throughput: 0: 11717.7. Samples: 34102208. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:06:15,661][106151] Avg episode reward: [(0, '4062.294')] [2023-03-12 00:06:16,269][106434] Updated weights for policy 0, policy_version 66640 (0.0005) [2023-03-12 00:06:19,574][106434] Updated weights for policy 0, policy_version 66720 (0.0005) [2023-03-12 00:06:20,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 12052.0). Total num frames: 34172928. Throughput: 0: 11815.6. Samples: 34139664. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:06:20,661][106151] Avg episode reward: [(0, '3866.992')] [2023-03-12 00:06:22,829][106434] Updated weights for policy 0, policy_version 66800 (0.0004) [2023-03-12 00:06:25,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11810.1, 300 sec: 12052.0). Total num frames: 34234368. Throughput: 0: 11929.5. Samples: 34214212. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:06:25,661][106151] Avg episode reward: [(0, '3969.501')] [2023-03-12 00:06:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000066864_34234368.pth... [2023-03-12 00:06:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000066168_33878016.pth [2023-03-12 00:06:26,049][106434] Updated weights for policy 0, policy_version 66880 (0.0004) [2023-03-12 00:06:29,407][106434] Updated weights for policy 0, policy_version 66960 (0.0005) [2023-03-12 00:06:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 12038.1). Total num frames: 34295808. Throughput: 0: 12000.7. Samples: 34288784. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:06:30,662][106151] Avg episode reward: [(0, '4074.969')] [2023-03-12 00:06:32,837][106434] Updated weights for policy 0, policy_version 67040 (0.0005) [2023-03-12 00:06:35,661][106151] Fps is (10 sec: 12288.2, 60 sec: 11946.7, 300 sec: 12024.2). Total num frames: 34357248. Throughput: 0: 11975.6. Samples: 34324492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:06:35,661][106151] Avg episode reward: [(0, '4037.278')] [2023-03-12 00:06:36,387][106434] Updated weights for policy 0, policy_version 67120 (0.0005) [2023-03-12 00:06:39,903][106434] Updated weights for policy 0, policy_version 67200 (0.0005) [2023-03-12 00:06:40,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12010.3). Total num frames: 34414592. Throughput: 0: 11952.6. Samples: 34394124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:06:40,661][106151] Avg episode reward: [(0, '3795.492')] [2023-03-12 00:06:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000067216_34414592.pth... [2023-03-12 00:06:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000066504_34050048.pth [2023-03-12 00:06:43,393][106434] Updated weights for policy 0, policy_version 67280 (0.0005) [2023-03-12 00:06:45,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11878.4, 300 sec: 11982.5). Total num frames: 34471936. Throughput: 0: 11954.7. Samples: 34463816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:06:45,672][106151] Avg episode reward: [(0, '4160.979')] [2023-03-12 00:06:46,990][106434] Updated weights for policy 0, policy_version 67360 (0.0005) [2023-03-12 00:06:50,553][106434] Updated weights for policy 0, policy_version 67440 (0.0005) [2023-03-12 00:06:50,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11878.4, 300 sec: 11954.8). Total num frames: 34529280. Throughput: 0: 11945.7. Samples: 34498004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:06:50,672][106151] Avg episode reward: [(0, '4058.137')] [2023-03-12 00:06:53,993][106434] Updated weights for policy 0, policy_version 67520 (0.0005) [2023-03-12 00:06:55,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11954.8). Total num frames: 34590720. Throughput: 0: 11912.2. Samples: 34568104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:06:55,661][106151] Avg episode reward: [(0, '4105.523')] [2023-03-12 00:06:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000067560_34590720.pth... [2023-03-12 00:06:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000066864_34234368.pth [2023-03-12 00:06:57,266][106434] Updated weights for policy 0, policy_version 67600 (0.0004) [2023-03-12 00:07:00,548][106434] Updated weights for policy 0, policy_version 67680 (0.0004) [2023-03-12 00:07:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11954.8). Total num frames: 34652160. Throughput: 0: 12031.8. Samples: 34643640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:07:00,672][106151] Avg episode reward: [(0, '4224.901')] [2023-03-12 00:07:03,787][106434] Updated weights for policy 0, policy_version 67760 (0.0004) [2023-03-12 00:07:05,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11940.9). Total num frames: 34713600. Throughput: 0: 12027.4. Samples: 34680896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:07:05,671][106151] Avg episode reward: [(0, '4309.281')] [2023-03-12 00:07:07,123][106434] Updated weights for policy 0, policy_version 67840 (0.0005) [2023-03-12 00:07:10,337][106434] Updated weights for policy 0, policy_version 67920 (0.0004) [2023-03-12 00:07:10,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12151.5, 300 sec: 11940.9). Total num frames: 34779136. Throughput: 0: 12026.0. Samples: 34755380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:07:10,661][106151] Avg episode reward: [(0, '4129.329')] [2023-03-12 00:07:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000067928_34779136.pth... [2023-03-12 00:07:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000067216_34414592.pth [2023-03-12 00:07:13,550][106434] Updated weights for policy 0, policy_version 68000 (0.0004) [2023-03-12 00:07:15,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 11940.9). Total num frames: 34840576. Throughput: 0: 12080.0. Samples: 34832384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:07:15,661][106151] Avg episode reward: [(0, '4386.058')] [2023-03-12 00:07:16,806][106434] Updated weights for policy 0, policy_version 68080 (0.0004) [2023-03-12 00:07:20,197][106434] Updated weights for policy 0, policy_version 68160 (0.0005) [2023-03-12 00:07:20,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11927.0). Total num frames: 34902016. Throughput: 0: 12110.6. Samples: 34869472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:07:20,662][106151] Avg episode reward: [(0, '4247.370')] [2023-03-12 00:07:23,728][106434] Updated weights for policy 0, policy_version 68240 (0.0006) [2023-03-12 00:07:25,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11927.0). Total num frames: 34959360. Throughput: 0: 12128.3. Samples: 34939896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:07:25,661][106151] Avg episode reward: [(0, '4479.384')] [2023-03-12 00:07:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000068280_34959360.pth... [2023-03-12 00:07:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000067560_34590720.pth [2023-03-12 00:07:27,205][106434] Updated weights for policy 0, policy_version 68320 (0.0005) [2023-03-12 00:07:30,509][106434] Updated weights for policy 0, policy_version 68400 (0.0005) [2023-03-12 00:07:30,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 11927.0). Total num frames: 35020800. Throughput: 0: 12182.1. Samples: 35012012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:07:30,661][106151] Avg episode reward: [(0, '4121.336')] [2023-03-12 00:07:33,952][106434] Updated weights for policy 0, policy_version 68480 (0.0005) [2023-03-12 00:07:35,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11913.1). Total num frames: 35078144. Throughput: 0: 12235.9. Samples: 35048620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:07:35,661][106151] Avg episode reward: [(0, '4097.686')] [2023-03-12 00:07:37,380][106434] Updated weights for policy 0, policy_version 68560 (0.0005) [2023-03-12 00:07:40,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 11899.2). Total num frames: 35139584. Throughput: 0: 12266.7. Samples: 35120108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:07:40,662][106151] Avg episode reward: [(0, '2959.492')] [2023-03-12 00:07:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000068632_35139584.pth... [2023-03-12 00:07:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000067928_34779136.pth [2023-03-12 00:07:40,720][106434] Updated weights for policy 0, policy_version 68640 (0.0005) [2023-03-12 00:07:44,177][106434] Updated weights for policy 0, policy_version 68720 (0.0005) [2023-03-12 00:07:45,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 11899.2). Total num frames: 35201024. Throughput: 0: 12192.5. Samples: 35192304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:07:45,661][106151] Avg episode reward: [(0, '3441.439')] [2023-03-12 00:07:47,671][106434] Updated weights for policy 0, policy_version 68800 (0.0005) [2023-03-12 00:07:50,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11885.3). Total num frames: 35258368. Throughput: 0: 12146.7. Samples: 35227496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:07:50,661][106151] Avg episode reward: [(0, '3692.030')] [2023-03-12 00:07:51,068][106434] Updated weights for policy 0, policy_version 68880 (0.0005) [2023-03-12 00:07:54,548][106434] Updated weights for policy 0, policy_version 68960 (0.0005) [2023-03-12 00:07:55,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12151.5, 300 sec: 11885.3). Total num frames: 35319808. Throughput: 0: 12087.7. Samples: 35299328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:07:55,661][106151] Avg episode reward: [(0, '3924.533')] [2023-03-12 00:07:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000068984_35319808.pth... [2023-03-12 00:07:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000068280_34959360.pth [2023-03-12 00:07:57,959][106434] Updated weights for policy 0, policy_version 69040 (0.0005) [2023-03-12 00:08:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11885.3). Total num frames: 35377152. Throughput: 0: 11958.2. Samples: 35370504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:08:00,662][106151] Avg episode reward: [(0, '4030.894')] [2023-03-12 00:08:01,397][106434] Updated weights for policy 0, policy_version 69120 (0.0005) [2023-03-12 00:08:04,864][106434] Updated weights for policy 0, policy_version 69200 (0.0005) [2023-03-12 00:08:05,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11885.3). Total num frames: 35438592. Throughput: 0: 11920.4. Samples: 35405888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:08:05,661][106151] Avg episode reward: [(0, '3731.564')] [2023-03-12 00:08:08,397][106434] Updated weights for policy 0, policy_version 69280 (0.0005) [2023-03-12 00:08:10,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11885.3). Total num frames: 35495936. Throughput: 0: 11915.5. Samples: 35476092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:08:10,662][106151] Avg episode reward: [(0, '3768.950')] [2023-03-12 00:08:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000069328_35495936.pth... [2023-03-12 00:08:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000068632_35139584.pth [2023-03-12 00:08:11,973][106434] Updated weights for policy 0, policy_version 69360 (0.0005) [2023-03-12 00:08:15,515][106434] Updated weights for policy 0, policy_version 69440 (0.0005) [2023-03-12 00:08:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11885.3). Total num frames: 35553280. Throughput: 0: 11850.3. Samples: 35545276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:08:15,662][106151] Avg episode reward: [(0, '3682.500')] [2023-03-12 00:08:19,090][106434] Updated weights for policy 0, policy_version 69520 (0.0005) [2023-03-12 00:08:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11885.3). Total num frames: 35610624. Throughput: 0: 11817.6. Samples: 35580412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:08:20,662][106151] Avg episode reward: [(0, '4115.529')] [2023-03-12 00:08:22,667][106434] Updated weights for policy 0, policy_version 69600 (0.0005) [2023-03-12 00:08:25,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 11885.3). Total num frames: 35667968. Throughput: 0: 11740.7. Samples: 35648440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:08:25,662][106151] Avg episode reward: [(0, '4178.796')] [2023-03-12 00:08:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000069664_35667968.pth... [2023-03-12 00:08:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000068984_35319808.pth [2023-03-12 00:08:26,135][106434] Updated weights for policy 0, policy_version 69680 (0.0005) [2023-03-12 00:08:29,677][106434] Updated weights for policy 0, policy_version 69760 (0.0005) [2023-03-12 00:08:30,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 11885.3). Total num frames: 35725312. Throughput: 0: 11701.9. Samples: 35718892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:08:30,661][106151] Avg episode reward: [(0, '4022.150')] [2023-03-12 00:08:33,247][106434] Updated weights for policy 0, policy_version 69840 (0.0005) [2023-03-12 00:08:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11871.5). Total num frames: 35782656. Throughput: 0: 11695.1. Samples: 35753776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:08:35,661][106151] Avg episode reward: [(0, '4055.948')] [2023-03-12 00:08:36,840][106434] Updated weights for policy 0, policy_version 69920 (0.0005) [2023-03-12 00:08:40,345][106434] Updated weights for policy 0, policy_version 70000 (0.0005) [2023-03-12 00:08:40,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11871.5). Total num frames: 35840000. Throughput: 0: 11623.7. Samples: 35822396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:08:40,661][106151] Avg episode reward: [(0, '4117.293')] [2023-03-12 00:08:40,688][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000070008_35844096.pth... [2023-03-12 00:08:40,690][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000069328_35495936.pth [2023-03-12 00:08:43,944][106434] Updated weights for policy 0, policy_version 70080 (0.0005) [2023-03-12 00:08:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11871.5). Total num frames: 35897344. Throughput: 0: 11563.2. Samples: 35890848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:08:45,661][106151] Avg episode reward: [(0, '4098.471')] [2023-03-12 00:08:47,482][106434] Updated weights for policy 0, policy_version 70160 (0.0005) [2023-03-12 00:08:50,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11885.3). Total num frames: 35958784. Throughput: 0: 11559.8. Samples: 35926080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:08:50,661][106151] Avg episode reward: [(0, '4134.675')] [2023-03-12 00:08:50,960][106434] Updated weights for policy 0, policy_version 70240 (0.0005) [2023-03-12 00:08:54,395][106434] Updated weights for policy 0, policy_version 70320 (0.0005) [2023-03-12 00:08:55,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 11871.5). Total num frames: 36016128. Throughput: 0: 11575.7. Samples: 35997000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:08:55,661][106151] Avg episode reward: [(0, '3896.846')] [2023-03-12 00:08:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000070344_36016128.pth... [2023-03-12 00:08:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000069664_35667968.pth [2023-03-12 00:08:57,947][106434] Updated weights for policy 0, policy_version 70400 (0.0005) [2023-03-12 00:09:00,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11871.5). Total num frames: 36073472. Throughput: 0: 11588.1. Samples: 36066740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:09:00,661][106151] Avg episode reward: [(0, '3656.033')] [2023-03-12 00:09:01,408][106434] Updated weights for policy 0, policy_version 70480 (0.0005) [2023-03-12 00:09:04,940][106434] Updated weights for policy 0, policy_version 70560 (0.0005) [2023-03-12 00:09:05,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11885.3). Total num frames: 36134912. Throughput: 0: 11595.7. Samples: 36102216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:09:05,661][106151] Avg episode reward: [(0, '3959.103')] [2023-03-12 00:09:08,324][106434] Updated weights for policy 0, policy_version 70640 (0.0005) [2023-03-12 00:09:10,661][106151] Fps is (10 sec: 11878.2, 60 sec: 11605.3, 300 sec: 11885.3). Total num frames: 36192256. Throughput: 0: 11674.0. Samples: 36173772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:09:10,662][106151] Avg episode reward: [(0, '3628.023')] [2023-03-12 00:09:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000070688_36192256.pth... [2023-03-12 00:09:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000070008_35844096.pth [2023-03-12 00:09:11,923][106434] Updated weights for policy 0, policy_version 70720 (0.0005) [2023-03-12 00:09:15,509][106434] Updated weights for policy 0, policy_version 70800 (0.0005) [2023-03-12 00:09:15,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11885.3). Total num frames: 36249600. Throughput: 0: 11612.9. Samples: 36241472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:09:15,662][106151] Avg episode reward: [(0, '3921.050')] [2023-03-12 00:09:19,098][106434] Updated weights for policy 0, policy_version 70880 (0.0005) [2023-03-12 00:09:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11885.3). Total num frames: 36306944. Throughput: 0: 11596.5. Samples: 36275620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:09:20,661][106151] Avg episode reward: [(0, '4287.959')] [2023-03-12 00:09:22,611][106434] Updated weights for policy 0, policy_version 70960 (0.0005) [2023-03-12 00:09:25,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11899.2). Total num frames: 36368384. Throughput: 0: 11650.0. Samples: 36346644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:09:25,662][106151] Avg episode reward: [(0, '4359.780')] [2023-03-12 00:09:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000071032_36368384.pth... [2023-03-12 00:09:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000070344_36016128.pth [2023-03-12 00:09:25,889][106434] Updated weights for policy 0, policy_version 71040 (0.0004) [2023-03-12 00:09:29,156][106434] Updated weights for policy 0, policy_version 71120 (0.0005) [2023-03-12 00:09:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11885.3). Total num frames: 36429824. Throughput: 0: 11795.4. Samples: 36421640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:09:30,661][106151] Avg episode reward: [(0, '4093.838')] [2023-03-12 00:09:32,533][106434] Updated weights for policy 0, policy_version 71200 (0.0004) [2023-03-12 00:09:35,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11810.1, 300 sec: 11885.3). Total num frames: 36491264. Throughput: 0: 11827.4. Samples: 36458312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:09:35,662][106151] Avg episode reward: [(0, '4068.825')] [2023-03-12 00:09:35,871][106434] Updated weights for policy 0, policy_version 71280 (0.0003) [2023-03-12 00:09:39,171][106434] Updated weights for policy 0, policy_version 71360 (0.0003) [2023-03-12 00:09:40,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11885.3). Total num frames: 36552704. Throughput: 0: 11893.9. Samples: 36532224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:09:40,661][106151] Avg episode reward: [(0, '4309.957')] [2023-03-12 00:09:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000071392_36552704.pth... [2023-03-12 00:09:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000070688_36192256.pth [2023-03-12 00:09:42,481][106434] Updated weights for policy 0, policy_version 71440 (0.0003) [2023-03-12 00:09:45,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11885.3). Total num frames: 36614144. Throughput: 0: 11998.4. Samples: 36606668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:09:45,661][106151] Avg episode reward: [(0, '4371.522')] [2023-03-12 00:09:45,699][106434] Updated weights for policy 0, policy_version 71520 (0.0003) [2023-03-12 00:09:49,068][106434] Updated weights for policy 0, policy_version 71600 (0.0003) [2023-03-12 00:09:50,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11871.5). Total num frames: 36675584. Throughput: 0: 12026.6. Samples: 36643412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:09:50,661][106151] Avg episode reward: [(0, '4020.630')] [2023-03-12 00:09:52,482][106434] Updated weights for policy 0, policy_version 71680 (0.0003) [2023-03-12 00:09:55,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12014.9, 300 sec: 11885.3). Total num frames: 36737024. Throughput: 0: 12063.1. Samples: 36716608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:09:55,661][106151] Avg episode reward: [(0, '4425.641')] [2023-03-12 00:09:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000071752_36737024.pth... [2023-03-12 00:09:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000071032_36368384.pth [2023-03-12 00:09:55,825][106434] Updated weights for policy 0, policy_version 71760 (0.0003) [2023-03-12 00:09:59,212][106434] Updated weights for policy 0, policy_version 71840 (0.0003) [2023-03-12 00:10:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11899.2). Total num frames: 36798464. Throughput: 0: 12184.1. Samples: 36789756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:10:00,661][106151] Avg episode reward: [(0, '4203.412')] [2023-03-12 00:10:02,498][106434] Updated weights for policy 0, policy_version 71920 (0.0005) [2023-03-12 00:10:05,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11899.2). Total num frames: 36859904. Throughput: 0: 12257.3. Samples: 36827200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:10:05,661][106151] Avg episode reward: [(0, '4236.518')] [2023-03-12 00:10:05,756][106434] Updated weights for policy 0, policy_version 72000 (0.0005) [2023-03-12 00:10:09,126][106434] Updated weights for policy 0, policy_version 72080 (0.0005) [2023-03-12 00:10:10,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12151.5, 300 sec: 11899.2). Total num frames: 36921344. Throughput: 0: 12318.9. Samples: 36900996. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:10:10,661][106151] Avg episode reward: [(0, '4296.875')] [2023-03-12 00:10:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000072112_36921344.pth... [2023-03-12 00:10:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000071392_36552704.pth [2023-03-12 00:10:12,417][106434] Updated weights for policy 0, policy_version 72160 (0.0005) [2023-03-12 00:10:15,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12219.8, 300 sec: 11913.1). Total num frames: 36982784. Throughput: 0: 12309.8. Samples: 36975580. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:10:15,661][106151] Avg episode reward: [(0, '3989.740')] [2023-03-12 00:10:15,685][106434] Updated weights for policy 0, policy_version 72240 (0.0004) [2023-03-12 00:10:18,920][106434] Updated weights for policy 0, policy_version 72320 (0.0004) [2023-03-12 00:10:20,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12356.3, 300 sec: 11940.9). Total num frames: 37048320. Throughput: 0: 12344.5. Samples: 37013812. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:10:20,661][106151] Avg episode reward: [(0, '3929.127')] [2023-03-12 00:10:22,195][106434] Updated weights for policy 0, policy_version 72400 (0.0005) [2023-03-12 00:10:25,426][106434] Updated weights for policy 0, policy_version 72480 (0.0004) [2023-03-12 00:10:25,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12356.3, 300 sec: 11954.8). Total num frames: 37109760. Throughput: 0: 12384.5. Samples: 37089528. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:10:25,661][106151] Avg episode reward: [(0, '4061.142')] [2023-03-12 00:10:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000072480_37109760.pth... [2023-03-12 00:10:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000071752_36737024.pth [2023-03-12 00:10:28,612][106434] Updated weights for policy 0, policy_version 72560 (0.0004) [2023-03-12 00:10:30,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 11982.5). Total num frames: 37175296. Throughput: 0: 12419.3. Samples: 37165536. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:10:30,661][106151] Avg episode reward: [(0, '4095.263')] [2023-03-12 00:10:31,942][106434] Updated weights for policy 0, policy_version 72640 (0.0005) [2023-03-12 00:10:35,529][106434] Updated weights for policy 0, policy_version 72720 (0.0006) [2023-03-12 00:10:35,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 11982.5). Total num frames: 37232640. Throughput: 0: 12405.2. Samples: 37201644. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:10:35,661][106151] Avg episode reward: [(0, '4127.346')] [2023-03-12 00:10:38,968][106434] Updated weights for policy 0, policy_version 72800 (0.0005) [2023-03-12 00:10:40,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12356.3, 300 sec: 11982.5). Total num frames: 37294080. Throughput: 0: 12335.4. Samples: 37271700. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:10:40,661][106151] Avg episode reward: [(0, '3667.128')] [2023-03-12 00:10:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000072840_37294080.pth... [2023-03-12 00:10:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000072112_36921344.pth [2023-03-12 00:10:42,257][106434] Updated weights for policy 0, policy_version 72880 (0.0004) [2023-03-12 00:10:45,557][106434] Updated weights for policy 0, policy_version 72960 (0.0004) [2023-03-12 00:10:45,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12356.2, 300 sec: 11996.4). Total num frames: 37355520. Throughput: 0: 12388.9. Samples: 37347256. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:10:45,661][106151] Avg episode reward: [(0, '4145.048')] [2023-03-12 00:10:48,743][106434] Updated weights for policy 0, policy_version 73040 (0.0004) [2023-03-12 00:10:50,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12424.5, 300 sec: 12024.2). Total num frames: 37421056. Throughput: 0: 12379.2. Samples: 37384264. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:10:50,661][106151] Avg episode reward: [(0, '3926.864')] [2023-03-12 00:10:51,930][106434] Updated weights for policy 0, policy_version 73120 (0.0004) [2023-03-12 00:10:55,256][106434] Updated weights for policy 0, policy_version 73200 (0.0005) [2023-03-12 00:10:55,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 12024.2). Total num frames: 37482496. Throughput: 0: 12450.0. Samples: 37461248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:10:55,661][106151] Avg episode reward: [(0, '4122.792')] [2023-03-12 00:10:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000073208_37482496.pth... [2023-03-12 00:10:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000072480_37109760.pth [2023-03-12 00:10:58,484][106434] Updated weights for policy 0, policy_version 73280 (0.0004) [2023-03-12 00:11:00,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 12038.1). Total num frames: 37543936. Throughput: 0: 12449.5. Samples: 37535808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:11:00,661][106151] Avg episode reward: [(0, '4196.959')] [2023-03-12 00:11:01,969][106434] Updated weights for policy 0, policy_version 73360 (0.0005) [2023-03-12 00:11:05,403][106434] Updated weights for policy 0, policy_version 73440 (0.0005) [2023-03-12 00:11:05,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 12038.1). Total num frames: 37601280. Throughput: 0: 12367.2. Samples: 37570336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:11:05,661][106151] Avg episode reward: [(0, '4250.025')] [2023-03-12 00:11:08,680][106434] Updated weights for policy 0, policy_version 73520 (0.0004) [2023-03-12 00:11:10,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 12052.0). Total num frames: 37666816. Throughput: 0: 12317.7. Samples: 37643824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:11:10,662][106151] Avg episode reward: [(0, '4207.717')] [2023-03-12 00:11:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000073568_37666816.pth... [2023-03-12 00:11:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000072840_37294080.pth [2023-03-12 00:11:11,909][106434] Updated weights for policy 0, policy_version 73600 (0.0004) [2023-03-12 00:11:15,178][106434] Updated weights for policy 0, policy_version 73680 (0.0005) [2023-03-12 00:11:15,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 12052.0). Total num frames: 37728256. Throughput: 0: 12323.0. Samples: 37720072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:11:15,661][106151] Avg episode reward: [(0, '4252.953')] [2023-03-12 00:11:18,369][106434] Updated weights for policy 0, policy_version 73760 (0.0004) [2023-03-12 00:11:20,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12424.5, 300 sec: 12065.8). Total num frames: 37793792. Throughput: 0: 12356.5. Samples: 37757688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:11:20,661][106151] Avg episode reward: [(0, '4485.075')] [2023-03-12 00:11:21,630][106434] Updated weights for policy 0, policy_version 73840 (0.0004) [2023-03-12 00:11:24,865][106434] Updated weights for policy 0, policy_version 73920 (0.0004) [2023-03-12 00:11:25,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 12065.8). Total num frames: 37855232. Throughput: 0: 12503.0. Samples: 37834336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:11:25,661][106151] Avg episode reward: [(0, '4388.060')] [2023-03-12 00:11:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000073936_37855232.pth... [2023-03-12 00:11:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000073208_37482496.pth [2023-03-12 00:11:28,082][106434] Updated weights for policy 0, policy_version 74000 (0.0004) [2023-03-12 00:11:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12065.8). Total num frames: 37916672. Throughput: 0: 12491.0. Samples: 37909348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:11:30,661][106151] Avg episode reward: [(0, '4296.322')] [2023-03-12 00:11:31,350][106434] Updated weights for policy 0, policy_version 74080 (0.0004) [2023-03-12 00:11:34,524][106434] Updated weights for policy 0, policy_version 74160 (0.0003) [2023-03-12 00:11:35,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12093.6). Total num frames: 37982208. Throughput: 0: 12520.1. Samples: 37947668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:11:35,661][106151] Avg episode reward: [(0, '4215.289')] [2023-03-12 00:11:37,842][106434] Updated weights for policy 0, policy_version 74240 (0.0004) [2023-03-12 00:11:40,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12107.5). Total num frames: 38043648. Throughput: 0: 12487.3. Samples: 38023176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:11:40,661][106151] Avg episode reward: [(0, '4348.008')] [2023-03-12 00:11:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000074304_38043648.pth... [2023-03-12 00:11:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000073568_37666816.pth [2023-03-12 00:11:41,101][106434] Updated weights for policy 0, policy_version 74320 (0.0004) [2023-03-12 00:11:44,309][106434] Updated weights for policy 0, policy_version 74400 (0.0004) [2023-03-12 00:11:45,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12135.3). Total num frames: 38109184. Throughput: 0: 12520.6. Samples: 38099236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:11:45,661][106151] Avg episode reward: [(0, '4296.077')] [2023-03-12 00:11:47,507][106434] Updated weights for policy 0, policy_version 74480 (0.0004) [2023-03-12 00:11:50,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12135.3). Total num frames: 38170624. Throughput: 0: 12613.0. Samples: 38137920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:11:50,661][106151] Avg episode reward: [(0, '4516.835')] [2023-03-12 00:11:50,662][106390] Saving new best policy, reward=4516.835! [2023-03-12 00:11:50,745][106434] Updated weights for policy 0, policy_version 74560 (0.0004) [2023-03-12 00:11:54,024][106434] Updated weights for policy 0, policy_version 74640 (0.0004) [2023-03-12 00:11:55,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12149.2). Total num frames: 38236160. Throughput: 0: 12646.2. Samples: 38212904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:11:55,661][106151] Avg episode reward: [(0, '4222.354')] [2023-03-12 00:11:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000074680_38236160.pth... [2023-03-12 00:11:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000073936_37855232.pth [2023-03-12 00:11:57,230][106434] Updated weights for policy 0, policy_version 74720 (0.0004) [2023-03-12 00:12:00,483][106434] Updated weights for policy 0, policy_version 74800 (0.0005) [2023-03-12 00:12:00,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12149.2). Total num frames: 38297600. Throughput: 0: 12652.2. Samples: 38289420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:12:00,661][106151] Avg episode reward: [(0, '4184.136')] [2023-03-12 00:12:03,752][106434] Updated weights for policy 0, policy_version 74880 (0.0004) [2023-03-12 00:12:05,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12629.3, 300 sec: 12135.3). Total num frames: 38359040. Throughput: 0: 12646.8. Samples: 38326796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:12:05,661][106151] Avg episode reward: [(0, '3979.790')] [2023-03-12 00:12:07,013][106434] Updated weights for policy 0, policy_version 74960 (0.0004) [2023-03-12 00:12:10,290][106434] Updated weights for policy 0, policy_version 75040 (0.0005) [2023-03-12 00:12:10,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12629.3, 300 sec: 12149.2). Total num frames: 38424576. Throughput: 0: 12625.1. Samples: 38402464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:12:10,661][106151] Avg episode reward: [(0, '4079.580')] [2023-03-12 00:12:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000075048_38424576.pth... [2023-03-12 00:12:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000074304_38043648.pth [2023-03-12 00:12:13,566][106434] Updated weights for policy 0, policy_version 75120 (0.0004) [2023-03-12 00:12:15,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12629.3, 300 sec: 12149.2). Total num frames: 38486016. Throughput: 0: 12606.1. Samples: 38476624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:12:15,661][106151] Avg episode reward: [(0, '4287.219')] [2023-03-12 00:12:16,850][106434] Updated weights for policy 0, policy_version 75200 (0.0003) [2023-03-12 00:12:20,149][106434] Updated weights for policy 0, policy_version 75280 (0.0003) [2023-03-12 00:12:20,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12163.0). Total num frames: 38547456. Throughput: 0: 12600.6. Samples: 38514696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:12:20,661][106151] Avg episode reward: [(0, '3902.680')] [2023-03-12 00:12:23,400][106434] Updated weights for policy 0, policy_version 75360 (0.0003) [2023-03-12 00:12:25,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12561.1, 300 sec: 12163.0). Total num frames: 38608896. Throughput: 0: 12589.4. Samples: 38589700. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:12:25,662][106151] Avg episode reward: [(0, '4048.510')] [2023-03-12 00:12:25,706][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000075416_38612992.pth... [2023-03-12 00:12:25,708][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000074680_38236160.pth [2023-03-12 00:12:26,741][106434] Updated weights for policy 0, policy_version 75440 (0.0003) [2023-03-12 00:12:29,984][106434] Updated weights for policy 0, policy_version 75520 (0.0003) [2023-03-12 00:12:30,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12190.8). Total num frames: 38674432. Throughput: 0: 12547.4. Samples: 38663868. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:12:30,661][106151] Avg episode reward: [(0, '4053.565')] [2023-03-12 00:12:33,291][106434] Updated weights for policy 0, policy_version 75600 (0.0003) [2023-03-12 00:12:35,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12492.8, 300 sec: 12176.9). Total num frames: 38731776. Throughput: 0: 12542.1. Samples: 38702316. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:12:35,661][106151] Avg episode reward: [(0, '3963.411')] [2023-03-12 00:12:36,729][106434] Updated weights for policy 0, policy_version 75680 (0.0003) [2023-03-12 00:12:40,077][106434] Updated weights for policy 0, policy_version 75760 (0.0003) [2023-03-12 00:12:40,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12492.8, 300 sec: 12176.9). Total num frames: 38793216. Throughput: 0: 12465.7. Samples: 38773860. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:12:40,662][106151] Avg episode reward: [(0, '4023.315')] [2023-03-12 00:12:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000075768_38793216.pth... [2023-03-12 00:12:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000075048_38424576.pth [2023-03-12 00:12:43,354][106434] Updated weights for policy 0, policy_version 75840 (0.0003) [2023-03-12 00:12:45,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12492.8, 300 sec: 12204.7). Total num frames: 38858752. Throughput: 0: 12428.1. Samples: 38848684. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:12:45,661][106151] Avg episode reward: [(0, '4016.337')] [2023-03-12 00:12:46,632][106434] Updated weights for policy 0, policy_version 75920 (0.0004) [2023-03-12 00:12:49,961][106434] Updated weights for policy 0, policy_version 76000 (0.0003) [2023-03-12 00:12:50,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12492.8, 300 sec: 12204.7). Total num frames: 38920192. Throughput: 0: 12423.3. Samples: 38885844. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:12:50,661][106151] Avg episode reward: [(0, '3757.390')] [2023-03-12 00:12:53,210][106434] Updated weights for policy 0, policy_version 76080 (0.0004) [2023-03-12 00:12:55,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 12218.6). Total num frames: 38981632. Throughput: 0: 12406.3. Samples: 38960748. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:12:55,662][106151] Avg episode reward: [(0, '4319.765')] [2023-03-12 00:12:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000076136_38981632.pth... [2023-03-12 00:12:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000075416_38612992.pth [2023-03-12 00:12:56,469][106434] Updated weights for policy 0, policy_version 76160 (0.0004) [2023-03-12 00:12:59,732][106434] Updated weights for policy 0, policy_version 76240 (0.0004) [2023-03-12 00:13:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12218.6). Total num frames: 39043072. Throughput: 0: 12426.7. Samples: 39035824. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:13:00,661][106151] Avg episode reward: [(0, '4092.535')] [2023-03-12 00:13:02,987][106434] Updated weights for policy 0, policy_version 76320 (0.0004) [2023-03-12 00:13:05,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12246.3). Total num frames: 39108608. Throughput: 0: 12422.2. Samples: 39073696. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:13:05,661][106151] Avg episode reward: [(0, '4429.058')] [2023-03-12 00:13:06,252][106434] Updated weights for policy 0, policy_version 76400 (0.0004) [2023-03-12 00:13:09,543][106434] Updated weights for policy 0, policy_version 76480 (0.0004) [2023-03-12 00:13:10,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 12260.2). Total num frames: 39170048. Throughput: 0: 12426.4. Samples: 39148888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:13:10,661][106151] Avg episode reward: [(0, '4140.038')] [2023-03-12 00:13:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000076504_39170048.pth... [2023-03-12 00:13:10,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000075768_38793216.pth [2023-03-12 00:13:13,164][106434] Updated weights for policy 0, policy_version 76560 (0.0006) [2023-03-12 00:13:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 12260.2). Total num frames: 39227392. Throughput: 0: 12312.4. Samples: 39217928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:13:15,661][106151] Avg episode reward: [(0, '4192.505')] [2023-03-12 00:13:16,695][106434] Updated weights for policy 0, policy_version 76640 (0.0005) [2023-03-12 00:13:20,034][106434] Updated weights for policy 0, policy_version 76720 (0.0005) [2023-03-12 00:13:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12288.0, 300 sec: 12260.2). Total num frames: 39284736. Throughput: 0: 12227.8. Samples: 39252568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:13:20,661][106151] Avg episode reward: [(0, '4432.888')] [2023-03-12 00:13:23,306][106434] Updated weights for policy 0, policy_version 76800 (0.0004) [2023-03-12 00:13:25,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12356.3, 300 sec: 12288.0). Total num frames: 39350272. Throughput: 0: 12319.6. Samples: 39328244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:13:25,662][106151] Avg episode reward: [(0, '4415.906')] [2023-03-12 00:13:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000076856_39350272.pth... [2023-03-12 00:13:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000076136_38981632.pth [2023-03-12 00:13:26,607][106434] Updated weights for policy 0, policy_version 76880 (0.0004) [2023-03-12 00:13:29,794][106434] Updated weights for policy 0, policy_version 76960 (0.0004) [2023-03-12 00:13:30,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 12301.9). Total num frames: 39411712. Throughput: 0: 12331.1. Samples: 39403584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:13:30,661][106151] Avg episode reward: [(0, '4366.070')] [2023-03-12 00:13:33,089][106434] Updated weights for policy 0, policy_version 77040 (0.0005) [2023-03-12 00:13:35,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12356.2, 300 sec: 12315.8). Total num frames: 39473152. Throughput: 0: 12338.0. Samples: 39441056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:13:35,661][106151] Avg episode reward: [(0, '4306.083')] [2023-03-12 00:13:36,377][106434] Updated weights for policy 0, policy_version 77120 (0.0004) [2023-03-12 00:13:39,629][106434] Updated weights for policy 0, policy_version 77200 (0.0004) [2023-03-12 00:13:40,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 12343.5). Total num frames: 39538688. Throughput: 0: 12347.2. Samples: 39516372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:13:40,661][106151] Avg episode reward: [(0, '4387.075')] [2023-03-12 00:13:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000077224_39538688.pth... [2023-03-12 00:13:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000076504_39170048.pth [2023-03-12 00:13:42,985][106434] Updated weights for policy 0, policy_version 77280 (0.0005) [2023-03-12 00:13:45,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12356.3, 300 sec: 12343.5). Total num frames: 39600128. Throughput: 0: 12317.2. Samples: 39590100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:13:45,661][106151] Avg episode reward: [(0, '4433.383')] [2023-03-12 00:13:46,280][106434] Updated weights for policy 0, policy_version 77360 (0.0004) [2023-03-12 00:13:49,557][106434] Updated weights for policy 0, policy_version 77440 (0.0005) [2023-03-12 00:13:50,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 12357.4). Total num frames: 39661568. Throughput: 0: 12308.0. Samples: 39627556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:13:50,661][106151] Avg episode reward: [(0, '4341.980')] [2023-03-12 00:13:52,853][106434] Updated weights for policy 0, policy_version 77520 (0.0005) [2023-03-12 00:13:55,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12356.3, 300 sec: 12371.3). Total num frames: 39723008. Throughput: 0: 12304.5. Samples: 39702592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:13:55,662][106151] Avg episode reward: [(0, '4328.752')] [2023-03-12 00:13:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000077584_39723008.pth... [2023-03-12 00:13:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000076856_39350272.pth [2023-03-12 00:13:56,101][106434] Updated weights for policy 0, policy_version 77600 (0.0004) [2023-03-12 00:13:59,295][106434] Updated weights for policy 0, policy_version 77680 (0.0004) [2023-03-12 00:14:00,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 12385.2). Total num frames: 39788544. Throughput: 0: 12471.6. Samples: 39779152. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:14:00,661][106151] Avg episode reward: [(0, '4458.193')] [2023-03-12 00:14:02,593][106434] Updated weights for policy 0, policy_version 77760 (0.0005) [2023-03-12 00:14:05,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12356.3, 300 sec: 12399.1). Total num frames: 39849984. Throughput: 0: 12522.1. Samples: 39816064. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:14:05,662][106151] Avg episode reward: [(0, '4449.702')] [2023-03-12 00:14:05,912][106434] Updated weights for policy 0, policy_version 77840 (0.0005) [2023-03-12 00:14:09,225][106434] Updated weights for policy 0, policy_version 77920 (0.0005) [2023-03-12 00:14:10,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12413.0). Total num frames: 39911424. Throughput: 0: 12495.7. Samples: 39890548. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:14:10,661][106151] Avg episode reward: [(0, '4241.996')] [2023-03-12 00:14:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000077952_39911424.pth... [2023-03-12 00:14:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000077224_39538688.pth [2023-03-12 00:14:12,487][106434] Updated weights for policy 0, policy_version 78000 (0.0004) [2023-03-12 00:14:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 12413.0). Total num frames: 39968768. Throughput: 0: 12419.7. Samples: 39962472. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:14:15,661][106151] Avg episode reward: [(0, '4190.898')] [2023-03-12 00:14:16,112][106434] Updated weights for policy 0, policy_version 78080 (0.0005) [2023-03-12 00:14:19,601][106434] Updated weights for policy 0, policy_version 78160 (0.0005) [2023-03-12 00:14:20,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 12413.0). Total num frames: 40030208. Throughput: 0: 12364.4. Samples: 39997452. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:14:20,662][106151] Avg episode reward: [(0, '4125.816')] [2023-03-12 00:14:23,131][106434] Updated weights for policy 0, policy_version 78240 (0.0005) [2023-03-12 00:14:25,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12288.0, 300 sec: 12399.1). Total num frames: 40087552. Throughput: 0: 12238.1. Samples: 40067084. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:14:25,661][106151] Avg episode reward: [(0, '4126.220')] [2023-03-12 00:14:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000078296_40087552.pth... [2023-03-12 00:14:25,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000077584_39723008.pth [2023-03-12 00:14:26,696][106434] Updated weights for policy 0, policy_version 78320 (0.0006) [2023-03-12 00:14:30,208][106434] Updated weights for policy 0, policy_version 78400 (0.0005) [2023-03-12 00:14:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12219.7, 300 sec: 12385.2). Total num frames: 40144896. Throughput: 0: 12147.0. Samples: 40136716. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:14:30,661][106151] Avg episode reward: [(0, '4337.784')] [2023-03-12 00:14:33,693][106434] Updated weights for policy 0, policy_version 78480 (0.0006) [2023-03-12 00:14:35,661][106151] Fps is (10 sec: 11468.7, 60 sec: 12151.5, 300 sec: 12371.3). Total num frames: 40202240. Throughput: 0: 12089.5. Samples: 40171584. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:14:35,661][106151] Avg episode reward: [(0, '4510.508')] [2023-03-12 00:14:37,068][106434] Updated weights for policy 0, policy_version 78560 (0.0004) [2023-03-12 00:14:40,589][106434] Updated weights for policy 0, policy_version 78640 (0.0005) [2023-03-12 00:14:40,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 12371.3). Total num frames: 40263680. Throughput: 0: 12020.2. Samples: 40243500. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:14:40,661][106151] Avg episode reward: [(0, '4213.176')] [2023-03-12 00:14:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000078640_40263680.pth... [2023-03-12 00:14:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000077952_39911424.pth [2023-03-12 00:14:44,195][106434] Updated weights for policy 0, policy_version 78720 (0.0005) [2023-03-12 00:14:45,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 12357.4). Total num frames: 40321024. Throughput: 0: 11853.2. Samples: 40312544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:14:45,661][106151] Avg episode reward: [(0, '4372.783')] [2023-03-12 00:14:47,767][106434] Updated weights for policy 0, policy_version 78800 (0.0005) [2023-03-12 00:14:50,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 12343.5). Total num frames: 40378368. Throughput: 0: 11775.8. Samples: 40345976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:14:50,661][106151] Avg episode reward: [(0, '4391.922')] [2023-03-12 00:14:51,329][106434] Updated weights for policy 0, policy_version 78880 (0.0005) [2023-03-12 00:14:54,955][106434] Updated weights for policy 0, policy_version 78960 (0.0005) [2023-03-12 00:14:55,661][106151] Fps is (10 sec: 11468.6, 60 sec: 11878.4, 300 sec: 12329.6). Total num frames: 40435712. Throughput: 0: 11659.6. Samples: 40415232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:14:55,662][106151] Avg episode reward: [(0, '4220.925')] [2023-03-12 00:14:55,666][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000078976_40435712.pth... [2023-03-12 00:14:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000078296_40087552.pth [2023-03-12 00:14:58,452][106434] Updated weights for policy 0, policy_version 79040 (0.0005) [2023-03-12 00:15:00,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11741.9, 300 sec: 12315.8). Total num frames: 40493056. Throughput: 0: 11608.7. Samples: 40484864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:15:00,661][106151] Avg episode reward: [(0, '4036.076')] [2023-03-12 00:15:01,984][106434] Updated weights for policy 0, policy_version 79120 (0.0005) [2023-03-12 00:15:05,628][106434] Updated weights for policy 0, policy_version 79200 (0.0005) [2023-03-12 00:15:05,661][106151] Fps is (10 sec: 11469.1, 60 sec: 11673.6, 300 sec: 12301.9). Total num frames: 40550400. Throughput: 0: 11591.8. Samples: 40519084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:15:05,661][106151] Avg episode reward: [(0, '4030.037')] [2023-03-12 00:15:09,241][106434] Updated weights for policy 0, policy_version 79280 (0.0005) [2023-03-12 00:15:10,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 12274.1). Total num frames: 40603648. Throughput: 0: 11557.4. Samples: 40587168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:15:10,661][106151] Avg episode reward: [(0, '4163.319')] [2023-03-12 00:15:10,687][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000079312_40607744.pth... [2023-03-12 00:15:10,690][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000078640_40263680.pth [2023-03-12 00:15:12,887][106434] Updated weights for policy 0, policy_version 79360 (0.0005) [2023-03-12 00:15:15,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 12246.3). Total num frames: 40660992. Throughput: 0: 11519.9. Samples: 40655112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:15:15,661][106151] Avg episode reward: [(0, '4164.283')] [2023-03-12 00:15:16,391][106434] Updated weights for policy 0, policy_version 79440 (0.0005) [2023-03-12 00:15:19,967][106434] Updated weights for policy 0, policy_version 79520 (0.0005) [2023-03-12 00:15:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 12232.5). Total num frames: 40718336. Throughput: 0: 11512.9. Samples: 40689664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:15:20,661][106151] Avg episode reward: [(0, '3763.278')] [2023-03-12 00:15:23,495][106434] Updated weights for policy 0, policy_version 79600 (0.0005) [2023-03-12 00:15:25,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11537.0, 300 sec: 12218.6). Total num frames: 40779776. Throughput: 0: 11462.3. Samples: 40759304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:15:25,661][106151] Avg episode reward: [(0, '4288.859')] [2023-03-12 00:15:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000079648_40779776.pth... [2023-03-12 00:15:25,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000078976_40435712.pth [2023-03-12 00:15:27,095][106434] Updated weights for policy 0, policy_version 79680 (0.0005) [2023-03-12 00:15:30,450][106434] Updated weights for policy 0, policy_version 79760 (0.0004) [2023-03-12 00:15:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 12218.6). Total num frames: 40837120. Throughput: 0: 11476.6. Samples: 40828992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:15:30,661][106151] Avg episode reward: [(0, '4250.559')] [2023-03-12 00:15:33,761][106434] Updated weights for policy 0, policy_version 79840 (0.0004) [2023-03-12 00:15:35,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 12218.6). Total num frames: 40898560. Throughput: 0: 11565.5. Samples: 40866424. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:15:35,661][106151] Avg episode reward: [(0, '4225.492')] [2023-03-12 00:15:37,156][106434] Updated weights for policy 0, policy_version 79920 (0.0004) [2023-03-12 00:15:40,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 12204.7). Total num frames: 40955904. Throughput: 0: 11631.6. Samples: 40938652. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:15:40,661][106151] Avg episode reward: [(0, '4088.278')] [2023-03-12 00:15:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000079992_40955904.pth... [2023-03-12 00:15:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000079312_40607744.pth [2023-03-12 00:15:40,733][106434] Updated weights for policy 0, policy_version 80000 (0.0005) [2023-03-12 00:15:44,317][106434] Updated weights for policy 0, policy_version 80080 (0.0005) [2023-03-12 00:15:45,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 12176.9). Total num frames: 41013248. Throughput: 0: 11605.4. Samples: 41007108. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:15:45,661][106151] Avg episode reward: [(0, '4104.219')] [2023-03-12 00:15:47,923][106434] Updated weights for policy 0, policy_version 80160 (0.0005) [2023-03-12 00:15:50,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 12163.0). Total num frames: 41070592. Throughput: 0: 11607.2. Samples: 41041408. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:15:50,661][106151] Avg episode reward: [(0, '3756.810')] [2023-03-12 00:15:51,520][106434] Updated weights for policy 0, policy_version 80240 (0.0005) [2023-03-12 00:15:55,140][106434] Updated weights for policy 0, policy_version 80320 (0.0005) [2023-03-12 00:15:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 12149.2). Total num frames: 41127936. Throughput: 0: 11604.2. Samples: 41109356. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:15:55,661][106151] Avg episode reward: [(0, '3838.086')] [2023-03-12 00:15:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000080328_41127936.pth... [2023-03-12 00:15:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000079648_40779776.pth [2023-03-12 00:15:58,725][106434] Updated weights for policy 0, policy_version 80400 (0.0005) [2023-03-12 00:16:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 12149.2). Total num frames: 41185280. Throughput: 0: 11600.9. Samples: 41177152. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:16:00,661][106151] Avg episode reward: [(0, '4217.427')] [2023-03-12 00:16:02,361][106434] Updated weights for policy 0, policy_version 80480 (0.0005) [2023-03-12 00:16:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 12121.4). Total num frames: 41242624. Throughput: 0: 11578.5. Samples: 41210696. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:16:05,661][106151] Avg episode reward: [(0, '4077.876')] [2023-03-12 00:16:05,997][106434] Updated weights for policy 0, policy_version 80560 (0.0005) [2023-03-12 00:16:09,544][106434] Updated weights for policy 0, policy_version 80640 (0.0005) [2023-03-12 00:16:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12107.5). Total num frames: 41299968. Throughput: 0: 11561.1. Samples: 41279552. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:16:10,661][106151] Avg episode reward: [(0, '4197.652')] [2023-03-12 00:16:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000080664_41299968.pth... [2023-03-12 00:16:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000079992_40955904.pth [2023-03-12 00:16:13,128][106434] Updated weights for policy 0, policy_version 80720 (0.0005) [2023-03-12 00:16:15,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 12079.7). Total num frames: 41357312. Throughput: 0: 11552.3. Samples: 41348844. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:16:15,661][106151] Avg episode reward: [(0, '3936.426')] [2023-03-12 00:16:16,616][106434] Updated weights for policy 0, policy_version 80800 (0.0005) [2023-03-12 00:16:20,155][106434] Updated weights for policy 0, policy_version 80880 (0.0005) [2023-03-12 00:16:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12065.8). Total num frames: 41414656. Throughput: 0: 11505.6. Samples: 41384176. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:16:20,661][106151] Avg episode reward: [(0, '2955.574')] [2023-03-12 00:16:23,860][106434] Updated weights for policy 0, policy_version 80960 (0.0006) [2023-03-12 00:16:25,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 12052.0). Total num frames: 41472000. Throughput: 0: 11397.1. Samples: 41451520. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:16:25,661][106151] Avg episode reward: [(0, '3686.665')] [2023-03-12 00:16:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000081000_41472000.pth... [2023-03-12 00:16:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000080328_41127936.pth [2023-03-12 00:16:27,452][106434] Updated weights for policy 0, policy_version 81040 (0.0005) [2023-03-12 00:16:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 12024.2). Total num frames: 41529344. Throughput: 0: 11412.7. Samples: 41520680. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:16:30,661][106151] Avg episode reward: [(0, '3080.833')] [2023-03-12 00:16:30,850][106434] Updated weights for policy 0, policy_version 81120 (0.0005) [2023-03-12 00:16:34,260][106434] Updated weights for policy 0, policy_version 81200 (0.0005) [2023-03-12 00:16:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 12010.3). Total num frames: 41586688. Throughput: 0: 11480.2. Samples: 41558016. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:16:35,661][106151] Avg episode reward: [(0, '3665.684')] [2023-03-12 00:16:37,959][106434] Updated weights for policy 0, policy_version 81280 (0.0005) [2023-03-12 00:16:40,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11982.5). Total num frames: 41644032. Throughput: 0: 11467.3. Samples: 41625384. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:16:40,662][106151] Avg episode reward: [(0, '3970.923')] [2023-03-12 00:16:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000081336_41644032.pth... [2023-03-12 00:16:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000080664_41299968.pth [2023-03-12 00:16:41,458][106434] Updated weights for policy 0, policy_version 81360 (0.0005) [2023-03-12 00:16:44,860][106434] Updated weights for policy 0, policy_version 81440 (0.0005) [2023-03-12 00:16:45,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11537.1, 300 sec: 11982.5). Total num frames: 41705472. Throughput: 0: 11558.1. Samples: 41697268. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:16:45,661][106151] Avg episode reward: [(0, '3763.498')] [2023-03-12 00:16:48,158][106434] Updated weights for policy 0, policy_version 81520 (0.0004) [2023-03-12 00:16:50,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11605.3, 300 sec: 11968.6). Total num frames: 41766912. Throughput: 0: 11633.6. Samples: 41734208. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:16:50,661][106151] Avg episode reward: [(0, '3815.757')] [2023-03-12 00:16:51,656][106434] Updated weights for policy 0, policy_version 81600 (0.0005) [2023-03-12 00:16:55,270][106434] Updated weights for policy 0, policy_version 81680 (0.0005) [2023-03-12 00:16:55,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 11954.8). Total num frames: 41824256. Throughput: 0: 11649.1. Samples: 41803760. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:16:55,661][106151] Avg episode reward: [(0, '4394.628')] [2023-03-12 00:16:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000081688_41824256.pth... [2023-03-12 00:16:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000081000_41472000.pth [2023-03-12 00:16:58,664][106434] Updated weights for policy 0, policy_version 81760 (0.0005) [2023-03-12 00:17:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11940.9). Total num frames: 41881600. Throughput: 0: 11698.8. Samples: 41875288. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:17:00,661][106151] Avg episode reward: [(0, '4156.166')] [2023-03-12 00:17:02,123][106434] Updated weights for policy 0, policy_version 81840 (0.0005) [2023-03-12 00:17:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11913.1). Total num frames: 41938944. Throughput: 0: 11691.0. Samples: 41910272. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:17:05,661][106151] Avg episode reward: [(0, '4122.305')] [2023-03-12 00:17:05,796][106434] Updated weights for policy 0, policy_version 81920 (0.0005) [2023-03-12 00:17:09,480][106434] Updated weights for policy 0, policy_version 82000 (0.0005) [2023-03-12 00:17:10,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11899.2). Total num frames: 41996288. Throughput: 0: 11659.4. Samples: 41976192. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:17:10,661][106151] Avg episode reward: [(0, '4353.976')] [2023-03-12 00:17:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000082024_41996288.pth... [2023-03-12 00:17:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000081336_41644032.pth [2023-03-12 00:17:13,127][106434] Updated weights for policy 0, policy_version 82080 (0.0005) [2023-03-12 00:17:15,661][106151] Fps is (10 sec: 11059.3, 60 sec: 11537.1, 300 sec: 11871.5). Total num frames: 42049536. Throughput: 0: 11632.8. Samples: 42044156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:17:15,661][106151] Avg episode reward: [(0, '4008.688')] [2023-03-12 00:17:16,805][106434] Updated weights for policy 0, policy_version 82160 (0.0005) [2023-03-12 00:17:20,399][106434] Updated weights for policy 0, policy_version 82240 (0.0005) [2023-03-12 00:17:20,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11857.6). Total num frames: 42106880. Throughput: 0: 11560.1. Samples: 42078220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:17:20,661][106151] Avg episode reward: [(0, '4099.128')] [2023-03-12 00:17:23,960][106434] Updated weights for policy 0, policy_version 82320 (0.0005) [2023-03-12 00:17:25,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11829.8). Total num frames: 42164224. Throughput: 0: 11585.3. Samples: 42146720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:17:25,661][106151] Avg episode reward: [(0, '3819.213')] [2023-03-12 00:17:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000082352_42164224.pth... [2023-03-12 00:17:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000081688_41824256.pth [2023-03-12 00:17:27,493][106434] Updated weights for policy 0, policy_version 82400 (0.0005) [2023-03-12 00:17:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11829.8). Total num frames: 42221568. Throughput: 0: 11529.6. Samples: 42216100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:17:30,661][106151] Avg episode reward: [(0, '4232.597')] [2023-03-12 00:17:31,033][106434] Updated weights for policy 0, policy_version 82480 (0.0005) [2023-03-12 00:17:34,612][106434] Updated weights for policy 0, policy_version 82560 (0.0005) [2023-03-12 00:17:35,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11815.9). Total num frames: 42278912. Throughput: 0: 11467.4. Samples: 42250240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:17:35,661][106151] Avg episode reward: [(0, '4226.422')] [2023-03-12 00:17:38,224][106434] Updated weights for policy 0, policy_version 82640 (0.0005) [2023-03-12 00:17:40,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11788.1). Total num frames: 42336256. Throughput: 0: 11453.2. Samples: 42319156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:17:40,661][106151] Avg episode reward: [(0, '4167.948')] [2023-03-12 00:17:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000082688_42336256.pth... [2023-03-12 00:17:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000082024_41996288.pth [2023-03-12 00:17:41,833][106434] Updated weights for policy 0, policy_version 82720 (0.0005) [2023-03-12 00:17:45,353][106434] Updated weights for policy 0, policy_version 82800 (0.0005) [2023-03-12 00:17:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11774.3). Total num frames: 42393600. Throughput: 0: 11395.9. Samples: 42388104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:17:45,661][106151] Avg episode reward: [(0, '4380.715')] [2023-03-12 00:17:48,945][106434] Updated weights for policy 0, policy_version 82880 (0.0005) [2023-03-12 00:17:50,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11400.5, 300 sec: 11760.4). Total num frames: 42450944. Throughput: 0: 11377.8. Samples: 42422272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:17:50,661][106151] Avg episode reward: [(0, '4371.319')] [2023-03-12 00:17:52,447][106434] Updated weights for policy 0, policy_version 82960 (0.0005) [2023-03-12 00:17:55,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 11760.4). Total num frames: 42512384. Throughput: 0: 11460.6. Samples: 42491916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:17:55,661][106151] Avg episode reward: [(0, '4415.781')] [2023-03-12 00:17:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000083032_42512384.pth... [2023-03-12 00:17:55,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000082352_42164224.pth [2023-03-12 00:17:55,949][106434] Updated weights for policy 0, policy_version 83040 (0.0005) [2023-03-12 00:17:59,420][106434] Updated weights for policy 0, policy_version 83120 (0.0004) [2023-03-12 00:18:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 11732.6). Total num frames: 42569728. Throughput: 0: 11508.1. Samples: 42562020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:18:00,661][106151] Avg episode reward: [(0, '4243.374')] [2023-03-12 00:18:02,924][106434] Updated weights for policy 0, policy_version 83200 (0.0006) [2023-03-12 00:18:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11718.7). Total num frames: 42627072. Throughput: 0: 11546.9. Samples: 42597832. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:18:05,661][106151] Avg episode reward: [(0, '4371.874')] [2023-03-12 00:18:06,366][106434] Updated weights for policy 0, policy_version 83280 (0.0005) [2023-03-12 00:18:09,780][106434] Updated weights for policy 0, policy_version 83360 (0.0005) [2023-03-12 00:18:10,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 42688512. Throughput: 0: 11608.0. Samples: 42669080. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:18:10,661][106151] Avg episode reward: [(0, '4250.936')] [2023-03-12 00:18:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000083376_42688512.pth... [2023-03-12 00:18:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000082688_42336256.pth [2023-03-12 00:18:13,329][106434] Updated weights for policy 0, policy_version 83440 (0.0005) [2023-03-12 00:18:15,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 11732.6). Total num frames: 42745856. Throughput: 0: 11629.4. Samples: 42739424. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:18:15,661][106151] Avg episode reward: [(0, '4138.544')] [2023-03-12 00:18:16,779][106434] Updated weights for policy 0, policy_version 83520 (0.0005) [2023-03-12 00:18:20,340][106434] Updated weights for policy 0, policy_version 83600 (0.0005) [2023-03-12 00:18:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11704.8). Total num frames: 42803200. Throughput: 0: 11650.8. Samples: 42774528. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:18:20,661][106151] Avg episode reward: [(0, '4140.731')] [2023-03-12 00:18:23,917][106434] Updated weights for policy 0, policy_version 83680 (0.0005) [2023-03-12 00:18:25,661][106151] Fps is (10 sec: 11878.2, 60 sec: 11673.6, 300 sec: 11704.8). Total num frames: 42864640. Throughput: 0: 11660.1. Samples: 42843864. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:18:25,662][106151] Avg episode reward: [(0, '4252.751')] [2023-03-12 00:18:25,666][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000083720_42864640.pth... [2023-03-12 00:18:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000083032_42512384.pth [2023-03-12 00:18:27,433][106434] Updated weights for policy 0, policy_version 83760 (0.0005) [2023-03-12 00:18:30,661][106151] Fps is (10 sec: 11878.2, 60 sec: 11673.6, 300 sec: 11691.0). Total num frames: 42921984. Throughput: 0: 11655.5. Samples: 42912604. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:18:30,662][106151] Avg episode reward: [(0, '4154.572')] [2023-03-12 00:18:31,016][106434] Updated weights for policy 0, policy_version 83840 (0.0005) [2023-03-12 00:18:34,498][106434] Updated weights for policy 0, policy_version 83920 (0.0005) [2023-03-12 00:18:35,661][106151] Fps is (10 sec: 11469.0, 60 sec: 11673.6, 300 sec: 11663.2). Total num frames: 42979328. Throughput: 0: 11666.4. Samples: 42947260. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:18:35,661][106151] Avg episode reward: [(0, '4060.835')] [2023-03-12 00:18:37,699][106434] Updated weights for policy 0, policy_version 84000 (0.0004) [2023-03-12 00:18:40,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11810.1, 300 sec: 11677.1). Total num frames: 43044864. Throughput: 0: 11786.7. Samples: 43022320. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:18:40,661][106151] Avg episode reward: [(0, '4151.214')] [2023-03-12 00:18:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000084072_43044864.pth... [2023-03-12 00:18:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000083376_42688512.pth [2023-03-12 00:18:40,979][106434] Updated weights for policy 0, policy_version 84080 (0.0004) [2023-03-12 00:18:44,504][106434] Updated weights for policy 0, policy_version 84160 (0.0005) [2023-03-12 00:18:45,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 11663.2). Total num frames: 43102208. Throughput: 0: 11822.1. Samples: 43094016. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:18:45,661][106151] Avg episode reward: [(0, '4192.224')] [2023-03-12 00:18:47,985][106434] Updated weights for policy 0, policy_version 84240 (0.0005) [2023-03-12 00:18:50,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11649.3). Total num frames: 43159552. Throughput: 0: 11802.6. Samples: 43128948. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:18:50,661][106151] Avg episode reward: [(0, '4186.533')] [2023-03-12 00:18:51,577][106434] Updated weights for policy 0, policy_version 84320 (0.0005) [2023-03-12 00:18:54,979][106434] Updated weights for policy 0, policy_version 84400 (0.0004) [2023-03-12 00:18:55,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11635.4). Total num frames: 43220992. Throughput: 0: 11753.6. Samples: 43197992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:18:55,662][106151] Avg episode reward: [(0, '4006.896')] [2023-03-12 00:18:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000084416_43220992.pth... [2023-03-12 00:18:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000083720_42864640.pth [2023-03-12 00:18:58,361][106434] Updated weights for policy 0, policy_version 84480 (0.0004) [2023-03-12 00:19:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11621.5). Total num frames: 43278336. Throughput: 0: 11795.4. Samples: 43270216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:19:00,661][106151] Avg episode reward: [(0, '3649.065')] [2023-03-12 00:19:01,874][106434] Updated weights for policy 0, policy_version 84560 (0.0005) [2023-03-12 00:19:05,453][106434] Updated weights for policy 0, policy_version 84640 (0.0005) [2023-03-12 00:19:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11607.6). Total num frames: 43335680. Throughput: 0: 11800.4. Samples: 43305548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:19:05,661][106151] Avg episode reward: [(0, '3967.291')] [2023-03-12 00:19:08,993][106434] Updated weights for policy 0, policy_version 84720 (0.0004) [2023-03-12 00:19:10,661][106151] Fps is (10 sec: 11468.6, 60 sec: 11741.8, 300 sec: 11607.6). Total num frames: 43393024. Throughput: 0: 11805.7. Samples: 43375120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:19:10,662][106151] Avg episode reward: [(0, '4152.267')] [2023-03-12 00:19:10,690][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000084760_43397120.pth... [2023-03-12 00:19:10,693][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000084072_43044864.pth [2023-03-12 00:19:12,423][106434] Updated weights for policy 0, policy_version 84800 (0.0005) [2023-03-12 00:19:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11607.6). Total num frames: 43454464. Throughput: 0: 11836.9. Samples: 43445264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:19:15,661][106151] Avg episode reward: [(0, '4075.757')] [2023-03-12 00:19:15,945][106434] Updated weights for policy 0, policy_version 84880 (0.0005) [2023-03-12 00:19:19,336][106434] Updated weights for policy 0, policy_version 84960 (0.0005) [2023-03-12 00:19:20,661][106151] Fps is (10 sec: 12288.2, 60 sec: 11878.4, 300 sec: 11621.5). Total num frames: 43515904. Throughput: 0: 11861.1. Samples: 43481008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:19:20,661][106151] Avg episode reward: [(0, '3883.710')] [2023-03-12 00:19:22,690][106434] Updated weights for policy 0, policy_version 85040 (0.0004) [2023-03-12 00:19:25,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11810.2, 300 sec: 11621.5). Total num frames: 43573248. Throughput: 0: 11812.7. Samples: 43553892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:19:25,662][106151] Avg episode reward: [(0, '4096.406')] [2023-03-12 00:19:25,688][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000085112_43577344.pth... [2023-03-12 00:19:25,690][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000084416_43220992.pth [2023-03-12 00:19:26,003][106434] Updated weights for policy 0, policy_version 85120 (0.0004) [2023-03-12 00:19:29,263][106434] Updated weights for policy 0, policy_version 85200 (0.0003) [2023-03-12 00:19:30,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11649.3). Total num frames: 43638784. Throughput: 0: 11893.6. Samples: 43629228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:19:30,661][106151] Avg episode reward: [(0, '4249.313')] [2023-03-12 00:19:32,736][106434] Updated weights for policy 0, policy_version 85280 (0.0005) [2023-03-12 00:19:35,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11635.4). Total num frames: 43696128. Throughput: 0: 11891.4. Samples: 43664060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:19:35,661][106151] Avg episode reward: [(0, '4003.370')] [2023-03-12 00:19:36,062][106434] Updated weights for policy 0, policy_version 85360 (0.0005) [2023-03-12 00:19:39,408][106434] Updated weights for policy 0, policy_version 85440 (0.0005) [2023-03-12 00:19:40,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 11649.3). Total num frames: 43757568. Throughput: 0: 11982.6. Samples: 43737208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:19:40,661][106151] Avg episode reward: [(0, '4223.404')] [2023-03-12 00:19:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000085464_43757568.pth... [2023-03-12 00:19:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000084760_43397120.pth [2023-03-12 00:19:42,801][106434] Updated weights for policy 0, policy_version 85520 (0.0004) [2023-03-12 00:19:45,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11663.2). Total num frames: 43819008. Throughput: 0: 12015.0. Samples: 43810892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:19:45,661][106151] Avg episode reward: [(0, '3841.271')] [2023-03-12 00:19:46,156][106434] Updated weights for policy 0, policy_version 85600 (0.0004) [2023-03-12 00:19:49,672][106434] Updated weights for policy 0, policy_version 85680 (0.0005) [2023-03-12 00:19:50,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11663.2). Total num frames: 43876352. Throughput: 0: 12036.7. Samples: 43847200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:19:50,662][106151] Avg episode reward: [(0, '4154.250')] [2023-03-12 00:19:53,055][106434] Updated weights for policy 0, policy_version 85760 (0.0005) [2023-03-12 00:19:55,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11677.1). Total num frames: 43937792. Throughput: 0: 12080.7. Samples: 43918752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:19:55,661][106151] Avg episode reward: [(0, '4075.322')] [2023-03-12 00:19:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000085816_43937792.pth... [2023-03-12 00:19:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000085112_43577344.pth [2023-03-12 00:19:56,397][106434] Updated weights for policy 0, policy_version 85840 (0.0004) [2023-03-12 00:19:59,781][106434] Updated weights for policy 0, policy_version 85920 (0.0004) [2023-03-12 00:20:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11691.0). Total num frames: 43999232. Throughput: 0: 12131.9. Samples: 43991200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:20:00,662][106151] Avg episode reward: [(0, '4426.825')] [2023-03-12 00:20:03,317][106434] Updated weights for policy 0, policy_version 86000 (0.0005) [2023-03-12 00:20:05,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12014.9, 300 sec: 11704.8). Total num frames: 44056576. Throughput: 0: 12120.5. Samples: 44026428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:20:05,661][106151] Avg episode reward: [(0, '4289.836')] [2023-03-12 00:20:06,704][106434] Updated weights for policy 0, policy_version 86080 (0.0005) [2023-03-12 00:20:10,113][106434] Updated weights for policy 0, policy_version 86160 (0.0004) [2023-03-12 00:20:10,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11718.7). Total num frames: 44118016. Throughput: 0: 12083.5. Samples: 44097648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:20:10,662][106151] Avg episode reward: [(0, '3836.376')] [2023-03-12 00:20:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000086168_44118016.pth... [2023-03-12 00:20:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000085464_43757568.pth [2023-03-12 00:20:13,660][106434] Updated weights for policy 0, policy_version 86240 (0.0005) [2023-03-12 00:20:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11718.7). Total num frames: 44175360. Throughput: 0: 11983.8. Samples: 44168500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:20:15,661][106151] Avg episode reward: [(0, '4394.190')] [2023-03-12 00:20:17,196][106434] Updated weights for policy 0, policy_version 86320 (0.0005) [2023-03-12 00:20:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11704.8). Total num frames: 44232704. Throughput: 0: 11992.8. Samples: 44203736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:20:20,661][106151] Avg episode reward: [(0, '4117.007')] [2023-03-12 00:20:20,824][106434] Updated weights for policy 0, policy_version 86400 (0.0005) [2023-03-12 00:20:24,345][106434] Updated weights for policy 0, policy_version 86480 (0.0004) [2023-03-12 00:20:25,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11718.7). Total num frames: 44294144. Throughput: 0: 11866.4. Samples: 44271196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:20:25,661][106151] Avg episode reward: [(0, '4153.786')] [2023-03-12 00:20:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000086512_44294144.pth... [2023-03-12 00:20:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000085816_43937792.pth [2023-03-12 00:20:27,683][106434] Updated weights for policy 0, policy_version 86560 (0.0003) [2023-03-12 00:20:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11704.8). Total num frames: 44351488. Throughput: 0: 11843.1. Samples: 44343832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:20:30,661][106151] Avg episode reward: [(0, '4128.309')] [2023-03-12 00:20:31,139][106434] Updated weights for policy 0, policy_version 86640 (0.0004) [2023-03-12 00:20:34,790][106434] Updated weights for policy 0, policy_version 86720 (0.0005) [2023-03-12 00:20:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11704.8). Total num frames: 44408832. Throughput: 0: 11821.0. Samples: 44379144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:20:35,661][106151] Avg episode reward: [(0, '4181.200')] [2023-03-12 00:20:38,388][106434] Updated weights for policy 0, policy_version 86800 (0.0005) [2023-03-12 00:20:40,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11704.8). Total num frames: 44466176. Throughput: 0: 11721.2. Samples: 44446204. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:20:40,661][106151] Avg episode reward: [(0, '4021.462')] [2023-03-12 00:20:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000086848_44466176.pth... [2023-03-12 00:20:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000086168_44118016.pth [2023-03-12 00:20:41,979][106434] Updated weights for policy 0, policy_version 86880 (0.0005) [2023-03-12 00:20:45,568][106434] Updated weights for policy 0, policy_version 86960 (0.0005) [2023-03-12 00:20:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11704.8). Total num frames: 44523520. Throughput: 0: 11647.3. Samples: 44515328. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:20:45,661][106151] Avg episode reward: [(0, '4056.802')] [2023-03-12 00:20:49,094][106434] Updated weights for policy 0, policy_version 87040 (0.0005) [2023-03-12 00:20:50,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11704.8). Total num frames: 44580864. Throughput: 0: 11640.4. Samples: 44550248. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:20:50,661][106151] Avg episode reward: [(0, '3834.078')] [2023-03-12 00:20:52,648][106434] Updated weights for policy 0, policy_version 87120 (0.0005) [2023-03-12 00:20:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11704.8). Total num frames: 44638208. Throughput: 0: 11589.9. Samples: 44619192. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:20:55,661][106151] Avg episode reward: [(0, '3807.842')] [2023-03-12 00:20:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000087184_44638208.pth... [2023-03-12 00:20:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000086512_44294144.pth [2023-03-12 00:20:56,152][106434] Updated weights for policy 0, policy_version 87200 (0.0005) [2023-03-12 00:20:59,672][106434] Updated weights for policy 0, policy_version 87280 (0.0005) [2023-03-12 00:21:00,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11704.8). Total num frames: 44695552. Throughput: 0: 11568.5. Samples: 44689080. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:21:00,661][106151] Avg episode reward: [(0, '4133.830')] [2023-03-12 00:21:03,205][106434] Updated weights for policy 0, policy_version 87360 (0.0005) [2023-03-12 00:21:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11704.8). Total num frames: 44752896. Throughput: 0: 11567.8. Samples: 44724288. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:21:05,661][106151] Avg episode reward: [(0, '3648.158')] [2023-03-12 00:21:06,787][106434] Updated weights for policy 0, policy_version 87440 (0.0005) [2023-03-12 00:21:10,405][106434] Updated weights for policy 0, policy_version 87520 (0.0005) [2023-03-12 00:21:10,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11704.8). Total num frames: 44810240. Throughput: 0: 11584.4. Samples: 44792496. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:21:10,661][106151] Avg episode reward: [(0, '4025.854')] [2023-03-12 00:21:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000087520_44810240.pth... [2023-03-12 00:21:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000086848_44466176.pth [2023-03-12 00:21:13,935][106434] Updated weights for policy 0, policy_version 87600 (0.0005) [2023-03-12 00:21:15,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11704.8). Total num frames: 44867584. Throughput: 0: 11493.6. Samples: 44861044. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:21:15,661][106151] Avg episode reward: [(0, '4070.030')] [2023-03-12 00:21:17,639][106434] Updated weights for policy 0, policy_version 87680 (0.0005) [2023-03-12 00:21:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11704.8). Total num frames: 44924928. Throughput: 0: 11453.9. Samples: 44894568. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:21:20,661][106151] Avg episode reward: [(0, '4214.278')] [2023-03-12 00:21:21,162][106434] Updated weights for policy 0, policy_version 87760 (0.0005) [2023-03-12 00:21:24,693][106434] Updated weights for policy 0, policy_version 87840 (0.0005) [2023-03-12 00:21:25,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11704.8). Total num frames: 44982272. Throughput: 0: 11500.7. Samples: 44963736. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:21:25,661][106151] Avg episode reward: [(0, '4131.144')] [2023-03-12 00:21:25,663][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000087856_44982272.pth... [2023-03-12 00:21:25,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000087184_44638208.pth [2023-03-12 00:21:25,713][106390] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000005 [2023-03-12 00:21:28,264][106434] Updated weights for policy 0, policy_version 87920 (0.0005) [2023-03-12 00:21:30,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11704.8). Total num frames: 45039616. Throughput: 0: 11508.6. Samples: 45033216. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:21:30,661][106151] Avg episode reward: [(0, '4272.808')] [2023-03-12 00:21:31,712][106434] Updated weights for policy 0, policy_version 88000 (0.0005) [2023-03-12 00:21:35,301][106434] Updated weights for policy 0, policy_version 88080 (0.0005) [2023-03-12 00:21:35,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 11718.7). Total num frames: 45101056. Throughput: 0: 11512.2. Samples: 45068296. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:21:35,661][106151] Avg episode reward: [(0, '4448.423')] [2023-03-12 00:21:38,687][106434] Updated weights for policy 0, policy_version 88160 (0.0004) [2023-03-12 00:21:40,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11605.3, 300 sec: 11718.7). Total num frames: 45162496. Throughput: 0: 11564.4. Samples: 45139588. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:21:40,661][106151] Avg episode reward: [(0, '4315.603')] [2023-03-12 00:21:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000088208_45162496.pth... [2023-03-12 00:21:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000087520_44810240.pth [2023-03-12 00:21:41,949][106434] Updated weights for policy 0, policy_version 88240 (0.0003) [2023-03-12 00:21:45,309][106434] Updated weights for policy 0, policy_version 88320 (0.0003) [2023-03-12 00:21:45,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 11718.7). Total num frames: 45223936. Throughput: 0: 11659.3. Samples: 45213748. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:21:45,661][106151] Avg episode reward: [(0, '4326.167')] [2023-03-12 00:21:48,612][106434] Updated weights for policy 0, policy_version 88400 (0.0003) [2023-03-12 00:21:50,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11741.9, 300 sec: 11732.6). Total num frames: 45285376. Throughput: 0: 11704.5. Samples: 45250992. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:21:50,665][106151] Avg episode reward: [(0, '3834.432')] [2023-03-12 00:21:51,905][106434] Updated weights for policy 0, policy_version 88480 (0.0003) [2023-03-12 00:21:55,188][106434] Updated weights for policy 0, policy_version 88560 (0.0003) [2023-03-12 00:21:55,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11810.1, 300 sec: 11746.5). Total num frames: 45346816. Throughput: 0: 11860.7. Samples: 45326228. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:21:55,662][106151] Avg episode reward: [(0, '3914.087')] [2023-03-12 00:21:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000088568_45346816.pth... [2023-03-12 00:21:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000087856_44982272.pth [2023-03-12 00:21:58,497][106434] Updated weights for policy 0, policy_version 88640 (0.0004) [2023-03-12 00:22:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11760.4). Total num frames: 45408256. Throughput: 0: 11967.6. Samples: 45399588. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:22:00,672][106151] Avg episode reward: [(0, '4158.458')] [2023-03-12 00:22:02,019][106434] Updated weights for policy 0, policy_version 88720 (0.0005) [2023-03-12 00:22:05,356][106434] Updated weights for policy 0, policy_version 88800 (0.0005) [2023-03-12 00:22:05,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 11760.4). Total num frames: 45465600. Throughput: 0: 12002.1. Samples: 45434664. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:22:05,672][106151] Avg episode reward: [(0, '4242.265')] [2023-03-12 00:22:08,823][106434] Updated weights for policy 0, policy_version 88880 (0.0005) [2023-03-12 00:22:10,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11788.1). Total num frames: 45527040. Throughput: 0: 12064.2. Samples: 45506624. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:22:10,662][106151] Avg episode reward: [(0, '3976.248')] [2023-03-12 00:22:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000088920_45527040.pth... [2023-03-12 00:22:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000088208_45162496.pth [2023-03-12 00:22:12,332][106434] Updated weights for policy 0, policy_version 88960 (0.0005) [2023-03-12 00:22:15,661][106151] Fps is (10 sec: 11878.6, 60 sec: 11946.7, 300 sec: 11788.2). Total num frames: 45584384. Throughput: 0: 12101.2. Samples: 45577768. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:22:15,672][106151] Avg episode reward: [(0, '4158.155')] [2023-03-12 00:22:15,771][106434] Updated weights for policy 0, policy_version 89040 (0.0005) [2023-03-12 00:22:19,312][106434] Updated weights for policy 0, policy_version 89120 (0.0005) [2023-03-12 00:22:20,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11946.7, 300 sec: 11788.1). Total num frames: 45641728. Throughput: 0: 12098.3. Samples: 45612720. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 00:22:20,662][106151] Avg episode reward: [(0, '4139.882')] [2023-03-12 00:22:22,734][106434] Updated weights for policy 0, policy_version 89200 (0.0005) [2023-03-12 00:22:25,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12014.9, 300 sec: 11802.0). Total num frames: 45703168. Throughput: 0: 12091.4. Samples: 45683700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:22:25,661][106151] Avg episode reward: [(0, '3846.748')] [2023-03-12 00:22:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000089264_45703168.pth... [2023-03-12 00:22:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000088568_45346816.pth [2023-03-12 00:22:26,227][106434] Updated weights for policy 0, policy_version 89280 (0.0005) [2023-03-12 00:22:29,680][106434] Updated weights for policy 0, policy_version 89360 (0.0005) [2023-03-12 00:22:30,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12014.9, 300 sec: 11802.0). Total num frames: 45760512. Throughput: 0: 12007.9. Samples: 45754104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:22:30,661][106151] Avg episode reward: [(0, '4303.327')] [2023-03-12 00:22:33,231][106434] Updated weights for policy 0, policy_version 89440 (0.0005) [2023-03-12 00:22:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11802.0). Total num frames: 45817856. Throughput: 0: 11959.8. Samples: 45789184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:22:35,672][106151] Avg episode reward: [(0, '4258.918')] [2023-03-12 00:22:36,806][106434] Updated weights for policy 0, policy_version 89520 (0.0005) [2023-03-12 00:22:40,324][106434] Updated weights for policy 0, policy_version 89600 (0.0005) [2023-03-12 00:22:40,661][106151] Fps is (10 sec: 11468.6, 60 sec: 11878.4, 300 sec: 11802.0). Total num frames: 45875200. Throughput: 0: 11829.7. Samples: 45858568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:22:40,662][106151] Avg episode reward: [(0, '4108.517')] [2023-03-12 00:22:40,699][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000089608_45879296.pth... [2023-03-12 00:22:40,701][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000088920_45527040.pth [2023-03-12 00:22:43,905][106434] Updated weights for policy 0, policy_version 89680 (0.0005) [2023-03-12 00:22:45,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 11802.0). Total num frames: 45932544. Throughput: 0: 11725.4. Samples: 45927232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:22:45,672][106151] Avg episode reward: [(0, '4162.217')] [2023-03-12 00:22:47,468][106434] Updated weights for policy 0, policy_version 89760 (0.0005) [2023-03-12 00:22:50,661][106151] Fps is (10 sec: 11878.8, 60 sec: 11810.2, 300 sec: 11802.0). Total num frames: 45993984. Throughput: 0: 11701.6. Samples: 45961232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:22:50,661][106151] Avg episode reward: [(0, '3833.595')] [2023-03-12 00:22:51,000][106434] Updated weights for policy 0, policy_version 89840 (0.0005) [2023-03-12 00:22:54,544][106434] Updated weights for policy 0, policy_version 89920 (0.0005) [2023-03-12 00:22:55,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11802.0). Total num frames: 46051328. Throughput: 0: 11651.0. Samples: 46030920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:22:55,661][106151] Avg episode reward: [(0, '4045.577')] [2023-03-12 00:22:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000089944_46051328.pth... [2023-03-12 00:22:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000089264_45703168.pth [2023-03-12 00:22:58,023][106434] Updated weights for policy 0, policy_version 90000 (0.0005) [2023-03-12 00:23:00,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11741.9, 300 sec: 11815.9). Total num frames: 46112768. Throughput: 0: 11655.5. Samples: 46102268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:23:00,672][106151] Avg episode reward: [(0, '3895.618')] [2023-03-12 00:23:01,296][106434] Updated weights for policy 0, policy_version 90080 (0.0005) [2023-03-12 00:23:04,559][106434] Updated weights for policy 0, policy_version 90160 (0.0005) [2023-03-12 00:23:05,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11810.2, 300 sec: 11815.9). Total num frames: 46174208. Throughput: 0: 11727.2. Samples: 46140444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:23:05,672][106151] Avg episode reward: [(0, '3811.117')] [2023-03-12 00:23:07,822][106434] Updated weights for policy 0, policy_version 90240 (0.0004) [2023-03-12 00:23:10,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11810.1, 300 sec: 11829.8). Total num frames: 46235648. Throughput: 0: 11820.1. Samples: 46215604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:23:10,662][106151] Avg episode reward: [(0, '4295.187')] [2023-03-12 00:23:10,670][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000090312_46239744.pth... [2023-03-12 00:23:10,671][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000089608_45879296.pth [2023-03-12 00:23:11,051][106434] Updated weights for policy 0, policy_version 90320 (0.0003) [2023-03-12 00:23:14,557][106434] Updated weights for policy 0, policy_version 90400 (0.0005) [2023-03-12 00:23:15,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11843.7). Total num frames: 46297088. Throughput: 0: 11872.4. Samples: 46288360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:23:15,672][106151] Avg episode reward: [(0, '4345.502')] [2023-03-12 00:23:18,084][106434] Updated weights for policy 0, policy_version 90480 (0.0005) [2023-03-12 00:23:20,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 11829.8). Total num frames: 46354432. Throughput: 0: 11858.5. Samples: 46322816. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:23:20,672][106151] Avg episode reward: [(0, '4515.007')] [2023-03-12 00:23:21,611][106434] Updated weights for policy 0, policy_version 90560 (0.0005) [2023-03-12 00:23:25,088][106434] Updated weights for policy 0, policy_version 90640 (0.0005) [2023-03-12 00:23:25,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 11829.8). Total num frames: 46411776. Throughput: 0: 11861.2. Samples: 46392320. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:23:25,662][106151] Avg episode reward: [(0, '4346.725')] [2023-03-12 00:23:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000090648_46411776.pth... [2023-03-12 00:23:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000089944_46051328.pth [2023-03-12 00:23:28,514][106434] Updated weights for policy 0, policy_version 90720 (0.0005) [2023-03-12 00:23:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11843.7). Total num frames: 46473216. Throughput: 0: 11951.2. Samples: 46465036. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:23:30,661][106151] Avg episode reward: [(0, '4480.853')] [2023-03-12 00:23:31,790][106434] Updated weights for policy 0, policy_version 90800 (0.0004) [2023-03-12 00:23:35,266][106434] Updated weights for policy 0, policy_version 90880 (0.0005) [2023-03-12 00:23:35,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11829.8). Total num frames: 46534656. Throughput: 0: 12016.0. Samples: 46501952. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:23:35,661][106151] Avg episode reward: [(0, '4133.422')] [2023-03-12 00:23:38,689][106434] Updated weights for policy 0, policy_version 90960 (0.0005) [2023-03-12 00:23:40,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11829.8). Total num frames: 46592000. Throughput: 0: 12050.3. Samples: 46573184. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:23:40,662][106151] Avg episode reward: [(0, '3930.015')] [2023-03-12 00:23:40,688][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000091008_46596096.pth... [2023-03-12 00:23:40,689][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000090312_46239744.pth [2023-03-12 00:23:42,073][106434] Updated weights for policy 0, policy_version 91040 (0.0005) [2023-03-12 00:23:45,455][106434] Updated weights for policy 0, policy_version 91120 (0.0004) [2023-03-12 00:23:45,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11843.7). Total num frames: 46653440. Throughput: 0: 12089.8. Samples: 46646308. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:23:45,661][106151] Avg episode reward: [(0, '3623.969')] [2023-03-12 00:23:49,045][106434] Updated weights for policy 0, policy_version 91200 (0.0005) [2023-03-12 00:23:50,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12014.9, 300 sec: 11843.7). Total num frames: 46714880. Throughput: 0: 11992.0. Samples: 46680084. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:23:50,661][106151] Avg episode reward: [(0, '4039.973')] [2023-03-12 00:23:52,243][106434] Updated weights for policy 0, policy_version 91280 (0.0003) [2023-03-12 00:23:55,466][106434] Updated weights for policy 0, policy_version 91360 (0.0003) [2023-03-12 00:23:55,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11857.6). Total num frames: 46776320. Throughput: 0: 11995.2. Samples: 46755388. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:23:55,662][106151] Avg episode reward: [(0, '4122.109')] [2023-03-12 00:23:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000091360_46776320.pth... [2023-03-12 00:23:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000090648_46411776.pth [2023-03-12 00:23:58,776][106434] Updated weights for policy 0, policy_version 91440 (0.0004) [2023-03-12 00:24:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11871.5). Total num frames: 46837760. Throughput: 0: 12036.3. Samples: 46829992. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:24:00,661][106151] Avg episode reward: [(0, '4204.657')] [2023-03-12 00:24:02,038][106434] Updated weights for policy 0, policy_version 91520 (0.0004) [2023-03-12 00:24:05,278][106434] Updated weights for policy 0, policy_version 91600 (0.0004) [2023-03-12 00:24:05,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12151.5, 300 sec: 11899.2). Total num frames: 46903296. Throughput: 0: 12113.1. Samples: 46867904. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:24:05,662][106151] Avg episode reward: [(0, '4174.681')] [2023-03-12 00:24:08,510][106434] Updated weights for policy 0, policy_version 91680 (0.0004) [2023-03-12 00:24:10,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 11899.2). Total num frames: 46964736. Throughput: 0: 12266.7. Samples: 46944320. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:24:10,661][106151] Avg episode reward: [(0, '4196.914')] [2023-03-12 00:24:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000091728_46964736.pth... [2023-03-12 00:24:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000091008_46596096.pth [2023-03-12 00:24:11,722][106434] Updated weights for policy 0, policy_version 91760 (0.0004) [2023-03-12 00:24:14,918][106434] Updated weights for policy 0, policy_version 91840 (0.0004) [2023-03-12 00:24:15,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12219.7, 300 sec: 11913.1). Total num frames: 47030272. Throughput: 0: 12359.8. Samples: 47021228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:24:15,661][106151] Avg episode reward: [(0, '4073.931')] [2023-03-12 00:24:18,079][106434] Updated weights for policy 0, policy_version 91920 (0.0003) [2023-03-12 00:24:20,661][106151] Fps is (10 sec: 13107.2, 60 sec: 12356.3, 300 sec: 11940.9). Total num frames: 47095808. Throughput: 0: 12385.4. Samples: 47059296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:24:20,661][106151] Avg episode reward: [(0, '4436.444')] [2023-03-12 00:24:21,303][106434] Updated weights for policy 0, policy_version 92000 (0.0005) [2023-03-12 00:24:24,445][106434] Updated weights for policy 0, policy_version 92080 (0.0003) [2023-03-12 00:24:25,661][106151] Fps is (10 sec: 12697.4, 60 sec: 12424.5, 300 sec: 11927.0). Total num frames: 47157248. Throughput: 0: 12525.5. Samples: 47136832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:24:25,662][106151] Avg episode reward: [(0, '4423.391')] [2023-03-12 00:24:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000092104_47157248.pth... [2023-03-12 00:24:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000091360_46776320.pth [2023-03-12 00:24:27,762][106434] Updated weights for policy 0, policy_version 92160 (0.0005) [2023-03-12 00:24:30,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 11940.9). Total num frames: 47218688. Throughput: 0: 12561.4. Samples: 47211572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:24:30,661][106151] Avg episode reward: [(0, '4347.203')] [2023-03-12 00:24:30,999][106434] Updated weights for policy 0, policy_version 92240 (0.0004) [2023-03-12 00:24:34,233][106434] Updated weights for policy 0, policy_version 92320 (0.0004) [2023-03-12 00:24:35,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12492.8, 300 sec: 11954.8). Total num frames: 47284224. Throughput: 0: 12672.0. Samples: 47250324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:24:35,661][106151] Avg episode reward: [(0, '4228.970')] [2023-03-12 00:24:37,475][106434] Updated weights for policy 0, policy_version 92400 (0.0004) [2023-03-12 00:24:40,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 11954.8). Total num frames: 47345664. Throughput: 0: 12663.6. Samples: 47325248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:24:40,662][106151] Avg episode reward: [(0, '4286.367')] [2023-03-12 00:24:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000092472_47345664.pth... [2023-03-12 00:24:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000091728_46964736.pth [2023-03-12 00:24:40,769][106434] Updated weights for policy 0, policy_version 92480 (0.0004) [2023-03-12 00:24:44,320][106434] Updated weights for policy 0, policy_version 92560 (0.0005) [2023-03-12 00:24:45,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12492.8, 300 sec: 11954.8). Total num frames: 47403008. Throughput: 0: 12595.5. Samples: 47396788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:24:45,661][106151] Avg episode reward: [(0, '4163.536')] [2023-03-12 00:24:47,962][106434] Updated weights for policy 0, policy_version 92640 (0.0005) [2023-03-12 00:24:50,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12424.5, 300 sec: 11940.9). Total num frames: 47460352. Throughput: 0: 12511.5. Samples: 47430920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:24:50,661][106151] Avg episode reward: [(0, '4164.343')] [2023-03-12 00:24:51,559][106434] Updated weights for policy 0, policy_version 92720 (0.0005) [2023-03-12 00:24:55,124][106434] Updated weights for policy 0, policy_version 92800 (0.0005) [2023-03-12 00:24:55,661][106151] Fps is (10 sec: 11468.7, 60 sec: 12356.3, 300 sec: 11927.0). Total num frames: 47517696. Throughput: 0: 12329.1. Samples: 47499128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:24:55,661][106151] Avg episode reward: [(0, '3572.678')] [2023-03-12 00:24:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000092808_47517696.pth... [2023-03-12 00:24:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000092104_47157248.pth [2023-03-12 00:24:58,584][106434] Updated weights for policy 0, policy_version 92880 (0.0004) [2023-03-12 00:25:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 11940.9). Total num frames: 47579136. Throughput: 0: 12207.2. Samples: 47570552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:25:00,661][106151] Avg episode reward: [(0, '3892.786')] [2023-03-12 00:25:01,830][106434] Updated weights for policy 0, policy_version 92960 (0.0004) [2023-03-12 00:25:05,060][106434] Updated weights for policy 0, policy_version 93040 (0.0004) [2023-03-12 00:25:05,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 11940.9). Total num frames: 47640576. Throughput: 0: 12190.6. Samples: 47607872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:25:05,672][106151] Avg episode reward: [(0, '4326.357')] [2023-03-12 00:25:08,291][106434] Updated weights for policy 0, policy_version 93120 (0.0004) [2023-03-12 00:25:10,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12356.3, 300 sec: 11968.6). Total num frames: 47706112. Throughput: 0: 12156.0. Samples: 47683852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:25:10,662][106151] Avg episode reward: [(0, '4333.962')] [2023-03-12 00:25:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000093176_47706112.pth... [2023-03-12 00:25:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000092472_47345664.pth [2023-03-12 00:25:11,700][106434] Updated weights for policy 0, policy_version 93200 (0.0004) [2023-03-12 00:25:14,949][106434] Updated weights for policy 0, policy_version 93280 (0.0004) [2023-03-12 00:25:15,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 11982.5). Total num frames: 47767552. Throughput: 0: 12134.1. Samples: 47757604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:25:15,672][106151] Avg episode reward: [(0, '4171.641')] [2023-03-12 00:25:18,177][106434] Updated weights for policy 0, policy_version 93360 (0.0004) [2023-03-12 00:25:20,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12219.7, 300 sec: 11982.5). Total num frames: 47828992. Throughput: 0: 12123.9. Samples: 47795900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:25:20,672][106151] Avg episode reward: [(0, '3999.834')] [2023-03-12 00:25:21,435][106434] Updated weights for policy 0, policy_version 93440 (0.0004) [2023-03-12 00:25:24,724][106434] Updated weights for policy 0, policy_version 93520 (0.0004) [2023-03-12 00:25:25,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12219.7, 300 sec: 11996.4). Total num frames: 47890432. Throughput: 0: 12122.6. Samples: 47870764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:25:25,662][106151] Avg episode reward: [(0, '4113.854')] [2023-03-12 00:25:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000093536_47890432.pth... [2023-03-12 00:25:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000092808_47517696.pth [2023-03-12 00:25:27,965][106434] Updated weights for policy 0, policy_version 93600 (0.0004) [2023-03-12 00:25:30,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 12024.2). Total num frames: 47955968. Throughput: 0: 12222.3. Samples: 47946792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:25:30,672][106151] Avg episode reward: [(0, '4438.164')] [2023-03-12 00:25:31,257][106434] Updated weights for policy 0, policy_version 93680 (0.0004) [2023-03-12 00:25:34,581][106434] Updated weights for policy 0, policy_version 93760 (0.0004) [2023-03-12 00:25:35,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12219.7, 300 sec: 12038.1). Total num frames: 48017408. Throughput: 0: 12283.9. Samples: 47983696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:25:35,672][106151] Avg episode reward: [(0, '4254.010')] [2023-03-12 00:25:37,932][106434] Updated weights for policy 0, policy_version 93840 (0.0004) [2023-03-12 00:25:40,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12219.7, 300 sec: 12052.0). Total num frames: 48078848. Throughput: 0: 12396.4. Samples: 48056968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:25:40,662][106151] Avg episode reward: [(0, '4345.545')] [2023-03-12 00:25:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000093904_48078848.pth... [2023-03-12 00:25:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000093176_47706112.pth [2023-03-12 00:25:41,295][106434] Updated weights for policy 0, policy_version 93920 (0.0004) [2023-03-12 00:25:44,514][106434] Updated weights for policy 0, policy_version 94000 (0.0004) [2023-03-12 00:25:45,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12065.8). Total num frames: 48140288. Throughput: 0: 12478.9. Samples: 48132104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:25:45,661][106151] Avg episode reward: [(0, '4386.332')] [2023-03-12 00:25:47,916][106434] Updated weights for policy 0, policy_version 94080 (0.0004) [2023-03-12 00:25:50,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12288.0, 300 sec: 12065.8). Total num frames: 48197632. Throughput: 0: 12450.2. Samples: 48168132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:25:50,661][106151] Avg episode reward: [(0, '4234.376')] [2023-03-12 00:25:51,445][106434] Updated weights for policy 0, policy_version 94160 (0.0005) [2023-03-12 00:25:54,931][106434] Updated weights for policy 0, policy_version 94240 (0.0005) [2023-03-12 00:25:55,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 12079.7). Total num frames: 48259072. Throughput: 0: 12327.8. Samples: 48238604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:25:55,661][106151] Avg episode reward: [(0, '4084.292')] [2023-03-12 00:25:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000094256_48259072.pth... [2023-03-12 00:25:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000093536_47890432.pth [2023-03-12 00:25:58,500][106434] Updated weights for policy 0, policy_version 94320 (0.0005) [2023-03-12 00:26:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 12079.7). Total num frames: 48316416. Throughput: 0: 12219.6. Samples: 48307488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:26:00,661][106151] Avg episode reward: [(0, '4212.557')] [2023-03-12 00:26:02,077][106434] Updated weights for policy 0, policy_version 94400 (0.0005) [2023-03-12 00:26:05,612][106434] Updated weights for policy 0, policy_version 94480 (0.0005) [2023-03-12 00:26:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12219.7, 300 sec: 12079.7). Total num frames: 48373760. Throughput: 0: 12114.8. Samples: 48341064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:26:05,662][106151] Avg episode reward: [(0, '4212.832')] [2023-03-12 00:26:09,173][106434] Updated weights for policy 0, policy_version 94560 (0.0005) [2023-03-12 00:26:10,661][106151] Fps is (10 sec: 11468.7, 60 sec: 12083.2, 300 sec: 12079.7). Total num frames: 48431104. Throughput: 0: 11998.3. Samples: 48410688. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:26:10,661][106151] Avg episode reward: [(0, '4178.976')] [2023-03-12 00:26:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000094592_48431104.pth... [2023-03-12 00:26:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000093904_48078848.pth [2023-03-12 00:26:12,652][106434] Updated weights for policy 0, policy_version 94640 (0.0005) [2023-03-12 00:26:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 12079.7). Total num frames: 48488448. Throughput: 0: 11877.2. Samples: 48481268. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:26:15,661][106151] Avg episode reward: [(0, '4305.964')] [2023-03-12 00:26:16,117][106434] Updated weights for policy 0, policy_version 94720 (0.0005) [2023-03-12 00:26:19,620][106434] Updated weights for policy 0, policy_version 94800 (0.0005) [2023-03-12 00:26:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 12079.7). Total num frames: 48545792. Throughput: 0: 11854.1. Samples: 48517128. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:26:20,661][106151] Avg episode reward: [(0, '4172.336')] [2023-03-12 00:26:23,157][106434] Updated weights for policy 0, policy_version 94880 (0.0005) [2023-03-12 00:26:25,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 12093.6). Total num frames: 48607232. Throughput: 0: 11773.3. Samples: 48586768. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:26:25,662][106151] Avg episode reward: [(0, '4245.939')] [2023-03-12 00:26:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000094936_48607232.pth... [2023-03-12 00:26:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000094256_48259072.pth [2023-03-12 00:26:26,690][106434] Updated weights for policy 0, policy_version 94960 (0.0005) [2023-03-12 00:26:30,173][106434] Updated weights for policy 0, policy_version 95040 (0.0005) [2023-03-12 00:26:30,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 12079.7). Total num frames: 48664576. Throughput: 0: 11652.3. Samples: 48656456. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:26:30,662][106151] Avg episode reward: [(0, '4335.298')] [2023-03-12 00:26:33,673][106434] Updated weights for policy 0, policy_version 95120 (0.0005) [2023-03-12 00:26:35,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 12065.8). Total num frames: 48721920. Throughput: 0: 11635.6. Samples: 48691732. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:26:35,662][106151] Avg episode reward: [(0, '4031.128')] [2023-03-12 00:26:37,324][106434] Updated weights for policy 0, policy_version 95200 (0.0005) [2023-03-12 00:26:40,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 12052.0). Total num frames: 48779264. Throughput: 0: 11586.0. Samples: 48759976. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:26:40,662][106151] Avg episode reward: [(0, '3859.643')] [2023-03-12 00:26:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000095272_48779264.pth... [2023-03-12 00:26:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000094592_48431104.pth [2023-03-12 00:26:40,823][106434] Updated weights for policy 0, policy_version 95280 (0.0005) [2023-03-12 00:26:44,376][106434] Updated weights for policy 0, policy_version 95360 (0.0005) [2023-03-12 00:26:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12038.1). Total num frames: 48836608. Throughput: 0: 11599.2. Samples: 48829452. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:26:45,661][106151] Avg episode reward: [(0, '4302.340')] [2023-03-12 00:26:47,935][106434] Updated weights for policy 0, policy_version 95440 (0.0005) [2023-03-12 00:26:50,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 12024.2). Total num frames: 48893952. Throughput: 0: 11624.0. Samples: 48864144. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:26:50,661][106151] Avg episode reward: [(0, '4255.426')] [2023-03-12 00:26:51,535][106434] Updated weights for policy 0, policy_version 95520 (0.0005) [2023-03-12 00:26:54,978][106434] Updated weights for policy 0, policy_version 95600 (0.0005) [2023-03-12 00:26:55,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 12024.2). Total num frames: 48955392. Throughput: 0: 11611.7. Samples: 48933216. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:26:55,661][106151] Avg episode reward: [(0, '4205.367')] [2023-03-12 00:26:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000095616_48955392.pth... [2023-03-12 00:26:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000094936_48607232.pth [2023-03-12 00:26:58,236][106434] Updated weights for policy 0, policy_version 95680 (0.0004) [2023-03-12 00:27:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 12038.1). Total num frames: 49016832. Throughput: 0: 11701.0. Samples: 49007812. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:27:00,661][106151] Avg episode reward: [(0, '4398.335')] [2023-03-12 00:27:01,519][106434] Updated weights for policy 0, policy_version 95760 (0.0004) [2023-03-12 00:27:04,776][106434] Updated weights for policy 0, policy_version 95840 (0.0004) [2023-03-12 00:27:05,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11741.9, 300 sec: 12038.1). Total num frames: 49078272. Throughput: 0: 11742.0. Samples: 49045516. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-12 00:27:05,661][106151] Avg episode reward: [(0, '4083.596')] [2023-03-12 00:27:08,111][106434] Updated weights for policy 0, policy_version 95920 (0.0004) [2023-03-12 00:27:10,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11810.2, 300 sec: 12052.0). Total num frames: 49139712. Throughput: 0: 11834.0. Samples: 49119296. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:27:10,661][106151] Avg episode reward: [(0, '4385.714')] [2023-03-12 00:27:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000095976_49139712.pth... [2023-03-12 00:27:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000095272_48779264.pth [2023-03-12 00:27:11,667][106434] Updated weights for policy 0, policy_version 96000 (0.0005) [2023-03-12 00:27:14,972][106434] Updated weights for policy 0, policy_version 96080 (0.0004) [2023-03-12 00:27:15,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11878.4, 300 sec: 12065.8). Total num frames: 49201152. Throughput: 0: 11887.6. Samples: 49191396. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:27:15,661][106151] Avg episode reward: [(0, '4259.424')] [2023-03-12 00:27:18,217][106434] Updated weights for policy 0, policy_version 96160 (0.0004) [2023-03-12 00:27:20,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 12065.8). Total num frames: 49262592. Throughput: 0: 11950.4. Samples: 49229500. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:27:20,661][106151] Avg episode reward: [(0, '3912.351')] [2023-03-12 00:27:21,516][106434] Updated weights for policy 0, policy_version 96240 (0.0004) [2023-03-12 00:27:24,687][106434] Updated weights for policy 0, policy_version 96320 (0.0003) [2023-03-12 00:27:25,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 12079.7). Total num frames: 49324032. Throughput: 0: 12101.5. Samples: 49304544. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:27:25,662][106151] Avg episode reward: [(0, '3930.042')] [2023-03-12 00:27:25,667][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000096344_49328128.pth... [2023-03-12 00:27:25,669][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000095616_48955392.pth [2023-03-12 00:27:27,980][106434] Updated weights for policy 0, policy_version 96400 (0.0005) [2023-03-12 00:27:30,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12083.2, 300 sec: 12107.5). Total num frames: 49389568. Throughput: 0: 12228.2. Samples: 49379720. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:27:30,661][106151] Avg episode reward: [(0, '4170.873')] [2023-03-12 00:27:31,267][106434] Updated weights for policy 0, policy_version 96480 (0.0004) [2023-03-12 00:27:34,522][106434] Updated weights for policy 0, policy_version 96560 (0.0004) [2023-03-12 00:27:35,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12151.5, 300 sec: 12121.4). Total num frames: 49451008. Throughput: 0: 12289.7. Samples: 49417180. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:27:35,661][106151] Avg episode reward: [(0, '3889.612')] [2023-03-12 00:27:37,780][106434] Updated weights for policy 0, policy_version 96640 (0.0004) [2023-03-12 00:27:40,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12135.3). Total num frames: 49512448. Throughput: 0: 12433.1. Samples: 49492704. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:27:40,661][106151] Avg episode reward: [(0, '4066.369')] [2023-03-12 00:27:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000096704_49512448.pth... [2023-03-12 00:27:40,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000095976_49139712.pth [2023-03-12 00:27:41,043][106434] Updated weights for policy 0, policy_version 96720 (0.0004) [2023-03-12 00:27:44,341][106434] Updated weights for policy 0, policy_version 96800 (0.0004) [2023-03-12 00:27:45,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12356.3, 300 sec: 12149.1). Total num frames: 49577984. Throughput: 0: 12444.2. Samples: 49567800. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:27:45,661][106151] Avg episode reward: [(0, '3930.955')] [2023-03-12 00:27:47,606][106434] Updated weights for policy 0, policy_version 96880 (0.0004) [2023-03-12 00:27:50,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 12163.0). Total num frames: 49639424. Throughput: 0: 12439.9. Samples: 49605312. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:27:50,661][106151] Avg episode reward: [(0, '3818.064')] [2023-03-12 00:27:50,912][106434] Updated weights for policy 0, policy_version 96960 (0.0004) [2023-03-12 00:27:54,156][106434] Updated weights for policy 0, policy_version 97040 (0.0004) [2023-03-12 00:27:55,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12163.0). Total num frames: 49700864. Throughput: 0: 12470.0. Samples: 49680448. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:27:55,661][106151] Avg episode reward: [(0, '4276.497')] [2023-03-12 00:27:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000097072_49700864.pth... [2023-03-12 00:27:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000096344_49328128.pth [2023-03-12 00:27:57,368][106434] Updated weights for policy 0, policy_version 97120 (0.0004) [2023-03-12 00:28:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12163.0). Total num frames: 49762304. Throughput: 0: 12548.5. Samples: 49756080. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:28:00,662][106151] Avg episode reward: [(0, '4402.751')] [2023-03-12 00:28:00,662][106434] Updated weights for policy 0, policy_version 97200 (0.0004) [2023-03-12 00:28:03,909][106434] Updated weights for policy 0, policy_version 97280 (0.0004) [2023-03-12 00:28:05,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12176.9). Total num frames: 49827840. Throughput: 0: 12533.4. Samples: 49793504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:28:05,661][106151] Avg episode reward: [(0, '4412.145')] [2023-03-12 00:28:07,236][106434] Updated weights for policy 0, policy_version 97360 (0.0004) [2023-03-12 00:28:10,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12163.0). Total num frames: 49885184. Throughput: 0: 12531.8. Samples: 49868476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:28:10,661][106151] Avg episode reward: [(0, '4326.462')] [2023-03-12 00:28:10,719][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000097440_49889280.pth... [2023-03-12 00:28:10,720][106434] Updated weights for policy 0, policy_version 97440 (0.0005) [2023-03-12 00:28:10,721][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000096704_49512448.pth [2023-03-12 00:28:14,145][106434] Updated weights for policy 0, policy_version 97520 (0.0005) [2023-03-12 00:28:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 12176.9). Total num frames: 49946624. Throughput: 0: 12416.0. Samples: 49938440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:28:15,662][106151] Avg episode reward: [(0, '4306.725')] [2023-03-12 00:28:17,661][106434] Updated weights for policy 0, policy_version 97600 (0.0005) [2023-03-12 00:28:20,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 12176.9). Total num frames: 50003968. Throughput: 0: 12353.3. Samples: 49973080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:28:20,661][106151] Avg episode reward: [(0, '4237.961')] [2023-03-12 00:28:21,234][106434] Updated weights for policy 0, policy_version 97680 (0.0005) [2023-03-12 00:28:24,784][106434] Updated weights for policy 0, policy_version 97760 (0.0005) [2023-03-12 00:28:25,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12288.0, 300 sec: 12163.0). Total num frames: 50061312. Throughput: 0: 12213.7. Samples: 50042320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:28:25,662][106151] Avg episode reward: [(0, '4469.431')] [2023-03-12 00:28:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000097776_50061312.pth... [2023-03-12 00:28:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000097072_49700864.pth [2023-03-12 00:28:28,275][106434] Updated weights for policy 0, policy_version 97840 (0.0005) [2023-03-12 00:28:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 12149.2). Total num frames: 50118656. Throughput: 0: 12104.1. Samples: 50112484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:28:30,661][106151] Avg episode reward: [(0, '4148.273')] [2023-03-12 00:28:31,769][106434] Updated weights for policy 0, policy_version 97920 (0.0005) [2023-03-12 00:28:35,335][106434] Updated weights for policy 0, policy_version 98000 (0.0005) [2023-03-12 00:28:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 12149.2). Total num frames: 50176000. Throughput: 0: 12045.0. Samples: 50147336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:28:35,661][106151] Avg episode reward: [(0, '4084.433')] [2023-03-12 00:28:38,893][106434] Updated weights for policy 0, policy_version 98080 (0.0005) [2023-03-12 00:28:40,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 12149.2). Total num frames: 50237440. Throughput: 0: 11912.5. Samples: 50216512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:28:40,661][106151] Avg episode reward: [(0, '4042.832')] [2023-03-12 00:28:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000098120_50237440.pth... [2023-03-12 00:28:40,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000097440_49889280.pth [2023-03-12 00:28:42,412][106434] Updated weights for policy 0, policy_version 98160 (0.0005) [2023-03-12 00:28:45,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12135.3). Total num frames: 50294784. Throughput: 0: 11789.2. Samples: 50286592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:28:45,661][106151] Avg episode reward: [(0, '4224.343')] [2023-03-12 00:28:45,931][106434] Updated weights for policy 0, policy_version 98240 (0.0005) [2023-03-12 00:28:49,520][106434] Updated weights for policy 0, policy_version 98320 (0.0005) [2023-03-12 00:28:50,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 12121.4). Total num frames: 50352128. Throughput: 0: 11719.2. Samples: 50320868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:28:50,661][106151] Avg episode reward: [(0, '3946.276')] [2023-03-12 00:28:53,148][106434] Updated weights for policy 0, policy_version 98400 (0.0005) [2023-03-12 00:28:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 12107.5). Total num frames: 50409472. Throughput: 0: 11568.4. Samples: 50389056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:28:55,661][106151] Avg episode reward: [(0, '4126.357')] [2023-03-12 00:28:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000098456_50409472.pth... [2023-03-12 00:28:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000097776_50061312.pth [2023-03-12 00:28:56,620][106434] Updated weights for policy 0, policy_version 98480 (0.0005) [2023-03-12 00:28:58,785][106390] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000008 [2023-03-12 00:29:00,193][106434] Updated weights for policy 0, policy_version 98560 (0.0004) [2023-03-12 00:29:00,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 12079.7). Total num frames: 50466816. Throughput: 0: 11559.8. Samples: 50458632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:29:00,672][106151] Avg episode reward: [(0, '4028.659')] [2023-03-12 00:29:03,745][106434] Updated weights for policy 0, policy_version 98640 (0.0005) [2023-03-12 00:29:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12065.8). Total num frames: 50524160. Throughput: 0: 11548.6. Samples: 50492768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:29:05,672][106151] Avg episode reward: [(0, '4074.708')] [2023-03-12 00:29:07,256][106434] Updated weights for policy 0, policy_version 98720 (0.0005) [2023-03-12 00:29:10,631][106434] Updated weights for policy 0, policy_version 98800 (0.0004) [2023-03-12 00:29:10,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 12052.0). Total num frames: 50585600. Throughput: 0: 11551.5. Samples: 50562136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:29:10,662][106151] Avg episode reward: [(0, '4105.602')] [2023-03-12 00:29:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000098800_50585600.pth... [2023-03-12 00:29:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000098120_50237440.pth [2023-03-12 00:29:13,863][106434] Updated weights for policy 0, policy_version 98880 (0.0004) [2023-03-12 00:29:15,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 12038.1). Total num frames: 50647040. Throughput: 0: 11698.4. Samples: 50638912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:29:15,672][106151] Avg episode reward: [(0, '4098.447')] [2023-03-12 00:29:17,031][106434] Updated weights for policy 0, policy_version 98960 (0.0004) [2023-03-12 00:29:20,218][106434] Updated weights for policy 0, policy_version 99040 (0.0004) [2023-03-12 00:29:20,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11810.1, 300 sec: 12052.0). Total num frames: 50712576. Throughput: 0: 11792.7. Samples: 50678008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:29:20,672][106151] Avg episode reward: [(0, '4332.867')] [2023-03-12 00:29:23,426][106434] Updated weights for policy 0, policy_version 99120 (0.0004) [2023-03-12 00:29:25,661][106151] Fps is (10 sec: 12697.5, 60 sec: 11878.4, 300 sec: 12052.0). Total num frames: 50774016. Throughput: 0: 11950.7. Samples: 50754296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:29:25,662][106151] Avg episode reward: [(0, '4307.286')] [2023-03-12 00:29:25,685][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000099176_50778112.pth... [2023-03-12 00:29:25,686][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000098456_50409472.pth [2023-03-12 00:29:26,685][106434] Updated weights for policy 0, policy_version 99200 (0.0004) [2023-03-12 00:29:29,919][106434] Updated weights for policy 0, policy_version 99280 (0.0004) [2023-03-12 00:29:30,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12014.9, 300 sec: 12052.0). Total num frames: 50839552. Throughput: 0: 12075.1. Samples: 50829972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:29:30,672][106151] Avg episode reward: [(0, '4430.466')] [2023-03-12 00:29:33,195][106434] Updated weights for policy 0, policy_version 99360 (0.0004) [2023-03-12 00:29:35,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12083.2, 300 sec: 12052.0). Total num frames: 50900992. Throughput: 0: 12153.6. Samples: 50867780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:29:35,661][106151] Avg episode reward: [(0, '3743.983')] [2023-03-12 00:29:36,374][106434] Updated weights for policy 0, policy_version 99440 (0.0004) [2023-03-12 00:29:39,586][106434] Updated weights for policy 0, policy_version 99520 (0.0004) [2023-03-12 00:29:40,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12151.5, 300 sec: 12079.7). Total num frames: 50966528. Throughput: 0: 12339.3. Samples: 50944324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:29:40,661][106151] Avg episode reward: [(0, '4070.721')] [2023-03-12 00:29:40,666][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000099544_50966528.pth... [2023-03-12 00:29:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000098800_50585600.pth [2023-03-12 00:29:42,796][106434] Updated weights for policy 0, policy_version 99600 (0.0004) [2023-03-12 00:29:45,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12219.7, 300 sec: 12093.6). Total num frames: 51027968. Throughput: 0: 12490.1. Samples: 51020688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:29:45,661][106151] Avg episode reward: [(0, '4342.057')] [2023-03-12 00:29:45,993][106434] Updated weights for policy 0, policy_version 99680 (0.0004) [2023-03-12 00:29:49,157][106434] Updated weights for policy 0, policy_version 99760 (0.0004) [2023-03-12 00:29:50,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12356.3, 300 sec: 12121.4). Total num frames: 51093504. Throughput: 0: 12605.6. Samples: 51060020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:29:50,672][106151] Avg episode reward: [(0, '4249.449')] [2023-03-12 00:29:52,403][106434] Updated weights for policy 0, policy_version 99840 (0.0004) [2023-03-12 00:29:55,528][106434] Updated weights for policy 0, policy_version 99920 (0.0003) [2023-03-12 00:29:55,661][106151] Fps is (10 sec: 13107.1, 60 sec: 12492.8, 300 sec: 12135.3). Total num frames: 51159040. Throughput: 0: 12756.7. Samples: 51136188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:29:55,661][106151] Avg episode reward: [(0, '4063.687')] [2023-03-12 00:29:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000099920_51159040.pth... [2023-03-12 00:29:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000099176_50778112.pth [2023-03-12 00:29:58,754][106434] Updated weights for policy 0, policy_version 100000 (0.0005) [2023-03-12 00:30:00,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12135.3). Total num frames: 51220480. Throughput: 0: 12755.3. Samples: 51212900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:30:00,661][106151] Avg episode reward: [(0, '3847.791')] [2023-03-12 00:30:02,015][106434] Updated weights for policy 0, policy_version 100080 (0.0004) [2023-03-12 00:30:05,253][106434] Updated weights for policy 0, policy_version 100160 (0.0004) [2023-03-12 00:30:05,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 12135.3). Total num frames: 51286016. Throughput: 0: 12739.6. Samples: 51251288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:30:05,661][106151] Avg episode reward: [(0, '4171.309')] [2023-03-12 00:30:08,509][106434] Updated weights for policy 0, policy_version 100240 (0.0004) [2023-03-12 00:30:10,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 12135.3). Total num frames: 51347456. Throughput: 0: 12727.7. Samples: 51327040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:30:10,661][106151] Avg episode reward: [(0, '3714.790')] [2023-03-12 00:30:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000100288_51347456.pth... [2023-03-12 00:30:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000099544_50966528.pth [2023-03-12 00:30:11,733][106434] Updated weights for policy 0, policy_version 100320 (0.0004) [2023-03-12 00:30:15,022][106434] Updated weights for policy 0, policy_version 100400 (0.0004) [2023-03-12 00:30:15,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12765.9, 300 sec: 12149.2). Total num frames: 51412992. Throughput: 0: 12710.7. Samples: 51401956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:30:15,672][106151] Avg episode reward: [(0, '3828.706')] [2023-03-12 00:30:18,277][106434] Updated weights for policy 0, policy_version 100480 (0.0004) [2023-03-12 00:30:20,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12629.3, 300 sec: 12135.3). Total num frames: 51470336. Throughput: 0: 12738.0. Samples: 51440992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:30:20,675][106151] Avg episode reward: [(0, '3207.804')] [2023-03-12 00:30:21,789][106434] Updated weights for policy 0, policy_version 100560 (0.0005) [2023-03-12 00:30:25,283][106434] Updated weights for policy 0, policy_version 100640 (0.0005) [2023-03-12 00:30:25,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12629.3, 300 sec: 12121.4). Total num frames: 51531776. Throughput: 0: 12599.6. Samples: 51511304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:30:25,662][106151] Avg episode reward: [(0, '2847.081')] [2023-03-12 00:30:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000100648_51531776.pth... [2023-03-12 00:30:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000099920_51159040.pth [2023-03-12 00:30:28,762][106434] Updated weights for policy 0, policy_version 100720 (0.0005) [2023-03-12 00:30:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12492.8, 300 sec: 12107.5). Total num frames: 51589120. Throughput: 0: 12451.2. Samples: 51580992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:30:30,672][106151] Avg episode reward: [(0, '3309.604')] [2023-03-12 00:30:32,320][106434] Updated weights for policy 0, policy_version 100800 (0.0005) [2023-03-12 00:30:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12424.5, 300 sec: 12093.6). Total num frames: 51646464. Throughput: 0: 12351.8. Samples: 51615852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:30:35,661][106151] Avg episode reward: [(0, '2911.046')] [2023-03-12 00:30:35,772][106434] Updated weights for policy 0, policy_version 100880 (0.0004) [2023-03-12 00:30:39,277][106434] Updated weights for policy 0, policy_version 100960 (0.0005) [2023-03-12 00:30:40,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 12093.6). Total num frames: 51707904. Throughput: 0: 12224.1. Samples: 51686272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:30:40,662][106151] Avg episode reward: [(0, '3122.883')] [2023-03-12 00:30:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000100992_51707904.pth... [2023-03-12 00:30:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000100288_51347456.pth [2023-03-12 00:30:42,693][106434] Updated weights for policy 0, policy_version 101040 (0.0004) [2023-03-12 00:30:45,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12288.0, 300 sec: 12093.6). Total num frames: 51765248. Throughput: 0: 12102.6. Samples: 51757516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:30:45,672][106151] Avg episode reward: [(0, '3410.184')] [2023-03-12 00:30:46,196][106434] Updated weights for policy 0, policy_version 101120 (0.0005) [2023-03-12 00:30:49,765][106434] Updated weights for policy 0, policy_version 101200 (0.0005) [2023-03-12 00:30:50,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 12079.7). Total num frames: 51822592. Throughput: 0: 12021.1. Samples: 51792236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:30:50,663][106151] Avg episode reward: [(0, '3279.582')] [2023-03-12 00:30:53,264][106434] Updated weights for policy 0, policy_version 101280 (0.0005) [2023-03-12 00:30:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12015.0, 300 sec: 12079.7). Total num frames: 51879936. Throughput: 0: 11897.0. Samples: 51862404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:30:55,661][106151] Avg episode reward: [(0, '3825.612')] [2023-03-12 00:30:55,715][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000101336_51884032.pth... [2023-03-12 00:30:55,716][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000100648_51531776.pth [2023-03-12 00:30:56,795][106434] Updated weights for policy 0, policy_version 101360 (0.0005) [2023-03-12 00:31:00,231][106434] Updated weights for policy 0, policy_version 101440 (0.0005) [2023-03-12 00:31:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 12093.6). Total num frames: 51941376. Throughput: 0: 11802.2. Samples: 51933056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:31:00,661][106151] Avg episode reward: [(0, '3849.449')] [2023-03-12 00:31:03,686][106434] Updated weights for policy 0, policy_version 101520 (0.0004) [2023-03-12 00:31:05,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 12093.6). Total num frames: 51998720. Throughput: 0: 11714.0. Samples: 51968124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:31:05,661][106151] Avg episode reward: [(0, '4204.280')] [2023-03-12 00:31:07,169][106434] Updated weights for policy 0, policy_version 101600 (0.0005) [2023-03-12 00:31:10,634][106434] Updated weights for policy 0, policy_version 101680 (0.0005) [2023-03-12 00:31:10,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 12107.5). Total num frames: 52060160. Throughput: 0: 11726.9. Samples: 52039016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:31:10,661][106151] Avg episode reward: [(0, '3713.084')] [2023-03-12 00:31:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000101680_52060160.pth... [2023-03-12 00:31:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000100992_51707904.pth [2023-03-12 00:31:14,080][106434] Updated weights for policy 0, policy_version 101760 (0.0005) [2023-03-12 00:31:15,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11741.9, 300 sec: 12107.5). Total num frames: 52117504. Throughput: 0: 11754.5. Samples: 52109944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:31:15,661][106151] Avg episode reward: [(0, '3900.898')] [2023-03-12 00:31:17,453][106434] Updated weights for policy 0, policy_version 101840 (0.0004) [2023-03-12 00:31:20,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11810.1, 300 sec: 12107.5). Total num frames: 52178944. Throughput: 0: 11786.6. Samples: 52146248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:31:20,661][106151] Avg episode reward: [(0, '4262.762')] [2023-03-12 00:31:20,948][106434] Updated weights for policy 0, policy_version 101920 (0.0005) [2023-03-12 00:31:24,443][106434] Updated weights for policy 0, policy_version 102000 (0.0005) [2023-03-12 00:31:25,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11741.9, 300 sec: 12107.5). Total num frames: 52236288. Throughput: 0: 11780.9. Samples: 52216412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:31:25,661][106151] Avg episode reward: [(0, '4205.560')] [2023-03-12 00:31:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000102024_52236288.pth... [2023-03-12 00:31:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000101336_51884032.pth [2023-03-12 00:31:27,951][106434] Updated weights for policy 0, policy_version 102080 (0.0005) [2023-03-12 00:31:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 12107.5). Total num frames: 52293632. Throughput: 0: 11761.3. Samples: 52286776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:31:30,661][106151] Avg episode reward: [(0, '4381.162')] [2023-03-12 00:31:31,452][106434] Updated weights for policy 0, policy_version 102160 (0.0005) [2023-03-12 00:31:34,965][106434] Updated weights for policy 0, policy_version 102240 (0.0005) [2023-03-12 00:31:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 12107.5). Total num frames: 52350976. Throughput: 0: 11779.3. Samples: 52322304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:31:35,661][106151] Avg episode reward: [(0, '4281.018')] [2023-03-12 00:31:38,588][106434] Updated weights for policy 0, policy_version 102320 (0.0005) [2023-03-12 00:31:40,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12107.5). Total num frames: 52408320. Throughput: 0: 11749.2. Samples: 52391116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:31:40,661][106151] Avg episode reward: [(0, '4305.172')] [2023-03-12 00:31:40,672][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000102368_52412416.pth... [2023-03-12 00:31:40,674][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000101680_52060160.pth [2023-03-12 00:31:42,084][106434] Updated weights for policy 0, policy_version 102400 (0.0005) [2023-03-12 00:31:45,608][106434] Updated weights for policy 0, policy_version 102480 (0.0005) [2023-03-12 00:31:45,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11741.9, 300 sec: 12121.4). Total num frames: 52469760. Throughput: 0: 11737.4. Samples: 52461240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:31:45,661][106151] Avg episode reward: [(0, '4483.565')] [2023-03-12 00:31:49,140][106434] Updated weights for policy 0, policy_version 102560 (0.0005) [2023-03-12 00:31:50,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11741.9, 300 sec: 12107.5). Total num frames: 52527104. Throughput: 0: 11710.8. Samples: 52495108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:31:50,661][106151] Avg episode reward: [(0, '4473.043')] [2023-03-12 00:31:52,669][106434] Updated weights for policy 0, policy_version 102640 (0.0005) [2023-03-12 00:31:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 12093.6). Total num frames: 52584448. Throughput: 0: 11694.4. Samples: 52565264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:31:55,661][106151] Avg episode reward: [(0, '4506.891')] [2023-03-12 00:31:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000102704_52584448.pth... [2023-03-12 00:31:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000102024_52236288.pth [2023-03-12 00:31:56,176][106434] Updated weights for policy 0, policy_version 102720 (0.0005) [2023-03-12 00:31:59,701][106434] Updated weights for policy 0, policy_version 102800 (0.0005) [2023-03-12 00:32:00,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 12079.7). Total num frames: 52641792. Throughput: 0: 11668.9. Samples: 52635044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:32:00,661][106151] Avg episode reward: [(0, '3853.834')] [2023-03-12 00:32:03,073][106434] Updated weights for policy 0, policy_version 102880 (0.0004) [2023-03-12 00:32:05,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 12079.7). Total num frames: 52703232. Throughput: 0: 11677.9. Samples: 52671752. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:32:05,661][106151] Avg episode reward: [(0, '3800.479')] [2023-03-12 00:32:06,504][106434] Updated weights for policy 0, policy_version 102960 (0.0005) [2023-03-12 00:32:10,016][106434] Updated weights for policy 0, policy_version 103040 (0.0005) [2023-03-12 00:32:10,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 12065.8). Total num frames: 52760576. Throughput: 0: 11704.8. Samples: 52743128. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:32:10,661][106151] Avg episode reward: [(0, '4331.866')] [2023-03-12 00:32:10,693][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000103056_52764672.pth... [2023-03-12 00:32:10,695][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000102368_52412416.pth [2023-03-12 00:32:13,508][106434] Updated weights for policy 0, policy_version 103120 (0.0005) [2023-03-12 00:32:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11741.8, 300 sec: 12065.8). Total num frames: 52822016. Throughput: 0: 11682.1. Samples: 52812472. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:32:15,661][106151] Avg episode reward: [(0, '4214.860')] [2023-03-12 00:32:17,070][106434] Updated weights for policy 0, policy_version 103200 (0.0005) [2023-03-12 00:32:20,541][106434] Updated weights for policy 0, policy_version 103280 (0.0005) [2023-03-12 00:32:20,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 12052.0). Total num frames: 52879360. Throughput: 0: 11657.8. Samples: 52846904. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:32:20,661][106151] Avg episode reward: [(0, '4018.371')] [2023-03-12 00:32:24,076][106434] Updated weights for policy 0, policy_version 103360 (0.0005) [2023-03-12 00:32:25,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 12024.2). Total num frames: 52936704. Throughput: 0: 11691.2. Samples: 52917220. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:32:25,662][106151] Avg episode reward: [(0, '4251.644')] [2023-03-12 00:32:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000103392_52936704.pth... [2023-03-12 00:32:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000102704_52584448.pth [2023-03-12 00:32:27,584][106434] Updated weights for policy 0, policy_version 103440 (0.0005) [2023-03-12 00:32:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12010.3). Total num frames: 52994048. Throughput: 0: 11691.9. Samples: 52987376. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:32:30,661][106151] Avg episode reward: [(0, '4011.054')] [2023-03-12 00:32:31,108][106434] Updated weights for policy 0, policy_version 103520 (0.0004) [2023-03-12 00:32:34,704][106434] Updated weights for policy 0, policy_version 103600 (0.0005) [2023-03-12 00:32:35,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 11996.4). Total num frames: 53051392. Throughput: 0: 11717.7. Samples: 53022404. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:32:35,661][106151] Avg episode reward: [(0, '4168.436')] [2023-03-12 00:32:38,299][106434] Updated weights for policy 0, policy_version 103680 (0.0005) [2023-03-12 00:32:40,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11968.6). Total num frames: 53108736. Throughput: 0: 11668.0. Samples: 53090324. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:32:40,661][106151] Avg episode reward: [(0, '4300.955')] [2023-03-12 00:32:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000103728_53108736.pth... [2023-03-12 00:32:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000103056_52764672.pth [2023-03-12 00:32:41,864][106434] Updated weights for policy 0, policy_version 103760 (0.0004) [2023-03-12 00:32:45,411][106434] Updated weights for policy 0, policy_version 103840 (0.0004) [2023-03-12 00:32:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11954.8). Total num frames: 53166080. Throughput: 0: 11649.6. Samples: 53159276. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:32:45,661][106151] Avg episode reward: [(0, '4087.428')] [2023-03-12 00:32:49,037][106434] Updated weights for policy 0, policy_version 103920 (0.0005) [2023-03-12 00:32:50,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11940.9). Total num frames: 53223424. Throughput: 0: 11613.8. Samples: 53194372. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:32:50,661][106151] Avg episode reward: [(0, '3934.821')] [2023-03-12 00:32:52,567][106434] Updated weights for policy 0, policy_version 104000 (0.0005) [2023-03-12 00:32:55,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11927.0). Total num frames: 53280768. Throughput: 0: 11552.3. Samples: 53262980. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:32:55,662][106151] Avg episode reward: [(0, '3656.381')] [2023-03-12 00:32:55,722][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000104072_53284864.pth... [2023-03-12 00:32:55,724][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000103392_52936704.pth [2023-03-12 00:32:56,094][106434] Updated weights for policy 0, policy_version 104080 (0.0005) [2023-03-12 00:32:59,421][106434] Updated weights for policy 0, policy_version 104160 (0.0004) [2023-03-12 00:33:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11913.1). Total num frames: 53342208. Throughput: 0: 11608.6. Samples: 53334860. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:33:00,661][106151] Avg episode reward: [(0, '4075.078')] [2023-03-12 00:33:02,707][106434] Updated weights for policy 0, policy_version 104240 (0.0004) [2023-03-12 00:33:05,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11673.6, 300 sec: 11927.0). Total num frames: 53403648. Throughput: 0: 11669.1. Samples: 53372012. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:33:05,661][106151] Avg episode reward: [(0, '4199.274')] [2023-03-12 00:33:06,180][106434] Updated weights for policy 0, policy_version 104320 (0.0005) [2023-03-12 00:33:09,763][106434] Updated weights for policy 0, policy_version 104400 (0.0005) [2023-03-12 00:33:10,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11913.1). Total num frames: 53460992. Throughput: 0: 11667.7. Samples: 53442264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:33:10,661][106151] Avg episode reward: [(0, '4423.874')] [2023-03-12 00:33:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000104416_53460992.pth... [2023-03-12 00:33:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000103728_53108736.pth [2023-03-12 00:33:13,276][106434] Updated weights for policy 0, policy_version 104480 (0.0005) [2023-03-12 00:33:15,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11913.1). Total num frames: 53518336. Throughput: 0: 11654.7. Samples: 53511836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:33:15,661][106151] Avg episode reward: [(0, '4217.305')] [2023-03-12 00:33:16,835][106434] Updated weights for policy 0, policy_version 104560 (0.0005) [2023-03-12 00:33:20,372][106434] Updated weights for policy 0, policy_version 104640 (0.0005) [2023-03-12 00:33:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.4, 300 sec: 11913.1). Total num frames: 53575680. Throughput: 0: 11645.4. Samples: 53546444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:33:20,661][106151] Avg episode reward: [(0, '3399.155')] [2023-03-12 00:33:24,001][106434] Updated weights for policy 0, policy_version 104720 (0.0005) [2023-03-12 00:33:25,661][106151] Fps is (10 sec: 11468.6, 60 sec: 11605.3, 300 sec: 11913.1). Total num frames: 53633024. Throughput: 0: 11650.8. Samples: 53614612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:33:25,662][106151] Avg episode reward: [(0, '3804.986')] [2023-03-12 00:33:25,677][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000104760_53637120.pth... [2023-03-12 00:33:25,679][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000104072_53284864.pth [2023-03-12 00:33:27,299][106434] Updated weights for policy 0, policy_version 104800 (0.0004) [2023-03-12 00:33:30,541][106434] Updated weights for policy 0, policy_version 104880 (0.0004) [2023-03-12 00:33:30,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11741.9, 300 sec: 11940.9). Total num frames: 53698560. Throughput: 0: 11776.4. Samples: 53689216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:33:30,661][106151] Avg episode reward: [(0, '3676.523')] [2023-03-12 00:33:33,902][106434] Updated weights for policy 0, policy_version 104960 (0.0004) [2023-03-12 00:33:35,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11810.1, 300 sec: 11940.9). Total num frames: 53760000. Throughput: 0: 11827.8. Samples: 53726624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:33:35,661][106151] Avg episode reward: [(0, '3978.548')] [2023-03-12 00:33:37,151][106434] Updated weights for policy 0, policy_version 105040 (0.0004) [2023-03-12 00:33:40,490][106434] Updated weights for policy 0, policy_version 105120 (0.0004) [2023-03-12 00:33:40,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11878.4, 300 sec: 11954.8). Total num frames: 53821440. Throughput: 0: 11956.5. Samples: 53801024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:33:40,662][106151] Avg episode reward: [(0, '3990.601')] [2023-03-12 00:33:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000105120_53821440.pth... [2023-03-12 00:33:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000104416_53460992.pth [2023-03-12 00:33:43,797][106434] Updated weights for policy 0, policy_version 105200 (0.0004) [2023-03-12 00:33:45,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11968.7). Total num frames: 53882880. Throughput: 0: 12011.6. Samples: 53875384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:33:45,661][106151] Avg episode reward: [(0, '4066.678')] [2023-03-12 00:33:47,033][106434] Updated weights for policy 0, policy_version 105280 (0.0003) [2023-03-12 00:33:50,361][106434] Updated weights for policy 0, policy_version 105360 (0.0004) [2023-03-12 00:33:50,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12014.9, 300 sec: 11982.5). Total num frames: 53944320. Throughput: 0: 12015.2. Samples: 53912696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:33:50,661][106151] Avg episode reward: [(0, '4144.138')] [2023-03-12 00:33:53,861][106434] Updated weights for policy 0, policy_version 105440 (0.0005) [2023-03-12 00:33:55,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11996.4). Total num frames: 54005760. Throughput: 0: 12067.0. Samples: 53985280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:33:55,662][106151] Avg episode reward: [(0, '3852.192')] [2023-03-12 00:33:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000105480_54005760.pth... [2023-03-12 00:33:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000104760_53637120.pth [2023-03-12 00:33:57,428][106434] Updated weights for policy 0, policy_version 105520 (0.0005) [2023-03-12 00:34:00,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11946.7, 300 sec: 11982.5). Total num frames: 54059008. Throughput: 0: 12043.5. Samples: 54053796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:34:00,662][106151] Avg episode reward: [(0, '4106.137')] [2023-03-12 00:34:01,009][106434] Updated weights for policy 0, policy_version 105600 (0.0004) [2023-03-12 00:34:04,632][106434] Updated weights for policy 0, policy_version 105680 (0.0005) [2023-03-12 00:34:05,661][106151] Fps is (10 sec: 11059.3, 60 sec: 11878.4, 300 sec: 11968.7). Total num frames: 54116352. Throughput: 0: 12028.9. Samples: 54087744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:34:05,661][106151] Avg episode reward: [(0, '4147.818')] [2023-03-12 00:34:08,300][106434] Updated weights for policy 0, policy_version 105760 (0.0005) [2023-03-12 00:34:10,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11878.4, 300 sec: 11954.8). Total num frames: 54173696. Throughput: 0: 12010.9. Samples: 54155104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:34:10,661][106151] Avg episode reward: [(0, '4172.723')] [2023-03-12 00:34:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000105808_54173696.pth... [2023-03-12 00:34:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000105120_53821440.pth [2023-03-12 00:34:11,954][106434] Updated weights for policy 0, policy_version 105840 (0.0005) [2023-03-12 00:34:15,537][106434] Updated weights for policy 0, policy_version 105920 (0.0005) [2023-03-12 00:34:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11927.0). Total num frames: 54231040. Throughput: 0: 11858.8. Samples: 54222860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:34:15,661][106151] Avg episode reward: [(0, '4232.134')] [2023-03-12 00:34:19,169][106434] Updated weights for policy 0, policy_version 106000 (0.0005) [2023-03-12 00:34:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11913.1). Total num frames: 54288384. Throughput: 0: 11777.4. Samples: 54256604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:34:20,661][106151] Avg episode reward: [(0, '4337.125')] [2023-03-12 00:34:22,732][106434] Updated weights for policy 0, policy_version 106080 (0.0005) [2023-03-12 00:34:25,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11878.4, 300 sec: 11885.3). Total num frames: 54345728. Throughput: 0: 11650.9. Samples: 54325312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:34:25,661][106151] Avg episode reward: [(0, '3704.371')] [2023-03-12 00:34:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000106144_54345728.pth... [2023-03-12 00:34:25,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000105480_54005760.pth [2023-03-12 00:34:26,350][106434] Updated weights for policy 0, policy_version 106160 (0.0005) [2023-03-12 00:34:29,915][106434] Updated weights for policy 0, policy_version 106240 (0.0005) [2023-03-12 00:34:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11871.5). Total num frames: 54403072. Throughput: 0: 11537.2. Samples: 54394556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:34:30,662][106151] Avg episode reward: [(0, '4019.966')] [2023-03-12 00:34:33,526][106434] Updated weights for policy 0, policy_version 106320 (0.0005) [2023-03-12 00:34:35,661][106151] Fps is (10 sec: 11059.3, 60 sec: 11605.4, 300 sec: 11829.8). Total num frames: 54456320. Throughput: 0: 11444.8. Samples: 54427712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:34:35,661][106151] Avg episode reward: [(0, '4349.140')] [2023-03-12 00:34:37,058][106434] Updated weights for policy 0, policy_version 106400 (0.0005) [2023-03-12 00:34:40,459][106434] Updated weights for policy 0, policy_version 106480 (0.0005) [2023-03-12 00:34:40,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11829.8). Total num frames: 54517760. Throughput: 0: 11391.3. Samples: 54497888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:34:40,661][106151] Avg episode reward: [(0, '4380.459')] [2023-03-12 00:34:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000106480_54517760.pth... [2023-03-12 00:34:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000105808_54173696.pth [2023-03-12 00:34:43,947][106434] Updated weights for policy 0, policy_version 106560 (0.0005) [2023-03-12 00:34:45,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11537.1, 300 sec: 11802.0). Total num frames: 54575104. Throughput: 0: 11446.3. Samples: 54568880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:34:45,661][106151] Avg episode reward: [(0, '3872.041')] [2023-03-12 00:34:47,437][106434] Updated weights for policy 0, policy_version 106640 (0.0005) [2023-03-12 00:34:50,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 11788.2). Total num frames: 54636544. Throughput: 0: 11476.9. Samples: 54604204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:34:50,661][106151] Avg episode reward: [(0, '3966.181')] [2023-03-12 00:34:50,956][106434] Updated weights for policy 0, policy_version 106720 (0.0005) [2023-03-12 00:34:54,488][106434] Updated weights for policy 0, policy_version 106800 (0.0005) [2023-03-12 00:34:55,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 11774.3). Total num frames: 54693888. Throughput: 0: 11524.1. Samples: 54673688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:34:55,661][106151] Avg episode reward: [(0, '4021.931')] [2023-03-12 00:34:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000106824_54693888.pth... [2023-03-12 00:34:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000106144_54345728.pth [2023-03-12 00:34:58,065][106434] Updated weights for policy 0, policy_version 106880 (0.0005) [2023-03-12 00:35:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11746.5). Total num frames: 54751232. Throughput: 0: 11561.0. Samples: 54743104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:35:00,661][106151] Avg episode reward: [(0, '4379.436')] [2023-03-12 00:35:01,576][106434] Updated weights for policy 0, policy_version 106960 (0.0005) [2023-03-12 00:35:05,027][106434] Updated weights for policy 0, policy_version 107040 (0.0005) [2023-03-12 00:35:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.0, 300 sec: 11732.6). Total num frames: 54808576. Throughput: 0: 11614.5. Samples: 54779256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:35:05,662][106151] Avg episode reward: [(0, '4384.943')] [2023-03-12 00:35:08,545][106434] Updated weights for policy 0, policy_version 107120 (0.0005) [2023-03-12 00:35:10,661][106151] Fps is (10 sec: 11878.2, 60 sec: 11605.3, 300 sec: 11718.7). Total num frames: 54870016. Throughput: 0: 11641.7. Samples: 54849188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:35:10,662][106151] Avg episode reward: [(0, '4330.116')] [2023-03-12 00:35:10,666][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000107168_54870016.pth... [2023-03-12 00:35:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000106480_54517760.pth [2023-03-12 00:35:12,079][106434] Updated weights for policy 0, policy_version 107200 (0.0005) [2023-03-12 00:35:15,625][106434] Updated weights for policy 0, policy_version 107280 (0.0005) [2023-03-12 00:35:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11718.7). Total num frames: 54927360. Throughput: 0: 11645.4. Samples: 54918600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:35:15,662][106151] Avg episode reward: [(0, '4531.481')] [2023-03-12 00:35:15,662][106390] Saving new best policy, reward=4531.481! [2023-03-12 00:35:19,153][106434] Updated weights for policy 0, policy_version 107360 (0.0005) [2023-03-12 00:35:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11704.8). Total num frames: 54984704. Throughput: 0: 11659.0. Samples: 54952368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:35:20,662][106151] Avg episode reward: [(0, '4474.239')] [2023-03-12 00:35:22,717][106434] Updated weights for policy 0, policy_version 107440 (0.0005) [2023-03-12 00:35:25,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11704.8). Total num frames: 55042048. Throughput: 0: 11646.4. Samples: 55021976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:35:25,662][106151] Avg episode reward: [(0, '4477.574')] [2023-03-12 00:35:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000107504_55042048.pth... [2023-03-12 00:35:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000106824_54693888.pth [2023-03-12 00:35:26,284][106434] Updated weights for policy 0, policy_version 107520 (0.0005) [2023-03-12 00:35:29,892][106434] Updated weights for policy 0, policy_version 107600 (0.0005) [2023-03-12 00:35:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11704.8). Total num frames: 55099392. Throughput: 0: 11597.9. Samples: 55090784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:35:30,662][106151] Avg episode reward: [(0, '4338.265')] [2023-03-12 00:35:33,466][106434] Updated weights for policy 0, policy_version 107680 (0.0005) [2023-03-12 00:35:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11691.0). Total num frames: 55156736. Throughput: 0: 11566.2. Samples: 55124684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:35:35,661][106151] Avg episode reward: [(0, '4335.955')] [2023-03-12 00:35:37,072][106434] Updated weights for policy 0, policy_version 107760 (0.0005) [2023-03-12 00:35:40,626][106434] Updated weights for policy 0, policy_version 107840 (0.0005) [2023-03-12 00:35:40,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11691.0). Total num frames: 55214080. Throughput: 0: 11553.6. Samples: 55193600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:35:40,662][106151] Avg episode reward: [(0, '4345.229')] [2023-03-12 00:35:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000107840_55214080.pth... [2023-03-12 00:35:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000107168_54870016.pth [2023-03-12 00:35:44,200][106434] Updated weights for policy 0, policy_version 107920 (0.0005) [2023-03-12 00:35:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11691.0). Total num frames: 55271424. Throughput: 0: 11550.1. Samples: 55262860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:35:45,662][106151] Avg episode reward: [(0, '4390.874')] [2023-03-12 00:35:47,724][106434] Updated weights for policy 0, policy_version 108000 (0.0005) [2023-03-12 00:35:50,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11691.0). Total num frames: 55328768. Throughput: 0: 11507.5. Samples: 55297092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:35:50,661][106151] Avg episode reward: [(0, '4275.038')] [2023-03-12 00:35:50,980][106434] Updated weights for policy 0, policy_version 108080 (0.0004) [2023-03-12 00:35:54,234][106434] Updated weights for policy 0, policy_version 108160 (0.0004) [2023-03-12 00:35:55,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11673.6, 300 sec: 11704.8). Total num frames: 55394304. Throughput: 0: 11638.1. Samples: 55372900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:35:55,661][106151] Avg episode reward: [(0, '4202.618')] [2023-03-12 00:35:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000108192_55394304.pth... [2023-03-12 00:35:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000107504_55042048.pth [2023-03-12 00:35:57,459][106434] Updated weights for policy 0, policy_version 108240 (0.0003) [2023-03-12 00:36:00,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11741.9, 300 sec: 11718.7). Total num frames: 55455744. Throughput: 0: 11781.3. Samples: 55448756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:36:00,661][106151] Avg episode reward: [(0, '4124.722')] [2023-03-12 00:36:00,689][106434] Updated weights for policy 0, policy_version 108320 (0.0004) [2023-03-12 00:36:04,039][106434] Updated weights for policy 0, policy_version 108400 (0.0005) [2023-03-12 00:36:05,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 11718.7). Total num frames: 55517184. Throughput: 0: 11856.8. Samples: 55485924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:36:05,662][106151] Avg episode reward: [(0, '4444.713')] [2023-03-12 00:36:07,349][106434] Updated weights for policy 0, policy_version 108480 (0.0004) [2023-03-12 00:36:10,641][106434] Updated weights for policy 0, policy_version 108560 (0.0004) [2023-03-12 00:36:10,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11878.4, 300 sec: 11746.5). Total num frames: 55582720. Throughput: 0: 11965.8. Samples: 55560436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:36:10,661][106151] Avg episode reward: [(0, '4370.868')] [2023-03-12 00:36:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000108560_55582720.pth... [2023-03-12 00:36:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000107840_55214080.pth [2023-03-12 00:36:13,900][106434] Updated weights for policy 0, policy_version 108640 (0.0004) [2023-03-12 00:36:15,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11946.7, 300 sec: 11746.5). Total num frames: 55644160. Throughput: 0: 12107.2. Samples: 55635608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:36:15,661][106151] Avg episode reward: [(0, '4465.792')] [2023-03-12 00:36:17,197][106434] Updated weights for policy 0, policy_version 108720 (0.0004) [2023-03-12 00:36:20,408][106434] Updated weights for policy 0, policy_version 108800 (0.0003) [2023-03-12 00:36:20,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11760.4). Total num frames: 55705600. Throughput: 0: 12181.3. Samples: 55672844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:36:20,661][106151] Avg episode reward: [(0, '4517.245')] [2023-03-12 00:36:23,672][106434] Updated weights for policy 0, policy_version 108880 (0.0004) [2023-03-12 00:36:25,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12151.5, 300 sec: 11788.1). Total num frames: 55771136. Throughput: 0: 12325.2. Samples: 55748232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:36:25,661][106151] Avg episode reward: [(0, '4338.652')] [2023-03-12 00:36:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000108928_55771136.pth... [2023-03-12 00:36:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000108192_55394304.pth [2023-03-12 00:36:26,910][106434] Updated weights for policy 0, policy_version 108960 (0.0004) [2023-03-12 00:36:30,180][106434] Updated weights for policy 0, policy_version 109040 (0.0004) [2023-03-12 00:36:30,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 11802.0). Total num frames: 55832576. Throughput: 0: 12475.2. Samples: 55824244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:36:30,661][106151] Avg episode reward: [(0, '4384.038')] [2023-03-12 00:36:33,435][106434] Updated weights for policy 0, policy_version 109120 (0.0004) [2023-03-12 00:36:35,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 11815.9). Total num frames: 55894016. Throughput: 0: 12547.0. Samples: 55861708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:36:35,661][106151] Avg episode reward: [(0, '4260.212')] [2023-03-12 00:36:36,739][106434] Updated weights for policy 0, policy_version 109200 (0.0004) [2023-03-12 00:36:39,975][106434] Updated weights for policy 0, policy_version 109280 (0.0004) [2023-03-12 00:36:40,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 11829.8). Total num frames: 55959552. Throughput: 0: 12527.6. Samples: 55936640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:36:40,661][106151] Avg episode reward: [(0, '4394.550')] [2023-03-12 00:36:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000109296_55959552.pth... [2023-03-12 00:36:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000108560_55582720.pth [2023-03-12 00:36:43,245][106434] Updated weights for policy 0, policy_version 109360 (0.0004) [2023-03-12 00:36:45,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 11843.7). Total num frames: 56020992. Throughput: 0: 12525.9. Samples: 56012420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:36:45,661][106151] Avg episode reward: [(0, '4472.069')] [2023-03-12 00:36:46,635][106434] Updated weights for policy 0, policy_version 109440 (0.0004) [2023-03-12 00:36:50,168][106434] Updated weights for policy 0, policy_version 109520 (0.0005) [2023-03-12 00:36:50,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12492.8, 300 sec: 11843.7). Total num frames: 56078336. Throughput: 0: 12468.7. Samples: 56047016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:36:50,661][106151] Avg episode reward: [(0, '4352.847')] [2023-03-12 00:36:53,672][106434] Updated weights for policy 0, policy_version 109600 (0.0005) [2023-03-12 00:36:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12356.3, 300 sec: 11843.7). Total num frames: 56135680. Throughput: 0: 12366.3. Samples: 56116920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:36:55,661][106151] Avg episode reward: [(0, '4473.384')] [2023-03-12 00:36:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000109640_56135680.pth... [2023-03-12 00:36:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000108928_55771136.pth [2023-03-12 00:36:57,269][106434] Updated weights for policy 0, policy_version 109680 (0.0005) [2023-03-12 00:37:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12288.0, 300 sec: 11829.8). Total num frames: 56193024. Throughput: 0: 12234.1. Samples: 56186144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:37:00,661][106151] Avg episode reward: [(0, '4212.267')] [2023-03-12 00:37:00,820][106434] Updated weights for policy 0, policy_version 109760 (0.0005) [2023-03-12 00:37:04,457][106434] Updated weights for policy 0, policy_version 109840 (0.0005) [2023-03-12 00:37:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 12219.7, 300 sec: 11829.8). Total num frames: 56250368. Throughput: 0: 12157.3. Samples: 56219924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:37:05,661][106151] Avg episode reward: [(0, '4234.842')] [2023-03-12 00:37:07,984][106434] Updated weights for policy 0, policy_version 109920 (0.0005) [2023-03-12 00:37:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 11815.9). Total num frames: 56307712. Throughput: 0: 12007.0. Samples: 56288548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:37:10,661][106151] Avg episode reward: [(0, '4377.005')] [2023-03-12 00:37:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000109976_56307712.pth... [2023-03-12 00:37:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000109296_55959552.pth [2023-03-12 00:37:11,568][106434] Updated weights for policy 0, policy_version 110000 (0.0005) [2023-03-12 00:37:15,135][106434] Updated weights for policy 0, policy_version 110080 (0.0005) [2023-03-12 00:37:15,661][106151] Fps is (10 sec: 11468.9, 60 sec: 12014.9, 300 sec: 11815.9). Total num frames: 56365056. Throughput: 0: 11844.5. Samples: 56357248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:37:15,661][106151] Avg episode reward: [(0, '4396.921')] [2023-03-12 00:37:18,744][106434] Updated weights for policy 0, policy_version 110160 (0.0005) [2023-03-12 00:37:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11815.9). Total num frames: 56422400. Throughput: 0: 11780.3. Samples: 56391820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:37:20,661][106151] Avg episode reward: [(0, '4433.878')] [2023-03-12 00:37:22,421][106434] Updated weights for policy 0, policy_version 110240 (0.0005) [2023-03-12 00:37:25,661][106151] Fps is (10 sec: 11468.6, 60 sec: 11810.1, 300 sec: 11815.9). Total num frames: 56479744. Throughput: 0: 11612.6. Samples: 56459208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:37:25,662][106151] Avg episode reward: [(0, '4450.864')] [2023-03-12 00:37:25,666][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000110312_56479744.pth... [2023-03-12 00:37:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000109640_56135680.pth [2023-03-12 00:37:26,029][106434] Updated weights for policy 0, policy_version 110320 (0.0005) [2023-03-12 00:37:29,710][106434] Updated weights for policy 0, policy_version 110400 (0.0005) [2023-03-12 00:37:30,661][106151] Fps is (10 sec: 11059.3, 60 sec: 11673.6, 300 sec: 11802.0). Total num frames: 56532992. Throughput: 0: 11413.9. Samples: 56526044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:37:30,661][106151] Avg episode reward: [(0, '4443.640')] [2023-03-12 00:37:33,377][106434] Updated weights for policy 0, policy_version 110480 (0.0005) [2023-03-12 00:37:35,661][106151] Fps is (10 sec: 11059.4, 60 sec: 11605.3, 300 sec: 11802.0). Total num frames: 56590336. Throughput: 0: 11398.3. Samples: 56559940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:37:35,661][106151] Avg episode reward: [(0, '4365.827')] [2023-03-12 00:37:37,024][106434] Updated weights for policy 0, policy_version 110560 (0.0005) [2023-03-12 00:37:40,417][106434] Updated weights for policy 0, policy_version 110640 (0.0004) [2023-03-12 00:37:40,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11802.0). Total num frames: 56647680. Throughput: 0: 11358.4. Samples: 56628048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:37:40,661][106151] Avg episode reward: [(0, '4190.147')] [2023-03-12 00:37:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000110640_56647680.pth... [2023-03-12 00:37:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000109976_56307712.pth [2023-03-12 00:37:43,772][106434] Updated weights for policy 0, policy_version 110720 (0.0004) [2023-03-12 00:37:45,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 11815.9). Total num frames: 56709120. Throughput: 0: 11441.1. Samples: 56700992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:37:45,661][106151] Avg episode reward: [(0, '4413.420')] [2023-03-12 00:37:47,169][106434] Updated weights for policy 0, policy_version 110800 (0.0004) [2023-03-12 00:37:50,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11468.8, 300 sec: 11815.9). Total num frames: 56766464. Throughput: 0: 11508.2. Samples: 56737792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:37:50,661][106151] Avg episode reward: [(0, '4375.122')] [2023-03-12 00:37:50,727][106434] Updated weights for policy 0, policy_version 110880 (0.0005) [2023-03-12 00:37:54,396][106434] Updated weights for policy 0, policy_version 110960 (0.0005) [2023-03-12 00:37:55,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11802.0). Total num frames: 56823808. Throughput: 0: 11478.9. Samples: 56805100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:37:55,661][106151] Avg episode reward: [(0, '4525.474')] [2023-03-12 00:37:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000110984_56823808.pth... [2023-03-12 00:37:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000110312_56479744.pth [2023-03-12 00:37:57,999][106434] Updated weights for policy 0, policy_version 111040 (0.0005) [2023-03-12 00:38:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11788.2). Total num frames: 56881152. Throughput: 0: 11460.3. Samples: 56872960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:38:00,661][106151] Avg episode reward: [(0, '4394.577')] [2023-03-12 00:38:01,657][106434] Updated weights for policy 0, policy_version 111120 (0.0005) [2023-03-12 00:38:05,335][106434] Updated weights for policy 0, policy_version 111200 (0.0005) [2023-03-12 00:38:05,661][106151] Fps is (10 sec: 11059.3, 60 sec: 11400.5, 300 sec: 11774.3). Total num frames: 56934400. Throughput: 0: 11430.4. Samples: 56906188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:38:05,661][106151] Avg episode reward: [(0, '4381.893')] [2023-03-12 00:38:08,942][106434] Updated weights for policy 0, policy_version 111280 (0.0005) [2023-03-12 00:38:10,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11400.5, 300 sec: 11774.3). Total num frames: 56991744. Throughput: 0: 11451.9. Samples: 56974544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:38:10,661][106151] Avg episode reward: [(0, '4369.698')] [2023-03-12 00:38:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000111312_56991744.pth... [2023-03-12 00:38:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000110640_56647680.pth [2023-03-12 00:38:12,516][106434] Updated weights for policy 0, policy_version 111360 (0.0005) [2023-03-12 00:38:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11774.3). Total num frames: 57049088. Throughput: 0: 11503.0. Samples: 57043680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:38:15,661][106151] Avg episode reward: [(0, '4191.045')] [2023-03-12 00:38:16,058][106434] Updated weights for policy 0, policy_version 111440 (0.0005) [2023-03-12 00:38:19,676][106434] Updated weights for policy 0, policy_version 111520 (0.0005) [2023-03-12 00:38:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11774.3). Total num frames: 57106432. Throughput: 0: 11507.1. Samples: 57077760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:38:20,661][106151] Avg episode reward: [(0, '4368.567')] [2023-03-12 00:38:23,276][106434] Updated weights for policy 0, policy_version 111600 (0.0005) [2023-03-12 00:38:25,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11400.5, 300 sec: 11746.5). Total num frames: 57163776. Throughput: 0: 11516.8. Samples: 57146304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:38:25,661][106151] Avg episode reward: [(0, '4311.950')] [2023-03-12 00:38:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000111648_57163776.pth... [2023-03-12 00:38:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000110984_56823808.pth [2023-03-12 00:38:26,882][106434] Updated weights for policy 0, policy_version 111680 (0.0005) [2023-03-12 00:38:30,489][106434] Updated weights for policy 0, policy_version 111760 (0.0005) [2023-03-12 00:38:30,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11732.6). Total num frames: 57221120. Throughput: 0: 11393.2. Samples: 57213684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:38:30,661][106151] Avg episode reward: [(0, '4106.216')] [2023-03-12 00:38:34,109][106434] Updated weights for policy 0, policy_version 111840 (0.0005) [2023-03-12 00:38:35,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11718.7). Total num frames: 57278464. Throughput: 0: 11327.6. Samples: 57247532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:38:35,661][106151] Avg episode reward: [(0, '4274.727')] [2023-03-12 00:38:37,715][106434] Updated weights for policy 0, policy_version 111920 (0.0005) [2023-03-12 00:38:40,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11704.8). Total num frames: 57335808. Throughput: 0: 11338.6. Samples: 57315336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:38:40,662][106151] Avg episode reward: [(0, '4336.574')] [2023-03-12 00:38:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000111984_57335808.pth... [2023-03-12 00:38:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000111312_56991744.pth [2023-03-12 00:38:41,316][106434] Updated weights for policy 0, policy_version 112000 (0.0005) [2023-03-12 00:38:44,925][106434] Updated weights for policy 0, policy_version 112080 (0.0005) [2023-03-12 00:38:45,661][106151] Fps is (10 sec: 11059.3, 60 sec: 11332.3, 300 sec: 11677.1). Total num frames: 57389056. Throughput: 0: 11355.7. Samples: 57383964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:38:45,661][106151] Avg episode reward: [(0, '4400.528')] [2023-03-12 00:38:48,587][106434] Updated weights for policy 0, policy_version 112160 (0.0005) [2023-03-12 00:38:50,661][106151] Fps is (10 sec: 11059.3, 60 sec: 11332.3, 300 sec: 11663.2). Total num frames: 57446400. Throughput: 0: 11366.6. Samples: 57417688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:38:50,661][106151] Avg episode reward: [(0, '4432.118')] [2023-03-12 00:38:52,187][106434] Updated weights for policy 0, policy_version 112240 (0.0005) [2023-03-12 00:38:55,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11332.3, 300 sec: 11677.1). Total num frames: 57503744. Throughput: 0: 11368.9. Samples: 57486144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:38:55,661][106151] Avg episode reward: [(0, '4178.302')] [2023-03-12 00:38:55,724][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000112320_57507840.pth... [2023-03-12 00:38:55,725][106434] Updated weights for policy 0, policy_version 112320 (0.0005) [2023-03-12 00:38:55,726][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000111648_57163776.pth [2023-03-12 00:38:59,331][106434] Updated weights for policy 0, policy_version 112400 (0.0005) [2023-03-12 00:39:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11677.1). Total num frames: 57561088. Throughput: 0: 11346.6. Samples: 57554280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:39:00,661][106151] Avg episode reward: [(0, '4484.593')] [2023-03-12 00:39:02,915][106434] Updated weights for policy 0, policy_version 112480 (0.0005) [2023-03-12 00:39:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11677.1). Total num frames: 57618432. Throughput: 0: 11369.7. Samples: 57589396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:39:05,661][106151] Avg episode reward: [(0, '4440.887')] [2023-03-12 00:39:06,462][106434] Updated weights for policy 0, policy_version 112560 (0.0005) [2023-03-12 00:39:10,094][106434] Updated weights for policy 0, policy_version 112640 (0.0005) [2023-03-12 00:39:10,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11400.5, 300 sec: 11677.1). Total num frames: 57675776. Throughput: 0: 11359.7. Samples: 57657492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:39:10,662][106151] Avg episode reward: [(0, '4402.636')] [2023-03-12 00:39:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000112648_57675776.pth... [2023-03-12 00:39:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000111984_57335808.pth [2023-03-12 00:39:13,663][106434] Updated weights for policy 0, policy_version 112720 (0.0005) [2023-03-12 00:39:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11677.1). Total num frames: 57733120. Throughput: 0: 11372.3. Samples: 57725440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:39:15,661][106151] Avg episode reward: [(0, '4437.964')] [2023-03-12 00:39:17,207][106434] Updated weights for policy 0, policy_version 112800 (0.0005) [2023-03-12 00:39:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11400.5, 300 sec: 11677.1). Total num frames: 57790464. Throughput: 0: 11406.9. Samples: 57760844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:39:20,661][106151] Avg episode reward: [(0, '4272.487')] [2023-03-12 00:39:20,836][106434] Updated weights for policy 0, policy_version 112880 (0.0005) [2023-03-12 00:39:24,260][106434] Updated weights for policy 0, policy_version 112960 (0.0004) [2023-03-12 00:39:25,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 11691.0). Total num frames: 57851904. Throughput: 0: 11450.1. Samples: 57830588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:39:25,661][106151] Avg episode reward: [(0, '4263.311')] [2023-03-12 00:39:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000112992_57851904.pth... [2023-03-12 00:39:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000112320_57507840.pth [2023-03-12 00:39:27,565][106434] Updated weights for policy 0, policy_version 113040 (0.0003) [2023-03-12 00:39:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11537.1, 300 sec: 11718.7). Total num frames: 57913344. Throughput: 0: 11577.9. Samples: 57904968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:39:30,661][106151] Avg episode reward: [(0, '4346.327')] [2023-03-12 00:39:30,862][106434] Updated weights for policy 0, policy_version 113120 (0.0003) [2023-03-12 00:39:34,219][106434] Updated weights for policy 0, policy_version 113200 (0.0003) [2023-03-12 00:39:35,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11605.3, 300 sec: 11718.7). Total num frames: 57974784. Throughput: 0: 11645.0. Samples: 57941712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:39:35,661][106151] Avg episode reward: [(0, '4350.157')] [2023-03-12 00:39:37,615][106434] Updated weights for policy 0, policy_version 113280 (0.0003) [2023-03-12 00:39:40,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11718.7). Total num frames: 58032128. Throughput: 0: 11721.3. Samples: 58013604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:39:40,661][106151] Avg episode reward: [(0, '4185.351')] [2023-03-12 00:39:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000113344_58032128.pth... [2023-03-12 00:39:40,665][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000112648_57675776.pth [2023-03-12 00:39:41,083][106434] Updated weights for policy 0, policy_version 113360 (0.0003) [2023-03-12 00:39:44,355][106434] Updated weights for policy 0, policy_version 113440 (0.0003) [2023-03-12 00:39:45,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11741.9, 300 sec: 11718.7). Total num frames: 58093568. Throughput: 0: 11832.4. Samples: 58086736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:39:45,661][106151] Avg episode reward: [(0, '4306.359')] [2023-03-12 00:39:47,793][106434] Updated weights for policy 0, policy_version 113520 (0.0003) [2023-03-12 00:39:50,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 11732.6). Total num frames: 58155008. Throughput: 0: 11842.6. Samples: 58122312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:39:50,661][106151] Avg episode reward: [(0, '4428.854')] [2023-03-12 00:39:51,026][106434] Updated weights for policy 0, policy_version 113600 (0.0003) [2023-03-12 00:39:54,286][106434] Updated weights for policy 0, policy_version 113680 (0.0003) [2023-03-12 00:39:55,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11878.4, 300 sec: 11746.5). Total num frames: 58216448. Throughput: 0: 12014.9. Samples: 58198164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:39:55,661][106151] Avg episode reward: [(0, '4257.291')] [2023-03-12 00:39:55,684][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000113712_58220544.pth... [2023-03-12 00:39:55,686][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000112992_57851904.pth [2023-03-12 00:39:57,693][106434] Updated weights for policy 0, policy_version 113760 (0.0003) [2023-03-12 00:40:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11760.4). Total num frames: 58277888. Throughput: 0: 12096.0. Samples: 58269760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:40:00,661][106151] Avg episode reward: [(0, '4344.554')] [2023-03-12 00:40:01,263][106434] Updated weights for policy 0, policy_version 113840 (0.0005) [2023-03-12 00:40:04,937][106434] Updated weights for policy 0, policy_version 113920 (0.0006) [2023-03-12 00:40:05,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11746.5). Total num frames: 58335232. Throughput: 0: 12058.8. Samples: 58303492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:40:05,661][106151] Avg episode reward: [(0, '4206.680')] [2023-03-12 00:40:08,487][106434] Updated weights for policy 0, policy_version 114000 (0.0005) [2023-03-12 00:40:10,661][106151] Fps is (10 sec: 11059.1, 60 sec: 11878.4, 300 sec: 11732.6). Total num frames: 58388480. Throughput: 0: 12033.5. Samples: 58372096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:40:10,661][106151] Avg episode reward: [(0, '4294.938')] [2023-03-12 00:40:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000114040_58388480.pth... [2023-03-12 00:40:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000113344_58032128.pth [2023-03-12 00:40:12,196][106434] Updated weights for policy 0, policy_version 114080 (0.0005) [2023-03-12 00:40:15,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11878.4, 300 sec: 11732.6). Total num frames: 58445824. Throughput: 0: 11878.8. Samples: 58439512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:40:15,661][106151] Avg episode reward: [(0, '3560.398')] [2023-03-12 00:40:15,748][106434] Updated weights for policy 0, policy_version 114160 (0.0005) [2023-03-12 00:40:19,395][106434] Updated weights for policy 0, policy_version 114240 (0.0006) [2023-03-12 00:40:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11878.4, 300 sec: 11732.6). Total num frames: 58503168. Throughput: 0: 11811.1. Samples: 58473212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:40:20,661][106151] Avg episode reward: [(0, '3091.860')] [2023-03-12 00:40:22,783][106434] Updated weights for policy 0, policy_version 114320 (0.0003) [2023-03-12 00:40:25,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 11746.5). Total num frames: 58564608. Throughput: 0: 11798.8. Samples: 58544552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:40:25,662][106151] Avg episode reward: [(0, '3892.022')] [2023-03-12 00:40:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000114384_58564608.pth... [2023-03-12 00:40:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000113712_58220544.pth [2023-03-12 00:40:26,090][106434] Updated weights for policy 0, policy_version 114400 (0.0003) [2023-03-12 00:40:29,449][106434] Updated weights for policy 0, policy_version 114480 (0.0003) [2023-03-12 00:40:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11760.4). Total num frames: 58626048. Throughput: 0: 11810.6. Samples: 58618216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:40:30,661][106151] Avg episode reward: [(0, '3737.504')] [2023-03-12 00:40:32,835][106434] Updated weights for policy 0, policy_version 114560 (0.0004) [2023-03-12 00:40:35,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11760.4). Total num frames: 58683392. Throughput: 0: 11831.7. Samples: 58654740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:40:35,661][106151] Avg episode reward: [(0, '4413.622')] [2023-03-12 00:40:36,420][106434] Updated weights for policy 0, policy_version 114640 (0.0005) [2023-03-12 00:40:39,932][106434] Updated weights for policy 0, policy_version 114720 (0.0005) [2023-03-12 00:40:40,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11774.3). Total num frames: 58744832. Throughput: 0: 11693.1. Samples: 58724352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:40:40,661][106151] Avg episode reward: [(0, '4192.222')] [2023-03-12 00:40:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000114736_58744832.pth... [2023-03-12 00:40:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000114040_58388480.pth [2023-03-12 00:40:43,527][106434] Updated weights for policy 0, policy_version 114800 (0.0006) [2023-03-12 00:40:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11760.4). Total num frames: 58798080. Throughput: 0: 11614.5. Samples: 58792412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:40:45,662][106151] Avg episode reward: [(0, '4229.013')] [2023-03-12 00:40:47,090][106434] Updated weights for policy 0, policy_version 114880 (0.0005) [2023-03-12 00:40:50,655][106434] Updated weights for policy 0, policy_version 114960 (0.0005) [2023-03-12 00:40:50,661][106151] Fps is (10 sec: 11469.0, 60 sec: 11741.9, 300 sec: 11746.5). Total num frames: 58859520. Throughput: 0: 11629.8. Samples: 58826832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:40:50,661][106151] Avg episode reward: [(0, '4010.600')] [2023-03-12 00:40:54,201][106434] Updated weights for policy 0, policy_version 115040 (0.0005) [2023-03-12 00:40:55,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11732.6). Total num frames: 58916864. Throughput: 0: 11651.1. Samples: 58896396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:40:55,662][106151] Avg episode reward: [(0, '4137.605')] [2023-03-12 00:40:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000115072_58916864.pth... [2023-03-12 00:40:55,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000114384_58564608.pth [2023-03-12 00:40:57,800][106434] Updated weights for policy 0, policy_version 115120 (0.0006) [2023-03-12 00:41:00,661][106151] Fps is (10 sec: 11059.1, 60 sec: 11537.1, 300 sec: 11704.8). Total num frames: 58970112. Throughput: 0: 11657.5. Samples: 58964100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:41:00,661][106151] Avg episode reward: [(0, '3761.204')] [2023-03-12 00:41:01,479][106434] Updated weights for policy 0, policy_version 115200 (0.0005) [2023-03-12 00:41:05,054][106434] Updated weights for policy 0, policy_version 115280 (0.0006) [2023-03-12 00:41:05,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11677.1). Total num frames: 59027456. Throughput: 0: 11668.7. Samples: 58998304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:41:05,661][106151] Avg episode reward: [(0, '4281.817')] [2023-03-12 00:41:08,653][106434] Updated weights for policy 0, policy_version 115360 (0.0005) [2023-03-12 00:41:10,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11663.2). Total num frames: 59084800. Throughput: 0: 11598.8. Samples: 59066500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:41:10,662][106151] Avg episode reward: [(0, '4336.233')] [2023-03-12 00:41:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000115400_59084800.pth... [2023-03-12 00:41:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000114736_58744832.pth [2023-03-12 00:41:12,203][106434] Updated weights for policy 0, policy_version 115440 (0.0006) [2023-03-12 00:41:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11649.3). Total num frames: 59142144. Throughput: 0: 11486.8. Samples: 59135120. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:41:15,661][106151] Avg episode reward: [(0, '3835.620')] [2023-03-12 00:41:15,789][106434] Updated weights for policy 0, policy_version 115520 (0.0006) [2023-03-12 00:41:19,120][106434] Updated weights for policy 0, policy_version 115600 (0.0003) [2023-03-12 00:41:20,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11635.4). Total num frames: 59203584. Throughput: 0: 11469.8. Samples: 59170880. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:41:20,661][106151] Avg episode reward: [(0, '3855.407')] [2023-03-12 00:41:22,675][106434] Updated weights for policy 0, policy_version 115680 (0.0005) [2023-03-12 00:41:25,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11621.5). Total num frames: 59260928. Throughput: 0: 11513.8. Samples: 59242472. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:41:25,661][106151] Avg episode reward: [(0, '3899.769')] [2023-03-12 00:41:25,667][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000115752_59265024.pth... [2023-03-12 00:41:25,669][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000115072_58916864.pth [2023-03-12 00:41:25,983][106434] Updated weights for policy 0, policy_version 115760 (0.0003) [2023-03-12 00:41:29,408][106434] Updated weights for policy 0, policy_version 115840 (0.0003) [2023-03-12 00:41:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11621.5). Total num frames: 59322368. Throughput: 0: 11608.4. Samples: 59314788. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:41:30,661][106151] Avg episode reward: [(0, '3942.557')] [2023-03-12 00:41:33,000][106434] Updated weights for policy 0, policy_version 115920 (0.0006) [2023-03-12 00:41:35,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11593.8). Total num frames: 59379712. Throughput: 0: 11614.2. Samples: 59349472. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:41:35,661][106151] Avg episode reward: [(0, '4429.742')] [2023-03-12 00:41:36,537][106434] Updated weights for policy 0, policy_version 116000 (0.0005) [2023-03-12 00:41:40,176][106434] Updated weights for policy 0, policy_version 116080 (0.0005) [2023-03-12 00:41:40,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11579.9). Total num frames: 59437056. Throughput: 0: 11567.6. Samples: 59416940. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:41:40,661][106151] Avg episode reward: [(0, '4390.429')] [2023-03-12 00:41:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000116088_59437056.pth... [2023-03-12 00:41:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000115400_59084800.pth [2023-03-12 00:41:43,797][106434] Updated weights for policy 0, policy_version 116160 (0.0005) [2023-03-12 00:41:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11579.9). Total num frames: 59494400. Throughput: 0: 11594.5. Samples: 59485852. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:41:45,661][106151] Avg episode reward: [(0, '4033.970')] [2023-03-12 00:41:47,414][106434] Updated weights for policy 0, policy_version 116240 (0.0005) [2023-03-12 00:41:50,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11537.0, 300 sec: 11579.9). Total num frames: 59551744. Throughput: 0: 11581.4. Samples: 59519468. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:41:50,661][106151] Avg episode reward: [(0, '4465.662')] [2023-03-12 00:41:51,018][106434] Updated weights for policy 0, policy_version 116320 (0.0005) [2023-03-12 00:41:54,581][106434] Updated weights for policy 0, policy_version 116400 (0.0005) [2023-03-12 00:41:55,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11579.9). Total num frames: 59609088. Throughput: 0: 11594.9. Samples: 59588272. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:41:55,662][106151] Avg episode reward: [(0, '4387.100')] [2023-03-12 00:41:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000116424_59609088.pth... [2023-03-12 00:41:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000115752_59265024.pth [2023-03-12 00:41:58,135][106434] Updated weights for policy 0, policy_version 116480 (0.0005) [2023-03-12 00:42:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11579.9). Total num frames: 59666432. Throughput: 0: 11605.9. Samples: 59657384. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:42:00,661][106151] Avg episode reward: [(0, '4387.985')] [2023-03-12 00:42:01,708][106434] Updated weights for policy 0, policy_version 116560 (0.0006) [2023-03-12 00:42:05,272][106434] Updated weights for policy 0, policy_version 116640 (0.0005) [2023-03-12 00:42:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11579.9). Total num frames: 59723776. Throughput: 0: 11569.9. Samples: 59691524. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:42:05,661][106151] Avg episode reward: [(0, '4358.906')] [2023-03-12 00:42:08,715][106434] Updated weights for policy 0, policy_version 116720 (0.0005) [2023-03-12 00:42:10,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11579.9). Total num frames: 59781120. Throughput: 0: 11541.1. Samples: 59761820. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 00:42:10,661][106151] Avg episode reward: [(0, '4386.881')] [2023-03-12 00:42:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000116760_59781120.pth... [2023-03-12 00:42:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000116088_59437056.pth [2023-03-12 00:42:12,273][106434] Updated weights for policy 0, policy_version 116800 (0.0005) [2023-03-12 00:42:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11579.9). Total num frames: 59838464. Throughput: 0: 11470.1. Samples: 59830944. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:42:15,661][106151] Avg episode reward: [(0, '4438.999')] [2023-03-12 00:42:15,803][106434] Updated weights for policy 0, policy_version 116880 (0.0005) [2023-03-12 00:42:19,409][106434] Updated weights for policy 0, policy_version 116960 (0.0006) [2023-03-12 00:42:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11579.9). Total num frames: 59895808. Throughput: 0: 11469.1. Samples: 59865580. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:42:20,661][106151] Avg episode reward: [(0, '4171.471')] [2023-03-12 00:42:22,774][106434] Updated weights for policy 0, policy_version 117040 (0.0004) [2023-03-12 00:42:25,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 11607.6). Total num frames: 59957248. Throughput: 0: 11553.2. Samples: 59936832. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:42:25,662][106151] Avg episode reward: [(0, '4043.687')] [2023-03-12 00:42:25,666][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000117104_59957248.pth... [2023-03-12 00:42:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000116424_59609088.pth [2023-03-12 00:42:26,145][106434] Updated weights for policy 0, policy_version 117120 (0.0004) [2023-03-12 00:42:29,704][106434] Updated weights for policy 0, policy_version 117200 (0.0005) [2023-03-12 00:42:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 11607.6). Total num frames: 60014592. Throughput: 0: 11594.2. Samples: 60007592. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:42:30,661][106151] Avg episode reward: [(0, '4255.920')] [2023-03-12 00:42:33,199][106434] Updated weights for policy 0, policy_version 117280 (0.0005) [2023-03-12 00:42:35,661][106151] Fps is (10 sec: 11878.6, 60 sec: 11605.3, 300 sec: 11621.5). Total num frames: 60076032. Throughput: 0: 11639.9. Samples: 60043264. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:42:35,661][106151] Avg episode reward: [(0, '4194.874')] [2023-03-12 00:42:36,735][106434] Updated weights for policy 0, policy_version 117360 (0.0005) [2023-03-12 00:42:40,311][106434] Updated weights for policy 0, policy_version 117440 (0.0005) [2023-03-12 00:42:40,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11607.6). Total num frames: 60133376. Throughput: 0: 11652.7. Samples: 60112644. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:42:40,661][106151] Avg episode reward: [(0, '4433.944')] [2023-03-12 00:42:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000117448_60133376.pth... [2023-03-12 00:42:40,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000116760_59781120.pth [2023-03-12 00:42:43,562][106434] Updated weights for policy 0, policy_version 117520 (0.0004) [2023-03-12 00:42:45,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11621.5). Total num frames: 60194816. Throughput: 0: 11762.5. Samples: 60186696. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:42:45,661][106151] Avg episode reward: [(0, '4326.300')] [2023-03-12 00:42:46,756][106434] Updated weights for policy 0, policy_version 117600 (0.0004) [2023-03-12 00:42:50,093][106434] Updated weights for policy 0, policy_version 117680 (0.0004) [2023-03-12 00:42:50,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11741.9, 300 sec: 11635.4). Total num frames: 60256256. Throughput: 0: 11857.9. Samples: 60225128. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:42:50,661][106151] Avg episode reward: [(0, '4280.340')] [2023-03-12 00:42:53,525][106434] Updated weights for policy 0, policy_version 117760 (0.0005) [2023-03-12 00:42:55,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11810.2, 300 sec: 11649.3). Total num frames: 60317696. Throughput: 0: 11897.2. Samples: 60297192. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:42:55,661][106151] Avg episode reward: [(0, '4261.070')] [2023-03-12 00:42:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000117808_60317696.pth... [2023-03-12 00:42:55,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000117104_59957248.pth [2023-03-12 00:42:57,045][106434] Updated weights for policy 0, policy_version 117840 (0.0005) [2023-03-12 00:43:00,573][106434] Updated weights for policy 0, policy_version 117920 (0.0005) [2023-03-12 00:43:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11663.2). Total num frames: 60375040. Throughput: 0: 11908.4. Samples: 60366824. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:43:00,661][106151] Avg episode reward: [(0, '4477.562')] [2023-03-12 00:43:04,111][106434] Updated weights for policy 0, policy_version 118000 (0.0005) [2023-03-12 00:43:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11663.2). Total num frames: 60432384. Throughput: 0: 11894.7. Samples: 60400840. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:43:05,661][106151] Avg episode reward: [(0, '4391.004')] [2023-03-12 00:43:07,672][106434] Updated weights for policy 0, policy_version 118080 (0.0005) [2023-03-12 00:43:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11663.2). Total num frames: 60489728. Throughput: 0: 11833.1. Samples: 60469320. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:43:10,661][106151] Avg episode reward: [(0, '4439.265')] [2023-03-12 00:43:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000118144_60489728.pth... [2023-03-12 00:43:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000117448_60133376.pth [2023-03-12 00:43:11,216][106434] Updated weights for policy 0, policy_version 118160 (0.0005) [2023-03-12 00:43:14,716][106434] Updated weights for policy 0, policy_version 118240 (0.0005) [2023-03-12 00:43:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11663.2). Total num frames: 60547072. Throughput: 0: 11829.7. Samples: 60539928. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:43:15,661][106151] Avg episode reward: [(0, '4332.679')] [2023-03-12 00:43:18,219][106434] Updated weights for policy 0, policy_version 118320 (0.0005) [2023-03-12 00:43:20,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11677.1). Total num frames: 60608512. Throughput: 0: 11822.9. Samples: 60575296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:43:20,661][106151] Avg episode reward: [(0, '4255.086')] [2023-03-12 00:43:21,531][106434] Updated weights for policy 0, policy_version 118400 (0.0003) [2023-03-12 00:43:24,848][106434] Updated weights for policy 0, policy_version 118480 (0.0003) [2023-03-12 00:43:25,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11691.0). Total num frames: 60669952. Throughput: 0: 11930.9. Samples: 60649536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:43:25,661][106151] Avg episode reward: [(0, '4262.799')] [2023-03-12 00:43:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000118496_60669952.pth... [2023-03-12 00:43:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000117808_60317696.pth [2023-03-12 00:43:28,109][106434] Updated weights for policy 0, policy_version 118560 (0.0003) [2023-03-12 00:43:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11704.8). Total num frames: 60731392. Throughput: 0: 11949.3. Samples: 60724416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:43:30,662][106151] Avg episode reward: [(0, '4057.482')] [2023-03-12 00:43:31,379][106434] Updated weights for policy 0, policy_version 118640 (0.0004) [2023-03-12 00:43:34,665][106434] Updated weights for policy 0, policy_version 118720 (0.0005) [2023-03-12 00:43:35,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11732.6). Total num frames: 60796928. Throughput: 0: 11924.5. Samples: 60761732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:43:35,662][106151] Avg episode reward: [(0, '4038.420')] [2023-03-12 00:43:37,853][106434] Updated weights for policy 0, policy_version 118800 (0.0004) [2023-03-12 00:43:40,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12083.2, 300 sec: 11760.4). Total num frames: 60858368. Throughput: 0: 12017.0. Samples: 60837960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:43:40,662][106151] Avg episode reward: [(0, '4252.792')] [2023-03-12 00:43:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000118864_60858368.pth... [2023-03-12 00:43:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000118144_60489728.pth [2023-03-12 00:43:41,045][106434] Updated weights for policy 0, policy_version 118880 (0.0004) [2023-03-12 00:43:44,314][106434] Updated weights for policy 0, policy_version 118960 (0.0004) [2023-03-12 00:43:45,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 11788.1). Total num frames: 60923904. Throughput: 0: 12153.4. Samples: 60913728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:43:45,661][106151] Avg episode reward: [(0, '4249.234')] [2023-03-12 00:43:47,491][106434] Updated weights for policy 0, policy_version 119040 (0.0003) [2023-03-12 00:43:50,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12151.5, 300 sec: 11802.0). Total num frames: 60985344. Throughput: 0: 12262.2. Samples: 60952640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:43:50,662][106151] Avg episode reward: [(0, '4198.168')] [2023-03-12 00:43:50,733][106434] Updated weights for policy 0, policy_version 119120 (0.0003) [2023-03-12 00:43:53,970][106434] Updated weights for policy 0, policy_version 119200 (0.0003) [2023-03-12 00:43:55,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12151.4, 300 sec: 11815.9). Total num frames: 61046784. Throughput: 0: 12431.4. Samples: 61028736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:43:55,662][106151] Avg episode reward: [(0, '4177.239')] [2023-03-12 00:43:55,720][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000119240_61050880.pth... [2023-03-12 00:43:55,722][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000118496_60669952.pth [2023-03-12 00:43:57,520][106434] Updated weights for policy 0, policy_version 119280 (0.0005) [2023-03-12 00:44:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11815.9). Total num frames: 61104128. Throughput: 0: 12396.9. Samples: 61097788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:44:00,662][106151] Avg episode reward: [(0, '4290.821')] [2023-03-12 00:44:01,057][106434] Updated weights for policy 0, policy_version 119360 (0.0005) [2023-03-12 00:44:04,572][106434] Updated weights for policy 0, policy_version 119440 (0.0005) [2023-03-12 00:44:05,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12219.7, 300 sec: 11829.8). Total num frames: 61165568. Throughput: 0: 12390.4. Samples: 61132864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:44:05,662][106151] Avg episode reward: [(0, '4301.620')] [2023-03-12 00:44:08,090][106434] Updated weights for policy 0, policy_version 119520 (0.0005) [2023-03-12 00:44:10,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 11829.8). Total num frames: 61222912. Throughput: 0: 12288.0. Samples: 61202496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:44:10,662][106151] Avg episode reward: [(0, '4301.651')] [2023-03-12 00:44:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000119576_61222912.pth... [2023-03-12 00:44:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000118864_60858368.pth [2023-03-12 00:44:11,636][106434] Updated weights for policy 0, policy_version 119600 (0.0006) [2023-03-12 00:44:15,235][106434] Updated weights for policy 0, policy_version 119680 (0.0006) [2023-03-12 00:44:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12219.7, 300 sec: 11829.8). Total num frames: 61280256. Throughput: 0: 12162.3. Samples: 61271720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:44:15,661][106151] Avg episode reward: [(0, '4206.567')] [2023-03-12 00:44:18,853][106434] Updated weights for policy 0, policy_version 119760 (0.0005) [2023-03-12 00:44:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 12151.5, 300 sec: 11815.9). Total num frames: 61337600. Throughput: 0: 12075.7. Samples: 61305140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:44:20,661][106151] Avg episode reward: [(0, '4337.584')] [2023-03-12 00:44:22,385][106434] Updated weights for policy 0, policy_version 119840 (0.0005) [2023-03-12 00:44:25,661][106151] Fps is (10 sec: 11468.7, 60 sec: 12083.2, 300 sec: 11802.0). Total num frames: 61394944. Throughput: 0: 11924.2. Samples: 61374548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:44:25,662][106151] Avg episode reward: [(0, '3594.332')] [2023-03-12 00:44:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000119912_61394944.pth... [2023-03-12 00:44:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000119240_61050880.pth [2023-03-12 00:44:25,915][106434] Updated weights for policy 0, policy_version 119920 (0.0006) [2023-03-12 00:44:29,419][106434] Updated weights for policy 0, policy_version 120000 (0.0005) [2023-03-12 00:44:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11788.1). Total num frames: 61452288. Throughput: 0: 11797.2. Samples: 61444600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:44:30,662][106151] Avg episode reward: [(0, '3851.842')] [2023-03-12 00:44:32,915][106434] Updated weights for policy 0, policy_version 120080 (0.0006) [2023-03-12 00:44:35,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11878.4, 300 sec: 11788.2). Total num frames: 61509632. Throughput: 0: 11723.6. Samples: 61480200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:44:35,661][106151] Avg episode reward: [(0, '3450.982')] [2023-03-12 00:44:36,419][106434] Updated weights for policy 0, policy_version 120160 (0.0005) [2023-03-12 00:44:40,004][106434] Updated weights for policy 0, policy_version 120240 (0.0005) [2023-03-12 00:44:40,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11810.2, 300 sec: 11774.3). Total num frames: 61566976. Throughput: 0: 11580.2. Samples: 61549844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:44:40,661][106151] Avg episode reward: [(0, '3966.362')] [2023-03-12 00:44:40,707][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000120256_61571072.pth... [2023-03-12 00:44:40,708][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000119576_61222912.pth [2023-03-12 00:44:43,551][106434] Updated weights for policy 0, policy_version 120320 (0.0005) [2023-03-12 00:44:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11760.4). Total num frames: 61624320. Throughput: 0: 11576.4. Samples: 61618724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:44:45,661][106151] Avg episode reward: [(0, '4041.799')] [2023-03-12 00:44:47,082][106434] Updated weights for policy 0, policy_version 120400 (0.0005) [2023-03-12 00:44:50,592][106434] Updated weights for policy 0, policy_version 120480 (0.0005) [2023-03-12 00:44:50,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11760.4). Total num frames: 61685760. Throughput: 0: 11560.2. Samples: 61653072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:44:50,661][106151] Avg episode reward: [(0, '3895.843')] [2023-03-12 00:44:54,127][106434] Updated weights for policy 0, policy_version 120560 (0.0005) [2023-03-12 00:44:55,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.4, 300 sec: 11746.5). Total num frames: 61743104. Throughput: 0: 11569.5. Samples: 61723124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:44:55,661][106151] Avg episode reward: [(0, '4135.213')] [2023-03-12 00:44:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000120592_61743104.pth... [2023-03-12 00:44:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000119912_61394944.pth [2023-03-12 00:44:57,769][106434] Updated weights for policy 0, policy_version 120640 (0.0005) [2023-03-12 00:45:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 61800448. Throughput: 0: 11567.6. Samples: 61792264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:45:00,661][106151] Avg episode reward: [(0, '4347.704')] [2023-03-12 00:45:01,249][106434] Updated weights for policy 0, policy_version 120720 (0.0005) [2023-03-12 00:45:04,818][106434] Updated weights for policy 0, policy_version 120800 (0.0005) [2023-03-12 00:45:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11760.4). Total num frames: 61857792. Throughput: 0: 11599.7. Samples: 61827128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:45:05,661][106151] Avg episode reward: [(0, '3995.643')] [2023-03-12 00:45:08,327][106434] Updated weights for policy 0, policy_version 120880 (0.0005) [2023-03-12 00:45:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11760.4). Total num frames: 61915136. Throughput: 0: 11596.6. Samples: 61896396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:45:10,661][106151] Avg episode reward: [(0, '4035.642')] [2023-03-12 00:45:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000120928_61915136.pth... [2023-03-12 00:45:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000120256_61571072.pth [2023-03-12 00:45:11,765][106434] Updated weights for policy 0, policy_version 120960 (0.0005) [2023-03-12 00:45:15,356][106434] Updated weights for policy 0, policy_version 121040 (0.0005) [2023-03-12 00:45:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11760.4). Total num frames: 61972480. Throughput: 0: 11600.8. Samples: 61966636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:45:15,661][106151] Avg episode reward: [(0, '4201.079')] [2023-03-12 00:45:18,893][106434] Updated weights for policy 0, policy_version 121120 (0.0005) [2023-03-12 00:45:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11746.5). Total num frames: 62029824. Throughput: 0: 11578.1. Samples: 62001216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:45:20,661][106151] Avg episode reward: [(0, '4152.524')] [2023-03-12 00:45:22,472][106434] Updated weights for policy 0, policy_version 121200 (0.0005) [2023-03-12 00:45:25,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 62087168. Throughput: 0: 11576.4. Samples: 62070784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:45:25,661][106151] Avg episode reward: [(0, '4348.208')] [2023-03-12 00:45:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000121272_62091264.pth... [2023-03-12 00:45:25,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000120592_61743104.pth [2023-03-12 00:45:26,007][106434] Updated weights for policy 0, policy_version 121280 (0.0005) [2023-03-12 00:45:29,525][106434] Updated weights for policy 0, policy_version 121360 (0.0005) [2023-03-12 00:45:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 62148608. Throughput: 0: 11592.9. Samples: 62140404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:45:30,661][106151] Avg episode reward: [(0, '4308.500')] [2023-03-12 00:45:33,092][106434] Updated weights for policy 0, policy_version 121440 (0.0005) [2023-03-12 00:45:35,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11732.6). Total num frames: 62205952. Throughput: 0: 11582.7. Samples: 62174296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:45:35,661][106151] Avg episode reward: [(0, '4475.814')] [2023-03-12 00:45:36,663][106434] Updated weights for policy 0, policy_version 121520 (0.0005) [2023-03-12 00:45:40,187][106434] Updated weights for policy 0, policy_version 121600 (0.0005) [2023-03-12 00:45:40,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 62263296. Throughput: 0: 11566.6. Samples: 62243620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:45:40,662][106151] Avg episode reward: [(0, '4345.720')] [2023-03-12 00:45:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000121608_62263296.pth... [2023-03-12 00:45:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000120928_61915136.pth [2023-03-12 00:45:43,797][106434] Updated weights for policy 0, policy_version 121680 (0.0005) [2023-03-12 00:45:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11732.6). Total num frames: 62320640. Throughput: 0: 11559.6. Samples: 62312448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:45:45,661][106151] Avg episode reward: [(0, '4305.124')] [2023-03-12 00:45:47,287][106434] Updated weights for policy 0, policy_version 121760 (0.0005) [2023-03-12 00:45:50,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 62377984. Throughput: 0: 11562.5. Samples: 62347440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:45:50,661][106151] Avg episode reward: [(0, '4049.218')] [2023-03-12 00:45:50,910][106434] Updated weights for policy 0, policy_version 121840 (0.0005) [2023-03-12 00:45:54,541][106434] Updated weights for policy 0, policy_version 121920 (0.0005) [2023-03-12 00:45:55,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11746.5). Total num frames: 62435328. Throughput: 0: 11522.6. Samples: 62414912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:45:55,662][106151] Avg episode reward: [(0, '4126.466')] [2023-03-12 00:45:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000121944_62435328.pth... [2023-03-12 00:45:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000121272_62091264.pth [2023-03-12 00:45:58,082][106434] Updated weights for policy 0, policy_version 122000 (0.0005) [2023-03-12 00:46:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11746.5). Total num frames: 62492672. Throughput: 0: 11507.6. Samples: 62484480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:46:00,661][106151] Avg episode reward: [(0, '3459.200')] [2023-03-12 00:46:01,661][106434] Updated weights for policy 0, policy_version 122080 (0.0005) [2023-03-12 00:46:05,169][106434] Updated weights for policy 0, policy_version 122160 (0.0005) [2023-03-12 00:46:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11746.5). Total num frames: 62550016. Throughput: 0: 11496.1. Samples: 62518540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:46:05,661][106151] Avg episode reward: [(0, '3462.819')] [2023-03-12 00:46:08,696][106434] Updated weights for policy 0, policy_version 122240 (0.0005) [2023-03-12 00:46:10,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11746.5). Total num frames: 62607360. Throughput: 0: 11498.6. Samples: 62588220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:46:10,662][106151] Avg episode reward: [(0, '3546.929')] [2023-03-12 00:46:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000122280_62607360.pth... [2023-03-12 00:46:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000121608_62263296.pth [2023-03-12 00:46:12,289][106434] Updated weights for policy 0, policy_version 122320 (0.0005) [2023-03-12 00:46:15,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 62664704. Throughput: 0: 11474.9. Samples: 62656776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:46:15,662][106151] Avg episode reward: [(0, '4129.728')] [2023-03-12 00:46:15,837][106434] Updated weights for policy 0, policy_version 122400 (0.0005) [2023-03-12 00:46:19,407][106434] Updated weights for policy 0, policy_version 122480 (0.0005) [2023-03-12 00:46:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 62722048. Throughput: 0: 11505.6. Samples: 62692048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:46:20,661][106151] Avg episode reward: [(0, '3944.212')] [2023-03-12 00:46:22,853][106434] Updated weights for policy 0, policy_version 122560 (0.0005) [2023-03-12 00:46:25,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11605.4, 300 sec: 11732.6). Total num frames: 62783488. Throughput: 0: 11529.0. Samples: 62762424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:46:25,661][106151] Avg episode reward: [(0, '3912.101')] [2023-03-12 00:46:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000122624_62783488.pth... [2023-03-12 00:46:25,665][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000121944_62435328.pth [2023-03-12 00:46:26,395][106434] Updated weights for policy 0, policy_version 122640 (0.0005) [2023-03-12 00:46:29,915][106434] Updated weights for policy 0, policy_version 122720 (0.0005) [2023-03-12 00:46:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 62840832. Throughput: 0: 11550.0. Samples: 62832196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:46:30,661][106151] Avg episode reward: [(0, '4287.822')] [2023-03-12 00:46:33,396][106434] Updated weights for policy 0, policy_version 122800 (0.0005) [2023-03-12 00:46:35,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 62898176. Throughput: 0: 11553.2. Samples: 62867336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:46:35,661][106151] Avg episode reward: [(0, '4042.856')] [2023-03-12 00:46:36,960][106434] Updated weights for policy 0, policy_version 122880 (0.0005) [2023-03-12 00:46:40,455][106434] Updated weights for policy 0, policy_version 122960 (0.0005) [2023-03-12 00:46:40,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 62955520. Throughput: 0: 11585.0. Samples: 62936236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:46:40,661][106151] Avg episode reward: [(0, '4245.978')] [2023-03-12 00:46:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000122960_62955520.pth... [2023-03-12 00:46:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000122280_62607360.pth [2023-03-12 00:46:43,804][106434] Updated weights for policy 0, policy_version 123040 (0.0005) [2023-03-12 00:46:45,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 63016960. Throughput: 0: 11651.0. Samples: 63008776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:46:45,672][106151] Avg episode reward: [(0, '4389.655')] [2023-03-12 00:46:47,329][106434] Updated weights for policy 0, policy_version 123120 (0.0005) [2023-03-12 00:46:50,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 63074304. Throughput: 0: 11661.0. Samples: 63043284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:46:50,672][106151] Avg episode reward: [(0, '4424.194')] [2023-03-12 00:46:50,879][106434] Updated weights for policy 0, policy_version 123200 (0.0005) [2023-03-12 00:46:54,486][106434] Updated weights for policy 0, policy_version 123280 (0.0005) [2023-03-12 00:46:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 63131648. Throughput: 0: 11633.0. Samples: 63111704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:46:55,661][106151] Avg episode reward: [(0, '4471.426')] [2023-03-12 00:46:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000123304_63131648.pth... [2023-03-12 00:46:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000122624_62783488.pth [2023-03-12 00:46:58,043][106434] Updated weights for policy 0, policy_version 123360 (0.0005) [2023-03-12 00:47:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 63188992. Throughput: 0: 11647.7. Samples: 63180920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:47:00,672][106151] Avg episode reward: [(0, '4457.286')] [2023-03-12 00:47:01,516][106434] Updated weights for policy 0, policy_version 123440 (0.0005) [2023-03-12 00:47:05,084][106434] Updated weights for policy 0, policy_version 123520 (0.0005) [2023-03-12 00:47:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 63246336. Throughput: 0: 11652.7. Samples: 63216420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:47:05,672][106151] Avg episode reward: [(0, '4288.418')] [2023-03-12 00:47:08,636][106434] Updated weights for policy 0, policy_version 123600 (0.0005) [2023-03-12 00:47:10,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 63303680. Throughput: 0: 11623.1. Samples: 63285464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:47:10,662][106151] Avg episode reward: [(0, '4325.361')] [2023-03-12 00:47:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000123640_63303680.pth... [2023-03-12 00:47:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000122960_62955520.pth [2023-03-12 00:47:12,225][106434] Updated weights for policy 0, policy_version 123680 (0.0005) [2023-03-12 00:47:15,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.4, 300 sec: 11746.5). Total num frames: 63361024. Throughput: 0: 11602.1. Samples: 63354292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:47:15,672][106151] Avg episode reward: [(0, '4380.415')] [2023-03-12 00:47:15,771][106434] Updated weights for policy 0, policy_version 123760 (0.0005) [2023-03-12 00:47:19,324][106434] Updated weights for policy 0, policy_version 123840 (0.0005) [2023-03-12 00:47:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11732.6). Total num frames: 63418368. Throughput: 0: 11590.1. Samples: 63388888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:47:20,672][106151] Avg episode reward: [(0, '4377.160')] [2023-03-12 00:47:22,867][106434] Updated weights for policy 0, policy_version 123920 (0.0005) [2023-03-12 00:47:25,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 63479808. Throughput: 0: 11616.5. Samples: 63458980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:47:25,661][106151] Avg episode reward: [(0, '4444.995')] [2023-03-12 00:47:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000123984_63479808.pth... [2023-03-12 00:47:25,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000123304_63131648.pth [2023-03-12 00:47:26,335][106434] Updated weights for policy 0, policy_version 124000 (0.0005) [2023-03-12 00:47:29,955][106434] Updated weights for policy 0, policy_version 124080 (0.0005) [2023-03-12 00:47:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11732.6). Total num frames: 63537152. Throughput: 0: 11526.8. Samples: 63527480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:47:30,672][106151] Avg episode reward: [(0, '4343.488')] [2023-03-12 00:47:33,436][106434] Updated weights for policy 0, policy_version 124160 (0.0005) [2023-03-12 00:47:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11732.6). Total num frames: 63594496. Throughput: 0: 11542.2. Samples: 63562684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:47:35,672][106151] Avg episode reward: [(0, '4380.540')] [2023-03-12 00:47:37,052][106434] Updated weights for policy 0, policy_version 124240 (0.0005) [2023-03-12 00:47:40,661][106151] Fps is (10 sec: 11059.1, 60 sec: 11537.1, 300 sec: 11704.8). Total num frames: 63647744. Throughput: 0: 11547.9. Samples: 63631360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:47:40,662][106151] Avg episode reward: [(0, '3959.567')] [2023-03-12 00:47:40,681][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000124320_63651840.pth... [2023-03-12 00:47:40,681][106434] Updated weights for policy 0, policy_version 124320 (0.0005) [2023-03-12 00:47:40,683][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000123640_63303680.pth [2023-03-12 00:47:44,201][106434] Updated weights for policy 0, policy_version 124400 (0.0005) [2023-03-12 00:47:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11704.8). Total num frames: 63709184. Throughput: 0: 11550.0. Samples: 63700668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:47:45,672][106151] Avg episode reward: [(0, '4068.943')] [2023-03-12 00:47:47,715][106434] Updated weights for policy 0, policy_version 124480 (0.0005) [2023-03-12 00:47:50,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11537.1, 300 sec: 11691.0). Total num frames: 63766528. Throughput: 0: 11523.5. Samples: 63734976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:47:50,661][106151] Avg episode reward: [(0, '4170.858')] [2023-03-12 00:47:51,260][106434] Updated weights for policy 0, policy_version 124560 (0.0005) [2023-03-12 00:47:54,785][106434] Updated weights for policy 0, policy_version 124640 (0.0005) [2023-03-12 00:47:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11691.0). Total num frames: 63823872. Throughput: 0: 11540.4. Samples: 63804784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:47:55,661][106151] Avg episode reward: [(0, '4247.629')] [2023-03-12 00:47:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000124656_63823872.pth... [2023-03-12 00:47:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000123984_63479808.pth [2023-03-12 00:47:58,277][106434] Updated weights for policy 0, policy_version 124720 (0.0005) [2023-03-12 00:48:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11691.0). Total num frames: 63881216. Throughput: 0: 11552.1. Samples: 63874136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:48:00,661][106151] Avg episode reward: [(0, '4341.476')] [2023-03-12 00:48:01,702][106434] Updated weights for policy 0, policy_version 124800 (0.0004) [2023-03-12 00:48:04,971][106434] Updated weights for policy 0, policy_version 124880 (0.0004) [2023-03-12 00:48:05,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11673.6, 300 sec: 11718.7). Total num frames: 63946752. Throughput: 0: 11625.8. Samples: 63912048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:48:05,661][106151] Avg episode reward: [(0, '4420.508')] [2023-03-12 00:48:08,177][106434] Updated weights for policy 0, policy_version 124960 (0.0004) [2023-03-12 00:48:10,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11741.9, 300 sec: 11732.6). Total num frames: 64008192. Throughput: 0: 11751.0. Samples: 63987776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:48:10,661][106151] Avg episode reward: [(0, '4336.781')] [2023-03-12 00:48:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000125016_64008192.pth... [2023-03-12 00:48:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000124320_63651840.pth [2023-03-12 00:48:11,389][106434] Updated weights for policy 0, policy_version 125040 (0.0004) [2023-03-12 00:48:14,587][106434] Updated weights for policy 0, policy_version 125120 (0.0004) [2023-03-12 00:48:15,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11878.4, 300 sec: 11746.5). Total num frames: 64073728. Throughput: 0: 11932.9. Samples: 64064460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:48:15,661][106151] Avg episode reward: [(0, '4384.954')] [2023-03-12 00:48:17,808][106434] Updated weights for policy 0, policy_version 125200 (0.0004) [2023-03-12 00:48:20,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11946.7, 300 sec: 11746.5). Total num frames: 64135168. Throughput: 0: 11995.1. Samples: 64102464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:48:20,661][106151] Avg episode reward: [(0, '4523.700')] [2023-03-12 00:48:21,044][106434] Updated weights for policy 0, policy_version 125280 (0.0003) [2023-03-12 00:48:24,361][106434] Updated weights for policy 0, policy_version 125360 (0.0004) [2023-03-12 00:48:25,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11746.5). Total num frames: 64196608. Throughput: 0: 12144.6. Samples: 64177868. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 00:48:25,661][106151] Avg episode reward: [(0, '4431.163')] [2023-03-12 00:48:25,685][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000125392_64200704.pth... [2023-03-12 00:48:25,686][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000124656_63823872.pth [2023-03-12 00:48:27,632][106434] Updated weights for policy 0, policy_version 125440 (0.0004) [2023-03-12 00:48:30,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12083.2, 300 sec: 11746.5). Total num frames: 64262144. Throughput: 0: 12292.3. Samples: 64253820. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 00:48:30,661][106151] Avg episode reward: [(0, '4389.374')] [2023-03-12 00:48:30,919][106434] Updated weights for policy 0, policy_version 125520 (0.0004) [2023-03-12 00:48:34,450][106434] Updated weights for policy 0, policy_version 125600 (0.0005) [2023-03-12 00:48:35,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11732.6). Total num frames: 64319488. Throughput: 0: 12292.6. Samples: 64288144. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 00:48:35,661][106151] Avg episode reward: [(0, '4475.364')] [2023-03-12 00:48:37,979][106434] Updated weights for policy 0, policy_version 125680 (0.0005) [2023-03-12 00:48:40,661][106151] Fps is (10 sec: 11468.7, 60 sec: 12151.5, 300 sec: 11704.8). Total num frames: 64376832. Throughput: 0: 12293.2. Samples: 64357976. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 00:48:40,661][106151] Avg episode reward: [(0, '4393.106')] [2023-03-12 00:48:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000125736_64376832.pth... [2023-03-12 00:48:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000125016_64008192.pth [2023-03-12 00:48:41,457][106434] Updated weights for policy 0, policy_version 125760 (0.0005) [2023-03-12 00:48:44,854][106434] Updated weights for policy 0, policy_version 125840 (0.0004) [2023-03-12 00:48:45,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11704.8). Total num frames: 64438272. Throughput: 0: 12347.6. Samples: 64429776. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 00:48:45,661][106151] Avg episode reward: [(0, '4488.633')] [2023-03-12 00:48:48,095][106434] Updated weights for policy 0, policy_version 125920 (0.0004) [2023-03-12 00:48:50,661][106151] Fps is (10 sec: 12288.2, 60 sec: 12219.8, 300 sec: 11704.8). Total num frames: 64499712. Throughput: 0: 12343.4. Samples: 64467500. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 00:48:50,661][106151] Avg episode reward: [(0, '4389.823')] [2023-03-12 00:48:51,318][106434] Updated weights for policy 0, policy_version 126000 (0.0004) [2023-03-12 00:48:54,554][106434] Updated weights for policy 0, policy_version 126080 (0.0003) [2023-03-12 00:48:55,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12356.3, 300 sec: 11732.6). Total num frames: 64565248. Throughput: 0: 12352.4. Samples: 64543636. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 00:48:55,661][106151] Avg episode reward: [(0, '4419.778')] [2023-03-12 00:48:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000126104_64565248.pth... [2023-03-12 00:48:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000125392_64200704.pth [2023-03-12 00:48:57,892][106434] Updated weights for policy 0, policy_version 126160 (0.0004) [2023-03-12 00:49:00,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12424.5, 300 sec: 11732.6). Total num frames: 64626688. Throughput: 0: 12304.7. Samples: 64618172. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 00:49:00,661][106151] Avg episode reward: [(0, '4383.787')] [2023-03-12 00:49:01,174][106434] Updated weights for policy 0, policy_version 126240 (0.0004) [2023-03-12 00:49:04,481][106434] Updated weights for policy 0, policy_version 126320 (0.0003) [2023-03-12 00:49:05,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 11746.5). Total num frames: 64688128. Throughput: 0: 12288.0. Samples: 64655424. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 00:49:05,661][106151] Avg episode reward: [(0, '4430.592')] [2023-03-12 00:49:07,815][106434] Updated weights for policy 0, policy_version 126400 (0.0003) [2023-03-12 00:49:10,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 11760.4). Total num frames: 64749568. Throughput: 0: 12250.8. Samples: 64729152. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 00:49:10,661][106151] Avg episode reward: [(0, '4379.708')] [2023-03-12 00:49:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000126464_64749568.pth... [2023-03-12 00:49:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000125736_64376832.pth [2023-03-12 00:49:11,163][106434] Updated weights for policy 0, policy_version 126480 (0.0004) [2023-03-12 00:49:14,493][106434] Updated weights for policy 0, policy_version 126560 (0.0004) [2023-03-12 00:49:15,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 11774.3). Total num frames: 64811008. Throughput: 0: 12200.2. Samples: 64802828. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 00:49:15,672][106151] Avg episode reward: [(0, '4397.849')] [2023-03-12 00:49:17,778][106434] Updated weights for policy 0, policy_version 126640 (0.0004) [2023-03-12 00:49:20,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 11788.1). Total num frames: 64872448. Throughput: 0: 12261.1. Samples: 64839896. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 00:49:20,672][106151] Avg episode reward: [(0, '4432.517')] [2023-03-12 00:49:21,135][106434] Updated weights for policy 0, policy_version 126720 (0.0004) [2023-03-12 00:49:24,440][106434] Updated weights for policy 0, policy_version 126800 (0.0004) [2023-03-12 00:49:25,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 11802.0). Total num frames: 64933888. Throughput: 0: 12349.8. Samples: 64913716. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 00:49:25,661][106151] Avg episode reward: [(0, '4481.742')] [2023-03-12 00:49:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000126824_64933888.pth... [2023-03-12 00:49:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000126104_64565248.pth [2023-03-12 00:49:27,780][106434] Updated weights for policy 0, policy_version 126880 (0.0004) [2023-03-12 00:49:30,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12151.5, 300 sec: 11802.0). Total num frames: 64991232. Throughput: 0: 12357.6. Samples: 64985868. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:49:30,672][106151] Avg episode reward: [(0, '4356.293')] [2023-03-12 00:49:31,393][106434] Updated weights for policy 0, policy_version 126960 (0.0005) [2023-03-12 00:49:34,992][106434] Updated weights for policy 0, policy_version 127040 (0.0005) [2023-03-12 00:49:35,661][106151] Fps is (10 sec: 11468.9, 60 sec: 12151.5, 300 sec: 11802.0). Total num frames: 65048576. Throughput: 0: 12277.1. Samples: 65019968. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:49:35,672][106151] Avg episode reward: [(0, '4291.076')] [2023-03-12 00:49:38,428][106434] Updated weights for policy 0, policy_version 127120 (0.0004) [2023-03-12 00:49:40,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12219.7, 300 sec: 11815.9). Total num frames: 65110016. Throughput: 0: 12132.7. Samples: 65089608. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:49:40,661][106151] Avg episode reward: [(0, '4472.859')] [2023-03-12 00:49:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000127168_65110016.pth... [2023-03-12 00:49:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000126464_64749568.pth [2023-03-12 00:49:42,000][106434] Updated weights for policy 0, policy_version 127200 (0.0005) [2023-03-12 00:49:45,391][106434] Updated weights for policy 0, policy_version 127280 (0.0004) [2023-03-12 00:49:45,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11802.0). Total num frames: 65167360. Throughput: 0: 12034.0. Samples: 65159700. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:49:45,672][106151] Avg episode reward: [(0, '4389.722')] [2023-03-12 00:49:48,665][106434] Updated weights for policy 0, policy_version 127360 (0.0004) [2023-03-12 00:49:50,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12219.7, 300 sec: 11829.8). Total num frames: 65232896. Throughput: 0: 12052.8. Samples: 65197800. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:49:50,672][106151] Avg episode reward: [(0, '4518.194')] [2023-03-12 00:49:51,867][106434] Updated weights for policy 0, policy_version 127440 (0.0004) [2023-03-12 00:49:55,096][106434] Updated weights for policy 0, policy_version 127520 (0.0004) [2023-03-12 00:49:55,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12151.5, 300 sec: 11843.7). Total num frames: 65294336. Throughput: 0: 12105.9. Samples: 65273920. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:49:55,661][106151] Avg episode reward: [(0, '4282.882')] [2023-03-12 00:49:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000127528_65294336.pth... [2023-03-12 00:49:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000126824_64933888.pth [2023-03-12 00:49:58,321][106434] Updated weights for policy 0, policy_version 127600 (0.0004) [2023-03-12 00:50:00,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12219.7, 300 sec: 11871.5). Total num frames: 65359872. Throughput: 0: 12155.1. Samples: 65349808. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:50:00,662][106151] Avg episode reward: [(0, '4481.425')] [2023-03-12 00:50:01,584][106434] Updated weights for policy 0, policy_version 127680 (0.0004) [2023-03-12 00:50:04,824][106434] Updated weights for policy 0, policy_version 127760 (0.0004) [2023-03-12 00:50:05,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12219.7, 300 sec: 11885.3). Total num frames: 65421312. Throughput: 0: 12185.7. Samples: 65388252. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:50:05,661][106151] Avg episode reward: [(0, '4406.711')] [2023-03-12 00:50:08,012][106434] Updated weights for policy 0, policy_version 127840 (0.0003) [2023-03-12 00:50:10,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12288.0, 300 sec: 11913.1). Total num frames: 65486848. Throughput: 0: 12224.8. Samples: 65463832. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:50:10,662][106151] Avg episode reward: [(0, '4519.000')] [2023-03-12 00:50:10,666][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000127904_65486848.pth... [2023-03-12 00:50:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000127168_65110016.pth [2023-03-12 00:50:11,314][106434] Updated weights for policy 0, policy_version 127920 (0.0004) [2023-03-12 00:50:14,558][106434] Updated weights for policy 0, policy_version 128000 (0.0004) [2023-03-12 00:50:15,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 11927.0). Total num frames: 65548288. Throughput: 0: 12303.4. Samples: 65539520. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:50:15,672][106151] Avg episode reward: [(0, '4390.995')] [2023-03-12 00:50:17,843][106434] Updated weights for policy 0, policy_version 128080 (0.0004) [2023-03-12 00:50:20,661][106151] Fps is (10 sec: 12288.2, 60 sec: 12288.0, 300 sec: 11940.9). Total num frames: 65609728. Throughput: 0: 12377.8. Samples: 65576968. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:50:20,672][106151] Avg episode reward: [(0, '4336.853')] [2023-03-12 00:50:21,110][106434] Updated weights for policy 0, policy_version 128160 (0.0004) [2023-03-12 00:50:24,355][106434] Updated weights for policy 0, policy_version 128240 (0.0004) [2023-03-12 00:50:25,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12356.3, 300 sec: 11954.8). Total num frames: 65675264. Throughput: 0: 12493.4. Samples: 65651812. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:50:25,661][106151] Avg episode reward: [(0, '4418.484')] [2023-03-12 00:50:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000128272_65675264.pth... [2023-03-12 00:50:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000127528_65294336.pth [2023-03-12 00:50:27,617][106434] Updated weights for policy 0, policy_version 128320 (0.0004) [2023-03-12 00:50:30,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 11968.7). Total num frames: 65736704. Throughput: 0: 12621.2. Samples: 65727656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:50:30,672][106151] Avg episode reward: [(0, '4442.324')] [2023-03-12 00:50:30,894][106434] Updated weights for policy 0, policy_version 128400 (0.0004) [2023-03-12 00:50:34,255][106434] Updated weights for policy 0, policy_version 128480 (0.0004) [2023-03-12 00:50:35,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 11982.5). Total num frames: 65798144. Throughput: 0: 12601.5. Samples: 65764868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:50:35,661][106151] Avg episode reward: [(0, '4388.374')] [2023-03-12 00:50:37,601][106434] Updated weights for policy 0, policy_version 128560 (0.0004) [2023-03-12 00:50:40,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 11996.4). Total num frames: 65859584. Throughput: 0: 12535.9. Samples: 65838036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:50:40,661][106151] Avg episode reward: [(0, '4359.779')] [2023-03-12 00:50:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000128632_65859584.pth... [2023-03-12 00:50:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000127904_65486848.pth [2023-03-12 00:50:40,909][106434] Updated weights for policy 0, policy_version 128640 (0.0004) [2023-03-12 00:50:44,263][106434] Updated weights for policy 0, policy_version 128720 (0.0004) [2023-03-12 00:50:45,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12010.3). Total num frames: 65921024. Throughput: 0: 12489.4. Samples: 65911828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:50:45,661][106151] Avg episode reward: [(0, '4388.674')] [2023-03-12 00:50:47,567][106434] Updated weights for policy 0, policy_version 128800 (0.0004) [2023-03-12 00:50:50,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12024.2). Total num frames: 65982464. Throughput: 0: 12459.6. Samples: 65948936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:50:50,661][106151] Avg episode reward: [(0, '3686.921')] [2023-03-12 00:50:50,838][106434] Updated weights for policy 0, policy_version 128880 (0.0004) [2023-03-12 00:50:54,112][106434] Updated weights for policy 0, policy_version 128960 (0.0004) [2023-03-12 00:50:55,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12038.1). Total num frames: 66043904. Throughput: 0: 12436.8. Samples: 66023488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:50:55,661][106151] Avg episode reward: [(0, '4388.901')] [2023-03-12 00:50:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000128992_66043904.pth... [2023-03-12 00:50:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000128272_65675264.pth [2023-03-12 00:50:57,344][106434] Updated weights for policy 0, policy_version 129040 (0.0004) [2023-03-12 00:51:00,611][106434] Updated weights for policy 0, policy_version 129120 (0.0004) [2023-03-12 00:51:00,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12065.8). Total num frames: 66109440. Throughput: 0: 12444.1. Samples: 66099504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:51:00,661][106151] Avg episode reward: [(0, '4344.168')] [2023-03-12 00:51:04,053][106434] Updated weights for policy 0, policy_version 129200 (0.0005) [2023-03-12 00:51:05,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12065.8). Total num frames: 66166784. Throughput: 0: 12433.9. Samples: 66136492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:51:05,661][106151] Avg episode reward: [(0, '4368.786')] [2023-03-12 00:51:07,576][106434] Updated weights for policy 0, policy_version 129280 (0.0005) [2023-03-12 00:51:10,661][106151] Fps is (10 sec: 11468.7, 60 sec: 12288.0, 300 sec: 12065.8). Total num frames: 66224128. Throughput: 0: 12301.9. Samples: 66205400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:51:10,661][106151] Avg episode reward: [(0, '4364.587')] [2023-03-12 00:51:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000129344_66224128.pth... [2023-03-12 00:51:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000128632_65859584.pth [2023-03-12 00:51:11,151][106434] Updated weights for policy 0, policy_version 129360 (0.0005) [2023-03-12 00:51:14,675][106434] Updated weights for policy 0, policy_version 129440 (0.0005) [2023-03-12 00:51:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 12079.7). Total num frames: 66285568. Throughput: 0: 12165.1. Samples: 66275084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:51:15,661][106151] Avg episode reward: [(0, '4335.363')] [2023-03-12 00:51:17,954][106434] Updated weights for policy 0, policy_version 129520 (0.0004) [2023-03-12 00:51:20,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 12079.7). Total num frames: 66347008. Throughput: 0: 12176.3. Samples: 66312800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:51:20,661][106151] Avg episode reward: [(0, '4384.182')] [2023-03-12 00:51:21,238][106434] Updated weights for policy 0, policy_version 129600 (0.0003) [2023-03-12 00:51:24,742][106434] Updated weights for policy 0, policy_version 129680 (0.0005) [2023-03-12 00:51:25,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12079.7). Total num frames: 66404352. Throughput: 0: 12181.6. Samples: 66386208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:51:25,661][106151] Avg episode reward: [(0, '4415.667')] [2023-03-12 00:51:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000129696_66404352.pth... [2023-03-12 00:51:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000128992_66043904.pth [2023-03-12 00:51:28,315][106434] Updated weights for policy 0, policy_version 129760 (0.0005) [2023-03-12 00:51:30,661][106151] Fps is (10 sec: 11468.9, 60 sec: 12083.2, 300 sec: 12079.7). Total num frames: 66461696. Throughput: 0: 12054.7. Samples: 66454288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:51:30,661][106151] Avg episode reward: [(0, '4440.083')] [2023-03-12 00:51:31,780][106434] Updated weights for policy 0, policy_version 129840 (0.0004) [2023-03-12 00:51:35,231][106434] Updated weights for policy 0, policy_version 129920 (0.0004) [2023-03-12 00:51:35,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 12093.6). Total num frames: 66523136. Throughput: 0: 12032.0. Samples: 66490376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:51:35,661][106151] Avg episode reward: [(0, '4421.621')] [2023-03-12 00:51:38,574][106434] Updated weights for policy 0, policy_version 130000 (0.0005) [2023-03-12 00:51:40,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 12093.6). Total num frames: 66584576. Throughput: 0: 11997.5. Samples: 66563376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:51:40,661][106151] Avg episode reward: [(0, '4424.306')] [2023-03-12 00:51:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000130048_66584576.pth... [2023-03-12 00:51:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000129344_66224128.pth [2023-03-12 00:51:41,853][106434] Updated weights for policy 0, policy_version 130080 (0.0004) [2023-03-12 00:51:45,457][106434] Updated weights for policy 0, policy_version 130160 (0.0005) [2023-03-12 00:51:45,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 12093.6). Total num frames: 66641920. Throughput: 0: 11897.6. Samples: 66634896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:51:45,661][106151] Avg episode reward: [(0, '4039.301')] [2023-03-12 00:51:49,057][106434] Updated weights for policy 0, policy_version 130240 (0.0005) [2023-03-12 00:51:50,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 12093.6). Total num frames: 66699264. Throughput: 0: 11830.7. Samples: 66668872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:51:50,661][106151] Avg episode reward: [(0, '4263.414')] [2023-03-12 00:51:52,621][106434] Updated weights for policy 0, policy_version 130320 (0.0005) [2023-03-12 00:51:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 12093.6). Total num frames: 66756608. Throughput: 0: 11839.1. Samples: 66738160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:51:55,661][106151] Avg episode reward: [(0, '4216.973')] [2023-03-12 00:51:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000130384_66756608.pth... [2023-03-12 00:51:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000129696_66404352.pth [2023-03-12 00:51:56,215][106434] Updated weights for policy 0, policy_version 130400 (0.0005) [2023-03-12 00:51:59,784][106434] Updated weights for policy 0, policy_version 130480 (0.0005) [2023-03-12 00:52:00,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11741.9, 300 sec: 12093.6). Total num frames: 66813952. Throughput: 0: 11795.5. Samples: 66805880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:52:00,661][106151] Avg episode reward: [(0, '4114.760')] [2023-03-12 00:52:03,376][106434] Updated weights for policy 0, policy_version 130560 (0.0005) [2023-03-12 00:52:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 12093.6). Total num frames: 66871296. Throughput: 0: 11717.2. Samples: 66840072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:52:05,661][106151] Avg episode reward: [(0, '3733.789')] [2023-03-12 00:52:06,938][106434] Updated weights for policy 0, policy_version 130640 (0.0005) [2023-03-12 00:52:10,552][106434] Updated weights for policy 0, policy_version 130720 (0.0005) [2023-03-12 00:52:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 12093.6). Total num frames: 66928640. Throughput: 0: 11615.9. Samples: 66908924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:52:10,661][106151] Avg episode reward: [(0, '3864.497')] [2023-03-12 00:52:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000130720_66928640.pth... [2023-03-12 00:52:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000130048_66584576.pth [2023-03-12 00:52:14,171][106434] Updated weights for policy 0, policy_version 130800 (0.0005) [2023-03-12 00:52:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12093.6). Total num frames: 66985984. Throughput: 0: 11630.8. Samples: 66977676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:52:15,661][106151] Avg episode reward: [(0, '3768.334')] [2023-03-12 00:52:17,544][106434] Updated weights for policy 0, policy_version 130880 (0.0004) [2023-03-12 00:52:20,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 12093.6). Total num frames: 67047424. Throughput: 0: 11640.7. Samples: 67014208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:52:20,661][106151] Avg episode reward: [(0, '4210.674')] [2023-03-12 00:52:20,844][106434] Updated weights for policy 0, policy_version 130960 (0.0004) [2023-03-12 00:52:24,109][106434] Updated weights for policy 0, policy_version 131040 (0.0004) [2023-03-12 00:52:25,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 12107.5). Total num frames: 67108864. Throughput: 0: 11669.2. Samples: 67088488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:52:25,661][106151] Avg episode reward: [(0, '3951.030')] [2023-03-12 00:52:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000131072_67108864.pth... [2023-03-12 00:52:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000130384_66756608.pth [2023-03-12 00:52:27,493][106434] Updated weights for policy 0, policy_version 131120 (0.0004) [2023-03-12 00:52:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11741.8, 300 sec: 12107.5). Total num frames: 67166208. Throughput: 0: 11673.9. Samples: 67160220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:52:30,661][106151] Avg episode reward: [(0, '4026.078')] [2023-03-12 00:52:31,056][106434] Updated weights for policy 0, policy_version 131200 (0.0005) [2023-03-12 00:52:34,650][106434] Updated weights for policy 0, policy_version 131280 (0.0005) [2023-03-12 00:52:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12121.4). Total num frames: 67223552. Throughput: 0: 11689.1. Samples: 67194880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:52:35,661][106151] Avg episode reward: [(0, '3645.667')] [2023-03-12 00:52:38,325][106434] Updated weights for policy 0, policy_version 131360 (0.0005) [2023-03-12 00:52:40,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12107.5). Total num frames: 67280896. Throughput: 0: 11645.8. Samples: 67262220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:52:40,661][106151] Avg episode reward: [(0, '4093.313')] [2023-03-12 00:52:40,666][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000131408_67280896.pth... [2023-03-12 00:52:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000130720_66928640.pth [2023-03-12 00:52:41,872][106434] Updated weights for policy 0, policy_version 131440 (0.0005) [2023-03-12 00:52:45,467][106434] Updated weights for policy 0, policy_version 131520 (0.0005) [2023-03-12 00:52:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12107.5). Total num frames: 67338240. Throughput: 0: 11666.8. Samples: 67330884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:52:45,661][106151] Avg episode reward: [(0, '3365.145')] [2023-03-12 00:52:48,935][106434] Updated weights for policy 0, policy_version 131600 (0.0004) [2023-03-12 00:52:50,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 12121.4). Total num frames: 67399680. Throughput: 0: 11691.1. Samples: 67366172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:52:50,661][106151] Avg episode reward: [(0, '3724.276')] [2023-03-12 00:52:52,308][106434] Updated weights for policy 0, policy_version 131680 (0.0003) [2023-03-12 00:52:55,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 12121.4). Total num frames: 67457024. Throughput: 0: 11782.1. Samples: 67439120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:52:55,661][106151] Avg episode reward: [(0, '4167.386')] [2023-03-12 00:52:55,671][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000131760_67461120.pth... [2023-03-12 00:52:55,671][106434] Updated weights for policy 0, policy_version 131760 (0.0004) [2023-03-12 00:52:55,672][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000131072_67108864.pth [2023-03-12 00:52:59,272][106434] Updated weights for policy 0, policy_version 131840 (0.0005) [2023-03-12 00:53:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12093.6). Total num frames: 67514368. Throughput: 0: 11800.3. Samples: 67508688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:53:00,661][106151] Avg episode reward: [(0, '3866.046')] [2023-03-12 00:53:02,815][106434] Updated weights for policy 0, policy_version 131920 (0.0005) [2023-03-12 00:53:05,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 12093.6). Total num frames: 67575808. Throughput: 0: 11753.2. Samples: 67543104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:53:05,662][106151] Avg episode reward: [(0, '3642.866')] [2023-03-12 00:53:06,144][106434] Updated weights for policy 0, policy_version 132000 (0.0004) [2023-03-12 00:53:09,681][106434] Updated weights for policy 0, policy_version 132080 (0.0004) [2023-03-12 00:53:10,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 12065.8). Total num frames: 67633152. Throughput: 0: 11697.4. Samples: 67614872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:53:10,662][106151] Avg episode reward: [(0, '4244.427')] [2023-03-12 00:53:10,677][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000132104_67637248.pth... [2023-03-12 00:53:10,680][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000131408_67280896.pth [2023-03-12 00:53:13,021][106434] Updated weights for policy 0, policy_version 132160 (0.0004) [2023-03-12 00:53:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 12065.8). Total num frames: 67694592. Throughput: 0: 11694.3. Samples: 67686464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:53:15,661][106151] Avg episode reward: [(0, '3913.909')] [2023-03-12 00:53:16,660][106434] Updated weights for policy 0, policy_version 132240 (0.0005) [2023-03-12 00:53:20,250][106434] Updated weights for policy 0, policy_version 132320 (0.0005) [2023-03-12 00:53:20,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 12052.0). Total num frames: 67751936. Throughput: 0: 11661.9. Samples: 67719664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:53:20,662][106151] Avg episode reward: [(0, '4135.277')] [2023-03-12 00:53:23,821][106434] Updated weights for policy 0, policy_version 132400 (0.0005) [2023-03-12 00:53:25,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 12024.2). Total num frames: 67809280. Throughput: 0: 11703.2. Samples: 67788864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:53:25,661][106151] Avg episode reward: [(0, '4232.322')] [2023-03-12 00:53:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000132440_67809280.pth... [2023-03-12 00:53:25,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000131760_67461120.pth [2023-03-12 00:53:27,362][106434] Updated weights for policy 0, policy_version 132480 (0.0005) [2023-03-12 00:53:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12024.2). Total num frames: 67866624. Throughput: 0: 11752.8. Samples: 67859760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:53:30,661][106151] Avg episode reward: [(0, '3973.588')] [2023-03-12 00:53:30,715][106434] Updated weights for policy 0, policy_version 132560 (0.0003) [2023-03-12 00:53:34,038][106434] Updated weights for policy 0, policy_version 132640 (0.0004) [2023-03-12 00:53:35,661][106151] Fps is (10 sec: 12288.2, 60 sec: 11810.2, 300 sec: 12052.0). Total num frames: 67932160. Throughput: 0: 11795.6. Samples: 67896972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:53:35,661][106151] Avg episode reward: [(0, '4404.852')] [2023-03-12 00:53:37,323][106434] Updated weights for policy 0, policy_version 132720 (0.0004) [2023-03-12 00:53:40,607][106434] Updated weights for policy 0, policy_version 132800 (0.0004) [2023-03-12 00:53:40,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11878.4, 300 sec: 12052.0). Total num frames: 67993600. Throughput: 0: 11826.0. Samples: 67971292. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:53:40,661][106151] Avg episode reward: [(0, '4164.311')] [2023-03-12 00:53:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000132800_67993600.pth... [2023-03-12 00:53:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000132104_67637248.pth [2023-03-12 00:53:43,873][106434] Updated weights for policy 0, policy_version 132880 (0.0004) [2023-03-12 00:53:45,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 12052.0). Total num frames: 68055040. Throughput: 0: 11950.3. Samples: 68046452. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:53:45,661][106151] Avg episode reward: [(0, '4043.013')] [2023-03-12 00:53:47,239][106434] Updated weights for policy 0, policy_version 132960 (0.0005) [2023-03-12 00:53:50,511][106434] Updated weights for policy 0, policy_version 133040 (0.0004) [2023-03-12 00:53:50,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 12038.1). Total num frames: 68116480. Throughput: 0: 12002.6. Samples: 68083220. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:53:50,661][106151] Avg episode reward: [(0, '4016.295')] [2023-03-12 00:53:53,779][106434] Updated weights for policy 0, policy_version 133120 (0.0004) [2023-03-12 00:53:55,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 12038.1). Total num frames: 68177920. Throughput: 0: 12061.3. Samples: 68157628. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:53:55,661][106151] Avg episode reward: [(0, '4219.223')] [2023-03-12 00:53:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000133160_68177920.pth... [2023-03-12 00:53:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000132440_67809280.pth [2023-03-12 00:53:57,161][106434] Updated weights for policy 0, policy_version 133200 (0.0005) [2023-03-12 00:54:00,387][106434] Updated weights for policy 0, policy_version 133280 (0.0004) [2023-03-12 00:54:00,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 12038.1). Total num frames: 68239360. Throughput: 0: 12123.6. Samples: 68232028. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:54:00,661][106151] Avg episode reward: [(0, '3606.420')] [2023-03-12 00:54:03,632][106434] Updated weights for policy 0, policy_version 133360 (0.0004) [2023-03-12 00:54:05,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12083.2, 300 sec: 12038.1). Total num frames: 68300800. Throughput: 0: 12223.5. Samples: 68269720. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:54:05,661][106151] Avg episode reward: [(0, '3920.889')] [2023-03-12 00:54:06,970][106434] Updated weights for policy 0, policy_version 133440 (0.0005) [2023-03-12 00:54:10,424][106434] Updated weights for policy 0, policy_version 133520 (0.0005) [2023-03-12 00:54:10,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12151.4, 300 sec: 12038.1). Total num frames: 68362240. Throughput: 0: 12324.8. Samples: 68343480. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:54:10,662][106151] Avg episode reward: [(0, '3820.295')] [2023-03-12 00:54:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000133520_68362240.pth... [2023-03-12 00:54:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000132800_67993600.pth [2023-03-12 00:54:14,064][106434] Updated weights for policy 0, policy_version 133600 (0.0005) [2023-03-12 00:54:15,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 12024.2). Total num frames: 68419584. Throughput: 0: 12287.5. Samples: 68412696. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:54:15,661][106151] Avg episode reward: [(0, '3805.664')] [2023-03-12 00:54:17,397][106434] Updated weights for policy 0, policy_version 133680 (0.0004) [2023-03-12 00:54:20,661][106151] Fps is (10 sec: 11878.6, 60 sec: 12151.5, 300 sec: 12024.2). Total num frames: 68481024. Throughput: 0: 12267.8. Samples: 68449024. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:54:20,661][106151] Avg episode reward: [(0, '4070.982')] [2023-03-12 00:54:20,874][106434] Updated weights for policy 0, policy_version 133760 (0.0005) [2023-03-12 00:54:24,369][106434] Updated weights for policy 0, policy_version 133840 (0.0005) [2023-03-12 00:54:25,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12151.5, 300 sec: 12024.2). Total num frames: 68538368. Throughput: 0: 12169.0. Samples: 68518896. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:54:25,662][106151] Avg episode reward: [(0, '4212.619')] [2023-03-12 00:54:25,686][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000133872_68542464.pth... [2023-03-12 00:54:25,687][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000133160_68177920.pth [2023-03-12 00:54:27,849][106434] Updated weights for policy 0, policy_version 133920 (0.0005) [2023-03-12 00:54:30,661][106151] Fps is (10 sec: 11468.7, 60 sec: 12151.5, 300 sec: 12024.2). Total num frames: 68595712. Throughput: 0: 12057.1. Samples: 68589024. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:54:30,661][106151] Avg episode reward: [(0, '3974.961')] [2023-03-12 00:54:31,466][106434] Updated weights for policy 0, policy_version 134000 (0.0005) [2023-03-12 00:54:35,029][106434] Updated weights for policy 0, policy_version 134080 (0.0005) [2023-03-12 00:54:35,661][106151] Fps is (10 sec: 11468.9, 60 sec: 12014.9, 300 sec: 12010.3). Total num frames: 68653056. Throughput: 0: 12017.0. Samples: 68623984. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 00:54:35,661][106151] Avg episode reward: [(0, '4241.931')] [2023-03-12 00:54:38,636][106434] Updated weights for policy 0, policy_version 134160 (0.0005) [2023-03-12 00:54:40,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 12010.3). Total num frames: 68710400. Throughput: 0: 11878.1. Samples: 68692144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:54:40,661][106151] Avg episode reward: [(0, '4252.839')] [2023-03-12 00:54:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000134200_68710400.pth... [2023-03-12 00:54:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000133520_68362240.pth [2023-03-12 00:54:42,189][106434] Updated weights for policy 0, policy_version 134240 (0.0005) [2023-03-12 00:54:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11982.5). Total num frames: 68767744. Throughput: 0: 11735.8. Samples: 68760140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:54:45,661][106151] Avg episode reward: [(0, '4413.986')] [2023-03-12 00:54:45,821][106434] Updated weights for policy 0, policy_version 134320 (0.0005) [2023-03-12 00:54:49,151][106434] Updated weights for policy 0, policy_version 134400 (0.0004) [2023-03-12 00:54:50,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11982.5). Total num frames: 68829184. Throughput: 0: 11705.8. Samples: 68796480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:54:50,661][106151] Avg episode reward: [(0, '4287.217')] [2023-03-12 00:54:52,394][106434] Updated weights for policy 0, policy_version 134480 (0.0004) [2023-03-12 00:54:55,616][106434] Updated weights for policy 0, policy_version 134560 (0.0004) [2023-03-12 00:54:55,661][106151] Fps is (10 sec: 12697.5, 60 sec: 11946.7, 300 sec: 11982.5). Total num frames: 68894720. Throughput: 0: 11738.6. Samples: 68871716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:54:55,661][106151] Avg episode reward: [(0, '4278.142')] [2023-03-12 00:54:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000134560_68894720.pth... [2023-03-12 00:54:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000133872_68542464.pth [2023-03-12 00:54:58,962][106434] Updated weights for policy 0, policy_version 134640 (0.0005) [2023-03-12 00:55:00,661][106151] Fps is (10 sec: 12697.5, 60 sec: 11946.7, 300 sec: 11982.5). Total num frames: 68956160. Throughput: 0: 11863.9. Samples: 68946572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:55:00,661][106151] Avg episode reward: [(0, '3692.364')] [2023-03-12 00:55:02,264][106434] Updated weights for policy 0, policy_version 134720 (0.0004) [2023-03-12 00:55:05,513][106434] Updated weights for policy 0, policy_version 134800 (0.0004) [2023-03-12 00:55:05,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11946.6, 300 sec: 11968.7). Total num frames: 69017600. Throughput: 0: 11881.5. Samples: 68983692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:55:05,662][106151] Avg episode reward: [(0, '4001.014')] [2023-03-12 00:55:08,800][106434] Updated weights for policy 0, policy_version 134880 (0.0004) [2023-03-12 00:55:10,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 11968.6). Total num frames: 69079040. Throughput: 0: 11994.1. Samples: 69058632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:55:10,662][106151] Avg episode reward: [(0, '4285.574')] [2023-03-12 00:55:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000134920_69079040.pth... [2023-03-12 00:55:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000134200_68710400.pth [2023-03-12 00:55:12,107][106434] Updated weights for policy 0, policy_version 134960 (0.0004) [2023-03-12 00:55:15,362][106434] Updated weights for policy 0, policy_version 135040 (0.0004) [2023-03-12 00:55:15,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12014.9, 300 sec: 11968.7). Total num frames: 69140480. Throughput: 0: 12093.7. Samples: 69133240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:55:15,661][106151] Avg episode reward: [(0, '4387.035')] [2023-03-12 00:55:18,701][106434] Updated weights for policy 0, policy_version 135120 (0.0005) [2023-03-12 00:55:20,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12083.2, 300 sec: 11968.7). Total num frames: 69206016. Throughput: 0: 12143.4. Samples: 69170440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:55:20,661][106151] Avg episode reward: [(0, '4037.487')] [2023-03-12 00:55:21,920][106434] Updated weights for policy 0, policy_version 135200 (0.0004) [2023-03-12 00:55:25,257][106434] Updated weights for policy 0, policy_version 135280 (0.0004) [2023-03-12 00:55:25,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 11968.6). Total num frames: 69267456. Throughput: 0: 12309.9. Samples: 69246088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:55:25,661][106151] Avg episode reward: [(0, '4426.603')] [2023-03-12 00:55:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000135288_69267456.pth... [2023-03-12 00:55:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000134560_68894720.pth [2023-03-12 00:55:28,523][106434] Updated weights for policy 0, policy_version 135360 (0.0004) [2023-03-12 00:55:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 11968.7). Total num frames: 69328896. Throughput: 0: 12457.1. Samples: 69320712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:55:30,661][106151] Avg episode reward: [(0, '4315.120')] [2023-03-12 00:55:31,830][106434] Updated weights for policy 0, policy_version 135440 (0.0004) [2023-03-12 00:55:35,168][106434] Updated weights for policy 0, policy_version 135520 (0.0004) [2023-03-12 00:55:35,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 11968.7). Total num frames: 69390336. Throughput: 0: 12468.8. Samples: 69357576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:55:35,661][106151] Avg episode reward: [(0, '4277.991')] [2023-03-12 00:55:38,530][106434] Updated weights for policy 0, policy_version 135600 (0.0004) [2023-03-12 00:55:40,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12288.0, 300 sec: 11954.8). Total num frames: 69447680. Throughput: 0: 12429.3. Samples: 69431032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:55:40,661][106151] Avg episode reward: [(0, '4314.420')] [2023-03-12 00:55:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000135640_69447680.pth... [2023-03-12 00:55:40,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000134920_69079040.pth [2023-03-12 00:55:42,250][106434] Updated weights for policy 0, policy_version 135680 (0.0005) [2023-03-12 00:55:45,661][106151] Fps is (10 sec: 11468.7, 60 sec: 12288.0, 300 sec: 11940.9). Total num frames: 69505024. Throughput: 0: 12250.8. Samples: 69497856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:55:45,661][106151] Avg episode reward: [(0, '4110.276')] [2023-03-12 00:55:45,688][106434] Updated weights for policy 0, policy_version 135760 (0.0004) [2023-03-12 00:55:48,956][106434] Updated weights for policy 0, policy_version 135840 (0.0004) [2023-03-12 00:55:50,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12356.3, 300 sec: 11954.8). Total num frames: 69570560. Throughput: 0: 12267.4. Samples: 69535724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:55:50,661][106151] Avg episode reward: [(0, '3936.673')] [2023-03-12 00:55:52,232][106434] Updated weights for policy 0, policy_version 135920 (0.0004) [2023-03-12 00:55:55,569][106434] Updated weights for policy 0, policy_version 136000 (0.0005) [2023-03-12 00:55:55,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 11940.9). Total num frames: 69632000. Throughput: 0: 12271.0. Samples: 69610828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:55:55,661][106151] Avg episode reward: [(0, '3936.071')] [2023-03-12 00:55:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000136000_69632000.pth... [2023-03-12 00:55:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000135288_69267456.pth [2023-03-12 00:55:58,841][106434] Updated weights for policy 0, policy_version 136080 (0.0004) [2023-03-12 00:56:00,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 11954.8). Total num frames: 69693440. Throughput: 0: 12268.3. Samples: 69685312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:56:00,661][106151] Avg episode reward: [(0, '4240.597')] [2023-03-12 00:56:02,160][106434] Updated weights for policy 0, policy_version 136160 (0.0004) [2023-03-12 00:56:05,397][106434] Updated weights for policy 0, policy_version 136240 (0.0004) [2023-03-12 00:56:05,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 11968.7). Total num frames: 69754880. Throughput: 0: 12261.0. Samples: 69722184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:56:05,661][106151] Avg episode reward: [(0, '4343.206')] [2023-03-12 00:56:08,822][106434] Updated weights for policy 0, policy_version 136320 (0.0004) [2023-03-12 00:56:10,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 11968.7). Total num frames: 69816320. Throughput: 0: 12218.2. Samples: 69795904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:56:10,661][106151] Avg episode reward: [(0, '4350.617')] [2023-03-12 00:56:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000136360_69816320.pth... [2023-03-12 00:56:10,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000135640_69447680.pth [2023-03-12 00:56:12,013][106434] Updated weights for policy 0, policy_version 136400 (0.0004) [2023-03-12 00:56:15,205][106434] Updated weights for policy 0, policy_version 136480 (0.0004) [2023-03-12 00:56:15,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12356.3, 300 sec: 11982.5). Total num frames: 69881856. Throughput: 0: 12268.7. Samples: 69872804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:56:15,662][106151] Avg episode reward: [(0, '3703.241')] [2023-03-12 00:56:18,560][106434] Updated weights for policy 0, policy_version 136560 (0.0005) [2023-03-12 00:56:20,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 11996.4). Total num frames: 69943296. Throughput: 0: 12271.5. Samples: 69909796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:56:20,661][106151] Avg episode reward: [(0, '4250.883')] [2023-03-12 00:56:21,945][106434] Updated weights for policy 0, policy_version 136640 (0.0005) [2023-03-12 00:56:25,467][106434] Updated weights for policy 0, policy_version 136720 (0.0005) [2023-03-12 00:56:25,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 11996.4). Total num frames: 70000640. Throughput: 0: 12240.3. Samples: 69981848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:56:25,662][106151] Avg episode reward: [(0, '3797.898')] [2023-03-12 00:56:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000136720_70000640.pth... [2023-03-12 00:56:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000136000_69632000.pth [2023-03-12 00:56:28,938][106434] Updated weights for policy 0, policy_version 136800 (0.0005) [2023-03-12 00:56:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 11996.4). Total num frames: 70062080. Throughput: 0: 12320.0. Samples: 70052256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:56:30,661][106151] Avg episode reward: [(0, '4166.482')] [2023-03-12 00:56:32,285][106434] Updated weights for policy 0, policy_version 136880 (0.0005) [2023-03-12 00:56:35,541][106434] Updated weights for policy 0, policy_version 136960 (0.0004) [2023-03-12 00:56:35,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12219.7, 300 sec: 11996.4). Total num frames: 70123520. Throughput: 0: 12305.1. Samples: 70089452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:56:35,661][106151] Avg episode reward: [(0, '3977.269')] [2023-03-12 00:56:38,821][106434] Updated weights for policy 0, policy_version 137040 (0.0004) [2023-03-12 00:56:40,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12010.3). Total num frames: 70184960. Throughput: 0: 12304.8. Samples: 70164544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:56:40,661][106151] Avg episode reward: [(0, '4261.285')] [2023-03-12 00:56:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000137080_70184960.pth... [2023-03-12 00:56:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000136360_69816320.pth [2023-03-12 00:56:42,083][106434] Updated weights for policy 0, policy_version 137120 (0.0004) [2023-03-12 00:56:45,392][106434] Updated weights for policy 0, policy_version 137200 (0.0004) [2023-03-12 00:56:45,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 12024.2). Total num frames: 70246400. Throughput: 0: 12313.9. Samples: 70239436. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:56:45,661][106151] Avg episode reward: [(0, '4339.398')] [2023-03-12 00:56:48,681][106434] Updated weights for policy 0, policy_version 137280 (0.0003) [2023-03-12 00:56:50,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12038.1). Total num frames: 70307840. Throughput: 0: 12320.3. Samples: 70276596. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:56:50,661][106151] Avg episode reward: [(0, '4363.385')] [2023-03-12 00:56:52,020][106434] Updated weights for policy 0, policy_version 137360 (0.0003) [2023-03-12 00:56:55,503][106434] Updated weights for policy 0, policy_version 137440 (0.0004) [2023-03-12 00:56:55,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 12052.0). Total num frames: 70369280. Throughput: 0: 12305.1. Samples: 70349636. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:56:55,661][106151] Avg episode reward: [(0, '4113.431')] [2023-03-12 00:56:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000137440_70369280.pth... [2023-03-12 00:56:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000136720_70000640.pth [2023-03-12 00:56:58,706][106434] Updated weights for policy 0, policy_version 137520 (0.0003) [2023-03-12 00:57:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12065.8). Total num frames: 70430720. Throughput: 0: 12241.3. Samples: 70423660. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:57:00,661][106151] Avg episode reward: [(0, '4212.670')] [2023-03-12 00:57:01,993][106434] Updated weights for policy 0, policy_version 137600 (0.0004) [2023-03-12 00:57:05,283][106434] Updated weights for policy 0, policy_version 137680 (0.0004) [2023-03-12 00:57:05,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12356.3, 300 sec: 12093.6). Total num frames: 70496256. Throughput: 0: 12253.3. Samples: 70461192. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:57:05,661][106151] Avg episode reward: [(0, '4212.166')] [2023-03-12 00:57:08,781][106434] Updated weights for policy 0, policy_version 137760 (0.0005) [2023-03-12 00:57:10,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12093.6). Total num frames: 70553600. Throughput: 0: 12254.2. Samples: 70533284. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:57:10,661][106151] Avg episode reward: [(0, '3859.267')] [2023-03-12 00:57:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000137800_70553600.pth... [2023-03-12 00:57:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000137080_70184960.pth [2023-03-12 00:57:12,251][106434] Updated weights for policy 0, policy_version 137840 (0.0004) [2023-03-12 00:57:15,543][106434] Updated weights for policy 0, policy_version 137920 (0.0004) [2023-03-12 00:57:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12093.6). Total num frames: 70615040. Throughput: 0: 12313.4. Samples: 70606360. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:57:15,661][106151] Avg episode reward: [(0, '4380.758')] [2023-03-12 00:57:18,827][106434] Updated weights for policy 0, policy_version 138000 (0.0005) [2023-03-12 00:57:20,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12219.7, 300 sec: 12093.6). Total num frames: 70676480. Throughput: 0: 12315.5. Samples: 70643648. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:57:20,661][106151] Avg episode reward: [(0, '4428.972')] [2023-03-12 00:57:22,048][106434] Updated weights for policy 0, policy_version 138080 (0.0004) [2023-03-12 00:57:25,335][106434] Updated weights for policy 0, policy_version 138160 (0.0004) [2023-03-12 00:57:25,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12107.5). Total num frames: 70737920. Throughput: 0: 12332.4. Samples: 70719500. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:57:25,661][106151] Avg episode reward: [(0, '4498.597')] [2023-03-12 00:57:25,684][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000138168_70742016.pth... [2023-03-12 00:57:25,685][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000137440_70369280.pth [2023-03-12 00:57:28,732][106434] Updated weights for policy 0, policy_version 138240 (0.0004) [2023-03-12 00:57:30,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 12121.4). Total num frames: 70799360. Throughput: 0: 12269.8. Samples: 70791576. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:57:30,661][106151] Avg episode reward: [(0, '4033.833')] [2023-03-12 00:57:32,016][106434] Updated weights for policy 0, policy_version 138320 (0.0003) [2023-03-12 00:57:35,480][106434] Updated weights for policy 0, policy_version 138400 (0.0004) [2023-03-12 00:57:35,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12135.3). Total num frames: 70860800. Throughput: 0: 12306.0. Samples: 70830364. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:57:35,661][106151] Avg episode reward: [(0, '4291.378')] [2023-03-12 00:57:39,033][106434] Updated weights for policy 0, policy_version 138480 (0.0005) [2023-03-12 00:57:40,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12135.3). Total num frames: 70918144. Throughput: 0: 12223.9. Samples: 70899712. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:57:40,661][106151] Avg episode reward: [(0, '4363.309')] [2023-03-12 00:57:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000138512_70918144.pth... [2023-03-12 00:57:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000137800_70553600.pth [2023-03-12 00:57:42,603][106434] Updated weights for policy 0, policy_version 138560 (0.0005) [2023-03-12 00:57:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 12121.4). Total num frames: 70975488. Throughput: 0: 12108.6. Samples: 70968548. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 00:57:45,661][106151] Avg episode reward: [(0, '4485.410')] [2023-03-12 00:57:46,164][106434] Updated weights for policy 0, policy_version 138640 (0.0005) [2023-03-12 00:57:49,740][106434] Updated weights for policy 0, policy_version 138720 (0.0005) [2023-03-12 00:57:50,661][106151] Fps is (10 sec: 11468.9, 60 sec: 12083.2, 300 sec: 12121.4). Total num frames: 71032832. Throughput: 0: 12027.7. Samples: 71002436. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:57:50,661][106151] Avg episode reward: [(0, '4476.357')] [2023-03-12 00:57:53,288][106434] Updated weights for policy 0, policy_version 138800 (0.0005) [2023-03-12 00:57:55,661][106151] Fps is (10 sec: 11468.7, 60 sec: 12014.9, 300 sec: 12121.4). Total num frames: 71090176. Throughput: 0: 11973.1. Samples: 71072072. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:57:55,661][106151] Avg episode reward: [(0, '4245.232')] [2023-03-12 00:57:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000138848_71090176.pth... [2023-03-12 00:57:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000138168_70742016.pth [2023-03-12 00:57:56,808][106434] Updated weights for policy 0, policy_version 138880 (0.0005) [2023-03-12 00:58:00,360][106434] Updated weights for policy 0, policy_version 138960 (0.0005) [2023-03-12 00:58:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 12107.5). Total num frames: 71147520. Throughput: 0: 11895.5. Samples: 71141656. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:58:00,661][106151] Avg episode reward: [(0, '4446.602')] [2023-03-12 00:58:03,888][106434] Updated weights for policy 0, policy_version 139040 (0.0005) [2023-03-12 00:58:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 12107.5). Total num frames: 71204864. Throughput: 0: 11835.9. Samples: 71176264. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:58:05,661][106151] Avg episode reward: [(0, '4480.986')] [2023-03-12 00:58:07,455][106434] Updated weights for policy 0, policy_version 139120 (0.0005) [2023-03-12 00:58:10,661][106151] Fps is (10 sec: 11468.6, 60 sec: 11810.1, 300 sec: 12093.6). Total num frames: 71262208. Throughput: 0: 11687.4. Samples: 71245432. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:58:10,661][106151] Avg episode reward: [(0, '4395.317')] [2023-03-12 00:58:10,687][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000139192_71266304.pth... [2023-03-12 00:58:10,689][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000138512_70918144.pth [2023-03-12 00:58:11,060][106434] Updated weights for policy 0, policy_version 139200 (0.0005) [2023-03-12 00:58:14,618][106434] Updated weights for policy 0, policy_version 139280 (0.0005) [2023-03-12 00:58:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 12093.6). Total num frames: 71319552. Throughput: 0: 11606.1. Samples: 71313852. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:58:15,661][106151] Avg episode reward: [(0, '4478.862')] [2023-03-12 00:58:18,203][106434] Updated weights for policy 0, policy_version 139360 (0.0005) [2023-03-12 00:58:20,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11741.9, 300 sec: 12107.5). Total num frames: 71380992. Throughput: 0: 11508.0. Samples: 71348224. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:58:20,661][106151] Avg episode reward: [(0, '4293.940')] [2023-03-12 00:58:21,639][106434] Updated weights for policy 0, policy_version 139440 (0.0005) [2023-03-12 00:58:24,965][106434] Updated weights for policy 0, policy_version 139520 (0.0004) [2023-03-12 00:58:25,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 12121.4). Total num frames: 71442432. Throughput: 0: 11565.4. Samples: 71420156. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:58:25,661][106151] Avg episode reward: [(0, '4390.041')] [2023-03-12 00:58:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000139536_71442432.pth... [2023-03-12 00:58:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000138848_71090176.pth [2023-03-12 00:58:28,207][106434] Updated weights for policy 0, policy_version 139600 (0.0004) [2023-03-12 00:58:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 12107.5). Total num frames: 71503872. Throughput: 0: 11709.2. Samples: 71495464. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:58:30,661][106151] Avg episode reward: [(0, '4402.357')] [2023-03-12 00:58:31,495][106434] Updated weights for policy 0, policy_version 139680 (0.0004) [2023-03-12 00:58:34,753][106434] Updated weights for policy 0, policy_version 139760 (0.0004) [2023-03-12 00:58:35,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 12107.5). Total num frames: 71565312. Throughput: 0: 11783.7. Samples: 71532704. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:58:35,661][106151] Avg episode reward: [(0, '4486.360')] [2023-03-12 00:58:38,032][106434] Updated weights for policy 0, policy_version 139840 (0.0004) [2023-03-12 00:58:40,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 12107.5). Total num frames: 71626752. Throughput: 0: 11914.4. Samples: 71608220. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:58:40,661][106151] Avg episode reward: [(0, '4389.801')] [2023-03-12 00:58:40,676][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000139904_71630848.pth... [2023-03-12 00:58:40,677][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000139192_71266304.pth [2023-03-12 00:58:41,301][106434] Updated weights for policy 0, policy_version 139920 (0.0004) [2023-03-12 00:58:44,601][106434] Updated weights for policy 0, policy_version 140000 (0.0005) [2023-03-12 00:58:45,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11946.7, 300 sec: 12121.4). Total num frames: 71692288. Throughput: 0: 12030.9. Samples: 71683048. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 00:58:45,661][106151] Avg episode reward: [(0, '4495.460')] [2023-03-12 00:58:48,003][106434] Updated weights for policy 0, policy_version 140080 (0.0005) [2023-03-12 00:58:50,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11946.6, 300 sec: 12107.5). Total num frames: 71749632. Throughput: 0: 12059.9. Samples: 71718960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:58:50,661][106151] Avg episode reward: [(0, '4297.592')] [2023-03-12 00:58:51,596][106434] Updated weights for policy 0, policy_version 140160 (0.0005) [2023-03-12 00:58:55,159][106434] Updated weights for policy 0, policy_version 140240 (0.0005) [2023-03-12 00:58:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 12093.6). Total num frames: 71806976. Throughput: 0: 12033.6. Samples: 71786944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:58:55,661][106151] Avg episode reward: [(0, '4520.714')] [2023-03-12 00:58:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000140248_71806976.pth... [2023-03-12 00:58:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000139536_71442432.pth [2023-03-12 00:58:58,721][106434] Updated weights for policy 0, policy_version 140320 (0.0005) [2023-03-12 00:59:00,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 12079.7). Total num frames: 71864320. Throughput: 0: 12055.8. Samples: 71856364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:59:00,661][106151] Avg episode reward: [(0, '4529.640')] [2023-03-12 00:59:02,275][106434] Updated weights for policy 0, policy_version 140400 (0.0005) [2023-03-12 00:59:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 12065.8). Total num frames: 71921664. Throughput: 0: 12073.0. Samples: 71891508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:59:05,661][106151] Avg episode reward: [(0, '4484.610')] [2023-03-12 00:59:05,821][106434] Updated weights for policy 0, policy_version 140480 (0.0005) [2023-03-12 00:59:09,396][106434] Updated weights for policy 0, policy_version 140560 (0.0005) [2023-03-12 00:59:10,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11946.7, 300 sec: 12065.8). Total num frames: 71979008. Throughput: 0: 12006.9. Samples: 71960468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:59:10,662][106151] Avg episode reward: [(0, '4492.446')] [2023-03-12 00:59:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000140584_71979008.pth... [2023-03-12 00:59:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000139904_71630848.pth [2023-03-12 00:59:12,925][106434] Updated weights for policy 0, policy_version 140640 (0.0005) [2023-03-12 00:59:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 12052.0). Total num frames: 72036352. Throughput: 0: 11884.2. Samples: 72030252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:59:15,661][106151] Avg episode reward: [(0, '4524.907')] [2023-03-12 00:59:16,421][106434] Updated weights for policy 0, policy_version 140720 (0.0005) [2023-03-12 00:59:20,020][106434] Updated weights for policy 0, policy_version 140800 (0.0005) [2023-03-12 00:59:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 12052.0). Total num frames: 72093696. Throughput: 0: 11829.5. Samples: 72065032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:59:20,672][106151] Avg episode reward: [(0, '3992.965')] [2023-03-12 00:59:23,693][106434] Updated weights for policy 0, policy_version 140880 (0.0005) [2023-03-12 00:59:25,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 12052.0). Total num frames: 72151040. Throughput: 0: 11638.0. Samples: 72131932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:59:25,661][106151] Avg episode reward: [(0, '4066.767')] [2023-03-12 00:59:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000140920_72151040.pth... [2023-03-12 00:59:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000140248_71806976.pth [2023-03-12 00:59:27,237][106434] Updated weights for policy 0, policy_version 140960 (0.0005) [2023-03-12 00:59:30,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 12052.0). Total num frames: 72208384. Throughput: 0: 11522.9. Samples: 72201576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:59:30,672][106151] Avg episode reward: [(0, '4105.009')] [2023-03-12 00:59:30,802][106434] Updated weights for policy 0, policy_version 141040 (0.0005) [2023-03-12 00:59:34,346][106434] Updated weights for policy 0, policy_version 141120 (0.0005) [2023-03-12 00:59:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12052.0). Total num frames: 72265728. Throughput: 0: 11495.6. Samples: 72236264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:59:35,672][106151] Avg episode reward: [(0, '4313.847')] [2023-03-12 00:59:37,981][106434] Updated weights for policy 0, policy_version 141200 (0.0005) [2023-03-12 00:59:40,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 12052.0). Total num frames: 72323072. Throughput: 0: 11503.6. Samples: 72304608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:59:40,661][106151] Avg episode reward: [(0, '4531.663')] [2023-03-12 00:59:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000141256_72323072.pth... [2023-03-12 00:59:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000140584_71979008.pth [2023-03-12 00:59:40,668][106390] Saving new best policy, reward=4531.663! [2023-03-12 00:59:41,581][106434] Updated weights for policy 0, policy_version 141280 (0.0005) [2023-03-12 00:59:45,237][106434] Updated weights for policy 0, policy_version 141360 (0.0005) [2023-03-12 00:59:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 12038.1). Total num frames: 72380416. Throughput: 0: 11453.8. Samples: 72371784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:59:45,672][106151] Avg episode reward: [(0, '4404.908')] [2023-03-12 00:59:48,638][106434] Updated weights for policy 0, policy_version 141440 (0.0004) [2023-03-12 00:59:50,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 12024.2). Total num frames: 72441856. Throughput: 0: 11446.4. Samples: 72406596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:59:50,672][106151] Avg episode reward: [(0, '4398.121')] [2023-03-12 00:59:51,887][106434] Updated weights for policy 0, policy_version 141520 (0.0004) [2023-03-12 00:59:55,165][106434] Updated weights for policy 0, policy_version 141600 (0.0004) [2023-03-12 00:59:55,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11605.3, 300 sec: 12024.2). Total num frames: 72503296. Throughput: 0: 11607.9. Samples: 72482824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 00:59:55,662][106151] Avg episode reward: [(0, '4384.733')] [2023-03-12 00:59:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000141608_72503296.pth... [2023-03-12 00:59:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000140920_72151040.pth [2023-03-12 00:59:58,548][106434] Updated weights for policy 0, policy_version 141680 (0.0003) [2023-03-12 01:00:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 12024.2). Total num frames: 72564736. Throughput: 0: 11695.6. Samples: 72556556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:00:00,661][106151] Avg episode reward: [(0, '4490.355')] [2023-03-12 01:00:01,830][106434] Updated weights for policy 0, policy_version 141760 (0.0003) [2023-03-12 01:00:05,057][106434] Updated weights for policy 0, policy_version 141840 (0.0004) [2023-03-12 01:00:05,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 12024.2). Total num frames: 72626176. Throughput: 0: 11746.4. Samples: 72593620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:00:05,661][106151] Avg episode reward: [(0, '4347.677')] [2023-03-12 01:00:08,534][106434] Updated weights for policy 0, policy_version 141920 (0.0005) [2023-03-12 01:00:10,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 12010.3). Total num frames: 72683520. Throughput: 0: 11887.6. Samples: 72666876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:00:10,661][106151] Avg episode reward: [(0, '4534.042')] [2023-03-12 01:00:10,700][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000141968_72687616.pth... [2023-03-12 01:00:10,702][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000141256_72323072.pth [2023-03-12 01:00:10,702][106390] Saving new best policy, reward=4534.042! [2023-03-12 01:00:12,031][106434] Updated weights for policy 0, policy_version 142000 (0.0005) [2023-03-12 01:00:15,310][106434] Updated weights for policy 0, policy_version 142080 (0.0004) [2023-03-12 01:00:15,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11878.4, 300 sec: 12010.3). Total num frames: 72749056. Throughput: 0: 11940.3. Samples: 72738888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:00:15,661][106151] Avg episode reward: [(0, '4311.987')] [2023-03-12 01:00:18,544][106434] Updated weights for policy 0, policy_version 142160 (0.0004) [2023-03-12 01:00:20,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11946.7, 300 sec: 12010.3). Total num frames: 72810496. Throughput: 0: 12016.4. Samples: 72777000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:00:20,661][106151] Avg episode reward: [(0, '4005.712')] [2023-03-12 01:00:21,937][106434] Updated weights for policy 0, policy_version 142240 (0.0005) [2023-03-12 01:00:25,340][106434] Updated weights for policy 0, policy_version 142320 (0.0005) [2023-03-12 01:00:25,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12014.9, 300 sec: 12010.3). Total num frames: 72871936. Throughput: 0: 12112.5. Samples: 72849672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:00:25,661][106151] Avg episode reward: [(0, '3480.276')] [2023-03-12 01:00:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000142328_72871936.pth... [2023-03-12 01:00:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000141608_72503296.pth [2023-03-12 01:00:28,757][106434] Updated weights for policy 0, policy_version 142400 (0.0004) [2023-03-12 01:00:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11996.4). Total num frames: 72929280. Throughput: 0: 12215.3. Samples: 72921472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:00:30,661][106151] Avg episode reward: [(0, '3316.407')] [2023-03-12 01:00:32,167][106434] Updated weights for policy 0, policy_version 142480 (0.0004) [2023-03-12 01:00:35,649][106434] Updated weights for policy 0, policy_version 142560 (0.0006) [2023-03-12 01:00:35,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 12010.3). Total num frames: 72990720. Throughput: 0: 12252.4. Samples: 72957952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:00:35,661][106151] Avg episode reward: [(0, '4224.962')] [2023-03-12 01:00:38,961][106434] Updated weights for policy 0, policy_version 142640 (0.0005) [2023-03-12 01:00:40,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12151.5, 300 sec: 12024.2). Total num frames: 73052160. Throughput: 0: 12164.7. Samples: 73030236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:00:40,661][106151] Avg episode reward: [(0, '4271.873')] [2023-03-12 01:00:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000142680_73052160.pth... [2023-03-12 01:00:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000141968_72687616.pth [2023-03-12 01:00:42,269][106434] Updated weights for policy 0, policy_version 142720 (0.0005) [2023-03-12 01:00:45,543][106434] Updated weights for policy 0, policy_version 142800 (0.0004) [2023-03-12 01:00:45,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12010.3). Total num frames: 73113600. Throughput: 0: 12179.6. Samples: 73104640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:00:45,661][106151] Avg episode reward: [(0, '4221.364')] [2023-03-12 01:00:48,871][106434] Updated weights for policy 0, policy_version 142880 (0.0005) [2023-03-12 01:00:50,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12219.7, 300 sec: 12010.3). Total num frames: 73175040. Throughput: 0: 12188.3. Samples: 73142092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:00:50,661][106151] Avg episode reward: [(0, '4396.088')] [2023-03-12 01:00:52,143][106434] Updated weights for policy 0, policy_version 142960 (0.0004) [2023-03-12 01:00:55,429][106434] Updated weights for policy 0, policy_version 143040 (0.0005) [2023-03-12 01:00:55,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12010.3). Total num frames: 73236480. Throughput: 0: 12213.3. Samples: 73216476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:00:55,661][106151] Avg episode reward: [(0, '4428.504')] [2023-03-12 01:00:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000143040_73236480.pth... [2023-03-12 01:00:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000142328_72871936.pth [2023-03-12 01:00:59,024][106434] Updated weights for policy 0, policy_version 143120 (0.0006) [2023-03-12 01:01:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11996.4). Total num frames: 73293824. Throughput: 0: 12176.4. Samples: 73286828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:01:00,661][106151] Avg episode reward: [(0, '4370.945')] [2023-03-12 01:01:02,424][106434] Updated weights for policy 0, policy_version 143200 (0.0005) [2023-03-12 01:01:05,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11996.4). Total num frames: 73355264. Throughput: 0: 12141.5. Samples: 73323368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:01:05,661][106151] Avg episode reward: [(0, '4389.819')] [2023-03-12 01:01:05,760][106434] Updated weights for policy 0, policy_version 143280 (0.0005) [2023-03-12 01:01:08,998][106434] Updated weights for policy 0, policy_version 143360 (0.0004) [2023-03-12 01:01:10,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 11996.4). Total num frames: 73420800. Throughput: 0: 12184.3. Samples: 73397964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:01:10,661][106151] Avg episode reward: [(0, '4217.730')] [2023-03-12 01:01:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000143400_73420800.pth... [2023-03-12 01:01:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000142680_73052160.pth [2023-03-12 01:01:12,257][106434] Updated weights for policy 0, policy_version 143440 (0.0004) [2023-03-12 01:01:15,543][106434] Updated weights for policy 0, policy_version 143520 (0.0004) [2023-03-12 01:01:15,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 11996.4). Total num frames: 73482240. Throughput: 0: 12262.8. Samples: 73473296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:01:15,661][106151] Avg episode reward: [(0, '4439.161')] [2023-03-12 01:01:18,879][106434] Updated weights for policy 0, policy_version 143600 (0.0005) [2023-03-12 01:01:20,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12219.7, 300 sec: 12010.3). Total num frames: 73543680. Throughput: 0: 12280.9. Samples: 73510592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:01:20,661][106151] Avg episode reward: [(0, '4413.481')] [2023-03-12 01:01:22,341][106434] Updated weights for policy 0, policy_version 143680 (0.0005) [2023-03-12 01:01:25,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11996.4). Total num frames: 73601024. Throughput: 0: 12230.5. Samples: 73580608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:01:25,661][106151] Avg episode reward: [(0, '4398.552')] [2023-03-12 01:01:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000143752_73601024.pth... [2023-03-12 01:01:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000143040_73236480.pth [2023-03-12 01:01:25,913][106434] Updated weights for policy 0, policy_version 143760 (0.0005) [2023-03-12 01:01:29,273][106434] Updated weights for policy 0, policy_version 143840 (0.0004) [2023-03-12 01:01:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 11982.5). Total num frames: 73658368. Throughput: 0: 12177.5. Samples: 73652628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:01:30,661][106151] Avg episode reward: [(0, '4368.698')] [2023-03-12 01:01:32,864][106434] Updated weights for policy 0, policy_version 143920 (0.0005) [2023-03-12 01:01:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 11968.7). Total num frames: 73715712. Throughput: 0: 12110.0. Samples: 73687040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:01:35,661][106151] Avg episode reward: [(0, '4170.088')] [2023-03-12 01:01:36,496][106434] Updated weights for policy 0, policy_version 144000 (0.0006) [2023-03-12 01:01:40,100][106434] Updated weights for policy 0, policy_version 144080 (0.0005) [2023-03-12 01:01:40,661][106151] Fps is (10 sec: 11468.7, 60 sec: 12014.9, 300 sec: 11954.8). Total num frames: 73773056. Throughput: 0: 11952.4. Samples: 73754336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:01:40,661][106151] Avg episode reward: [(0, '4435.075')] [2023-03-12 01:01:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000144088_73773056.pth... [2023-03-12 01:01:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000143400_73420800.pth [2023-03-12 01:01:43,465][106434] Updated weights for policy 0, policy_version 144160 (0.0003) [2023-03-12 01:01:45,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11954.8). Total num frames: 73834496. Throughput: 0: 11990.0. Samples: 73826376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:01:45,661][106151] Avg episode reward: [(0, '4218.881')] [2023-03-12 01:01:46,752][106434] Updated weights for policy 0, policy_version 144240 (0.0003) [2023-03-12 01:01:50,110][106434] Updated weights for policy 0, policy_version 144320 (0.0003) [2023-03-12 01:01:50,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11954.8). Total num frames: 73895936. Throughput: 0: 11997.0. Samples: 73863232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:01:50,661][106151] Avg episode reward: [(0, '4432.480')] [2023-03-12 01:01:53,631][106434] Updated weights for policy 0, policy_version 144400 (0.0005) [2023-03-12 01:01:55,661][106151] Fps is (10 sec: 12287.8, 60 sec: 12014.9, 300 sec: 11954.8). Total num frames: 73957376. Throughput: 0: 11940.8. Samples: 73935300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:01:55,662][106151] Avg episode reward: [(0, '4406.705')] [2023-03-12 01:01:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000144448_73957376.pth... [2023-03-12 01:01:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000143752_73601024.pth [2023-03-12 01:01:56,941][106434] Updated weights for policy 0, policy_version 144480 (0.0004) [2023-03-12 01:02:00,593][106434] Updated weights for policy 0, policy_version 144560 (0.0005) [2023-03-12 01:02:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11927.0). Total num frames: 74014720. Throughput: 0: 11849.6. Samples: 74006528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:02:00,661][106151] Avg episode reward: [(0, '4280.483')] [2023-03-12 01:02:04,068][106434] Updated weights for policy 0, policy_version 144640 (0.0004) [2023-03-12 01:02:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11927.0). Total num frames: 74072064. Throughput: 0: 11802.5. Samples: 74041704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:02:05,661][106151] Avg episode reward: [(0, '4387.750')] [2023-03-12 01:02:07,515][106434] Updated weights for policy 0, policy_version 144720 (0.0004) [2023-03-12 01:02:10,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11927.0). Total num frames: 74133504. Throughput: 0: 11831.4. Samples: 74113024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:02:10,661][106151] Avg episode reward: [(0, '4529.308')] [2023-03-12 01:02:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000144792_74133504.pth... [2023-03-12 01:02:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000144088_73773056.pth [2023-03-12 01:02:10,859][106434] Updated weights for policy 0, policy_version 144800 (0.0003) [2023-03-12 01:02:14,411][106434] Updated weights for policy 0, policy_version 144880 (0.0005) [2023-03-12 01:02:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11913.1). Total num frames: 74190848. Throughput: 0: 11791.3. Samples: 74183236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:02:15,661][106151] Avg episode reward: [(0, '4327.380')] [2023-03-12 01:02:18,021][106434] Updated weights for policy 0, policy_version 144960 (0.0005) [2023-03-12 01:02:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 11899.2). Total num frames: 74248192. Throughput: 0: 11790.9. Samples: 74217632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:02:20,661][106151] Avg episode reward: [(0, '4467.217')] [2023-03-12 01:02:21,480][106434] Updated weights for policy 0, policy_version 145040 (0.0005) [2023-03-12 01:02:24,770][106434] Updated weights for policy 0, policy_version 145120 (0.0004) [2023-03-12 01:02:25,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11899.2). Total num frames: 74309632. Throughput: 0: 11890.5. Samples: 74289408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:02:25,662][106151] Avg episode reward: [(0, '4491.970')] [2023-03-12 01:02:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000145136_74309632.pth... [2023-03-12 01:02:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000144448_73957376.pth [2023-03-12 01:02:28,059][106434] Updated weights for policy 0, policy_version 145200 (0.0004) [2023-03-12 01:02:30,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11946.7, 300 sec: 11913.1). Total num frames: 74375168. Throughput: 0: 11952.3. Samples: 74364232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:02:30,662][106151] Avg episode reward: [(0, '4408.747')] [2023-03-12 01:02:31,309][106434] Updated weights for policy 0, policy_version 145280 (0.0004) [2023-03-12 01:02:34,590][106434] Updated weights for policy 0, policy_version 145360 (0.0004) [2023-03-12 01:02:35,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12014.9, 300 sec: 11927.0). Total num frames: 74436608. Throughput: 0: 11984.0. Samples: 74402512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:02:35,661][106151] Avg episode reward: [(0, '4531.539')] [2023-03-12 01:02:37,898][106434] Updated weights for policy 0, policy_version 145440 (0.0004) [2023-03-12 01:02:40,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11940.9). Total num frames: 74498048. Throughput: 0: 12031.8. Samples: 74476732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:02:40,662][106151] Avg episode reward: [(0, '4514.045')] [2023-03-12 01:02:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000145504_74498048.pth... [2023-03-12 01:02:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000144792_74133504.pth [2023-03-12 01:02:41,247][106434] Updated weights for policy 0, policy_version 145520 (0.0005) [2023-03-12 01:02:44,566][106434] Updated weights for policy 0, policy_version 145600 (0.0005) [2023-03-12 01:02:45,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11954.8). Total num frames: 74559488. Throughput: 0: 12087.9. Samples: 74550484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:02:45,672][106151] Avg episode reward: [(0, '4354.374')] [2023-03-12 01:02:47,938][106434] Updated weights for policy 0, policy_version 145680 (0.0005) [2023-03-12 01:02:50,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11968.7). Total num frames: 74620928. Throughput: 0: 12121.1. Samples: 74587152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:02:50,661][106151] Avg episode reward: [(0, '4464.958')] [2023-03-12 01:02:51,215][106434] Updated weights for policy 0, policy_version 145760 (0.0004) [2023-03-12 01:02:54,516][106434] Updated weights for policy 0, policy_version 145840 (0.0005) [2023-03-12 01:02:55,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11982.5). Total num frames: 74682368. Throughput: 0: 12187.8. Samples: 74661476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:02:55,661][106151] Avg episode reward: [(0, '4308.381')] [2023-03-12 01:02:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000145864_74682368.pth... [2023-03-12 01:02:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000145136_74309632.pth [2023-03-12 01:02:57,964][106434] Updated weights for policy 0, policy_version 145920 (0.0005) [2023-03-12 01:03:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11982.5). Total num frames: 74739712. Throughput: 0: 12204.5. Samples: 74732440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:03:00,672][106151] Avg episode reward: [(0, '4407.950')] [2023-03-12 01:03:01,524][106434] Updated weights for policy 0, policy_version 146000 (0.0006) [2023-03-12 01:03:05,110][106434] Updated weights for policy 0, policy_version 146080 (0.0005) [2023-03-12 01:03:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 11982.5). Total num frames: 74797056. Throughput: 0: 12213.2. Samples: 74767224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:03:05,672][106151] Avg episode reward: [(0, '4444.350')] [2023-03-12 01:03:08,472][106434] Updated weights for policy 0, policy_version 146160 (0.0005) [2023-03-12 01:03:10,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11996.4). Total num frames: 74858496. Throughput: 0: 12192.7. Samples: 74838080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:03:10,661][106151] Avg episode reward: [(0, '4362.174')] [2023-03-12 01:03:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000146208_74858496.pth... [2023-03-12 01:03:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000145504_74498048.pth [2023-03-12 01:03:11,831][106434] Updated weights for policy 0, policy_version 146240 (0.0005) [2023-03-12 01:03:15,132][106434] Updated weights for policy 0, policy_version 146320 (0.0004) [2023-03-12 01:03:15,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11996.4). Total num frames: 74919936. Throughput: 0: 12168.4. Samples: 74911808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:03:15,672][106151] Avg episode reward: [(0, '4356.728')] [2023-03-12 01:03:18,482][106434] Updated weights for policy 0, policy_version 146400 (0.0005) [2023-03-12 01:03:20,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 11996.4). Total num frames: 74981376. Throughput: 0: 12136.9. Samples: 74948672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:03:20,672][106151] Avg episode reward: [(0, '4529.538')] [2023-03-12 01:03:21,813][106434] Updated weights for policy 0, policy_version 146480 (0.0005) [2023-03-12 01:03:25,357][106434] Updated weights for policy 0, policy_version 146560 (0.0005) [2023-03-12 01:03:25,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12151.5, 300 sec: 11982.5). Total num frames: 75038720. Throughput: 0: 12114.5. Samples: 75021884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:03:25,662][106151] Avg episode reward: [(0, '4414.483')] [2023-03-12 01:03:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000146560_75038720.pth... [2023-03-12 01:03:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000145864_74682368.pth [2023-03-12 01:03:28,878][106434] Updated weights for policy 0, policy_version 146640 (0.0004) [2023-03-12 01:03:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11982.5). Total num frames: 75100160. Throughput: 0: 12034.4. Samples: 75092032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:03:30,672][106151] Avg episode reward: [(0, '4433.565')] [2023-03-12 01:03:32,203][106434] Updated weights for policy 0, policy_version 146720 (0.0004) [2023-03-12 01:03:35,596][106434] Updated weights for policy 0, policy_version 146800 (0.0005) [2023-03-12 01:03:35,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12083.2, 300 sec: 11982.5). Total num frames: 75161600. Throughput: 0: 12024.5. Samples: 75128256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:03:35,672][106151] Avg episode reward: [(0, '4486.175')] [2023-03-12 01:03:38,844][106434] Updated weights for policy 0, policy_version 146880 (0.0004) [2023-03-12 01:03:40,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11968.6). Total num frames: 75223040. Throughput: 0: 12021.5. Samples: 75202444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:03:40,662][106151] Avg episode reward: [(0, '4483.684')] [2023-03-12 01:03:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000146920_75223040.pth... [2023-03-12 01:03:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000146208_74858496.pth [2023-03-12 01:03:42,120][106434] Updated weights for policy 0, policy_version 146960 (0.0004) [2023-03-12 01:03:45,355][106434] Updated weights for policy 0, policy_version 147040 (0.0005) [2023-03-12 01:03:45,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11982.5). Total num frames: 75284480. Throughput: 0: 12117.3. Samples: 75277720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:03:45,672][106151] Avg episode reward: [(0, '4405.537')] [2023-03-12 01:03:48,701][106434] Updated weights for policy 0, policy_version 147120 (0.0004) [2023-03-12 01:03:50,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11996.4). Total num frames: 75345920. Throughput: 0: 12147.2. Samples: 75313848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:03:50,661][106151] Avg episode reward: [(0, '4376.498')] [2023-03-12 01:03:51,955][106434] Updated weights for policy 0, policy_version 147200 (0.0003) [2023-03-12 01:03:55,328][106434] Updated weights for policy 0, policy_version 147280 (0.0003) [2023-03-12 01:03:55,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 12024.2). Total num frames: 75411456. Throughput: 0: 12259.3. Samples: 75389748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:03:55,662][106151] Avg episode reward: [(0, '4394.527')] [2023-03-12 01:03:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000147288_75411456.pth... [2023-03-12 01:03:55,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000146560_75038720.pth [2023-03-12 01:03:58,642][106434] Updated weights for policy 0, policy_version 147360 (0.0003) [2023-03-12 01:04:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 12024.2). Total num frames: 75468800. Throughput: 0: 12236.3. Samples: 75462440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:04:00,661][106151] Avg episode reward: [(0, '4526.336')] [2023-03-12 01:04:01,960][106434] Updated weights for policy 0, policy_version 147440 (0.0003) [2023-03-12 01:04:05,183][106434] Updated weights for policy 0, policy_version 147520 (0.0003) [2023-03-12 01:04:05,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 12052.0). Total num frames: 75534336. Throughput: 0: 12260.7. Samples: 75500404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:04:05,661][106151] Avg episode reward: [(0, '4351.758')] [2023-03-12 01:04:08,504][106434] Updated weights for policy 0, policy_version 147600 (0.0004) [2023-03-12 01:04:10,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 12065.8). Total num frames: 75595776. Throughput: 0: 12298.3. Samples: 75575308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:04:10,662][106151] Avg episode reward: [(0, '4521.692')] [2023-03-12 01:04:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000147648_75595776.pth... [2023-03-12 01:04:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000146920_75223040.pth [2023-03-12 01:04:11,904][106434] Updated weights for policy 0, policy_version 147680 (0.0004) [2023-03-12 01:04:15,412][106434] Updated weights for policy 0, policy_version 147760 (0.0005) [2023-03-12 01:04:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12065.8). Total num frames: 75653120. Throughput: 0: 12324.5. Samples: 75646636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:04:15,672][106151] Avg episode reward: [(0, '4327.023')] [2023-03-12 01:04:18,900][106434] Updated weights for policy 0, policy_version 147840 (0.0005) [2023-03-12 01:04:20,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12219.7, 300 sec: 12079.7). Total num frames: 75714560. Throughput: 0: 12295.7. Samples: 75681564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:04:20,672][106151] Avg episode reward: [(0, '4339.903')] [2023-03-12 01:04:22,456][106434] Updated weights for policy 0, policy_version 147920 (0.0005) [2023-03-12 01:04:25,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 12065.8). Total num frames: 75767808. Throughput: 0: 12186.6. Samples: 75750840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:04:25,661][106151] Avg episode reward: [(0, '4527.481')] [2023-03-12 01:04:25,691][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000147992_75771904.pth... [2023-03-12 01:04:25,693][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000147288_75411456.pth [2023-03-12 01:04:26,036][106434] Updated weights for policy 0, policy_version 148000 (0.0005) [2023-03-12 01:04:29,581][106434] Updated weights for policy 0, policy_version 148080 (0.0005) [2023-03-12 01:04:30,661][106151] Fps is (10 sec: 11059.2, 60 sec: 12083.2, 300 sec: 12065.8). Total num frames: 75825152. Throughput: 0: 12051.5. Samples: 75820036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:04:30,672][106151] Avg episode reward: [(0, '4286.822')] [2023-03-12 01:04:33,021][106434] Updated weights for policy 0, policy_version 148160 (0.0004) [2023-03-12 01:04:35,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 12079.7). Total num frames: 75886592. Throughput: 0: 12031.2. Samples: 75855252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:04:35,672][106151] Avg episode reward: [(0, '4473.801')] [2023-03-12 01:04:36,324][106434] Updated weights for policy 0, policy_version 148240 (0.0003) [2023-03-12 01:04:39,721][106434] Updated weights for policy 0, policy_version 148320 (0.0005) [2023-03-12 01:04:40,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 12093.6). Total num frames: 75948032. Throughput: 0: 11981.8. Samples: 75928928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:04:40,662][106151] Avg episode reward: [(0, '4529.470')] [2023-03-12 01:04:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000148336_75948032.pth... [2023-03-12 01:04:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000147648_75595776.pth [2023-03-12 01:04:43,249][106434] Updated weights for policy 0, policy_version 148400 (0.0005) [2023-03-12 01:04:45,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 12079.7). Total num frames: 76005376. Throughput: 0: 11922.6. Samples: 75998956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:04:45,672][106151] Avg episode reward: [(0, '4435.821')] [2023-03-12 01:04:46,808][106434] Updated weights for policy 0, policy_version 148480 (0.0005) [2023-03-12 01:04:50,142][106434] Updated weights for policy 0, policy_version 148560 (0.0004) [2023-03-12 01:04:50,661][106151] Fps is (10 sec: 11878.6, 60 sec: 12014.9, 300 sec: 12079.7). Total num frames: 76066816. Throughput: 0: 11849.5. Samples: 76033632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:04:50,672][106151] Avg episode reward: [(0, '4526.974')] [2023-03-12 01:04:53,375][106434] Updated weights for policy 0, policy_version 148640 (0.0003) [2023-03-12 01:04:55,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12015.0, 300 sec: 12093.6). Total num frames: 76132352. Throughput: 0: 11855.8. Samples: 76108816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:04:55,661][106151] Avg episode reward: [(0, '4527.840')] [2023-03-12 01:04:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000148696_76132352.pth... [2023-03-12 01:04:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000147992_75771904.pth [2023-03-12 01:04:56,639][106434] Updated weights for policy 0, policy_version 148720 (0.0003) [2023-03-12 01:04:59,970][106434] Updated weights for policy 0, policy_version 148800 (0.0003) [2023-03-12 01:05:00,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12015.0, 300 sec: 12079.7). Total num frames: 76189696. Throughput: 0: 11932.6. Samples: 76183600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:05:00,661][106151] Avg episode reward: [(0, '4180.139')] [2023-03-12 01:05:03,491][106434] Updated weights for policy 0, policy_version 148880 (0.0005) [2023-03-12 01:05:05,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12093.6). Total num frames: 76251136. Throughput: 0: 11933.2. Samples: 76218556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:05:05,661][106151] Avg episode reward: [(0, '4239.566')] [2023-03-12 01:05:07,021][106434] Updated weights for policy 0, policy_version 148960 (0.0005) [2023-03-12 01:05:10,516][106434] Updated weights for policy 0, policy_version 149040 (0.0005) [2023-03-12 01:05:10,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 12065.8). Total num frames: 76308480. Throughput: 0: 11963.5. Samples: 76289196. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:05:10,661][106151] Avg episode reward: [(0, '4387.842')] [2023-03-12 01:05:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000149040_76308480.pth... [2023-03-12 01:05:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000148336_75948032.pth [2023-03-12 01:05:13,964][106434] Updated weights for policy 0, policy_version 149120 (0.0005) [2023-03-12 01:05:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 12052.0). Total num frames: 76365824. Throughput: 0: 11980.5. Samples: 76359160. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:05:15,661][106151] Avg episode reward: [(0, '4482.927')] [2023-03-12 01:05:17,532][106434] Updated weights for policy 0, policy_version 149200 (0.0005) [2023-03-12 01:05:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 12038.1). Total num frames: 76423168. Throughput: 0: 11978.8. Samples: 76394296. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:05:20,661][106151] Avg episode reward: [(0, '4518.598')] [2023-03-12 01:05:21,053][106434] Updated weights for policy 0, policy_version 149280 (0.0006) [2023-03-12 01:05:24,609][106434] Updated weights for policy 0, policy_version 149360 (0.0005) [2023-03-12 01:05:25,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 12038.1). Total num frames: 76480512. Throughput: 0: 11876.2. Samples: 76463356. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:05:25,661][106151] Avg episode reward: [(0, '4479.562')] [2023-03-12 01:05:25,692][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000149384_76484608.pth... [2023-03-12 01:05:25,693][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000148696_76132352.pth [2023-03-12 01:05:28,180][106434] Updated weights for policy 0, policy_version 149440 (0.0005) [2023-03-12 01:05:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12038.1). Total num frames: 76541952. Throughput: 0: 11863.4. Samples: 76532808. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:05:30,662][106151] Avg episode reward: [(0, '4385.638')] [2023-03-12 01:05:31,727][106434] Updated weights for policy 0, policy_version 149520 (0.0005) [2023-03-12 01:05:35,217][106434] Updated weights for policy 0, policy_version 149600 (0.0005) [2023-03-12 01:05:35,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 12024.2). Total num frames: 76599296. Throughput: 0: 11843.8. Samples: 76566604. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:05:35,661][106151] Avg episode reward: [(0, '4481.302')] [2023-03-12 01:05:38,815][106434] Updated weights for policy 0, policy_version 149680 (0.0005) [2023-03-12 01:05:40,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 12010.3). Total num frames: 76656640. Throughput: 0: 11720.2. Samples: 76636224. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:05:40,661][106151] Avg episode reward: [(0, '4528.485')] [2023-03-12 01:05:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000149720_76656640.pth... [2023-03-12 01:05:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000149040_76308480.pth [2023-03-12 01:05:42,393][106434] Updated weights for policy 0, policy_version 149760 (0.0005) [2023-03-12 01:05:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11996.4). Total num frames: 76713984. Throughput: 0: 11597.1. Samples: 76705472. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:05:45,661][106151] Avg episode reward: [(0, '4311.554')] [2023-03-12 01:05:45,944][106434] Updated weights for policy 0, policy_version 149840 (0.0005) [2023-03-12 01:05:49,545][106434] Updated weights for policy 0, policy_version 149920 (0.0005) [2023-03-12 01:05:50,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11741.8, 300 sec: 11982.5). Total num frames: 76771328. Throughput: 0: 11567.1. Samples: 76739076. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:05:50,662][106151] Avg episode reward: [(0, '3715.265')] [2023-03-12 01:05:53,112][106434] Updated weights for policy 0, policy_version 150000 (0.0005) [2023-03-12 01:05:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11982.5). Total num frames: 76828672. Throughput: 0: 11534.7. Samples: 76808256. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:05:55,661][106151] Avg episode reward: [(0, '3905.011')] [2023-03-12 01:05:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000150056_76828672.pth... [2023-03-12 01:05:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000149384_76484608.pth [2023-03-12 01:05:56,615][106434] Updated weights for policy 0, policy_version 150080 (0.0005) [2023-03-12 01:06:00,211][106434] Updated weights for policy 0, policy_version 150160 (0.0005) [2023-03-12 01:06:00,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11968.6). Total num frames: 76886016. Throughput: 0: 11526.1. Samples: 76877836. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:06:00,661][106151] Avg episode reward: [(0, '3715.342')] [2023-03-12 01:06:03,680][106434] Updated weights for policy 0, policy_version 150240 (0.0005) [2023-03-12 01:06:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11940.9). Total num frames: 76943360. Throughput: 0: 11508.4. Samples: 76912172. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:06:05,661][106151] Avg episode reward: [(0, '4360.250')] [2023-03-12 01:06:07,248][106434] Updated weights for policy 0, policy_version 150320 (0.0005) [2023-03-12 01:06:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11927.0). Total num frames: 77000704. Throughput: 0: 11534.7. Samples: 76982420. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:06:10,661][106151] Avg episode reward: [(0, '4487.453')] [2023-03-12 01:06:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000150392_77000704.pth... [2023-03-12 01:06:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000149720_76656640.pth [2023-03-12 01:06:10,816][106434] Updated weights for policy 0, policy_version 150400 (0.0005) [2023-03-12 01:06:14,337][106434] Updated weights for policy 0, policy_version 150480 (0.0005) [2023-03-12 01:06:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11913.1). Total num frames: 77058048. Throughput: 0: 11530.1. Samples: 77051660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:06:15,661][106151] Avg episode reward: [(0, '4534.322')] [2023-03-12 01:06:15,662][106390] Saving new best policy, reward=4534.322! [2023-03-12 01:06:17,764][106434] Updated weights for policy 0, policy_version 150560 (0.0005) [2023-03-12 01:06:20,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11927.0). Total num frames: 77119488. Throughput: 0: 11567.7. Samples: 77087148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:06:20,661][106151] Avg episode reward: [(0, '4058.157')] [2023-03-12 01:06:21,321][106434] Updated weights for policy 0, policy_version 150640 (0.0005) [2023-03-12 01:06:24,883][106434] Updated weights for policy 0, policy_version 150720 (0.0005) [2023-03-12 01:06:25,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 11927.0). Total num frames: 77176832. Throughput: 0: 11559.8. Samples: 77156416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:06:25,662][106151] Avg episode reward: [(0, '4483.132')] [2023-03-12 01:06:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000150736_77176832.pth... [2023-03-12 01:06:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000150056_76828672.pth [2023-03-12 01:06:28,383][106434] Updated weights for policy 0, policy_version 150800 (0.0005) [2023-03-12 01:06:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11927.0). Total num frames: 77234176. Throughput: 0: 11569.5. Samples: 77226100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:06:30,661][106151] Avg episode reward: [(0, '4477.410')] [2023-03-12 01:06:31,947][106434] Updated weights for policy 0, policy_version 150880 (0.0005) [2023-03-12 01:06:35,475][106434] Updated weights for policy 0, policy_version 150960 (0.0005) [2023-03-12 01:06:35,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11927.0). Total num frames: 77291520. Throughput: 0: 11588.8. Samples: 77260572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:06:35,661][106151] Avg episode reward: [(0, '4479.783')] [2023-03-12 01:06:38,988][106434] Updated weights for policy 0, policy_version 151040 (0.0005) [2023-03-12 01:06:40,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11913.1). Total num frames: 77348864. Throughput: 0: 11610.3. Samples: 77330720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:06:40,661][106151] Avg episode reward: [(0, '4444.033')] [2023-03-12 01:06:40,663][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000151072_77348864.pth... [2023-03-12 01:06:40,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000150392_77000704.pth [2023-03-12 01:06:42,448][106434] Updated weights for policy 0, policy_version 151120 (0.0005) [2023-03-12 01:06:45,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11899.2). Total num frames: 77406208. Throughput: 0: 11628.2. Samples: 77401104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:06:45,662][106151] Avg episode reward: [(0, '4519.364')] [2023-03-12 01:06:46,049][106434] Updated weights for policy 0, policy_version 151200 (0.0005) [2023-03-12 01:06:49,601][106434] Updated weights for policy 0, policy_version 151280 (0.0005) [2023-03-12 01:06:50,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.4, 300 sec: 11899.2). Total num frames: 77467648. Throughput: 0: 11616.0. Samples: 77434892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:06:50,661][106151] Avg episode reward: [(0, '4397.796')] [2023-03-12 01:06:53,040][106434] Updated weights for policy 0, policy_version 151360 (0.0005) [2023-03-12 01:06:55,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11899.2). Total num frames: 77524992. Throughput: 0: 11631.7. Samples: 77505848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:06:55,661][106151] Avg episode reward: [(0, '4221.109')] [2023-03-12 01:06:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000151416_77524992.pth... [2023-03-12 01:06:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000150736_77176832.pth [2023-03-12 01:06:56,559][106434] Updated weights for policy 0, policy_version 151440 (0.0005) [2023-03-12 01:07:00,031][106434] Updated weights for policy 0, policy_version 151520 (0.0005) [2023-03-12 01:07:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.4, 300 sec: 11899.2). Total num frames: 77582336. Throughput: 0: 11639.8. Samples: 77575448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:07:00,661][106151] Avg episode reward: [(0, '4436.300')] [2023-03-12 01:07:03,448][106434] Updated weights for policy 0, policy_version 151600 (0.0005) [2023-03-12 01:07:05,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11899.2). Total num frames: 77643776. Throughput: 0: 11652.2. Samples: 77611496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:07:05,661][106151] Avg episode reward: [(0, '4196.898')] [2023-03-12 01:07:06,932][106434] Updated weights for policy 0, policy_version 151680 (0.0005) [2023-03-12 01:07:10,424][106434] Updated weights for policy 0, policy_version 151760 (0.0005) [2023-03-12 01:07:10,661][106151] Fps is (10 sec: 11878.2, 60 sec: 11673.6, 300 sec: 11899.2). Total num frames: 77701120. Throughput: 0: 11704.4. Samples: 77683112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:07:10,661][106151] Avg episode reward: [(0, '4432.038')] [2023-03-12 01:07:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000151760_77701120.pth... [2023-03-12 01:07:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000151072_77348864.pth [2023-03-12 01:07:14,080][106434] Updated weights for policy 0, policy_version 151840 (0.0005) [2023-03-12 01:07:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11899.2). Total num frames: 77758464. Throughput: 0: 11649.9. Samples: 77750344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:07:15,661][106151] Avg episode reward: [(0, '4381.398')] [2023-03-12 01:07:17,530][106434] Updated weights for policy 0, policy_version 151920 (0.0005) [2023-03-12 01:07:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11885.3). Total num frames: 77815808. Throughput: 0: 11697.7. Samples: 77786968. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:07:20,661][106151] Avg episode reward: [(0, '4335.975')] [2023-03-12 01:07:21,115][106434] Updated weights for policy 0, policy_version 152000 (0.0005) [2023-03-12 01:07:24,585][106434] Updated weights for policy 0, policy_version 152080 (0.0005) [2023-03-12 01:07:25,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.4, 300 sec: 11857.6). Total num frames: 77873152. Throughput: 0: 11678.9. Samples: 77856272. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:07:25,661][106151] Avg episode reward: [(0, '4440.622')] [2023-03-12 01:07:25,679][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000152104_77877248.pth... [2023-03-12 01:07:25,680][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000151416_77524992.pth [2023-03-12 01:07:28,164][106434] Updated weights for policy 0, policy_version 152160 (0.0005) [2023-03-12 01:07:30,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11843.7). Total num frames: 77930496. Throughput: 0: 11651.0. Samples: 77925396. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:07:30,661][106151] Avg episode reward: [(0, '4385.131')] [2023-03-12 01:07:31,758][106434] Updated weights for policy 0, policy_version 152240 (0.0005) [2023-03-12 01:07:35,345][106434] Updated weights for policy 0, policy_version 152320 (0.0005) [2023-03-12 01:07:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11829.8). Total num frames: 77987840. Throughput: 0: 11652.0. Samples: 77959232. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:07:35,661][106151] Avg episode reward: [(0, '4422.796')] [2023-03-12 01:07:38,893][106434] Updated weights for policy 0, policy_version 152400 (0.0005) [2023-03-12 01:07:40,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11815.9). Total num frames: 78045184. Throughput: 0: 11610.7. Samples: 78028328. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:07:40,661][106151] Avg episode reward: [(0, '4419.781')] [2023-03-12 01:07:40,671][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000152440_78049280.pth... [2023-03-12 01:07:40,673][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000151760_77701120.pth [2023-03-12 01:07:42,404][106434] Updated weights for policy 0, policy_version 152480 (0.0005) [2023-03-12 01:07:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.4, 300 sec: 11802.0). Total num frames: 78102528. Throughput: 0: 11596.4. Samples: 78097284. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:07:45,661][106151] Avg episode reward: [(0, '4335.478')] [2023-03-12 01:07:46,039][106434] Updated weights for policy 0, policy_version 152560 (0.0005) [2023-03-12 01:07:49,720][106434] Updated weights for policy 0, policy_version 152640 (0.0005) [2023-03-12 01:07:50,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11788.2). Total num frames: 78159872. Throughput: 0: 11549.2. Samples: 78131208. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:07:50,661][106151] Avg episode reward: [(0, '4491.462')] [2023-03-12 01:07:53,289][106434] Updated weights for policy 0, policy_version 152720 (0.0005) [2023-03-12 01:07:55,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11788.2). Total num frames: 78217216. Throughput: 0: 11460.7. Samples: 78198844. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:07:55,661][106151] Avg episode reward: [(0, '4491.793')] [2023-03-12 01:07:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000152768_78217216.pth... [2023-03-12 01:07:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000152104_77877248.pth [2023-03-12 01:07:56,817][106434] Updated weights for policy 0, policy_version 152800 (0.0005) [2023-03-12 01:08:00,375][106434] Updated weights for policy 0, policy_version 152880 (0.0005) [2023-03-12 01:08:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11788.2). Total num frames: 78274560. Throughput: 0: 11515.9. Samples: 78268560. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:08:00,661][106151] Avg episode reward: [(0, '4445.944')] [2023-03-12 01:08:04,021][106434] Updated weights for policy 0, policy_version 152960 (0.0005) [2023-03-12 01:08:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11774.3). Total num frames: 78331904. Throughput: 0: 11451.3. Samples: 78302276. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:08:05,661][106151] Avg episode reward: [(0, '4384.862')] [2023-03-12 01:08:07,491][106434] Updated weights for policy 0, policy_version 153040 (0.0005) [2023-03-12 01:08:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11760.4). Total num frames: 78389248. Throughput: 0: 11462.7. Samples: 78372092. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:08:10,661][106151] Avg episode reward: [(0, '4489.211')] [2023-03-12 01:08:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000153104_78389248.pth... [2023-03-12 01:08:10,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000152440_78049280.pth [2023-03-12 01:08:11,063][106434] Updated weights for policy 0, policy_version 153120 (0.0005) [2023-03-12 01:08:14,210][106434] Updated weights for policy 0, policy_version 153200 (0.0003) [2023-03-12 01:08:15,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11605.3, 300 sec: 11774.3). Total num frames: 78454784. Throughput: 0: 11572.9. Samples: 78446176. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:08:15,661][106151] Avg episode reward: [(0, '4434.104')] [2023-03-12 01:08:17,467][106434] Updated weights for policy 0, policy_version 153280 (0.0004) [2023-03-12 01:08:20,659][106434] Updated weights for policy 0, policy_version 153360 (0.0004) [2023-03-12 01:08:20,661][106151] Fps is (10 sec: 13107.2, 60 sec: 11741.9, 300 sec: 11802.0). Total num frames: 78520320. Throughput: 0: 11655.2. Samples: 78483716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:08:20,661][106151] Avg episode reward: [(0, '4478.897')] [2023-03-12 01:08:23,892][106434] Updated weights for policy 0, policy_version 153440 (0.0004) [2023-03-12 01:08:25,661][106151] Fps is (10 sec: 12697.5, 60 sec: 11810.1, 300 sec: 11802.0). Total num frames: 78581760. Throughput: 0: 11822.4. Samples: 78560336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:08:25,661][106151] Avg episode reward: [(0, '4480.465')] [2023-03-12 01:08:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000153480_78581760.pth... [2023-03-12 01:08:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000152768_78217216.pth [2023-03-12 01:08:27,114][106434] Updated weights for policy 0, policy_version 153520 (0.0004) [2023-03-12 01:08:30,275][106434] Updated weights for policy 0, policy_version 153600 (0.0003) [2023-03-12 01:08:30,661][106151] Fps is (10 sec: 12697.5, 60 sec: 11946.6, 300 sec: 11815.9). Total num frames: 78647296. Throughput: 0: 12010.6. Samples: 78637764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:08:30,661][106151] Avg episode reward: [(0, '4352.918')] [2023-03-12 01:08:33,495][106434] Updated weights for policy 0, policy_version 153680 (0.0004) [2023-03-12 01:08:35,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11815.9). Total num frames: 78708736. Throughput: 0: 12101.6. Samples: 78675780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:08:35,661][106151] Avg episode reward: [(0, '4525.343')] [2023-03-12 01:08:36,776][106434] Updated weights for policy 0, policy_version 153760 (0.0004) [2023-03-12 01:08:40,005][106434] Updated weights for policy 0, policy_version 153840 (0.0004) [2023-03-12 01:08:40,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 11829.8). Total num frames: 78774272. Throughput: 0: 12270.4. Samples: 78751012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:08:40,661][106151] Avg episode reward: [(0, '4525.398')] [2023-03-12 01:08:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000153856_78774272.pth... [2023-03-12 01:08:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000153104_78389248.pth [2023-03-12 01:08:43,360][106434] Updated weights for policy 0, policy_version 153920 (0.0004) [2023-03-12 01:08:45,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 11815.9). Total num frames: 78831616. Throughput: 0: 12331.7. Samples: 78823488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:08:45,661][106151] Avg episode reward: [(0, '4477.599')] [2023-03-12 01:08:46,925][106434] Updated weights for policy 0, policy_version 154000 (0.0005) [2023-03-12 01:08:50,452][106434] Updated weights for policy 0, policy_version 154080 (0.0005) [2023-03-12 01:08:50,661][106151] Fps is (10 sec: 11468.9, 60 sec: 12151.5, 300 sec: 11788.2). Total num frames: 78888960. Throughput: 0: 12356.4. Samples: 78858312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:08:50,661][106151] Avg episode reward: [(0, '4532.032')] [2023-03-12 01:08:54,099][106434] Updated weights for policy 0, policy_version 154160 (0.0005) [2023-03-12 01:08:55,661][106151] Fps is (10 sec: 11468.7, 60 sec: 12151.5, 300 sec: 11788.1). Total num frames: 78946304. Throughput: 0: 12324.9. Samples: 78926712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:08:55,661][106151] Avg episode reward: [(0, '4476.695')] [2023-03-12 01:08:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000154192_78946304.pth... [2023-03-12 01:08:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000153480_78581760.pth [2023-03-12 01:08:57,609][106434] Updated weights for policy 0, policy_version 154240 (0.0005) [2023-03-12 01:09:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 11760.4). Total num frames: 79003648. Throughput: 0: 12224.4. Samples: 78996276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:09:00,661][106151] Avg episode reward: [(0, '4479.422')] [2023-03-12 01:09:01,121][106434] Updated weights for policy 0, policy_version 154320 (0.0005) [2023-03-12 01:09:04,714][106434] Updated weights for policy 0, policy_version 154400 (0.0005) [2023-03-12 01:09:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 12151.5, 300 sec: 11746.5). Total num frames: 79060992. Throughput: 0: 12191.2. Samples: 79032320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:09:05,661][106151] Avg episode reward: [(0, '4487.823')] [2023-03-12 01:09:08,244][106434] Updated weights for policy 0, policy_version 154480 (0.0005) [2023-03-12 01:09:10,661][106151] Fps is (10 sec: 11468.7, 60 sec: 12151.5, 300 sec: 11746.5). Total num frames: 79118336. Throughput: 0: 12006.0. Samples: 79100604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:09:10,661][106151] Avg episode reward: [(0, '4422.319')] [2023-03-12 01:09:10,688][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000154536_79122432.pth... [2023-03-12 01:09:10,689][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000153856_78774272.pth [2023-03-12 01:09:11,775][106434] Updated weights for policy 0, policy_version 154560 (0.0005) [2023-03-12 01:09:14,971][106434] Updated weights for policy 0, policy_version 154640 (0.0004) [2023-03-12 01:09:15,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11760.4). Total num frames: 79183872. Throughput: 0: 11908.8. Samples: 79173660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:09:15,661][106151] Avg episode reward: [(0, '4440.423')] [2023-03-12 01:09:18,110][106434] Updated weights for policy 0, policy_version 154720 (0.0004) [2023-03-12 01:09:20,661][106151] Fps is (10 sec: 13107.3, 60 sec: 12151.5, 300 sec: 11802.0). Total num frames: 79249408. Throughput: 0: 11933.7. Samples: 79212796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:09:20,661][106151] Avg episode reward: [(0, '4529.742')] [2023-03-12 01:09:21,324][106434] Updated weights for policy 0, policy_version 154800 (0.0004) [2023-03-12 01:09:24,499][106434] Updated weights for policy 0, policy_version 154880 (0.0004) [2023-03-12 01:09:25,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12151.5, 300 sec: 11815.9). Total num frames: 79310848. Throughput: 0: 11985.7. Samples: 79290368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:09:25,661][106151] Avg episode reward: [(0, '4385.978')] [2023-03-12 01:09:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000154904_79310848.pth... [2023-03-12 01:09:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000154192_78946304.pth [2023-03-12 01:09:27,753][106434] Updated weights for policy 0, policy_version 154960 (0.0004) [2023-03-12 01:09:30,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 11829.8). Total num frames: 79376384. Throughput: 0: 12053.6. Samples: 79365900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:09:30,661][106151] Avg episode reward: [(0, '4533.309')] [2023-03-12 01:09:30,934][106434] Updated weights for policy 0, policy_version 155040 (0.0005) [2023-03-12 01:09:34,163][106434] Updated weights for policy 0, policy_version 155120 (0.0004) [2023-03-12 01:09:35,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12151.5, 300 sec: 11829.8). Total num frames: 79437824. Throughput: 0: 12133.5. Samples: 79404320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:09:35,661][106151] Avg episode reward: [(0, '4516.392')] [2023-03-12 01:09:37,365][106434] Updated weights for policy 0, policy_version 155200 (0.0004) [2023-03-12 01:09:40,572][106434] Updated weights for policy 0, policy_version 155280 (0.0004) [2023-03-12 01:09:40,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12151.5, 300 sec: 11857.6). Total num frames: 79503360. Throughput: 0: 12312.1. Samples: 79480756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:09:40,661][106151] Avg episode reward: [(0, '4528.009')] [2023-03-12 01:09:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000155280_79503360.pth... [2023-03-12 01:09:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000154536_79122432.pth [2023-03-12 01:09:43,872][106434] Updated weights for policy 0, policy_version 155360 (0.0005) [2023-03-12 01:09:45,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 11857.6). Total num frames: 79564800. Throughput: 0: 12453.2. Samples: 79556672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:09:45,661][106151] Avg episode reward: [(0, '4529.831')] [2023-03-12 01:09:47,235][106434] Updated weights for policy 0, policy_version 155440 (0.0005) [2023-03-12 01:09:50,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12219.7, 300 sec: 11829.8). Total num frames: 79622144. Throughput: 0: 12450.0. Samples: 79592572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:09:50,661][106151] Avg episode reward: [(0, '4536.660')] [2023-03-12 01:09:50,662][106390] Saving new best policy, reward=4536.660! [2023-03-12 01:09:50,715][106434] Updated weights for policy 0, policy_version 155520 (0.0005) [2023-03-12 01:09:53,933][106434] Updated weights for policy 0, policy_version 155600 (0.0004) [2023-03-12 01:09:55,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 11857.6). Total num frames: 79687680. Throughput: 0: 12564.9. Samples: 79666024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:09:55,661][106151] Avg episode reward: [(0, '4402.813')] [2023-03-12 01:09:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000155640_79687680.pth... [2023-03-12 01:09:55,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000154904_79310848.pth [2023-03-12 01:09:57,211][106434] Updated weights for policy 0, policy_version 155680 (0.0005) [2023-03-12 01:10:00,421][106434] Updated weights for policy 0, policy_version 155760 (0.0004) [2023-03-12 01:10:00,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12424.5, 300 sec: 11857.6). Total num frames: 79749120. Throughput: 0: 12607.5. Samples: 79741000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:10:00,661][106151] Avg episode reward: [(0, '4489.144')] [2023-03-12 01:10:03,673][106434] Updated weights for policy 0, policy_version 155840 (0.0005) [2023-03-12 01:10:05,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 11885.3). Total num frames: 79814656. Throughput: 0: 12589.3. Samples: 79779316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:10:05,661][106151] Avg episode reward: [(0, '4531.629')] [2023-03-12 01:10:06,975][106434] Updated weights for policy 0, policy_version 155920 (0.0005) [2023-03-12 01:10:10,146][106434] Updated weights for policy 0, policy_version 156000 (0.0005) [2023-03-12 01:10:10,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12629.3, 300 sec: 11899.2). Total num frames: 79876096. Throughput: 0: 12550.7. Samples: 79855152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:10:10,661][106151] Avg episode reward: [(0, '4533.762')] [2023-03-12 01:10:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000156008_79876096.pth... [2023-03-12 01:10:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000155280_79503360.pth [2023-03-12 01:10:13,362][106434] Updated weights for policy 0, policy_version 156080 (0.0004) [2023-03-12 01:10:15,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 11927.0). Total num frames: 79941632. Throughput: 0: 12573.2. Samples: 79931696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:10:15,661][106151] Avg episode reward: [(0, '4526.716')] [2023-03-12 01:10:16,558][106434] Updated weights for policy 0, policy_version 156160 (0.0004) [2023-03-12 01:10:19,774][106434] Updated weights for policy 0, policy_version 156240 (0.0004) [2023-03-12 01:10:20,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 11940.9). Total num frames: 80003072. Throughput: 0: 12577.4. Samples: 79970304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:10:20,661][106151] Avg episode reward: [(0, '4487.809')] [2023-03-12 01:10:22,981][106434] Updated weights for policy 0, policy_version 156320 (0.0004) [2023-03-12 01:10:25,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 11954.8). Total num frames: 80068608. Throughput: 0: 12575.4. Samples: 80046648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:10:25,661][106151] Avg episode reward: [(0, '4479.717')] [2023-03-12 01:10:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000156384_80068608.pth... [2023-03-12 01:10:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000155640_79687680.pth [2023-03-12 01:10:26,193][106434] Updated weights for policy 0, policy_version 156400 (0.0003) [2023-03-12 01:10:29,621][106434] Updated weights for policy 0, policy_version 156480 (0.0004) [2023-03-12 01:10:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 11954.8). Total num frames: 80125952. Throughput: 0: 12524.2. Samples: 80120264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:10:30,661][106151] Avg episode reward: [(0, '4528.523')] [2023-03-12 01:10:33,146][106434] Updated weights for policy 0, policy_version 156560 (0.0005) [2023-03-12 01:10:35,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12492.8, 300 sec: 11968.7). Total num frames: 80187392. Throughput: 0: 12491.5. Samples: 80154688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:10:35,661][106151] Avg episode reward: [(0, '4440.925')] [2023-03-12 01:10:36,454][106434] Updated weights for policy 0, policy_version 156640 (0.0004) [2023-03-12 01:10:39,704][106434] Updated weights for policy 0, policy_version 156720 (0.0004) [2023-03-12 01:10:40,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 11982.5). Total num frames: 80248832. Throughput: 0: 12513.9. Samples: 80229152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:10:40,661][106151] Avg episode reward: [(0, '4428.816')] [2023-03-12 01:10:40,669][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000156744_80252928.pth... [2023-03-12 01:10:40,671][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000156008_79876096.pth [2023-03-12 01:10:42,938][106434] Updated weights for policy 0, policy_version 156800 (0.0004) [2023-03-12 01:10:45,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12492.8, 300 sec: 12010.3). Total num frames: 80314368. Throughput: 0: 12551.2. Samples: 80305804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:10:45,661][106151] Avg episode reward: [(0, '4477.730')] [2023-03-12 01:10:46,199][106434] Updated weights for policy 0, policy_version 156880 (0.0004) [2023-03-12 01:10:49,382][106434] Updated weights for policy 0, policy_version 156960 (0.0004) [2023-03-12 01:10:50,661][106151] Fps is (10 sec: 13107.3, 60 sec: 12629.3, 300 sec: 12038.1). Total num frames: 80379904. Throughput: 0: 12528.6. Samples: 80343104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:10:50,661][106151] Avg episode reward: [(0, '4299.671')] [2023-03-12 01:10:52,635][106434] Updated weights for policy 0, policy_version 157040 (0.0005) [2023-03-12 01:10:55,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12561.0, 300 sec: 12052.0). Total num frames: 80441344. Throughput: 0: 12538.4. Samples: 80419380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:10:55,661][106151] Avg episode reward: [(0, '4390.426')] [2023-03-12 01:10:55,666][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000157112_80441344.pth... [2023-03-12 01:10:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000156384_80068608.pth [2023-03-12 01:10:55,891][106434] Updated weights for policy 0, policy_version 157120 (0.0004) [2023-03-12 01:10:59,464][106434] Updated weights for policy 0, policy_version 157200 (0.0005) [2023-03-12 01:11:00,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12492.8, 300 sec: 12052.0). Total num frames: 80498688. Throughput: 0: 12419.4. Samples: 80490568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:11:00,661][106151] Avg episode reward: [(0, '4342.526')] [2023-03-12 01:11:02,999][106434] Updated weights for policy 0, policy_version 157280 (0.0005) [2023-03-12 01:11:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 12356.3, 300 sec: 12052.0). Total num frames: 80556032. Throughput: 0: 12320.7. Samples: 80524736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:11:05,661][106151] Avg episode reward: [(0, '4525.608')] [2023-03-12 01:11:06,317][106434] Updated weights for policy 0, policy_version 157360 (0.0005) [2023-03-12 01:11:09,605][106434] Updated weights for policy 0, policy_version 157440 (0.0004) [2023-03-12 01:11:10,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 12079.7). Total num frames: 80621568. Throughput: 0: 12281.1. Samples: 80599300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:11:10,662][106151] Avg episode reward: [(0, '4480.049')] [2023-03-12 01:11:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000157464_80621568.pth... [2023-03-12 01:11:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000156744_80252928.pth [2023-03-12 01:11:12,879][106434] Updated weights for policy 0, policy_version 157520 (0.0004) [2023-03-12 01:11:15,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12356.3, 300 sec: 12079.7). Total num frames: 80683008. Throughput: 0: 12324.8. Samples: 80674880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:11:15,661][106151] Avg episode reward: [(0, '4507.703')] [2023-03-12 01:11:16,108][106434] Updated weights for policy 0, policy_version 157600 (0.0004) [2023-03-12 01:11:19,387][106434] Updated weights for policy 0, policy_version 157680 (0.0004) [2023-03-12 01:11:20,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12093.6). Total num frames: 80744448. Throughput: 0: 12390.2. Samples: 80712248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:11:20,661][106151] Avg episode reward: [(0, '4387.555')] [2023-03-12 01:11:22,662][106434] Updated weights for policy 0, policy_version 157760 (0.0005) [2023-03-12 01:11:25,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 12107.5). Total num frames: 80805888. Throughput: 0: 12409.8. Samples: 80787592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:11:25,662][106151] Avg episode reward: [(0, '4202.031')] [2023-03-12 01:11:25,666][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000157832_80809984.pth... [2023-03-12 01:11:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000157112_80441344.pth [2023-03-12 01:11:25,983][106434] Updated weights for policy 0, policy_version 157840 (0.0005) [2023-03-12 01:11:29,319][106434] Updated weights for policy 0, policy_version 157920 (0.0005) [2023-03-12 01:11:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12121.4). Total num frames: 80867328. Throughput: 0: 12329.3. Samples: 80860624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:11:30,661][106151] Avg episode reward: [(0, '4516.831')] [2023-03-12 01:11:32,619][106434] Updated weights for policy 0, policy_version 158000 (0.0005) [2023-03-12 01:11:35,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12424.5, 300 sec: 12149.2). Total num frames: 80932864. Throughput: 0: 12347.6. Samples: 80898748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:11:35,661][106151] Avg episode reward: [(0, '4484.651')] [2023-03-12 01:11:35,946][106434] Updated weights for policy 0, policy_version 158080 (0.0005) [2023-03-12 01:11:39,203][106434] Updated weights for policy 0, policy_version 158160 (0.0004) [2023-03-12 01:11:40,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12424.5, 300 sec: 12163.0). Total num frames: 80994304. Throughput: 0: 12313.3. Samples: 80973480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:11:40,661][106151] Avg episode reward: [(0, '4524.099')] [2023-03-12 01:11:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000158192_80994304.pth... [2023-03-12 01:11:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000157464_80621568.pth [2023-03-12 01:11:42,520][106434] Updated weights for policy 0, policy_version 158240 (0.0005) [2023-03-12 01:11:45,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12288.0, 300 sec: 12149.2). Total num frames: 81051648. Throughput: 0: 12330.1. Samples: 81045420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:11:45,661][106151] Avg episode reward: [(0, '4440.806')] [2023-03-12 01:11:46,108][106434] Updated weights for policy 0, policy_version 158320 (0.0005) [2023-03-12 01:11:49,697][106434] Updated weights for policy 0, policy_version 158400 (0.0005) [2023-03-12 01:11:50,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12151.4, 300 sec: 12149.2). Total num frames: 81108992. Throughput: 0: 12335.7. Samples: 81079844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:11:50,661][106151] Avg episode reward: [(0, '4474.045')] [2023-03-12 01:11:53,313][106434] Updated weights for policy 0, policy_version 158480 (0.0005) [2023-03-12 01:11:55,661][106151] Fps is (10 sec: 11468.7, 60 sec: 12083.2, 300 sec: 12149.1). Total num frames: 81166336. Throughput: 0: 12181.8. Samples: 81147480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:11:55,661][106151] Avg episode reward: [(0, '4382.495')] [2023-03-12 01:11:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000158528_81166336.pth... [2023-03-12 01:11:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000157832_80809984.pth [2023-03-12 01:11:56,953][106434] Updated weights for policy 0, policy_version 158560 (0.0005) [2023-03-12 01:12:00,606][106434] Updated weights for policy 0, policy_version 158640 (0.0005) [2023-03-12 01:12:00,661][106151] Fps is (10 sec: 11468.9, 60 sec: 12083.2, 300 sec: 12135.3). Total num frames: 81223680. Throughput: 0: 12013.5. Samples: 81215488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:12:00,661][106151] Avg episode reward: [(0, '4348.516')] [2023-03-12 01:12:04,256][106434] Updated weights for policy 0, policy_version 158720 (0.0005) [2023-03-12 01:12:05,661][106151] Fps is (10 sec: 11059.3, 60 sec: 12014.9, 300 sec: 12121.4). Total num frames: 81276928. Throughput: 0: 11912.7. Samples: 81248320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:12:05,661][106151] Avg episode reward: [(0, '4473.280')] [2023-03-12 01:12:07,948][106434] Updated weights for policy 0, policy_version 158800 (0.0005) [2023-03-12 01:12:10,661][106151] Fps is (10 sec: 11059.1, 60 sec: 11878.4, 300 sec: 12121.4). Total num frames: 81334272. Throughput: 0: 11728.7. Samples: 81315384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:12:10,661][106151] Avg episode reward: [(0, '4263.130')] [2023-03-12 01:12:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000158856_81334272.pth... [2023-03-12 01:12:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000158192_80994304.pth [2023-03-12 01:12:11,541][106434] Updated weights for policy 0, policy_version 158880 (0.0005) [2023-03-12 01:12:14,931][106434] Updated weights for policy 0, policy_version 158960 (0.0005) [2023-03-12 01:12:15,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 12135.3). Total num frames: 81395712. Throughput: 0: 11681.4. Samples: 81386288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:12:15,661][106151] Avg episode reward: [(0, '4299.363')] [2023-03-12 01:12:18,222][106434] Updated weights for policy 0, policy_version 159040 (0.0005) [2023-03-12 01:12:20,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11878.4, 300 sec: 12149.2). Total num frames: 81457152. Throughput: 0: 11660.3. Samples: 81423464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:12:20,661][106151] Avg episode reward: [(0, '4384.490')] [2023-03-12 01:12:21,498][106434] Updated weights for policy 0, policy_version 159120 (0.0004) [2023-03-12 01:12:24,806][106434] Updated weights for policy 0, policy_version 159200 (0.0005) [2023-03-12 01:12:25,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 12163.0). Total num frames: 81518592. Throughput: 0: 11658.8. Samples: 81498128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:12:25,662][106151] Avg episode reward: [(0, '4030.776')] [2023-03-12 01:12:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000159216_81518592.pth... [2023-03-12 01:12:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000158528_81166336.pth [2023-03-12 01:12:28,292][106434] Updated weights for policy 0, policy_version 159280 (0.0005) [2023-03-12 01:12:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 12163.0). Total num frames: 81575936. Throughput: 0: 11628.5. Samples: 81568704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:12:30,661][106151] Avg episode reward: [(0, '4431.578')] [2023-03-12 01:12:31,836][106434] Updated weights for policy 0, policy_version 159360 (0.0005) [2023-03-12 01:12:35,388][106434] Updated weights for policy 0, policy_version 159440 (0.0005) [2023-03-12 01:12:35,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 12163.0). Total num frames: 81633280. Throughput: 0: 11647.9. Samples: 81604000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:12:35,661][106151] Avg episode reward: [(0, '4475.831')] [2023-03-12 01:12:38,909][106434] Updated weights for policy 0, policy_version 159520 (0.0005) [2023-03-12 01:12:40,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 12163.0). Total num frames: 81690624. Throughput: 0: 11698.4. Samples: 81673908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:12:40,661][106151] Avg episode reward: [(0, '4258.623')] [2023-03-12 01:12:40,667][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000159560_81694720.pth... [2023-03-12 01:12:40,669][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000158856_81334272.pth [2023-03-12 01:12:42,451][106434] Updated weights for policy 0, policy_version 159600 (0.0005) [2023-03-12 01:12:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12163.0). Total num frames: 81747968. Throughput: 0: 11718.8. Samples: 81742836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:12:45,661][106151] Avg episode reward: [(0, '4358.034')] [2023-03-12 01:12:46,059][106434] Updated weights for policy 0, policy_version 159680 (0.0005) [2023-03-12 01:12:49,671][106434] Updated weights for policy 0, policy_version 159760 (0.0005) [2023-03-12 01:12:50,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12163.0). Total num frames: 81805312. Throughput: 0: 11740.4. Samples: 81776640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:12:50,661][106151] Avg episode reward: [(0, '4398.479')] [2023-03-12 01:12:53,308][106434] Updated weights for policy 0, policy_version 159840 (0.0005) [2023-03-12 01:12:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12163.0). Total num frames: 81862656. Throughput: 0: 11747.1. Samples: 81844004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:12:55,661][106151] Avg episode reward: [(0, '4378.636')] [2023-03-12 01:12:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000159888_81862656.pth... [2023-03-12 01:12:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000159216_81518592.pth [2023-03-12 01:12:56,864][106434] Updated weights for policy 0, policy_version 159920 (0.0005) [2023-03-12 01:13:00,460][106434] Updated weights for policy 0, policy_version 160000 (0.0005) [2023-03-12 01:13:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12163.0). Total num frames: 81920000. Throughput: 0: 11693.1. Samples: 81912476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:13:00,661][106151] Avg episode reward: [(0, '4298.740')] [2023-03-12 01:13:04,012][106434] Updated weights for policy 0, policy_version 160080 (0.0005) [2023-03-12 01:13:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12163.0). Total num frames: 81977344. Throughput: 0: 11638.0. Samples: 81947176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:13:05,661][106151] Avg episode reward: [(0, '4471.128')] [2023-03-12 01:13:07,557][106434] Updated weights for policy 0, policy_version 160160 (0.0005) [2023-03-12 01:13:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12135.3). Total num frames: 82034688. Throughput: 0: 11507.7. Samples: 82015976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:13:10,661][106151] Avg episode reward: [(0, '4393.973')] [2023-03-12 01:13:10,700][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000160232_82038784.pth... [2023-03-12 01:13:10,702][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000159560_81694720.pth [2023-03-12 01:13:11,017][106434] Updated weights for policy 0, policy_version 160240 (0.0004) [2023-03-12 01:13:14,221][106434] Updated weights for policy 0, policy_version 160320 (0.0004) [2023-03-12 01:13:15,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 12135.3). Total num frames: 82100224. Throughput: 0: 11614.2. Samples: 82091344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:13:15,661][106151] Avg episode reward: [(0, '4395.585')] [2023-03-12 01:13:17,561][106434] Updated weights for policy 0, policy_version 160400 (0.0004) [2023-03-12 01:13:20,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11741.9, 300 sec: 12135.3). Total num frames: 82161664. Throughput: 0: 11649.0. Samples: 82128204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:13:20,661][106151] Avg episode reward: [(0, '4400.058')] [2023-03-12 01:13:20,869][106434] Updated weights for policy 0, policy_version 160480 (0.0004) [2023-03-12 01:13:24,305][106434] Updated weights for policy 0, policy_version 160560 (0.0005) [2023-03-12 01:13:25,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 12107.5). Total num frames: 82219008. Throughput: 0: 11718.3. Samples: 82201232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:13:25,661][106151] Avg episode reward: [(0, '4377.744')] [2023-03-12 01:13:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000160584_82219008.pth... [2023-03-12 01:13:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000159888_81862656.pth [2023-03-12 01:13:27,883][106434] Updated weights for policy 0, policy_version 160640 (0.0005) [2023-03-12 01:13:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12093.6). Total num frames: 82276352. Throughput: 0: 11707.4. Samples: 82269668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:13:30,662][106151] Avg episode reward: [(0, '4374.761')] [2023-03-12 01:13:31,540][106434] Updated weights for policy 0, policy_version 160720 (0.0005) [2023-03-12 01:13:35,013][106434] Updated weights for policy 0, policy_version 160800 (0.0004) [2023-03-12 01:13:35,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 12065.8). Total num frames: 82333696. Throughput: 0: 11712.6. Samples: 82303708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:13:35,661][106151] Avg episode reward: [(0, '4289.997')] [2023-03-12 01:13:38,565][106434] Updated weights for policy 0, policy_version 160880 (0.0004) [2023-03-12 01:13:40,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 12079.7). Total num frames: 82395136. Throughput: 0: 11774.8. Samples: 82373872. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:13:40,662][106151] Avg episode reward: [(0, '4308.037')] [2023-03-12 01:13:40,666][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000160928_82395136.pth... [2023-03-12 01:13:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000160232_82038784.pth [2023-03-12 01:13:41,890][106434] Updated weights for policy 0, policy_version 160960 (0.0004) [2023-03-12 01:13:45,190][106434] Updated weights for policy 0, policy_version 161040 (0.0005) [2023-03-12 01:13:45,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11810.1, 300 sec: 12093.6). Total num frames: 82456576. Throughput: 0: 11903.3. Samples: 82448124. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:13:45,661][106151] Avg episode reward: [(0, '4326.616')] [2023-03-12 01:13:48,490][106434] Updated weights for policy 0, policy_version 161120 (0.0004) [2023-03-12 01:13:50,661][106151] Fps is (10 sec: 12288.2, 60 sec: 11878.4, 300 sec: 12107.5). Total num frames: 82518016. Throughput: 0: 11958.6. Samples: 82485312. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:13:50,661][106151] Avg episode reward: [(0, '4289.766')] [2023-03-12 01:13:52,111][106434] Updated weights for policy 0, policy_version 161200 (0.0005) [2023-03-12 01:13:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 12093.6). Total num frames: 82571264. Throughput: 0: 11955.6. Samples: 82553976. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:13:55,662][106151] Avg episode reward: [(0, '4521.776')] [2023-03-12 01:13:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000161272_82571264.pth... [2023-03-12 01:13:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000160584_82219008.pth [2023-03-12 01:13:55,742][106434] Updated weights for policy 0, policy_version 161280 (0.0005) [2023-03-12 01:13:59,420][106434] Updated weights for policy 0, policy_version 161360 (0.0005) [2023-03-12 01:14:00,661][106151] Fps is (10 sec: 11059.0, 60 sec: 11810.1, 300 sec: 12093.6). Total num frames: 82628608. Throughput: 0: 11758.7. Samples: 82620488. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:14:00,662][106151] Avg episode reward: [(0, '4432.993')] [2023-03-12 01:14:03,045][106434] Updated weights for policy 0, policy_version 161440 (0.0006) [2023-03-12 01:14:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 12093.6). Total num frames: 82685952. Throughput: 0: 11699.5. Samples: 82654680. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:14:05,661][106151] Avg episode reward: [(0, '4475.605')] [2023-03-12 01:14:06,725][106434] Updated weights for policy 0, policy_version 161520 (0.0005) [2023-03-12 01:14:10,385][106434] Updated weights for policy 0, policy_version 161600 (0.0005) [2023-03-12 01:14:10,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11741.9, 300 sec: 12052.0). Total num frames: 82739200. Throughput: 0: 11571.6. Samples: 82721956. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:14:10,662][106151] Avg episode reward: [(0, '4440.925')] [2023-03-12 01:14:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000161600_82739200.pth... [2023-03-12 01:14:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000160928_82395136.pth [2023-03-12 01:14:13,965][106434] Updated weights for policy 0, policy_version 161680 (0.0005) [2023-03-12 01:14:15,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11605.3, 300 sec: 12024.2). Total num frames: 82796544. Throughput: 0: 11554.9. Samples: 82789636. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:14:15,661][106151] Avg episode reward: [(0, '4429.622')] [2023-03-12 01:14:17,617][106434] Updated weights for policy 0, policy_version 161760 (0.0005) [2023-03-12 01:14:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 12010.3). Total num frames: 82853888. Throughput: 0: 11553.9. Samples: 82823632. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:14:20,661][106151] Avg episode reward: [(0, '4328.523')] [2023-03-12 01:14:21,249][106434] Updated weights for policy 0, policy_version 161840 (0.0005) [2023-03-12 01:14:24,820][106434] Updated weights for policy 0, policy_version 161920 (0.0005) [2023-03-12 01:14:25,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11982.5). Total num frames: 82911232. Throughput: 0: 11501.2. Samples: 82891428. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:14:25,662][106151] Avg episode reward: [(0, '4428.616')] [2023-03-12 01:14:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000161936_82911232.pth... [2023-03-12 01:14:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000161272_82571264.pth [2023-03-12 01:14:28,398][106434] Updated weights for policy 0, policy_version 162000 (0.0005) [2023-03-12 01:14:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11968.6). Total num frames: 82968576. Throughput: 0: 11383.6. Samples: 82960384. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:14:30,661][106151] Avg episode reward: [(0, '4440.660')] [2023-03-12 01:14:32,079][106434] Updated weights for policy 0, policy_version 162080 (0.0005) [2023-03-12 01:14:35,661][106151] Fps is (10 sec: 11059.3, 60 sec: 11468.8, 300 sec: 11927.0). Total num frames: 83021824. Throughput: 0: 11292.7. Samples: 82993484. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:14:35,661][106151] Avg episode reward: [(0, '4395.956')] [2023-03-12 01:14:35,717][106434] Updated weights for policy 0, policy_version 162160 (0.0005) [2023-03-12 01:14:39,275][106434] Updated weights for policy 0, policy_version 162240 (0.0006) [2023-03-12 01:14:40,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11400.5, 300 sec: 11913.1). Total num frames: 83079168. Throughput: 0: 11291.9. Samples: 83062112. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-12 01:14:40,661][106151] Avg episode reward: [(0, '4390.597')] [2023-03-12 01:14:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000162264_83079168.pth... [2023-03-12 01:14:40,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000161600_82739200.pth [2023-03-12 01:14:42,916][106434] Updated weights for policy 0, policy_version 162320 (0.0005) [2023-03-12 01:14:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11913.1). Total num frames: 83136512. Throughput: 0: 11307.8. Samples: 83129336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:14:45,661][106151] Avg episode reward: [(0, '4278.075')] [2023-03-12 01:14:46,515][106434] Updated weights for policy 0, policy_version 162400 (0.0005) [2023-03-12 01:14:50,056][106434] Updated weights for policy 0, policy_version 162480 (0.0005) [2023-03-12 01:14:50,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11885.3). Total num frames: 83193856. Throughput: 0: 11316.5. Samples: 83163924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:14:50,661][106151] Avg episode reward: [(0, '4337.947')] [2023-03-12 01:14:53,637][106434] Updated weights for policy 0, policy_version 162560 (0.0006) [2023-03-12 01:14:55,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11332.3, 300 sec: 11871.5). Total num frames: 83251200. Throughput: 0: 11356.6. Samples: 83233004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:14:55,662][106151] Avg episode reward: [(0, '4328.872')] [2023-03-12 01:14:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000162600_83251200.pth... [2023-03-12 01:14:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000161936_82911232.pth [2023-03-12 01:14:57,186][106434] Updated weights for policy 0, policy_version 162640 (0.0005) [2023-03-12 01:15:00,605][106434] Updated weights for policy 0, policy_version 162720 (0.0003) [2023-03-12 01:15:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11400.5, 300 sec: 11857.6). Total num frames: 83312640. Throughput: 0: 11420.3. Samples: 83303548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:15:00,661][106151] Avg episode reward: [(0, '4249.833')] [2023-03-12 01:15:03,883][106434] Updated weights for policy 0, policy_version 162800 (0.0003) [2023-03-12 01:15:05,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11468.8, 300 sec: 11857.6). Total num frames: 83374080. Throughput: 0: 11504.3. Samples: 83341324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:15:05,672][106151] Avg episode reward: [(0, '4083.615')] [2023-03-12 01:15:07,068][106434] Updated weights for policy 0, policy_version 162880 (0.0003) [2023-03-12 01:15:10,556][106434] Updated weights for policy 0, policy_version 162960 (0.0004) [2023-03-12 01:15:10,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11605.3, 300 sec: 11843.7). Total num frames: 83435520. Throughput: 0: 11643.9. Samples: 83415404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:15:10,662][106151] Avg episode reward: [(0, '4388.821')] [2023-03-12 01:15:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000162960_83435520.pth... [2023-03-12 01:15:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000162264_83079168.pth [2023-03-12 01:15:13,775][106434] Updated weights for policy 0, policy_version 163040 (0.0005) [2023-03-12 01:15:15,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11673.6, 300 sec: 11843.7). Total num frames: 83496960. Throughput: 0: 11767.9. Samples: 83489940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:15:15,672][106151] Avg episode reward: [(0, '4300.207')] [2023-03-12 01:15:17,002][106434] Updated weights for policy 0, policy_version 163120 (0.0005) [2023-03-12 01:15:20,317][106434] Updated weights for policy 0, policy_version 163200 (0.0005) [2023-03-12 01:15:20,661][106151] Fps is (10 sec: 12697.7, 60 sec: 11810.1, 300 sec: 11843.7). Total num frames: 83562496. Throughput: 0: 11862.4. Samples: 83527292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:15:20,672][106151] Avg episode reward: [(0, '4210.018')] [2023-03-12 01:15:23,606][106434] Updated weights for policy 0, policy_version 163280 (0.0004) [2023-03-12 01:15:25,661][106151] Fps is (10 sec: 12697.4, 60 sec: 11878.4, 300 sec: 11857.6). Total num frames: 83623936. Throughput: 0: 11999.5. Samples: 83602092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:15:25,662][106151] Avg episode reward: [(0, '4327.926')] [2023-03-12 01:15:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000163328_83623936.pth... [2023-03-12 01:15:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000162600_83251200.pth [2023-03-12 01:15:26,892][106434] Updated weights for policy 0, policy_version 163360 (0.0005) [2023-03-12 01:15:30,171][106434] Updated weights for policy 0, policy_version 163440 (0.0005) [2023-03-12 01:15:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11857.6). Total num frames: 83685376. Throughput: 0: 12174.3. Samples: 83677180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:15:30,672][106151] Avg episode reward: [(0, '4106.038')] [2023-03-12 01:15:33,406][106434] Updated weights for policy 0, policy_version 163520 (0.0004) [2023-03-12 01:15:35,661][106151] Fps is (10 sec: 12288.2, 60 sec: 12083.2, 300 sec: 11857.6). Total num frames: 83746816. Throughput: 0: 12238.1. Samples: 83714636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:15:35,672][106151] Avg episode reward: [(0, '4213.083')] [2023-03-12 01:15:36,630][106434] Updated weights for policy 0, policy_version 163600 (0.0004) [2023-03-12 01:15:39,907][106434] Updated weights for policy 0, policy_version 163680 (0.0005) [2023-03-12 01:15:40,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12219.7, 300 sec: 11857.6). Total num frames: 83812352. Throughput: 0: 12397.7. Samples: 83790900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:15:40,661][106151] Avg episode reward: [(0, '4278.595')] [2023-03-12 01:15:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000163696_83812352.pth... [2023-03-12 01:15:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000162960_83435520.pth [2023-03-12 01:15:43,208][106434] Updated weights for policy 0, policy_version 163760 (0.0005) [2023-03-12 01:15:45,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12288.0, 300 sec: 11843.7). Total num frames: 83873792. Throughput: 0: 12489.3. Samples: 83865568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:15:45,661][106151] Avg episode reward: [(0, '4279.419')] [2023-03-12 01:15:46,418][106434] Updated weights for policy 0, policy_version 163840 (0.0004) [2023-03-12 01:15:49,691][106434] Updated weights for policy 0, policy_version 163920 (0.0005) [2023-03-12 01:15:50,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 11843.7). Total num frames: 83935232. Throughput: 0: 12504.1. Samples: 83904008. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:15:50,661][106151] Avg episode reward: [(0, '4413.890')] [2023-03-12 01:15:52,937][106434] Updated weights for policy 0, policy_version 164000 (0.0005) [2023-03-12 01:15:55,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 11871.5). Total num frames: 84000768. Throughput: 0: 12537.4. Samples: 83979588. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:15:55,661][106151] Avg episode reward: [(0, '4420.874')] [2023-03-12 01:15:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000164064_84000768.pth... [2023-03-12 01:15:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000163328_83623936.pth [2023-03-12 01:15:56,112][106434] Updated weights for policy 0, policy_version 164080 (0.0004) [2023-03-12 01:15:59,356][106434] Updated weights for policy 0, policy_version 164160 (0.0004) [2023-03-12 01:16:00,661][106151] Fps is (10 sec: 13107.3, 60 sec: 12561.1, 300 sec: 11899.2). Total num frames: 84066304. Throughput: 0: 12571.2. Samples: 84055644. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:16:00,661][106151] Avg episode reward: [(0, '4432.026')] [2023-03-12 01:16:02,591][106434] Updated weights for policy 0, policy_version 164240 (0.0004) [2023-03-12 01:16:05,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 11885.3). Total num frames: 84127744. Throughput: 0: 12591.7. Samples: 84093920. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:16:05,661][106151] Avg episode reward: [(0, '4514.567')] [2023-03-12 01:16:05,859][106434] Updated weights for policy 0, policy_version 164320 (0.0004) [2023-03-12 01:16:09,125][106434] Updated weights for policy 0, policy_version 164400 (0.0005) [2023-03-12 01:16:10,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12561.1, 300 sec: 11885.3). Total num frames: 84189184. Throughput: 0: 12592.8. Samples: 84168768. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:16:10,662][106151] Avg episode reward: [(0, '4482.244')] [2023-03-12 01:16:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000164432_84189184.pth... [2023-03-12 01:16:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000163696_83812352.pth [2023-03-12 01:16:12,355][106434] Updated weights for policy 0, policy_version 164480 (0.0004) [2023-03-12 01:16:15,659][106434] Updated weights for policy 0, policy_version 164560 (0.0004) [2023-03-12 01:16:15,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 11899.2). Total num frames: 84254720. Throughput: 0: 12598.4. Samples: 84244108. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:16:15,661][106151] Avg episode reward: [(0, '4376.126')] [2023-03-12 01:16:18,908][106434] Updated weights for policy 0, policy_version 164640 (0.0004) [2023-03-12 01:16:20,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 11899.2). Total num frames: 84316160. Throughput: 0: 12602.7. Samples: 84281760. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:16:20,662][106151] Avg episode reward: [(0, '4381.924')] [2023-03-12 01:16:22,168][106434] Updated weights for policy 0, policy_version 164720 (0.0005) [2023-03-12 01:16:25,427][106434] Updated weights for policy 0, policy_version 164800 (0.0005) [2023-03-12 01:16:25,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 11899.2). Total num frames: 84377600. Throughput: 0: 12584.3. Samples: 84357192. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:16:25,661][106151] Avg episode reward: [(0, '4512.052')] [2023-03-12 01:16:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000164800_84377600.pth... [2023-03-12 01:16:25,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000164064_84000768.pth [2023-03-12 01:16:28,701][106434] Updated weights for policy 0, policy_version 164880 (0.0005) [2023-03-12 01:16:30,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 11899.2). Total num frames: 84443136. Throughput: 0: 12600.8. Samples: 84432604. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:16:30,661][106151] Avg episode reward: [(0, '4124.861')] [2023-03-12 01:16:31,895][106434] Updated weights for policy 0, policy_version 164960 (0.0004) [2023-03-12 01:16:35,172][106434] Updated weights for policy 0, policy_version 165040 (0.0005) [2023-03-12 01:16:35,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 11899.2). Total num frames: 84504576. Throughput: 0: 12615.3. Samples: 84471696. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:16:35,661][106151] Avg episode reward: [(0, '4420.829')] [2023-03-12 01:16:38,424][106434] Updated weights for policy 0, policy_version 165120 (0.0004) [2023-03-12 01:16:40,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 11913.1). Total num frames: 84566016. Throughput: 0: 12587.6. Samples: 84546032. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:16:40,661][106151] Avg episode reward: [(0, '4425.739')] [2023-03-12 01:16:40,684][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000165176_84570112.pth... [2023-03-12 01:16:40,685][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000164432_84189184.pth [2023-03-12 01:16:41,642][106434] Updated weights for policy 0, policy_version 165200 (0.0004) [2023-03-12 01:16:44,903][106434] Updated weights for policy 0, policy_version 165280 (0.0004) [2023-03-12 01:16:45,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 11940.9). Total num frames: 84631552. Throughput: 0: 12592.4. Samples: 84622304. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:16:45,661][106151] Avg episode reward: [(0, '4465.381')] [2023-03-12 01:16:48,095][106434] Updated weights for policy 0, policy_version 165360 (0.0004) [2023-03-12 01:16:50,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12629.3, 300 sec: 11954.8). Total num frames: 84692992. Throughput: 0: 12586.9. Samples: 84660332. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:16:50,661][106151] Avg episode reward: [(0, '4517.425')] [2023-03-12 01:16:51,293][106434] Updated weights for policy 0, policy_version 165440 (0.0004) [2023-03-12 01:16:54,632][106434] Updated weights for policy 0, policy_version 165520 (0.0005) [2023-03-12 01:16:55,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12629.3, 300 sec: 11982.5). Total num frames: 84758528. Throughput: 0: 12614.7. Samples: 84736428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:16:55,661][106151] Avg episode reward: [(0, '4517.355')] [2023-03-12 01:16:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000165544_84758528.pth... [2023-03-12 01:16:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000164800_84377600.pth [2023-03-12 01:16:57,824][106434] Updated weights for policy 0, policy_version 165600 (0.0004) [2023-03-12 01:17:00,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12010.3). Total num frames: 84819968. Throughput: 0: 12623.6. Samples: 84812172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:17:00,662][106151] Avg episode reward: [(0, '4502.037')] [2023-03-12 01:17:01,017][106434] Updated weights for policy 0, policy_version 165680 (0.0004) [2023-03-12 01:17:04,339][106434] Updated weights for policy 0, policy_version 165760 (0.0005) [2023-03-12 01:17:05,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12024.2). Total num frames: 84881408. Throughput: 0: 12647.9. Samples: 84850916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:17:05,661][106151] Avg episode reward: [(0, '4431.829')] [2023-03-12 01:17:07,697][106434] Updated weights for policy 0, policy_version 165840 (0.0005) [2023-03-12 01:17:10,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12038.1). Total num frames: 84946944. Throughput: 0: 12587.5. Samples: 84923628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:17:10,661][106151] Avg episode reward: [(0, '4463.461')] [2023-03-12 01:17:10,666][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000165912_84946944.pth... [2023-03-12 01:17:10,669][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000165176_84570112.pth [2023-03-12 01:17:10,976][106434] Updated weights for policy 0, policy_version 165920 (0.0004) [2023-03-12 01:17:14,293][106434] Updated weights for policy 0, policy_version 166000 (0.0005) [2023-03-12 01:17:15,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12038.1). Total num frames: 85008384. Throughput: 0: 12573.8. Samples: 84998424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:17:15,661][106151] Avg episode reward: [(0, '4411.716')] [2023-03-12 01:17:17,597][106434] Updated weights for policy 0, policy_version 166080 (0.0004) [2023-03-12 01:17:20,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12038.1). Total num frames: 85069824. Throughput: 0: 12536.2. Samples: 85035824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:17:20,661][106151] Avg episode reward: [(0, '4427.028')] [2023-03-12 01:17:20,981][106434] Updated weights for policy 0, policy_version 166160 (0.0005) [2023-03-12 01:17:24,299][106434] Updated weights for policy 0, policy_version 166240 (0.0004) [2023-03-12 01:17:25,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12052.0). Total num frames: 85131264. Throughput: 0: 12515.9. Samples: 85109248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:17:25,661][106151] Avg episode reward: [(0, '4460.659')] [2023-03-12 01:17:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000166272_85131264.pth... [2023-03-12 01:17:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000165544_84758528.pth [2023-03-12 01:17:27,582][106434] Updated weights for policy 0, policy_version 166320 (0.0004) [2023-03-12 01:17:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12065.8). Total num frames: 85192704. Throughput: 0: 12474.1. Samples: 85183640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:17:30,662][106151] Avg episode reward: [(0, '4473.172')] [2023-03-12 01:17:30,905][106434] Updated weights for policy 0, policy_version 166400 (0.0004) [2023-03-12 01:17:34,205][106434] Updated weights for policy 0, policy_version 166480 (0.0004) [2023-03-12 01:17:35,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12079.7). Total num frames: 85254144. Throughput: 0: 12448.9. Samples: 85220532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:17:35,661][106151] Avg episode reward: [(0, '4446.845')] [2023-03-12 01:17:37,563][106434] Updated weights for policy 0, policy_version 166560 (0.0005) [2023-03-12 01:17:40,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12093.6). Total num frames: 85315584. Throughput: 0: 12407.7. Samples: 85294776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:17:40,661][106151] Avg episode reward: [(0, '4475.976')] [2023-03-12 01:17:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000166632_85315584.pth... [2023-03-12 01:17:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000165912_84946944.pth [2023-03-12 01:17:40,783][106434] Updated weights for policy 0, policy_version 166640 (0.0004) [2023-03-12 01:17:44,108][106434] Updated weights for policy 0, policy_version 166720 (0.0005) [2023-03-12 01:17:45,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12107.5). Total num frames: 85377024. Throughput: 0: 12388.6. Samples: 85369660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:17:45,661][106151] Avg episode reward: [(0, '4510.446')] [2023-03-12 01:17:47,380][106434] Updated weights for policy 0, policy_version 166800 (0.0005) [2023-03-12 01:17:50,610][106434] Updated weights for policy 0, policy_version 166880 (0.0004) [2023-03-12 01:17:50,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12135.3). Total num frames: 85442560. Throughput: 0: 12364.4. Samples: 85407312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:17:50,662][106151] Avg episode reward: [(0, '4525.405')] [2023-03-12 01:17:53,955][106434] Updated weights for policy 0, policy_version 166960 (0.0005) [2023-03-12 01:17:55,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 12135.3). Total num frames: 85499904. Throughput: 0: 12415.9. Samples: 85482340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:17:55,661][106151] Avg episode reward: [(0, '4529.004')] [2023-03-12 01:17:55,673][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000167000_85504000.pth... [2023-03-12 01:17:55,675][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000166272_85131264.pth [2023-03-12 01:17:57,491][106434] Updated weights for policy 0, policy_version 167040 (0.0005) [2023-03-12 01:18:00,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12356.3, 300 sec: 12149.2). Total num frames: 85561344. Throughput: 0: 12295.9. Samples: 85551740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:18:00,661][106151] Avg episode reward: [(0, '4478.143')] [2023-03-12 01:18:00,948][106434] Updated weights for policy 0, policy_version 167120 (0.0005) [2023-03-12 01:18:04,400][106434] Updated weights for policy 0, policy_version 167200 (0.0005) [2023-03-12 01:18:05,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 12149.2). Total num frames: 85618688. Throughput: 0: 12251.7. Samples: 85587148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:18:05,661][106151] Avg episode reward: [(0, '4483.880')] [2023-03-12 01:18:07,807][106434] Updated weights for policy 0, policy_version 167280 (0.0004) [2023-03-12 01:18:10,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12219.7, 300 sec: 12135.3). Total num frames: 85680128. Throughput: 0: 12231.1. Samples: 85659648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:18:10,662][106151] Avg episode reward: [(0, '4516.177')] [2023-03-12 01:18:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000167344_85680128.pth... [2023-03-12 01:18:10,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000166632_85315584.pth [2023-03-12 01:18:11,401][106434] Updated weights for policy 0, policy_version 167360 (0.0005) [2023-03-12 01:18:14,756][106434] Updated weights for policy 0, policy_version 167440 (0.0004) [2023-03-12 01:18:15,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12151.5, 300 sec: 12121.4). Total num frames: 85737472. Throughput: 0: 12138.0. Samples: 85729848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:18:15,661][106151] Avg episode reward: [(0, '4520.094')] [2023-03-12 01:18:18,003][106434] Updated weights for policy 0, policy_version 167520 (0.0004) [2023-03-12 01:18:20,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12219.7, 300 sec: 12149.2). Total num frames: 85803008. Throughput: 0: 12165.2. Samples: 85767968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:18:20,661][106151] Avg episode reward: [(0, '4405.356')] [2023-03-12 01:18:21,282][106434] Updated weights for policy 0, policy_version 167600 (0.0004) [2023-03-12 01:18:24,508][106434] Updated weights for policy 0, policy_version 167680 (0.0004) [2023-03-12 01:18:25,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12219.7, 300 sec: 12163.0). Total num frames: 85864448. Throughput: 0: 12203.9. Samples: 85843952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:18:25,662][106151] Avg episode reward: [(0, '4448.888')] [2023-03-12 01:18:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000167704_85864448.pth... [2023-03-12 01:18:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000167000_85504000.pth [2023-03-12 01:18:27,780][106434] Updated weights for policy 0, policy_version 167760 (0.0004) [2023-03-12 01:18:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12176.9). Total num frames: 85925888. Throughput: 0: 12192.4. Samples: 85918320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:18:30,661][106151] Avg episode reward: [(0, '4365.007')] [2023-03-12 01:18:31,060][106434] Updated weights for policy 0, policy_version 167840 (0.0004) [2023-03-12 01:18:34,350][106434] Updated weights for policy 0, policy_version 167920 (0.0004) [2023-03-12 01:18:35,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12176.9). Total num frames: 85987328. Throughput: 0: 12204.5. Samples: 85956516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:18:35,662][106151] Avg episode reward: [(0, '4484.570')] [2023-03-12 01:18:37,614][106434] Updated weights for policy 0, policy_version 168000 (0.0005) [2023-03-12 01:18:40,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12288.0, 300 sec: 12190.8). Total num frames: 86052864. Throughput: 0: 12215.5. Samples: 86032040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:18:40,662][106151] Avg episode reward: [(0, '4484.681')] [2023-03-12 01:18:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000168072_86052864.pth... [2023-03-12 01:18:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000167344_85680128.pth [2023-03-12 01:18:40,802][106434] Updated weights for policy 0, policy_version 168080 (0.0004) [2023-03-12 01:18:43,973][106434] Updated weights for policy 0, policy_version 168160 (0.0003) [2023-03-12 01:18:45,661][106151] Fps is (10 sec: 13107.2, 60 sec: 12356.3, 300 sec: 12204.7). Total num frames: 86118400. Throughput: 0: 12366.6. Samples: 86108236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:18:45,661][106151] Avg episode reward: [(0, '4430.982')] [2023-03-12 01:18:47,264][106434] Updated weights for policy 0, policy_version 168240 (0.0004) [2023-03-12 01:18:50,619][106434] Updated weights for policy 0, policy_version 168320 (0.0004) [2023-03-12 01:18:50,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12288.0, 300 sec: 12232.5). Total num frames: 86179840. Throughput: 0: 12423.6. Samples: 86146212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:18:50,662][106151] Avg episode reward: [(0, '4526.876')] [2023-03-12 01:18:53,891][106434] Updated weights for policy 0, policy_version 168400 (0.0004) [2023-03-12 01:18:55,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12356.2, 300 sec: 12246.3). Total num frames: 86241280. Throughput: 0: 12454.0. Samples: 86220076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:18:55,662][106151] Avg episode reward: [(0, '4517.182')] [2023-03-12 01:18:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000168440_86241280.pth... [2023-03-12 01:18:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000167704_85864448.pth [2023-03-12 01:18:57,178][106434] Updated weights for policy 0, policy_version 168480 (0.0004) [2023-03-12 01:19:00,449][106434] Updated weights for policy 0, policy_version 168560 (0.0004) [2023-03-12 01:19:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12260.2). Total num frames: 86302720. Throughput: 0: 12550.0. Samples: 86294600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:19:00,662][106151] Avg episode reward: [(0, '4525.530')] [2023-03-12 01:19:03,772][106434] Updated weights for policy 0, policy_version 168640 (0.0005) [2023-03-12 01:19:05,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12288.0). Total num frames: 86364160. Throughput: 0: 12522.1. Samples: 86331464. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:19:05,661][106151] Avg episode reward: [(0, '4513.008')] [2023-03-12 01:19:06,935][106434] Updated weights for policy 0, policy_version 168720 (0.0004) [2023-03-12 01:19:10,399][106434] Updated weights for policy 0, policy_version 168800 (0.0005) [2023-03-12 01:19:10,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12301.9). Total num frames: 86425600. Throughput: 0: 12534.8. Samples: 86408016. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:19:10,661][106151] Avg episode reward: [(0, '4526.659')] [2023-03-12 01:19:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000168800_86425600.pth... [2023-03-12 01:19:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000168072_86052864.pth [2023-03-12 01:19:13,980][106434] Updated weights for policy 0, policy_version 168880 (0.0005) [2023-03-12 01:19:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 12301.9). Total num frames: 86482944. Throughput: 0: 12386.0. Samples: 86475688. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:19:15,661][106151] Avg episode reward: [(0, '4519.421')] [2023-03-12 01:19:17,685][106434] Updated weights for policy 0, policy_version 168960 (0.0005) [2023-03-12 01:19:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12288.0, 300 sec: 12301.9). Total num frames: 86540288. Throughput: 0: 12281.9. Samples: 86509200. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:19:20,661][106151] Avg episode reward: [(0, '4520.675')] [2023-03-12 01:19:21,165][106434] Updated weights for policy 0, policy_version 169040 (0.0005) [2023-03-12 01:19:24,532][106434] Updated weights for policy 0, policy_version 169120 (0.0003) [2023-03-12 01:19:25,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 12315.8). Total num frames: 86601728. Throughput: 0: 12206.1. Samples: 86581312. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:19:25,661][106151] Avg episode reward: [(0, '4482.434')] [2023-03-12 01:19:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000169144_86601728.pth... [2023-03-12 01:19:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000168440_86241280.pth [2023-03-12 01:19:27,810][106434] Updated weights for policy 0, policy_version 169200 (0.0004) [2023-03-12 01:19:30,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12343.5). Total num frames: 86663168. Throughput: 0: 12151.4. Samples: 86655048. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:19:30,661][106151] Avg episode reward: [(0, '4483.252')] [2023-03-12 01:19:31,248][106434] Updated weights for policy 0, policy_version 169280 (0.0005) [2023-03-12 01:19:34,668][106434] Updated weights for policy 0, policy_version 169360 (0.0005) [2023-03-12 01:19:35,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12343.5). Total num frames: 86720512. Throughput: 0: 12067.2. Samples: 86689236. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:19:35,661][106151] Avg episode reward: [(0, '4325.420')] [2023-03-12 01:19:38,018][106434] Updated weights for policy 0, policy_version 169440 (0.0005) [2023-03-12 01:19:40,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12371.3). Total num frames: 86786048. Throughput: 0: 12071.5. Samples: 86763292. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:19:40,661][106151] Avg episode reward: [(0, '4491.943')] [2023-03-12 01:19:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000169504_86786048.pth... [2023-03-12 01:19:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000168800_86425600.pth [2023-03-12 01:19:41,320][106434] Updated weights for policy 0, policy_version 169520 (0.0005) [2023-03-12 01:19:44,654][106434] Updated weights for policy 0, policy_version 169600 (0.0004) [2023-03-12 01:19:45,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 12385.2). Total num frames: 86847488. Throughput: 0: 12057.7. Samples: 86837196. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:19:45,661][106151] Avg episode reward: [(0, '4481.391')] [2023-03-12 01:19:47,943][106434] Updated weights for policy 0, policy_version 169680 (0.0005) [2023-03-12 01:19:50,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 12399.1). Total num frames: 86908928. Throughput: 0: 12071.7. Samples: 86874688. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:19:50,661][106151] Avg episode reward: [(0, '4512.635')] [2023-03-12 01:19:51,267][106434] Updated weights for policy 0, policy_version 169760 (0.0005) [2023-03-12 01:19:54,493][106434] Updated weights for policy 0, policy_version 169840 (0.0004) [2023-03-12 01:19:55,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12151.5, 300 sec: 12399.1). Total num frames: 86970368. Throughput: 0: 12041.1. Samples: 86949864. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:19:55,661][106151] Avg episode reward: [(0, '4297.175')] [2023-03-12 01:19:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000169864_86970368.pth... [2023-03-12 01:19:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000169144_86601728.pth [2023-03-12 01:19:57,944][106434] Updated weights for policy 0, policy_version 169920 (0.0005) [2023-03-12 01:20:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 12385.2). Total num frames: 87027712. Throughput: 0: 12113.2. Samples: 87020784. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:20:00,662][106151] Avg episode reward: [(0, '4293.714')] [2023-03-12 01:20:01,451][106434] Updated weights for policy 0, policy_version 170000 (0.0005) [2023-03-12 01:20:05,058][106434] Updated weights for policy 0, policy_version 170080 (0.0005) [2023-03-12 01:20:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 12014.9, 300 sec: 12371.3). Total num frames: 87085056. Throughput: 0: 12143.6. Samples: 87055664. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:20:05,661][106151] Avg episode reward: [(0, '4507.373')] [2023-03-12 01:20:08,559][106434] Updated weights for policy 0, policy_version 170160 (0.0005) [2023-03-12 01:20:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 12357.4). Total num frames: 87142400. Throughput: 0: 12091.7. Samples: 87125440. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:20:10,661][106151] Avg episode reward: [(0, '4463.108')] [2023-03-12 01:20:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000170208_87146496.pth... [2023-03-12 01:20:10,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000169504_86786048.pth [2023-03-12 01:20:12,045][106434] Updated weights for policy 0, policy_version 170240 (0.0005) [2023-03-12 01:20:15,601][106434] Updated weights for policy 0, policy_version 170320 (0.0005) [2023-03-12 01:20:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 12343.5). Total num frames: 87203840. Throughput: 0: 12013.3. Samples: 87195648. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:20:15,661][106151] Avg episode reward: [(0, '4459.787')] [2023-03-12 01:20:18,900][106434] Updated weights for policy 0, policy_version 170400 (0.0005) [2023-03-12 01:20:20,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 12343.5). Total num frames: 87265280. Throughput: 0: 12058.0. Samples: 87231844. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:20:20,661][106151] Avg episode reward: [(0, '4523.322')] [2023-03-12 01:20:22,159][106434] Updated weights for policy 0, policy_version 170480 (0.0004) [2023-03-12 01:20:25,364][106434] Updated weights for policy 0, policy_version 170560 (0.0004) [2023-03-12 01:20:25,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 12343.5). Total num frames: 87326720. Throughput: 0: 12079.9. Samples: 87306888. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:20:25,661][106151] Avg episode reward: [(0, '4263.446')] [2023-03-12 01:20:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000170560_87326720.pth... [2023-03-12 01:20:25,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000169864_86970368.pth [2023-03-12 01:20:28,570][106434] Updated weights for policy 0, policy_version 170640 (0.0004) [2023-03-12 01:20:30,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 12357.4). Total num frames: 87392256. Throughput: 0: 12146.6. Samples: 87383792. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:20:30,661][106151] Avg episode reward: [(0, '4522.662')] [2023-03-12 01:20:31,809][106434] Updated weights for policy 0, policy_version 170720 (0.0005) [2023-03-12 01:20:35,034][106434] Updated weights for policy 0, policy_version 170800 (0.0004) [2023-03-12 01:20:35,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 12343.5). Total num frames: 87453696. Throughput: 0: 12140.3. Samples: 87421000. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:20:35,661][106151] Avg episode reward: [(0, '4519.395')] [2023-03-12 01:20:38,301][106434] Updated weights for policy 0, policy_version 170880 (0.0005) [2023-03-12 01:20:40,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12219.7, 300 sec: 12357.4). Total num frames: 87519232. Throughput: 0: 12164.7. Samples: 87497276. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:20:40,661][106151] Avg episode reward: [(0, '4346.483')] [2023-03-12 01:20:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000170936_87519232.pth... [2023-03-12 01:20:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000170208_87146496.pth [2023-03-12 01:20:41,524][106434] Updated weights for policy 0, policy_version 170960 (0.0004) [2023-03-12 01:20:44,680][106434] Updated weights for policy 0, policy_version 171040 (0.0004) [2023-03-12 01:20:45,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12219.7, 300 sec: 12357.4). Total num frames: 87580672. Throughput: 0: 12299.2. Samples: 87574248. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:20:45,661][106151] Avg episode reward: [(0, '4517.182')] [2023-03-12 01:20:47,963][106434] Updated weights for policy 0, policy_version 171120 (0.0004) [2023-03-12 01:20:50,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12288.0, 300 sec: 12357.4). Total num frames: 87646208. Throughput: 0: 12353.8. Samples: 87611584. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:20:50,661][106151] Avg episode reward: [(0, '4275.948')] [2023-03-12 01:20:51,271][106434] Updated weights for policy 0, policy_version 171200 (0.0004) [2023-03-12 01:20:54,513][106434] Updated weights for policy 0, policy_version 171280 (0.0004) [2023-03-12 01:20:55,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 12343.5). Total num frames: 87707648. Throughput: 0: 12482.5. Samples: 87687152. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:20:55,661][106151] Avg episode reward: [(0, '4332.684')] [2023-03-12 01:20:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000171304_87707648.pth... [2023-03-12 01:20:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000170560_87326720.pth [2023-03-12 01:20:57,722][106434] Updated weights for policy 0, policy_version 171360 (0.0004) [2023-03-12 01:21:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12343.5). Total num frames: 87769088. Throughput: 0: 12591.2. Samples: 87762252. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:21:00,661][106151] Avg episode reward: [(0, '4471.780')] [2023-03-12 01:21:01,039][106434] Updated weights for policy 0, policy_version 171440 (0.0004) [2023-03-12 01:21:04,237][106434] Updated weights for policy 0, policy_version 171520 (0.0003) [2023-03-12 01:21:05,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12492.8, 300 sec: 12357.4). Total num frames: 87834624. Throughput: 0: 12636.6. Samples: 87800492. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:21:05,661][106151] Avg episode reward: [(0, '4507.907')] [2023-03-12 01:21:07,458][106434] Updated weights for policy 0, policy_version 171600 (0.0004) [2023-03-12 01:21:10,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12561.1, 300 sec: 12343.5). Total num frames: 87896064. Throughput: 0: 12639.3. Samples: 87875656. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:21:10,662][106151] Avg episode reward: [(0, '4501.264')] [2023-03-12 01:21:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000171672_87896064.pth... [2023-03-12 01:21:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000170936_87519232.pth [2023-03-12 01:21:10,791][106434] Updated weights for policy 0, policy_version 171680 (0.0005) [2023-03-12 01:21:14,098][106434] Updated weights for policy 0, policy_version 171760 (0.0004) [2023-03-12 01:21:15,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12343.5). Total num frames: 87957504. Throughput: 0: 12583.7. Samples: 87950060. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 01:21:15,661][106151] Avg episode reward: [(0, '4480.911')] [2023-03-12 01:21:17,355][106434] Updated weights for policy 0, policy_version 171840 (0.0004) [2023-03-12 01:21:20,556][106434] Updated weights for policy 0, policy_version 171920 (0.0004) [2023-03-12 01:21:20,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12357.4). Total num frames: 88023040. Throughput: 0: 12598.6. Samples: 87987936. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 01:21:20,662][106151] Avg episode reward: [(0, '4517.484')] [2023-03-12 01:21:23,763][106434] Updated weights for policy 0, policy_version 172000 (0.0004) [2023-03-12 01:21:25,661][106151] Fps is (10 sec: 12697.4, 60 sec: 12629.3, 300 sec: 12343.5). Total num frames: 88084480. Throughput: 0: 12604.6. Samples: 88064484. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 01:21:25,662][106151] Avg episode reward: [(0, '4524.530')] [2023-03-12 01:21:25,669][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000172048_88088576.pth... [2023-03-12 01:21:25,671][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000171304_87707648.pth [2023-03-12 01:21:26,954][106434] Updated weights for policy 0, policy_version 172080 (0.0004) [2023-03-12 01:21:30,191][106434] Updated weights for policy 0, policy_version 172160 (0.0004) [2023-03-12 01:21:30,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12629.3, 300 sec: 12357.4). Total num frames: 88150016. Throughput: 0: 12612.8. Samples: 88141824. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 01:21:30,661][106151] Avg episode reward: [(0, '4509.969')] [2023-03-12 01:21:33,424][106434] Updated weights for policy 0, policy_version 172240 (0.0004) [2023-03-12 01:21:35,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12629.3, 300 sec: 12357.4). Total num frames: 88211456. Throughput: 0: 12607.4. Samples: 88178916. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 01:21:35,661][106151] Avg episode reward: [(0, '4535.451')] [2023-03-12 01:21:36,733][106434] Updated weights for policy 0, policy_version 172320 (0.0004) [2023-03-12 01:21:39,948][106434] Updated weights for policy 0, policy_version 172400 (0.0004) [2023-03-12 01:21:40,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12629.3, 300 sec: 12357.4). Total num frames: 88276992. Throughput: 0: 12597.9. Samples: 88254060. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 01:21:40,662][106151] Avg episode reward: [(0, '3991.700')] [2023-03-12 01:21:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000172416_88276992.pth... [2023-03-12 01:21:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000171672_87896064.pth [2023-03-12 01:21:43,250][106434] Updated weights for policy 0, policy_version 172480 (0.0004) [2023-03-12 01:21:45,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12629.3, 300 sec: 12357.4). Total num frames: 88338432. Throughput: 0: 12598.4. Samples: 88329180. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 01:21:45,662][106151] Avg episode reward: [(0, '4519.939')] [2023-03-12 01:21:46,520][106434] Updated weights for policy 0, policy_version 172560 (0.0004) [2023-03-12 01:21:49,827][106434] Updated weights for policy 0, policy_version 172640 (0.0004) [2023-03-12 01:21:50,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12343.5). Total num frames: 88399872. Throughput: 0: 12592.8. Samples: 88367168. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 01:21:50,661][106151] Avg episode reward: [(0, '4516.593')] [2023-03-12 01:21:53,344][106434] Updated weights for policy 0, policy_version 172720 (0.0004) [2023-03-12 01:21:55,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12492.8, 300 sec: 12329.7). Total num frames: 88457216. Throughput: 0: 12510.0. Samples: 88438604. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 01:21:55,661][106151] Avg episode reward: [(0, '4523.787')] [2023-03-12 01:21:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000172768_88457216.pth... [2023-03-12 01:21:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000172048_88088576.pth [2023-03-12 01:21:56,901][106434] Updated weights for policy 0, policy_version 172800 (0.0005) [2023-03-12 01:22:00,456][106434] Updated weights for policy 0, policy_version 172880 (0.0005) [2023-03-12 01:22:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12424.5, 300 sec: 12315.8). Total num frames: 88514560. Throughput: 0: 12364.0. Samples: 88506440. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 01:22:00,661][106151] Avg episode reward: [(0, '4526.417')] [2023-03-12 01:22:04,009][106434] Updated weights for policy 0, policy_version 172960 (0.0005) [2023-03-12 01:22:05,661][106151] Fps is (10 sec: 11469.0, 60 sec: 12288.0, 300 sec: 12288.0). Total num frames: 88571904. Throughput: 0: 12312.3. Samples: 88541988. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 01:22:05,661][106151] Avg episode reward: [(0, '4521.107')] [2023-03-12 01:22:07,527][106434] Updated weights for policy 0, policy_version 173040 (0.0005) [2023-03-12 01:22:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12219.7, 300 sec: 12274.1). Total num frames: 88629248. Throughput: 0: 12153.4. Samples: 88611388. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 01:22:10,661][106151] Avg episode reward: [(0, '4481.151')] [2023-03-12 01:22:10,700][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000173112_88633344.pth... [2023-03-12 01:22:10,701][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000172416_88276992.pth [2023-03-12 01:22:11,070][106434] Updated weights for policy 0, policy_version 173120 (0.0005) [2023-03-12 01:22:14,617][106434] Updated weights for policy 0, policy_version 173200 (0.0005) [2023-03-12 01:22:15,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12219.7, 300 sec: 12274.1). Total num frames: 88690688. Throughput: 0: 11981.3. Samples: 88680980. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-12 01:22:15,661][106151] Avg episode reward: [(0, '4514.463')] [2023-03-12 01:22:17,882][106434] Updated weights for policy 0, policy_version 173280 (0.0004) [2023-03-12 01:22:20,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 12260.2). Total num frames: 88748032. Throughput: 0: 11993.4. Samples: 88718620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:22:20,661][106151] Avg episode reward: [(0, '4486.990')] [2023-03-12 01:22:21,444][106434] Updated weights for policy 0, policy_version 173360 (0.0004) [2023-03-12 01:22:24,983][106434] Updated weights for policy 0, policy_version 173440 (0.0005) [2023-03-12 01:22:25,661][106151] Fps is (10 sec: 11468.7, 60 sec: 12015.0, 300 sec: 12246.3). Total num frames: 88805376. Throughput: 0: 11875.9. Samples: 88788476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:22:25,661][106151] Avg episode reward: [(0, '4510.779')] [2023-03-12 01:22:25,680][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000173456_88809472.pth... [2023-03-12 01:22:25,682][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000172768_88457216.pth [2023-03-12 01:22:28,385][106434] Updated weights for policy 0, policy_version 173520 (0.0005) [2023-03-12 01:22:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12246.3). Total num frames: 88866816. Throughput: 0: 11796.8. Samples: 88860036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:22:30,661][106151] Avg episode reward: [(0, '4473.001')] [2023-03-12 01:22:31,773][106434] Updated weights for policy 0, policy_version 173600 (0.0004) [2023-03-12 01:22:35,299][106434] Updated weights for policy 0, policy_version 173680 (0.0005) [2023-03-12 01:22:35,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 12246.3). Total num frames: 88928256. Throughput: 0: 11740.6. Samples: 88895496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:22:35,661][106151] Avg episode reward: [(0, '4506.882')] [2023-03-12 01:22:38,860][106434] Updated weights for policy 0, policy_version 173760 (0.0005) [2023-03-12 01:22:40,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 12232.5). Total num frames: 88985600. Throughput: 0: 11700.6. Samples: 88965132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:22:40,661][106151] Avg episode reward: [(0, '4517.112')] [2023-03-12 01:22:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000173800_88985600.pth... [2023-03-12 01:22:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000173112_88633344.pth [2023-03-12 01:22:42,400][106434] Updated weights for policy 0, policy_version 173840 (0.0004) [2023-03-12 01:22:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 12204.7). Total num frames: 89042944. Throughput: 0: 11734.6. Samples: 89034496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:22:45,661][106151] Avg episode reward: [(0, '4469.707')] [2023-03-12 01:22:45,963][106434] Updated weights for policy 0, policy_version 173920 (0.0005) [2023-03-12 01:22:49,509][106434] Updated weights for policy 0, policy_version 174000 (0.0005) [2023-03-12 01:22:50,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 12204.7). Total num frames: 89100288. Throughput: 0: 11685.0. Samples: 89067812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:22:50,661][106151] Avg episode reward: [(0, '4393.570')] [2023-03-12 01:22:53,074][106434] Updated weights for policy 0, policy_version 174080 (0.0005) [2023-03-12 01:22:55,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 12190.8). Total num frames: 89157632. Throughput: 0: 11692.9. Samples: 89137568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:22:55,661][106151] Avg episode reward: [(0, '4396.088')] [2023-03-12 01:22:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000174136_89157632.pth... [2023-03-12 01:22:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000173456_88809472.pth [2023-03-12 01:22:56,623][106434] Updated weights for policy 0, policy_version 174160 (0.0005) [2023-03-12 01:23:00,160][106434] Updated weights for policy 0, policy_version 174240 (0.0005) [2023-03-12 01:23:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12190.8). Total num frames: 89214976. Throughput: 0: 11686.1. Samples: 89206856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:23:00,661][106151] Avg episode reward: [(0, '4489.838')] [2023-03-12 01:23:03,770][106434] Updated weights for policy 0, policy_version 174320 (0.0005) [2023-03-12 01:23:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 12176.9). Total num frames: 89272320. Throughput: 0: 11615.8. Samples: 89241332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:23:05,661][106151] Avg episode reward: [(0, '4404.209')] [2023-03-12 01:23:07,309][106434] Updated weights for policy 0, policy_version 174400 (0.0005) [2023-03-12 01:23:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12176.9). Total num frames: 89329664. Throughput: 0: 11584.2. Samples: 89309764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:23:10,661][106151] Avg episode reward: [(0, '4441.378')] [2023-03-12 01:23:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000174472_89329664.pth... [2023-03-12 01:23:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000173800_88985600.pth [2023-03-12 01:23:10,869][106434] Updated weights for policy 0, policy_version 174480 (0.0005) [2023-03-12 01:23:14,402][106434] Updated weights for policy 0, policy_version 174560 (0.0005) [2023-03-12 01:23:15,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 12149.2). Total num frames: 89387008. Throughput: 0: 11541.3. Samples: 89379396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:23:15,661][106151] Avg episode reward: [(0, '4431.540')] [2023-03-12 01:23:17,952][106434] Updated weights for policy 0, policy_version 174640 (0.0005) [2023-03-12 01:23:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 12135.3). Total num frames: 89444352. Throughput: 0: 11544.3. Samples: 89414988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:23:20,661][106151] Avg episode reward: [(0, '4376.040')] [2023-03-12 01:23:21,541][106434] Updated weights for policy 0, policy_version 174720 (0.0005) [2023-03-12 01:23:25,151][106434] Updated weights for policy 0, policy_version 174800 (0.0005) [2023-03-12 01:23:25,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12121.4). Total num frames: 89501696. Throughput: 0: 11486.6. Samples: 89482028. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:23:25,661][106151] Avg episode reward: [(0, '4351.777')] [2023-03-12 01:23:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000174808_89501696.pth... [2023-03-12 01:23:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000174136_89157632.pth [2023-03-12 01:23:28,623][106434] Updated weights for policy 0, policy_version 174880 (0.0005) [2023-03-12 01:23:30,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 12107.5). Total num frames: 89559040. Throughput: 0: 11501.8. Samples: 89552076. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:23:30,661][106151] Avg episode reward: [(0, '4444.227')] [2023-03-12 01:23:32,181][106434] Updated weights for policy 0, policy_version 174960 (0.0005) [2023-03-12 01:23:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 12079.7). Total num frames: 89616384. Throughput: 0: 11553.3. Samples: 89587712. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:23:35,661][106151] Avg episode reward: [(0, '4477.016')] [2023-03-12 01:23:35,698][106434] Updated weights for policy 0, policy_version 175040 (0.0005) [2023-03-12 01:23:39,315][106434] Updated weights for policy 0, policy_version 175120 (0.0004) [2023-03-12 01:23:40,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 12052.0). Total num frames: 89673728. Throughput: 0: 11514.3. Samples: 89655712. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:23:40,661][106151] Avg episode reward: [(0, '4509.885')] [2023-03-12 01:23:40,713][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000175152_89677824.pth... [2023-03-12 01:23:40,715][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000174472_89329664.pth [2023-03-12 01:23:42,879][106434] Updated weights for policy 0, policy_version 175200 (0.0005) [2023-03-12 01:23:45,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 12038.1). Total num frames: 89731072. Throughput: 0: 11517.9. Samples: 89725160. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:23:45,661][106151] Avg episode reward: [(0, '4483.603')] [2023-03-12 01:23:46,416][106434] Updated weights for policy 0, policy_version 175280 (0.0005) [2023-03-12 01:23:49,998][106434] Updated weights for policy 0, policy_version 175360 (0.0005) [2023-03-12 01:23:50,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 12024.2). Total num frames: 89788416. Throughput: 0: 11517.3. Samples: 89759612. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:23:50,661][106151] Avg episode reward: [(0, '4529.549')] [2023-03-12 01:23:53,633][106434] Updated weights for policy 0, policy_version 175440 (0.0005) [2023-03-12 01:23:55,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 12010.3). Total num frames: 89845760. Throughput: 0: 11507.0. Samples: 89827580. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:23:55,661][106151] Avg episode reward: [(0, '4522.767')] [2023-03-12 01:23:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000175480_89845760.pth... [2023-03-12 01:23:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000174808_89501696.pth [2023-03-12 01:23:57,151][106434] Updated weights for policy 0, policy_version 175520 (0.0005) [2023-03-12 01:24:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11996.4). Total num frames: 89903104. Throughput: 0: 11505.8. Samples: 89897156. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:24:00,661][106151] Avg episode reward: [(0, '4477.130')] [2023-03-12 01:24:00,693][106434] Updated weights for policy 0, policy_version 175600 (0.0005) [2023-03-12 01:24:04,317][106434] Updated weights for policy 0, policy_version 175680 (0.0005) [2023-03-12 01:24:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11982.5). Total num frames: 89960448. Throughput: 0: 11479.4. Samples: 89931564. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:24:05,661][106151] Avg episode reward: [(0, '4497.184')] [2023-03-12 01:24:07,917][106434] Updated weights for policy 0, policy_version 175760 (0.0005) [2023-03-12 01:24:10,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11982.5). Total num frames: 90017792. Throughput: 0: 11504.3. Samples: 89999724. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:24:10,661][106151] Avg episode reward: [(0, '4471.883')] [2023-03-12 01:24:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000175816_90017792.pth... [2023-03-12 01:24:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000175152_89677824.pth [2023-03-12 01:24:11,477][106434] Updated weights for policy 0, policy_version 175840 (0.0005) [2023-03-12 01:24:14,976][106434] Updated weights for policy 0, policy_version 175920 (0.0005) [2023-03-12 01:24:15,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11537.1, 300 sec: 11996.4). Total num frames: 90079232. Throughput: 0: 11493.0. Samples: 90069260. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:24:15,661][106151] Avg episode reward: [(0, '4466.080')] [2023-03-12 01:24:18,499][106434] Updated weights for policy 0, policy_version 176000 (0.0005) [2023-03-12 01:24:20,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11537.1, 300 sec: 11982.5). Total num frames: 90136576. Throughput: 0: 11470.4. Samples: 90103880. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:24:20,661][106151] Avg episode reward: [(0, '4514.308')] [2023-03-12 01:24:22,034][106434] Updated weights for policy 0, policy_version 176080 (0.0005) [2023-03-12 01:24:25,559][106434] Updated weights for policy 0, policy_version 176160 (0.0005) [2023-03-12 01:24:25,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11968.6). Total num frames: 90193920. Throughput: 0: 11506.7. Samples: 90173512. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:24:25,661][106151] Avg episode reward: [(0, '4513.526')] [2023-03-12 01:24:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000176160_90193920.pth... [2023-03-12 01:24:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000175480_89845760.pth [2023-03-12 01:24:29,208][106434] Updated weights for policy 0, policy_version 176240 (0.0005) [2023-03-12 01:24:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11968.7). Total num frames: 90251264. Throughput: 0: 11499.6. Samples: 90242644. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:24:30,661][106151] Avg episode reward: [(0, '4508.807')] [2023-03-12 01:24:32,735][106434] Updated weights for policy 0, policy_version 176320 (0.0004) [2023-03-12 01:24:35,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11940.9). Total num frames: 90308608. Throughput: 0: 11491.7. Samples: 90276740. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:24:35,661][106151] Avg episode reward: [(0, '4514.528')] [2023-03-12 01:24:36,293][106434] Updated weights for policy 0, policy_version 176400 (0.0005) [2023-03-12 01:24:39,816][106434] Updated weights for policy 0, policy_version 176480 (0.0005) [2023-03-12 01:24:40,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11927.0). Total num frames: 90365952. Throughput: 0: 11539.2. Samples: 90346844. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:24:40,662][106151] Avg episode reward: [(0, '4417.505')] [2023-03-12 01:24:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000176496_90365952.pth... [2023-03-12 01:24:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000175816_90017792.pth [2023-03-12 01:24:43,436][106434] Updated weights for policy 0, policy_version 176560 (0.0005) [2023-03-12 01:24:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11913.1). Total num frames: 90423296. Throughput: 0: 11511.4. Samples: 90415168. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:24:45,662][106151] Avg episode reward: [(0, '4515.455')] [2023-03-12 01:24:46,983][106434] Updated weights for policy 0, policy_version 176640 (0.0005) [2023-03-12 01:24:50,475][106434] Updated weights for policy 0, policy_version 176720 (0.0004) [2023-03-12 01:24:50,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11899.2). Total num frames: 90480640. Throughput: 0: 11507.4. Samples: 90449396. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:24:50,661][106151] Avg episode reward: [(0, '4513.678')] [2023-03-12 01:24:53,791][106434] Updated weights for policy 0, policy_version 176800 (0.0004) [2023-03-12 01:24:55,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11913.1). Total num frames: 90542080. Throughput: 0: 11598.9. Samples: 90521676. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:24:55,662][106151] Avg episode reward: [(0, '4473.256')] [2023-03-12 01:24:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000176840_90542080.pth... [2023-03-12 01:24:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000176160_90193920.pth [2023-03-12 01:24:57,169][106434] Updated weights for policy 0, policy_version 176880 (0.0004) [2023-03-12 01:25:00,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11913.1). Total num frames: 90599424. Throughput: 0: 11658.9. Samples: 90593908. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:25:00,661][106151] Avg episode reward: [(0, '4473.586')] [2023-03-12 01:25:00,664][106434] Updated weights for policy 0, policy_version 176960 (0.0005) [2023-03-12 01:25:04,236][106434] Updated weights for policy 0, policy_version 177040 (0.0005) [2023-03-12 01:25:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11913.1). Total num frames: 90656768. Throughput: 0: 11654.9. Samples: 90628352. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:25:05,661][106151] Avg episode reward: [(0, '4390.848')] [2023-03-12 01:25:07,803][106434] Updated weights for policy 0, policy_version 177120 (0.0005) [2023-03-12 01:25:10,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11913.1). Total num frames: 90718208. Throughput: 0: 11649.3. Samples: 90697728. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:25:10,661][106151] Avg episode reward: [(0, '4428.222')] [2023-03-12 01:25:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000177184_90718208.pth... [2023-03-12 01:25:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000176496_90365952.pth [2023-03-12 01:25:11,363][106434] Updated weights for policy 0, policy_version 177200 (0.0004) [2023-03-12 01:25:14,933][106434] Updated weights for policy 0, policy_version 177280 (0.0005) [2023-03-12 01:25:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11885.3). Total num frames: 90771456. Throughput: 0: 11636.8. Samples: 90766300. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:25:15,672][106151] Avg episode reward: [(0, '4476.359')] [2023-03-12 01:25:18,539][106434] Updated weights for policy 0, policy_version 177360 (0.0005) [2023-03-12 01:25:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11885.3). Total num frames: 90832896. Throughput: 0: 11632.3. Samples: 90800192. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:25:20,672][106151] Avg episode reward: [(0, '4511.585')] [2023-03-12 01:25:22,036][106434] Updated weights for policy 0, policy_version 177440 (0.0005) [2023-03-12 01:25:25,579][106434] Updated weights for policy 0, policy_version 177520 (0.0005) [2023-03-12 01:25:25,661][106151] Fps is (10 sec: 11877.9, 60 sec: 11605.3, 300 sec: 11857.6). Total num frames: 90890240. Throughput: 0: 11621.9. Samples: 90869832. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:25:25,662][106151] Avg episode reward: [(0, '4456.073')] [2023-03-12 01:25:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000177520_90890240.pth... [2023-03-12 01:25:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000176840_90542080.pth [2023-03-12 01:25:29,189][106434] Updated weights for policy 0, policy_version 177600 (0.0005) [2023-03-12 01:25:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11843.7). Total num frames: 90947584. Throughput: 0: 11646.5. Samples: 90939260. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-12 01:25:30,672][106151] Avg episode reward: [(0, '4398.922')] [2023-03-12 01:25:32,752][106434] Updated weights for policy 0, policy_version 177680 (0.0005) [2023-03-12 01:25:35,661][106151] Fps is (10 sec: 11469.2, 60 sec: 11605.3, 300 sec: 11815.9). Total num frames: 91004928. Throughput: 0: 11631.4. Samples: 90972808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:25:35,672][106151] Avg episode reward: [(0, '4400.648')] [2023-03-12 01:25:36,387][106434] Updated weights for policy 0, policy_version 177760 (0.0005) [2023-03-12 01:25:39,966][106434] Updated weights for policy 0, policy_version 177840 (0.0005) [2023-03-12 01:25:40,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11788.1). Total num frames: 91058176. Throughput: 0: 11543.9. Samples: 91041152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:25:40,662][106151] Avg episode reward: [(0, '4360.081')] [2023-03-12 01:25:40,672][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000177856_91062272.pth... [2023-03-12 01:25:40,674][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000177184_90718208.pth [2023-03-12 01:25:43,507][106434] Updated weights for policy 0, policy_version 177920 (0.0004) [2023-03-12 01:25:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11774.3). Total num frames: 91119616. Throughput: 0: 11488.1. Samples: 91110872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:25:45,661][106151] Avg episode reward: [(0, '4311.858')] [2023-03-12 01:25:47,016][106434] Updated weights for policy 0, policy_version 178000 (0.0005) [2023-03-12 01:25:50,539][106434] Updated weights for policy 0, policy_version 178080 (0.0005) [2023-03-12 01:25:50,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11760.4). Total num frames: 91176960. Throughput: 0: 11494.1. Samples: 91145588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:25:50,661][106151] Avg episode reward: [(0, '4104.136')] [2023-03-12 01:25:54,140][106434] Updated weights for policy 0, policy_version 178160 (0.0005) [2023-03-12 01:25:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11746.5). Total num frames: 91234304. Throughput: 0: 11476.4. Samples: 91214168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:25:55,661][106151] Avg episode reward: [(0, '4149.745')] [2023-03-12 01:25:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000178192_91234304.pth... [2023-03-12 01:25:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000177520_90890240.pth [2023-03-12 01:25:57,728][106434] Updated weights for policy 0, policy_version 178240 (0.0005) [2023-03-12 01:26:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.0, 300 sec: 11718.7). Total num frames: 91291648. Throughput: 0: 11492.7. Samples: 91283472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:26:00,662][106151] Avg episode reward: [(0, '4190.662')] [2023-03-12 01:26:01,311][106434] Updated weights for policy 0, policy_version 178320 (0.0005) [2023-03-12 01:26:04,864][106434] Updated weights for policy 0, policy_version 178400 (0.0005) [2023-03-12 01:26:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11704.8). Total num frames: 91348992. Throughput: 0: 11474.1. Samples: 91316528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:26:05,661][106151] Avg episode reward: [(0, '4144.678')] [2023-03-12 01:26:08,456][106434] Updated weights for policy 0, policy_version 178480 (0.0005) [2023-03-12 01:26:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11691.0). Total num frames: 91406336. Throughput: 0: 11468.9. Samples: 91385928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:26:10,661][106151] Avg episode reward: [(0, '4410.454')] [2023-03-12 01:26:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000178528_91406336.pth... [2023-03-12 01:26:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000177856_91062272.pth [2023-03-12 01:26:12,011][106434] Updated weights for policy 0, policy_version 178560 (0.0005) [2023-03-12 01:26:15,571][106434] Updated weights for policy 0, policy_version 178640 (0.0005) [2023-03-12 01:26:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11663.2). Total num frames: 91463680. Throughput: 0: 11472.1. Samples: 91455504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:26:15,661][106151] Avg episode reward: [(0, '4222.173')] [2023-03-12 01:26:19,034][106434] Updated weights for policy 0, policy_version 178720 (0.0004) [2023-03-12 01:26:20,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11649.3). Total num frames: 91521024. Throughput: 0: 11481.6. Samples: 91489480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:26:20,661][106151] Avg episode reward: [(0, '4133.427')] [2023-03-12 01:26:22,327][106434] Updated weights for policy 0, policy_version 178800 (0.0004) [2023-03-12 01:26:25,620][106434] Updated weights for policy 0, policy_version 178880 (0.0004) [2023-03-12 01:26:25,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11605.4, 300 sec: 11649.3). Total num frames: 91586560. Throughput: 0: 11624.3. Samples: 91564244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:26:25,661][106151] Avg episode reward: [(0, '4039.939')] [2023-03-12 01:26:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000178880_91586560.pth... [2023-03-12 01:26:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000178192_91234304.pth [2023-03-12 01:26:28,866][106434] Updated weights for policy 0, policy_version 178960 (0.0004) [2023-03-12 01:26:30,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11673.6, 300 sec: 11649.3). Total num frames: 91648000. Throughput: 0: 11733.0. Samples: 91638856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:26:30,661][106151] Avg episode reward: [(0, '4376.065')] [2023-03-12 01:26:32,489][106434] Updated weights for policy 0, policy_version 179040 (0.0005) [2023-03-12 01:26:35,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11607.7). Total num frames: 91701248. Throughput: 0: 11712.3. Samples: 91672640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:26:35,661][106151] Avg episode reward: [(0, '4496.024')] [2023-03-12 01:26:36,055][106434] Updated weights for policy 0, policy_version 179120 (0.0005) [2023-03-12 01:26:39,598][106434] Updated weights for policy 0, policy_version 179200 (0.0005) [2023-03-12 01:26:40,661][106151] Fps is (10 sec: 11059.1, 60 sec: 11673.6, 300 sec: 11593.8). Total num frames: 91758592. Throughput: 0: 11720.6. Samples: 91741596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:26:40,661][106151] Avg episode reward: [(0, '4355.417')] [2023-03-12 01:26:40,695][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000179224_91762688.pth... [2023-03-12 01:26:40,697][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000178528_91406336.pth [2023-03-12 01:26:43,159][106434] Updated weights for policy 0, policy_version 179280 (0.0005) [2023-03-12 01:26:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11579.9). Total num frames: 91815936. Throughput: 0: 11715.6. Samples: 91810672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:26:45,661][106151] Avg episode reward: [(0, '4460.880')] [2023-03-12 01:26:46,801][106434] Updated weights for policy 0, policy_version 179360 (0.0005) [2023-03-12 01:26:50,340][106434] Updated weights for policy 0, policy_version 179440 (0.0005) [2023-03-12 01:26:50,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11579.9). Total num frames: 91873280. Throughput: 0: 11734.1. Samples: 91844560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:26:50,661][106151] Avg episode reward: [(0, '4242.809')] [2023-03-12 01:26:53,916][106434] Updated weights for policy 0, policy_version 179520 (0.0005) [2023-03-12 01:26:55,661][106151] Fps is (10 sec: 11878.2, 60 sec: 11673.6, 300 sec: 11593.8). Total num frames: 91934720. Throughput: 0: 11722.5. Samples: 91913444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:26:55,662][106151] Avg episode reward: [(0, '4459.243')] [2023-03-12 01:26:55,666][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000179560_91934720.pth... [2023-03-12 01:26:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000178880_91586560.pth [2023-03-12 01:26:57,497][106434] Updated weights for policy 0, policy_version 179600 (0.0005) [2023-03-12 01:27:00,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11579.9). Total num frames: 91987968. Throughput: 0: 11712.1. Samples: 91982548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:27:00,661][106151] Avg episode reward: [(0, '4468.773')] [2023-03-12 01:27:01,037][106434] Updated weights for policy 0, policy_version 179680 (0.0005) [2023-03-12 01:27:04,607][106434] Updated weights for policy 0, policy_version 179760 (0.0005) [2023-03-12 01:27:05,661][106151] Fps is (10 sec: 11059.4, 60 sec: 11605.3, 300 sec: 11579.9). Total num frames: 92045312. Throughput: 0: 11716.1. Samples: 92016704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:27:05,661][106151] Avg episode reward: [(0, '4459.967')] [2023-03-12 01:27:08,215][106434] Updated weights for policy 0, policy_version 179840 (0.0005) [2023-03-12 01:27:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11566.0). Total num frames: 92102656. Throughput: 0: 11576.1. Samples: 92085168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:27:10,661][106151] Avg episode reward: [(0, '4451.666')] [2023-03-12 01:27:10,719][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000179896_92106752.pth... [2023-03-12 01:27:10,720][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000179224_91762688.pth [2023-03-12 01:27:11,754][106434] Updated weights for policy 0, policy_version 179920 (0.0005) [2023-03-12 01:27:15,376][106434] Updated weights for policy 0, policy_version 180000 (0.0005) [2023-03-12 01:27:15,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11566.0). Total num frames: 92160000. Throughput: 0: 11449.2. Samples: 92154068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:27:15,661][106151] Avg episode reward: [(0, '4434.899')] [2023-03-12 01:27:18,967][106434] Updated weights for policy 0, policy_version 180080 (0.0005) [2023-03-12 01:27:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11566.0). Total num frames: 92217344. Throughput: 0: 11463.6. Samples: 92188500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:27:20,661][106151] Avg episode reward: [(0, '4322.093')] [2023-03-12 01:27:22,504][106434] Updated weights for policy 0, policy_version 180160 (0.0005) [2023-03-12 01:27:25,661][106151] Fps is (10 sec: 11468.6, 60 sec: 11468.8, 300 sec: 11552.1). Total num frames: 92274688. Throughput: 0: 11458.7. Samples: 92257240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:27:25,662][106151] Avg episode reward: [(0, '4363.561')] [2023-03-12 01:27:25,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000180224_92274688.pth... [2023-03-12 01:27:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000179560_91934720.pth [2023-03-12 01:27:26,099][106434] Updated weights for policy 0, policy_version 180240 (0.0005) [2023-03-12 01:27:29,405][106434] Updated weights for policy 0, policy_version 180320 (0.0003) [2023-03-12 01:27:30,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11468.8, 300 sec: 11552.1). Total num frames: 92336128. Throughput: 0: 11505.1. Samples: 92328400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:27:30,661][106151] Avg episode reward: [(0, '4277.654')] [2023-03-12 01:27:32,792][106434] Updated weights for policy 0, policy_version 180400 (0.0003) [2023-03-12 01:27:35,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11605.3, 300 sec: 11566.0). Total num frames: 92397568. Throughput: 0: 11562.5. Samples: 92364872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:27:35,661][106151] Avg episode reward: [(0, '4459.578')] [2023-03-12 01:27:36,070][106434] Updated weights for policy 0, policy_version 180480 (0.0003) [2023-03-12 01:27:39,348][106434] Updated weights for policy 0, policy_version 180560 (0.0003) [2023-03-12 01:27:40,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11741.9, 300 sec: 11593.8). Total num frames: 92463104. Throughput: 0: 11698.1. Samples: 92439856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:27:40,661][106151] Avg episode reward: [(0, '4501.039')] [2023-03-12 01:27:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000180592_92463104.pth... [2023-03-12 01:27:40,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000179896_92106752.pth [2023-03-12 01:27:42,610][106434] Updated weights for policy 0, policy_version 180640 (0.0003) [2023-03-12 01:27:45,661][106151] Fps is (10 sec: 12697.7, 60 sec: 11810.1, 300 sec: 11607.6). Total num frames: 92524544. Throughput: 0: 11819.7. Samples: 92514436. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:27:45,661][106151] Avg episode reward: [(0, '4511.658')] [2023-03-12 01:27:45,984][106434] Updated weights for policy 0, policy_version 180720 (0.0003) [2023-03-12 01:27:49,217][106434] Updated weights for policy 0, policy_version 180800 (0.0003) [2023-03-12 01:27:50,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11878.4, 300 sec: 11621.5). Total num frames: 92585984. Throughput: 0: 11895.3. Samples: 92551992. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:27:50,661][106151] Avg episode reward: [(0, '4460.169')] [2023-03-12 01:27:52,523][106434] Updated weights for policy 0, policy_version 180880 (0.0004) [2023-03-12 01:27:55,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11878.4, 300 sec: 11635.4). Total num frames: 92647424. Throughput: 0: 12040.9. Samples: 92627008. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:27:55,661][106151] Avg episode reward: [(0, '4523.563')] [2023-03-12 01:27:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000180952_92647424.pth... [2023-03-12 01:27:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000180224_92274688.pth [2023-03-12 01:27:55,801][106434] Updated weights for policy 0, policy_version 180960 (0.0003) [2023-03-12 01:27:59,165][106434] Updated weights for policy 0, policy_version 181040 (0.0004) [2023-03-12 01:28:00,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12014.9, 300 sec: 11649.3). Total num frames: 92708864. Throughput: 0: 12146.9. Samples: 92700680. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:28:00,661][106151] Avg episode reward: [(0, '4516.683')] [2023-03-12 01:28:02,426][106434] Updated weights for policy 0, policy_version 181120 (0.0004) [2023-03-12 01:28:05,648][106434] Updated weights for policy 0, policy_version 181200 (0.0003) [2023-03-12 01:28:05,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 11677.1). Total num frames: 92774400. Throughput: 0: 12220.1. Samples: 92738404. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:28:05,661][106151] Avg episode reward: [(0, '4398.007')] [2023-03-12 01:28:08,925][106434] Updated weights for policy 0, policy_version 181280 (0.0003) [2023-03-12 01:28:10,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 11691.0). Total num frames: 92835840. Throughput: 0: 12379.5. Samples: 92814316. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:28:10,661][106151] Avg episode reward: [(0, '4480.200')] [2023-03-12 01:28:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000181320_92835840.pth... [2023-03-12 01:28:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000180592_92463104.pth [2023-03-12 01:28:12,164][106434] Updated weights for policy 0, policy_version 181360 (0.0003) [2023-03-12 01:28:15,434][106434] Updated weights for policy 0, policy_version 181440 (0.0003) [2023-03-12 01:28:15,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 11704.8). Total num frames: 92897280. Throughput: 0: 12461.2. Samples: 92889152. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:28:15,661][106151] Avg episode reward: [(0, '4489.023')] [2023-03-12 01:28:18,793][106434] Updated weights for policy 0, policy_version 181520 (0.0003) [2023-03-12 01:28:20,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 11718.7). Total num frames: 92958720. Throughput: 0: 12483.4. Samples: 92926624. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:28:20,661][106151] Avg episode reward: [(0, '4398.654')] [2023-03-12 01:28:22,363][106434] Updated weights for policy 0, policy_version 181600 (0.0005) [2023-03-12 01:28:25,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 11718.7). Total num frames: 93016064. Throughput: 0: 12349.8. Samples: 92995596. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:28:25,661][106151] Avg episode reward: [(0, '4356.943')] [2023-03-12 01:28:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000181672_93016064.pth... [2023-03-12 01:28:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000180952_92647424.pth [2023-03-12 01:28:26,032][106434] Updated weights for policy 0, policy_version 181680 (0.0005) [2023-03-12 01:28:29,576][106434] Updated weights for policy 0, policy_version 181760 (0.0005) [2023-03-12 01:28:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12288.0, 300 sec: 11718.7). Total num frames: 93073408. Throughput: 0: 12220.0. Samples: 93064336. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:28:30,661][106151] Avg episode reward: [(0, '4438.806')] [2023-03-12 01:28:33,098][106434] Updated weights for policy 0, policy_version 181840 (0.0005) [2023-03-12 01:28:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12219.7, 300 sec: 11718.7). Total num frames: 93130752. Throughput: 0: 12155.0. Samples: 93098968. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:28:35,661][106151] Avg episode reward: [(0, '4435.912')] [2023-03-12 01:28:36,632][106434] Updated weights for policy 0, policy_version 181920 (0.0004) [2023-03-12 01:28:40,124][106434] Updated weights for policy 0, policy_version 182000 (0.0005) [2023-03-12 01:28:40,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 11718.7). Total num frames: 93188096. Throughput: 0: 12035.9. Samples: 93168624. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:28:40,662][106151] Avg episode reward: [(0, '4402.235')] [2023-03-12 01:28:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000182008_93188096.pth... [2023-03-12 01:28:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000181320_92835840.pth [2023-03-12 01:28:43,756][106434] Updated weights for policy 0, policy_version 182080 (0.0005) [2023-03-12 01:28:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11718.7). Total num frames: 93245440. Throughput: 0: 11925.2. Samples: 93237312. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:28:45,661][106151] Avg episode reward: [(0, '4514.723')] [2023-03-12 01:28:47,295][106434] Updated weights for policy 0, policy_version 182160 (0.0005) [2023-03-12 01:28:50,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11718.7). Total num frames: 93302784. Throughput: 0: 11854.0. Samples: 93271836. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:28:50,661][106151] Avg episode reward: [(0, '4378.050')] [2023-03-12 01:28:50,855][106434] Updated weights for policy 0, policy_version 182240 (0.0005) [2023-03-12 01:28:54,469][106434] Updated weights for policy 0, policy_version 182320 (0.0005) [2023-03-12 01:28:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11718.7). Total num frames: 93360128. Throughput: 0: 11684.1. Samples: 93340100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:28:55,662][106151] Avg episode reward: [(0, '4430.896')] [2023-03-12 01:28:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000182344_93360128.pth... [2023-03-12 01:28:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000181672_93016064.pth [2023-03-12 01:28:57,998][106434] Updated weights for policy 0, policy_version 182400 (0.0005) [2023-03-12 01:29:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11718.7). Total num frames: 93417472. Throughput: 0: 11561.1. Samples: 93409400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:29:00,672][106151] Avg episode reward: [(0, '4469.432')] [2023-03-12 01:29:01,595][106434] Updated weights for policy 0, policy_version 182480 (0.0005) [2023-03-12 01:29:05,052][106434] Updated weights for policy 0, policy_version 182560 (0.0005) [2023-03-12 01:29:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 11718.7). Total num frames: 93474816. Throughput: 0: 11511.7. Samples: 93444648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:29:05,672][106151] Avg episode reward: [(0, '4502.561')] [2023-03-12 01:29:08,648][106434] Updated weights for policy 0, policy_version 182640 (0.0005) [2023-03-12 01:29:10,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11704.8). Total num frames: 93532160. Throughput: 0: 11519.6. Samples: 93513980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:29:10,662][106151] Avg episode reward: [(0, '4382.049')] [2023-03-12 01:29:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000182680_93532160.pth... [2023-03-12 01:29:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000182008_93188096.pth [2023-03-12 01:29:12,172][106434] Updated weights for policy 0, policy_version 182720 (0.0005) [2023-03-12 01:29:15,657][106434] Updated weights for policy 0, policy_version 182800 (0.0005) [2023-03-12 01:29:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11718.7). Total num frames: 93593600. Throughput: 0: 11540.8. Samples: 93583672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:29:15,672][106151] Avg episode reward: [(0, '4470.643')] [2023-03-12 01:29:19,232][106434] Updated weights for policy 0, policy_version 182880 (0.0005) [2023-03-12 01:29:20,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 11718.7). Total num frames: 93650944. Throughput: 0: 11539.4. Samples: 93618240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:29:20,672][106151] Avg episode reward: [(0, '4238.172')] [2023-03-12 01:29:22,775][106434] Updated weights for policy 0, policy_version 182960 (0.0005) [2023-03-12 01:29:25,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11718.7). Total num frames: 93708288. Throughput: 0: 11538.8. Samples: 93687872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:29:25,662][106151] Avg episode reward: [(0, '4278.385')] [2023-03-12 01:29:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000183024_93708288.pth... [2023-03-12 01:29:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000182344_93360128.pth [2023-03-12 01:29:26,244][106434] Updated weights for policy 0, policy_version 183040 (0.0005) [2023-03-12 01:29:29,806][106434] Updated weights for policy 0, policy_version 183120 (0.0005) [2023-03-12 01:29:30,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11718.7). Total num frames: 93765632. Throughput: 0: 11560.0. Samples: 93757512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:29:30,672][106151] Avg episode reward: [(0, '4427.814')] [2023-03-12 01:29:33,296][106434] Updated weights for policy 0, policy_version 183200 (0.0004) [2023-03-12 01:29:35,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11718.7). Total num frames: 93822976. Throughput: 0: 11577.9. Samples: 93792840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:29:35,672][106151] Avg episode reward: [(0, '4426.686')] [2023-03-12 01:29:36,820][106434] Updated weights for policy 0, policy_version 183280 (0.0005) [2023-03-12 01:29:40,373][106434] Updated weights for policy 0, policy_version 183360 (0.0005) [2023-03-12 01:29:40,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11718.7). Total num frames: 93880320. Throughput: 0: 11630.1. Samples: 93863456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:29:40,661][106151] Avg episode reward: [(0, '4467.570')] [2023-03-12 01:29:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000183360_93880320.pth... [2023-03-12 01:29:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000182680_93532160.pth [2023-03-12 01:29:43,832][106434] Updated weights for policy 0, policy_version 183440 (0.0005) [2023-03-12 01:29:45,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11732.6). Total num frames: 93941760. Throughput: 0: 11635.2. Samples: 93932984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:29:45,662][106151] Avg episode reward: [(0, '4391.114')] [2023-03-12 01:29:47,386][106434] Updated weights for policy 0, policy_version 183520 (0.0005) [2023-03-12 01:29:50,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11718.7). Total num frames: 93999104. Throughput: 0: 11616.7. Samples: 93967400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:29:50,661][106151] Avg episode reward: [(0, '4397.533')] [2023-03-12 01:29:50,812][106434] Updated weights for policy 0, policy_version 183600 (0.0005) [2023-03-12 01:29:54,354][106434] Updated weights for policy 0, policy_version 183680 (0.0005) [2023-03-12 01:29:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11718.7). Total num frames: 94056448. Throughput: 0: 11642.5. Samples: 94037892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:29:55,661][106151] Avg episode reward: [(0, '4306.991')] [2023-03-12 01:29:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000183704_94056448.pth... [2023-03-12 01:29:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000183024_93708288.pth [2023-03-12 01:29:57,877][106434] Updated weights for policy 0, policy_version 183760 (0.0005) [2023-03-12 01:30:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11718.7). Total num frames: 94113792. Throughput: 0: 11646.2. Samples: 94107752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:30:00,661][106151] Avg episode reward: [(0, '4382.765')] [2023-03-12 01:30:01,469][106434] Updated weights for policy 0, policy_version 183840 (0.0005) [2023-03-12 01:30:05,013][106434] Updated weights for policy 0, policy_version 183920 (0.0005) [2023-03-12 01:30:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11704.8). Total num frames: 94171136. Throughput: 0: 11640.0. Samples: 94142040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:30:05,661][106151] Avg episode reward: [(0, '4274.801')] [2023-03-12 01:30:08,548][106434] Updated weights for policy 0, policy_version 184000 (0.0005) [2023-03-12 01:30:10,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11732.6). Total num frames: 94232576. Throughput: 0: 11640.7. Samples: 94211704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:30:10,661][106151] Avg episode reward: [(0, '4236.105')] [2023-03-12 01:30:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000184048_94232576.pth... [2023-03-12 01:30:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000183360_93880320.pth [2023-03-12 01:30:12,043][106434] Updated weights for policy 0, policy_version 184080 (0.0005) [2023-03-12 01:30:15,642][106434] Updated weights for policy 0, policy_version 184160 (0.0005) [2023-03-12 01:30:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11718.7). Total num frames: 94289920. Throughput: 0: 11634.1. Samples: 94281048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:30:15,661][106151] Avg episode reward: [(0, '4283.947')] [2023-03-12 01:30:19,145][106434] Updated weights for policy 0, policy_version 184240 (0.0005) [2023-03-12 01:30:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11718.7). Total num frames: 94347264. Throughput: 0: 11617.6. Samples: 94315632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:30:20,661][106151] Avg episode reward: [(0, '4331.067')] [2023-03-12 01:30:22,720][106434] Updated weights for policy 0, policy_version 184320 (0.0005) [2023-03-12 01:30:25,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11718.7). Total num frames: 94404608. Throughput: 0: 11572.1. Samples: 94384200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:30:25,662][106151] Avg episode reward: [(0, '4298.720')] [2023-03-12 01:30:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000184384_94404608.pth... [2023-03-12 01:30:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000183704_94056448.pth [2023-03-12 01:30:26,261][106434] Updated weights for policy 0, policy_version 184400 (0.0005) [2023-03-12 01:30:29,829][106434] Updated weights for policy 0, policy_version 184480 (0.0005) [2023-03-12 01:30:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11718.7). Total num frames: 94461952. Throughput: 0: 11574.2. Samples: 94453824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:30:30,662][106151] Avg episode reward: [(0, '4257.592')] [2023-03-12 01:30:33,405][106434] Updated weights for policy 0, policy_version 184560 (0.0005) [2023-03-12 01:30:35,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11732.6). Total num frames: 94519296. Throughput: 0: 11566.3. Samples: 94487884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:30:35,661][106151] Avg episode reward: [(0, '4429.690')] [2023-03-12 01:30:36,998][106434] Updated weights for policy 0, policy_version 184640 (0.0005) [2023-03-12 01:30:40,485][106434] Updated weights for policy 0, policy_version 184720 (0.0005) [2023-03-12 01:30:40,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11718.7). Total num frames: 94576640. Throughput: 0: 11540.8. Samples: 94557228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:30:40,662][106151] Avg episode reward: [(0, '4254.874')] [2023-03-12 01:30:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000184720_94576640.pth... [2023-03-12 01:30:40,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000184048_94232576.pth [2023-03-12 01:30:44,016][106434] Updated weights for policy 0, policy_version 184800 (0.0005) [2023-03-12 01:30:45,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11718.7). Total num frames: 94633984. Throughput: 0: 11542.6. Samples: 94627168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:30:45,661][106151] Avg episode reward: [(0, '4209.947')] [2023-03-12 01:30:47,501][106434] Updated weights for policy 0, policy_version 184880 (0.0005) [2023-03-12 01:30:50,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11718.7). Total num frames: 94691328. Throughput: 0: 11569.4. Samples: 94662664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:30:50,661][106151] Avg episode reward: [(0, '4342.950')] [2023-03-12 01:30:51,069][106434] Updated weights for policy 0, policy_version 184960 (0.0005) [2023-03-12 01:30:54,567][106434] Updated weights for policy 0, policy_version 185040 (0.0005) [2023-03-12 01:30:55,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11732.6). Total num frames: 94752768. Throughput: 0: 11568.5. Samples: 94732288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:30:55,661][106151] Avg episode reward: [(0, '4383.670')] [2023-03-12 01:30:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000185064_94752768.pth... [2023-03-12 01:30:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000184384_94404608.pth [2023-03-12 01:30:58,085][106434] Updated weights for policy 0, policy_version 185120 (0.0005) [2023-03-12 01:31:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11732.6). Total num frames: 94810112. Throughput: 0: 11575.1. Samples: 94801928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:31:00,661][106151] Avg episode reward: [(0, '4205.704')] [2023-03-12 01:31:01,620][106434] Updated weights for policy 0, policy_version 185200 (0.0005) [2023-03-12 01:31:05,139][106434] Updated weights for policy 0, policy_version 185280 (0.0005) [2023-03-12 01:31:05,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11732.6). Total num frames: 94867456. Throughput: 0: 11570.9. Samples: 94836324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:31:05,661][106151] Avg episode reward: [(0, '4393.013')] [2023-03-12 01:31:06,242][106390] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000005 [2023-03-12 01:31:08,769][106434] Updated weights for policy 0, policy_version 185360 (0.0005) [2023-03-12 01:31:10,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 94924800. Throughput: 0: 11566.6. Samples: 94904696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:31:10,661][106151] Avg episode reward: [(0, '4308.963')] [2023-03-12 01:31:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000185400_94924800.pth... [2023-03-12 01:31:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000184720_94576640.pth [2023-03-12 01:31:12,373][106434] Updated weights for policy 0, policy_version 185440 (0.0005) [2023-03-12 01:31:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 94982144. Throughput: 0: 11554.0. Samples: 94973752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:31:15,661][106151] Avg episode reward: [(0, '4439.741')] [2023-03-12 01:31:15,971][106434] Updated weights for policy 0, policy_version 185520 (0.0005) [2023-03-12 01:31:19,531][106434] Updated weights for policy 0, policy_version 185600 (0.0005) [2023-03-12 01:31:20,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11704.8). Total num frames: 95039488. Throughput: 0: 11543.8. Samples: 95007356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:31:20,661][106151] Avg episode reward: [(0, '4475.989')] [2023-03-12 01:31:23,155][106434] Updated weights for policy 0, policy_version 185680 (0.0005) [2023-03-12 01:31:25,661][106151] Fps is (10 sec: 11059.2, 60 sec: 11468.8, 300 sec: 11677.1). Total num frames: 95092736. Throughput: 0: 11530.1. Samples: 95076080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:31:25,661][106151] Avg episode reward: [(0, '4306.730')] [2023-03-12 01:31:25,719][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000185736_95096832.pth... [2023-03-12 01:31:25,721][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000185064_94752768.pth [2023-03-12 01:31:26,783][106434] Updated weights for policy 0, policy_version 185760 (0.0005) [2023-03-12 01:31:30,444][106434] Updated weights for policy 0, policy_version 185840 (0.0005) [2023-03-12 01:31:30,661][106151] Fps is (10 sec: 11059.3, 60 sec: 11468.8, 300 sec: 11691.0). Total num frames: 95150080. Throughput: 0: 11471.1. Samples: 95143368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:31:30,661][106151] Avg episode reward: [(0, '4287.268')] [2023-03-12 01:31:34,132][106434] Updated weights for policy 0, policy_version 185920 (0.0005) [2023-03-12 01:31:35,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11691.0). Total num frames: 95207424. Throughput: 0: 11420.6. Samples: 95176592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:31:35,661][106151] Avg episode reward: [(0, '4479.899')] [2023-03-12 01:31:37,756][106434] Updated weights for policy 0, policy_version 186000 (0.0005) [2023-03-12 01:31:40,661][106151] Fps is (10 sec: 11059.0, 60 sec: 11400.5, 300 sec: 11677.1). Total num frames: 95260672. Throughput: 0: 11378.1. Samples: 95244304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:31:40,662][106151] Avg episode reward: [(0, '4345.760')] [2023-03-12 01:31:40,688][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000186064_95264768.pth... [2023-03-12 01:31:40,690][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000185400_94924800.pth [2023-03-12 01:31:41,424][106434] Updated weights for policy 0, policy_version 186080 (0.0005) [2023-03-12 01:31:45,028][106434] Updated weights for policy 0, policy_version 186160 (0.0005) [2023-03-12 01:31:45,661][106151] Fps is (10 sec: 11059.3, 60 sec: 11400.5, 300 sec: 11677.1). Total num frames: 95318016. Throughput: 0: 11332.1. Samples: 95311872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:31:45,661][106151] Avg episode reward: [(0, '4425.257')] [2023-03-12 01:31:48,615][106434] Updated weights for policy 0, policy_version 186240 (0.0005) [2023-03-12 01:31:50,661][106151] Fps is (10 sec: 11469.0, 60 sec: 11400.5, 300 sec: 11663.2). Total num frames: 95375360. Throughput: 0: 11341.4. Samples: 95346688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:31:50,661][106151] Avg episode reward: [(0, '4514.288')] [2023-03-12 01:31:52,132][106434] Updated weights for policy 0, policy_version 186320 (0.0005) [2023-03-12 01:31:55,468][106434] Updated weights for policy 0, policy_version 186400 (0.0004) [2023-03-12 01:31:55,661][106151] Fps is (10 sec: 11878.2, 60 sec: 11400.5, 300 sec: 11691.0). Total num frames: 95436800. Throughput: 0: 11371.0. Samples: 95416392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:31:55,662][106151] Avg episode reward: [(0, '4476.112')] [2023-03-12 01:31:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000186400_95436800.pth... [2023-03-12 01:31:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000185736_95096832.pth [2023-03-12 01:31:58,802][106434] Updated weights for policy 0, policy_version 186480 (0.0004) [2023-03-12 01:32:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11468.8, 300 sec: 11704.8). Total num frames: 95498240. Throughput: 0: 11473.5. Samples: 95490060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:32:00,661][106151] Avg episode reward: [(0, '4481.332')] [2023-03-12 01:32:02,172][106434] Updated weights for policy 0, policy_version 186560 (0.0004) [2023-03-12 01:32:05,438][106434] Updated weights for policy 0, policy_version 186640 (0.0003) [2023-03-12 01:32:05,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11537.1, 300 sec: 11718.7). Total num frames: 95559680. Throughput: 0: 11547.1. Samples: 95526976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:32:05,661][106151] Avg episode reward: [(0, '4520.582')] [2023-03-12 01:32:08,641][106434] Updated weights for policy 0, policy_version 186720 (0.0003) [2023-03-12 01:32:10,661][106151] Fps is (10 sec: 12697.5, 60 sec: 11673.6, 300 sec: 11746.5). Total num frames: 95625216. Throughput: 0: 11707.8. Samples: 95602932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:32:10,662][106151] Avg episode reward: [(0, '4488.378')] [2023-03-12 01:32:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000186768_95625216.pth... [2023-03-12 01:32:10,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000186064_95264768.pth [2023-03-12 01:32:11,935][106434] Updated weights for policy 0, policy_version 186800 (0.0003) [2023-03-12 01:32:15,235][106434] Updated weights for policy 0, policy_version 186880 (0.0004) [2023-03-12 01:32:15,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11741.9, 300 sec: 11760.4). Total num frames: 95686656. Throughput: 0: 11865.7. Samples: 95677324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:32:15,661][106151] Avg episode reward: [(0, '4403.196')] [2023-03-12 01:32:18,525][106434] Updated weights for policy 0, policy_version 186960 (0.0004) [2023-03-12 01:32:20,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11810.1, 300 sec: 11774.3). Total num frames: 95748096. Throughput: 0: 11967.3. Samples: 95715120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:32:20,661][106151] Avg episode reward: [(0, '4431.264')] [2023-03-12 01:32:21,951][106434] Updated weights for policy 0, policy_version 187040 (0.0005) [2023-03-12 01:32:25,525][106434] Updated weights for policy 0, policy_version 187120 (0.0005) [2023-03-12 01:32:25,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 11760.4). Total num frames: 95805440. Throughput: 0: 12058.3. Samples: 95786924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:32:25,661][106151] Avg episode reward: [(0, '4482.687')] [2023-03-12 01:32:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000187120_95805440.pth... [2023-03-12 01:32:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000186400_95436800.pth [2023-03-12 01:32:29,036][106434] Updated weights for policy 0, policy_version 187200 (0.0005) [2023-03-12 01:32:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11746.5). Total num frames: 95862784. Throughput: 0: 12088.7. Samples: 95855864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:32:30,661][106151] Avg episode reward: [(0, '4443.124')] [2023-03-12 01:32:32,318][106434] Updated weights for policy 0, policy_version 187280 (0.0004) [2023-03-12 01:32:35,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11732.6). Total num frames: 95924224. Throughput: 0: 12147.2. Samples: 95893312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:32:35,661][106151] Avg episode reward: [(0, '4479.929')] [2023-03-12 01:32:35,695][106434] Updated weights for policy 0, policy_version 187360 (0.0005) [2023-03-12 01:32:39,014][106434] Updated weights for policy 0, policy_version 187440 (0.0004) [2023-03-12 01:32:40,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11732.6). Total num frames: 95985664. Throughput: 0: 12235.8. Samples: 95967004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:32:40,661][106151] Avg episode reward: [(0, '4480.657')] [2023-03-12 01:32:40,677][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000187480_95989760.pth... [2023-03-12 01:32:40,679][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000186768_95625216.pth [2023-03-12 01:32:42,360][106434] Updated weights for policy 0, policy_version 187520 (0.0004) [2023-03-12 01:32:45,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11732.6). Total num frames: 96047104. Throughput: 0: 12197.2. Samples: 96038936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:32:45,661][106151] Avg episode reward: [(0, '4480.066')] [2023-03-12 01:32:45,900][106434] Updated weights for policy 0, policy_version 187600 (0.0005) [2023-03-12 01:32:49,509][106434] Updated weights for policy 0, policy_version 187680 (0.0005) [2023-03-12 01:32:50,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11718.7). Total num frames: 96104448. Throughput: 0: 12136.9. Samples: 96073136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:32:50,661][106151] Avg episode reward: [(0, '4531.584')] [2023-03-12 01:32:52,876][106434] Updated weights for policy 0, policy_version 187760 (0.0003) [2023-03-12 01:32:55,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11718.7). Total num frames: 96165888. Throughput: 0: 12031.1. Samples: 96144332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:32:55,661][106151] Avg episode reward: [(0, '4436.986')] [2023-03-12 01:32:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000187824_96165888.pth... [2023-03-12 01:32:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000187120_95805440.pth [2023-03-12 01:32:56,297][106434] Updated weights for policy 0, policy_version 187840 (0.0004) [2023-03-12 01:32:59,707][106434] Updated weights for policy 0, policy_version 187920 (0.0004) [2023-03-12 01:33:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11691.0). Total num frames: 96223232. Throughput: 0: 11974.6. Samples: 96216180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:33:00,661][106151] Avg episode reward: [(0, '4528.215')] [2023-03-12 01:33:03,173][106434] Updated weights for policy 0, policy_version 188000 (0.0003) [2023-03-12 01:33:05,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11691.0). Total num frames: 96284672. Throughput: 0: 11929.0. Samples: 96251924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:33:05,662][106151] Avg episode reward: [(0, '4474.081')] [2023-03-12 01:33:06,528][106434] Updated weights for policy 0, policy_version 188080 (0.0003) [2023-03-12 01:33:09,960][106434] Updated weights for policy 0, policy_version 188160 (0.0003) [2023-03-12 01:33:10,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11677.1). Total num frames: 96342016. Throughput: 0: 11937.8. Samples: 96324124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:33:10,662][106151] Avg episode reward: [(0, '4531.084')] [2023-03-12 01:33:10,679][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000188176_96346112.pth... [2023-03-12 01:33:10,680][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000187480_95989760.pth [2023-03-12 01:33:13,540][106434] Updated weights for policy 0, policy_version 188240 (0.0005) [2023-03-12 01:33:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11677.1). Total num frames: 96403456. Throughput: 0: 11964.3. Samples: 96394256. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:33:15,662][106151] Avg episode reward: [(0, '4446.065')] [2023-03-12 01:33:17,039][106434] Updated weights for policy 0, policy_version 188320 (0.0005) [2023-03-12 01:33:20,427][106434] Updated weights for policy 0, policy_version 188400 (0.0004) [2023-03-12 01:33:20,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 11677.1). Total num frames: 96460800. Throughput: 0: 11896.2. Samples: 96428640. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:33:20,661][106151] Avg episode reward: [(0, '4521.011')] [2023-03-12 01:33:23,718][106434] Updated weights for policy 0, policy_version 188480 (0.0004) [2023-03-12 01:33:25,661][106151] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11691.0). Total num frames: 96522240. Throughput: 0: 11908.9. Samples: 96502904. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:33:25,662][106151] Avg episode reward: [(0, '4523.920')] [2023-03-12 01:33:25,699][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000188528_96526336.pth... [2023-03-12 01:33:25,701][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000187824_96165888.pth [2023-03-12 01:33:27,012][106434] Updated weights for policy 0, policy_version 188560 (0.0004) [2023-03-12 01:33:30,287][106434] Updated weights for policy 0, policy_version 188640 (0.0004) [2023-03-12 01:33:30,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12083.2, 300 sec: 11718.7). Total num frames: 96587776. Throughput: 0: 11974.3. Samples: 96577780. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:33:30,661][106151] Avg episode reward: [(0, '4442.460')] [2023-03-12 01:33:33,564][106434] Updated weights for policy 0, policy_version 188720 (0.0004) [2023-03-12 01:33:35,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12083.2, 300 sec: 11732.6). Total num frames: 96649216. Throughput: 0: 12042.8. Samples: 96615060. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:33:35,661][106151] Avg episode reward: [(0, '4396.708')] [2023-03-12 01:33:36,856][106434] Updated weights for policy 0, policy_version 188800 (0.0004) [2023-03-12 01:33:40,188][106434] Updated weights for policy 0, policy_version 188880 (0.0004) [2023-03-12 01:33:40,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11746.5). Total num frames: 96710656. Throughput: 0: 12124.8. Samples: 96689948. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:33:40,662][106151] Avg episode reward: [(0, '4427.763')] [2023-03-12 01:33:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000188888_96710656.pth... [2023-03-12 01:33:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000188176_96346112.pth [2023-03-12 01:33:43,434][106434] Updated weights for policy 0, policy_version 188960 (0.0004) [2023-03-12 01:33:45,661][106151] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11760.4). Total num frames: 96772096. Throughput: 0: 12194.5. Samples: 96764932. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:33:45,661][106151] Avg episode reward: [(0, '4445.000')] [2023-03-12 01:33:46,708][106434] Updated weights for policy 0, policy_version 189040 (0.0004) [2023-03-12 01:33:49,887][106434] Updated weights for policy 0, policy_version 189120 (0.0003) [2023-03-12 01:33:50,661][106151] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 11788.2). Total num frames: 96837632. Throughput: 0: 12236.7. Samples: 96802576. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:33:50,662][106151] Avg episode reward: [(0, '4357.799')] [2023-03-12 01:33:53,176][106434] Updated weights for policy 0, policy_version 189200 (0.0004) [2023-03-12 01:33:55,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12219.7, 300 sec: 11802.0). Total num frames: 96899072. Throughput: 0: 12322.9. Samples: 96878656. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:33:55,662][106151] Avg episode reward: [(0, '4494.268')] [2023-03-12 01:33:55,666][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000189256_96899072.pth... [2023-03-12 01:33:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000188528_96526336.pth [2023-03-12 01:33:56,419][106434] Updated weights for policy 0, policy_version 189280 (0.0003) [2023-03-12 01:33:59,759][106434] Updated weights for policy 0, policy_version 189360 (0.0004) [2023-03-12 01:34:00,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 11815.9). Total num frames: 96960512. Throughput: 0: 12413.1. Samples: 96952844. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:34:00,661][106151] Avg episode reward: [(0, '4487.080')] [2023-03-12 01:34:03,169][106434] Updated weights for policy 0, policy_version 189440 (0.0004) [2023-03-12 01:34:05,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12219.7, 300 sec: 11815.9). Total num frames: 97017856. Throughput: 0: 12458.1. Samples: 96989256. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:34:05,661][106151] Avg episode reward: [(0, '4398.685')] [2023-03-12 01:34:06,719][106434] Updated weights for policy 0, policy_version 189520 (0.0005) [2023-03-12 01:34:10,307][106434] Updated weights for policy 0, policy_version 189600 (0.0005) [2023-03-12 01:34:10,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12288.0, 300 sec: 11815.9). Total num frames: 97079296. Throughput: 0: 12355.0. Samples: 97058880. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:34:10,661][106151] Avg episode reward: [(0, '4395.144')] [2023-03-12 01:34:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000189608_97079296.pth... [2023-03-12 01:34:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000188888_96710656.pth [2023-03-12 01:34:13,908][106434] Updated weights for policy 0, policy_version 189680 (0.0005) [2023-03-12 01:34:15,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 11802.0). Total num frames: 97132544. Throughput: 0: 12215.9. Samples: 97127496. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:34:15,661][106151] Avg episode reward: [(0, '4441.288')] [2023-03-12 01:34:17,448][106434] Updated weights for policy 0, policy_version 189760 (0.0004) [2023-03-12 01:34:20,661][106151] Fps is (10 sec: 11059.3, 60 sec: 12151.5, 300 sec: 11802.0). Total num frames: 97189888. Throughput: 0: 12138.2. Samples: 97161280. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-12 01:34:20,661][106151] Avg episode reward: [(0, '4491.936')] [2023-03-12 01:34:21,160][106434] Updated weights for policy 0, policy_version 189840 (0.0005) [2023-03-12 01:34:24,727][106434] Updated weights for policy 0, policy_version 189920 (0.0004) [2023-03-12 01:34:25,661][106151] Fps is (10 sec: 11468.7, 60 sec: 12083.2, 300 sec: 11802.0). Total num frames: 97247232. Throughput: 0: 11965.4. Samples: 97228392. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:34:25,661][106151] Avg episode reward: [(0, '4488.512')] [2023-03-12 01:34:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000189936_97247232.pth... [2023-03-12 01:34:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000189256_96899072.pth [2023-03-12 01:34:28,312][106434] Updated weights for policy 0, policy_version 190000 (0.0005) [2023-03-12 01:34:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11802.0). Total num frames: 97304576. Throughput: 0: 11832.7. Samples: 97297404. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:34:30,661][106151] Avg episode reward: [(0, '4408.875')] [2023-03-12 01:34:31,896][106434] Updated weights for policy 0, policy_version 190080 (0.0005) [2023-03-12 01:34:35,434][106434] Updated weights for policy 0, policy_version 190160 (0.0005) [2023-03-12 01:34:35,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11878.4, 300 sec: 11802.0). Total num frames: 97361920. Throughput: 0: 11761.4. Samples: 97331840. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:34:35,661][106151] Avg episode reward: [(0, '4481.326')] [2023-03-12 01:34:38,979][106434] Updated weights for policy 0, policy_version 190240 (0.0005) [2023-03-12 01:34:40,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 11788.1). Total num frames: 97419264. Throughput: 0: 11613.5. Samples: 97401264. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:34:40,661][106151] Avg episode reward: [(0, '4482.390')] [2023-03-12 01:34:40,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000190272_97419264.pth... [2023-03-12 01:34:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000189608_97079296.pth [2023-03-12 01:34:42,551][106434] Updated weights for policy 0, policy_version 190320 (0.0005) [2023-03-12 01:34:45,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11802.0). Total num frames: 97480704. Throughput: 0: 11508.7. Samples: 97470736. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:34:45,661][106151] Avg episode reward: [(0, '4354.906')] [2023-03-12 01:34:45,988][106434] Updated weights for policy 0, policy_version 190400 (0.0005) [2023-03-12 01:34:49,215][106434] Updated weights for policy 0, policy_version 190480 (0.0004) [2023-03-12 01:34:50,661][106151] Fps is (10 sec: 12288.1, 60 sec: 11741.9, 300 sec: 11815.9). Total num frames: 97542144. Throughput: 0: 11521.8. Samples: 97507736. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:34:50,661][106151] Avg episode reward: [(0, '4484.308')] [2023-03-12 01:34:52,532][106434] Updated weights for policy 0, policy_version 190560 (0.0005) [2023-03-12 01:34:55,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11741.9, 300 sec: 11829.8). Total num frames: 97603584. Throughput: 0: 11650.8. Samples: 97583168. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:34:55,661][106151] Avg episode reward: [(0, '4348.139')] [2023-03-12 01:34:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000190632_97603584.pth... [2023-03-12 01:34:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000189936_97247232.pth [2023-03-12 01:34:55,892][106434] Updated weights for policy 0, policy_version 190640 (0.0004) [2023-03-12 01:34:59,434][106434] Updated weights for policy 0, policy_version 190720 (0.0005) [2023-03-12 01:35:00,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11829.8). Total num frames: 97660928. Throughput: 0: 11679.6. Samples: 97653080. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:35:00,661][106151] Avg episode reward: [(0, '4401.376')] [2023-03-12 01:35:02,925][106434] Updated weights for policy 0, policy_version 190800 (0.0005) [2023-03-12 01:35:05,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 11815.9). Total num frames: 97718272. Throughput: 0: 11718.9. Samples: 97688632. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:35:05,661][106151] Avg episode reward: [(0, '4441.374')] [2023-03-12 01:35:06,354][106434] Updated weights for policy 0, policy_version 190880 (0.0004) [2023-03-12 01:35:09,713][106434] Updated weights for policy 0, policy_version 190960 (0.0003) [2023-03-12 01:35:10,661][106151] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11843.7). Total num frames: 97783808. Throughput: 0: 11829.6. Samples: 97760724. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:35:10,661][106151] Avg episode reward: [(0, '4479.511')] [2023-03-12 01:35:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000190984_97783808.pth... [2023-03-12 01:35:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000190272_97419264.pth [2023-03-12 01:35:12,924][106434] Updated weights for policy 0, policy_version 191040 (0.0003) [2023-03-12 01:35:15,661][106151] Fps is (10 sec: 12697.6, 60 sec: 11878.4, 300 sec: 11857.6). Total num frames: 97845248. Throughput: 0: 11970.0. Samples: 97836052. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:35:15,661][106151] Avg episode reward: [(0, '4393.172')] [2023-03-12 01:35:16,260][106434] Updated weights for policy 0, policy_version 191120 (0.0004) [2023-03-12 01:35:19,812][106434] Updated weights for policy 0, policy_version 191200 (0.0005) [2023-03-12 01:35:20,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11857.6). Total num frames: 97902592. Throughput: 0: 12001.8. Samples: 97871920. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:35:20,672][106151] Avg episode reward: [(0, '4526.839')] [2023-03-12 01:35:23,384][106434] Updated weights for policy 0, policy_version 191280 (0.0005) [2023-03-12 01:35:25,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11878.4, 300 sec: 11857.6). Total num frames: 97959936. Throughput: 0: 11979.1. Samples: 97940324. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-12 01:35:25,661][106151] Avg episode reward: [(0, '4488.064')] [2023-03-12 01:35:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000191328_97959936.pth... [2023-03-12 01:35:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000190632_97603584.pth [2023-03-12 01:35:26,844][106434] Updated weights for policy 0, policy_version 191360 (0.0004) [2023-03-12 01:35:30,058][106434] Updated weights for policy 0, policy_version 191440 (0.0003) [2023-03-12 01:35:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11871.5). Total num frames: 98021376. Throughput: 0: 12070.9. Samples: 98013928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:35:30,672][106151] Avg episode reward: [(0, '4541.462')] [2023-03-12 01:35:30,684][106390] Saving new best policy, reward=4541.462! [2023-03-12 01:35:33,457][106434] Updated weights for policy 0, policy_version 191520 (0.0004) [2023-03-12 01:35:35,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11885.3). Total num frames: 98082816. Throughput: 0: 12066.8. Samples: 98050744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:35:35,672][106151] Avg episode reward: [(0, '4539.365')] [2023-03-12 01:35:37,051][106434] Updated weights for policy 0, policy_version 191600 (0.0005) [2023-03-12 01:35:40,643][106434] Updated weights for policy 0, policy_version 191680 (0.0005) [2023-03-12 01:35:40,661][106151] Fps is (10 sec: 11878.3, 60 sec: 12014.9, 300 sec: 11885.3). Total num frames: 98140160. Throughput: 0: 11922.7. Samples: 98119692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:35:40,662][106151] Avg episode reward: [(0, '4530.174')] [2023-03-12 01:35:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000191680_98140160.pth... [2023-03-12 01:35:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000190984_97783808.pth [2023-03-12 01:35:44,187][106434] Updated weights for policy 0, policy_version 191760 (0.0005) [2023-03-12 01:35:45,661][106151] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11885.3). Total num frames: 98197504. Throughput: 0: 11902.9. Samples: 98188712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:35:45,661][106151] Avg episode reward: [(0, '4525.569')] [2023-03-12 01:35:47,481][106434] Updated weights for policy 0, policy_version 191840 (0.0004) [2023-03-12 01:35:50,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 11885.3). Total num frames: 98258944. Throughput: 0: 11946.8. Samples: 98226240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:35:50,661][106151] Avg episode reward: [(0, '4439.607')] [2023-03-12 01:35:50,803][106434] Updated weights for policy 0, policy_version 191920 (0.0004) [2023-03-12 01:35:54,046][106434] Updated weights for policy 0, policy_version 192000 (0.0004) [2023-03-12 01:35:55,661][106151] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 11899.2). Total num frames: 98320384. Throughput: 0: 12006.1. Samples: 98301000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:35:55,662][106151] Avg episode reward: [(0, '4532.891')] [2023-03-12 01:35:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000192032_98320384.pth... [2023-03-12 01:35:55,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000191328_97959936.pth [2023-03-12 01:35:57,593][106434] Updated weights for policy 0, policy_version 192080 (0.0005) [2023-03-12 01:36:00,661][106151] Fps is (10 sec: 11878.2, 60 sec: 11946.6, 300 sec: 11899.2). Total num frames: 98377728. Throughput: 0: 11892.4. Samples: 98371212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:36:00,662][106151] Avg episode reward: [(0, '4443.606')] [2023-03-12 01:36:01,108][106434] Updated weights for policy 0, policy_version 192160 (0.0005) [2023-03-12 01:36:04,638][106434] Updated weights for policy 0, policy_version 192240 (0.0005) [2023-03-12 01:36:05,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12014.9, 300 sec: 11913.1). Total num frames: 98439168. Throughput: 0: 11868.2. Samples: 98405988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:36:05,661][106151] Avg episode reward: [(0, '4520.660')] [2023-03-12 01:36:07,917][106434] Updated weights for policy 0, policy_version 192320 (0.0004) [2023-03-12 01:36:10,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11913.1). Total num frames: 98496512. Throughput: 0: 11969.7. Samples: 98478960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:36:10,661][106151] Avg episode reward: [(0, '4492.149')] [2023-03-12 01:36:10,673][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000192384_98500608.pth... [2023-03-12 01:36:10,675][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000191680_98140160.pth [2023-03-12 01:36:11,382][106434] Updated weights for policy 0, policy_version 192400 (0.0005) [2023-03-12 01:36:14,915][106434] Updated weights for policy 0, policy_version 192480 (0.0005) [2023-03-12 01:36:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11927.0). Total num frames: 98557952. Throughput: 0: 11898.7. Samples: 98549372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:36:15,661][106151] Avg episode reward: [(0, '4483.585')] [2023-03-12 01:36:18,472][106434] Updated weights for policy 0, policy_version 192560 (0.0005) [2023-03-12 01:36:20,661][106151] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 11940.9). Total num frames: 98615296. Throughput: 0: 11829.7. Samples: 98583080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:36:20,661][106151] Avg episode reward: [(0, '4483.392')] [2023-03-12 01:36:21,965][106434] Updated weights for policy 0, policy_version 192640 (0.0004) [2023-03-12 01:36:25,475][106434] Updated weights for policy 0, policy_version 192720 (0.0004) [2023-03-12 01:36:25,661][106151] Fps is (10 sec: 11468.7, 60 sec: 11878.4, 300 sec: 11940.9). Total num frames: 98672640. Throughput: 0: 11834.0. Samples: 98652224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:36:25,662][106151] Avg episode reward: [(0, '4484.318')] [2023-03-12 01:36:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000192720_98672640.pth... [2023-03-12 01:36:25,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000192032_98320384.pth [2023-03-12 01:36:28,700][106434] Updated weights for policy 0, policy_version 192800 (0.0004) [2023-03-12 01:36:30,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11954.8). Total num frames: 98734080. Throughput: 0: 11981.4. Samples: 98727876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:36:30,661][106151] Avg episode reward: [(0, '4316.162')] [2023-03-12 01:36:31,991][106434] Updated weights for policy 0, policy_version 192880 (0.0004) [2023-03-12 01:36:35,160][106434] Updated weights for policy 0, policy_version 192960 (0.0004) [2023-03-12 01:36:35,661][106151] Fps is (10 sec: 12697.7, 60 sec: 11946.7, 300 sec: 11996.4). Total num frames: 98799616. Throughput: 0: 11981.1. Samples: 98765388. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:36:35,661][106151] Avg episode reward: [(0, '4538.693')] [2023-03-12 01:36:38,419][106434] Updated weights for policy 0, policy_version 193040 (0.0004) [2023-03-12 01:36:40,661][106151] Fps is (10 sec: 12697.5, 60 sec: 12014.9, 300 sec: 12010.3). Total num frames: 98861056. Throughput: 0: 12004.4. Samples: 98841200. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:36:40,662][106151] Avg episode reward: [(0, '4491.686')] [2023-03-12 01:36:40,693][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000193096_98865152.pth... [2023-03-12 01:36:40,695][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000192384_98500608.pth [2023-03-12 01:36:41,699][106434] Updated weights for policy 0, policy_version 193120 (0.0004) [2023-03-12 01:36:45,015][106434] Updated weights for policy 0, policy_version 193200 (0.0004) [2023-03-12 01:36:45,661][106151] Fps is (10 sec: 12288.1, 60 sec: 12083.2, 300 sec: 12024.2). Total num frames: 98922496. Throughput: 0: 12103.8. Samples: 98915880. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:36:45,661][106151] Avg episode reward: [(0, '4446.667')] [2023-03-12 01:36:48,227][106434] Updated weights for policy 0, policy_version 193280 (0.0004) [2023-03-12 01:36:50,661][106151] Fps is (10 sec: 12697.7, 60 sec: 12151.4, 300 sec: 12038.1). Total num frames: 98988032. Throughput: 0: 12194.6. Samples: 98954744. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:36:50,662][106151] Avg episode reward: [(0, '4530.414')] [2023-03-12 01:36:51,423][106434] Updated weights for policy 0, policy_version 193360 (0.0003) [2023-03-12 01:36:54,849][106434] Updated weights for policy 0, policy_version 193440 (0.0004) [2023-03-12 01:36:55,661][106151] Fps is (10 sec: 12697.4, 60 sec: 12151.5, 300 sec: 12038.1). Total num frames: 99049472. Throughput: 0: 12237.1. Samples: 99029628. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:36:55,662][106151] Avg episode reward: [(0, '4490.632')] [2023-03-12 01:36:55,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000193456_99049472.pth... [2023-03-12 01:36:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000192720_98672640.pth [2023-03-12 01:36:58,193][106434] Updated weights for policy 0, policy_version 193520 (0.0004) [2023-03-12 01:37:00,661][106151] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12038.1). Total num frames: 99110912. Throughput: 0: 12298.0. Samples: 99102784. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:37:00,662][106151] Avg episode reward: [(0, '4483.967')] [2023-03-12 01:37:01,542][106434] Updated weights for policy 0, policy_version 193600 (0.0004) [2023-03-12 01:37:05,056][106434] Updated weights for policy 0, policy_version 193680 (0.0004) [2023-03-12 01:37:05,661][106151] Fps is (10 sec: 11878.5, 60 sec: 12151.5, 300 sec: 12010.3). Total num frames: 99168256. Throughput: 0: 12341.1. Samples: 99138428. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:37:05,662][106151] Avg episode reward: [(0, '4491.157')] [2023-03-12 01:37:08,558][106434] Updated weights for policy 0, policy_version 193760 (0.0005) [2023-03-12 01:37:10,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12010.3). Total num frames: 99229696. Throughput: 0: 12365.3. Samples: 99208660. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:37:10,661][106151] Avg episode reward: [(0, '4490.074')] [2023-03-12 01:37:10,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000193808_99229696.pth... [2023-03-12 01:37:10,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000193096_98865152.pth [2023-03-12 01:37:11,876][106434] Updated weights for policy 0, policy_version 193840 (0.0004) [2023-03-12 01:37:15,356][106434] Updated weights for policy 0, policy_version 193920 (0.0004) [2023-03-12 01:37:15,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11996.4). Total num frames: 99287040. Throughput: 0: 12289.1. Samples: 99280884. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:37:15,661][106151] Avg episode reward: [(0, '4480.891')] [2023-03-12 01:37:18,826][106434] Updated weights for policy 0, policy_version 194000 (0.0005) [2023-03-12 01:37:20,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12010.3). Total num frames: 99348480. Throughput: 0: 12229.6. Samples: 99315720. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:37:20,661][106151] Avg episode reward: [(0, '4386.493')] [2023-03-12 01:37:22,309][106434] Updated weights for policy 0, policy_version 194080 (0.0005) [2023-03-12 01:37:25,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12010.3). Total num frames: 99405824. Throughput: 0: 12120.5. Samples: 99386624. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:37:25,662][106151] Avg episode reward: [(0, '4441.233')] [2023-03-12 01:37:25,665][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000194152_99405824.pth... [2023-03-12 01:37:25,668][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000193456_99049472.pth [2023-03-12 01:37:25,855][106434] Updated weights for policy 0, policy_version 194160 (0.0005) [2023-03-12 01:37:29,375][106434] Updated weights for policy 0, policy_version 194240 (0.0005) [2023-03-12 01:37:30,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 11996.4). Total num frames: 99463168. Throughput: 0: 11992.3. Samples: 99455536. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:37:30,661][106151] Avg episode reward: [(0, '4396.951')] [2023-03-12 01:37:32,955][106434] Updated weights for policy 0, policy_version 194320 (0.0005) [2023-03-12 01:37:35,661][106151] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11982.5). Total num frames: 99520512. Throughput: 0: 11915.4. Samples: 99490936. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-12 01:37:35,661][106151] Avg episode reward: [(0, '4488.751')] [2023-03-12 01:37:36,452][106434] Updated weights for policy 0, policy_version 194400 (0.0005) [2023-03-12 01:37:39,918][106434] Updated weights for policy 0, policy_version 194480 (0.0005) [2023-03-12 01:37:40,661][106151] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11982.5). Total num frames: 99581952. Throughput: 0: 11798.7. Samples: 99560568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:37:40,661][106151] Avg episode reward: [(0, '4447.274')] [2023-03-12 01:37:40,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000194496_99581952.pth... [2023-03-12 01:37:40,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000193808_99229696.pth [2023-03-12 01:37:43,493][106434] Updated weights for policy 0, policy_version 194560 (0.0005) [2023-03-12 01:37:45,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11946.6, 300 sec: 11982.5). Total num frames: 99639296. Throughput: 0: 11734.7. Samples: 99630844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:37:45,661][106151] Avg episode reward: [(0, '4520.179')] [2023-03-12 01:37:47,088][106434] Updated weights for policy 0, policy_version 194640 (0.0004) [2023-03-12 01:37:50,649][106434] Updated weights for policy 0, policy_version 194720 (0.0005) [2023-03-12 01:37:50,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11968.7). Total num frames: 99696640. Throughput: 0: 11678.1. Samples: 99663944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:37:50,661][106151] Avg episode reward: [(0, '4521.577')] [2023-03-12 01:37:54,147][106434] Updated weights for policy 0, policy_version 194800 (0.0005) [2023-03-12 01:37:55,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11968.7). Total num frames: 99753984. Throughput: 0: 11664.8. Samples: 99733576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:37:55,661][106151] Avg episode reward: [(0, '4533.214')] [2023-03-12 01:37:55,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000194832_99753984.pth... [2023-03-12 01:37:55,667][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000194152_99405824.pth [2023-03-12 01:37:57,589][106434] Updated weights for policy 0, policy_version 194880 (0.0004) [2023-03-12 01:38:00,661][106151] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11954.8). Total num frames: 99811328. Throughput: 0: 11641.0. Samples: 99804728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:38:00,661][106151] Avg episode reward: [(0, '4481.376')] [2023-03-12 01:38:01,123][106434] Updated weights for policy 0, policy_version 194960 (0.0005) [2023-03-12 01:38:04,605][106434] Updated weights for policy 0, policy_version 195040 (0.0005) [2023-03-12 01:38:05,661][106151] Fps is (10 sec: 11468.6, 60 sec: 11673.6, 300 sec: 11954.8). Total num frames: 99868672. Throughput: 0: 11650.6. Samples: 99840000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:38:05,662][106151] Avg episode reward: [(0, '4478.403')] [2023-03-12 01:38:08,141][106434] Updated weights for policy 0, policy_version 195120 (0.0005) [2023-03-12 01:38:10,661][106151] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11954.8). Total num frames: 99930112. Throughput: 0: 11622.7. Samples: 99909644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:38:10,661][106151] Avg episode reward: [(0, '4442.667')] [2023-03-12 01:38:10,664][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000195176_99930112.pth... [2023-03-12 01:38:10,666][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000194496_99581952.pth [2023-03-12 01:38:11,632][106434] Updated weights for policy 0, policy_version 195200 (0.0005) [2023-03-12 01:38:15,094][106434] Updated weights for policy 0, policy_version 195280 (0.0005) [2023-03-12 01:38:15,661][106151] Fps is (10 sec: 11878.6, 60 sec: 11673.6, 300 sec: 11954.8). Total num frames: 99987456. Throughput: 0: 11648.5. Samples: 99979720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-12 01:38:15,661][106151] Avg episode reward: [(0, '4534.038')] [2023-03-12 01:38:16,887][106390] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000000 [2023-03-12 01:38:17,256][106390] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000000 [2023-03-12 01:38:17,257][106390] Stopping Batcher_0... [2023-03-12 01:38:17,257][106439] Stopping RolloutWorker_w4... [2023-03-12 01:38:17,257][106438] Stopping RolloutWorker_w3... [2023-03-12 01:38:17,257][106440] Stopping RolloutWorker_w5... [2023-03-12 01:38:17,257][106435] Stopping RolloutWorker_w1... [2023-03-12 01:38:17,257][106441] Stopping RolloutWorker_w6... [2023-03-12 01:38:17,257][106439] Loop rollout_proc4_evt_loop terminating... [2023-03-12 01:38:17,257][106436] Stopping RolloutWorker_w2... [2023-03-12 01:38:17,257][106437] Stopping RolloutWorker_w0... [2023-03-12 01:38:17,257][106438] Loop rollout_proc3_evt_loop terminating... [2023-03-12 01:38:17,257][106440] Loop rollout_proc5_evt_loop terminating... [2023-03-12 01:38:17,257][106435] Loop rollout_proc1_evt_loop terminating... [2023-03-12 01:38:17,257][106390] Loop batcher_evt_loop terminating... [2023-03-12 01:38:17,257][106441] Loop rollout_proc6_evt_loop terminating... [2023-03-12 01:38:17,257][106436] Loop rollout_proc2_evt_loop terminating... [2023-03-12 01:38:17,257][106504] Stopping RolloutWorker_w7... [2023-03-12 01:38:17,257][106437] Loop rollout_proc0_evt_loop terminating... [2023-03-12 01:38:17,257][106504] Loop rollout_proc7_evt_loop terminating... [2023-03-12 01:38:17,257][106151] Component Batcher_0 stopped! [2023-03-12 01:38:17,257][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000195328_100007936.pth... [2023-03-12 01:38:17,258][106151] Component RolloutWorker_w4 stopped! [2023-03-12 01:38:17,258][106151] Component RolloutWorker_w5 stopped! [2023-03-12 01:38:17,258][106151] Component RolloutWorker_w3 stopped! [2023-03-12 01:38:17,259][106151] Component RolloutWorker_w1 stopped! [2023-03-12 01:38:17,259][106151] Component RolloutWorker_w6 stopped! [2023-03-12 01:38:17,259][106151] Component RolloutWorker_w2 stopped! [2023-03-12 01:38:17,260][106151] Component RolloutWorker_w0 stopped! [2023-03-12 01:38:17,260][106151] Component RolloutWorker_w7 stopped! [2023-03-12 01:38:17,260][106390] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000194832_99753984.pth [2023-03-12 01:38:17,261][106390] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/sweep-v2/checkpoint_p0/checkpoint_000195328_100007936.pth... [2023-03-12 01:38:17,263][106390] Stopping LearnerWorker_p0... [2023-03-12 01:38:17,264][106390] Loop learner_proc0_evt_loop terminating... [2023-03-12 01:38:17,263][106151] Component LearnerWorker_p0 stopped! [2023-03-12 01:38:17,280][106434] Weights refcount: 2 0 [2023-03-12 01:38:17,281][106434] Stopping InferenceWorker_p0-w0... [2023-03-12 01:38:17,281][106434] Loop inference_proc0-0_evt_loop terminating... [2023-03-12 01:38:17,281][106151] Component InferenceWorker_p0-w0 stopped! [2023-03-12 01:38:17,282][106151] Waiting for process learner_proc0 to stop... [2023-03-12 01:38:17,694][106151] Waiting for process inference_proc0-0 to join... [2023-03-12 01:38:17,694][106151] Waiting for process rollout_proc0 to join... [2023-03-12 01:38:17,694][106151] Waiting for process rollout_proc1 to join... [2023-03-12 01:38:17,695][106151] Waiting for process rollout_proc2 to join... [2023-03-12 01:38:17,695][106151] Waiting for process rollout_proc3 to join... [2023-03-12 01:38:17,695][106151] Waiting for process rollout_proc4 to join... [2023-03-12 01:38:17,695][106151] Waiting for process rollout_proc5 to join... [2023-03-12 01:38:17,696][106151] Waiting for process rollout_proc6 to join... [2023-03-12 01:38:17,696][106151] Waiting for process rollout_proc7 to join... [2023-03-12 01:38:17,696][106151] Batcher 0 profile tree view: batching: 17.3725, releasing_batches: 14.9156 [2023-03-12 01:38:17,696][106151] InferenceWorker_p0-w0 profile tree view: wait_policy: 0.0001 wait_policy_total: 2859.4639 update_model: 95.8577 weight_update: 0.0005 one_step: 0.0012 handle_policy_step: 4842.6360 deserialize: 207.1257, stack: 49.9190, obs_to_device_normalize: 851.2827, forward: 2399.4514, send_messages: 368.3866 prepare_outputs: 548.1135 to_cpu: 85.5750 [2023-03-12 01:38:17,697][106151] Learner 0 profile tree view: misc: 0.0849, prepare_batch: 89.5963 train: 1158.4743 epoch_init: 0.3534, minibatch_init: 11.6852, losses_postprocess: 11.8995, kl_divergence: 4.2858, after_optimizer: 4.7705 calculate_losses: 476.2120 losses_init: 0.3315, forward_head: 235.7417, bptt_initial: 1.2098, bptt: 1.1678, tail: 111.9284, advantages_returns: 8.6374, losses: 103.3145 update: 633.7199 clip: 55.7227 [2023-03-12 01:38:17,697][106151] RolloutWorker_w0 profile tree view: wait_for_trajectories: 2.6733, enqueue_policy_requests: 126.3159, env_step: 5535.4235, overhead: 299.5024, complete_rollouts: 3.1618 save_policy_outputs: 321.3306 split_output_tensors: 159.3528 [2023-03-12 01:38:17,697][106151] RolloutWorker_w7 profile tree view: wait_for_trajectories: 2.5965, enqueue_policy_requests: 126.4008, env_step: 5574.0932, overhead: 306.7829, complete_rollouts: 3.1569 save_policy_outputs: 325.7798 split_output_tensors: 161.1009 [2023-03-12 01:38:17,697][106151] Loop Runner_EvtLoop terminating... [2023-03-12 01:38:17,698][106151] Runner profile tree view: main_loop: 8389.8773 [2023-03-12 01:38:17,698][106151] Collected {0: 100007936}, FPS: 11920.1