[2023-03-11 12:49:18,400][22439] Saving configuration to /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/config.json... [2023-03-11 12:49:18,413][22439] Rollout worker 0 uses device cpu [2023-03-11 12:49:18,413][22439] Rollout worker 1 uses device cpu [2023-03-11 12:49:18,413][22439] Rollout worker 2 uses device cpu [2023-03-11 12:49:18,413][22439] Rollout worker 3 uses device cpu [2023-03-11 12:49:18,414][22439] Rollout worker 4 uses device cpu [2023-03-11 12:49:18,414][22439] Rollout worker 5 uses device cpu [2023-03-11 12:49:18,414][22439] Rollout worker 6 uses device cpu [2023-03-11 12:49:18,414][22439] Rollout worker 7 uses device cpu [2023-03-11 12:49:18,414][22439] In synchronous mode, we only accumulate one batch. Setting num_batches_to_accumulate to 1 [2023-03-11 12:49:18,424][22439] InferenceWorker_p0-w0: min num requests: 2 [2023-03-11 12:49:18,440][22439] Starting all processes... [2023-03-11 12:49:18,440][22439] Starting process learner_proc0 [2023-03-11 12:49:18,490][22439] Starting all processes... [2023-03-11 12:49:18,521][22439] Starting process inference_proc0-0 [2023-03-11 12:49:18,528][22439] Starting process rollout_proc0 [2023-03-11 12:49:18,529][22439] Starting process rollout_proc1 [2023-03-11 12:49:18,529][22439] Starting process rollout_proc2 [2023-03-11 12:49:18,529][22439] Starting process rollout_proc3 [2023-03-11 12:49:18,529][22439] Starting process rollout_proc4 [2023-03-11 12:49:18,529][22439] Starting process rollout_proc5 [2023-03-11 12:49:18,529][22439] Starting process rollout_proc6 [2023-03-11 12:49:18,530][22439] Starting process rollout_proc7 [2023-03-11 12:49:19,933][22682] Starting seed is not provided [2023-03-11 12:49:19,933][22682] Initializing actor-critic model on device cpu [2023-03-11 12:49:19,933][22682] RunningMeanStd input shape: (39,) [2023-03-11 12:49:19,933][22682] RunningMeanStd input shape: (1,) [2023-03-11 12:49:19,988][22728] Worker 2 uses CPU cores [8, 9, 10, 11] [2023-03-11 12:49:19,993][22682] Created Actor Critic model with architecture: [2023-03-11 12:49:19,993][22682] ActorCriticSharedWeights( (obs_normalizer): ObservationNormalizer( (running_mean_std): RunningMeanStdDictInPlace( (running_mean_std): ModuleDict( (obs): RunningMeanStdInPlace() ) ) ) (returns_normalizer): RecursiveScriptModule(original_name=RunningMeanStdInPlace) (encoder): MultiInputEncoder( (encoders): ModuleDict( (obs): MlpEncoder( (mlp_head): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Linear) (1): RecursiveScriptModule(original_name=Tanh) (2): RecursiveScriptModule(original_name=Linear) (3): RecursiveScriptModule(original_name=Tanh) ) ) ) ) (core): ModelCoreIdentity() (decoder): MlpDecoder( (mlp): Identity() ) (critic_linear): Linear(in_features=64, out_features=1, bias=True) (action_parameterization): ActionParameterizationContinuousNonAdaptiveStddev( (distribution_linear): Linear(in_features=64, out_features=4, bias=True) ) ) [2023-03-11 12:49:20,208][22815] Worker 7 uses CPU cores [28, 29, 30, 31] [2023-03-11 12:49:20,208][22764] Worker 6 uses CPU cores [24, 25, 26, 27] [2023-03-11 12:49:20,285][22730] Worker 3 uses CPU cores [12, 13, 14, 15] [2023-03-11 12:49:20,298][22682] Using optimizer [2023-03-11 12:49:20,298][22682] No checkpoints found [2023-03-11 12:49:20,298][22682] Did not load from checkpoint, starting from scratch! [2023-03-11 12:49:20,298][22682] Initialized policy 0 weights for model version 0 [2023-03-11 12:49:20,299][22682] LearnerWorker_p0 finished initialization! [2023-03-11 12:49:20,300][22726] RunningMeanStd input shape: (39,) [2023-03-11 12:49:20,301][22726] RunningMeanStd input shape: (1,) [2023-03-11 12:49:20,359][22731] Worker 4 uses CPU cores [16, 17, 18, 19] [2023-03-11 12:49:20,387][22439] Inference worker 0-0 is ready! [2023-03-11 12:49:20,387][22439] All inference workers are ready! Signal rollout workers to start! [2023-03-11 12:49:20,439][22727] Worker 1 uses CPU cores [4, 5, 6, 7] [2023-03-11 12:49:20,551][22729] Worker 0 uses CPU cores [0, 1, 2, 3] [2023-03-11 12:49:20,649][22732] Worker 5 uses CPU cores [20, 21, 22, 23] [2023-03-11 12:49:21,345][22439] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 0. Throughput: 0: nan. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-11 12:49:23,920][22764] Decorrelating experience for 0 frames... [2023-03-11 12:49:23,933][22764] Decorrelating experience for 64 frames... [2023-03-11 12:49:23,940][22728] Decorrelating experience for 0 frames... [2023-03-11 12:49:23,947][22730] Decorrelating experience for 0 frames... [2023-03-11 12:49:23,949][22815] Decorrelating experience for 0 frames... [2023-03-11 12:49:23,952][22728] Decorrelating experience for 64 frames... [2023-03-11 12:49:23,959][22730] Decorrelating experience for 64 frames... [2023-03-11 12:49:23,961][22815] Decorrelating experience for 64 frames... [2023-03-11 12:49:23,971][22764] Decorrelating experience for 128 frames... [2023-03-11 12:49:23,981][22731] Decorrelating experience for 0 frames... [2023-03-11 12:49:23,989][22728] Decorrelating experience for 128 frames... [2023-03-11 12:49:23,993][22731] Decorrelating experience for 64 frames... [2023-03-11 12:49:23,997][22730] Decorrelating experience for 128 frames... [2023-03-11 12:49:23,999][22815] Decorrelating experience for 128 frames... [2023-03-11 12:49:24,031][22731] Decorrelating experience for 128 frames... [2023-03-11 12:49:24,034][22764] Decorrelating experience for 192 frames... [2023-03-11 12:49:24,052][22728] Decorrelating experience for 192 frames... [2023-03-11 12:49:24,059][22727] Decorrelating experience for 0 frames... [2023-03-11 12:49:24,060][22730] Decorrelating experience for 192 frames... [2023-03-11 12:49:24,062][22815] Decorrelating experience for 192 frames... [2023-03-11 12:49:24,073][22727] Decorrelating experience for 64 frames... [2023-03-11 12:49:24,094][22731] Decorrelating experience for 192 frames... [2023-03-11 12:49:24,114][22727] Decorrelating experience for 128 frames... [2023-03-11 12:49:24,118][22729] Decorrelating experience for 0 frames... [2023-03-11 12:49:24,130][22729] Decorrelating experience for 64 frames... [2023-03-11 12:49:24,168][22729] Decorrelating experience for 128 frames... [2023-03-11 12:49:24,177][22727] Decorrelating experience for 192 frames... [2023-03-11 12:49:24,231][22729] Decorrelating experience for 192 frames... [2023-03-11 12:49:24,254][22732] Decorrelating experience for 0 frames... [2023-03-11 12:49:24,266][22732] Decorrelating experience for 64 frames... [2023-03-11 12:49:24,304][22732] Decorrelating experience for 128 frames... [2023-03-11 12:49:24,367][22732] Decorrelating experience for 192 frames... [2023-03-11 12:49:26,345][22439] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-11 12:49:27,567][22764] Decorrelating experience for 256 frames... [2023-03-11 12:49:27,584][22728] Decorrelating experience for 256 frames... [2023-03-11 12:49:27,594][22730] Decorrelating experience for 256 frames... [2023-03-11 12:49:27,597][22815] Decorrelating experience for 256 frames... [2023-03-11 12:49:27,628][22731] Decorrelating experience for 256 frames... [2023-03-11 12:49:27,682][22764] Decorrelating experience for 320 frames... [2023-03-11 12:49:27,697][22728] Decorrelating experience for 320 frames... [2023-03-11 12:49:27,708][22730] Decorrelating experience for 320 frames... [2023-03-11 12:49:27,716][22815] Decorrelating experience for 320 frames... [2023-03-11 12:49:27,723][22727] Decorrelating experience for 256 frames... [2023-03-11 12:49:27,746][22731] Decorrelating experience for 320 frames... [2023-03-11 12:49:27,764][22729] Decorrelating experience for 256 frames... [2023-03-11 12:49:27,821][22764] Decorrelating experience for 384 frames... [2023-03-11 12:49:27,836][22728] Decorrelating experience for 384 frames... [2023-03-11 12:49:27,837][22727] Decorrelating experience for 320 frames... [2023-03-11 12:49:27,846][22730] Decorrelating experience for 384 frames... [2023-03-11 12:49:27,855][22815] Decorrelating experience for 384 frames... [2023-03-11 12:49:27,878][22729] Decorrelating experience for 320 frames... [2023-03-11 12:49:27,891][22731] Decorrelating experience for 384 frames... [2023-03-11 12:49:27,916][22732] Decorrelating experience for 256 frames... [2023-03-11 12:49:27,976][22727] Decorrelating experience for 384 frames... [2023-03-11 12:49:27,987][22764] Decorrelating experience for 448 frames... [2023-03-11 12:49:27,998][22728] Decorrelating experience for 448 frames... [2023-03-11 12:49:28,010][22730] Decorrelating experience for 448 frames... [2023-03-11 12:49:28,017][22729] Decorrelating experience for 384 frames... [2023-03-11 12:49:28,020][22815] Decorrelating experience for 448 frames... [2023-03-11 12:49:28,030][22732] Decorrelating experience for 320 frames... [2023-03-11 12:49:28,056][22731] Decorrelating experience for 448 frames... [2023-03-11 12:49:28,139][22727] Decorrelating experience for 448 frames... [2023-03-11 12:49:28,173][22732] Decorrelating experience for 384 frames... [2023-03-11 12:49:28,182][22729] Decorrelating experience for 448 frames... [2023-03-11 12:49:28,341][22732] Decorrelating experience for 448 frames... [2023-03-11 12:49:31,345][22439] Fps is (10 sec: 2867.2, 60 sec: 2867.2, 300 sec: 2867.2). Total num frames: 28672. Throughput: 0: 819.2. Samples: 8192. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 12:49:31,346][22439] Avg episode reward: [(0, '24.833')] [2023-03-11 12:49:31,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000000056_28672.pth... [2023-03-11 12:49:32,260][22726] Updated weights for policy 0, policy_version 80 (0.0005) [2023-03-11 12:49:35,676][22726] Updated weights for policy 0, policy_version 160 (0.0005) [2023-03-11 12:49:36,345][22439] Fps is (10 sec: 8601.6, 60 sec: 5734.4, 300 sec: 5734.4). Total num frames: 86016. Throughput: 0: 5259.2. Samples: 78888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:49:36,346][22439] Avg episode reward: [(0, '286.459')] [2023-03-11 12:49:38,420][22439] Heartbeat connected on Batcher_0 [2023-03-11 12:49:38,422][22439] Heartbeat connected on LearnerWorker_p0 [2023-03-11 12:49:38,426][22439] Heartbeat connected on InferenceWorker_p0-w0 [2023-03-11 12:49:38,429][22439] Heartbeat connected on RolloutWorker_w0 [2023-03-11 12:49:38,431][22439] Heartbeat connected on RolloutWorker_w1 [2023-03-11 12:49:38,433][22439] Heartbeat connected on RolloutWorker_w2 [2023-03-11 12:49:38,435][22439] Heartbeat connected on RolloutWorker_w3 [2023-03-11 12:49:38,436][22439] Heartbeat connected on RolloutWorker_w4 [2023-03-11 12:49:38,439][22439] Heartbeat connected on RolloutWorker_w5 [2023-03-11 12:49:38,441][22439] Heartbeat connected on RolloutWorker_w6 [2023-03-11 12:49:38,442][22439] Heartbeat connected on RolloutWorker_w7 [2023-03-11 12:49:39,009][22726] Updated weights for policy 0, policy_version 240 (0.0005) [2023-03-11 12:49:41,345][22439] Fps is (10 sec: 11878.4, 60 sec: 7372.8, 300 sec: 7372.8). Total num frames: 147456. Throughput: 0: 5772.0. Samples: 115440. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 12:49:41,346][22439] Avg episode reward: [(0, '102.129')] [2023-03-11 12:49:41,364][22682] Saving new best policy, reward=102.129! [2023-03-11 12:49:42,402][22726] Updated weights for policy 0, policy_version 320 (0.0005) [2023-03-11 12:49:45,819][22726] Updated weights for policy 0, policy_version 400 (0.0005) [2023-03-11 12:49:46,345][22439] Fps is (10 sec: 12288.0, 60 sec: 8355.8, 300 sec: 8355.8). Total num frames: 208896. Throughput: 0: 7539.2. Samples: 188480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:49:46,350][22439] Avg episode reward: [(0, '47.029')] [2023-03-11 12:49:46,354][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000000408_208896.pth... [2023-03-11 12:49:49,409][22726] Updated weights for policy 0, policy_version 480 (0.0005) [2023-03-11 12:49:51,345][22439] Fps is (10 sec: 11878.5, 60 sec: 8874.7, 300 sec: 8874.7). Total num frames: 266240. Throughput: 0: 8601.6. Samples: 258048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:49:51,346][22439] Avg episode reward: [(0, '131.767')] [2023-03-11 12:49:51,346][22682] Saving new best policy, reward=131.767! [2023-03-11 12:49:52,813][22726] Updated weights for policy 0, policy_version 560 (0.0005) [2023-03-11 12:49:56,260][22726] Updated weights for policy 0, policy_version 640 (0.0005) [2023-03-11 12:49:56,345][22439] Fps is (10 sec: 11878.4, 60 sec: 9362.3, 300 sec: 9362.3). Total num frames: 327680. Throughput: 0: 8402.6. Samples: 294092. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 12:49:56,346][22439] Avg episode reward: [(0, '67.268')] [2023-03-11 12:49:59,679][22726] Updated weights for policy 0, policy_version 720 (0.0005) [2023-03-11 12:50:01,345][22439] Fps is (10 sec: 11878.4, 60 sec: 9625.6, 300 sec: 9625.6). Total num frames: 385024. Throughput: 0: 9138.5. Samples: 365540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:50:01,345][22439] Avg episode reward: [(0, '68.715')] [2023-03-11 12:50:01,387][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000000760_389120.pth... [2023-03-11 12:50:01,389][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000000056_28672.pth [2023-03-11 12:50:03,120][22726] Updated weights for policy 0, policy_version 800 (0.0005) [2023-03-11 12:50:06,345][22439] Fps is (10 sec: 11878.4, 60 sec: 9921.4, 300 sec: 9921.4). Total num frames: 446464. Throughput: 0: 9728.0. Samples: 437760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:50:06,346][22439] Avg episode reward: [(0, '61.679')] [2023-03-11 12:50:06,512][22726] Updated weights for policy 0, policy_version 880 (0.0005) [2023-03-11 12:50:09,952][22726] Updated weights for policy 0, policy_version 960 (0.0005) [2023-03-11 12:50:11,345][22439] Fps is (10 sec: 12287.9, 60 sec: 10158.1, 300 sec: 10158.1). Total num frames: 507904. Throughput: 0: 10522.3. Samples: 473504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:50:11,346][22439] Avg episode reward: [(0, '22.366')] [2023-03-11 12:50:13,272][22726] Updated weights for policy 0, policy_version 1040 (0.0005) [2023-03-11 12:50:16,345][22439] Fps is (10 sec: 11878.4, 60 sec: 10277.2, 300 sec: 10277.2). Total num frames: 565248. Throughput: 0: 11960.8. Samples: 546428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:50:16,346][22439] Avg episode reward: [(0, '31.927')] [2023-03-11 12:50:16,364][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000001112_569344.pth... [2023-03-11 12:50:16,367][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000000408_208896.pth [2023-03-11 12:50:16,699][22726] Updated weights for policy 0, policy_version 1120 (0.0005) [2023-03-11 12:50:19,861][22726] Updated weights for policy 0, policy_version 1200 (0.0004) [2023-03-11 12:50:21,345][22439] Fps is (10 sec: 12288.0, 60 sec: 10513.1, 300 sec: 10513.1). Total num frames: 630784. Throughput: 0: 12077.3. Samples: 622368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:50:21,346][22439] Avg episode reward: [(0, '72.202')] [2023-03-11 12:50:22,904][22726] Updated weights for policy 0, policy_version 1280 (0.0004) [2023-03-11 12:50:26,017][22726] Updated weights for policy 0, policy_version 1360 (0.0004) [2023-03-11 12:50:26,345][22439] Fps is (10 sec: 13516.8, 60 sec: 11673.6, 300 sec: 10775.6). Total num frames: 700416. Throughput: 0: 12147.7. Samples: 662088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:50:26,346][22439] Avg episode reward: [(0, '29.327')] [2023-03-11 12:50:29,143][22726] Updated weights for policy 0, policy_version 1440 (0.0004) [2023-03-11 12:50:31,345][22439] Fps is (10 sec: 13107.2, 60 sec: 12219.7, 300 sec: 10883.6). Total num frames: 761856. Throughput: 0: 12284.4. Samples: 741280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:50:31,346][22439] Avg episode reward: [(0, '60.937')] [2023-03-11 12:50:31,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000001488_761856.pth... [2023-03-11 12:50:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000000760_389120.pth [2023-03-11 12:50:32,485][22726] Updated weights for policy 0, policy_version 1520 (0.0005) [2023-03-11 12:50:35,888][22726] Updated weights for policy 0, policy_version 1600 (0.0005) [2023-03-11 12:50:36,345][22439] Fps is (10 sec: 12288.2, 60 sec: 12288.0, 300 sec: 10977.3). Total num frames: 823296. Throughput: 0: 12340.7. Samples: 813380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:50:36,356][22439] Avg episode reward: [(0, '63.794')] [2023-03-11 12:50:39,259][22726] Updated weights for policy 0, policy_version 1680 (0.0005) [2023-03-11 12:50:41,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 11059.2). Total num frames: 884736. Throughput: 0: 12373.9. Samples: 850916. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 12:50:41,356][22439] Avg episode reward: [(0, '142.041')] [2023-03-11 12:50:41,357][22682] Saving new best policy, reward=142.041! [2023-03-11 12:50:42,657][22726] Updated weights for policy 0, policy_version 1760 (0.0005) [2023-03-11 12:50:46,147][22726] Updated weights for policy 0, policy_version 1840 (0.0005) [2023-03-11 12:50:46,345][22439] Fps is (10 sec: 11878.3, 60 sec: 12219.7, 300 sec: 11083.3). Total num frames: 942080. Throughput: 0: 12358.3. Samples: 921664. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 12:50:46,356][22439] Avg episode reward: [(0, '181.943')] [2023-03-11 12:50:46,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000001840_942080.pth... [2023-03-11 12:50:46,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000001112_569344.pth [2023-03-11 12:50:46,362][22682] Saving new best policy, reward=181.943! [2023-03-11 12:50:49,631][22726] Updated weights for policy 0, policy_version 1920 (0.0005) [2023-03-11 12:50:51,345][22439] Fps is (10 sec: 11468.9, 60 sec: 12219.7, 300 sec: 11104.7). Total num frames: 999424. Throughput: 0: 12323.2. Samples: 992300. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 12:50:51,346][22439] Avg episode reward: [(0, '147.589')] [2023-03-11 12:50:53,079][22726] Updated weights for policy 0, policy_version 2000 (0.0005) [2023-03-11 12:50:56,345][22439] Fps is (10 sec: 11878.5, 60 sec: 12219.7, 300 sec: 11167.0). Total num frames: 1060864. Throughput: 0: 12325.7. Samples: 1028160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:50:56,346][22439] Avg episode reward: [(0, '145.514')] [2023-03-11 12:50:56,645][22726] Updated weights for policy 0, policy_version 2080 (0.0005) [2023-03-11 12:50:59,849][22726] Updated weights for policy 0, policy_version 2160 (0.0004) [2023-03-11 12:51:01,345][22439] Fps is (10 sec: 12697.4, 60 sec: 12356.2, 300 sec: 11264.0). Total num frames: 1126400. Throughput: 0: 12304.1. Samples: 1100112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:51:01,346][22439] Avg episode reward: [(0, '172.437')] [2023-03-11 12:51:01,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000002200_1126400.pth... [2023-03-11 12:51:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000001488_761856.pth [2023-03-11 12:51:02,853][22726] Updated weights for policy 0, policy_version 2240 (0.0003) [2023-03-11 12:51:05,954][22726] Updated weights for policy 0, policy_version 2320 (0.0004) [2023-03-11 12:51:06,345][22439] Fps is (10 sec: 13107.2, 60 sec: 12424.5, 300 sec: 11351.8). Total num frames: 1191936. Throughput: 0: 12394.1. Samples: 1180104. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 12:51:06,346][22439] Avg episode reward: [(0, '210.761')] [2023-03-11 12:51:06,346][22682] Saving new best policy, reward=210.761! [2023-03-11 12:51:09,067][22726] Updated weights for policy 0, policy_version 2400 (0.0003) [2023-03-11 12:51:11,345][22439] Fps is (10 sec: 13107.2, 60 sec: 12492.8, 300 sec: 11431.6). Total num frames: 1257472. Throughput: 0: 12411.8. Samples: 1220620. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 12:51:11,346][22439] Avg episode reward: [(0, '196.360')] [2023-03-11 12:51:12,235][22726] Updated weights for policy 0, policy_version 2480 (0.0004) [2023-03-11 12:51:15,364][22726] Updated weights for policy 0, policy_version 2560 (0.0004) [2023-03-11 12:51:16,345][22439] Fps is (10 sec: 13107.2, 60 sec: 12629.3, 300 sec: 11504.4). Total num frames: 1323008. Throughput: 0: 12381.4. Samples: 1298444. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 12:51:16,346][22439] Avg episode reward: [(0, '240.509')] [2023-03-11 12:51:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000002584_1323008.pth... [2023-03-11 12:51:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000001840_942080.pth [2023-03-11 12:51:16,352][22682] Saving new best policy, reward=240.509! [2023-03-11 12:51:18,623][22726] Updated weights for policy 0, policy_version 2640 (0.0005) [2023-03-11 12:51:21,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 11537.1). Total num frames: 1384448. Throughput: 0: 12442.1. Samples: 1373276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:51:21,346][22439] Avg episode reward: [(0, '186.589')] [2023-03-11 12:51:21,995][22726] Updated weights for policy 0, policy_version 2720 (0.0005) [2023-03-11 12:51:25,360][22726] Updated weights for policy 0, policy_version 2800 (0.0005) [2023-03-11 12:51:26,345][22439] Fps is (10 sec: 11878.5, 60 sec: 12356.3, 300 sec: 11534.3). Total num frames: 1441792. Throughput: 0: 12415.4. Samples: 1409608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:51:26,346][22439] Avg episode reward: [(0, '137.605')] [2023-03-11 12:51:28,659][22726] Updated weights for policy 0, policy_version 2880 (0.0003) [2023-03-11 12:51:31,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 11594.8). Total num frames: 1507328. Throughput: 0: 12496.3. Samples: 1483996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:51:31,346][22439] Avg episode reward: [(0, '206.693')] [2023-03-11 12:51:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000002944_1507328.pth... [2023-03-11 12:51:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000002200_1126400.pth [2023-03-11 12:51:31,839][22726] Updated weights for policy 0, policy_version 2960 (0.0004) [2023-03-11 12:51:35,105][22726] Updated weights for policy 0, policy_version 3040 (0.0005) [2023-03-11 12:51:36,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12424.5, 300 sec: 11620.5). Total num frames: 1568768. Throughput: 0: 12628.7. Samples: 1560592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:51:36,356][22439] Avg episode reward: [(0, '189.980')] [2023-03-11 12:51:38,520][22726] Updated weights for policy 0, policy_version 3120 (0.0005) [2023-03-11 12:51:41,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 11644.3). Total num frames: 1630208. Throughput: 0: 12632.4. Samples: 1596616. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 12:51:41,356][22439] Avg episode reward: [(0, '208.504')] [2023-03-11 12:51:42,034][22726] Updated weights for policy 0, policy_version 3200 (0.0005) [2023-03-11 12:51:45,653][22726] Updated weights for policy 0, policy_version 3280 (0.0005) [2023-03-11 12:51:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 12356.3, 300 sec: 11610.0). Total num frames: 1683456. Throughput: 0: 12558.8. Samples: 1665256. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 12:51:46,356][22439] Avg episode reward: [(0, '189.439')] [2023-03-11 12:51:46,391][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000003296_1687552.pth... [2023-03-11 12:51:46,393][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000002584_1323008.pth [2023-03-11 12:51:49,169][22726] Updated weights for policy 0, policy_version 3360 (0.0005) [2023-03-11 12:51:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 12424.5, 300 sec: 11632.6). Total num frames: 1744896. Throughput: 0: 12330.4. Samples: 1734972. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 12:51:51,356][22439] Avg episode reward: [(0, '308.604')] [2023-03-11 12:51:51,357][22682] Saving new best policy, reward=308.604! [2023-03-11 12:51:52,673][22726] Updated weights for policy 0, policy_version 3440 (0.0005) [2023-03-11 12:51:56,147][22726] Updated weights for policy 0, policy_version 3520 (0.0005) [2023-03-11 12:51:56,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 11627.4). Total num frames: 1802240. Throughput: 0: 12205.6. Samples: 1769872. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 12:51:56,356][22439] Avg episode reward: [(0, '185.193')] [2023-03-11 12:51:59,677][22726] Updated weights for policy 0, policy_version 3600 (0.0005) [2023-03-11 12:52:01,345][22439] Fps is (10 sec: 11468.8, 60 sec: 12219.7, 300 sec: 11622.4). Total num frames: 1859584. Throughput: 0: 12028.6. Samples: 1839732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:52:01,356][22439] Avg episode reward: [(0, '223.242')] [2023-03-11 12:52:01,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000003632_1859584.pth... [2023-03-11 12:52:01,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000002944_1507328.pth [2023-03-11 12:52:03,234][22726] Updated weights for policy 0, policy_version 3680 (0.0005) [2023-03-11 12:52:06,345][22439] Fps is (10 sec: 11468.9, 60 sec: 12083.2, 300 sec: 11617.8). Total num frames: 1916928. Throughput: 0: 11900.6. Samples: 1908800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:52:06,346][22439] Avg episode reward: [(0, '142.102')] [2023-03-11 12:52:06,886][22726] Updated weights for policy 0, policy_version 3760 (0.0005) [2023-03-11 12:52:10,332][22726] Updated weights for policy 0, policy_version 3840 (0.0005) [2023-03-11 12:52:11,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11613.4). Total num frames: 1974272. Throughput: 0: 11867.3. Samples: 1943636. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 12:52:11,346][22439] Avg episode reward: [(0, '188.507')] [2023-03-11 12:52:13,862][22726] Updated weights for policy 0, policy_version 3920 (0.0005) [2023-03-11 12:52:16,345][22439] Fps is (10 sec: 11878.2, 60 sec: 11878.4, 300 sec: 11632.6). Total num frames: 2035712. Throughput: 0: 11770.2. Samples: 2013656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:52:16,346][22439] Avg episode reward: [(0, '318.211')] [2023-03-11 12:52:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000003976_2035712.pth... [2023-03-11 12:52:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000003296_1687552.pth [2023-03-11 12:52:16,352][22682] Saving new best policy, reward=318.211! [2023-03-11 12:52:17,318][22726] Updated weights for policy 0, policy_version 4000 (0.0005) [2023-03-11 12:52:20,796][22726] Updated weights for policy 0, policy_version 4080 (0.0005) [2023-03-11 12:52:21,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11628.1). Total num frames: 2093056. Throughput: 0: 11650.7. Samples: 2084872. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 12:52:21,346][22439] Avg episode reward: [(0, '228.585')] [2023-03-11 12:52:24,384][22726] Updated weights for policy 0, policy_version 4160 (0.0005) [2023-03-11 12:52:26,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 11623.8). Total num frames: 2150400. Throughput: 0: 11602.4. Samples: 2118724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:52:26,346][22439] Avg episode reward: [(0, '264.140')] [2023-03-11 12:52:27,880][22726] Updated weights for policy 0, policy_version 4240 (0.0005) [2023-03-11 12:52:31,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11619.7). Total num frames: 2207744. Throughput: 0: 11607.2. Samples: 2187580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:52:31,346][22439] Avg episode reward: [(0, '278.530')] [2023-03-11 12:52:31,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000004312_2207744.pth... [2023-03-11 12:52:31,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000003632_1859584.pth [2023-03-11 12:52:31,549][22726] Updated weights for policy 0, policy_version 4320 (0.0005) [2023-03-11 12:52:35,065][22726] Updated weights for policy 0, policy_version 4400 (0.0005) [2023-03-11 12:52:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11615.8). Total num frames: 2265088. Throughput: 0: 11598.6. Samples: 2256908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:52:36,346][22439] Avg episode reward: [(0, '307.448')] [2023-03-11 12:52:38,639][22726] Updated weights for policy 0, policy_version 4480 (0.0005) [2023-03-11 12:52:41,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11612.2). Total num frames: 2322432. Throughput: 0: 11589.9. Samples: 2291416. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 12:52:41,346][22439] Avg episode reward: [(0, '313.277')] [2023-03-11 12:52:42,248][22726] Updated weights for policy 0, policy_version 4560 (0.0005) [2023-03-11 12:52:45,888][22726] Updated weights for policy 0, policy_version 4640 (0.0005) [2023-03-11 12:52:46,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11608.7). Total num frames: 2379776. Throughput: 0: 11557.8. Samples: 2359832. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 12:52:46,346][22439] Avg episode reward: [(0, '323.522')] [2023-03-11 12:52:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000004648_2379776.pth... [2023-03-11 12:52:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000003976_2035712.pth [2023-03-11 12:52:46,352][22682] Saving new best policy, reward=323.522! [2023-03-11 12:52:49,412][22726] Updated weights for policy 0, policy_version 4720 (0.0005) [2023-03-11 12:52:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11605.3). Total num frames: 2437120. Throughput: 0: 11556.3. Samples: 2428836. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 12:52:51,356][22439] Avg episode reward: [(0, '220.390')] [2023-03-11 12:52:52,965][22726] Updated weights for policy 0, policy_version 4800 (0.0005) [2023-03-11 12:52:56,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11468.8, 300 sec: 11583.1). Total num frames: 2490368. Throughput: 0: 11532.5. Samples: 2462600. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 12:52:56,356][22439] Avg episode reward: [(0, '311.774')] [2023-03-11 12:52:56,711][22726] Updated weights for policy 0, policy_version 4880 (0.0005) [2023-03-11 12:53:00,316][22726] Updated weights for policy 0, policy_version 4960 (0.0005) [2023-03-11 12:53:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11468.8, 300 sec: 11580.5). Total num frames: 2547712. Throughput: 0: 11480.1. Samples: 2530260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:53:01,356][22439] Avg episode reward: [(0, '276.205')] [2023-03-11 12:53:01,415][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000004984_2551808.pth... [2023-03-11 12:53:01,417][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000004312_2207744.pth [2023-03-11 12:53:03,897][22726] Updated weights for policy 0, policy_version 5040 (0.0005) [2023-03-11 12:53:06,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11578.0). Total num frames: 2605056. Throughput: 0: 11404.3. Samples: 2598064. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 12:53:06,356][22439] Avg episode reward: [(0, '112.524')] [2023-03-11 12:53:07,471][22726] Updated weights for policy 0, policy_version 5120 (0.0005) [2023-03-11 12:53:11,061][22726] Updated weights for policy 0, policy_version 5200 (0.0005) [2023-03-11 12:53:11,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11575.6). Total num frames: 2662400. Throughput: 0: 11417.0. Samples: 2632492. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 12:53:11,357][22439] Avg episode reward: [(0, '49.620')] [2023-03-11 12:53:14,468][22726] Updated weights for policy 0, policy_version 5280 (0.0005) [2023-03-11 12:53:16,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 11590.8). Total num frames: 2723840. Throughput: 0: 11458.7. Samples: 2703220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:53:16,356][22439] Avg episode reward: [(0, '33.376')] [2023-03-11 12:53:16,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000005320_2723840.pth... [2023-03-11 12:53:16,363][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000004648_2379776.pth [2023-03-11 12:53:17,909][22726] Updated weights for policy 0, policy_version 5360 (0.0005) [2023-03-11 12:53:21,280][22726] Updated weights for policy 0, policy_version 5440 (0.0005) [2023-03-11 12:53:21,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11537.1, 300 sec: 11605.3). Total num frames: 2785280. Throughput: 0: 11522.8. Samples: 2775436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:53:21,356][22439] Avg episode reward: [(0, '27.827')] [2023-03-11 12:53:24,776][22726] Updated weights for policy 0, policy_version 5520 (0.0005) [2023-03-11 12:53:26,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 11602.5). Total num frames: 2842624. Throughput: 0: 11522.5. Samples: 2809928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:53:26,356][22439] Avg episode reward: [(0, '129.275')] [2023-03-11 12:53:28,144][22726] Updated weights for policy 0, policy_version 5600 (0.0005) [2023-03-11 12:53:31,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11616.3). Total num frames: 2904064. Throughput: 0: 11616.3. Samples: 2882564. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 12:53:31,346][22439] Avg episode reward: [(0, '87.478')] [2023-03-11 12:53:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000005672_2904064.pth... [2023-03-11 12:53:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000004984_2551808.pth [2023-03-11 12:53:31,611][22726] Updated weights for policy 0, policy_version 5680 (0.0005) [2023-03-11 12:53:35,060][22726] Updated weights for policy 0, policy_version 5760 (0.0005) [2023-03-11 12:53:36,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11613.4). Total num frames: 2961408. Throughput: 0: 11654.6. Samples: 2953292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:53:36,346][22439] Avg episode reward: [(0, '76.924')] [2023-03-11 12:53:38,583][22726] Updated weights for policy 0, policy_version 5840 (0.0005) [2023-03-11 12:53:41,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 11626.3). Total num frames: 3022848. Throughput: 0: 11690.9. Samples: 2988692. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 12:53:41,346][22439] Avg episode reward: [(0, '55.532')] [2023-03-11 12:53:42,012][22726] Updated weights for policy 0, policy_version 5920 (0.0005) [2023-03-11 12:53:45,337][22726] Updated weights for policy 0, policy_version 6000 (0.0005) [2023-03-11 12:53:46,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11623.4). Total num frames: 3080192. Throughput: 0: 11773.6. Samples: 3060072. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 12:53:46,346][22439] Avg episode reward: [(0, '86.082')] [2023-03-11 12:53:46,368][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000006024_3084288.pth... [2023-03-11 12:53:46,369][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000005320_2723840.pth [2023-03-11 12:53:48,771][22726] Updated weights for policy 0, policy_version 6080 (0.0005) [2023-03-11 12:53:51,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11635.7). Total num frames: 3141632. Throughput: 0: 11881.9. Samples: 3132748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:53:51,346][22439] Avg episode reward: [(0, '80.119')] [2023-03-11 12:53:52,292][22726] Updated weights for policy 0, policy_version 6160 (0.0005) [2023-03-11 12:53:55,595][22726] Updated weights for policy 0, policy_version 6240 (0.0005) [2023-03-11 12:53:56,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11878.4, 300 sec: 11647.5). Total num frames: 3203072. Throughput: 0: 11915.6. Samples: 3168692. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 12:53:56,346][22439] Avg episode reward: [(0, '124.957')] [2023-03-11 12:53:58,995][22726] Updated weights for policy 0, policy_version 6320 (0.0005) [2023-03-11 12:54:01,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11644.3). Total num frames: 3260416. Throughput: 0: 11936.0. Samples: 3240340. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 12:54:01,346][22439] Avg episode reward: [(0, '92.700')] [2023-03-11 12:54:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000006368_3260416.pth... [2023-03-11 12:54:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000005672_2904064.pth [2023-03-11 12:54:02,456][22726] Updated weights for policy 0, policy_version 6400 (0.0005) [2023-03-11 12:54:05,886][22726] Updated weights for policy 0, policy_version 6480 (0.0005) [2023-03-11 12:54:06,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11655.6). Total num frames: 3321856. Throughput: 0: 11950.0. Samples: 3313184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:54:06,346][22439] Avg episode reward: [(0, '189.948')] [2023-03-11 12:54:09,356][22726] Updated weights for policy 0, policy_version 6560 (0.0005) [2023-03-11 12:54:11,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 11652.4). Total num frames: 3379200. Throughput: 0: 11949.3. Samples: 3347644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:54:11,346][22439] Avg episode reward: [(0, '96.720')] [2023-03-11 12:54:12,753][22726] Updated weights for policy 0, policy_version 6640 (0.0005) [2023-03-11 12:54:16,141][22726] Updated weights for policy 0, policy_version 6720 (0.0005) [2023-03-11 12:54:16,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11663.2). Total num frames: 3440640. Throughput: 0: 11946.8. Samples: 3420168. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 12:54:16,346][22439] Avg episode reward: [(0, '149.208')] [2023-03-11 12:54:16,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000006720_3440640.pth... [2023-03-11 12:54:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000006024_3084288.pth [2023-03-11 12:54:19,505][22726] Updated weights for policy 0, policy_version 6800 (0.0005) [2023-03-11 12:54:21,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11871.5). Total num frames: 3502080. Throughput: 0: 11996.5. Samples: 3493136. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 12:54:21,352][22439] Avg episode reward: [(0, '258.948')] [2023-03-11 12:54:22,915][22726] Updated weights for policy 0, policy_version 6880 (0.0004) [2023-03-11 12:54:26,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 11968.7). Total num frames: 3559424. Throughput: 0: 11992.7. Samples: 3528364. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 12:54:26,356][22439] Avg episode reward: [(0, '174.474')] [2023-03-11 12:54:26,412][22726] Updated weights for policy 0, policy_version 6960 (0.0005) [2023-03-11 12:54:29,513][22726] Updated weights for policy 0, policy_version 7040 (0.0004) [2023-03-11 12:54:31,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12014.9, 300 sec: 11996.4). Total num frames: 3624960. Throughput: 0: 12080.5. Samples: 3603696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:54:31,356][22439] Avg episode reward: [(0, '174.834')] [2023-03-11 12:54:31,391][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000007088_3629056.pth... [2023-03-11 12:54:31,393][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000006368_3260416.pth [2023-03-11 12:54:32,667][22726] Updated weights for policy 0, policy_version 7120 (0.0004) [2023-03-11 12:54:35,763][22726] Updated weights for policy 0, policy_version 7200 (0.0004) [2023-03-11 12:54:36,345][22439] Fps is (10 sec: 13107.0, 60 sec: 12151.5, 300 sec: 12010.3). Total num frames: 3690496. Throughput: 0: 12211.8. Samples: 3682280. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 12:54:36,356][22439] Avg episode reward: [(0, '310.319')] [2023-03-11 12:54:38,968][22726] Updated weights for policy 0, policy_version 7280 (0.0004) [2023-03-11 12:54:41,345][22439] Fps is (10 sec: 13107.2, 60 sec: 12219.7, 300 sec: 12024.2). Total num frames: 3756032. Throughput: 0: 12249.3. Samples: 3719912. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 12:54:41,356][22439] Avg episode reward: [(0, '263.417')] [2023-03-11 12:54:42,089][22726] Updated weights for policy 0, policy_version 7360 (0.0004) [2023-03-11 12:54:45,174][22726] Updated weights for policy 0, policy_version 7440 (0.0004) [2023-03-11 12:54:46,345][22439] Fps is (10 sec: 13107.1, 60 sec: 12356.3, 300 sec: 12052.0). Total num frames: 3821568. Throughput: 0: 12427.2. Samples: 3799564. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 12:54:46,356][22439] Avg episode reward: [(0, '203.826')] [2023-03-11 12:54:46,367][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000007472_3825664.pth... [2023-03-11 12:54:46,369][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000006720_3440640.pth [2023-03-11 12:54:48,239][22726] Updated weights for policy 0, policy_version 7520 (0.0004) [2023-03-11 12:54:51,345][22439] Fps is (10 sec: 13107.2, 60 sec: 12424.5, 300 sec: 12065.8). Total num frames: 3887104. Throughput: 0: 12554.6. Samples: 3878140. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 12:54:51,356][22439] Avg episode reward: [(0, '189.039')] [2023-03-11 12:54:51,498][22726] Updated weights for policy 0, policy_version 7600 (0.0004) [2023-03-11 12:54:54,729][22726] Updated weights for policy 0, policy_version 7680 (0.0004) [2023-03-11 12:54:56,345][22439] Fps is (10 sec: 12697.7, 60 sec: 12424.5, 300 sec: 12079.7). Total num frames: 3948544. Throughput: 0: 12625.5. Samples: 3915792. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 12:54:56,346][22439] Avg episode reward: [(0, '272.108')] [2023-03-11 12:54:58,176][22726] Updated weights for policy 0, policy_version 7760 (0.0005) [2023-03-11 12:55:01,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12079.7). Total num frames: 4009984. Throughput: 0: 12638.9. Samples: 3988920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:55:01,346][22439] Avg episode reward: [(0, '290.490')] [2023-03-11 12:55:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000007832_4009984.pth... [2023-03-11 12:55:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000007088_3629056.pth [2023-03-11 12:55:01,601][22726] Updated weights for policy 0, policy_version 7840 (0.0005) [2023-03-11 12:55:04,761][22726] Updated weights for policy 0, policy_version 7920 (0.0004) [2023-03-11 12:55:06,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12492.8, 300 sec: 12079.7). Total num frames: 4071424. Throughput: 0: 12670.2. Samples: 4063296. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 12:55:06,346][22439] Avg episode reward: [(0, '267.504')] [2023-03-11 12:55:08,042][22726] Updated weights for policy 0, policy_version 8000 (0.0003) [2023-03-11 12:55:11,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12561.1, 300 sec: 12093.6). Total num frames: 4132864. Throughput: 0: 12706.8. Samples: 4100168. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 12:55:11,346][22439] Avg episode reward: [(0, '304.156')] [2023-03-11 12:55:11,405][22726] Updated weights for policy 0, policy_version 8080 (0.0004) [2023-03-11 12:55:14,657][22726] Updated weights for policy 0, policy_version 8160 (0.0003) [2023-03-11 12:55:16,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12629.3, 300 sec: 12093.6). Total num frames: 4198400. Throughput: 0: 12680.2. Samples: 4174304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:55:16,346][22439] Avg episode reward: [(0, '191.720')] [2023-03-11 12:55:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000008200_4198400.pth... [2023-03-11 12:55:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000007472_3825664.pth [2023-03-11 12:55:17,781][22726] Updated weights for policy 0, policy_version 8240 (0.0003) [2023-03-11 12:55:20,955][22726] Updated weights for policy 0, policy_version 8320 (0.0004) [2023-03-11 12:55:21,345][22439] Fps is (10 sec: 13107.1, 60 sec: 12697.6, 300 sec: 12079.7). Total num frames: 4263936. Throughput: 0: 12675.9. Samples: 4252696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:55:21,346][22439] Avg episode reward: [(0, '146.614')] [2023-03-11 12:55:24,092][22726] Updated weights for policy 0, policy_version 8400 (0.0005) [2023-03-11 12:55:26,345][22439] Fps is (10 sec: 13107.3, 60 sec: 12834.1, 300 sec: 12093.6). Total num frames: 4329472. Throughput: 0: 12726.8. Samples: 4292616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:55:26,346][22439] Avg episode reward: [(0, '188.923')] [2023-03-11 12:55:27,214][22726] Updated weights for policy 0, policy_version 8480 (0.0004) [2023-03-11 12:55:30,315][22726] Updated weights for policy 0, policy_version 8560 (0.0004) [2023-03-11 12:55:31,345][22439] Fps is (10 sec: 13107.1, 60 sec: 12834.1, 300 sec: 12107.5). Total num frames: 4395008. Throughput: 0: 12687.6. Samples: 4370504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:55:31,346][22439] Avg episode reward: [(0, '201.248')] [2023-03-11 12:55:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000008584_4395008.pth... [2023-03-11 12:55:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000007832_4009984.pth [2023-03-11 12:55:33,810][22726] Updated weights for policy 0, policy_version 8640 (0.0005) [2023-03-11 12:55:36,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12697.6, 300 sec: 12093.6). Total num frames: 4452352. Throughput: 0: 12567.7. Samples: 4443688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:55:36,346][22439] Avg episode reward: [(0, '263.137')] [2023-03-11 12:55:37,319][22726] Updated weights for policy 0, policy_version 8720 (0.0005) [2023-03-11 12:55:40,566][22726] Updated weights for policy 0, policy_version 8800 (0.0004) [2023-03-11 12:55:41,345][22439] Fps is (10 sec: 11878.5, 60 sec: 12629.3, 300 sec: 12107.5). Total num frames: 4513792. Throughput: 0: 12512.8. Samples: 4478868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:55:41,346][22439] Avg episode reward: [(0, '240.881')] [2023-03-11 12:55:43,820][22726] Updated weights for policy 0, policy_version 8880 (0.0004) [2023-03-11 12:55:46,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12121.4). Total num frames: 4575232. Throughput: 0: 12565.0. Samples: 4554344. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 12:55:46,346][22439] Avg episode reward: [(0, '249.910')] [2023-03-11 12:55:46,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000008936_4575232.pth... [2023-03-11 12:55:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000008200_4198400.pth [2023-03-11 12:55:47,095][22726] Updated weights for policy 0, policy_version 8960 (0.0004) [2023-03-11 12:55:50,316][22726] Updated weights for policy 0, policy_version 9040 (0.0004) [2023-03-11 12:55:51,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12135.3). Total num frames: 4640768. Throughput: 0: 12586.7. Samples: 4629700. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 12:55:51,346][22439] Avg episode reward: [(0, '224.390')] [2023-03-11 12:55:53,653][22726] Updated weights for policy 0, policy_version 9120 (0.0005) [2023-03-11 12:55:56,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12121.4). Total num frames: 4702208. Throughput: 0: 12583.3. Samples: 4666416. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 12:55:56,346][22439] Avg episode reward: [(0, '344.567')] [2023-03-11 12:55:56,346][22682] Saving new best policy, reward=344.567! [2023-03-11 12:55:56,814][22726] Updated weights for policy 0, policy_version 9200 (0.0004) [2023-03-11 12:56:00,440][22726] Updated weights for policy 0, policy_version 9280 (0.0005) [2023-03-11 12:56:01,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12492.8, 300 sec: 12093.6). Total num frames: 4759552. Throughput: 0: 12567.6. Samples: 4739848. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 12:56:01,346][22439] Avg episode reward: [(0, '241.553')] [2023-03-11 12:56:01,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000009296_4759552.pth... [2023-03-11 12:56:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000008584_4395008.pth [2023-03-11 12:56:04,045][22726] Updated weights for policy 0, policy_version 9360 (0.0005) [2023-03-11 12:56:06,345][22439] Fps is (10 sec: 11468.9, 60 sec: 12424.5, 300 sec: 12065.8). Total num frames: 4816896. Throughput: 0: 12355.2. Samples: 4808680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:56:06,346][22439] Avg episode reward: [(0, '238.223')] [2023-03-11 12:56:07,609][22726] Updated weights for policy 0, policy_version 9440 (0.0005) [2023-03-11 12:56:10,946][22726] Updated weights for policy 0, policy_version 9520 (0.0005) [2023-03-11 12:56:11,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 12052.0). Total num frames: 4878336. Throughput: 0: 12238.3. Samples: 4843340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:56:11,346][22439] Avg episode reward: [(0, '239.414')] [2023-03-11 12:56:14,213][22726] Updated weights for policy 0, policy_version 9600 (0.0004) [2023-03-11 12:56:16,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12356.3, 300 sec: 12052.0). Total num frames: 4939776. Throughput: 0: 12164.5. Samples: 4917904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:56:16,346][22439] Avg episode reward: [(0, '215.140')] [2023-03-11 12:56:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000009648_4939776.pth... [2023-03-11 12:56:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000008936_4575232.pth [2023-03-11 12:56:17,708][22726] Updated weights for policy 0, policy_version 9680 (0.0005) [2023-03-11 12:56:20,927][22726] Updated weights for policy 0, policy_version 9760 (0.0004) [2023-03-11 12:56:21,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12065.8). Total num frames: 5001216. Throughput: 0: 12161.2. Samples: 4990940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:56:21,346][22439] Avg episode reward: [(0, '272.985')] [2023-03-11 12:56:24,310][22726] Updated weights for policy 0, policy_version 9840 (0.0005) [2023-03-11 12:56:26,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12052.0). Total num frames: 5062656. Throughput: 0: 12183.9. Samples: 5027144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:56:26,346][22439] Avg episode reward: [(0, '302.546')] [2023-03-11 12:56:27,696][22726] Updated weights for policy 0, policy_version 9920 (0.0004) [2023-03-11 12:56:31,031][22726] Updated weights for policy 0, policy_version 10000 (0.0005) [2023-03-11 12:56:31,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 12052.0). Total num frames: 5124096. Throughput: 0: 12116.5. Samples: 5099584. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 12:56:31,346][22439] Avg episode reward: [(0, '362.921')] [2023-03-11 12:56:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000010008_5124096.pth... [2023-03-11 12:56:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000009296_4759552.pth [2023-03-11 12:56:31,351][22682] Saving new best policy, reward=362.921! [2023-03-11 12:56:34,189][22726] Updated weights for policy 0, policy_version 10080 (0.0004) [2023-03-11 12:56:36,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12219.7, 300 sec: 12052.0). Total num frames: 5185536. Throughput: 0: 12135.9. Samples: 5175816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:56:36,346][22439] Avg episode reward: [(0, '349.337')] [2023-03-11 12:56:37,509][22726] Updated weights for policy 0, policy_version 10160 (0.0004) [2023-03-11 12:56:40,883][22726] Updated weights for policy 0, policy_version 10240 (0.0004) [2023-03-11 12:56:41,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12079.7). Total num frames: 5246976. Throughput: 0: 12147.8. Samples: 5213068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:56:41,346][22439] Avg episode reward: [(0, '298.410')] [2023-03-11 12:56:44,110][22726] Updated weights for policy 0, policy_version 10320 (0.0004) [2023-03-11 12:56:46,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12288.0, 300 sec: 12093.6). Total num frames: 5312512. Throughput: 0: 12179.9. Samples: 5287944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:56:46,346][22439] Avg episode reward: [(0, '308.783')] [2023-03-11 12:56:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000010376_5312512.pth... [2023-03-11 12:56:46,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000009648_4939776.pth [2023-03-11 12:56:47,244][22726] Updated weights for policy 0, policy_version 10400 (0.0003) [2023-03-11 12:56:50,409][22726] Updated weights for policy 0, policy_version 10480 (0.0004) [2023-03-11 12:56:51,345][22439] Fps is (10 sec: 13107.3, 60 sec: 12288.0, 300 sec: 12121.4). Total num frames: 5378048. Throughput: 0: 12381.0. Samples: 5365824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:56:51,346][22439] Avg episode reward: [(0, '339.341')] [2023-03-11 12:56:53,559][22726] Updated weights for policy 0, policy_version 10560 (0.0004) [2023-03-11 12:56:56,345][22439] Fps is (10 sec: 12697.8, 60 sec: 12288.0, 300 sec: 12135.3). Total num frames: 5439488. Throughput: 0: 12480.9. Samples: 5404980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:56:56,356][22439] Avg episode reward: [(0, '219.411')] [2023-03-11 12:56:56,700][22726] Updated weights for policy 0, policy_version 10640 (0.0004) [2023-03-11 12:56:59,793][22726] Updated weights for policy 0, policy_version 10720 (0.0004) [2023-03-11 12:57:01,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12424.5, 300 sec: 12163.0). Total num frames: 5505024. Throughput: 0: 12581.1. Samples: 5484052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:57:01,356][22439] Avg episode reward: [(0, '157.439')] [2023-03-11 12:57:01,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000010752_5505024.pth... [2023-03-11 12:57:01,361][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000010008_5124096.pth [2023-03-11 12:57:03,020][22726] Updated weights for policy 0, policy_version 10800 (0.0004) [2023-03-11 12:57:06,302][22726] Updated weights for policy 0, policy_version 10880 (0.0004) [2023-03-11 12:57:06,345][22439] Fps is (10 sec: 13107.1, 60 sec: 12561.1, 300 sec: 12190.8). Total num frames: 5570560. Throughput: 0: 12640.7. Samples: 5559772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:57:06,363][22439] Avg episode reward: [(0, '240.301')] [2023-03-11 12:57:09,731][22726] Updated weights for policy 0, policy_version 10960 (0.0004) [2023-03-11 12:57:11,345][22439] Fps is (10 sec: 12288.2, 60 sec: 12492.8, 300 sec: 12176.9). Total num frames: 5627904. Throughput: 0: 12666.8. Samples: 5597148. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 12:57:11,356][22439] Avg episode reward: [(0, '289.030')] [2023-03-11 12:57:13,142][22726] Updated weights for policy 0, policy_version 11040 (0.0005) [2023-03-11 12:57:16,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12492.8, 300 sec: 12190.8). Total num frames: 5689344. Throughput: 0: 12652.1. Samples: 5668928. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 12:57:16,356][22439] Avg episode reward: [(0, '289.694')] [2023-03-11 12:57:16,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000011112_5689344.pth... [2023-03-11 12:57:16,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000010376_5312512.pth [2023-03-11 12:57:16,544][22726] Updated weights for policy 0, policy_version 11120 (0.0005) [2023-03-11 12:57:19,978][22726] Updated weights for policy 0, policy_version 11200 (0.0006) [2023-03-11 12:57:21,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12492.8, 300 sec: 12204.7). Total num frames: 5750784. Throughput: 0: 12537.5. Samples: 5740004. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 12:57:21,356][22439] Avg episode reward: [(0, '217.650')] [2023-03-11 12:57:23,167][22726] Updated weights for policy 0, policy_version 11280 (0.0004) [2023-03-11 12:57:26,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12218.6). Total num frames: 5812224. Throughput: 0: 12570.6. Samples: 5778744. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 12:57:26,346][22439] Avg episode reward: [(0, '285.279')] [2023-03-11 12:57:26,461][22726] Updated weights for policy 0, policy_version 11360 (0.0005) [2023-03-11 12:57:29,589][22726] Updated weights for policy 0, policy_version 11440 (0.0004) [2023-03-11 12:57:31,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12561.1, 300 sec: 12246.3). Total num frames: 5877760. Throughput: 0: 12608.3. Samples: 5855316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:57:31,356][22439] Avg episode reward: [(0, '201.898')] [2023-03-11 12:57:31,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000011480_5877760.pth... [2023-03-11 12:57:31,363][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000010752_5505024.pth [2023-03-11 12:57:32,849][22726] Updated weights for policy 0, policy_version 11520 (0.0005) [2023-03-11 12:57:35,963][22726] Updated weights for policy 0, policy_version 11600 (0.0004) [2023-03-11 12:57:36,345][22439] Fps is (10 sec: 13107.2, 60 sec: 12629.3, 300 sec: 12274.1). Total num frames: 5943296. Throughput: 0: 12577.4. Samples: 5931808. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 12:57:36,346][22439] Avg episode reward: [(0, '239.584')] [2023-03-11 12:57:39,240][22726] Updated weights for policy 0, policy_version 11680 (0.0005) [2023-03-11 12:57:41,345][22439] Fps is (10 sec: 12697.7, 60 sec: 12629.3, 300 sec: 12288.0). Total num frames: 6004736. Throughput: 0: 12557.0. Samples: 5970044. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 12:57:41,346][22439] Avg episode reward: [(0, '255.268')] [2023-03-11 12:57:42,541][22726] Updated weights for policy 0, policy_version 11760 (0.0005) [2023-03-11 12:57:45,863][22726] Updated weights for policy 0, policy_version 11840 (0.0005) [2023-03-11 12:57:46,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12301.9). Total num frames: 6066176. Throughput: 0: 12455.5. Samples: 6044548. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 12:57:46,346][22439] Avg episode reward: [(0, '310.838')] [2023-03-11 12:57:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000011848_6066176.pth... [2023-03-11 12:57:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000011112_5689344.pth [2023-03-11 12:57:49,184][22726] Updated weights for policy 0, policy_version 11920 (0.0005) [2023-03-11 12:57:51,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12329.7). Total num frames: 6127616. Throughput: 0: 12414.6. Samples: 6118428. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 12:57:51,346][22439] Avg episode reward: [(0, '513.196')] [2023-03-11 12:57:51,346][22682] Saving new best policy, reward=513.196! [2023-03-11 12:57:52,460][22726] Updated weights for policy 0, policy_version 12000 (0.0005) [2023-03-11 12:57:55,668][22726] Updated weights for policy 0, policy_version 12080 (0.0005) [2023-03-11 12:57:56,345][22439] Fps is (10 sec: 12697.7, 60 sec: 12561.1, 300 sec: 12357.4). Total num frames: 6193152. Throughput: 0: 12426.7. Samples: 6156352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:57:56,346][22439] Avg episode reward: [(0, '360.679')] [2023-03-11 12:57:58,935][22726] Updated weights for policy 0, policy_version 12160 (0.0004) [2023-03-11 12:58:01,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12492.8, 300 sec: 12371.3). Total num frames: 6254592. Throughput: 0: 12509.1. Samples: 6231840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:58:01,346][22439] Avg episode reward: [(0, '294.392')] [2023-03-11 12:58:01,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000012216_6254592.pth... [2023-03-11 12:58:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000011480_5877760.pth [2023-03-11 12:58:02,114][22726] Updated weights for policy 0, policy_version 12240 (0.0004) [2023-03-11 12:58:05,351][22726] Updated weights for policy 0, policy_version 12320 (0.0005) [2023-03-11 12:58:06,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12399.1). Total num frames: 6320128. Throughput: 0: 12632.1. Samples: 6308448. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 12:58:06,346][22439] Avg episode reward: [(0, '337.799')] [2023-03-11 12:58:08,625][22726] Updated weights for policy 0, policy_version 12400 (0.0005) [2023-03-11 12:58:11,345][22439] Fps is (10 sec: 12697.7, 60 sec: 12561.1, 300 sec: 12399.1). Total num frames: 6381568. Throughput: 0: 12602.5. Samples: 6345856. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 12:58:11,346][22439] Avg episode reward: [(0, '374.664')] [2023-03-11 12:58:11,832][22726] Updated weights for policy 0, policy_version 12480 (0.0004) [2023-03-11 12:58:15,115][22726] Updated weights for policy 0, policy_version 12560 (0.0005) [2023-03-11 12:58:16,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12561.1, 300 sec: 12399.1). Total num frames: 6443008. Throughput: 0: 12606.1. Samples: 6422592. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 12:58:16,346][22439] Avg episode reward: [(0, '285.364')] [2023-03-11 12:58:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000012584_6443008.pth... [2023-03-11 12:58:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000011848_6066176.pth [2023-03-11 12:58:18,491][22726] Updated weights for policy 0, policy_version 12640 (0.0005) [2023-03-11 12:58:21,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12413.0). Total num frames: 6504448. Throughput: 0: 12543.5. Samples: 6496264. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 12:58:21,346][22439] Avg episode reward: [(0, '298.914')] [2023-03-11 12:58:21,712][22726] Updated weights for policy 0, policy_version 12720 (0.0005) [2023-03-11 12:58:25,028][22726] Updated weights for policy 0, policy_version 12800 (0.0005) [2023-03-11 12:58:26,345][22439] Fps is (10 sec: 12697.7, 60 sec: 12629.3, 300 sec: 12426.8). Total num frames: 6569984. Throughput: 0: 12524.1. Samples: 6533628. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 12:58:26,346][22439] Avg episode reward: [(0, '233.468')] [2023-03-11 12:58:28,373][22726] Updated weights for policy 0, policy_version 12880 (0.0004) [2023-03-11 12:58:31,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12426.8). Total num frames: 6627328. Throughput: 0: 12495.6. Samples: 6606848. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 12:58:31,346][22439] Avg episode reward: [(0, '325.857')] [2023-03-11 12:58:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000012944_6627328.pth... [2023-03-11 12:58:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000012216_6254592.pth [2023-03-11 12:58:32,013][22726] Updated weights for policy 0, policy_version 12960 (0.0006) [2023-03-11 12:58:35,585][22726] Updated weights for policy 0, policy_version 13040 (0.0005) [2023-03-11 12:58:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 12356.3, 300 sec: 12413.0). Total num frames: 6684672. Throughput: 0: 12361.2. Samples: 6674684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:58:36,356][22439] Avg episode reward: [(0, '234.166')] [2023-03-11 12:58:38,766][22726] Updated weights for policy 0, policy_version 13120 (0.0004) [2023-03-11 12:58:41,345][22439] Fps is (10 sec: 11878.5, 60 sec: 12356.3, 300 sec: 12426.9). Total num frames: 6746112. Throughput: 0: 12377.6. Samples: 6713344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:58:41,356][22439] Avg episode reward: [(0, '207.381')] [2023-03-11 12:58:42,031][22726] Updated weights for policy 0, policy_version 13200 (0.0005) [2023-03-11 12:58:45,222][22726] Updated weights for policy 0, policy_version 13280 (0.0004) [2023-03-11 12:58:46,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12424.5, 300 sec: 12440.7). Total num frames: 6811648. Throughput: 0: 12380.3. Samples: 6788952. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 12:58:46,356][22439] Avg episode reward: [(0, '219.733')] [2023-03-11 12:58:46,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000013304_6811648.pth... [2023-03-11 12:58:46,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000012584_6443008.pth [2023-03-11 12:58:48,386][22726] Updated weights for policy 0, policy_version 13360 (0.0004) [2023-03-11 12:58:51,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12426.8). Total num frames: 6868992. Throughput: 0: 12326.4. Samples: 6863136. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 12:58:51,356][22439] Avg episode reward: [(0, '267.593')] [2023-03-11 12:58:52,206][22726] Updated weights for policy 0, policy_version 13440 (0.0006) [2023-03-11 12:58:55,814][22726] Updated weights for policy 0, policy_version 13520 (0.0005) [2023-03-11 12:58:56,345][22439] Fps is (10 sec: 11468.9, 60 sec: 12219.7, 300 sec: 12426.8). Total num frames: 6926336. Throughput: 0: 12188.6. Samples: 6894344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:58:56,356][22439] Avg episode reward: [(0, '324.875')] [2023-03-11 12:58:59,362][22726] Updated weights for policy 0, policy_version 13600 (0.0005) [2023-03-11 12:59:01,345][22439] Fps is (10 sec: 11468.7, 60 sec: 12151.5, 300 sec: 12413.0). Total num frames: 6983680. Throughput: 0: 12022.7. Samples: 6963612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:59:01,356][22439] Avg episode reward: [(0, '289.098')] [2023-03-11 12:59:01,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000013640_6983680.pth... [2023-03-11 12:59:01,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000012944_6627328.pth [2023-03-11 12:59:03,089][22726] Updated weights for policy 0, policy_version 13680 (0.0005) [2023-03-11 12:59:06,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11946.7, 300 sec: 12399.1). Total num frames: 7036928. Throughput: 0: 11865.2. Samples: 7030196. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 12:59:06,356][22439] Avg episode reward: [(0, '259.163')] [2023-03-11 12:59:06,795][22726] Updated weights for policy 0, policy_version 13760 (0.0005) [2023-03-11 12:59:10,344][22726] Updated weights for policy 0, policy_version 13840 (0.0005) [2023-03-11 12:59:11,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11878.4, 300 sec: 12385.2). Total num frames: 7094272. Throughput: 0: 11782.2. Samples: 7063828. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 12:59:11,356][22439] Avg episode reward: [(0, '309.596')] [2023-03-11 12:59:14,004][22726] Updated weights for policy 0, policy_version 13920 (0.0005) [2023-03-11 12:59:16,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 12371.3). Total num frames: 7151616. Throughput: 0: 11666.0. Samples: 7131816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:59:16,356][22439] Avg episode reward: [(0, '272.115')] [2023-03-11 12:59:16,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000013968_7151616.pth... [2023-03-11 12:59:16,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000013304_6811648.pth [2023-03-11 12:59:17,545][22726] Updated weights for policy 0, policy_version 14000 (0.0005) [2023-03-11 12:59:21,147][22726] Updated weights for policy 0, policy_version 14080 (0.0005) [2023-03-11 12:59:21,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 12371.3). Total num frames: 7208960. Throughput: 0: 11690.9. Samples: 7200776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:59:21,346][22439] Avg episode reward: [(0, '312.949')] [2023-03-11 12:59:24,700][22726] Updated weights for policy 0, policy_version 14160 (0.0005) [2023-03-11 12:59:26,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12343.5). Total num frames: 7266304. Throughput: 0: 11601.6. Samples: 7235416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:59:26,346][22439] Avg episode reward: [(0, '310.067')] [2023-03-11 12:59:28,353][22726] Updated weights for policy 0, policy_version 14240 (0.0005) [2023-03-11 12:59:31,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12315.8). Total num frames: 7323648. Throughput: 0: 11428.6. Samples: 7303240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:59:31,346][22439] Avg episode reward: [(0, '392.763')] [2023-03-11 12:59:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000014304_7323648.pth... [2023-03-11 12:59:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000013640_6983680.pth [2023-03-11 12:59:31,956][22726] Updated weights for policy 0, policy_version 14320 (0.0005) [2023-03-11 12:59:35,512][22726] Updated weights for policy 0, policy_version 14400 (0.0005) [2023-03-11 12:59:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12288.0). Total num frames: 7380992. Throughput: 0: 11309.8. Samples: 7372076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:59:36,346][22439] Avg episode reward: [(0, '292.041')] [2023-03-11 12:59:38,848][22726] Updated weights for policy 0, policy_version 14480 (0.0004) [2023-03-11 12:59:41,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 12274.1). Total num frames: 7442432. Throughput: 0: 11427.7. Samples: 7408592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:59:41,346][22439] Avg episode reward: [(0, '350.971')] [2023-03-11 12:59:42,061][22726] Updated weights for policy 0, policy_version 14560 (0.0004) [2023-03-11 12:59:45,471][22726] Updated weights for policy 0, policy_version 14640 (0.0005) [2023-03-11 12:59:46,345][22439] Fps is (10 sec: 12287.9, 60 sec: 11537.1, 300 sec: 12260.2). Total num frames: 7503872. Throughput: 0: 11552.1. Samples: 7483456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:59:46,346][22439] Avg episode reward: [(0, '279.198')] [2023-03-11 12:59:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000014656_7503872.pth... [2023-03-11 12:59:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000013968_7151616.pth [2023-03-11 12:59:48,769][22726] Updated weights for policy 0, policy_version 14720 (0.0004) [2023-03-11 12:59:51,345][22439] Fps is (10 sec: 12287.9, 60 sec: 11605.3, 300 sec: 12260.2). Total num frames: 7565312. Throughput: 0: 11710.8. Samples: 7557184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:59:51,346][22439] Avg episode reward: [(0, '256.713')] [2023-03-11 12:59:52,120][22726] Updated weights for policy 0, policy_version 14800 (0.0004) [2023-03-11 12:59:55,549][22726] Updated weights for policy 0, policy_version 14880 (0.0005) [2023-03-11 12:59:56,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11673.6, 300 sec: 12260.2). Total num frames: 7626752. Throughput: 0: 11767.2. Samples: 7593352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 12:59:56,346][22439] Avg episode reward: [(0, '274.665')] [2023-03-11 12:59:59,045][22726] Updated weights for policy 0, policy_version 14960 (0.0005) [2023-03-11 13:00:01,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 12246.3). Total num frames: 7684096. Throughput: 0: 11819.2. Samples: 7663680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:00:01,346][22439] Avg episode reward: [(0, '350.584')] [2023-03-11 13:00:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000015008_7684096.pth... [2023-03-11 13:00:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000014304_7323648.pth [2023-03-11 13:00:02,381][22726] Updated weights for policy 0, policy_version 15040 (0.0005) [2023-03-11 13:00:05,763][22726] Updated weights for policy 0, policy_version 15120 (0.0005) [2023-03-11 13:00:06,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 12246.3). Total num frames: 7745536. Throughput: 0: 11923.7. Samples: 7737344. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:00:06,346][22439] Avg episode reward: [(0, '369.225')] [2023-03-11 13:00:09,117][22726] Updated weights for policy 0, policy_version 15200 (0.0005) [2023-03-11 13:00:11,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11878.4, 300 sec: 12232.5). Total num frames: 7806976. Throughput: 0: 11974.6. Samples: 7774272. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:00:11,346][22439] Avg episode reward: [(0, '355.988')] [2023-03-11 13:00:12,464][22726] Updated weights for policy 0, policy_version 15280 (0.0005) [2023-03-11 13:00:15,855][22726] Updated weights for policy 0, policy_version 15360 (0.0005) [2023-03-11 13:00:16,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 12218.6). Total num frames: 7868416. Throughput: 0: 12097.2. Samples: 7847616. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:00:16,346][22439] Avg episode reward: [(0, '352.278')] [2023-03-11 13:00:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000015368_7868416.pth... [2023-03-11 13:00:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000014656_7503872.pth [2023-03-11 13:00:16,534][22682] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000007 [2023-03-11 13:00:19,209][22726] Updated weights for policy 0, policy_version 15440 (0.0005) [2023-03-11 13:00:21,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12014.9, 300 sec: 12204.7). Total num frames: 7929856. Throughput: 0: 12173.4. Samples: 7919880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:00:21,346][22439] Avg episode reward: [(0, '301.566')] [2023-03-11 13:00:22,620][22726] Updated weights for policy 0, policy_version 15520 (0.0005) [2023-03-11 13:00:26,177][22726] Updated weights for policy 0, policy_version 15600 (0.0005) [2023-03-11 13:00:26,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 12176.9). Total num frames: 7987200. Throughput: 0: 12143.4. Samples: 7955044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:00:26,346][22439] Avg episode reward: [(0, '319.439')] [2023-03-11 13:00:29,827][22726] Updated weights for policy 0, policy_version 15680 (0.0006) [2023-03-11 13:00:31,345][22439] Fps is (10 sec: 11468.7, 60 sec: 12014.9, 300 sec: 12176.9). Total num frames: 8044544. Throughput: 0: 12013.8. Samples: 8024076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:00:31,346][22439] Avg episode reward: [(0, '265.682')] [2023-03-11 13:00:31,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000015712_8044544.pth... [2023-03-11 13:00:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000015008_7684096.pth [2023-03-11 13:00:33,460][22726] Updated weights for policy 0, policy_version 15760 (0.0005) [2023-03-11 13:00:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11946.7, 300 sec: 12149.2). Total num frames: 8097792. Throughput: 0: 11869.4. Samples: 8091308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:00:36,346][22439] Avg episode reward: [(0, '369.047')] [2023-03-11 13:00:37,030][22726] Updated weights for policy 0, policy_version 15840 (0.0005) [2023-03-11 13:00:40,733][22726] Updated weights for policy 0, policy_version 15920 (0.0006) [2023-03-11 13:00:41,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11878.4, 300 sec: 12135.3). Total num frames: 8155136. Throughput: 0: 11835.6. Samples: 8125952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:00:41,346][22439] Avg episode reward: [(0, '316.177')] [2023-03-11 13:00:44,137][22726] Updated weights for policy 0, policy_version 16000 (0.0005) [2023-03-11 13:00:46,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 12121.4). Total num frames: 8216576. Throughput: 0: 11823.7. Samples: 8195748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:00:46,346][22439] Avg episode reward: [(0, '361.391')] [2023-03-11 13:00:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000016048_8216576.pth... [2023-03-11 13:00:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000015368_7868416.pth [2023-03-11 13:00:47,563][22726] Updated weights for policy 0, policy_version 16080 (0.0005) [2023-03-11 13:00:51,251][22726] Updated weights for policy 0, policy_version 16160 (0.0006) [2023-03-11 13:00:51,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 12107.5). Total num frames: 8273920. Throughput: 0: 11739.8. Samples: 8265636. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:00:51,346][22439] Avg episode reward: [(0, '301.599')] [2023-03-11 13:00:54,911][22726] Updated weights for policy 0, policy_version 16240 (0.0006) [2023-03-11 13:00:56,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 12107.5). Total num frames: 8331264. Throughput: 0: 11649.6. Samples: 8298504. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:00:56,346][22439] Avg episode reward: [(0, '234.179')] [2023-03-11 13:00:58,522][22726] Updated weights for policy 0, policy_version 16320 (0.0005) [2023-03-11 13:01:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11673.6, 300 sec: 12093.6). Total num frames: 8384512. Throughput: 0: 11529.3. Samples: 8366432. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:01:01,346][22439] Avg episode reward: [(0, '241.142')] [2023-03-11 13:01:01,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000016376_8384512.pth... [2023-03-11 13:01:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000015712_8044544.pth [2023-03-11 13:01:02,172][22726] Updated weights for policy 0, policy_version 16400 (0.0005) [2023-03-11 13:01:05,447][22726] Updated weights for policy 0, policy_version 16480 (0.0004) [2023-03-11 13:01:06,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 12093.6). Total num frames: 8445952. Throughput: 0: 11508.7. Samples: 8437772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:01:06,346][22439] Avg episode reward: [(0, '411.744')] [2023-03-11 13:01:08,706][22726] Updated weights for policy 0, policy_version 16560 (0.0005) [2023-03-11 13:01:11,345][22439] Fps is (10 sec: 12697.6, 60 sec: 11741.9, 300 sec: 12107.5). Total num frames: 8511488. Throughput: 0: 11557.1. Samples: 8475112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:01:11,346][22439] Avg episode reward: [(0, '406.578')] [2023-03-11 13:01:11,937][22726] Updated weights for policy 0, policy_version 16640 (0.0004) [2023-03-11 13:01:15,411][22726] Updated weights for policy 0, policy_version 16720 (0.0005) [2023-03-11 13:01:16,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 12093.6). Total num frames: 8568832. Throughput: 0: 11681.3. Samples: 8549732. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:01:16,346][22439] Avg episode reward: [(0, '368.939')] [2023-03-11 13:01:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000016736_8568832.pth... [2023-03-11 13:01:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000016048_8216576.pth [2023-03-11 13:01:19,027][22726] Updated weights for policy 0, policy_version 16800 (0.0005) [2023-03-11 13:01:21,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 12079.7). Total num frames: 8626176. Throughput: 0: 11703.8. Samples: 8617980. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:01:21,346][22439] Avg episode reward: [(0, '243.353')] [2023-03-11 13:01:22,628][22726] Updated weights for policy 0, policy_version 16880 (0.0005) [2023-03-11 13:01:26,200][22726] Updated weights for policy 0, policy_version 16960 (0.0005) [2023-03-11 13:01:26,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 12065.8). Total num frames: 8683520. Throughput: 0: 11671.2. Samples: 8651156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:01:26,346][22439] Avg episode reward: [(0, '299.229')] [2023-03-11 13:01:29,732][22726] Updated weights for policy 0, policy_version 17040 (0.0005) [2023-03-11 13:01:31,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12052.0). Total num frames: 8740864. Throughput: 0: 11671.7. Samples: 8720976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:01:31,346][22439] Avg episode reward: [(0, '425.769')] [2023-03-11 13:01:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000017072_8740864.pth... [2023-03-11 13:01:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000016376_8384512.pth [2023-03-11 13:01:33,494][22726] Updated weights for policy 0, policy_version 17120 (0.0005) [2023-03-11 13:01:36,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11605.3, 300 sec: 12024.2). Total num frames: 8794112. Throughput: 0: 11601.3. Samples: 8787696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:01:36,346][22439] Avg episode reward: [(0, '405.501')] [2023-03-11 13:01:37,184][22726] Updated weights for policy 0, policy_version 17200 (0.0005) [2023-03-11 13:01:40,856][22726] Updated weights for policy 0, policy_version 17280 (0.0005) [2023-03-11 13:01:41,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11605.3, 300 sec: 11996.4). Total num frames: 8851456. Throughput: 0: 11582.4. Samples: 8819712. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:01:41,346][22439] Avg episode reward: [(0, '360.526')] [2023-03-11 13:01:44,517][22726] Updated weights for policy 0, policy_version 17360 (0.0005) [2023-03-11 13:01:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11968.6). Total num frames: 8908800. Throughput: 0: 11591.8. Samples: 8888064. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:01:46,346][22439] Avg episode reward: [(0, '511.881')] [2023-03-11 13:01:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000017400_8908800.pth... [2023-03-11 13:01:46,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000016736_8568832.pth [2023-03-11 13:01:48,156][22726] Updated weights for policy 0, policy_version 17440 (0.0005) [2023-03-11 13:01:51,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11468.8, 300 sec: 11940.9). Total num frames: 8962048. Throughput: 0: 11489.2. Samples: 8954784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:01:51,346][22439] Avg episode reward: [(0, '344.100')] [2023-03-11 13:01:51,840][22726] Updated weights for policy 0, policy_version 17520 (0.0005) [2023-03-11 13:01:55,272][22726] Updated weights for policy 0, policy_version 17600 (0.0004) [2023-03-11 13:01:56,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11927.0). Total num frames: 9023488. Throughput: 0: 11412.7. Samples: 8988684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:01:56,346][22439] Avg episode reward: [(0, '475.383')] [2023-03-11 13:01:58,914][22726] Updated weights for policy 0, policy_version 17680 (0.0005) [2023-03-11 13:02:01,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11537.0, 300 sec: 11885.3). Total num frames: 9076736. Throughput: 0: 11293.1. Samples: 9057920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:02:01,346][22439] Avg episode reward: [(0, '334.822')] [2023-03-11 13:02:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000017728_9076736.pth... [2023-03-11 13:02:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000017072_8740864.pth [2023-03-11 13:02:02,564][22726] Updated weights for policy 0, policy_version 17760 (0.0005) [2023-03-11 13:02:06,164][22726] Updated weights for policy 0, policy_version 17840 (0.0005) [2023-03-11 13:02:06,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11468.8, 300 sec: 11885.3). Total num frames: 9134080. Throughput: 0: 11287.0. Samples: 9125896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:02:06,346][22439] Avg episode reward: [(0, '480.344')] [2023-03-11 13:02:09,811][22726] Updated weights for policy 0, policy_version 17920 (0.0005) [2023-03-11 13:02:11,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11871.5). Total num frames: 9191424. Throughput: 0: 11280.8. Samples: 9158792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:02:11,346][22439] Avg episode reward: [(0, '425.954')] [2023-03-11 13:02:13,412][22726] Updated weights for policy 0, policy_version 18000 (0.0005) [2023-03-11 13:02:16,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11857.6). Total num frames: 9248768. Throughput: 0: 11275.0. Samples: 9228352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:02:16,346][22439] Avg episode reward: [(0, '355.996')] [2023-03-11 13:02:16,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000018064_9248768.pth... [2023-03-11 13:02:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000017400_8908800.pth [2023-03-11 13:02:16,745][22726] Updated weights for policy 0, policy_version 18080 (0.0004) [2023-03-11 13:02:20,368][22726] Updated weights for policy 0, policy_version 18160 (0.0005) [2023-03-11 13:02:21,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11843.7). Total num frames: 9306112. Throughput: 0: 11345.2. Samples: 9298232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:02:21,356][22439] Avg episode reward: [(0, '528.658')] [2023-03-11 13:02:21,357][22682] Saving new best policy, reward=528.658! [2023-03-11 13:02:23,991][22726] Updated weights for policy 0, policy_version 18240 (0.0005) [2023-03-11 13:02:26,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11815.9). Total num frames: 9363456. Throughput: 0: 11396.1. Samples: 9332536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:02:26,356][22439] Avg episode reward: [(0, '371.406')] [2023-03-11 13:02:27,623][22726] Updated weights for policy 0, policy_version 18320 (0.0005) [2023-03-11 13:02:31,020][22726] Updated weights for policy 0, policy_version 18400 (0.0004) [2023-03-11 13:02:31,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11400.5, 300 sec: 11802.0). Total num frames: 9424896. Throughput: 0: 11389.1. Samples: 9400572. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:02:31,356][22439] Avg episode reward: [(0, '288.722')] [2023-03-11 13:02:31,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000018408_9424896.pth... [2023-03-11 13:02:31,363][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000017728_9076736.pth [2023-03-11 13:02:34,464][22726] Updated weights for policy 0, policy_version 18480 (0.0005) [2023-03-11 13:02:36,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 11788.1). Total num frames: 9482240. Throughput: 0: 11526.7. Samples: 9473488. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:02:36,356][22439] Avg episode reward: [(0, '406.164')] [2023-03-11 13:02:37,818][22726] Updated weights for policy 0, policy_version 18560 (0.0004) [2023-03-11 13:02:41,199][22726] Updated weights for policy 0, policy_version 18640 (0.0004) [2023-03-11 13:02:41,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 11788.1). Total num frames: 9543680. Throughput: 0: 11594.6. Samples: 9510440. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:02:41,356][22439] Avg episode reward: [(0, '457.700')] [2023-03-11 13:02:44,571][22726] Updated weights for policy 0, policy_version 18720 (0.0004) [2023-03-11 13:02:46,345][22439] Fps is (10 sec: 12287.9, 60 sec: 11605.3, 300 sec: 11788.1). Total num frames: 9605120. Throughput: 0: 11663.2. Samples: 9582764. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:02:46,356][22439] Avg episode reward: [(0, '424.084')] [2023-03-11 13:02:46,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000018760_9605120.pth... [2023-03-11 13:02:46,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000018064_9248768.pth [2023-03-11 13:02:47,851][22726] Updated weights for policy 0, policy_version 18800 (0.0004) [2023-03-11 13:02:51,306][22726] Updated weights for policy 0, policy_version 18880 (0.0004) [2023-03-11 13:02:51,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11741.9, 300 sec: 11774.3). Total num frames: 9666560. Throughput: 0: 11780.2. Samples: 9656004. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:02:51,356][22439] Avg episode reward: [(0, '413.455')] [2023-03-11 13:02:54,945][22726] Updated weights for policy 0, policy_version 18960 (0.0005) [2023-03-11 13:02:56,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 9719808. Throughput: 0: 11830.2. Samples: 9691152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:02:56,356][22439] Avg episode reward: [(0, '604.213')] [2023-03-11 13:02:56,357][22682] Saving new best policy, reward=604.213! [2023-03-11 13:02:58,629][22726] Updated weights for policy 0, policy_version 19040 (0.0005) [2023-03-11 13:03:01,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11673.6, 300 sec: 11718.7). Total num frames: 9777152. Throughput: 0: 11745.2. Samples: 9756888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:03:01,356][22439] Avg episode reward: [(0, '622.825')] [2023-03-11 13:03:01,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000019096_9777152.pth... [2023-03-11 13:03:01,363][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000018408_9424896.pth [2023-03-11 13:03:01,363][22682] Saving new best policy, reward=622.825! [2023-03-11 13:03:02,322][22726] Updated weights for policy 0, policy_version 19120 (0.0005) [2023-03-11 13:03:06,056][22726] Updated weights for policy 0, policy_version 19200 (0.0005) [2023-03-11 13:03:06,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11605.3, 300 sec: 11691.0). Total num frames: 9830400. Throughput: 0: 11654.8. Samples: 9822696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:03:06,356][22439] Avg episode reward: [(0, '503.753')] [2023-03-11 13:03:09,680][22726] Updated weights for policy 0, policy_version 19280 (0.0005) [2023-03-11 13:03:11,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11605.3, 300 sec: 11677.1). Total num frames: 9887744. Throughput: 0: 11668.5. Samples: 9857616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:03:11,346][22439] Avg episode reward: [(0, '387.823')] [2023-03-11 13:03:13,553][22726] Updated weights for policy 0, policy_version 19360 (0.0005) [2023-03-11 13:03:16,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11649.3). Total num frames: 9940992. Throughput: 0: 11585.5. Samples: 9921920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:03:16,346][22439] Avg episode reward: [(0, '551.216')] [2023-03-11 13:03:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000019416_9940992.pth... [2023-03-11 13:03:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000018760_9605120.pth [2023-03-11 13:03:17,245][22726] Updated weights for policy 0, policy_version 19440 (0.0005) [2023-03-11 13:03:20,863][22726] Updated weights for policy 0, policy_version 19520 (0.0005) [2023-03-11 13:03:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11621.5). Total num frames: 9998336. Throughput: 0: 11481.1. Samples: 9990136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:03:21,356][22439] Avg episode reward: [(0, '425.126')] [2023-03-11 13:03:24,529][22726] Updated weights for policy 0, policy_version 19600 (0.0004) [2023-03-11 13:03:26,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11468.8, 300 sec: 11607.7). Total num frames: 10051584. Throughput: 0: 11385.7. Samples: 10022796. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:03:26,356][22439] Avg episode reward: [(0, '556.406')] [2023-03-11 13:03:28,097][22726] Updated weights for policy 0, policy_version 19680 (0.0003) [2023-03-11 13:03:31,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11621.5). Total num frames: 10113024. Throughput: 0: 11329.9. Samples: 10092608. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:03:31,356][22439] Avg episode reward: [(0, '640.466')] [2023-03-11 13:03:31,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000019752_10113024.pth... [2023-03-11 13:03:31,363][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000019096_9777152.pth [2023-03-11 13:03:31,363][22682] Saving new best policy, reward=640.466! [2023-03-11 13:03:31,576][22726] Updated weights for policy 0, policy_version 19760 (0.0004) [2023-03-11 13:03:35,429][22726] Updated weights for policy 0, policy_version 19840 (0.0005) [2023-03-11 13:03:36,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11400.5, 300 sec: 11593.8). Total num frames: 10166272. Throughput: 0: 11158.7. Samples: 10158144. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:03:36,356][22439] Avg episode reward: [(0, '432.051')] [2023-03-11 13:03:39,226][22726] Updated weights for policy 0, policy_version 19920 (0.0005) [2023-03-11 13:03:41,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11264.0, 300 sec: 11552.1). Total num frames: 10219520. Throughput: 0: 11105.8. Samples: 10190912. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:03:41,356][22439] Avg episode reward: [(0, '547.890')] [2023-03-11 13:03:42,901][22726] Updated weights for policy 0, policy_version 20000 (0.0006) [2023-03-11 13:03:46,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11195.7, 300 sec: 11552.1). Total num frames: 10276864. Throughput: 0: 11101.5. Samples: 10256456. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:03:46,356][22439] Avg episode reward: [(0, '527.966')] [2023-03-11 13:03:46,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000020072_10276864.pth... [2023-03-11 13:03:46,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000019416_9940992.pth [2023-03-11 13:03:46,640][22726] Updated weights for policy 0, policy_version 20080 (0.0005) [2023-03-11 13:03:50,380][22726] Updated weights for policy 0, policy_version 20160 (0.0005) [2023-03-11 13:03:51,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 11538.2). Total num frames: 10330112. Throughput: 0: 11097.2. Samples: 10322072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:03:51,356][22439] Avg episode reward: [(0, '677.812')] [2023-03-11 13:03:51,357][22682] Saving new best policy, reward=677.812! [2023-03-11 13:03:53,904][22726] Updated weights for policy 0, policy_version 20240 (0.0004) [2023-03-11 13:03:56,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11538.2). Total num frames: 10387456. Throughput: 0: 11121.6. Samples: 10358088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:03:56,356][22439] Avg episode reward: [(0, '853.780')] [2023-03-11 13:03:56,357][22682] Saving new best policy, reward=853.780! [2023-03-11 13:03:57,696][22726] Updated weights for policy 0, policy_version 20320 (0.0005) [2023-03-11 13:04:01,232][22726] Updated weights for policy 0, policy_version 20400 (0.0004) [2023-03-11 13:04:01,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11127.5, 300 sec: 11552.1). Total num frames: 10444800. Throughput: 0: 11133.2. Samples: 10422916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:04:01,356][22439] Avg episode reward: [(0, '845.228')] [2023-03-11 13:04:01,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000020400_10444800.pth... [2023-03-11 13:04:01,363][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000019752_10113024.pth [2023-03-11 13:04:04,852][22726] Updated weights for policy 0, policy_version 20480 (0.0004) [2023-03-11 13:04:06,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11538.2). Total num frames: 10498048. Throughput: 0: 11155.5. Samples: 10492132. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:04:06,356][22439] Avg episode reward: [(0, '848.505')] [2023-03-11 13:04:08,457][22726] Updated weights for policy 0, policy_version 20560 (0.0005) [2023-03-11 13:04:11,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 11552.1). Total num frames: 10559488. Throughput: 0: 11196.5. Samples: 10526640. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:04:11,346][22439] Avg episode reward: [(0, '739.641')] [2023-03-11 13:04:11,906][22726] Updated weights for policy 0, policy_version 20640 (0.0005) [2023-03-11 13:04:15,515][22726] Updated weights for policy 0, policy_version 20720 (0.0005) [2023-03-11 13:04:16,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11264.0, 300 sec: 11552.1). Total num frames: 10616832. Throughput: 0: 11193.9. Samples: 10596332. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:04:16,346][22439] Avg episode reward: [(0, '841.717')] [2023-03-11 13:04:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000020736_10616832.pth... [2023-03-11 13:04:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000020072_10276864.pth [2023-03-11 13:04:18,988][22726] Updated weights for policy 0, policy_version 20800 (0.0005) [2023-03-11 13:04:21,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11332.3, 300 sec: 11566.0). Total num frames: 10678272. Throughput: 0: 11299.8. Samples: 10666636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:04:21,346][22439] Avg episode reward: [(0, '523.108')] [2023-03-11 13:04:22,321][22726] Updated weights for policy 0, policy_version 20880 (0.0004) [2023-03-11 13:04:25,608][22726] Updated weights for policy 0, policy_version 20960 (0.0005) [2023-03-11 13:04:26,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11468.8, 300 sec: 11579.9). Total num frames: 10739712. Throughput: 0: 11399.6. Samples: 10703892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:04:26,346][22439] Avg episode reward: [(0, '407.066')] [2023-03-11 13:04:29,086][22726] Updated weights for policy 0, policy_version 21040 (0.0005) [2023-03-11 13:04:31,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11400.5, 300 sec: 11579.9). Total num frames: 10797056. Throughput: 0: 11558.2. Samples: 10776576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:04:31,346][22439] Avg episode reward: [(0, '460.426')] [2023-03-11 13:04:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000021088_10797056.pth... [2023-03-11 13:04:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000020400_10444800.pth [2023-03-11 13:04:32,556][22726] Updated weights for policy 0, policy_version 21120 (0.0006) [2023-03-11 13:04:36,042][22726] Updated weights for policy 0, policy_version 21200 (0.0005) [2023-03-11 13:04:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11566.0). Total num frames: 10854400. Throughput: 0: 11650.4. Samples: 10846340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:04:36,346][22439] Avg episode reward: [(0, '311.442')] [2023-03-11 13:04:39,254][22726] Updated weights for policy 0, policy_version 21280 (0.0005) [2023-03-11 13:04:41,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 11579.9). Total num frames: 10919936. Throughput: 0: 11697.7. Samples: 10884484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:04:41,346][22439] Avg episode reward: [(0, '457.060')] [2023-03-11 13:04:42,562][22726] Updated weights for policy 0, policy_version 21360 (0.0004) [2023-03-11 13:04:45,847][22726] Updated weights for policy 0, policy_version 21440 (0.0004) [2023-03-11 13:04:46,345][22439] Fps is (10 sec: 12697.7, 60 sec: 11741.9, 300 sec: 11579.9). Total num frames: 10981376. Throughput: 0: 11934.5. Samples: 10959968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:04:46,346][22439] Avg episode reward: [(0, '490.914')] [2023-03-11 13:04:46,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000021448_10981376.pth... [2023-03-11 13:04:46,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000020736_10616832.pth [2023-03-11 13:04:49,396][22726] Updated weights for policy 0, policy_version 21520 (0.0005) [2023-03-11 13:04:51,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11566.0). Total num frames: 11038720. Throughput: 0: 11964.4. Samples: 11030528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:04:51,346][22439] Avg episode reward: [(0, '479.739')] [2023-03-11 13:04:52,964][22726] Updated weights for policy 0, policy_version 21600 (0.0005) [2023-03-11 13:04:56,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11566.0). Total num frames: 11096064. Throughput: 0: 11938.1. Samples: 11063856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:04:56,346][22439] Avg episode reward: [(0, '455.779')] [2023-03-11 13:04:56,651][22726] Updated weights for policy 0, policy_version 21680 (0.0005) [2023-03-11 13:05:00,240][22726] Updated weights for policy 0, policy_version 21760 (0.0005) [2023-03-11 13:05:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11741.9, 300 sec: 11538.2). Total num frames: 11149312. Throughput: 0: 11914.0. Samples: 11132460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:05:01,346][22439] Avg episode reward: [(0, '581.120')] [2023-03-11 13:05:01,356][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000021784_11153408.pth... [2023-03-11 13:05:01,358][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000021088_10797056.pth [2023-03-11 13:05:03,889][22726] Updated weights for policy 0, policy_version 21840 (0.0005) [2023-03-11 13:05:06,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11878.4, 300 sec: 11538.2). Total num frames: 11210752. Throughput: 0: 11853.3. Samples: 11200032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:05:06,346][22439] Avg episode reward: [(0, '399.047')] [2023-03-11 13:05:07,397][22726] Updated weights for policy 0, policy_version 21920 (0.0005) [2023-03-11 13:05:10,998][22726] Updated weights for policy 0, policy_version 22000 (0.0005) [2023-03-11 13:05:11,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 11510.5). Total num frames: 11264000. Throughput: 0: 11797.1. Samples: 11234760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:05:11,346][22439] Avg episode reward: [(0, '357.040')] [2023-03-11 13:05:14,547][22726] Updated weights for policy 0, policy_version 22080 (0.0005) [2023-03-11 13:05:16,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11741.9, 300 sec: 11496.6). Total num frames: 11321344. Throughput: 0: 11718.1. Samples: 11303892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:05:16,346][22439] Avg episode reward: [(0, '375.069')] [2023-03-11 13:05:16,393][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000022120_11325440.pth... [2023-03-11 13:05:16,394][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000021448_10981376.pth [2023-03-11 13:05:18,164][22726] Updated weights for policy 0, policy_version 22160 (0.0005) [2023-03-11 13:05:21,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11510.5). Total num frames: 11382784. Throughput: 0: 11699.8. Samples: 11372832. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 13:05:21,346][22439] Avg episode reward: [(0, '399.642')] [2023-03-11 13:05:21,664][22726] Updated weights for policy 0, policy_version 22240 (0.0005) [2023-03-11 13:05:25,207][22726] Updated weights for policy 0, policy_version 22320 (0.0005) [2023-03-11 13:05:26,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11510.5). Total num frames: 11440128. Throughput: 0: 11621.1. Samples: 11407432. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 13:05:26,346][22439] Avg episode reward: [(0, '484.447')] [2023-03-11 13:05:28,744][22726] Updated weights for policy 0, policy_version 22400 (0.0005) [2023-03-11 13:05:31,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 11524.3). Total num frames: 11497472. Throughput: 0: 11489.6. Samples: 11477000. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 13:05:31,346][22439] Avg episode reward: [(0, '515.405')] [2023-03-11 13:05:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000022456_11497472.pth... [2023-03-11 13:05:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000021784_11153408.pth [2023-03-11 13:05:32,190][22726] Updated weights for policy 0, policy_version 22480 (0.0005) [2023-03-11 13:05:35,799][22726] Updated weights for policy 0, policy_version 22560 (0.0005) [2023-03-11 13:05:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11524.3). Total num frames: 11554816. Throughput: 0: 11470.2. Samples: 11546688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:05:36,346][22439] Avg episode reward: [(0, '379.224')] [2023-03-11 13:05:39,396][22726] Updated weights for policy 0, policy_version 22640 (0.0005) [2023-03-11 13:05:41,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11510.5). Total num frames: 11612160. Throughput: 0: 11485.4. Samples: 11580700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:05:41,346][22439] Avg episode reward: [(0, '582.259')] [2023-03-11 13:05:43,035][22726] Updated weights for policy 0, policy_version 22720 (0.0005) [2023-03-11 13:05:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11510.5). Total num frames: 11669504. Throughput: 0: 11479.2. Samples: 11649024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:05:46,346][22439] Avg episode reward: [(0, '437.479')] [2023-03-11 13:05:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000022792_11669504.pth... [2023-03-11 13:05:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000022120_11325440.pth [2023-03-11 13:05:46,606][22726] Updated weights for policy 0, policy_version 22800 (0.0005) [2023-03-11 13:05:50,114][22726] Updated weights for policy 0, policy_version 22880 (0.0005) [2023-03-11 13:05:51,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11510.5). Total num frames: 11726848. Throughput: 0: 11525.0. Samples: 11718656. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:05:51,346][22439] Avg episode reward: [(0, '556.319')] [2023-03-11 13:05:53,747][22726] Updated weights for policy 0, policy_version 22960 (0.0005) [2023-03-11 13:05:56,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11524.3). Total num frames: 11784192. Throughput: 0: 11482.8. Samples: 11751488. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:05:56,346][22439] Avg episode reward: [(0, '466.183')] [2023-03-11 13:05:57,272][22726] Updated weights for policy 0, policy_version 23040 (0.0005) [2023-03-11 13:06:00,905][22726] Updated weights for policy 0, policy_version 23120 (0.0005) [2023-03-11 13:06:01,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11510.5). Total num frames: 11841536. Throughput: 0: 11494.0. Samples: 11821120. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:06:01,346][22439] Avg episode reward: [(0, '424.551')] [2023-03-11 13:06:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000023128_11841536.pth... [2023-03-11 13:06:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000022456_11497472.pth [2023-03-11 13:06:04,472][22726] Updated weights for policy 0, policy_version 23200 (0.0005) [2023-03-11 13:06:06,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11482.7). Total num frames: 11898880. Throughput: 0: 11481.6. Samples: 11889504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:06:06,346][22439] Avg episode reward: [(0, '557.958')] [2023-03-11 13:06:08,003][22726] Updated weights for policy 0, policy_version 23280 (0.0004) [2023-03-11 13:06:11,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11482.7). Total num frames: 11956224. Throughput: 0: 11483.8. Samples: 11924204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:06:11,346][22439] Avg episode reward: [(0, '516.191')] [2023-03-11 13:06:11,547][22726] Updated weights for policy 0, policy_version 23360 (0.0005) [2023-03-11 13:06:15,231][22726] Updated weights for policy 0, policy_version 23440 (0.0005) [2023-03-11 13:06:16,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11482.7). Total num frames: 12013568. Throughput: 0: 11466.2. Samples: 11992980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:06:16,346][22439] Avg episode reward: [(0, '502.974')] [2023-03-11 13:06:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000023464_12013568.pth... [2023-03-11 13:06:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000022792_11669504.pth [2023-03-11 13:06:18,930][22726] Updated weights for policy 0, policy_version 23520 (0.0005) [2023-03-11 13:06:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11400.5, 300 sec: 11468.8). Total num frames: 12066816. Throughput: 0: 11376.7. Samples: 12058640. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:06:21,346][22439] Avg episode reward: [(0, '469.752')] [2023-03-11 13:06:22,614][22726] Updated weights for policy 0, policy_version 23600 (0.0005) [2023-03-11 13:06:26,108][22726] Updated weights for policy 0, policy_version 23680 (0.0005) [2023-03-11 13:06:26,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11400.5, 300 sec: 11468.8). Total num frames: 12124160. Throughput: 0: 11370.3. Samples: 12092364. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:06:26,346][22439] Avg episode reward: [(0, '467.028')] [2023-03-11 13:06:29,704][22726] Updated weights for policy 0, policy_version 23760 (0.0005) [2023-03-11 13:06:31,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11400.5, 300 sec: 11482.7). Total num frames: 12181504. Throughput: 0: 11393.9. Samples: 12161748. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:06:31,346][22439] Avg episode reward: [(0, '499.305')] [2023-03-11 13:06:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000023792_12181504.pth... [2023-03-11 13:06:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000023128_11841536.pth [2023-03-11 13:06:33,223][22726] Updated weights for policy 0, policy_version 23840 (0.0005) [2023-03-11 13:06:36,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11400.5, 300 sec: 11482.7). Total num frames: 12238848. Throughput: 0: 11384.7. Samples: 12230968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:06:36,346][22439] Avg episode reward: [(0, '489.838')] [2023-03-11 13:06:36,757][22726] Updated weights for policy 0, policy_version 23920 (0.0005) [2023-03-11 13:06:40,193][22726] Updated weights for policy 0, policy_version 24000 (0.0005) [2023-03-11 13:06:41,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 11496.6). Total num frames: 12300288. Throughput: 0: 11445.2. Samples: 12266524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:06:41,346][22439] Avg episode reward: [(0, '651.369')] [2023-03-11 13:06:43,521][22726] Updated weights for policy 0, policy_version 24080 (0.0005) [2023-03-11 13:06:46,345][22439] Fps is (10 sec: 12287.9, 60 sec: 11537.0, 300 sec: 11524.3). Total num frames: 12361728. Throughput: 0: 11548.2. Samples: 12340788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:06:46,346][22439] Avg episode reward: [(0, '445.718')] [2023-03-11 13:06:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000024144_12361728.pth... [2023-03-11 13:06:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000023464_12013568.pth [2023-03-11 13:06:46,814][22726] Updated weights for policy 0, policy_version 24160 (0.0005) [2023-03-11 13:06:50,180][22726] Updated weights for policy 0, policy_version 24240 (0.0005) [2023-03-11 13:06:51,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11605.3, 300 sec: 11524.3). Total num frames: 12423168. Throughput: 0: 11656.4. Samples: 12414044. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:06:51,346][22439] Avg episode reward: [(0, '402.439')] [2023-03-11 13:06:53,518][22726] Updated weights for policy 0, policy_version 24320 (0.0005) [2023-03-11 13:06:56,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11673.6, 300 sec: 11552.1). Total num frames: 12484608. Throughput: 0: 11710.7. Samples: 12451184. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:06:56,346][22439] Avg episode reward: [(0, '738.197')] [2023-03-11 13:06:56,786][22726] Updated weights for policy 0, policy_version 24400 (0.0005) [2023-03-11 13:07:00,165][22726] Updated weights for policy 0, policy_version 24480 (0.0004) [2023-03-11 13:07:01,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11566.0). Total num frames: 12546048. Throughput: 0: 11820.3. Samples: 12524896. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:07:01,346][22439] Avg episode reward: [(0, '511.156')] [2023-03-11 13:07:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000024504_12546048.pth... [2023-03-11 13:07:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000023792_12181504.pth [2023-03-11 13:07:03,445][22726] Updated weights for policy 0, policy_version 24560 (0.0004) [2023-03-11 13:07:06,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 11579.9). Total num frames: 12607488. Throughput: 0: 12016.0. Samples: 12599360. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:07:06,346][22439] Avg episode reward: [(0, '460.163')] [2023-03-11 13:07:06,789][22726] Updated weights for policy 0, policy_version 24640 (0.0004) [2023-03-11 13:07:10,332][22726] Updated weights for policy 0, policy_version 24720 (0.0004) [2023-03-11 13:07:11,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11579.9). Total num frames: 12664832. Throughput: 0: 12064.7. Samples: 12635276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:07:11,346][22439] Avg episode reward: [(0, '572.349')] [2023-03-11 13:07:13,738][22726] Updated weights for policy 0, policy_version 24800 (0.0003) [2023-03-11 13:07:16,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 11593.8). Total num frames: 12726272. Throughput: 0: 12091.3. Samples: 12705856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:07:16,346][22439] Avg episode reward: [(0, '655.997')] [2023-03-11 13:07:16,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000024856_12726272.pth... [2023-03-11 13:07:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000024144_12361728.pth [2023-03-11 13:07:17,140][22726] Updated weights for policy 0, policy_version 24880 (0.0005) [2023-03-11 13:07:20,627][22726] Updated weights for policy 0, policy_version 24960 (0.0005) [2023-03-11 13:07:21,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11607.6). Total num frames: 12787712. Throughput: 0: 12141.2. Samples: 12777320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:07:21,356][22439] Avg episode reward: [(0, '671.820')] [2023-03-11 13:07:23,979][22726] Updated weights for policy 0, policy_version 25040 (0.0004) [2023-03-11 13:07:26,345][22439] Fps is (10 sec: 11878.5, 60 sec: 12014.9, 300 sec: 11593.8). Total num frames: 12845056. Throughput: 0: 12162.5. Samples: 12813836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:07:26,356][22439] Avg episode reward: [(0, '690.207')] [2023-03-11 13:07:27,406][22726] Updated weights for policy 0, policy_version 25120 (0.0005) [2023-03-11 13:07:30,714][22726] Updated weights for policy 0, policy_version 25200 (0.0004) [2023-03-11 13:07:31,345][22439] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 11607.6). Total num frames: 12906496. Throughput: 0: 12116.4. Samples: 12886028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:07:31,356][22439] Avg episode reward: [(0, '649.978')] [2023-03-11 13:07:31,365][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000025216_12910592.pth... [2023-03-11 13:07:31,367][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000024504_12546048.pth [2023-03-11 13:07:33,940][22726] Updated weights for policy 0, policy_version 25280 (0.0004) [2023-03-11 13:07:36,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12219.7, 300 sec: 11621.5). Total num frames: 12972032. Throughput: 0: 12179.4. Samples: 12962116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:07:36,356][22439] Avg episode reward: [(0, '625.106')] [2023-03-11 13:07:37,204][22726] Updated weights for policy 0, policy_version 25360 (0.0004) [2023-03-11 13:07:40,621][22726] Updated weights for policy 0, policy_version 25440 (0.0004) [2023-03-11 13:07:41,345][22439] Fps is (10 sec: 12697.7, 60 sec: 12219.7, 300 sec: 11621.5). Total num frames: 13033472. Throughput: 0: 12190.1. Samples: 12999740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:07:41,356][22439] Avg episode reward: [(0, '498.241')] [2023-03-11 13:07:43,981][22726] Updated weights for policy 0, policy_version 25520 (0.0004) [2023-03-11 13:07:46,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11607.6). Total num frames: 13090816. Throughput: 0: 12140.1. Samples: 13071200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:07:46,363][22439] Avg episode reward: [(0, '510.682')] [2023-03-11 13:07:46,366][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000025568_13090816.pth... [2023-03-11 13:07:46,367][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000024856_12726272.pth [2023-03-11 13:07:47,488][22726] Updated weights for policy 0, policy_version 25600 (0.0005) [2023-03-11 13:07:50,932][22726] Updated weights for policy 0, policy_version 25680 (0.0004) [2023-03-11 13:07:51,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11635.4). Total num frames: 13152256. Throughput: 0: 12049.2. Samples: 13141572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:07:51,356][22439] Avg episode reward: [(0, '452.504')] [2023-03-11 13:07:54,392][22726] Updated weights for policy 0, policy_version 25760 (0.0004) [2023-03-11 13:07:56,345][22439] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 11635.4). Total num frames: 13209600. Throughput: 0: 12038.2. Samples: 13176996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:07:56,356][22439] Avg episode reward: [(0, '494.419')] [2023-03-11 13:07:57,702][22726] Updated weights for policy 0, policy_version 25840 (0.0004) [2023-03-11 13:08:01,142][22726] Updated weights for policy 0, policy_version 25920 (0.0004) [2023-03-11 13:08:01,345][22439] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 11663.2). Total num frames: 13271040. Throughput: 0: 12106.0. Samples: 13250624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:08:01,356][22439] Avg episode reward: [(0, '553.568')] [2023-03-11 13:08:01,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000025920_13271040.pth... [2023-03-11 13:08:01,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000025216_12910592.pth [2023-03-11 13:08:04,595][22726] Updated weights for policy 0, policy_version 26000 (0.0005) [2023-03-11 13:08:06,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11677.1). Total num frames: 13332480. Throughput: 0: 12094.7. Samples: 13321580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:08:06,356][22439] Avg episode reward: [(0, '554.613')] [2023-03-11 13:08:08,048][22726] Updated weights for policy 0, policy_version 26080 (0.0005) [2023-03-11 13:08:11,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11691.0). Total num frames: 13389824. Throughput: 0: 12079.2. Samples: 13357400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:08:11,356][22439] Avg episode reward: [(0, '520.003')] [2023-03-11 13:08:11,476][22726] Updated weights for policy 0, policy_version 26160 (0.0004) [2023-03-11 13:08:14,847][22726] Updated weights for policy 0, policy_version 26240 (0.0004) [2023-03-11 13:08:16,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11704.8). Total num frames: 13451264. Throughput: 0: 12088.9. Samples: 13430028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:08:16,346][22439] Avg episode reward: [(0, '695.557')] [2023-03-11 13:08:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000026272_13451264.pth... [2023-03-11 13:08:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000025568_13090816.pth [2023-03-11 13:08:18,311][22726] Updated weights for policy 0, policy_version 26320 (0.0004) [2023-03-11 13:08:21,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11718.7). Total num frames: 13508608. Throughput: 0: 11962.2. Samples: 13500416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:08:21,346][22439] Avg episode reward: [(0, '508.988')] [2023-03-11 13:08:21,758][22726] Updated weights for policy 0, policy_version 26400 (0.0004) [2023-03-11 13:08:25,195][22726] Updated weights for policy 0, policy_version 26480 (0.0004) [2023-03-11 13:08:26,345][22439] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 11718.7). Total num frames: 13570048. Throughput: 0: 11942.0. Samples: 13537128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:08:26,346][22439] Avg episode reward: [(0, '558.165')] [2023-03-11 13:08:28,656][22726] Updated weights for policy 0, policy_version 26560 (0.0004) [2023-03-11 13:08:31,345][22439] Fps is (10 sec: 11878.3, 60 sec: 12014.9, 300 sec: 11732.6). Total num frames: 13627392. Throughput: 0: 11927.9. Samples: 13607956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:08:31,346][22439] Avg episode reward: [(0, '456.733')] [2023-03-11 13:08:31,379][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000026624_13631488.pth... [2023-03-11 13:08:31,380][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000025920_13271040.pth [2023-03-11 13:08:32,096][22726] Updated weights for policy 0, policy_version 26640 (0.0004) [2023-03-11 13:08:35,480][22726] Updated weights for policy 0, policy_version 26720 (0.0005) [2023-03-11 13:08:36,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11760.4). Total num frames: 13688832. Throughput: 0: 11968.4. Samples: 13680152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:08:36,346][22439] Avg episode reward: [(0, '686.193')] [2023-03-11 13:08:38,900][22726] Updated weights for policy 0, policy_version 26800 (0.0004) [2023-03-11 13:08:41,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11774.3). Total num frames: 13750272. Throughput: 0: 11977.9. Samples: 13716004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:08:41,346][22439] Avg episode reward: [(0, '352.360')] [2023-03-11 13:08:42,371][22726] Updated weights for policy 0, policy_version 26880 (0.0004) [2023-03-11 13:08:45,833][22726] Updated weights for policy 0, policy_version 26960 (0.0004) [2023-03-11 13:08:46,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11788.1). Total num frames: 13807616. Throughput: 0: 11921.8. Samples: 13787104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:08:46,346][22439] Avg episode reward: [(0, '301.372')] [2023-03-11 13:08:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000026968_13807616.pth... [2023-03-11 13:08:46,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000026272_13451264.pth [2023-03-11 13:08:49,363][22726] Updated weights for policy 0, policy_version 27040 (0.0005) [2023-03-11 13:08:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11788.1). Total num frames: 13864960. Throughput: 0: 11894.7. Samples: 13856840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:08:51,346][22439] Avg episode reward: [(0, '444.595')] [2023-03-11 13:08:52,871][22726] Updated weights for policy 0, policy_version 27120 (0.0005) [2023-03-11 13:08:56,330][22726] Updated weights for policy 0, policy_version 27200 (0.0004) [2023-03-11 13:08:56,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11802.0). Total num frames: 13926400. Throughput: 0: 11871.3. Samples: 13891608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:08:56,346][22439] Avg episode reward: [(0, '395.713')] [2023-03-11 13:09:00,033][22726] Updated weights for policy 0, policy_version 27280 (0.0005) [2023-03-11 13:09:01,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11802.0). Total num frames: 13979648. Throughput: 0: 11799.7. Samples: 13961012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:09:01,346][22439] Avg episode reward: [(0, '326.044')] [2023-03-11 13:09:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000027304_13979648.pth... [2023-03-11 13:09:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000026624_13631488.pth [2023-03-11 13:09:03,828][22726] Updated weights for policy 0, policy_version 27360 (0.0005) [2023-03-11 13:09:06,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11673.6, 300 sec: 11774.3). Total num frames: 14032896. Throughput: 0: 11656.0. Samples: 14024936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:09:06,346][22439] Avg episode reward: [(0, '498.295')] [2023-03-11 13:09:07,579][22726] Updated weights for policy 0, policy_version 27440 (0.0005) [2023-03-11 13:09:11,304][22726] Updated weights for policy 0, policy_version 27520 (0.0005) [2023-03-11 13:09:11,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11673.6, 300 sec: 11774.3). Total num frames: 14090240. Throughput: 0: 11583.7. Samples: 14058396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:09:11,346][22439] Avg episode reward: [(0, '550.747')] [2023-03-11 13:09:14,769][22726] Updated weights for policy 0, policy_version 27600 (0.0005) [2023-03-11 13:09:16,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11760.4). Total num frames: 14147584. Throughput: 0: 11538.2. Samples: 14127176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:09:16,346][22439] Avg episode reward: [(0, '347.832')] [2023-03-11 13:09:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000027632_14147584.pth... [2023-03-11 13:09:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000026968_13807616.pth [2023-03-11 13:09:18,228][22726] Updated weights for policy 0, policy_version 27680 (0.0005) [2023-03-11 13:09:21,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11760.4). Total num frames: 14209024. Throughput: 0: 11515.7. Samples: 14198356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:09:21,346][22439] Avg episode reward: [(0, '397.895')] [2023-03-11 13:09:21,667][22726] Updated weights for policy 0, policy_version 27760 (0.0003) [2023-03-11 13:09:25,142][22726] Updated weights for policy 0, policy_version 27840 (0.0004) [2023-03-11 13:09:26,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11760.4). Total num frames: 14266368. Throughput: 0: 11507.8. Samples: 14233856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:09:26,346][22439] Avg episode reward: [(0, '551.825')] [2023-03-11 13:09:28,597][22726] Updated weights for policy 0, policy_version 27920 (0.0004) [2023-03-11 13:09:31,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11760.4). Total num frames: 14323712. Throughput: 0: 11502.5. Samples: 14304716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:09:31,346][22439] Avg episode reward: [(0, '650.883')] [2023-03-11 13:09:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000027976_14323712.pth... [2023-03-11 13:09:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000027304_13979648.pth [2023-03-11 13:09:32,145][22726] Updated weights for policy 0, policy_version 28000 (0.0004) [2023-03-11 13:09:35,643][22726] Updated weights for policy 0, policy_version 28080 (0.0005) [2023-03-11 13:09:36,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 14381056. Throughput: 0: 11494.6. Samples: 14374096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:09:36,346][22439] Avg episode reward: [(0, '534.831')] [2023-03-11 13:09:39,264][22726] Updated weights for policy 0, policy_version 28160 (0.0003) [2023-03-11 13:09:41,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 14442496. Throughput: 0: 11498.7. Samples: 14409048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:09:41,346][22439] Avg episode reward: [(0, '381.875')] [2023-03-11 13:09:42,800][22726] Updated weights for policy 0, policy_version 28240 (0.0003) [2023-03-11 13:09:46,327][22726] Updated weights for policy 0, policy_version 28320 (0.0003) [2023-03-11 13:09:46,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 14499840. Throughput: 0: 11516.8. Samples: 14479268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:09:46,346][22439] Avg episode reward: [(0, '507.647')] [2023-03-11 13:09:46,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000028320_14499840.pth... [2023-03-11 13:09:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000027632_14147584.pth [2023-03-11 13:09:50,140][22726] Updated weights for policy 0, policy_version 28400 (0.0005) [2023-03-11 13:09:51,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11468.8, 300 sec: 11718.7). Total num frames: 14553088. Throughput: 0: 11545.1. Samples: 14544464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:09:51,346][22439] Avg episode reward: [(0, '663.743')] [2023-03-11 13:09:53,497][22726] Updated weights for policy 0, policy_version 28480 (0.0005) [2023-03-11 13:09:56,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11746.5). Total num frames: 14614528. Throughput: 0: 11618.4. Samples: 14581224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:09:56,346][22439] Avg episode reward: [(0, '678.692')] [2023-03-11 13:09:56,938][22726] Updated weights for policy 0, policy_version 28560 (0.0005) [2023-03-11 13:10:00,384][22726] Updated weights for policy 0, policy_version 28640 (0.0005) [2023-03-11 13:10:01,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 14671872. Throughput: 0: 11653.8. Samples: 14651596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:10:01,346][22439] Avg episode reward: [(0, '449.098')] [2023-03-11 13:10:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000028656_14671872.pth... [2023-03-11 13:10:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000027976_14323712.pth [2023-03-11 13:10:03,861][22726] Updated weights for policy 0, policy_version 28720 (0.0004) [2023-03-11 13:10:06,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11760.4). Total num frames: 14733312. Throughput: 0: 11688.1. Samples: 14724320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:10:06,346][22439] Avg episode reward: [(0, '436.509')] [2023-03-11 13:10:07,214][22726] Updated weights for policy 0, policy_version 28800 (0.0003) [2023-03-11 13:10:10,677][22726] Updated weights for policy 0, policy_version 28880 (0.0004) [2023-03-11 13:10:11,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11760.4). Total num frames: 14790656. Throughput: 0: 11683.2. Samples: 14759600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:10:11,346][22439] Avg episode reward: [(0, '469.085')] [2023-03-11 13:10:14,132][22726] Updated weights for policy 0, policy_version 28960 (0.0004) [2023-03-11 13:10:16,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11741.9, 300 sec: 11760.4). Total num frames: 14852096. Throughput: 0: 11706.6. Samples: 14831512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:10:16,346][22439] Avg episode reward: [(0, '510.971')] [2023-03-11 13:10:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000029008_14852096.pth... [2023-03-11 13:10:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000028320_14499840.pth [2023-03-11 13:10:17,585][22726] Updated weights for policy 0, policy_version 29040 (0.0004) [2023-03-11 13:10:20,935][22726] Updated weights for policy 0, policy_version 29120 (0.0004) [2023-03-11 13:10:21,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11774.3). Total num frames: 14913536. Throughput: 0: 11752.1. Samples: 14902940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:10:21,346][22439] Avg episode reward: [(0, '400.271')] [2023-03-11 13:10:24,290][22726] Updated weights for policy 0, policy_version 29200 (0.0004) [2023-03-11 13:10:26,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11810.1, 300 sec: 11788.1). Total num frames: 14974976. Throughput: 0: 11792.5. Samples: 14939712. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:10:26,346][22439] Avg episode reward: [(0, '443.940')] [2023-03-11 13:10:27,776][22726] Updated weights for policy 0, policy_version 29280 (0.0005) [2023-03-11 13:10:31,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11741.9, 300 sec: 11774.3). Total num frames: 15028224. Throughput: 0: 11791.5. Samples: 15009888. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:10:31,346][22439] Avg episode reward: [(0, '554.421')] [2023-03-11 13:10:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000029352_15028224.pth... [2023-03-11 13:10:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000028656_14671872.pth [2023-03-11 13:10:31,512][22726] Updated weights for policy 0, policy_version 29360 (0.0005) [2023-03-11 13:10:35,228][22726] Updated weights for policy 0, policy_version 29440 (0.0005) [2023-03-11 13:10:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11741.9, 300 sec: 11774.3). Total num frames: 15085568. Throughput: 0: 11803.0. Samples: 15075600. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:10:36,346][22439] Avg episode reward: [(0, '471.602')] [2023-03-11 13:10:38,791][22726] Updated weights for policy 0, policy_version 29520 (0.0005) [2023-03-11 13:10:41,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11605.3, 300 sec: 11760.4). Total num frames: 15138816. Throughput: 0: 11755.2. Samples: 15110208. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:10:41,346][22439] Avg episode reward: [(0, '501.232')] [2023-03-11 13:10:42,455][22726] Updated weights for policy 0, policy_version 29600 (0.0005) [2023-03-11 13:10:46,165][22726] Updated weights for policy 0, policy_version 29680 (0.0005) [2023-03-11 13:10:46,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11605.3, 300 sec: 11760.4). Total num frames: 15196160. Throughput: 0: 11668.8. Samples: 15176692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:10:46,346][22439] Avg episode reward: [(0, '493.300')] [2023-03-11 13:10:46,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000029680_15196160.pth... [2023-03-11 13:10:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000029008_14852096.pth [2023-03-11 13:10:49,783][22726] Updated weights for policy 0, policy_version 29760 (0.0004) [2023-03-11 13:10:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11760.4). Total num frames: 15253504. Throughput: 0: 11566.8. Samples: 15244824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:10:51,346][22439] Avg episode reward: [(0, '551.003')] [2023-03-11 13:10:53,468][22726] Updated weights for policy 0, policy_version 29840 (0.0005) [2023-03-11 13:10:56,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11746.5). Total num frames: 15306752. Throughput: 0: 11521.8. Samples: 15278080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:10:56,346][22439] Avg episode reward: [(0, '615.292')] [2023-03-11 13:10:57,291][22726] Updated weights for policy 0, policy_version 29920 (0.0005) [2023-03-11 13:11:00,987][22726] Updated weights for policy 0, policy_version 30000 (0.0005) [2023-03-11 13:11:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11746.5). Total num frames: 15364096. Throughput: 0: 11368.3. Samples: 15343084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:11:01,346][22439] Avg episode reward: [(0, '486.436')] [2023-03-11 13:11:01,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000030008_15364096.pth... [2023-03-11 13:11:01,349][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000029352_15028224.pth [2023-03-11 13:11:04,828][22726] Updated weights for policy 0, policy_version 30080 (0.0005) [2023-03-11 13:11:06,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11400.5, 300 sec: 11732.6). Total num frames: 15417344. Throughput: 0: 11223.4. Samples: 15407992. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:11:06,346][22439] Avg episode reward: [(0, '495.455')] [2023-03-11 13:11:08,463][22726] Updated weights for policy 0, policy_version 30160 (0.0005) [2023-03-11 13:11:11,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11332.3, 300 sec: 11718.7). Total num frames: 15470592. Throughput: 0: 11160.2. Samples: 15441920. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:11:11,346][22439] Avg episode reward: [(0, '330.500')] [2023-03-11 13:11:12,114][22726] Updated weights for policy 0, policy_version 30240 (0.0005) [2023-03-11 13:11:15,877][22726] Updated weights for policy 0, policy_version 30320 (0.0005) [2023-03-11 13:11:16,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11264.0, 300 sec: 11732.6). Total num frames: 15527936. Throughput: 0: 11077.2. Samples: 15508360. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:11:16,346][22439] Avg episode reward: [(0, '399.566')] [2023-03-11 13:11:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000030328_15527936.pth... [2023-03-11 13:11:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000029680_15196160.pth [2023-03-11 13:11:19,784][22726] Updated weights for policy 0, policy_version 30400 (0.0005) [2023-03-11 13:11:21,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11127.5, 300 sec: 11718.7). Total num frames: 15581184. Throughput: 0: 11037.8. Samples: 15572300. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:11:21,346][22439] Avg episode reward: [(0, '502.260')] [2023-03-11 13:11:23,463][22726] Updated weights for policy 0, policy_version 30480 (0.0005) [2023-03-11 13:11:26,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10990.9, 300 sec: 11704.8). Total num frames: 15634432. Throughput: 0: 11012.3. Samples: 15605760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:11:26,346][22439] Avg episode reward: [(0, '251.296')] [2023-03-11 13:11:27,312][22726] Updated weights for policy 0, policy_version 30560 (0.0005) [2023-03-11 13:11:31,240][22726] Updated weights for policy 0, policy_version 30640 (0.0005) [2023-03-11 13:11:31,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10990.9, 300 sec: 11691.0). Total num frames: 15687680. Throughput: 0: 10943.6. Samples: 15669152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:11:31,346][22439] Avg episode reward: [(0, '290.700')] [2023-03-11 13:11:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000030640_15687680.pth... [2023-03-11 13:11:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000030008_15364096.pth [2023-03-11 13:11:35,021][22726] Updated weights for policy 0, policy_version 30720 (0.0005) [2023-03-11 13:11:36,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10922.7, 300 sec: 11663.2). Total num frames: 15740928. Throughput: 0: 10844.3. Samples: 15732816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:11:36,346][22439] Avg episode reward: [(0, '197.211')] [2023-03-11 13:11:38,744][22726] Updated weights for policy 0, policy_version 30800 (0.0005) [2023-03-11 13:11:41,345][22439] Fps is (10 sec: 10649.7, 60 sec: 10922.7, 300 sec: 11635.4). Total num frames: 15794176. Throughput: 0: 10837.1. Samples: 15765748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:11:41,346][22439] Avg episode reward: [(0, '403.842')] [2023-03-11 13:11:42,487][22726] Updated weights for policy 0, policy_version 30880 (0.0005) [2023-03-11 13:11:46,296][22726] Updated weights for policy 0, policy_version 30960 (0.0005) [2023-03-11 13:11:46,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 11621.5). Total num frames: 15851520. Throughput: 0: 10843.6. Samples: 15831048. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:11:46,346][22439] Avg episode reward: [(0, '488.675')] [2023-03-11 13:11:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000030960_15851520.pth... [2023-03-11 13:11:46,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000030328_15527936.pth [2023-03-11 13:11:50,026][22726] Updated weights for policy 0, policy_version 31040 (0.0005) [2023-03-11 13:11:51,345][22439] Fps is (10 sec: 11059.1, 60 sec: 10854.4, 300 sec: 11593.8). Total num frames: 15904768. Throughput: 0: 10858.8. Samples: 15896640. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:11:51,346][22439] Avg episode reward: [(0, '559.277')] [2023-03-11 13:11:53,886][22726] Updated weights for policy 0, policy_version 31120 (0.0005) [2023-03-11 13:11:56,345][22439] Fps is (10 sec: 10649.7, 60 sec: 10854.4, 300 sec: 11566.0). Total num frames: 15958016. Throughput: 0: 10831.3. Samples: 15929328. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:11:56,346][22439] Avg episode reward: [(0, '569.471')] [2023-03-11 13:11:57,641][22726] Updated weights for policy 0, policy_version 31200 (0.0005) [2023-03-11 13:12:01,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10786.1, 300 sec: 11538.2). Total num frames: 16011264. Throughput: 0: 10803.1. Samples: 15994500. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:12:01,346][22439] Avg episode reward: [(0, '549.081')] [2023-03-11 13:12:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000031272_16011264.pth... [2023-03-11 13:12:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000030640_15687680.pth [2023-03-11 13:12:01,435][22726] Updated weights for policy 0, policy_version 31280 (0.0005) [2023-03-11 13:12:05,431][22726] Updated weights for policy 0, policy_version 31360 (0.0005) [2023-03-11 13:12:06,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10786.1, 300 sec: 11524.3). Total num frames: 16064512. Throughput: 0: 10757.4. Samples: 16056384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:12:06,346][22439] Avg episode reward: [(0, '405.306')] [2023-03-11 13:12:09,263][22726] Updated weights for policy 0, policy_version 31440 (0.0005) [2023-03-11 13:12:11,345][22439] Fps is (10 sec: 10649.7, 60 sec: 10786.1, 300 sec: 11496.6). Total num frames: 16117760. Throughput: 0: 10727.2. Samples: 16088484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:12:11,346][22439] Avg episode reward: [(0, '337.646')] [2023-03-11 13:12:13,120][22726] Updated weights for policy 0, policy_version 31520 (0.0005) [2023-03-11 13:12:16,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10717.9, 300 sec: 11468.8). Total num frames: 16171008. Throughput: 0: 10732.6. Samples: 16152120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:12:16,346][22439] Avg episode reward: [(0, '475.219')] [2023-03-11 13:12:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000031584_16171008.pth... [2023-03-11 13:12:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000030960_15851520.pth [2023-03-11 13:12:17,028][22726] Updated weights for policy 0, policy_version 31600 (0.0006) [2023-03-11 13:12:20,840][22726] Updated weights for policy 0, policy_version 31680 (0.0005) [2023-03-11 13:12:21,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10717.9, 300 sec: 11454.9). Total num frames: 16224256. Throughput: 0: 10738.8. Samples: 16216064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:12:21,346][22439] Avg episode reward: [(0, '404.623')] [2023-03-11 13:12:24,544][22726] Updated weights for policy 0, policy_version 31760 (0.0005) [2023-03-11 13:12:26,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10717.9, 300 sec: 11427.1). Total num frames: 16277504. Throughput: 0: 10735.4. Samples: 16248840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:12:26,346][22439] Avg episode reward: [(0, '381.442')] [2023-03-11 13:12:28,379][22726] Updated weights for policy 0, policy_version 31840 (0.0006) [2023-03-11 13:12:31,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10786.1, 300 sec: 11399.4). Total num frames: 16334848. Throughput: 0: 10740.4. Samples: 16314368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:12:31,346][22439] Avg episode reward: [(0, '506.936')] [2023-03-11 13:12:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000031904_16334848.pth... [2023-03-11 13:12:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000031272_16011264.pth [2023-03-11 13:12:32,045][22726] Updated weights for policy 0, policy_version 31920 (0.0005) [2023-03-11 13:12:35,888][22726] Updated weights for policy 0, policy_version 32000 (0.0005) [2023-03-11 13:12:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10786.1, 300 sec: 11371.6). Total num frames: 16388096. Throughput: 0: 10736.1. Samples: 16379764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:12:36,346][22439] Avg episode reward: [(0, '343.888')] [2023-03-11 13:12:39,701][22726] Updated weights for policy 0, policy_version 32080 (0.0005) [2023-03-11 13:12:41,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10786.1, 300 sec: 11357.7). Total num frames: 16441344. Throughput: 0: 10718.7. Samples: 16411672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:12:41,346][22439] Avg episode reward: [(0, '605.893')] [2023-03-11 13:12:43,510][22726] Updated weights for policy 0, policy_version 32160 (0.0005) [2023-03-11 13:12:46,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10717.9, 300 sec: 11330.0). Total num frames: 16494592. Throughput: 0: 10698.3. Samples: 16475924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:12:46,346][22439] Avg episode reward: [(0, '441.101')] [2023-03-11 13:12:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000032216_16494592.pth... [2023-03-11 13:12:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000031584_16171008.pth [2023-03-11 13:12:47,276][22726] Updated weights for policy 0, policy_version 32240 (0.0006) [2023-03-11 13:12:51,115][22726] Updated weights for policy 0, policy_version 32320 (0.0005) [2023-03-11 13:12:51,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10717.9, 300 sec: 11316.1). Total num frames: 16547840. Throughput: 0: 10741.7. Samples: 16539760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:12:51,346][22439] Avg episode reward: [(0, '439.522')] [2023-03-11 13:12:54,832][22726] Updated weights for policy 0, policy_version 32400 (0.0004) [2023-03-11 13:12:56,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10717.8, 300 sec: 11288.3). Total num frames: 16601088. Throughput: 0: 10783.9. Samples: 16573760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:12:56,346][22439] Avg episode reward: [(0, '303.562')] [2023-03-11 13:12:58,657][22726] Updated weights for policy 0, policy_version 32480 (0.0005) [2023-03-11 13:13:01,345][22439] Fps is (10 sec: 11059.1, 60 sec: 10786.1, 300 sec: 11274.4). Total num frames: 16658432. Throughput: 0: 10802.3. Samples: 16638224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:13:01,356][22439] Avg episode reward: [(0, '328.797')] [2023-03-11 13:13:01,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000032536_16658432.pth... [2023-03-11 13:13:01,363][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000031904_16334848.pth [2023-03-11 13:13:02,404][22726] Updated weights for policy 0, policy_version 32560 (0.0005) [2023-03-11 13:13:06,182][22726] Updated weights for policy 0, policy_version 32640 (0.0005) [2023-03-11 13:13:06,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10786.1, 300 sec: 11260.5). Total num frames: 16711680. Throughput: 0: 10833.1. Samples: 16703552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:13:06,356][22439] Avg episode reward: [(0, '297.615')] [2023-03-11 13:13:09,858][22726] Updated weights for policy 0, policy_version 32720 (0.0005) [2023-03-11 13:13:11,345][22439] Fps is (10 sec: 11059.3, 60 sec: 10854.4, 300 sec: 11246.6). Total num frames: 16769024. Throughput: 0: 10840.6. Samples: 16736664. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:13:11,356][22439] Avg episode reward: [(0, '452.746')] [2023-03-11 13:13:13,584][22726] Updated weights for policy 0, policy_version 32800 (0.0005) [2023-03-11 13:13:16,345][22439] Fps is (10 sec: 11059.1, 60 sec: 10854.4, 300 sec: 11232.8). Total num frames: 16822272. Throughput: 0: 10841.9. Samples: 16802252. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:13:16,356][22439] Avg episode reward: [(0, '452.740')] [2023-03-11 13:13:16,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000032856_16822272.pth... [2023-03-11 13:13:16,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000032216_16494592.pth [2023-03-11 13:13:17,347][22726] Updated weights for policy 0, policy_version 32880 (0.0005) [2023-03-11 13:13:21,001][22726] Updated weights for policy 0, policy_version 32960 (0.0005) [2023-03-11 13:13:21,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10854.4, 300 sec: 11205.0). Total num frames: 16875520. Throughput: 0: 10871.4. Samples: 16868976. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:13:21,355][22439] Avg episode reward: [(0, '397.046')] [2023-03-11 13:13:24,660][22726] Updated weights for policy 0, policy_version 33040 (0.0005) [2023-03-11 13:13:26,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 11205.0). Total num frames: 16932864. Throughput: 0: 10930.1. Samples: 16903528. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:13:26,356][22439] Avg episode reward: [(0, '363.060')] [2023-03-11 13:13:28,455][22726] Updated weights for policy 0, policy_version 33120 (0.0005) [2023-03-11 13:13:31,345][22439] Fps is (10 sec: 11059.1, 60 sec: 10854.4, 300 sec: 11177.2). Total num frames: 16986112. Throughput: 0: 10937.7. Samples: 16968120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:13:31,351][22439] Avg episode reward: [(0, '460.134')] [2023-03-11 13:13:31,354][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000033176_16986112.pth... [2023-03-11 13:13:31,357][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000032536_16658432.pth [2023-03-11 13:13:32,251][22726] Updated weights for policy 0, policy_version 33200 (0.0005) [2023-03-11 13:13:35,884][22726] Updated weights for policy 0, policy_version 33280 (0.0005) [2023-03-11 13:13:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 11163.3). Total num frames: 17043456. Throughput: 0: 10995.7. Samples: 17034568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:13:36,346][22439] Avg episode reward: [(0, '366.943')] [2023-03-11 13:13:39,559][22726] Updated weights for policy 0, policy_version 33360 (0.0005) [2023-03-11 13:13:41,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 11149.5). Total num frames: 17096704. Throughput: 0: 10984.0. Samples: 17068040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:13:41,346][22439] Avg episode reward: [(0, '452.791')] [2023-03-11 13:13:43,373][22726] Updated weights for policy 0, policy_version 33440 (0.0005) [2023-03-11 13:13:46,345][22439] Fps is (10 sec: 11059.1, 60 sec: 10990.9, 300 sec: 11149.4). Total num frames: 17154048. Throughput: 0: 11007.6. Samples: 17133568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:13:46,346][22439] Avg episode reward: [(0, '486.543')] [2023-03-11 13:13:46,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000033504_17154048.pth... [2023-03-11 13:13:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000032856_16822272.pth [2023-03-11 13:13:46,997][22726] Updated weights for policy 0, policy_version 33520 (0.0005) [2023-03-11 13:13:50,641][22726] Updated weights for policy 0, policy_version 33600 (0.0005) [2023-03-11 13:13:51,345][22439] Fps is (10 sec: 11059.3, 60 sec: 10991.0, 300 sec: 11121.7). Total num frames: 17207296. Throughput: 0: 11049.6. Samples: 17200784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:13:51,346][22439] Avg episode reward: [(0, '570.433')] [2023-03-11 13:13:54,348][22726] Updated weights for policy 0, policy_version 33680 (0.0005) [2023-03-11 13:13:56,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11059.2, 300 sec: 11135.6). Total num frames: 17264640. Throughput: 0: 11051.9. Samples: 17234000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:13:56,346][22439] Avg episode reward: [(0, '449.941')] [2023-03-11 13:13:57,928][22726] Updated weights for policy 0, policy_version 33760 (0.0005) [2023-03-11 13:14:01,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11059.2, 300 sec: 11149.4). Total num frames: 17321984. Throughput: 0: 11096.1. Samples: 17301576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:14:01,346][22439] Avg episode reward: [(0, '398.466')] [2023-03-11 13:14:01,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000033832_17321984.pth... [2023-03-11 13:14:01,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000033176_16986112.pth [2023-03-11 13:14:01,617][22726] Updated weights for policy 0, policy_version 33840 (0.0005) [2023-03-11 13:14:05,163][22726] Updated weights for policy 0, policy_version 33920 (0.0004) [2023-03-11 13:14:06,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11127.5, 300 sec: 11149.4). Total num frames: 17379328. Throughput: 0: 11141.9. Samples: 17370364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:14:06,346][22439] Avg episode reward: [(0, '235.850')] [2023-03-11 13:14:08,604][22726] Updated weights for policy 0, policy_version 34000 (0.0005) [2023-03-11 13:14:11,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11127.5, 300 sec: 11149.5). Total num frames: 17436672. Throughput: 0: 11159.9. Samples: 17405724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:14:11,346][22439] Avg episode reward: [(0, '417.795')] [2023-03-11 13:14:12,058][22726] Updated weights for policy 0, policy_version 34080 (0.0005) [2023-03-11 13:14:15,476][22726] Updated weights for policy 0, policy_version 34160 (0.0005) [2023-03-11 13:14:16,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11264.0, 300 sec: 11149.4). Total num frames: 17498112. Throughput: 0: 11303.2. Samples: 17476764. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:14:16,346][22439] Avg episode reward: [(0, '417.671')] [2023-03-11 13:14:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000034176_17498112.pth... [2023-03-11 13:14:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000033504_17154048.pth [2023-03-11 13:14:18,932][22726] Updated weights for policy 0, policy_version 34240 (0.0005) [2023-03-11 13:14:21,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11400.5, 300 sec: 11163.3). Total num frames: 17559552. Throughput: 0: 11432.5. Samples: 17549028. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:14:21,346][22439] Avg episode reward: [(0, '495.185')] [2023-03-11 13:14:22,347][22726] Updated weights for policy 0, policy_version 34320 (0.0005) [2023-03-11 13:14:25,882][22726] Updated weights for policy 0, policy_version 34400 (0.0005) [2023-03-11 13:14:26,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11400.5, 300 sec: 11163.3). Total num frames: 17616896. Throughput: 0: 11471.4. Samples: 17584252. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:14:26,346][22439] Avg episode reward: [(0, '471.557')] [2023-03-11 13:14:29,464][22726] Updated weights for policy 0, policy_version 34480 (0.0005) [2023-03-11 13:14:31,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11163.3). Total num frames: 17674240. Throughput: 0: 11559.8. Samples: 17653756. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:14:31,346][22439] Avg episode reward: [(0, '416.982')] [2023-03-11 13:14:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000034520_17674240.pth... [2023-03-11 13:14:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000033832_17321984.pth [2023-03-11 13:14:32,991][22726] Updated weights for policy 0, policy_version 34560 (0.0005) [2023-03-11 13:14:36,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11149.5). Total num frames: 17731584. Throughput: 0: 11633.7. Samples: 17724300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:14:36,346][22439] Avg episode reward: [(0, '600.597')] [2023-03-11 13:14:36,363][22726] Updated weights for policy 0, policy_version 34640 (0.0005) [2023-03-11 13:14:39,814][22726] Updated weights for policy 0, policy_version 34720 (0.0005) [2023-03-11 13:14:41,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 11163.3). Total num frames: 17793024. Throughput: 0: 11694.7. Samples: 17760264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:14:41,346][22439] Avg episode reward: [(0, '469.124')] [2023-03-11 13:14:43,244][22726] Updated weights for policy 0, policy_version 34800 (0.0005) [2023-03-11 13:14:46,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 11177.2). Total num frames: 17850368. Throughput: 0: 11770.4. Samples: 17831244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:14:46,346][22439] Avg episode reward: [(0, '327.858')] [2023-03-11 13:14:46,363][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000034872_17854464.pth... [2023-03-11 13:14:46,364][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000034176_17498112.pth [2023-03-11 13:14:46,690][22726] Updated weights for policy 0, policy_version 34880 (0.0005) [2023-03-11 13:14:49,965][22726] Updated weights for policy 0, policy_version 34960 (0.0005) [2023-03-11 13:14:51,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11810.1, 300 sec: 11191.1). Total num frames: 17915904. Throughput: 0: 11886.1. Samples: 17905236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:14:51,346][22439] Avg episode reward: [(0, '178.971')] [2023-03-11 13:14:53,238][22726] Updated weights for policy 0, policy_version 35040 (0.0005) [2023-03-11 13:14:56,345][22439] Fps is (10 sec: 12697.7, 60 sec: 11878.4, 300 sec: 11205.0). Total num frames: 17977344. Throughput: 0: 11938.1. Samples: 17942936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:14:56,346][22439] Avg episode reward: [(0, '371.513')] [2023-03-11 13:14:56,492][22726] Updated weights for policy 0, policy_version 35120 (0.0005) [2023-03-11 13:14:59,916][22726] Updated weights for policy 0, policy_version 35200 (0.0005) [2023-03-11 13:15:01,345][22439] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 11205.0). Total num frames: 18038784. Throughput: 0: 12005.2. Samples: 18017000. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:15:01,346][22439] Avg episode reward: [(0, '354.803')] [2023-03-11 13:15:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000035232_18038784.pth... [2023-03-11 13:15:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000034520_17674240.pth [2023-03-11 13:15:03,425][22726] Updated weights for policy 0, policy_version 35280 (0.0005) [2023-03-11 13:15:06,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11205.0). Total num frames: 18096128. Throughput: 0: 11934.6. Samples: 18086088. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:15:06,346][22439] Avg episode reward: [(0, '415.897')] [2023-03-11 13:15:07,044][22726] Updated weights for policy 0, policy_version 35360 (0.0005) [2023-03-11 13:15:10,640][22726] Updated weights for policy 0, policy_version 35440 (0.0005) [2023-03-11 13:15:11,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11191.1). Total num frames: 18153472. Throughput: 0: 11921.2. Samples: 18120704. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:15:11,346][22439] Avg episode reward: [(0, '430.601')] [2023-03-11 13:15:14,051][22726] Updated weights for policy 0, policy_version 35520 (0.0005) [2023-03-11 13:15:16,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11878.4, 300 sec: 11177.2). Total num frames: 18210816. Throughput: 0: 11925.6. Samples: 18190408. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:15:16,346][22439] Avg episode reward: [(0, '449.644')] [2023-03-11 13:15:16,381][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000035576_18214912.pth... [2023-03-11 13:15:16,382][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000034872_17854464.pth [2023-03-11 13:15:17,403][22726] Updated weights for policy 0, policy_version 35600 (0.0004) [2023-03-11 13:15:20,715][22726] Updated weights for policy 0, policy_version 35680 (0.0004) [2023-03-11 13:15:21,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 11177.2). Total num frames: 18272256. Throughput: 0: 12007.2. Samples: 18264624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:15:21,346][22439] Avg episode reward: [(0, '547.569')] [2023-03-11 13:15:24,113][22726] Updated weights for policy 0, policy_version 35760 (0.0004) [2023-03-11 13:15:26,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11205.0). Total num frames: 18333696. Throughput: 0: 12009.0. Samples: 18300668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:15:26,346][22439] Avg episode reward: [(0, '382.941')] [2023-03-11 13:15:27,521][22726] Updated weights for policy 0, policy_version 35840 (0.0005) [2023-03-11 13:15:31,197][22726] Updated weights for policy 0, policy_version 35920 (0.0005) [2023-03-11 13:15:31,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11205.0). Total num frames: 18391040. Throughput: 0: 12004.3. Samples: 18371436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:15:31,346][22439] Avg episode reward: [(0, '683.325')] [2023-03-11 13:15:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000035920_18391040.pth... [2023-03-11 13:15:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000035232_18038784.pth [2023-03-11 13:15:34,964][22726] Updated weights for policy 0, policy_version 36000 (0.0005) [2023-03-11 13:15:36,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11878.4, 300 sec: 11205.0). Total num frames: 18444288. Throughput: 0: 11812.8. Samples: 18436812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:15:36,356][22439] Avg episode reward: [(0, '473.719')] [2023-03-11 13:15:38,662][22726] Updated weights for policy 0, policy_version 36080 (0.0005) [2023-03-11 13:15:41,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11810.1, 300 sec: 11205.0). Total num frames: 18501632. Throughput: 0: 11718.6. Samples: 18470272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:15:41,356][22439] Avg episode reward: [(0, '498.482')] [2023-03-11 13:15:42,262][22726] Updated weights for policy 0, policy_version 36160 (0.0005) [2023-03-11 13:15:46,018][22726] Updated weights for policy 0, policy_version 36240 (0.0004) [2023-03-11 13:15:46,345][22439] Fps is (10 sec: 11059.0, 60 sec: 11741.9, 300 sec: 11191.1). Total num frames: 18554880. Throughput: 0: 11578.3. Samples: 18538024. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 13:15:46,346][22439] Avg episode reward: [(0, '548.228')] [2023-03-11 13:15:46,385][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000036248_18558976.pth... [2023-03-11 13:15:46,387][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000035576_18214912.pth [2023-03-11 13:15:49,295][22726] Updated weights for policy 0, policy_version 36320 (0.0004) [2023-03-11 13:15:51,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11741.9, 300 sec: 11232.8). Total num frames: 18620416. Throughput: 0: 11623.2. Samples: 18609132. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 13:15:51,346][22439] Avg episode reward: [(0, '533.042')] [2023-03-11 13:15:52,702][22726] Updated weights for policy 0, policy_version 36400 (0.0005) [2023-03-11 13:15:56,058][22726] Updated weights for policy 0, policy_version 36480 (0.0005) [2023-03-11 13:15:56,345][22439] Fps is (10 sec: 12288.2, 60 sec: 11673.6, 300 sec: 11232.8). Total num frames: 18677760. Throughput: 0: 11652.5. Samples: 18645064. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 13:15:56,346][22439] Avg episode reward: [(0, '552.474')] [2023-03-11 13:15:59,535][22726] Updated weights for policy 0, policy_version 36560 (0.0005) [2023-03-11 13:16:01,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11260.5). Total num frames: 18739200. Throughput: 0: 11719.8. Samples: 18717800. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 13:16:01,346][22439] Avg episode reward: [(0, '331.151')] [2023-03-11 13:16:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000036600_18739200.pth... [2023-03-11 13:16:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000035920_18391040.pth [2023-03-11 13:16:03,108][22726] Updated weights for policy 0, policy_version 36640 (0.0005) [2023-03-11 13:16:06,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11274.4). Total num frames: 18796544. Throughput: 0: 11602.5. Samples: 18786736. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 13:16:06,346][22439] Avg episode reward: [(0, '497.341')] [2023-03-11 13:16:06,659][22726] Updated weights for policy 0, policy_version 36720 (0.0005) [2023-03-11 13:16:10,127][22726] Updated weights for policy 0, policy_version 36800 (0.0005) [2023-03-11 13:16:11,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11274.4). Total num frames: 18853888. Throughput: 0: 11565.6. Samples: 18821120. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:16:11,346][22439] Avg episode reward: [(0, '442.244')] [2023-03-11 13:16:13,601][22726] Updated weights for policy 0, policy_version 36880 (0.0005) [2023-03-11 13:16:16,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 11288.3). Total num frames: 18911232. Throughput: 0: 11560.4. Samples: 18891656. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:16:16,346][22439] Avg episode reward: [(0, '388.850')] [2023-03-11 13:16:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000036936_18911232.pth... [2023-03-11 13:16:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000036248_18558976.pth [2023-03-11 13:16:17,176][22726] Updated weights for policy 0, policy_version 36960 (0.0005) [2023-03-11 13:16:20,773][22726] Updated weights for policy 0, policy_version 37040 (0.0005) [2023-03-11 13:16:21,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11302.2). Total num frames: 18968576. Throughput: 0: 11636.5. Samples: 18960456. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:16:21,346][22439] Avg episode reward: [(0, '438.092')] [2023-03-11 13:16:24,313][22726] Updated weights for policy 0, policy_version 37120 (0.0003) [2023-03-11 13:16:26,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11330.0). Total num frames: 19030016. Throughput: 0: 11641.6. Samples: 18994144. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:16:26,346][22439] Avg episode reward: [(0, '406.133')] [2023-03-11 13:16:27,801][22726] Updated weights for policy 0, policy_version 37200 (0.0004) [2023-03-11 13:16:31,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11330.0). Total num frames: 19083264. Throughput: 0: 11684.4. Samples: 19063820. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:16:31,346][22439] Avg episode reward: [(0, '481.278')] [2023-03-11 13:16:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000037272_19083264.pth... [2023-03-11 13:16:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000036600_18739200.pth [2023-03-11 13:16:31,593][22726] Updated weights for policy 0, policy_version 37280 (0.0005) [2023-03-11 13:16:35,260][22726] Updated weights for policy 0, policy_version 37360 (0.0005) [2023-03-11 13:16:36,345][22439] Fps is (10 sec: 10649.7, 60 sec: 11537.1, 300 sec: 11330.0). Total num frames: 19136512. Throughput: 0: 11579.6. Samples: 19130212. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:16:36,346][22439] Avg episode reward: [(0, '504.340')] [2023-03-11 13:16:38,836][22726] Updated weights for policy 0, policy_version 37440 (0.0005) [2023-03-11 13:16:41,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11537.1, 300 sec: 11330.0). Total num frames: 19193856. Throughput: 0: 11553.9. Samples: 19164988. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:16:41,346][22439] Avg episode reward: [(0, '499.201')] [2023-03-11 13:16:42,357][22726] Updated weights for policy 0, policy_version 37520 (0.0004) [2023-03-11 13:16:46,023][22726] Updated weights for policy 0, policy_version 37600 (0.0003) [2023-03-11 13:16:46,345][22439] Fps is (10 sec: 11468.6, 60 sec: 11605.3, 300 sec: 11343.8). Total num frames: 19251200. Throughput: 0: 11443.1. Samples: 19232740. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:16:46,346][22439] Avg episode reward: [(0, '635.015')] [2023-03-11 13:16:46,361][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000037608_19255296.pth... [2023-03-11 13:16:46,364][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000036936_18911232.pth [2023-03-11 13:16:49,511][22726] Updated weights for policy 0, policy_version 37680 (0.0004) [2023-03-11 13:16:51,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11357.7). Total num frames: 19308544. Throughput: 0: 11445.5. Samples: 19301784. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:16:51,346][22439] Avg episode reward: [(0, '515.214')] [2023-03-11 13:16:53,240][22726] Updated weights for policy 0, policy_version 37760 (0.0005) [2023-03-11 13:16:56,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11371.6). Total num frames: 19365888. Throughput: 0: 11428.0. Samples: 19335380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:16:56,346][22439] Avg episode reward: [(0, '323.789')] [2023-03-11 13:16:57,004][22726] Updated weights for policy 0, policy_version 37840 (0.0005) [2023-03-11 13:17:00,745][22726] Updated weights for policy 0, policy_version 37920 (0.0004) [2023-03-11 13:17:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 11371.6). Total num frames: 19419136. Throughput: 0: 11292.0. Samples: 19399796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:17:01,346][22439] Avg episode reward: [(0, '298.071')] [2023-03-11 13:17:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000037928_19419136.pth... [2023-03-11 13:17:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000037272_19083264.pth [2023-03-11 13:17:04,410][22726] Updated weights for policy 0, policy_version 38000 (0.0005) [2023-03-11 13:17:06,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 11385.5). Total num frames: 19476480. Throughput: 0: 11261.9. Samples: 19467240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:17:06,346][22439] Avg episode reward: [(0, '374.203')] [2023-03-11 13:17:08,157][22726] Updated weights for policy 0, policy_version 38080 (0.0005) [2023-03-11 13:17:11,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11264.0, 300 sec: 11385.5). Total num frames: 19529728. Throughput: 0: 11249.4. Samples: 19500368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:17:11,356][22439] Avg episode reward: [(0, '378.598')] [2023-03-11 13:17:11,778][22726] Updated weights for policy 0, policy_version 38160 (0.0005) [2023-03-11 13:17:15,476][22726] Updated weights for policy 0, policy_version 38240 (0.0006) [2023-03-11 13:17:16,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11264.0, 300 sec: 11399.4). Total num frames: 19587072. Throughput: 0: 11179.4. Samples: 19566892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:17:16,356][22439] Avg episode reward: [(0, '399.387')] [2023-03-11 13:17:16,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000038256_19587072.pth... [2023-03-11 13:17:16,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000037608_19255296.pth [2023-03-11 13:17:19,263][22726] Updated weights for policy 0, policy_version 38320 (0.0006) [2023-03-11 13:17:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11399.4). Total num frames: 19640320. Throughput: 0: 11156.1. Samples: 19632236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:17:21,356][22439] Avg episode reward: [(0, '545.326')] [2023-03-11 13:17:22,928][22726] Updated weights for policy 0, policy_version 38400 (0.0005) [2023-03-11 13:17:26,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11127.5, 300 sec: 11399.4). Total num frames: 19697664. Throughput: 0: 11134.9. Samples: 19666060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:17:26,356][22439] Avg episode reward: [(0, '352.633')] [2023-03-11 13:17:26,674][22726] Updated weights for policy 0, policy_version 38480 (0.0006) [2023-03-11 13:17:30,383][22726] Updated weights for policy 0, policy_version 38560 (0.0005) [2023-03-11 13:17:31,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11127.5, 300 sec: 11399.4). Total num frames: 19750912. Throughput: 0: 11109.3. Samples: 19732660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:17:31,356][22439] Avg episode reward: [(0, '401.202')] [2023-03-11 13:17:31,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000038576_19750912.pth... [2023-03-11 13:17:31,363][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000037928_19419136.pth [2023-03-11 13:17:34,119][22726] Updated weights for policy 0, policy_version 38640 (0.0005) [2023-03-11 13:17:36,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11127.4, 300 sec: 11399.4). Total num frames: 19804160. Throughput: 0: 11016.4. Samples: 19797520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:17:36,356][22439] Avg episode reward: [(0, '380.736')] [2023-03-11 13:17:37,897][22726] Updated weights for policy 0, policy_version 38720 (0.0005) [2023-03-11 13:17:41,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11127.4, 300 sec: 11413.3). Total num frames: 19861504. Throughput: 0: 10989.3. Samples: 19829900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:17:41,356][22439] Avg episode reward: [(0, '510.115')] [2023-03-11 13:17:41,578][22726] Updated weights for policy 0, policy_version 38800 (0.0004) [2023-03-11 13:17:45,335][22726] Updated weights for policy 0, policy_version 38880 (0.0005) [2023-03-11 13:17:46,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11059.2, 300 sec: 11413.3). Total num frames: 19914752. Throughput: 0: 11043.1. Samples: 19896736. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:17:46,356][22439] Avg episode reward: [(0, '419.541')] [2023-03-11 13:17:46,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000038896_19914752.pth... [2023-03-11 13:17:46,363][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000038256_19587072.pth [2023-03-11 13:17:49,107][22726] Updated weights for policy 0, policy_version 38960 (0.0005) [2023-03-11 13:17:51,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 11427.1). Total num frames: 19972096. Throughput: 0: 11013.9. Samples: 19962864. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:17:51,356][22439] Avg episode reward: [(0, '470.339')] [2023-03-11 13:17:52,713][22726] Updated weights for policy 0, policy_version 39040 (0.0004) [2023-03-11 13:17:56,345][22439] Fps is (10 sec: 11059.4, 60 sec: 10990.9, 300 sec: 11413.3). Total num frames: 20025344. Throughput: 0: 11029.1. Samples: 19996680. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:17:56,346][22439] Avg episode reward: [(0, '385.414')] [2023-03-11 13:17:56,537][22726] Updated weights for policy 0, policy_version 39120 (0.0006) [2023-03-11 13:18:00,283][22726] Updated weights for policy 0, policy_version 39200 (0.0006) [2023-03-11 13:18:01,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10990.9, 300 sec: 11413.3). Total num frames: 20078592. Throughput: 0: 10980.3. Samples: 20061004. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:18:01,346][22439] Avg episode reward: [(0, '402.853')] [2023-03-11 13:18:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000039216_20078592.pth... [2023-03-11 13:18:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000038576_19750912.pth [2023-03-11 13:18:04,043][22726] Updated weights for policy 0, policy_version 39280 (0.0006) [2023-03-11 13:18:06,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 11413.3). Total num frames: 20135936. Throughput: 0: 10984.0. Samples: 20126516. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:18:06,356][22439] Avg episode reward: [(0, '318.401')] [2023-03-11 13:18:07,820][22726] Updated weights for policy 0, policy_version 39360 (0.0005) [2023-03-11 13:18:11,345][22439] Fps is (10 sec: 11059.3, 60 sec: 10990.9, 300 sec: 11413.3). Total num frames: 20189184. Throughput: 0: 10960.5. Samples: 20159284. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:18:11,356][22439] Avg episode reward: [(0, '303.788')] [2023-03-11 13:18:11,486][22726] Updated weights for policy 0, policy_version 39440 (0.0005) [2023-03-11 13:18:15,177][22726] Updated weights for policy 0, policy_version 39520 (0.0005) [2023-03-11 13:18:16,345][22439] Fps is (10 sec: 11059.1, 60 sec: 10990.9, 300 sec: 11427.1). Total num frames: 20246528. Throughput: 0: 10965.6. Samples: 20226112. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:18:16,356][22439] Avg episode reward: [(0, '315.122')] [2023-03-11 13:18:16,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000039544_20246528.pth... [2023-03-11 13:18:16,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000038896_19914752.pth [2023-03-11 13:18:18,935][22726] Updated weights for policy 0, policy_version 39600 (0.0005) [2023-03-11 13:18:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 11413.3). Total num frames: 20299776. Throughput: 0: 10975.8. Samples: 20291432. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:18:21,356][22439] Avg episode reward: [(0, '543.447')] [2023-03-11 13:18:22,760][22726] Updated weights for policy 0, policy_version 39680 (0.0005) [2023-03-11 13:18:26,345][22439] Fps is (10 sec: 10240.1, 60 sec: 10854.4, 300 sec: 11399.4). Total num frames: 20348928. Throughput: 0: 10965.1. Samples: 20323328. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:18:26,363][22439] Avg episode reward: [(0, '404.876')] [2023-03-11 13:18:26,732][22726] Updated weights for policy 0, policy_version 39760 (0.0005) [2023-03-11 13:18:30,390][22726] Updated weights for policy 0, policy_version 39840 (0.0004) [2023-03-11 13:18:31,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10922.7, 300 sec: 11399.4). Total num frames: 20406272. Throughput: 0: 10889.7. Samples: 20386772. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:18:31,356][22439] Avg episode reward: [(0, '357.777')] [2023-03-11 13:18:31,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000039856_20406272.pth... [2023-03-11 13:18:31,360][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000039216_20078592.pth [2023-03-11 13:18:33,836][22726] Updated weights for policy 0, policy_version 39920 (0.0004) [2023-03-11 13:18:36,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11059.2, 300 sec: 11427.1). Total num frames: 20467712. Throughput: 0: 11011.3. Samples: 20458372. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:18:36,356][22439] Avg episode reward: [(0, '455.058')] [2023-03-11 13:18:37,336][22726] Updated weights for policy 0, policy_version 40000 (0.0004) [2023-03-11 13:18:40,900][22726] Updated weights for policy 0, policy_version 40080 (0.0004) [2023-03-11 13:18:41,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11059.2, 300 sec: 11427.1). Total num frames: 20525056. Throughput: 0: 11013.9. Samples: 20492304. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:18:41,356][22439] Avg episode reward: [(0, '329.818')] [2023-03-11 13:18:44,403][22726] Updated weights for policy 0, policy_version 40160 (0.0003) [2023-03-11 13:18:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11127.5, 300 sec: 11441.0). Total num frames: 20582400. Throughput: 0: 11133.2. Samples: 20561996. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:18:46,356][22439] Avg episode reward: [(0, '259.384')] [2023-03-11 13:18:46,393][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000040208_20586496.pth... [2023-03-11 13:18:46,397][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000039544_20246528.pth [2023-03-11 13:18:47,806][22726] Updated weights for policy 0, policy_version 40240 (0.0004) [2023-03-11 13:18:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11127.5, 300 sec: 11441.0). Total num frames: 20639744. Throughput: 0: 11223.4. Samples: 20631568. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:18:51,356][22439] Avg episode reward: [(0, '210.278')] [2023-03-11 13:18:51,584][22726] Updated weights for policy 0, policy_version 40320 (0.0005) [2023-03-11 13:18:55,371][22726] Updated weights for policy 0, policy_version 40400 (0.0005) [2023-03-11 13:18:56,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11427.1). Total num frames: 20692992. Throughput: 0: 11223.0. Samples: 20664320. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:18:56,356][22439] Avg episode reward: [(0, '189.572')] [2023-03-11 13:18:59,036][22726] Updated weights for policy 0, policy_version 40480 (0.0005) [2023-03-11 13:19:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11427.1). Total num frames: 20750336. Throughput: 0: 11195.7. Samples: 20729920. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:19:01,356][22439] Avg episode reward: [(0, '344.606')] [2023-03-11 13:19:01,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000040528_20750336.pth... [2023-03-11 13:19:01,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000039856_20406272.pth [2023-03-11 13:19:02,726][22726] Updated weights for policy 0, policy_version 40560 (0.0005) [2023-03-11 13:19:06,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11413.3). Total num frames: 20803584. Throughput: 0: 11199.4. Samples: 20795404. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:19:06,346][22439] Avg episode reward: [(0, '269.847')] [2023-03-11 13:19:06,596][22726] Updated weights for policy 0, policy_version 40640 (0.0005) [2023-03-11 13:19:10,277][22726] Updated weights for policy 0, policy_version 40720 (0.0005) [2023-03-11 13:19:11,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11127.5, 300 sec: 11385.5). Total num frames: 20856832. Throughput: 0: 11220.8. Samples: 20828264. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:19:11,346][22439] Avg episode reward: [(0, '262.665')] [2023-03-11 13:19:14,100][22726] Updated weights for policy 0, policy_version 40800 (0.0005) [2023-03-11 13:19:16,345][22439] Fps is (10 sec: 10649.5, 60 sec: 11059.2, 300 sec: 11357.7). Total num frames: 20910080. Throughput: 0: 11263.6. Samples: 20893636. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:19:16,346][22439] Avg episode reward: [(0, '248.183')] [2023-03-11 13:19:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000040840_20910080.pth... [2023-03-11 13:19:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000040208_20586496.pth [2023-03-11 13:19:17,964][22726] Updated weights for policy 0, policy_version 40880 (0.0005) [2023-03-11 13:19:21,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11059.2, 300 sec: 11343.8). Total num frames: 20963328. Throughput: 0: 11102.8. Samples: 20958000. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:19:21,346][22439] Avg episode reward: [(0, '510.065')] [2023-03-11 13:19:21,771][22726] Updated weights for policy 0, policy_version 40960 (0.0005) [2023-03-11 13:19:25,579][22726] Updated weights for policy 0, policy_version 41040 (0.0005) [2023-03-11 13:19:26,345][22439] Fps is (10 sec: 10649.7, 60 sec: 11127.5, 300 sec: 11330.0). Total num frames: 21016576. Throughput: 0: 11031.9. Samples: 20988740. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:19:26,346][22439] Avg episode reward: [(0, '532.981')] [2023-03-11 13:19:29,367][22726] Updated weights for policy 0, policy_version 41120 (0.0005) [2023-03-11 13:19:31,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11127.5, 300 sec: 11329.9). Total num frames: 21073920. Throughput: 0: 10928.8. Samples: 21053792. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:19:31,346][22439] Avg episode reward: [(0, '275.000')] [2023-03-11 13:19:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000041160_21073920.pth... [2023-03-11 13:19:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000040528_20750336.pth [2023-03-11 13:19:33,078][22726] Updated weights for policy 0, policy_version 41200 (0.0005) [2023-03-11 13:19:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 11302.2). Total num frames: 21127168. Throughput: 0: 10841.8. Samples: 21119448. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:19:36,346][22439] Avg episode reward: [(0, '587.433')] [2023-03-11 13:19:36,885][22726] Updated weights for policy 0, policy_version 41280 (0.0005) [2023-03-11 13:19:40,663][22726] Updated weights for policy 0, policy_version 41360 (0.0005) [2023-03-11 13:19:41,345][22439] Fps is (10 sec: 10649.7, 60 sec: 10922.7, 300 sec: 11288.3). Total num frames: 21180416. Throughput: 0: 10833.3. Samples: 21151816. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:19:41,346][22439] Avg episode reward: [(0, '447.367')] [2023-03-11 13:19:44,521][22726] Updated weights for policy 0, policy_version 41440 (0.0005) [2023-03-11 13:19:46,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10854.4, 300 sec: 11246.6). Total num frames: 21233664. Throughput: 0: 10820.1. Samples: 21216824. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:19:46,346][22439] Avg episode reward: [(0, '447.209')] [2023-03-11 13:19:46,374][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000041480_21237760.pth... [2023-03-11 13:19:46,376][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000040840_20910080.pth [2023-03-11 13:19:48,224][22726] Updated weights for policy 0, policy_version 41520 (0.0005) [2023-03-11 13:19:51,345][22439] Fps is (10 sec: 11059.1, 60 sec: 10854.4, 300 sec: 11232.8). Total num frames: 21291008. Throughput: 0: 10827.1. Samples: 21282624. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:19:51,346][22439] Avg episode reward: [(0, '412.454')] [2023-03-11 13:19:52,065][22726] Updated weights for policy 0, policy_version 41600 (0.0005) [2023-03-11 13:19:55,529][22726] Updated weights for policy 0, policy_version 41680 (0.0003) [2023-03-11 13:19:56,345][22439] Fps is (10 sec: 11468.8, 60 sec: 10922.7, 300 sec: 11218.9). Total num frames: 21348352. Throughput: 0: 10829.3. Samples: 21315584. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:19:56,346][22439] Avg episode reward: [(0, '372.684')] [2023-03-11 13:19:59,200][22726] Updated weights for policy 0, policy_version 41760 (0.0004) [2023-03-11 13:20:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10854.4, 300 sec: 11205.0). Total num frames: 21401600. Throughput: 0: 10892.3. Samples: 21383788. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:20:01,346][22439] Avg episode reward: [(0, '326.301')] [2023-03-11 13:20:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000041800_21401600.pth... [2023-03-11 13:20:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000041160_21073920.pth [2023-03-11 13:20:03,021][22726] Updated weights for policy 0, policy_version 41840 (0.0004) [2023-03-11 13:20:06,345][22439] Fps is (10 sec: 10649.7, 60 sec: 10854.4, 300 sec: 11191.1). Total num frames: 21454848. Throughput: 0: 10882.1. Samples: 21447692. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:20:06,346][22439] Avg episode reward: [(0, '397.079')] [2023-03-11 13:20:06,863][22726] Updated weights for policy 0, policy_version 41920 (0.0005) [2023-03-11 13:20:10,587][22726] Updated weights for policy 0, policy_version 42000 (0.0005) [2023-03-11 13:20:11,345][22439] Fps is (10 sec: 10649.7, 60 sec: 10854.4, 300 sec: 11177.2). Total num frames: 21508096. Throughput: 0: 10905.5. Samples: 21479488. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:20:11,346][22439] Avg episode reward: [(0, '551.767')] [2023-03-11 13:20:14,435][22726] Updated weights for policy 0, policy_version 42080 (0.0005) [2023-03-11 13:20:16,345][22439] Fps is (10 sec: 10649.4, 60 sec: 10854.4, 300 sec: 11149.4). Total num frames: 21561344. Throughput: 0: 10915.0. Samples: 21544968. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:20:16,346][22439] Avg episode reward: [(0, '461.098')] [2023-03-11 13:20:16,376][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000042120_21565440.pth... [2023-03-11 13:20:16,377][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000041480_21237760.pth [2023-03-11 13:20:18,194][22726] Updated weights for policy 0, policy_version 42160 (0.0005) [2023-03-11 13:20:21,345][22439] Fps is (10 sec: 11468.7, 60 sec: 10990.9, 300 sec: 11149.4). Total num frames: 21622784. Throughput: 0: 10948.1. Samples: 21612112. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:20:21,346][22439] Avg episode reward: [(0, '464.466')] [2023-03-11 13:20:21,669][22726] Updated weights for policy 0, policy_version 42240 (0.0004) [2023-03-11 13:20:25,040][22726] Updated weights for policy 0, policy_version 42320 (0.0004) [2023-03-11 13:20:26,345][22439] Fps is (10 sec: 11878.6, 60 sec: 11059.2, 300 sec: 11149.5). Total num frames: 21680128. Throughput: 0: 11035.7. Samples: 21648424. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:20:26,346][22439] Avg episode reward: [(0, '406.525')] [2023-03-11 13:20:28,816][22726] Updated weights for policy 0, policy_version 42400 (0.0005) [2023-03-11 13:20:31,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 11149.4). Total num frames: 21733376. Throughput: 0: 11092.4. Samples: 21715984. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:20:31,346][22439] Avg episode reward: [(0, '665.458')] [2023-03-11 13:20:31,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000042448_21733376.pth... [2023-03-11 13:20:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000041800_21401600.pth [2023-03-11 13:20:32,617][22726] Updated weights for policy 0, policy_version 42480 (0.0005) [2023-03-11 13:20:36,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10990.9, 300 sec: 11135.6). Total num frames: 21786624. Throughput: 0: 11053.7. Samples: 21780040. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:20:36,346][22439] Avg episode reward: [(0, '617.720')] [2023-03-11 13:20:36,381][22726] Updated weights for policy 0, policy_version 42560 (0.0005) [2023-03-11 13:20:40,296][22726] Updated weights for policy 0, policy_version 42640 (0.0005) [2023-03-11 13:20:41,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10990.9, 300 sec: 11135.6). Total num frames: 21839872. Throughput: 0: 11024.7. Samples: 21811696. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:20:41,346][22439] Avg episode reward: [(0, '625.660')] [2023-03-11 13:20:44,059][22726] Updated weights for policy 0, policy_version 42720 (0.0005) [2023-03-11 13:20:46,345][22439] Fps is (10 sec: 11059.0, 60 sec: 11059.2, 300 sec: 11107.8). Total num frames: 21897216. Throughput: 0: 10955.8. Samples: 21876800. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:20:46,346][22439] Avg episode reward: [(0, '490.635')] [2023-03-11 13:20:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000042768_21897216.pth... [2023-03-11 13:20:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000042120_21565440.pth [2023-03-11 13:20:47,845][22726] Updated weights for policy 0, policy_version 42800 (0.0005) [2023-03-11 13:20:51,345][22439] Fps is (10 sec: 11059.3, 60 sec: 10990.9, 300 sec: 11093.9). Total num frames: 21950464. Throughput: 0: 10979.4. Samples: 21941764. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:20:51,346][22439] Avg episode reward: [(0, '594.328')] [2023-03-11 13:20:51,735][22726] Updated weights for policy 0, policy_version 42880 (0.0005) [2023-03-11 13:20:55,453][22726] Updated weights for policy 0, policy_version 42960 (0.0005) [2023-03-11 13:20:56,345][22439] Fps is (10 sec: 10649.9, 60 sec: 10922.7, 300 sec: 11066.1). Total num frames: 22003712. Throughput: 0: 10970.5. Samples: 21973160. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:20:56,346][22439] Avg episode reward: [(0, '666.314')] [2023-03-11 13:20:59,228][22726] Updated weights for policy 0, policy_version 43040 (0.0005) [2023-03-11 13:21:01,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10922.7, 300 sec: 11052.3). Total num frames: 22056960. Throughput: 0: 10976.7. Samples: 22038920. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:21:01,346][22439] Avg episode reward: [(0, '609.153')] [2023-03-11 13:21:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000043080_22056960.pth... [2023-03-11 13:21:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000042448_21733376.pth [2023-03-11 13:21:03,113][22726] Updated weights for policy 0, policy_version 43120 (0.0005) [2023-03-11 13:21:06,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10922.6, 300 sec: 11038.4). Total num frames: 22110208. Throughput: 0: 10888.4. Samples: 22102088. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:21:06,346][22439] Avg episode reward: [(0, '486.374')] [2023-03-11 13:21:06,939][22726] Updated weights for policy 0, policy_version 43200 (0.0005) [2023-03-11 13:21:10,783][22726] Updated weights for policy 0, policy_version 43280 (0.0005) [2023-03-11 13:21:11,345][22439] Fps is (10 sec: 10649.7, 60 sec: 10922.7, 300 sec: 11024.5). Total num frames: 22163456. Throughput: 0: 10805.1. Samples: 22134652. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:21:11,346][22439] Avg episode reward: [(0, '434.194')] [2023-03-11 13:21:14,640][22726] Updated weights for policy 0, policy_version 43360 (0.0005) [2023-03-11 13:21:16,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10922.7, 300 sec: 11010.6). Total num frames: 22216704. Throughput: 0: 10711.9. Samples: 22198020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:21:16,346][22439] Avg episode reward: [(0, '679.231')] [2023-03-11 13:21:16,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000043392_22216704.pth... [2023-03-11 13:21:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000042768_21897216.pth [2023-03-11 13:21:18,527][22726] Updated weights for policy 0, policy_version 43440 (0.0005) [2023-03-11 13:21:21,345][22439] Fps is (10 sec: 10649.4, 60 sec: 10786.1, 300 sec: 10982.8). Total num frames: 22269952. Throughput: 0: 10727.9. Samples: 22262796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:21:21,346][22439] Avg episode reward: [(0, '655.622')] [2023-03-11 13:21:22,123][22726] Updated weights for policy 0, policy_version 43520 (0.0005) [2023-03-11 13:21:25,643][22726] Updated weights for policy 0, policy_version 43600 (0.0005) [2023-03-11 13:21:26,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10786.1, 300 sec: 10996.7). Total num frames: 22327296. Throughput: 0: 10793.8. Samples: 22297416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:21:26,346][22439] Avg episode reward: [(0, '626.031')] [2023-03-11 13:21:29,111][22726] Updated weights for policy 0, policy_version 43680 (0.0005) [2023-03-11 13:21:31,345][22439] Fps is (10 sec: 11878.5, 60 sec: 10922.7, 300 sec: 11024.5). Total num frames: 22388736. Throughput: 0: 10921.3. Samples: 22368256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:21:31,346][22439] Avg episode reward: [(0, '487.282')] [2023-03-11 13:21:31,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000043728_22388736.pth... [2023-03-11 13:21:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000043080_22056960.pth [2023-03-11 13:21:32,564][22726] Updated weights for policy 0, policy_version 43760 (0.0005) [2023-03-11 13:21:35,859][22726] Updated weights for policy 0, policy_version 43840 (0.0005) [2023-03-11 13:21:36,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11059.2, 300 sec: 11038.4). Total num frames: 22450176. Throughput: 0: 11087.9. Samples: 22440720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:21:36,346][22439] Avg episode reward: [(0, '501.703')] [2023-03-11 13:21:39,188][22726] Updated weights for policy 0, policy_version 43920 (0.0005) [2023-03-11 13:21:41,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11195.7, 300 sec: 11052.3). Total num frames: 22511616. Throughput: 0: 11217.5. Samples: 22477948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:21:41,346][22439] Avg episode reward: [(0, '430.865')] [2023-03-11 13:21:42,582][22726] Updated weights for policy 0, policy_version 44000 (0.0005) [2023-03-11 13:21:46,023][22726] Updated weights for policy 0, policy_version 44080 (0.0005) [2023-03-11 13:21:46,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11195.8, 300 sec: 11052.3). Total num frames: 22568960. Throughput: 0: 11351.1. Samples: 22549720. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:21:46,356][22439] Avg episode reward: [(0, '620.749')] [2023-03-11 13:21:46,365][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000044088_22573056.pth... [2023-03-11 13:21:46,367][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000043392_22216704.pth [2023-03-11 13:21:49,394][22726] Updated weights for policy 0, policy_version 44160 (0.0005) [2023-03-11 13:21:51,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11332.3, 300 sec: 11066.1). Total num frames: 22630400. Throughput: 0: 11562.6. Samples: 22622404. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:21:51,356][22439] Avg episode reward: [(0, '443.159')] [2023-03-11 13:21:52,719][22726] Updated weights for policy 0, policy_version 44240 (0.0005) [2023-03-11 13:21:56,113][22726] Updated weights for policy 0, policy_version 44320 (0.0005) [2023-03-11 13:21:56,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11468.8, 300 sec: 11093.9). Total num frames: 22691840. Throughput: 0: 11655.6. Samples: 22659152. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:21:56,356][22439] Avg episode reward: [(0, '420.748')] [2023-03-11 13:21:59,397][22726] Updated weights for policy 0, policy_version 44400 (0.0005) [2023-03-11 13:22:01,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11605.3, 300 sec: 11107.8). Total num frames: 22753280. Throughput: 0: 11885.6. Samples: 22732872. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:22:01,346][22439] Avg episode reward: [(0, '648.984')] [2023-03-11 13:22:01,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000044440_22753280.pth... [2023-03-11 13:22:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000043728_22388736.pth [2023-03-11 13:22:02,691][22726] Updated weights for policy 0, policy_version 44480 (0.0004) [2023-03-11 13:22:05,928][22726] Updated weights for policy 0, policy_version 44560 (0.0004) [2023-03-11 13:22:06,345][22439] Fps is (10 sec: 12697.5, 60 sec: 11810.1, 300 sec: 11149.4). Total num frames: 22818816. Throughput: 0: 12118.4. Samples: 22808124. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:22:06,356][22439] Avg episode reward: [(0, '442.483')] [2023-03-11 13:22:09,221][22726] Updated weights for policy 0, policy_version 44640 (0.0004) [2023-03-11 13:22:11,345][22439] Fps is (10 sec: 12697.6, 60 sec: 11946.7, 300 sec: 11163.3). Total num frames: 22880256. Throughput: 0: 12191.9. Samples: 22846052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:22:11,356][22439] Avg episode reward: [(0, '738.402')] [2023-03-11 13:22:12,577][22726] Updated weights for policy 0, policy_version 44720 (0.0005) [2023-03-11 13:22:16,041][22726] Updated weights for policy 0, policy_version 44800 (0.0005) [2023-03-11 13:22:16,345][22439] Fps is (10 sec: 11878.5, 60 sec: 12014.9, 300 sec: 11177.2). Total num frames: 22937600. Throughput: 0: 12238.9. Samples: 22919004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:22:16,356][22439] Avg episode reward: [(0, '695.858')] [2023-03-11 13:22:16,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000044800_22937600.pth... [2023-03-11 13:22:16,360][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000044088_22573056.pth [2023-03-11 13:22:19,484][22726] Updated weights for policy 0, policy_version 44880 (0.0005) [2023-03-11 13:22:21,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11191.1). Total num frames: 22999040. Throughput: 0: 12199.5. Samples: 22989696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:22:21,356][22439] Avg episode reward: [(0, '910.610')] [2023-03-11 13:22:21,357][22682] Saving new best policy, reward=910.610! [2023-03-11 13:22:22,839][22726] Updated weights for policy 0, policy_version 44960 (0.0005) [2023-03-11 13:22:26,191][22726] Updated weights for policy 0, policy_version 45040 (0.0005) [2023-03-11 13:22:26,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12219.7, 300 sec: 11218.9). Total num frames: 23060480. Throughput: 0: 12205.3. Samples: 23027188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:22:26,356][22439] Avg episode reward: [(0, '792.362')] [2023-03-11 13:22:29,612][22726] Updated weights for policy 0, policy_version 45120 (0.0005) [2023-03-11 13:22:31,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 11246.6). Total num frames: 23121920. Throughput: 0: 12205.2. Samples: 23098952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:22:31,346][22439] Avg episode reward: [(0, '687.228')] [2023-03-11 13:22:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000045160_23121920.pth... [2023-03-11 13:22:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000044440_22753280.pth [2023-03-11 13:22:33,048][22726] Updated weights for policy 0, policy_version 45200 (0.0005) [2023-03-11 13:22:36,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11246.6). Total num frames: 23179264. Throughput: 0: 12194.0. Samples: 23171136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:22:36,346][22439] Avg episode reward: [(0, '690.491')] [2023-03-11 13:22:36,445][22726] Updated weights for policy 0, policy_version 45280 (0.0005) [2023-03-11 13:22:39,853][22726] Updated weights for policy 0, policy_version 45360 (0.0005) [2023-03-11 13:22:41,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11274.4). Total num frames: 23240704. Throughput: 0: 12183.8. Samples: 23207424. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:22:41,346][22439] Avg episode reward: [(0, '671.296')] [2023-03-11 13:22:43,137][22726] Updated weights for policy 0, policy_version 45440 (0.0005) [2023-03-11 13:22:46,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12219.7, 300 sec: 11288.3). Total num frames: 23302144. Throughput: 0: 12188.0. Samples: 23281332. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:22:46,346][22439] Avg episode reward: [(0, '533.971')] [2023-03-11 13:22:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000045512_23302144.pth... [2023-03-11 13:22:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000044800_22937600.pth [2023-03-11 13:22:46,431][22726] Updated weights for policy 0, policy_version 45520 (0.0005) [2023-03-11 13:22:49,752][22726] Updated weights for policy 0, policy_version 45600 (0.0004) [2023-03-11 13:22:51,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 11316.1). Total num frames: 23363584. Throughput: 0: 12162.9. Samples: 23355456. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:22:51,346][22439] Avg episode reward: [(0, '485.117')] [2023-03-11 13:22:53,416][22726] Updated weights for policy 0, policy_version 45680 (0.0005) [2023-03-11 13:22:56,345][22439] Fps is (10 sec: 11468.9, 60 sec: 12083.2, 300 sec: 11316.1). Total num frames: 23416832. Throughput: 0: 12048.3. Samples: 23388224. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:22:56,346][22439] Avg episode reward: [(0, '402.157')] [2023-03-11 13:22:57,178][22726] Updated weights for policy 0, policy_version 45760 (0.0005) [2023-03-11 13:23:00,877][22726] Updated weights for policy 0, policy_version 45840 (0.0005) [2023-03-11 13:23:01,345][22439] Fps is (10 sec: 11059.1, 60 sec: 12014.9, 300 sec: 11316.1). Total num frames: 23474176. Throughput: 0: 11883.6. Samples: 23453768. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:23:01,346][22439] Avg episode reward: [(0, '560.350')] [2023-03-11 13:23:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000045848_23474176.pth... [2023-03-11 13:23:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000045160_23121920.pth [2023-03-11 13:23:04,563][22726] Updated weights for policy 0, policy_version 45920 (0.0005) [2023-03-11 13:23:06,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11810.1, 300 sec: 11316.1). Total num frames: 23527424. Throughput: 0: 11792.5. Samples: 23520360. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:23:06,346][22439] Avg episode reward: [(0, '698.155')] [2023-03-11 13:23:08,334][22726] Updated weights for policy 0, policy_version 46000 (0.0005) [2023-03-11 13:23:11,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11741.9, 300 sec: 11316.1). Total num frames: 23584768. Throughput: 0: 11680.7. Samples: 23552820. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:23:11,346][22439] Avg episode reward: [(0, '491.690')] [2023-03-11 13:23:11,991][22726] Updated weights for policy 0, policy_version 46080 (0.0005) [2023-03-11 13:23:15,715][22726] Updated weights for policy 0, policy_version 46160 (0.0005) [2023-03-11 13:23:16,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11673.6, 300 sec: 11316.1). Total num frames: 23638016. Throughput: 0: 11577.9. Samples: 23619956. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:23:16,346][22439] Avg episode reward: [(0, '580.034')] [2023-03-11 13:23:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000046168_23638016.pth... [2023-03-11 13:23:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000045512_23302144.pth [2023-03-11 13:23:19,320][22726] Updated weights for policy 0, policy_version 46240 (0.0005) [2023-03-11 13:23:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11605.3, 300 sec: 11343.8). Total num frames: 23695360. Throughput: 0: 11467.6. Samples: 23687180. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:23:21,346][22439] Avg episode reward: [(0, '497.052')] [2023-03-11 13:23:23,050][22726] Updated weights for policy 0, policy_version 46320 (0.0005) [2023-03-11 13:23:26,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11343.8). Total num frames: 23752704. Throughput: 0: 11390.8. Samples: 23720008. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:23:26,346][22439] Avg episode reward: [(0, '469.003')] [2023-03-11 13:23:26,468][22726] Updated weights for policy 0, policy_version 46400 (0.0005) [2023-03-11 13:23:29,802][22726] Updated weights for policy 0, policy_version 46480 (0.0005) [2023-03-11 13:23:31,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11537.1, 300 sec: 11343.8). Total num frames: 23814144. Throughput: 0: 11383.6. Samples: 23793596. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:23:31,346][22439] Avg episode reward: [(0, '637.100')] [2023-03-11 13:23:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000046512_23814144.pth... [2023-03-11 13:23:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000045848_23474176.pth [2023-03-11 13:23:33,188][22726] Updated weights for policy 0, policy_version 46560 (0.0005) [2023-03-11 13:23:36,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11605.3, 300 sec: 11357.7). Total num frames: 23875584. Throughput: 0: 11323.9. Samples: 23865032. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:23:36,346][22439] Avg episode reward: [(0, '521.604')] [2023-03-11 13:23:36,654][22726] Updated weights for policy 0, policy_version 46640 (0.0004) [2023-03-11 13:23:39,895][22726] Updated weights for policy 0, policy_version 46720 (0.0004) [2023-03-11 13:23:41,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11605.3, 300 sec: 11371.6). Total num frames: 23937024. Throughput: 0: 11419.9. Samples: 23902120. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:23:41,346][22439] Avg episode reward: [(0, '657.488')] [2023-03-11 13:23:43,313][22726] Updated weights for policy 0, policy_version 46800 (0.0005) [2023-03-11 13:23:46,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11605.3, 300 sec: 11385.5). Total num frames: 23998464. Throughput: 0: 11592.8. Samples: 23975444. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:23:46,346][22439] Avg episode reward: [(0, '582.891')] [2023-03-11 13:23:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000046872_23998464.pth... [2023-03-11 13:23:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000046168_23638016.pth [2023-03-11 13:23:46,628][22726] Updated weights for policy 0, policy_version 46880 (0.0004) [2023-03-11 13:23:50,024][22726] Updated weights for policy 0, policy_version 46960 (0.0005) [2023-03-11 13:23:51,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 11399.4). Total num frames: 24055808. Throughput: 0: 11718.6. Samples: 24047696. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:23:51,346][22439] Avg episode reward: [(0, '750.589')] [2023-03-11 13:23:53,328][22726] Updated weights for policy 0, policy_version 47040 (0.0005) [2023-03-11 13:23:56,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11413.3). Total num frames: 24117248. Throughput: 0: 11835.9. Samples: 24085436. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:23:56,346][22439] Avg episode reward: [(0, '710.237')] [2023-03-11 13:23:56,917][22726] Updated weights for policy 0, policy_version 47120 (0.0005) [2023-03-11 13:24:00,353][22726] Updated weights for policy 0, policy_version 47200 (0.0004) [2023-03-11 13:24:01,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11427.1). Total num frames: 24174592. Throughput: 0: 11907.9. Samples: 24155812. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:24:01,346][22439] Avg episode reward: [(0, '657.311')] [2023-03-11 13:24:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000047216_24174592.pth... [2023-03-11 13:24:01,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000046512_23814144.pth [2023-03-11 13:24:03,773][22726] Updated weights for policy 0, policy_version 47280 (0.0005) [2023-03-11 13:24:06,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11454.9). Total num frames: 24236032. Throughput: 0: 11992.9. Samples: 24226860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:24:06,346][22439] Avg episode reward: [(0, '650.165')] [2023-03-11 13:24:07,253][22726] Updated weights for policy 0, policy_version 47360 (0.0005) [2023-03-11 13:24:10,678][22726] Updated weights for policy 0, policy_version 47440 (0.0005) [2023-03-11 13:24:11,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11468.8). Total num frames: 24293376. Throughput: 0: 12049.2. Samples: 24262224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:24:11,346][22439] Avg episode reward: [(0, '662.875')] [2023-03-11 13:24:14,139][22726] Updated weights for policy 0, policy_version 47520 (0.0005) [2023-03-11 13:24:16,345][22439] Fps is (10 sec: 11878.2, 60 sec: 11946.6, 300 sec: 11496.6). Total num frames: 24354816. Throughput: 0: 12010.4. Samples: 24334064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:24:16,346][22439] Avg episode reward: [(0, '555.335')] [2023-03-11 13:24:16,351][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000047568_24354816.pth... [2023-03-11 13:24:16,353][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000046872_23998464.pth [2023-03-11 13:24:17,863][22726] Updated weights for policy 0, policy_version 47600 (0.0005) [2023-03-11 13:24:21,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11496.6). Total num frames: 24408064. Throughput: 0: 11914.2. Samples: 24401172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:24:21,346][22439] Avg episode reward: [(0, '517.874')] [2023-03-11 13:24:21,360][22726] Updated weights for policy 0, policy_version 47680 (0.0005) [2023-03-11 13:24:24,765][22726] Updated weights for policy 0, policy_version 47760 (0.0005) [2023-03-11 13:24:26,345][22439] Fps is (10 sec: 11469.0, 60 sec: 11946.7, 300 sec: 11510.5). Total num frames: 24469504. Throughput: 0: 11881.8. Samples: 24436800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:24:26,346][22439] Avg episode reward: [(0, '780.744')] [2023-03-11 13:24:28,291][22726] Updated weights for policy 0, policy_version 47840 (0.0005) [2023-03-11 13:24:31,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 11524.3). Total num frames: 24526848. Throughput: 0: 11831.8. Samples: 24507876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:24:31,346][22439] Avg episode reward: [(0, '863.884')] [2023-03-11 13:24:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000047904_24526848.pth... [2023-03-11 13:24:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000047216_24174592.pth [2023-03-11 13:24:31,825][22726] Updated weights for policy 0, policy_version 47920 (0.0005) [2023-03-11 13:24:35,383][22726] Updated weights for policy 0, policy_version 48000 (0.0005) [2023-03-11 13:24:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11538.2). Total num frames: 24584192. Throughput: 0: 11742.4. Samples: 24576104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:24:36,356][22439] Avg episode reward: [(0, '551.029')] [2023-03-11 13:24:38,672][22726] Updated weights for policy 0, policy_version 48080 (0.0005) [2023-03-11 13:24:41,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11878.4, 300 sec: 11579.9). Total num frames: 24649728. Throughput: 0: 11739.2. Samples: 24613700. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:24:41,356][22439] Avg episode reward: [(0, '437.205')] [2023-03-11 13:24:41,931][22726] Updated weights for policy 0, policy_version 48160 (0.0005) [2023-03-11 13:24:45,140][22726] Updated weights for policy 0, policy_version 48240 (0.0005) [2023-03-11 13:24:46,345][22439] Fps is (10 sec: 12697.5, 60 sec: 11878.4, 300 sec: 11593.8). Total num frames: 24711168. Throughput: 0: 11867.9. Samples: 24689868. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:24:46,356][22439] Avg episode reward: [(0, '340.450')] [2023-03-11 13:24:46,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000048264_24711168.pth... [2023-03-11 13:24:46,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000047568_24354816.pth [2023-03-11 13:24:48,533][22726] Updated weights for policy 0, policy_version 48320 (0.0005) [2023-03-11 13:24:51,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11607.6). Total num frames: 24772608. Throughput: 0: 11941.6. Samples: 24764232. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:24:51,346][22439] Avg episode reward: [(0, '314.093')] [2023-03-11 13:24:51,691][22726] Updated weights for policy 0, policy_version 48400 (0.0005) [2023-03-11 13:24:54,855][22726] Updated weights for policy 0, policy_version 48480 (0.0005) [2023-03-11 13:24:56,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11649.3). Total num frames: 24838144. Throughput: 0: 12025.8. Samples: 24803384. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:24:56,346][22439] Avg episode reward: [(0, '163.747')] [2023-03-11 13:24:57,954][22726] Updated weights for policy 0, policy_version 48560 (0.0004) [2023-03-11 13:25:01,291][22726] Updated weights for policy 0, policy_version 48640 (0.0005) [2023-03-11 13:25:01,345][22439] Fps is (10 sec: 13107.1, 60 sec: 12151.5, 300 sec: 11691.0). Total num frames: 24903680. Throughput: 0: 12151.4. Samples: 24880876. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:25:01,346][22439] Avg episode reward: [(0, '175.625')] [2023-03-11 13:25:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000048640_24903680.pth... [2023-03-11 13:25:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000047904_24526848.pth [2023-03-11 13:25:04,609][22726] Updated weights for policy 0, policy_version 48720 (0.0005) [2023-03-11 13:25:06,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 11718.7). Total num frames: 24965120. Throughput: 0: 12311.2. Samples: 24955176. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:25:06,356][22439] Avg episode reward: [(0, '367.985')] [2023-03-11 13:25:07,763][22726] Updated weights for policy 0, policy_version 48800 (0.0004) [2023-03-11 13:25:10,962][22726] Updated weights for policy 0, policy_version 48880 (0.0003) [2023-03-11 13:25:11,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 11760.4). Total num frames: 25030656. Throughput: 0: 12377.6. Samples: 24993792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:25:11,356][22439] Avg episode reward: [(0, '437.756')] [2023-03-11 13:25:14,265][22726] Updated weights for policy 0, policy_version 48960 (0.0003) [2023-03-11 13:25:16,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 11760.4). Total num frames: 25092096. Throughput: 0: 12483.7. Samples: 25069644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:25:16,356][22439] Avg episode reward: [(0, '437.266')] [2023-03-11 13:25:16,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000049008_25092096.pth... [2023-03-11 13:25:16,363][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000048264_24711168.pth [2023-03-11 13:25:17,478][22726] Updated weights for policy 0, policy_version 49040 (0.0003) [2023-03-11 13:25:20,747][22726] Updated weights for policy 0, policy_version 49120 (0.0003) [2023-03-11 13:25:21,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12424.5, 300 sec: 11774.3). Total num frames: 25153536. Throughput: 0: 12651.4. Samples: 25145416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:25:21,356][22439] Avg episode reward: [(0, '402.603')] [2023-03-11 13:25:23,883][22726] Updated weights for policy 0, policy_version 49200 (0.0003) [2023-03-11 13:25:26,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 11815.9). Total num frames: 25219072. Throughput: 0: 12674.0. Samples: 25184028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:25:26,356][22439] Avg episode reward: [(0, '347.087')] [2023-03-11 13:25:27,145][22726] Updated weights for policy 0, policy_version 49280 (0.0004) [2023-03-11 13:25:30,428][22726] Updated weights for policy 0, policy_version 49360 (0.0003) [2023-03-11 13:25:31,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12561.1, 300 sec: 11843.7). Total num frames: 25280512. Throughput: 0: 12671.7. Samples: 25260096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:25:31,346][22439] Avg episode reward: [(0, '311.566')] [2023-03-11 13:25:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000049376_25280512.pth... [2023-03-11 13:25:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000048640_24903680.pth [2023-03-11 13:25:33,772][22726] Updated weights for policy 0, policy_version 49440 (0.0003) [2023-03-11 13:25:36,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12629.3, 300 sec: 11871.5). Total num frames: 25341952. Throughput: 0: 12660.6. Samples: 25333960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:25:36,346][22439] Avg episode reward: [(0, '427.822')] [2023-03-11 13:25:37,005][22726] Updated weights for policy 0, policy_version 49520 (0.0003) [2023-03-11 13:25:40,184][22726] Updated weights for policy 0, policy_version 49600 (0.0003) [2023-03-11 13:25:41,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 11899.2). Total num frames: 25407488. Throughput: 0: 12656.3. Samples: 25372916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:25:41,346][22439] Avg episode reward: [(0, '550.029')] [2023-03-11 13:25:43,420][22726] Updated weights for policy 0, policy_version 49680 (0.0003) [2023-03-11 13:25:46,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12629.3, 300 sec: 11927.0). Total num frames: 25468928. Throughput: 0: 12614.1. Samples: 25448512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:25:46,346][22439] Avg episode reward: [(0, '390.124')] [2023-03-11 13:25:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000049744_25468928.pth... [2023-03-11 13:25:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000049008_25092096.pth [2023-03-11 13:25:46,816][22726] Updated weights for policy 0, policy_version 49760 (0.0003) [2023-03-11 13:25:50,022][22726] Updated weights for policy 0, policy_version 49840 (0.0003) [2023-03-11 13:25:51,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 11968.6). Total num frames: 25534464. Throughput: 0: 12605.8. Samples: 25522436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:25:51,346][22439] Avg episode reward: [(0, '632.176')] [2023-03-11 13:25:53,396][22726] Updated weights for policy 0, policy_version 49920 (0.0004) [2023-03-11 13:25:56,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 11996.4). Total num frames: 25595904. Throughput: 0: 12562.7. Samples: 25559112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:25:56,346][22439] Avg episode reward: [(0, '470.381')] [2023-03-11 13:25:56,557][22726] Updated weights for policy 0, policy_version 50000 (0.0004) [2023-03-11 13:25:59,942][22726] Updated weights for policy 0, policy_version 50080 (0.0004) [2023-03-11 13:26:01,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12561.1, 300 sec: 12024.2). Total num frames: 25657344. Throughput: 0: 12591.2. Samples: 25636248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:26:01,346][22439] Avg episode reward: [(0, '334.091')] [2023-03-11 13:26:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000050112_25657344.pth... [2023-03-11 13:26:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000049376_25280512.pth [2023-03-11 13:26:03,208][22726] Updated weights for policy 0, policy_version 50160 (0.0004) [2023-03-11 13:26:06,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12052.0). Total num frames: 25718784. Throughput: 0: 12548.8. Samples: 25710112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:26:06,346][22439] Avg episode reward: [(0, '409.032')] [2023-03-11 13:26:06,541][22726] Updated weights for policy 0, policy_version 50240 (0.0003) [2023-03-11 13:26:09,760][22726] Updated weights for policy 0, policy_version 50320 (0.0003) [2023-03-11 13:26:11,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12492.8, 300 sec: 12079.7). Total num frames: 25780224. Throughput: 0: 12520.8. Samples: 25747464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:26:11,346][22439] Avg episode reward: [(0, '159.104')] [2023-03-11 13:26:13,009][22726] Updated weights for policy 0, policy_version 50400 (0.0003) [2023-03-11 13:26:16,216][22726] Updated weights for policy 0, policy_version 50480 (0.0003) [2023-03-11 13:26:16,345][22439] Fps is (10 sec: 12697.7, 60 sec: 12561.1, 300 sec: 12121.4). Total num frames: 25845760. Throughput: 0: 12496.5. Samples: 25822436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:26:16,346][22439] Avg episode reward: [(0, '308.341')] [2023-03-11 13:26:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000050480_25845760.pth... [2023-03-11 13:26:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000049744_25468928.pth [2023-03-11 13:26:19,443][22726] Updated weights for policy 0, policy_version 50560 (0.0003) [2023-03-11 13:26:21,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12561.1, 300 sec: 12135.3). Total num frames: 25907200. Throughput: 0: 12558.0. Samples: 25899072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:26:21,346][22439] Avg episode reward: [(0, '209.230')] [2023-03-11 13:26:22,775][22726] Updated weights for policy 0, policy_version 50640 (0.0005) [2023-03-11 13:26:26,117][22726] Updated weights for policy 0, policy_version 50720 (0.0005) [2023-03-11 13:26:26,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12492.8, 300 sec: 12135.3). Total num frames: 25968640. Throughput: 0: 12511.6. Samples: 25935936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:26:26,346][22439] Avg episode reward: [(0, '251.588')] [2023-03-11 13:26:29,330][22726] Updated weights for policy 0, policy_version 50800 (0.0003) [2023-03-11 13:26:31,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12135.3). Total num frames: 26030080. Throughput: 0: 12490.3. Samples: 26010576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:26:31,346][22439] Avg episode reward: [(0, '454.871')] [2023-03-11 13:26:31,358][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000050848_26034176.pth... [2023-03-11 13:26:31,360][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000050112_25657344.pth [2023-03-11 13:26:32,626][22726] Updated weights for policy 0, policy_version 50880 (0.0003) [2023-03-11 13:26:35,996][22726] Updated weights for policy 0, policy_version 50960 (0.0004) [2023-03-11 13:26:36,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12149.2). Total num frames: 26095616. Throughput: 0: 12482.0. Samples: 26084128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:26:36,346][22439] Avg episode reward: [(0, '502.192')] [2023-03-11 13:26:39,225][22726] Updated weights for policy 0, policy_version 51040 (0.0003) [2023-03-11 13:26:41,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12163.0). Total num frames: 26157056. Throughput: 0: 12501.8. Samples: 26121692. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:26:41,346][22439] Avg episode reward: [(0, '531.048')] [2023-03-11 13:26:42,573][22726] Updated weights for policy 0, policy_version 51120 (0.0003) [2023-03-11 13:26:45,810][22726] Updated weights for policy 0, policy_version 51200 (0.0004) [2023-03-11 13:26:46,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12492.8, 300 sec: 12163.0). Total num frames: 26218496. Throughput: 0: 12479.0. Samples: 26197804. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:26:46,346][22439] Avg episode reward: [(0, '456.343')] [2023-03-11 13:26:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000051208_26218496.pth... [2023-03-11 13:26:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000050480_25845760.pth [2023-03-11 13:26:49,120][22726] Updated weights for policy 0, policy_version 51280 (0.0003) [2023-03-11 13:26:51,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12424.5, 300 sec: 12163.0). Total num frames: 26279936. Throughput: 0: 12482.1. Samples: 26271808. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:26:51,346][22439] Avg episode reward: [(0, '401.836')] [2023-03-11 13:26:52,365][22726] Updated weights for policy 0, policy_version 51360 (0.0004) [2023-03-11 13:26:55,572][22726] Updated weights for policy 0, policy_version 51440 (0.0003) [2023-03-11 13:26:56,345][22439] Fps is (10 sec: 12697.7, 60 sec: 12492.8, 300 sec: 12176.9). Total num frames: 26345472. Throughput: 0: 12507.4. Samples: 26310296. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:26:56,346][22439] Avg episode reward: [(0, '431.399')] [2023-03-11 13:26:58,865][22726] Updated weights for policy 0, policy_version 51520 (0.0003) [2023-03-11 13:27:01,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12492.8, 300 sec: 12163.0). Total num frames: 26406912. Throughput: 0: 12508.3. Samples: 26385312. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:27:01,346][22439] Avg episode reward: [(0, '429.243')] [2023-03-11 13:27:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000051576_26406912.pth... [2023-03-11 13:27:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000050848_26034176.pth [2023-03-11 13:27:02,093][22726] Updated weights for policy 0, policy_version 51600 (0.0003) [2023-03-11 13:27:05,501][22726] Updated weights for policy 0, policy_version 51680 (0.0003) [2023-03-11 13:27:06,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12492.8, 300 sec: 12163.0). Total num frames: 26468352. Throughput: 0: 12456.9. Samples: 26459632. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:27:06,346][22439] Avg episode reward: [(0, '541.312')] [2023-03-11 13:27:08,771][22726] Updated weights for policy 0, policy_version 51760 (0.0005) [2023-03-11 13:27:11,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12190.8). Total num frames: 26533888. Throughput: 0: 12468.9. Samples: 26497036. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:27:11,346][22439] Avg episode reward: [(0, '388.961')] [2023-03-11 13:27:11,947][22726] Updated weights for policy 0, policy_version 51840 (0.0004) [2023-03-11 13:27:15,300][22726] Updated weights for policy 0, policy_version 51920 (0.0004) [2023-03-11 13:27:16,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12492.8, 300 sec: 12190.8). Total num frames: 26595328. Throughput: 0: 12493.6. Samples: 26572788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:27:16,346][22439] Avg episode reward: [(0, '534.199')] [2023-03-11 13:27:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000051944_26595328.pth... [2023-03-11 13:27:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000051208_26218496.pth [2023-03-11 13:27:18,642][22726] Updated weights for policy 0, policy_version 52000 (0.0003) [2023-03-11 13:27:21,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 12176.9). Total num frames: 26652672. Throughput: 0: 12468.6. Samples: 26645216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:27:21,346][22439] Avg episode reward: [(0, '636.806')] [2023-03-11 13:27:22,075][22726] Updated weights for policy 0, policy_version 52080 (0.0003) [2023-03-11 13:27:25,425][22726] Updated weights for policy 0, policy_version 52160 (0.0004) [2023-03-11 13:27:26,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 12176.9). Total num frames: 26714112. Throughput: 0: 12438.1. Samples: 26681408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:27:26,346][22439] Avg episode reward: [(0, '478.232')] [2023-03-11 13:27:29,025][22726] Updated weights for policy 0, policy_version 52240 (0.0003) [2023-03-11 13:27:31,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12190.8). Total num frames: 26775552. Throughput: 0: 12311.9. Samples: 26751840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:27:31,346][22439] Avg episode reward: [(0, '393.782')] [2023-03-11 13:27:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000052296_26775552.pth... [2023-03-11 13:27:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000051576_26406912.pth [2023-03-11 13:27:32,290][22726] Updated weights for policy 0, policy_version 52320 (0.0003) [2023-03-11 13:27:35,661][22726] Updated weights for policy 0, policy_version 52400 (0.0003) [2023-03-11 13:27:36,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12190.8). Total num frames: 26836992. Throughput: 0: 12316.8. Samples: 26826064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:27:36,356][22439] Avg episode reward: [(0, '647.470')] [2023-03-11 13:27:38,873][22726] Updated weights for policy 0, policy_version 52480 (0.0003) [2023-03-11 13:27:41,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12190.8). Total num frames: 26898432. Throughput: 0: 12295.5. Samples: 26863592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:27:41,356][22439] Avg episode reward: [(0, '272.969')] [2023-03-11 13:27:42,189][22726] Updated weights for policy 0, policy_version 52560 (0.0004) [2023-03-11 13:27:45,673][22726] Updated weights for policy 0, policy_version 52640 (0.0003) [2023-03-11 13:27:46,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12356.3, 300 sec: 12190.8). Total num frames: 26959872. Throughput: 0: 12270.5. Samples: 26937484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:27:46,356][22439] Avg episode reward: [(0, '474.893')] [2023-03-11 13:27:46,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000052656_26959872.pth... [2023-03-11 13:27:46,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000051944_26595328.pth [2023-03-11 13:27:48,980][22726] Updated weights for policy 0, policy_version 52720 (0.0003) [2023-03-11 13:27:51,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12218.6). Total num frames: 27021312. Throughput: 0: 12262.4. Samples: 27011440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:27:51,356][22439] Avg episode reward: [(0, '519.123')] [2023-03-11 13:27:52,156][22726] Updated weights for policy 0, policy_version 52800 (0.0003) [2023-03-11 13:27:55,480][22726] Updated weights for policy 0, policy_version 52880 (0.0003) [2023-03-11 13:27:56,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12232.5). Total num frames: 27082752. Throughput: 0: 12283.9. Samples: 27049812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:27:56,356][22439] Avg episode reward: [(0, '319.064')] [2023-03-11 13:27:58,739][22726] Updated weights for policy 0, policy_version 52960 (0.0004) [2023-03-11 13:28:01,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12260.2). Total num frames: 27144192. Throughput: 0: 12249.5. Samples: 27124016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:28:01,356][22439] Avg episode reward: [(0, '423.121')] [2023-03-11 13:28:01,362][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000053024_27148288.pth... [2023-03-11 13:28:01,364][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000052296_26775552.pth [2023-03-11 13:28:02,063][22726] Updated weights for policy 0, policy_version 53040 (0.0005) [2023-03-11 13:28:05,666][22726] Updated weights for policy 0, policy_version 53120 (0.0005) [2023-03-11 13:28:06,345][22439] Fps is (10 sec: 11878.5, 60 sec: 12219.7, 300 sec: 12260.2). Total num frames: 27201536. Throughput: 0: 12212.7. Samples: 27194788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:28:06,356][22439] Avg episode reward: [(0, '439.035')] [2023-03-11 13:28:09,164][22726] Updated weights for policy 0, policy_version 53200 (0.0005) [2023-03-11 13:28:11,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12288.0). Total num frames: 27262976. Throughput: 0: 12191.7. Samples: 27230036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:28:11,356][22439] Avg episode reward: [(0, '410.725')] [2023-03-11 13:28:12,682][22726] Updated weights for policy 0, policy_version 53280 (0.0005) [2023-03-11 13:28:16,018][22726] Updated weights for policy 0, policy_version 53360 (0.0005) [2023-03-11 13:28:16,345][22439] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 12288.0). Total num frames: 27320320. Throughput: 0: 12179.4. Samples: 27299912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:28:16,346][22439] Avg episode reward: [(0, '471.841')] [2023-03-11 13:28:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000053368_27324416.pth... [2023-03-11 13:28:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000052656_26959872.pth [2023-03-11 13:28:19,361][22726] Updated weights for policy 0, policy_version 53440 (0.0005) [2023-03-11 13:28:21,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12301.9). Total num frames: 27381760. Throughput: 0: 12168.4. Samples: 27373640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:28:21,346][22439] Avg episode reward: [(0, '720.088')] [2023-03-11 13:28:22,725][22726] Updated weights for policy 0, policy_version 53520 (0.0005) [2023-03-11 13:28:26,124][22726] Updated weights for policy 0, policy_version 53600 (0.0005) [2023-03-11 13:28:26,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 12301.9). Total num frames: 27443200. Throughput: 0: 12152.4. Samples: 27410448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:28:26,346][22439] Avg episode reward: [(0, '532.061')] [2023-03-11 13:28:29,659][22726] Updated weights for policy 0, policy_version 53680 (0.0005) [2023-03-11 13:28:31,345][22439] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 12288.0). Total num frames: 27500544. Throughput: 0: 12090.9. Samples: 27481572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:28:31,346][22439] Avg episode reward: [(0, '425.073')] [2023-03-11 13:28:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000053712_27500544.pth... [2023-03-11 13:28:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000053024_27148288.pth [2023-03-11 13:28:33,180][22726] Updated weights for policy 0, policy_version 53760 (0.0005) [2023-03-11 13:28:36,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 12288.0). Total num frames: 27561984. Throughput: 0: 12047.1. Samples: 27553560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:28:36,346][22439] Avg episode reward: [(0, '515.599')] [2023-03-11 13:28:36,410][22726] Updated weights for policy 0, policy_version 53840 (0.0005) [2023-03-11 13:28:39,630][22726] Updated weights for policy 0, policy_version 53920 (0.0004) [2023-03-11 13:28:41,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12083.2, 300 sec: 12288.0). Total num frames: 27623424. Throughput: 0: 12024.3. Samples: 27590904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:28:41,346][22439] Avg episode reward: [(0, '558.649')] [2023-03-11 13:28:42,984][22726] Updated weights for policy 0, policy_version 54000 (0.0005) [2023-03-11 13:28:46,298][22726] Updated weights for policy 0, policy_version 54080 (0.0005) [2023-03-11 13:28:46,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12151.5, 300 sec: 12315.8). Total num frames: 27688960. Throughput: 0: 12028.2. Samples: 27665288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:28:46,346][22439] Avg episode reward: [(0, '477.752')] [2023-03-11 13:28:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000054080_27688960.pth... [2023-03-11 13:28:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000053368_27324416.pth [2023-03-11 13:28:49,575][22726] Updated weights for policy 0, policy_version 54160 (0.0005) [2023-03-11 13:28:51,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 12315.8). Total num frames: 27750400. Throughput: 0: 12125.5. Samples: 27740436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:28:51,346][22439] Avg episode reward: [(0, '438.598')] [2023-03-11 13:28:52,958][22726] Updated weights for policy 0, policy_version 54240 (0.0005) [2023-03-11 13:28:56,236][22726] Updated weights for policy 0, policy_version 54320 (0.0004) [2023-03-11 13:28:56,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 12329.7). Total num frames: 27811840. Throughput: 0: 12149.7. Samples: 27776772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:28:56,346][22439] Avg episode reward: [(0, '547.112')] [2023-03-11 13:28:59,558][22726] Updated weights for policy 0, policy_version 54400 (0.0003) [2023-03-11 13:29:01,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 12329.7). Total num frames: 27873280. Throughput: 0: 12262.4. Samples: 27851720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:29:01,346][22439] Avg episode reward: [(0, '334.200')] [2023-03-11 13:29:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000054440_27873280.pth... [2023-03-11 13:29:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000053712_27500544.pth [2023-03-11 13:29:02,936][22726] Updated weights for policy 0, policy_version 54480 (0.0003) [2023-03-11 13:29:06,201][22726] Updated weights for policy 0, policy_version 54560 (0.0003) [2023-03-11 13:29:06,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12343.5). Total num frames: 27934720. Throughput: 0: 12273.2. Samples: 27925932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:29:06,346][22439] Avg episode reward: [(0, '301.783')] [2023-03-11 13:29:09,602][22726] Updated weights for policy 0, policy_version 54640 (0.0003) [2023-03-11 13:29:11,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12343.5). Total num frames: 27996160. Throughput: 0: 12245.8. Samples: 27961508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:29:11,346][22439] Avg episode reward: [(0, '344.263')] [2023-03-11 13:29:12,956][22726] Updated weights for policy 0, policy_version 54720 (0.0003) [2023-03-11 13:29:16,345][22439] Fps is (10 sec: 11878.3, 60 sec: 12219.7, 300 sec: 12357.4). Total num frames: 28053504. Throughput: 0: 12273.7. Samples: 28033888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:29:16,346][22439] Avg episode reward: [(0, '343.133')] [2023-03-11 13:29:16,352][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000054800_28057600.pth... [2023-03-11 13:29:16,352][22726] Updated weights for policy 0, policy_version 54800 (0.0005) [2023-03-11 13:29:16,353][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000054080_27688960.pth [2023-03-11 13:29:19,655][22726] Updated weights for policy 0, policy_version 54880 (0.0004) [2023-03-11 13:29:21,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 12371.3). Total num frames: 28119040. Throughput: 0: 12320.2. Samples: 28107968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:29:21,346][22439] Avg episode reward: [(0, '429.043')] [2023-03-11 13:29:23,177][22726] Updated weights for policy 0, policy_version 54960 (0.0004) [2023-03-11 13:29:26,345][22439] Fps is (10 sec: 11878.5, 60 sec: 12151.5, 300 sec: 12357.4). Total num frames: 28172288. Throughput: 0: 12266.4. Samples: 28142892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:29:26,346][22439] Avg episode reward: [(0, '393.594')] [2023-03-11 13:29:26,798][22726] Updated weights for policy 0, policy_version 55040 (0.0004) [2023-03-11 13:29:30,355][22726] Updated weights for policy 0, policy_version 55120 (0.0005) [2023-03-11 13:29:31,345][22439] Fps is (10 sec: 11059.1, 60 sec: 12151.5, 300 sec: 12357.4). Total num frames: 28229632. Throughput: 0: 12124.0. Samples: 28210868. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:29:31,346][22439] Avg episode reward: [(0, '329.747')] [2023-03-11 13:29:31,403][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000055144_28233728.pth... [2023-03-11 13:29:31,404][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000054440_27873280.pth [2023-03-11 13:29:33,833][22726] Updated weights for policy 0, policy_version 55200 (0.0005) [2023-03-11 13:29:36,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12343.5). Total num frames: 28291072. Throughput: 0: 12035.2. Samples: 28282020. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:29:36,346][22439] Avg episode reward: [(0, '347.119')] [2023-03-11 13:29:37,146][22726] Updated weights for policy 0, policy_version 55280 (0.0004) [2023-03-11 13:29:40,444][22726] Updated weights for policy 0, policy_version 55360 (0.0004) [2023-03-11 13:29:41,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 12343.5). Total num frames: 28352512. Throughput: 0: 12066.2. Samples: 28319752. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:29:41,346][22439] Avg episode reward: [(0, '344.084')] [2023-03-11 13:29:43,730][22726] Updated weights for policy 0, policy_version 55440 (0.0004) [2023-03-11 13:29:46,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 12343.5). Total num frames: 28413952. Throughput: 0: 12045.4. Samples: 28393764. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:29:46,346][22439] Avg episode reward: [(0, '442.648')] [2023-03-11 13:29:46,363][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000055504_28418048.pth... [2023-03-11 13:29:46,365][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000054800_28057600.pth [2023-03-11 13:29:47,014][22726] Updated weights for policy 0, policy_version 55520 (0.0004) [2023-03-11 13:29:50,489][22726] Updated weights for policy 0, policy_version 55600 (0.0005) [2023-03-11 13:29:51,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 12329.7). Total num frames: 28475392. Throughput: 0: 12025.9. Samples: 28467096. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:29:51,346][22439] Avg episode reward: [(0, '335.116')] [2023-03-11 13:29:54,017][22726] Updated weights for policy 0, policy_version 55680 (0.0006) [2023-03-11 13:29:56,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 12301.9). Total num frames: 28532736. Throughput: 0: 11991.4. Samples: 28501120. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:29:56,346][22439] Avg episode reward: [(0, '525.264')] [2023-03-11 13:29:57,595][22726] Updated weights for policy 0, policy_version 55760 (0.0005) [2023-03-11 13:30:01,184][22726] Updated weights for policy 0, policy_version 55840 (0.0006) [2023-03-11 13:30:01,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11946.7, 300 sec: 12288.0). Total num frames: 28590080. Throughput: 0: 11906.1. Samples: 28569664. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:30:01,346][22439] Avg episode reward: [(0, '343.559')] [2023-03-11 13:30:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000055840_28590080.pth... [2023-03-11 13:30:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000055144_28233728.pth [2023-03-11 13:30:04,678][22726] Updated weights for policy 0, policy_version 55920 (0.0005) [2023-03-11 13:30:06,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12274.1). Total num frames: 28651520. Throughput: 0: 11823.4. Samples: 28640020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:30:06,346][22439] Avg episode reward: [(0, '439.415')] [2023-03-11 13:30:08,016][22726] Updated weights for policy 0, policy_version 56000 (0.0005) [2023-03-11 13:30:11,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 12260.2). Total num frames: 28708864. Throughput: 0: 11852.5. Samples: 28676256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:30:11,346][22439] Avg episode reward: [(0, '279.366')] [2023-03-11 13:30:11,523][22726] Updated weights for policy 0, policy_version 56080 (0.0006) [2023-03-11 13:30:14,917][22726] Updated weights for policy 0, policy_version 56160 (0.0005) [2023-03-11 13:30:16,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12260.2). Total num frames: 28770304. Throughput: 0: 11945.1. Samples: 28748396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:30:16,346][22439] Avg episode reward: [(0, '383.726')] [2023-03-11 13:30:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000056192_28770304.pth... [2023-03-11 13:30:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000055504_28418048.pth [2023-03-11 13:30:18,460][22726] Updated weights for policy 0, policy_version 56240 (0.0005) [2023-03-11 13:30:21,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 12232.5). Total num frames: 28827648. Throughput: 0: 11899.2. Samples: 28817484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:30:21,346][22439] Avg episode reward: [(0, '397.591')] [2023-03-11 13:30:22,039][22726] Updated weights for policy 0, policy_version 56320 (0.0005) [2023-03-11 13:30:25,472][22726] Updated weights for policy 0, policy_version 56400 (0.0005) [2023-03-11 13:30:26,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 12218.6). Total num frames: 28884992. Throughput: 0: 11820.7. Samples: 28851684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:30:26,346][22439] Avg episode reward: [(0, '339.900')] [2023-03-11 13:30:28,717][22726] Updated weights for policy 0, policy_version 56480 (0.0005) [2023-03-11 13:30:31,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12014.9, 300 sec: 12232.5). Total num frames: 28950528. Throughput: 0: 11848.4. Samples: 28926944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:30:31,346][22439] Avg episode reward: [(0, '314.964')] [2023-03-11 13:30:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000056544_28950528.pth... [2023-03-11 13:30:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000055840_28590080.pth [2023-03-11 13:30:31,918][22726] Updated weights for policy 0, policy_version 56560 (0.0005) [2023-03-11 13:30:35,100][22726] Updated weights for policy 0, policy_version 56640 (0.0004) [2023-03-11 13:30:36,345][22439] Fps is (10 sec: 12697.7, 60 sec: 12014.9, 300 sec: 12218.6). Total num frames: 29011968. Throughput: 0: 11927.8. Samples: 29003848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:30:36,346][22439] Avg episode reward: [(0, '389.014')] [2023-03-11 13:30:38,272][22726] Updated weights for policy 0, policy_version 56720 (0.0005) [2023-03-11 13:30:41,345][22439] Fps is (10 sec: 12697.7, 60 sec: 12083.2, 300 sec: 12232.5). Total num frames: 29077504. Throughput: 0: 12033.0. Samples: 29042604. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:30:41,346][22439] Avg episode reward: [(0, '286.779')] [2023-03-11 13:30:41,462][22726] Updated weights for policy 0, policy_version 56800 (0.0004) [2023-03-11 13:30:44,641][22726] Updated weights for policy 0, policy_version 56880 (0.0004) [2023-03-11 13:30:46,345][22439] Fps is (10 sec: 13107.1, 60 sec: 12151.5, 300 sec: 12232.5). Total num frames: 29143040. Throughput: 0: 12224.0. Samples: 29119744. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:30:46,346][22439] Avg episode reward: [(0, '415.983')] [2023-03-11 13:30:46,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000056920_29143040.pth... [2023-03-11 13:30:46,353][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000056192_28770304.pth [2023-03-11 13:30:47,856][22726] Updated weights for policy 0, policy_version 56960 (0.0005) [2023-03-11 13:30:51,100][22726] Updated weights for policy 0, policy_version 57040 (0.0005) [2023-03-11 13:30:51,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12151.5, 300 sec: 12232.5). Total num frames: 29204480. Throughput: 0: 12362.9. Samples: 29196352. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:30:51,346][22439] Avg episode reward: [(0, '355.895')] [2023-03-11 13:30:54,251][22726] Updated weights for policy 0, policy_version 57120 (0.0004) [2023-03-11 13:30:56,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 12246.3). Total num frames: 29270016. Throughput: 0: 12417.4. Samples: 29235040. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:30:56,346][22439] Avg episode reward: [(0, '452.584')] [2023-03-11 13:30:57,363][22726] Updated weights for policy 0, policy_version 57200 (0.0004) [2023-03-11 13:31:00,531][22726] Updated weights for policy 0, policy_version 57280 (0.0004) [2023-03-11 13:31:01,345][22439] Fps is (10 sec: 13107.1, 60 sec: 12424.5, 300 sec: 12260.2). Total num frames: 29335552. Throughput: 0: 12544.4. Samples: 29312892. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:31:01,346][22439] Avg episode reward: [(0, '325.962')] [2023-03-11 13:31:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000057296_29335552.pth... [2023-03-11 13:31:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000056544_28950528.pth [2023-03-11 13:31:03,666][22726] Updated weights for policy 0, policy_version 57360 (0.0004) [2023-03-11 13:31:06,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 12260.2). Total num frames: 29396992. Throughput: 0: 12700.6. Samples: 29389012. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:31:06,346][22439] Avg episode reward: [(0, '289.348')] [2023-03-11 13:31:07,132][22726] Updated weights for policy 0, policy_version 57440 (0.0005) [2023-03-11 13:31:10,640][22726] Updated weights for policy 0, policy_version 57520 (0.0005) [2023-03-11 13:31:11,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 12232.5). Total num frames: 29454336. Throughput: 0: 12725.2. Samples: 29424320. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:31:11,346][22439] Avg episode reward: [(0, '322.053')] [2023-03-11 13:31:14,083][22726] Updated weights for policy 0, policy_version 57600 (0.0005) [2023-03-11 13:31:16,345][22439] Fps is (10 sec: 11878.3, 60 sec: 12424.5, 300 sec: 12232.5). Total num frames: 29515776. Throughput: 0: 12631.6. Samples: 29495368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:31:16,346][22439] Avg episode reward: [(0, '252.302')] [2023-03-11 13:31:16,409][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000057656_29519872.pth... [2023-03-11 13:31:16,411][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000056920_29143040.pth [2023-03-11 13:31:17,412][22726] Updated weights for policy 0, policy_version 57680 (0.0005) [2023-03-11 13:31:20,977][22726] Updated weights for policy 0, policy_version 57760 (0.0005) [2023-03-11 13:31:21,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 12218.6). Total num frames: 29573120. Throughput: 0: 12525.6. Samples: 29567500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:31:21,346][22439] Avg episode reward: [(0, '238.276')] [2023-03-11 13:31:24,500][22726] Updated weights for policy 0, policy_version 57840 (0.0005) [2023-03-11 13:31:26,345][22439] Fps is (10 sec: 11878.5, 60 sec: 12492.8, 300 sec: 12218.6). Total num frames: 29634560. Throughput: 0: 12426.4. Samples: 29601792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:31:26,346][22439] Avg episode reward: [(0, '150.263')] [2023-03-11 13:31:27,889][22726] Updated weights for policy 0, policy_version 57920 (0.0005) [2023-03-11 13:31:31,235][22726] Updated weights for policy 0, policy_version 58000 (0.0005) [2023-03-11 13:31:31,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 12204.7). Total num frames: 29696000. Throughput: 0: 12326.7. Samples: 29674444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:31:31,346][22439] Avg episode reward: [(0, '404.249')] [2023-03-11 13:31:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000058000_29696000.pth... [2023-03-11 13:31:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000057296_29335552.pth [2023-03-11 13:31:34,679][22726] Updated weights for policy 0, policy_version 58080 (0.0005) [2023-03-11 13:31:36,345][22439] Fps is (10 sec: 11878.3, 60 sec: 12356.3, 300 sec: 12190.8). Total num frames: 29753344. Throughput: 0: 12197.2. Samples: 29745224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:31:36,346][22439] Avg episode reward: [(0, '383.075')] [2023-03-11 13:31:38,082][22726] Updated weights for policy 0, policy_version 58160 (0.0005) [2023-03-11 13:31:41,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 12190.8). Total num frames: 29814784. Throughput: 0: 12156.6. Samples: 29782088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:31:41,346][22439] Avg episode reward: [(0, '223.878')] [2023-03-11 13:31:41,564][22726] Updated weights for policy 0, policy_version 58240 (0.0005) [2023-03-11 13:31:44,982][22726] Updated weights for policy 0, policy_version 58320 (0.0005) [2023-03-11 13:31:46,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12176.9). Total num frames: 29872128. Throughput: 0: 11994.9. Samples: 29852664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:31:46,346][22439] Avg episode reward: [(0, '245.023')] [2023-03-11 13:31:46,355][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000058352_29876224.pth... [2023-03-11 13:31:46,356][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000057656_29519872.pth [2023-03-11 13:31:48,393][22726] Updated weights for policy 0, policy_version 58400 (0.0005) [2023-03-11 13:31:51,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12163.0). Total num frames: 29933568. Throughput: 0: 11920.9. Samples: 29925452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:31:51,346][22439] Avg episode reward: [(0, '269.522')] [2023-03-11 13:31:51,761][22726] Updated weights for policy 0, policy_version 58480 (0.0005) [2023-03-11 13:31:55,213][22726] Updated weights for policy 0, policy_version 58560 (0.0005) [2023-03-11 13:31:56,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12083.2, 300 sec: 12163.0). Total num frames: 29995008. Throughput: 0: 11942.3. Samples: 29961724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:31:56,346][22439] Avg episode reward: [(0, '321.637')] [2023-03-11 13:31:58,706][22726] Updated weights for policy 0, policy_version 58640 (0.0005) [2023-03-11 13:32:01,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12149.2). Total num frames: 30052352. Throughput: 0: 11924.8. Samples: 30031984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:32:01,346][22439] Avg episode reward: [(0, '440.459')] [2023-03-11 13:32:01,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000058696_30052352.pth... [2023-03-11 13:32:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000058000_29696000.pth [2023-03-11 13:32:02,176][22726] Updated weights for policy 0, policy_version 58720 (0.0005) [2023-03-11 13:32:05,645][22726] Updated weights for policy 0, policy_version 58800 (0.0005) [2023-03-11 13:32:06,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12135.3). Total num frames: 30113792. Throughput: 0: 11892.3. Samples: 30102656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:32:06,346][22439] Avg episode reward: [(0, '194.690')] [2023-03-11 13:32:09,096][22726] Updated weights for policy 0, policy_version 58880 (0.0005) [2023-03-11 13:32:11,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12121.4). Total num frames: 30171136. Throughput: 0: 11925.5. Samples: 30138440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:32:11,346][22439] Avg episode reward: [(0, '408.395')] [2023-03-11 13:32:12,549][22726] Updated weights for policy 0, policy_version 58960 (0.0005) [2023-03-11 13:32:16,023][22726] Updated weights for policy 0, policy_version 59040 (0.0005) [2023-03-11 13:32:16,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 12121.4). Total num frames: 30228480. Throughput: 0: 11899.8. Samples: 30209936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:32:16,346][22439] Avg episode reward: [(0, '322.582')] [2023-03-11 13:32:16,352][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000059048_30232576.pth... [2023-03-11 13:32:16,354][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000058352_29876224.pth [2023-03-11 13:32:19,464][22726] Updated weights for policy 0, policy_version 59120 (0.0005) [2023-03-11 13:32:21,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 12121.4). Total num frames: 30289920. Throughput: 0: 11908.2. Samples: 30281092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:32:21,346][22439] Avg episode reward: [(0, '252.030')] [2023-03-11 13:32:22,900][22726] Updated weights for policy 0, policy_version 59200 (0.0005) [2023-03-11 13:32:26,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 12107.5). Total num frames: 30347264. Throughput: 0: 11876.2. Samples: 30316516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:32:26,346][22439] Avg episode reward: [(0, '305.872')] [2023-03-11 13:32:26,440][22726] Updated weights for policy 0, policy_version 59280 (0.0005) [2023-03-11 13:32:29,870][22726] Updated weights for policy 0, policy_version 59360 (0.0005) [2023-03-11 13:32:31,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 12107.5). Total num frames: 30408704. Throughput: 0: 11890.9. Samples: 30387756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:32:31,346][22439] Avg episode reward: [(0, '328.938')] [2023-03-11 13:32:31,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000059392_30408704.pth... [2023-03-11 13:32:31,353][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000058696_30052352.pth [2023-03-11 13:32:33,347][22726] Updated weights for policy 0, policy_version 59440 (0.0005) [2023-03-11 13:32:36,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 12107.5). Total num frames: 30470144. Throughput: 0: 11878.9. Samples: 30460004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:32:36,346][22439] Avg episode reward: [(0, '405.342')] [2023-03-11 13:32:36,580][22726] Updated weights for policy 0, policy_version 59520 (0.0005) [2023-03-11 13:32:39,681][22726] Updated weights for policy 0, policy_version 59600 (0.0004) [2023-03-11 13:32:41,345][22439] Fps is (10 sec: 12697.7, 60 sec: 12014.9, 300 sec: 12121.4). Total num frames: 30535680. Throughput: 0: 11918.3. Samples: 30498048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:32:41,346][22439] Avg episode reward: [(0, '547.379')] [2023-03-11 13:32:42,882][22726] Updated weights for policy 0, policy_version 59680 (0.0005) [2023-03-11 13:32:46,067][22726] Updated weights for policy 0, policy_version 59760 (0.0005) [2023-03-11 13:32:46,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12083.2, 300 sec: 12121.4). Total num frames: 30597120. Throughput: 0: 12103.5. Samples: 30576640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:32:46,346][22439] Avg episode reward: [(0, '370.322')] [2023-03-11 13:32:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000059760_30597120.pth... [2023-03-11 13:32:46,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000059048_30232576.pth [2023-03-11 13:32:49,245][22726] Updated weights for policy 0, policy_version 59840 (0.0004) [2023-03-11 13:32:51,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 12135.3). Total num frames: 30662656. Throughput: 0: 12231.2. Samples: 30653060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:32:51,346][22439] Avg episode reward: [(0, '523.621')] [2023-03-11 13:32:52,479][22726] Updated weights for policy 0, policy_version 59920 (0.0005) [2023-03-11 13:32:55,580][22726] Updated weights for policy 0, policy_version 60000 (0.0004) [2023-03-11 13:32:56,345][22439] Fps is (10 sec: 13107.2, 60 sec: 12219.7, 300 sec: 12149.2). Total num frames: 30728192. Throughput: 0: 12286.6. Samples: 30691336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:32:56,346][22439] Avg episode reward: [(0, '360.490')] [2023-03-11 13:32:58,969][22726] Updated weights for policy 0, policy_version 60080 (0.0005) [2023-03-11 13:33:01,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12219.7, 300 sec: 12149.1). Total num frames: 30785536. Throughput: 0: 12364.0. Samples: 30766316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:33:01,346][22439] Avg episode reward: [(0, '388.388')] [2023-03-11 13:33:01,407][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000060136_30789632.pth... [2023-03-11 13:33:01,410][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000059392_30408704.pth [2023-03-11 13:33:02,445][22726] Updated weights for policy 0, policy_version 60160 (0.0005) [2023-03-11 13:33:06,011][22726] Updated weights for policy 0, policy_version 60240 (0.0005) [2023-03-11 13:33:06,345][22439] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 12135.3). Total num frames: 30842880. Throughput: 0: 12337.7. Samples: 30836288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:33:06,356][22439] Avg episode reward: [(0, '459.246')] [2023-03-11 13:33:09,480][22726] Updated weights for policy 0, policy_version 60320 (0.0005) [2023-03-11 13:33:11,345][22439] Fps is (10 sec: 11878.5, 60 sec: 12219.7, 300 sec: 12149.2). Total num frames: 30904320. Throughput: 0: 12333.7. Samples: 30871532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:33:11,356][22439] Avg episode reward: [(0, '423.644')] [2023-03-11 13:33:12,583][22726] Updated weights for policy 0, policy_version 60400 (0.0004) [2023-03-11 13:33:15,960][22726] Updated weights for policy 0, policy_version 60480 (0.0005) [2023-03-11 13:33:16,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12356.3, 300 sec: 12163.0). Total num frames: 30969856. Throughput: 0: 12444.5. Samples: 30947760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:33:16,356][22439] Avg episode reward: [(0, '382.931')] [2023-03-11 13:33:16,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000060488_30969856.pth... [2023-03-11 13:33:16,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000059760_30597120.pth [2023-03-11 13:33:19,437][22726] Updated weights for policy 0, policy_version 60560 (0.0005) [2023-03-11 13:33:21,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12149.2). Total num frames: 31027200. Throughput: 0: 12393.4. Samples: 31017708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:33:21,356][22439] Avg episode reward: [(0, '549.010')] [2023-03-11 13:33:23,028][22726] Updated weights for policy 0, policy_version 60640 (0.0006) [2023-03-11 13:33:26,345][22439] Fps is (10 sec: 11468.9, 60 sec: 12288.0, 300 sec: 12149.2). Total num frames: 31084544. Throughput: 0: 12314.1. Samples: 31052180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:33:26,356][22439] Avg episode reward: [(0, '585.134')] [2023-03-11 13:33:26,413][22726] Updated weights for policy 0, policy_version 60720 (0.0005) [2023-03-11 13:33:29,650][22726] Updated weights for policy 0, policy_version 60800 (0.0005) [2023-03-11 13:33:31,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12356.3, 300 sec: 12163.0). Total num frames: 31150080. Throughput: 0: 12213.1. Samples: 31126228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:33:31,356][22439] Avg episode reward: [(0, '300.368')] [2023-03-11 13:33:31,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000060840_31150080.pth... [2023-03-11 13:33:31,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000060136_30789632.pth [2023-03-11 13:33:33,055][22726] Updated weights for policy 0, policy_version 60880 (0.0005) [2023-03-11 13:33:36,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 12149.2). Total num frames: 31207424. Throughput: 0: 12137.5. Samples: 31199248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:33:36,356][22439] Avg episode reward: [(0, '550.196')] [2023-03-11 13:33:36,534][22726] Updated weights for policy 0, policy_version 60960 (0.0006) [2023-03-11 13:33:39,907][22726] Updated weights for policy 0, policy_version 61040 (0.0006) [2023-03-11 13:33:41,345][22439] Fps is (10 sec: 11878.5, 60 sec: 12219.7, 300 sec: 12135.3). Total num frames: 31268864. Throughput: 0: 12086.7. Samples: 31235236. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:33:41,356][22439] Avg episode reward: [(0, '398.960')] [2023-03-11 13:33:43,344][22726] Updated weights for policy 0, policy_version 61120 (0.0005) [2023-03-11 13:33:46,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12135.3). Total num frames: 31330304. Throughput: 0: 12027.9. Samples: 31307572. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:33:46,356][22439] Avg episode reward: [(0, '222.016')] [2023-03-11 13:33:46,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000061192_31330304.pth... [2023-03-11 13:33:46,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000060488_30969856.pth [2023-03-11 13:33:46,506][22726] Updated weights for policy 0, policy_version 61200 (0.0004) [2023-03-11 13:33:49,745][22726] Updated weights for policy 0, policy_version 61280 (0.0005) [2023-03-11 13:33:51,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 12135.3). Total num frames: 31391744. Throughput: 0: 12162.9. Samples: 31383616. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:33:51,356][22439] Avg episode reward: [(0, '374.771')] [2023-03-11 13:33:52,976][22726] Updated weights for policy 0, policy_version 61360 (0.0005) [2023-03-11 13:33:56,200][22726] Updated weights for policy 0, policy_version 61440 (0.0005) [2023-03-11 13:33:56,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 12149.2). Total num frames: 31457280. Throughput: 0: 12226.4. Samples: 31421720. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:33:56,356][22439] Avg episode reward: [(0, '380.817')] [2023-03-11 13:33:59,621][22726] Updated weights for policy 0, policy_version 61520 (0.0005) [2023-03-11 13:34:01,345][22439] Fps is (10 sec: 12697.4, 60 sec: 12219.7, 300 sec: 12149.1). Total num frames: 31518720. Throughput: 0: 12183.0. Samples: 31495996. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:34:01,346][22439] Avg episode reward: [(0, '493.549')] [2023-03-11 13:34:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000061560_31518720.pth... [2023-03-11 13:34:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000060840_31150080.pth [2023-03-11 13:34:03,046][22726] Updated weights for policy 0, policy_version 61600 (0.0005) [2023-03-11 13:34:06,345][22439] Fps is (10 sec: 11878.3, 60 sec: 12219.7, 300 sec: 12135.3). Total num frames: 31576064. Throughput: 0: 12177.5. Samples: 31565696. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:34:06,346][22439] Avg episode reward: [(0, '543.465')] [2023-03-11 13:34:06,689][22726] Updated weights for policy 0, policy_version 61680 (0.0006) [2023-03-11 13:34:10,192][22726] Updated weights for policy 0, policy_version 61760 (0.0005) [2023-03-11 13:34:11,345][22439] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 12135.3). Total num frames: 31633408. Throughput: 0: 12183.2. Samples: 31600424. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:34:11,346][22439] Avg episode reward: [(0, '586.184')] [2023-03-11 13:34:13,404][22726] Updated weights for policy 0, policy_version 61840 (0.0004) [2023-03-11 13:34:16,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 12135.3). Total num frames: 31698944. Throughput: 0: 12183.7. Samples: 31674496. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:34:16,346][22439] Avg episode reward: [(0, '700.162')] [2023-03-11 13:34:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000061912_31698944.pth... [2023-03-11 13:34:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000061192_31330304.pth [2023-03-11 13:34:16,675][22726] Updated weights for policy 0, policy_version 61920 (0.0005) [2023-03-11 13:34:20,028][22726] Updated weights for policy 0, policy_version 62000 (0.0005) [2023-03-11 13:34:21,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 12149.2). Total num frames: 31756288. Throughput: 0: 12200.1. Samples: 31748252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:34:21,346][22439] Avg episode reward: [(0, '562.981')] [2023-03-11 13:34:23,323][22726] Updated weights for policy 0, policy_version 62080 (0.0004) [2023-03-11 13:34:26,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 12176.9). Total num frames: 31821824. Throughput: 0: 12240.8. Samples: 31786072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:34:26,346][22439] Avg episode reward: [(0, '510.993')] [2023-03-11 13:34:26,508][22726] Updated weights for policy 0, policy_version 62160 (0.0005) [2023-03-11 13:34:29,794][22726] Updated weights for policy 0, policy_version 62240 (0.0005) [2023-03-11 13:34:31,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12219.7, 300 sec: 12176.9). Total num frames: 31883264. Throughput: 0: 12335.1. Samples: 31862652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:34:31,346][22439] Avg episode reward: [(0, '330.976')] [2023-03-11 13:34:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000062272_31883264.pth... [2023-03-11 13:34:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000061560_31518720.pth [2023-03-11 13:34:33,093][22726] Updated weights for policy 0, policy_version 62320 (0.0004) [2023-03-11 13:34:36,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12176.9). Total num frames: 31944704. Throughput: 0: 12286.2. Samples: 31936496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:34:36,346][22439] Avg episode reward: [(0, '379.413')] [2023-03-11 13:34:36,483][22726] Updated weights for policy 0, policy_version 62400 (0.0005) [2023-03-11 13:34:39,865][22726] Updated weights for policy 0, policy_version 62480 (0.0005) [2023-03-11 13:34:41,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 12176.9). Total num frames: 32006144. Throughput: 0: 12249.9. Samples: 31972964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:34:41,346][22439] Avg episode reward: [(0, '500.400')] [2023-03-11 13:34:43,342][22726] Updated weights for policy 0, policy_version 62560 (0.0005) [2023-03-11 13:34:46,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12163.0). Total num frames: 32063488. Throughput: 0: 12173.2. Samples: 32043788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:34:46,346][22439] Avg episode reward: [(0, '421.808')] [2023-03-11 13:34:46,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000062624_32063488.pth... [2023-03-11 13:34:46,349][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000061912_31698944.pth [2023-03-11 13:34:46,732][22726] Updated weights for policy 0, policy_version 62640 (0.0005) [2023-03-11 13:34:50,087][22726] Updated weights for policy 0, policy_version 62720 (0.0005) [2023-03-11 13:34:51,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12176.9). Total num frames: 32124928. Throughput: 0: 12245.7. Samples: 32116752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:34:51,346][22439] Avg episode reward: [(0, '507.313')] [2023-03-11 13:34:53,451][22726] Updated weights for policy 0, policy_version 62800 (0.0005) [2023-03-11 13:34:56,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 12190.8). Total num frames: 32186368. Throughput: 0: 12287.2. Samples: 32153348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:34:56,346][22439] Avg episode reward: [(0, '513.427')] [2023-03-11 13:34:56,811][22726] Updated weights for policy 0, policy_version 62880 (0.0005) [2023-03-11 13:35:00,213][22726] Updated weights for policy 0, policy_version 62960 (0.0005) [2023-03-11 13:35:01,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12151.5, 300 sec: 12190.8). Total num frames: 32247808. Throughput: 0: 12262.2. Samples: 32226296. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:35:01,346][22439] Avg episode reward: [(0, '445.541')] [2023-03-11 13:35:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000062984_32247808.pth... [2023-03-11 13:35:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000062272_31883264.pth [2023-03-11 13:35:03,599][22726] Updated weights for policy 0, policy_version 63040 (0.0005) [2023-03-11 13:35:06,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12219.7, 300 sec: 12204.7). Total num frames: 32309248. Throughput: 0: 12232.2. Samples: 32298704. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:35:06,346][22439] Avg episode reward: [(0, '629.910')] [2023-03-11 13:35:06,890][22726] Updated weights for policy 0, policy_version 63120 (0.0004) [2023-03-11 13:35:10,173][22726] Updated weights for policy 0, policy_version 63200 (0.0005) [2023-03-11 13:35:11,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 12204.7). Total num frames: 32370688. Throughput: 0: 12245.6. Samples: 32337124. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:35:11,346][22439] Avg episode reward: [(0, '680.428')] [2023-03-11 13:35:13,587][22726] Updated weights for policy 0, policy_version 63280 (0.0005) [2023-03-11 13:35:16,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12218.6). Total num frames: 32432128. Throughput: 0: 12150.5. Samples: 32409424. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:35:16,346][22439] Avg episode reward: [(0, '688.149')] [2023-03-11 13:35:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000063344_32432128.pth... [2023-03-11 13:35:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000062624_32063488.pth [2023-03-11 13:35:17,002][22726] Updated weights for policy 0, policy_version 63360 (0.0005) [2023-03-11 13:35:20,536][22726] Updated weights for policy 0, policy_version 63440 (0.0005) [2023-03-11 13:35:21,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12218.6). Total num frames: 32489472. Throughput: 0: 12088.7. Samples: 32480488. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:35:21,346][22439] Avg episode reward: [(0, '747.715')] [2023-03-11 13:35:24,208][22726] Updated weights for policy 0, policy_version 63520 (0.0005) [2023-03-11 13:35:26,345][22439] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 12190.8). Total num frames: 32546816. Throughput: 0: 12014.8. Samples: 32513632. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:35:26,346][22439] Avg episode reward: [(0, '910.562')] [2023-03-11 13:35:27,716][22726] Updated weights for policy 0, policy_version 63600 (0.0004) [2023-03-11 13:35:31,316][22726] Updated weights for policy 0, policy_version 63680 (0.0005) [2023-03-11 13:35:31,345][22439] Fps is (10 sec: 11468.7, 60 sec: 12014.9, 300 sec: 12176.9). Total num frames: 32604160. Throughput: 0: 11989.8. Samples: 32583332. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:35:31,346][22439] Avg episode reward: [(0, '623.327')] [2023-03-11 13:35:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000063680_32604160.pth... [2023-03-11 13:35:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000062984_32247808.pth [2023-03-11 13:35:35,049][22726] Updated weights for policy 0, policy_version 63760 (0.0005) [2023-03-11 13:35:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11878.4, 300 sec: 12135.3). Total num frames: 32657408. Throughput: 0: 11832.7. Samples: 32649224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:35:36,356][22439] Avg episode reward: [(0, '748.479')] [2023-03-11 13:35:38,704][22726] Updated weights for policy 0, policy_version 63840 (0.0005) [2023-03-11 13:35:41,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11810.1, 300 sec: 12107.5). Total num frames: 32714752. Throughput: 0: 11758.0. Samples: 32682456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:35:41,356][22439] Avg episode reward: [(0, '635.774')] [2023-03-11 13:35:42,263][22726] Updated weights for policy 0, policy_version 63920 (0.0005) [2023-03-11 13:35:46,027][22726] Updated weights for policy 0, policy_version 64000 (0.0006) [2023-03-11 13:35:46,345][22439] Fps is (10 sec: 11059.0, 60 sec: 11741.8, 300 sec: 12079.7). Total num frames: 32768000. Throughput: 0: 11660.8. Samples: 32751032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:35:46,346][22439] Avg episode reward: [(0, '742.593')] [2023-03-11 13:35:46,376][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000064008_32772096.pth... [2023-03-11 13:35:46,378][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000063344_32432128.pth [2023-03-11 13:35:49,659][22726] Updated weights for policy 0, policy_version 64080 (0.0005) [2023-03-11 13:35:51,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11673.6, 300 sec: 12052.0). Total num frames: 32825344. Throughput: 0: 11522.7. Samples: 32817224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:35:51,346][22439] Avg episode reward: [(0, '692.590')] [2023-03-11 13:35:53,220][22726] Updated weights for policy 0, policy_version 64160 (0.0005) [2023-03-11 13:35:56,345][22439] Fps is (10 sec: 11469.0, 60 sec: 11605.3, 300 sec: 12024.2). Total num frames: 32882688. Throughput: 0: 11450.5. Samples: 32852396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:35:56,346][22439] Avg episode reward: [(0, '525.483')] [2023-03-11 13:35:56,889][22726] Updated weights for policy 0, policy_version 64240 (0.0006) [2023-03-11 13:36:00,543][22726] Updated weights for policy 0, policy_version 64320 (0.0005) [2023-03-11 13:36:01,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 12010.3). Total num frames: 32940032. Throughput: 0: 11336.5. Samples: 32919568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:36:01,346][22439] Avg episode reward: [(0, '521.054')] [2023-03-11 13:36:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000064336_32940032.pth... [2023-03-11 13:36:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000063680_32604160.pth [2023-03-11 13:36:04,030][22726] Updated weights for policy 0, policy_version 64400 (0.0005) [2023-03-11 13:36:06,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 12010.3). Total num frames: 32997376. Throughput: 0: 11287.2. Samples: 32988412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:36:06,346][22439] Avg episode reward: [(0, '594.862')] [2023-03-11 13:36:07,602][22726] Updated weights for policy 0, policy_version 64480 (0.0004) [2023-03-11 13:36:10,895][22726] Updated weights for policy 0, policy_version 64560 (0.0003) [2023-03-11 13:36:11,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 12010.3). Total num frames: 33058816. Throughput: 0: 11320.4. Samples: 33023052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:36:11,346][22439] Avg episode reward: [(0, '705.653')] [2023-03-11 13:36:14,363][22726] Updated weights for policy 0, policy_version 64640 (0.0003) [2023-03-11 13:36:16,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11400.5, 300 sec: 12010.3). Total num frames: 33116160. Throughput: 0: 11395.4. Samples: 33096124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:36:16,346][22439] Avg episode reward: [(0, '528.235')] [2023-03-11 13:36:16,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000064680_33116160.pth... [2023-03-11 13:36:16,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000064008_32772096.pth [2023-03-11 13:36:17,767][22726] Updated weights for policy 0, policy_version 64720 (0.0004) [2023-03-11 13:36:21,193][22726] Updated weights for policy 0, policy_version 64800 (0.0003) [2023-03-11 13:36:21,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11468.8, 300 sec: 12010.3). Total num frames: 33177600. Throughput: 0: 11559.2. Samples: 33169388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:36:21,346][22439] Avg episode reward: [(0, '607.047')] [2023-03-11 13:36:24,680][22726] Updated weights for policy 0, policy_version 64880 (0.0003) [2023-03-11 13:36:26,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 11996.4). Total num frames: 33234944. Throughput: 0: 11587.8. Samples: 33203908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:36:26,346][22439] Avg episode reward: [(0, '508.019')] [2023-03-11 13:36:28,142][22726] Updated weights for policy 0, policy_version 64960 (0.0003) [2023-03-11 13:36:31,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11537.1, 300 sec: 12010.3). Total num frames: 33296384. Throughput: 0: 11664.1. Samples: 33275916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:36:31,346][22439] Avg episode reward: [(0, '454.578')] [2023-03-11 13:36:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000065032_33296384.pth... [2023-03-11 13:36:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000064336_32940032.pth [2023-03-11 13:36:31,394][22726] Updated weights for policy 0, policy_version 65040 (0.0003) [2023-03-11 13:36:34,670][22726] Updated weights for policy 0, policy_version 65120 (0.0003) [2023-03-11 13:36:36,345][22439] Fps is (10 sec: 12697.7, 60 sec: 11741.9, 300 sec: 12024.2). Total num frames: 33361920. Throughput: 0: 11866.8. Samples: 33351228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:36:36,346][22439] Avg episode reward: [(0, '411.270')] [2023-03-11 13:36:37,992][22726] Updated weights for policy 0, policy_version 65200 (0.0003) [2023-03-11 13:36:41,123][22726] Updated weights for policy 0, policy_version 65280 (0.0003) [2023-03-11 13:36:41,345][22439] Fps is (10 sec: 12697.6, 60 sec: 11810.1, 300 sec: 12038.1). Total num frames: 33423360. Throughput: 0: 11897.9. Samples: 33387800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:36:41,346][22439] Avg episode reward: [(0, '461.672')] [2023-03-11 13:36:44,364][22726] Updated weights for policy 0, policy_version 65360 (0.0003) [2023-03-11 13:36:46,345][22439] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 12038.1). Total num frames: 33484800. Throughput: 0: 12114.9. Samples: 33464736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:36:46,346][22439] Avg episode reward: [(0, '543.306')] [2023-03-11 13:36:46,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000065400_33484800.pth... [2023-03-11 13:36:46,349][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000064680_33116160.pth [2023-03-11 13:36:47,667][22726] Updated weights for policy 0, policy_version 65440 (0.0004) [2023-03-11 13:36:51,083][22726] Updated weights for policy 0, policy_version 65520 (0.0004) [2023-03-11 13:36:51,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 12038.1). Total num frames: 33546240. Throughput: 0: 12215.5. Samples: 33538112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:36:51,346][22439] Avg episode reward: [(0, '810.737')] [2023-03-11 13:36:54,255][22726] Updated weights for policy 0, policy_version 65600 (0.0004) [2023-03-11 13:36:56,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12151.5, 300 sec: 12065.8). Total num frames: 33611776. Throughput: 0: 12292.5. Samples: 33576216. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 13:36:56,346][22439] Avg episode reward: [(0, '714.613')] [2023-03-11 13:36:57,606][22726] Updated weights for policy 0, policy_version 65680 (0.0005) [2023-03-11 13:37:01,316][22726] Updated weights for policy 0, policy_version 65760 (0.0005) [2023-03-11 13:37:01,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12151.5, 300 sec: 12052.0). Total num frames: 33669120. Throughput: 0: 12269.0. Samples: 33648232. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 13:37:01,346][22439] Avg episode reward: [(0, '662.889')] [2023-03-11 13:37:01,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000065760_33669120.pth... [2023-03-11 13:37:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000065032_33296384.pth [2023-03-11 13:37:04,776][22726] Updated weights for policy 0, policy_version 65840 (0.0005) [2023-03-11 13:37:06,345][22439] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 12052.0). Total num frames: 33726464. Throughput: 0: 12188.8. Samples: 33717884. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 13:37:06,346][22439] Avg episode reward: [(0, '746.082')] [2023-03-11 13:37:08,196][22726] Updated weights for policy 0, policy_version 65920 (0.0005) [2023-03-11 13:37:11,345][22439] Fps is (10 sec: 11878.5, 60 sec: 12151.5, 300 sec: 12065.8). Total num frames: 33787904. Throughput: 0: 12223.2. Samples: 33753952. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 13:37:11,354][22439] Avg episode reward: [(0, '525.640')] [2023-03-11 13:37:11,510][22726] Updated weights for policy 0, policy_version 66000 (0.0005) [2023-03-11 13:37:14,875][22726] Updated weights for policy 0, policy_version 66080 (0.0004) [2023-03-11 13:37:16,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12219.7, 300 sec: 12065.8). Total num frames: 33849344. Throughput: 0: 12265.4. Samples: 33827860. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 13:37:16,356][22439] Avg episode reward: [(0, '573.453')] [2023-03-11 13:37:16,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000066112_33849344.pth... [2023-03-11 13:37:16,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000065400_33484800.pth [2023-03-11 13:37:18,295][22726] Updated weights for policy 0, policy_version 66160 (0.0005) [2023-03-11 13:37:21,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12065.8). Total num frames: 33906688. Throughput: 0: 12178.6. Samples: 33899264. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 13:37:21,356][22439] Avg episode reward: [(0, '878.319')] [2023-03-11 13:37:21,709][22726] Updated weights for policy 0, policy_version 66240 (0.0005) [2023-03-11 13:37:25,157][22726] Updated weights for policy 0, policy_version 66320 (0.0005) [2023-03-11 13:37:26,345][22439] Fps is (10 sec: 11878.3, 60 sec: 12219.7, 300 sec: 12065.8). Total num frames: 33968128. Throughput: 0: 12169.4. Samples: 33935424. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 13:37:26,356][22439] Avg episode reward: [(0, '731.358')] [2023-03-11 13:37:28,927][22726] Updated weights for policy 0, policy_version 66400 (0.0005) [2023-03-11 13:37:31,345][22439] Fps is (10 sec: 11468.7, 60 sec: 12083.2, 300 sec: 12038.1). Total num frames: 34021376. Throughput: 0: 11952.5. Samples: 34002600. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 13:37:31,356][22439] Avg episode reward: [(0, '621.168')] [2023-03-11 13:37:31,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000066448_34021376.pth... [2023-03-11 13:37:31,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000065760_33669120.pth [2023-03-11 13:37:32,610][22726] Updated weights for policy 0, policy_version 66480 (0.0005) [2023-03-11 13:37:36,299][22726] Updated weights for policy 0, policy_version 66560 (0.0005) [2023-03-11 13:37:36,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11946.6, 300 sec: 12010.3). Total num frames: 34078720. Throughput: 0: 11810.1. Samples: 34069568. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:37:36,346][22439] Avg episode reward: [(0, '522.955')] [2023-03-11 13:37:39,908][22726] Updated weights for policy 0, policy_version 66640 (0.0006) [2023-03-11 13:37:41,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11810.1, 300 sec: 11982.5). Total num frames: 34131968. Throughput: 0: 11714.3. Samples: 34103360. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:37:41,346][22439] Avg episode reward: [(0, '453.516')] [2023-03-11 13:37:43,569][22726] Updated weights for policy 0, policy_version 66720 (0.0006) [2023-03-11 13:37:46,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 11968.7). Total num frames: 34193408. Throughput: 0: 11616.9. Samples: 34170992. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:37:46,346][22439] Avg episode reward: [(0, '699.538')] [2023-03-11 13:37:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000066784_34193408.pth... [2023-03-11 13:37:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000066112_33849344.pth [2023-03-11 13:37:47,003][22726] Updated weights for policy 0, policy_version 66800 (0.0005) [2023-03-11 13:37:50,653][22726] Updated weights for policy 0, policy_version 66880 (0.0006) [2023-03-11 13:37:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11927.0). Total num frames: 34246656. Throughput: 0: 11598.1. Samples: 34239800. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:37:51,346][22439] Avg episode reward: [(0, '754.485')] [2023-03-11 13:37:54,344][22726] Updated weights for policy 0, policy_version 66960 (0.0005) [2023-03-11 13:37:56,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11927.0). Total num frames: 34304000. Throughput: 0: 11543.3. Samples: 34273400. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:37:56,346][22439] Avg episode reward: [(0, '782.047')] [2023-03-11 13:37:58,000][22726] Updated weights for policy 0, policy_version 67040 (0.0006) [2023-03-11 13:38:01,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11927.0). Total num frames: 34361344. Throughput: 0: 11400.4. Samples: 34340876. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:38:01,346][22439] Avg episode reward: [(0, '657.932')] [2023-03-11 13:38:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000067112_34361344.pth... [2023-03-11 13:38:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000066448_34021376.pth [2023-03-11 13:38:01,656][22726] Updated weights for policy 0, policy_version 67120 (0.0005) [2023-03-11 13:38:05,234][22726] Updated weights for policy 0, policy_version 67200 (0.0006) [2023-03-11 13:38:06,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11468.8, 300 sec: 11899.2). Total num frames: 34414592. Throughput: 0: 11319.1. Samples: 34408624. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:38:06,346][22439] Avg episode reward: [(0, '950.128')] [2023-03-11 13:38:06,362][22682] Saving new best policy, reward=950.128! [2023-03-11 13:38:08,896][22726] Updated weights for policy 0, policy_version 67280 (0.0006) [2023-03-11 13:38:11,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11400.5, 300 sec: 11871.5). Total num frames: 34471936. Throughput: 0: 11262.7. Samples: 34442244. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:38:11,346][22439] Avg episode reward: [(0, '800.004')] [2023-03-11 13:38:12,520][22726] Updated weights for policy 0, policy_version 67360 (0.0006) [2023-03-11 13:38:16,095][22726] Updated weights for policy 0, policy_version 67440 (0.0006) [2023-03-11 13:38:16,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11871.5). Total num frames: 34529280. Throughput: 0: 11274.9. Samples: 34509972. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:38:16,346][22439] Avg episode reward: [(0, '787.007')] [2023-03-11 13:38:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000067440_34529280.pth... [2023-03-11 13:38:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000066784_34193408.pth [2023-03-11 13:38:19,739][22726] Updated weights for policy 0, policy_version 67520 (0.0006) [2023-03-11 13:38:21,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11871.5). Total num frames: 34586624. Throughput: 0: 11308.1. Samples: 34578432. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:38:21,346][22439] Avg episode reward: [(0, '766.863')] [2023-03-11 13:38:23,489][22726] Updated weights for policy 0, policy_version 67600 (0.0005) [2023-03-11 13:38:26,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11195.8, 300 sec: 11829.8). Total num frames: 34639872. Throughput: 0: 11285.3. Samples: 34611196. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:38:26,346][22439] Avg episode reward: [(0, '977.165')] [2023-03-11 13:38:26,346][22682] Saving new best policy, reward=977.165! [2023-03-11 13:38:27,176][22726] Updated weights for policy 0, policy_version 67680 (0.0006) [2023-03-11 13:38:30,908][22726] Updated weights for policy 0, policy_version 67760 (0.0006) [2023-03-11 13:38:31,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11264.0, 300 sec: 11829.8). Total num frames: 34697216. Throughput: 0: 11244.9. Samples: 34677012. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:38:31,346][22439] Avg episode reward: [(0, '611.036')] [2023-03-11 13:38:31,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000067768_34697216.pth... [2023-03-11 13:38:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000067112_34361344.pth [2023-03-11 13:38:34,668][22726] Updated weights for policy 0, policy_version 67840 (0.0006) [2023-03-11 13:38:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11802.0). Total num frames: 34750464. Throughput: 0: 11167.5. Samples: 34742336. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:38:36,346][22439] Avg episode reward: [(0, '638.039')] [2023-03-11 13:38:38,296][22726] Updated weights for policy 0, policy_version 67920 (0.0005) [2023-03-11 13:38:41,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11264.0, 300 sec: 11788.1). Total num frames: 34807808. Throughput: 0: 11176.6. Samples: 34776348. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:38:41,346][22439] Avg episode reward: [(0, '976.706')] [2023-03-11 13:38:41,928][22726] Updated weights for policy 0, policy_version 68000 (0.0006) [2023-03-11 13:38:45,541][22726] Updated weights for policy 0, policy_version 68080 (0.0005) [2023-03-11 13:38:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 11774.3). Total num frames: 34865152. Throughput: 0: 11195.7. Samples: 34844684. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:38:46,346][22439] Avg episode reward: [(0, '849.736')] [2023-03-11 13:38:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000068096_34865152.pth... [2023-03-11 13:38:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000067440_34529280.pth [2023-03-11 13:38:49,181][22726] Updated weights for policy 0, policy_version 68160 (0.0005) [2023-03-11 13:38:51,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11264.0, 300 sec: 11746.5). Total num frames: 34922496. Throughput: 0: 11195.6. Samples: 34912424. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:38:51,346][22439] Avg episode reward: [(0, '1007.075')] [2023-03-11 13:38:51,346][22682] Saving new best policy, reward=1007.075! [2023-03-11 13:38:52,843][22726] Updated weights for policy 0, policy_version 68240 (0.0005) [2023-03-11 13:38:56,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11718.7). Total num frames: 34975744. Throughput: 0: 11184.2. Samples: 34945532. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 13:38:56,346][22439] Avg episode reward: [(0, '782.356')] [2023-03-11 13:38:56,519][22726] Updated weights for policy 0, policy_version 68320 (0.0005) [2023-03-11 13:39:00,140][22726] Updated weights for policy 0, policy_version 68400 (0.0005) [2023-03-11 13:39:01,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11195.7, 300 sec: 11718.7). Total num frames: 35033088. Throughput: 0: 11171.1. Samples: 35012672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:39:01,346][22439] Avg episode reward: [(0, '1084.130')] [2023-03-11 13:39:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000068424_35033088.pth... [2023-03-11 13:39:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000067768_34697216.pth [2023-03-11 13:39:01,352][22682] Saving new best policy, reward=1084.130! [2023-03-11 13:39:03,755][22726] Updated weights for policy 0, policy_version 68480 (0.0005) [2023-03-11 13:39:06,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11718.7). Total num frames: 35090432. Throughput: 0: 11193.2. Samples: 35082124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:39:06,346][22439] Avg episode reward: [(0, '839.234')] [2023-03-11 13:39:07,189][22726] Updated weights for policy 0, policy_version 68560 (0.0005) [2023-03-11 13:39:10,840][22726] Updated weights for policy 0, policy_version 68640 (0.0005) [2023-03-11 13:39:11,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11691.0). Total num frames: 35147776. Throughput: 0: 11238.4. Samples: 35116924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:39:11,356][22439] Avg episode reward: [(0, '715.431')] [2023-03-11 13:39:14,428][22726] Updated weights for policy 0, policy_version 68720 (0.0005) [2023-03-11 13:39:16,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11691.0). Total num frames: 35205120. Throughput: 0: 11282.0. Samples: 35184704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:39:16,356][22439] Avg episode reward: [(0, '689.717')] [2023-03-11 13:39:16,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000068760_35205120.pth... [2023-03-11 13:39:16,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000068096_34865152.pth [2023-03-11 13:39:18,070][22726] Updated weights for policy 0, policy_version 68800 (0.0005) [2023-03-11 13:39:21,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11195.7, 300 sec: 11649.3). Total num frames: 35258368. Throughput: 0: 11330.7. Samples: 35252216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:39:21,356][22439] Avg episode reward: [(0, '725.858')] [2023-03-11 13:39:21,704][22726] Updated weights for policy 0, policy_version 68880 (0.0005) [2023-03-11 13:39:25,209][22726] Updated weights for policy 0, policy_version 68960 (0.0005) [2023-03-11 13:39:26,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11649.3). Total num frames: 35319808. Throughput: 0: 11347.9. Samples: 35287004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:39:26,356][22439] Avg episode reward: [(0, '571.658')] [2023-03-11 13:39:28,633][22726] Updated weights for policy 0, policy_version 69040 (0.0005) [2023-03-11 13:39:31,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11332.3, 300 sec: 11635.4). Total num frames: 35377152. Throughput: 0: 11392.4. Samples: 35357344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:39:31,356][22439] Avg episode reward: [(0, '612.423')] [2023-03-11 13:39:31,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000069096_35377152.pth... [2023-03-11 13:39:31,363][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000068424_35033088.pth [2023-03-11 13:39:32,269][22726] Updated weights for policy 0, policy_version 69120 (0.0005) [2023-03-11 13:39:35,939][22726] Updated weights for policy 0, policy_version 69200 (0.0004) [2023-03-11 13:39:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11621.5). Total num frames: 35434496. Throughput: 0: 11388.7. Samples: 35424916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:39:36,356][22439] Avg episode reward: [(0, '677.302')] [2023-03-11 13:39:39,500][22726] Updated weights for policy 0, policy_version 69280 (0.0005) [2023-03-11 13:39:41,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11400.5, 300 sec: 11621.5). Total num frames: 35491840. Throughput: 0: 11412.2. Samples: 35459080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:39:41,356][22439] Avg episode reward: [(0, '381.263')] [2023-03-11 13:39:43,176][22726] Updated weights for policy 0, policy_version 69360 (0.0004) [2023-03-11 13:39:46,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11332.3, 300 sec: 11593.8). Total num frames: 35545088. Throughput: 0: 11419.6. Samples: 35526556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:39:46,352][22439] Avg episode reward: [(0, '738.254')] [2023-03-11 13:39:46,356][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000069424_35545088.pth... [2023-03-11 13:39:46,359][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000068760_35205120.pth [2023-03-11 13:39:46,849][22726] Updated weights for policy 0, policy_version 69440 (0.0005) [2023-03-11 13:39:50,516][22726] Updated weights for policy 0, policy_version 69520 (0.0005) [2023-03-11 13:39:51,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 11579.9). Total num frames: 35602432. Throughput: 0: 11367.1. Samples: 35593644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:39:51,356][22439] Avg episode reward: [(0, '848.403')] [2023-03-11 13:39:54,336][22726] Updated weights for policy 0, policy_version 69600 (0.0004) [2023-03-11 13:39:56,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11332.3, 300 sec: 11552.1). Total num frames: 35655680. Throughput: 0: 11326.5. Samples: 35626616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:39:56,346][22439] Avg episode reward: [(0, '1093.086')] [2023-03-11 13:39:56,346][22682] Saving new best policy, reward=1093.086! [2023-03-11 13:39:58,096][22726] Updated weights for policy 0, policy_version 69680 (0.0005) [2023-03-11 13:40:01,345][22439] Fps is (10 sec: 10649.5, 60 sec: 11264.0, 300 sec: 11524.3). Total num frames: 35708928. Throughput: 0: 11256.7. Samples: 35691256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:40:01,346][22439] Avg episode reward: [(0, '743.010')] [2023-03-11 13:40:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000069744_35708928.pth... [2023-03-11 13:40:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000069096_35377152.pth [2023-03-11 13:40:01,876][22726] Updated weights for policy 0, policy_version 69760 (0.0005) [2023-03-11 13:40:05,651][22726] Updated weights for policy 0, policy_version 69840 (0.0005) [2023-03-11 13:40:06,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11195.7, 300 sec: 11496.6). Total num frames: 35762176. Throughput: 0: 11182.6. Samples: 35755432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:40:06,346][22439] Avg episode reward: [(0, '745.286')] [2023-03-11 13:40:09,327][22726] Updated weights for policy 0, policy_version 69920 (0.0005) [2023-03-11 13:40:11,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11195.7, 300 sec: 11482.7). Total num frames: 35819520. Throughput: 0: 11169.6. Samples: 35789636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:40:11,346][22439] Avg episode reward: [(0, '687.325')] [2023-03-11 13:40:12,953][22726] Updated weights for policy 0, policy_version 70000 (0.0005) [2023-03-11 13:40:16,345][22439] Fps is (10 sec: 11058.9, 60 sec: 11127.4, 300 sec: 11468.8). Total num frames: 35872768. Throughput: 0: 11089.7. Samples: 35856384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:40:16,346][22439] Avg episode reward: [(0, '819.027')] [2023-03-11 13:40:16,357][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000070072_35876864.pth... [2023-03-11 13:40:16,358][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000069424_35545088.pth [2023-03-11 13:40:16,733][22726] Updated weights for policy 0, policy_version 70080 (0.0005) [2023-03-11 13:40:20,452][22726] Updated weights for policy 0, policy_version 70160 (0.0005) [2023-03-11 13:40:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11468.8). Total num frames: 35930112. Throughput: 0: 11044.8. Samples: 35921932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:40:21,346][22439] Avg episode reward: [(0, '1096.588')] [2023-03-11 13:40:21,346][22682] Saving new best policy, reward=1096.588! [2023-03-11 13:40:23,999][22726] Updated weights for policy 0, policy_version 70240 (0.0005) [2023-03-11 13:40:26,345][22439] Fps is (10 sec: 11469.0, 60 sec: 11127.5, 300 sec: 11468.8). Total num frames: 35987456. Throughput: 0: 11045.7. Samples: 35956136. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:40:26,346][22439] Avg episode reward: [(0, '771.592')] [2023-03-11 13:40:27,549][22726] Updated weights for policy 0, policy_version 70320 (0.0005) [2023-03-11 13:40:31,276][22726] Updated weights for policy 0, policy_version 70400 (0.0004) [2023-03-11 13:40:31,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11127.5, 300 sec: 11482.7). Total num frames: 36044800. Throughput: 0: 11061.6. Samples: 36024328. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:40:31,346][22439] Avg episode reward: [(0, '912.919')] [2023-03-11 13:40:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000070400_36044800.pth... [2023-03-11 13:40:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000069744_35708928.pth [2023-03-11 13:40:34,911][22726] Updated weights for policy 0, policy_version 70480 (0.0005) [2023-03-11 13:40:36,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11059.2, 300 sec: 11468.8). Total num frames: 36098048. Throughput: 0: 11065.4. Samples: 36091588. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:40:36,346][22439] Avg episode reward: [(0, '836.151')] [2023-03-11 13:40:38,552][22726] Updated weights for policy 0, policy_version 70560 (0.0005) [2023-03-11 13:40:41,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 11482.7). Total num frames: 36155392. Throughput: 0: 11095.1. Samples: 36125896. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:40:41,346][22439] Avg episode reward: [(0, '943.535')] [2023-03-11 13:40:42,289][22726] Updated weights for policy 0, policy_version 70640 (0.0005) [2023-03-11 13:40:45,946][22726] Updated weights for policy 0, policy_version 70720 (0.0005) [2023-03-11 13:40:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11127.5, 300 sec: 11482.7). Total num frames: 36212736. Throughput: 0: 11129.0. Samples: 36192060. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:40:46,346][22439] Avg episode reward: [(0, '903.396')] [2023-03-11 13:40:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000070728_36212736.pth... [2023-03-11 13:40:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000070072_35876864.pth [2023-03-11 13:40:49,468][22726] Updated weights for policy 0, policy_version 70800 (0.0005) [2023-03-11 13:40:51,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11127.5, 300 sec: 11482.7). Total num frames: 36270080. Throughput: 0: 11221.2. Samples: 36260384. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:40:51,346][22439] Avg episode reward: [(0, '683.595')] [2023-03-11 13:40:53,116][22726] Updated weights for policy 0, policy_version 70880 (0.0005) [2023-03-11 13:40:56,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11468.8). Total num frames: 36323328. Throughput: 0: 11218.4. Samples: 36294464. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:40:56,346][22439] Avg episode reward: [(0, '1153.998')] [2023-03-11 13:40:56,346][22682] Saving new best policy, reward=1153.998! [2023-03-11 13:40:56,911][22726] Updated weights for policy 0, policy_version 70960 (0.0005) [2023-03-11 13:41:00,508][22726] Updated weights for policy 0, policy_version 71040 (0.0005) [2023-03-11 13:41:01,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11195.7, 300 sec: 11468.8). Total num frames: 36380672. Throughput: 0: 11197.2. Samples: 36360256. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:41:01,346][22439] Avg episode reward: [(0, '693.981')] [2023-03-11 13:41:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000071056_36380672.pth... [2023-03-11 13:41:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000070400_36044800.pth [2023-03-11 13:41:04,004][22726] Updated weights for policy 0, policy_version 71120 (0.0005) [2023-03-11 13:41:06,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11264.0, 300 sec: 11454.9). Total num frames: 36438016. Throughput: 0: 11287.9. Samples: 36429888. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:41:06,346][22439] Avg episode reward: [(0, '708.395')] [2023-03-11 13:41:07,576][22726] Updated weights for policy 0, policy_version 71200 (0.0005) [2023-03-11 13:41:11,227][22726] Updated weights for policy 0, policy_version 71280 (0.0005) [2023-03-11 13:41:11,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11264.0, 300 sec: 11454.9). Total num frames: 36495360. Throughput: 0: 11276.8. Samples: 36463592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:41:11,346][22439] Avg episode reward: [(0, '721.119')] [2023-03-11 13:41:14,839][22726] Updated weights for policy 0, policy_version 71360 (0.0005) [2023-03-11 13:41:16,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11441.0). Total num frames: 36552704. Throughput: 0: 11277.3. Samples: 36531808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:41:16,346][22439] Avg episode reward: [(0, '916.432')] [2023-03-11 13:41:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000071392_36552704.pth... [2023-03-11 13:41:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000070728_36212736.pth [2023-03-11 13:41:18,400][22726] Updated weights for policy 0, policy_version 71440 (0.0005) [2023-03-11 13:41:21,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11332.3, 300 sec: 11441.0). Total num frames: 36610048. Throughput: 0: 11311.2. Samples: 36600592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:41:21,346][22439] Avg episode reward: [(0, '845.140')] [2023-03-11 13:41:21,988][22726] Updated weights for policy 0, policy_version 71520 (0.0005) [2023-03-11 13:41:25,532][22726] Updated weights for policy 0, policy_version 71600 (0.0005) [2023-03-11 13:41:26,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11427.1). Total num frames: 36667392. Throughput: 0: 11306.7. Samples: 36634696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:41:26,346][22439] Avg episode reward: [(0, '707.142')] [2023-03-11 13:41:29,119][22726] Updated weights for policy 0, policy_version 71680 (0.0005) [2023-03-11 13:41:31,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11399.4). Total num frames: 36724736. Throughput: 0: 11381.3. Samples: 36704216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:41:31,346][22439] Avg episode reward: [(0, '890.298')] [2023-03-11 13:41:31,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000071728_36724736.pth... [2023-03-11 13:41:31,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000071056_36380672.pth [2023-03-11 13:41:32,756][22726] Updated weights for policy 0, policy_version 71760 (0.0005) [2023-03-11 13:41:36,239][22726] Updated weights for policy 0, policy_version 71840 (0.0005) [2023-03-11 13:41:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11385.5). Total num frames: 36782080. Throughput: 0: 11389.5. Samples: 36772912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:41:36,346][22439] Avg episode reward: [(0, '816.116')] [2023-03-11 13:41:39,855][22726] Updated weights for policy 0, policy_version 71920 (0.0005) [2023-03-11 13:41:41,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11400.5, 300 sec: 11371.6). Total num frames: 36839424. Throughput: 0: 11384.4. Samples: 36806764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:41:41,346][22439] Avg episode reward: [(0, '943.323')] [2023-03-11 13:41:43,425][22726] Updated weights for policy 0, policy_version 72000 (0.0005) [2023-03-11 13:41:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11357.7). Total num frames: 36896768. Throughput: 0: 11451.0. Samples: 36875552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:41:46,346][22439] Avg episode reward: [(0, '1051.959')] [2023-03-11 13:41:46,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000072064_36896768.pth... [2023-03-11 13:41:46,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000071392_36552704.pth [2023-03-11 13:41:47,062][22726] Updated weights for policy 0, policy_version 72080 (0.0005) [2023-03-11 13:41:50,767][22726] Updated weights for policy 0, policy_version 72160 (0.0005) [2023-03-11 13:41:51,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11332.3, 300 sec: 11316.1). Total num frames: 36950016. Throughput: 0: 11381.0. Samples: 36942032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:41:51,346][22439] Avg episode reward: [(0, '895.253')] [2023-03-11 13:41:54,479][22726] Updated weights for policy 0, policy_version 72240 (0.0005) [2023-03-11 13:41:56,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11400.5, 300 sec: 11316.1). Total num frames: 37007360. Throughput: 0: 11369.4. Samples: 36975216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:41:56,346][22439] Avg episode reward: [(0, '1221.514')] [2023-03-11 13:41:56,346][22682] Saving new best policy, reward=1221.514! [2023-03-11 13:41:58,062][22726] Updated weights for policy 0, policy_version 72320 (0.0005) [2023-03-11 13:42:01,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11332.3, 300 sec: 11302.2). Total num frames: 37060608. Throughput: 0: 11383.4. Samples: 37044060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:42:01,346][22439] Avg episode reward: [(0, '1216.463')] [2023-03-11 13:42:01,367][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000072392_37064704.pth... [2023-03-11 13:42:01,369][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000071728_36724736.pth [2023-03-11 13:42:01,734][22726] Updated weights for policy 0, policy_version 72400 (0.0005) [2023-03-11 13:42:05,524][22726] Updated weights for policy 0, policy_version 72480 (0.0005) [2023-03-11 13:42:06,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 11288.3). Total num frames: 37117952. Throughput: 0: 11299.5. Samples: 37109068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:42:06,346][22439] Avg episode reward: [(0, '964.525')] [2023-03-11 13:42:09,179][22726] Updated weights for policy 0, policy_version 72560 (0.0005) [2023-03-11 13:42:11,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11264.0, 300 sec: 11260.5). Total num frames: 37171200. Throughput: 0: 11286.6. Samples: 37142592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:42:11,346][22439] Avg episode reward: [(0, '1289.334')] [2023-03-11 13:42:11,346][22682] Saving new best policy, reward=1289.334! [2023-03-11 13:42:13,052][22726] Updated weights for policy 0, policy_version 72640 (0.0005) [2023-03-11 13:42:16,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11195.7, 300 sec: 11246.6). Total num frames: 37224448. Throughput: 0: 11177.8. Samples: 37207216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:42:16,346][22439] Avg episode reward: [(0, '1425.079')] [2023-03-11 13:42:16,388][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000072712_37228544.pth... [2023-03-11 13:42:16,390][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000072064_36896768.pth [2023-03-11 13:42:16,390][22682] Saving new best policy, reward=1425.079! [2023-03-11 13:42:16,787][22726] Updated weights for policy 0, policy_version 72720 (0.0005) [2023-03-11 13:42:20,481][22726] Updated weights for policy 0, policy_version 72800 (0.0005) [2023-03-11 13:42:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11232.8). Total num frames: 37281792. Throughput: 0: 11126.4. Samples: 37273600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:42:21,346][22439] Avg episode reward: [(0, '936.328')] [2023-03-11 13:42:24,145][22726] Updated weights for policy 0, policy_version 72880 (0.0005) [2023-03-11 13:42:26,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11195.7, 300 sec: 11246.6). Total num frames: 37339136. Throughput: 0: 11103.8. Samples: 37306432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:42:26,346][22439] Avg episode reward: [(0, '1061.982')] [2023-03-11 13:42:27,826][22726] Updated weights for policy 0, policy_version 72960 (0.0005) [2023-03-11 13:42:31,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11127.5, 300 sec: 11232.8). Total num frames: 37392384. Throughput: 0: 11062.8. Samples: 37373380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:42:31,346][22439] Avg episode reward: [(0, '975.466')] [2023-03-11 13:42:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000073032_37392384.pth... [2023-03-11 13:42:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000072392_37064704.pth [2023-03-11 13:42:31,500][22726] Updated weights for policy 0, policy_version 73040 (0.0005) [2023-03-11 13:42:35,227][22726] Updated weights for policy 0, policy_version 73120 (0.0004) [2023-03-11 13:42:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11246.6). Total num frames: 37449728. Throughput: 0: 11065.6. Samples: 37439984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:42:36,346][22439] Avg episode reward: [(0, '1028.346')] [2023-03-11 13:42:38,808][22726] Updated weights for policy 0, policy_version 73200 (0.0005) [2023-03-11 13:42:41,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11127.5, 300 sec: 11232.8). Total num frames: 37507072. Throughput: 0: 11091.1. Samples: 37474316. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:42:41,346][22439] Avg episode reward: [(0, '869.936')] [2023-03-11 13:42:42,419][22726] Updated weights for policy 0, policy_version 73280 (0.0005) [2023-03-11 13:42:46,170][22726] Updated weights for policy 0, policy_version 73360 (0.0005) [2023-03-11 13:42:46,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11059.2, 300 sec: 11232.8). Total num frames: 37560320. Throughput: 0: 11058.5. Samples: 37541692. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:42:46,346][22439] Avg episode reward: [(0, '1026.649')] [2023-03-11 13:42:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000073360_37560320.pth... [2023-03-11 13:42:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000072712_37228544.pth [2023-03-11 13:42:49,865][22726] Updated weights for policy 0, policy_version 73440 (0.0005) [2023-03-11 13:42:51,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11232.8). Total num frames: 37617664. Throughput: 0: 11077.5. Samples: 37607556. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:42:51,346][22439] Avg episode reward: [(0, '792.317')] [2023-03-11 13:42:53,315][22726] Updated weights for policy 0, policy_version 73520 (0.0004) [2023-03-11 13:42:56,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11127.5, 300 sec: 11232.8). Total num frames: 37675008. Throughput: 0: 11128.9. Samples: 37643392. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:42:56,346][22439] Avg episode reward: [(0, '916.670')] [2023-03-11 13:42:56,930][22726] Updated weights for policy 0, policy_version 73600 (0.0004) [2023-03-11 13:43:00,663][22726] Updated weights for policy 0, policy_version 73680 (0.0005) [2023-03-11 13:43:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11232.8). Total num frames: 37728256. Throughput: 0: 11185.6. Samples: 37710568. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:43:01,346][22439] Avg episode reward: [(0, '1123.294')] [2023-03-11 13:43:01,411][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000073696_37732352.pth... [2023-03-11 13:43:01,412][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000073032_37392384.pth [2023-03-11 13:43:04,396][22726] Updated weights for policy 0, policy_version 73760 (0.0005) [2023-03-11 13:43:06,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11232.8). Total num frames: 37785600. Throughput: 0: 11195.7. Samples: 37777408. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:43:06,346][22439] Avg episode reward: [(0, '674.386')] [2023-03-11 13:43:07,957][22726] Updated weights for policy 0, policy_version 73840 (0.0005) [2023-03-11 13:43:11,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11218.9). Total num frames: 37838848. Throughput: 0: 11208.4. Samples: 37810812. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:43:11,346][22439] Avg episode reward: [(0, '981.119')] [2023-03-11 13:43:11,955][22726] Updated weights for policy 0, policy_version 73920 (0.0005) [2023-03-11 13:43:15,777][22726] Updated weights for policy 0, policy_version 74000 (0.0005) [2023-03-11 13:43:16,345][22439] Fps is (10 sec: 10649.5, 60 sec: 11127.5, 300 sec: 11205.0). Total num frames: 37892096. Throughput: 0: 11112.3. Samples: 37873432. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:43:16,346][22439] Avg episode reward: [(0, '1308.521')] [2023-03-11 13:43:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000074008_37892096.pth... [2023-03-11 13:43:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000073360_37560320.pth [2023-03-11 13:43:19,540][22726] Updated weights for policy 0, policy_version 74080 (0.0005) [2023-03-11 13:43:21,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11059.2, 300 sec: 11205.0). Total num frames: 37945344. Throughput: 0: 11097.0. Samples: 37939348. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 13:43:21,346][22439] Avg episode reward: [(0, '1139.047')] [2023-03-11 13:43:23,355][22726] Updated weights for policy 0, policy_version 74160 (0.0005) [2023-03-11 13:43:26,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10990.9, 300 sec: 11191.1). Total num frames: 37998592. Throughput: 0: 11024.0. Samples: 37970396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:43:26,346][22439] Avg episode reward: [(0, '1282.012')] [2023-03-11 13:43:27,212][22726] Updated weights for policy 0, policy_version 74240 (0.0005) [2023-03-11 13:43:31,020][22726] Updated weights for policy 0, policy_version 74320 (0.0005) [2023-03-11 13:43:31,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10990.9, 300 sec: 11191.1). Total num frames: 38051840. Throughput: 0: 10958.7. Samples: 38034832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:43:31,346][22439] Avg episode reward: [(0, '910.480')] [2023-03-11 13:43:31,384][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000074328_38055936.pth... [2023-03-11 13:43:31,385][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000073696_37732352.pth [2023-03-11 13:43:34,829][22726] Updated weights for policy 0, policy_version 74400 (0.0005) [2023-03-11 13:43:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 11191.1). Total num frames: 38109184. Throughput: 0: 10948.2. Samples: 38100224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:43:36,356][22439] Avg episode reward: [(0, '1253.117')] [2023-03-11 13:43:38,263][22726] Updated weights for policy 0, policy_version 74480 (0.0005) [2023-03-11 13:43:41,345][22439] Fps is (10 sec: 11468.8, 60 sec: 10990.9, 300 sec: 11191.1). Total num frames: 38166528. Throughput: 0: 10939.5. Samples: 38135668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:43:41,356][22439] Avg episode reward: [(0, '1029.182')] [2023-03-11 13:43:41,735][22726] Updated weights for policy 0, policy_version 74560 (0.0005) [2023-03-11 13:43:45,365][22726] Updated weights for policy 0, policy_version 74640 (0.0005) [2023-03-11 13:43:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11059.2, 300 sec: 11191.1). Total num frames: 38223872. Throughput: 0: 10983.0. Samples: 38204804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:43:46,357][22439] Avg episode reward: [(0, '1374.284')] [2023-03-11 13:43:46,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000074656_38223872.pth... [2023-03-11 13:43:46,363][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000074008_37892096.pth [2023-03-11 13:43:49,018][22726] Updated weights for policy 0, policy_version 74720 (0.0005) [2023-03-11 13:43:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11059.2, 300 sec: 11205.0). Total num frames: 38281216. Throughput: 0: 11013.9. Samples: 38273032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:43:51,356][22439] Avg episode reward: [(0, '1204.795')] [2023-03-11 13:43:52,796][22726] Updated weights for policy 0, policy_version 74800 (0.0005) [2023-03-11 13:43:56,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 11191.1). Total num frames: 38334464. Throughput: 0: 10983.7. Samples: 38305080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:43:56,356][22439] Avg episode reward: [(0, '1155.595')] [2023-03-11 13:43:56,549][22726] Updated weights for policy 0, policy_version 74880 (0.0006) [2023-03-11 13:44:00,192][22726] Updated weights for policy 0, policy_version 74960 (0.0006) [2023-03-11 13:44:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 11191.1). Total num frames: 38391808. Throughput: 0: 11064.4. Samples: 38371328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:44:01,356][22439] Avg episode reward: [(0, '915.825')] [2023-03-11 13:44:01,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000074984_38391808.pth... [2023-03-11 13:44:01,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000074328_38055936.pth [2023-03-11 13:44:03,636][22726] Updated weights for policy 0, policy_version 75040 (0.0005) [2023-03-11 13:44:06,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11059.2, 300 sec: 11191.1). Total num frames: 38449152. Throughput: 0: 11146.2. Samples: 38440928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:44:06,356][22439] Avg episode reward: [(0, '1070.034')] [2023-03-11 13:44:07,212][22726] Updated weights for policy 0, policy_version 75120 (0.0005) [2023-03-11 13:44:10,722][22726] Updated weights for policy 0, policy_version 75200 (0.0005) [2023-03-11 13:44:11,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11127.5, 300 sec: 11191.1). Total num frames: 38506496. Throughput: 0: 11225.6. Samples: 38475548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:44:11,356][22439] Avg episode reward: [(0, '1125.761')] [2023-03-11 13:44:14,220][22726] Updated weights for policy 0, policy_version 75280 (0.0005) [2023-03-11 13:44:16,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 11205.0). Total num frames: 38563840. Throughput: 0: 11352.7. Samples: 38545704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:44:16,356][22439] Avg episode reward: [(0, '1395.970')] [2023-03-11 13:44:16,416][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000075328_38567936.pth... [2023-03-11 13:44:16,418][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000074656_38223872.pth [2023-03-11 13:44:17,856][22726] Updated weights for policy 0, policy_version 75360 (0.0005) [2023-03-11 13:44:21,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11191.1). Total num frames: 38621184. Throughput: 0: 11405.5. Samples: 38613472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:44:21,356][22439] Avg episode reward: [(0, '1151.738')] [2023-03-11 13:44:21,414][22726] Updated weights for policy 0, policy_version 75440 (0.0005) [2023-03-11 13:44:24,971][22726] Updated weights for policy 0, policy_version 75520 (0.0005) [2023-03-11 13:44:26,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11191.1). Total num frames: 38678528. Throughput: 0: 11397.4. Samples: 38648552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:44:26,356][22439] Avg episode reward: [(0, '1112.342')] [2023-03-11 13:44:28,368][22726] Updated weights for policy 0, policy_version 75600 (0.0005) [2023-03-11 13:44:31,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11191.1). Total num frames: 38735872. Throughput: 0: 11438.9. Samples: 38719552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:44:31,356][22439] Avg episode reward: [(0, '1116.635')] [2023-03-11 13:44:31,383][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000075664_38739968.pth... [2023-03-11 13:44:31,385][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000074984_38391808.pth [2023-03-11 13:44:32,148][22726] Updated weights for policy 0, policy_version 75680 (0.0005) [2023-03-11 13:44:35,678][22726] Updated weights for policy 0, policy_version 75760 (0.0005) [2023-03-11 13:44:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11191.1). Total num frames: 38793216. Throughput: 0: 11400.7. Samples: 38786064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:44:36,356][22439] Avg episode reward: [(0, '1031.398')] [2023-03-11 13:44:39,278][22726] Updated weights for policy 0, policy_version 75840 (0.0005) [2023-03-11 13:44:41,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 11218.9). Total num frames: 38854656. Throughput: 0: 11436.1. Samples: 38819704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:44:41,346][22439] Avg episode reward: [(0, '496.805')] [2023-03-11 13:44:42,626][22726] Updated weights for policy 0, policy_version 75920 (0.0005) [2023-03-11 13:44:46,223][22726] Updated weights for policy 0, policy_version 76000 (0.0006) [2023-03-11 13:44:46,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 11218.9). Total num frames: 38912000. Throughput: 0: 11555.4. Samples: 38891320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:44:46,346][22439] Avg episode reward: [(0, '688.737')] [2023-03-11 13:44:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000076000_38912000.pth... [2023-03-11 13:44:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000075328_38567936.pth [2023-03-11 13:44:49,725][22726] Updated weights for policy 0, policy_version 76080 (0.0005) [2023-03-11 13:44:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11232.8). Total num frames: 38969344. Throughput: 0: 11560.7. Samples: 38961160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:44:51,356][22439] Avg episode reward: [(0, '1255.320')] [2023-03-11 13:44:53,103][22726] Updated weights for policy 0, policy_version 76160 (0.0005) [2023-03-11 13:44:56,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11260.5). Total num frames: 39030784. Throughput: 0: 11610.0. Samples: 38998000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:44:56,346][22439] Avg episode reward: [(0, '1161.005')] [2023-03-11 13:44:56,652][22726] Updated weights for policy 0, policy_version 76240 (0.0005) [2023-03-11 13:45:00,101][22726] Updated weights for policy 0, policy_version 76320 (0.0005) [2023-03-11 13:45:01,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 11274.4). Total num frames: 39088128. Throughput: 0: 11600.4. Samples: 39067720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:45:01,346][22439] Avg episode reward: [(0, '1365.158')] [2023-03-11 13:45:01,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000076344_39088128.pth... [2023-03-11 13:45:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000075664_38739968.pth [2023-03-11 13:45:03,630][22726] Updated weights for policy 0, policy_version 76400 (0.0005) [2023-03-11 13:45:06,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11274.4). Total num frames: 39145472. Throughput: 0: 11640.2. Samples: 39137280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:45:06,346][22439] Avg episode reward: [(0, '1312.993')] [2023-03-11 13:45:07,258][22726] Updated weights for policy 0, policy_version 76480 (0.0005) [2023-03-11 13:45:10,771][22726] Updated weights for policy 0, policy_version 76560 (0.0005) [2023-03-11 13:45:11,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11288.3). Total num frames: 39202816. Throughput: 0: 11612.7. Samples: 39171124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:45:11,346][22439] Avg episode reward: [(0, '1428.536')] [2023-03-11 13:45:11,346][22682] Saving new best policy, reward=1428.536! [2023-03-11 13:45:14,307][22726] Updated weights for policy 0, policy_version 76640 (0.0004) [2023-03-11 13:45:16,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11288.3). Total num frames: 39260160. Throughput: 0: 11586.7. Samples: 39240956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:45:16,346][22439] Avg episode reward: [(0, '1112.199')] [2023-03-11 13:45:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000076680_39260160.pth... [2023-03-11 13:45:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000076000_38912000.pth [2023-03-11 13:45:17,849][22726] Updated weights for policy 0, policy_version 76720 (0.0004) [2023-03-11 13:45:21,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11288.3). Total num frames: 39317504. Throughput: 0: 11640.8. Samples: 39309900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:45:21,346][22439] Avg episode reward: [(0, '1234.484')] [2023-03-11 13:45:21,454][22726] Updated weights for policy 0, policy_version 76800 (0.0005) [2023-03-11 13:45:25,101][22726] Updated weights for policy 0, policy_version 76880 (0.0004) [2023-03-11 13:45:26,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11288.3). Total num frames: 39374848. Throughput: 0: 11640.9. Samples: 39343544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:45:26,346][22439] Avg episode reward: [(0, '1296.209')] [2023-03-11 13:45:28,594][22726] Updated weights for policy 0, policy_version 76960 (0.0005) [2023-03-11 13:45:31,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11302.2). Total num frames: 39432192. Throughput: 0: 11586.4. Samples: 39412708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:45:31,346][22439] Avg episode reward: [(0, '1425.110')] [2023-03-11 13:45:31,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000077016_39432192.pth... [2023-03-11 13:45:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000076344_39088128.pth [2023-03-11 13:45:32,197][22726] Updated weights for policy 0, policy_version 77040 (0.0005) [2023-03-11 13:45:35,854][22726] Updated weights for policy 0, policy_version 77120 (0.0005) [2023-03-11 13:45:36,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11302.2). Total num frames: 39489536. Throughput: 0: 11550.8. Samples: 39480944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:45:36,346][22439] Avg episode reward: [(0, '1161.611')] [2023-03-11 13:45:39,361][22726] Updated weights for policy 0, policy_version 77200 (0.0004) [2023-03-11 13:45:41,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11302.2). Total num frames: 39546880. Throughput: 0: 11507.4. Samples: 39515832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:45:41,346][22439] Avg episode reward: [(0, '1439.357')] [2023-03-11 13:45:41,346][22682] Saving new best policy, reward=1439.357! [2023-03-11 13:45:42,950][22726] Updated weights for policy 0, policy_version 77280 (0.0005) [2023-03-11 13:45:46,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11302.2). Total num frames: 39604224. Throughput: 0: 11495.9. Samples: 39585036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:45:46,346][22439] Avg episode reward: [(0, '1364.035')] [2023-03-11 13:45:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000077352_39604224.pth... [2023-03-11 13:45:46,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000076680_39260160.pth [2023-03-11 13:45:46,526][22726] Updated weights for policy 0, policy_version 77360 (0.0004) [2023-03-11 13:45:50,391][22726] Updated weights for policy 0, policy_version 77440 (0.0005) [2023-03-11 13:45:51,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11468.8, 300 sec: 11302.2). Total num frames: 39657472. Throughput: 0: 11379.4. Samples: 39649352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:45:51,346][22439] Avg episode reward: [(0, '1561.949')] [2023-03-11 13:45:51,346][22682] Saving new best policy, reward=1561.949! [2023-03-11 13:45:54,388][22726] Updated weights for policy 0, policy_version 77520 (0.0005) [2023-03-11 13:45:56,345][22439] Fps is (10 sec: 10240.1, 60 sec: 11264.0, 300 sec: 11274.4). Total num frames: 39706624. Throughput: 0: 11314.1. Samples: 39680256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:45:56,345][22439] Avg episode reward: [(0, '1601.375')] [2023-03-11 13:45:56,364][22682] Saving new best policy, reward=1601.375! [2023-03-11 13:45:58,373][22726] Updated weights for policy 0, policy_version 77600 (0.0005) [2023-03-11 13:46:01,345][22439] Fps is (10 sec: 10239.9, 60 sec: 11195.7, 300 sec: 11260.5). Total num frames: 39759872. Throughput: 0: 11138.9. Samples: 39742204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:46:01,346][22439] Avg episode reward: [(0, '1778.362')] [2023-03-11 13:46:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000077656_39759872.pth... [2023-03-11 13:46:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000077016_39432192.pth [2023-03-11 13:46:01,352][22682] Saving new best policy, reward=1778.362! [2023-03-11 13:46:02,397][22726] Updated weights for policy 0, policy_version 77680 (0.0005) [2023-03-11 13:46:06,338][22726] Updated weights for policy 0, policy_version 77760 (0.0005) [2023-03-11 13:46:06,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11127.5, 300 sec: 11246.6). Total num frames: 39813120. Throughput: 0: 10982.3. Samples: 39804104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:46:06,346][22439] Avg episode reward: [(0, '1232.372')] [2023-03-11 13:46:10,247][22726] Updated weights for policy 0, policy_version 77840 (0.0005) [2023-03-11 13:46:11,345][22439] Fps is (10 sec: 10240.1, 60 sec: 10990.9, 300 sec: 11218.9). Total num frames: 39862272. Throughput: 0: 10941.1. Samples: 39835892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:46:11,346][22439] Avg episode reward: [(0, '1326.208')] [2023-03-11 13:46:14,223][22726] Updated weights for policy 0, policy_version 77920 (0.0005) [2023-03-11 13:46:16,345][22439] Fps is (10 sec: 10239.9, 60 sec: 10922.7, 300 sec: 11205.0). Total num frames: 39915520. Throughput: 0: 10768.0. Samples: 39897268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:46:16,346][22439] Avg episode reward: [(0, '1404.492')] [2023-03-11 13:46:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000077960_39915520.pth... [2023-03-11 13:46:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000077352_39604224.pth [2023-03-11 13:46:18,061][22726] Updated weights for policy 0, policy_version 78000 (0.0005) [2023-03-11 13:46:21,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10854.4, 300 sec: 11191.1). Total num frames: 39968768. Throughput: 0: 10663.0. Samples: 39960780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:46:21,346][22439] Avg episode reward: [(0, '1288.071')] [2023-03-11 13:46:21,741][22726] Updated weights for policy 0, policy_version 78080 (0.0005) [2023-03-11 13:46:25,555][22726] Updated weights for policy 0, policy_version 78160 (0.0004) [2023-03-11 13:46:26,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10854.4, 300 sec: 11191.1). Total num frames: 40026112. Throughput: 0: 10673.0. Samples: 39996116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:46:26,346][22439] Avg episode reward: [(0, '1061.483')] [2023-03-11 13:46:29,046][22726] Updated weights for policy 0, policy_version 78240 (0.0004) [2023-03-11 13:46:31,345][22439] Fps is (10 sec: 11468.7, 60 sec: 10854.4, 300 sec: 11191.1). Total num frames: 40083456. Throughput: 0: 10622.3. Samples: 40063040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:46:31,346][22439] Avg episode reward: [(0, '1308.521')] [2023-03-11 13:46:31,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000078288_40083456.pth... [2023-03-11 13:46:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000077656_39759872.pth [2023-03-11 13:46:32,751][22726] Updated weights for policy 0, policy_version 78320 (0.0005) [2023-03-11 13:46:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10786.1, 300 sec: 11177.2). Total num frames: 40136704. Throughput: 0: 10649.4. Samples: 40128576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:46:36,346][22439] Avg episode reward: [(0, '1398.989')] [2023-03-11 13:46:36,638][22726] Updated weights for policy 0, policy_version 78400 (0.0005) [2023-03-11 13:46:40,420][22726] Updated weights for policy 0, policy_version 78480 (0.0005) [2023-03-11 13:46:41,345][22439] Fps is (10 sec: 10649.7, 60 sec: 10717.9, 300 sec: 11163.3). Total num frames: 40189952. Throughput: 0: 10651.3. Samples: 40159564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:46:41,346][22439] Avg episode reward: [(0, '1305.249')] [2023-03-11 13:46:44,303][22726] Updated weights for policy 0, policy_version 78560 (0.0005) [2023-03-11 13:46:46,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10649.6, 300 sec: 11163.3). Total num frames: 40243200. Throughput: 0: 10705.4. Samples: 40223948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:46:46,346][22439] Avg episode reward: [(0, '1266.278')] [2023-03-11 13:46:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000078600_40243200.pth... [2023-03-11 13:46:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000077960_39915520.pth [2023-03-11 13:46:48,167][22726] Updated weights for policy 0, policy_version 78640 (0.0005) [2023-03-11 13:46:51,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10581.3, 300 sec: 11135.6). Total num frames: 40292352. Throughput: 0: 10751.3. Samples: 40287912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:46:51,346][22439] Avg episode reward: [(0, '1320.681')] [2023-03-11 13:46:52,219][22726] Updated weights for policy 0, policy_version 78720 (0.0005) [2023-03-11 13:46:56,149][22726] Updated weights for policy 0, policy_version 78800 (0.0005) [2023-03-11 13:46:56,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10649.6, 300 sec: 11135.6). Total num frames: 40345600. Throughput: 0: 10691.1. Samples: 40316992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:46:56,346][22439] Avg episode reward: [(0, '1420.912')] [2023-03-11 13:47:00,031][22726] Updated weights for policy 0, policy_version 78880 (0.0005) [2023-03-11 13:47:01,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10649.6, 300 sec: 11121.7). Total num frames: 40398848. Throughput: 0: 10727.9. Samples: 40380024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:47:01,356][22439] Avg episode reward: [(0, '1398.070')] [2023-03-11 13:47:01,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000078904_40398848.pth... [2023-03-11 13:47:01,363][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000078288_40083456.pth [2023-03-11 13:47:03,961][22726] Updated weights for policy 0, policy_version 78960 (0.0005) [2023-03-11 13:47:06,345][22439] Fps is (10 sec: 10649.7, 60 sec: 10649.6, 300 sec: 11121.7). Total num frames: 40452096. Throughput: 0: 10735.5. Samples: 40443876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:47:06,346][22439] Avg episode reward: [(0, '1115.651')] [2023-03-11 13:47:07,792][22726] Updated weights for policy 0, policy_version 79040 (0.0005) [2023-03-11 13:47:11,345][22439] Fps is (10 sec: 10239.9, 60 sec: 10649.6, 300 sec: 11107.8). Total num frames: 40501248. Throughput: 0: 10654.3. Samples: 40475560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:47:11,346][22439] Avg episode reward: [(0, '1275.370')] [2023-03-11 13:47:11,728][22726] Updated weights for policy 0, policy_version 79120 (0.0005) [2023-03-11 13:47:15,558][22726] Updated weights for policy 0, policy_version 79200 (0.0005) [2023-03-11 13:47:16,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10717.9, 300 sec: 11107.8). Total num frames: 40558592. Throughput: 0: 10562.0. Samples: 40538328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:47:16,346][22439] Avg episode reward: [(0, '1128.533')] [2023-03-11 13:47:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000079216_40558592.pth... [2023-03-11 13:47:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000078600_40243200.pth [2023-03-11 13:47:19,368][22726] Updated weights for policy 0, policy_version 79280 (0.0005) [2023-03-11 13:47:21,345][22439] Fps is (10 sec: 11059.3, 60 sec: 10717.9, 300 sec: 11093.9). Total num frames: 40611840. Throughput: 0: 10553.2. Samples: 40603468. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:47:21,346][22439] Avg episode reward: [(0, '1397.141')] [2023-03-11 13:47:23,167][22726] Updated weights for policy 0, policy_version 79360 (0.0005) [2023-03-11 13:47:26,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10649.6, 300 sec: 11093.9). Total num frames: 40665088. Throughput: 0: 10578.7. Samples: 40635604. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:47:26,346][22439] Avg episode reward: [(0, '1244.427')] [2023-03-11 13:47:27,049][22726] Updated weights for policy 0, policy_version 79440 (0.0005) [2023-03-11 13:47:30,849][22726] Updated weights for policy 0, policy_version 79520 (0.0005) [2023-03-11 13:47:31,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10581.3, 300 sec: 11080.0). Total num frames: 40718336. Throughput: 0: 10559.2. Samples: 40699112. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:47:31,346][22439] Avg episode reward: [(0, '1115.215')] [2023-03-11 13:47:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000079528_40718336.pth... [2023-03-11 13:47:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000078904_40398848.pth [2023-03-11 13:47:34,834][22726] Updated weights for policy 0, policy_version 79600 (0.0005) [2023-03-11 13:47:36,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10513.1, 300 sec: 11052.3). Total num frames: 40767488. Throughput: 0: 10535.3. Samples: 40762000. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:47:36,346][22439] Avg episode reward: [(0, '1192.512')] [2023-03-11 13:47:38,676][22726] Updated weights for policy 0, policy_version 79680 (0.0005) [2023-03-11 13:47:41,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10513.1, 300 sec: 11052.3). Total num frames: 40820736. Throughput: 0: 10586.8. Samples: 40793396. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:47:41,346][22439] Avg episode reward: [(0, '1235.116')] [2023-03-11 13:47:42,659][22726] Updated weights for policy 0, policy_version 79760 (0.0005) [2023-03-11 13:47:46,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10513.1, 300 sec: 11038.4). Total num frames: 40873984. Throughput: 0: 10578.0. Samples: 40856036. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:47:46,346][22439] Avg episode reward: [(0, '1167.313')] [2023-03-11 13:47:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000079832_40873984.pth... [2023-03-11 13:47:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000079216_40558592.pth [2023-03-11 13:47:46,456][22726] Updated weights for policy 0, policy_version 79840 (0.0005) [2023-03-11 13:47:50,438][22726] Updated weights for policy 0, policy_version 79920 (0.0005) [2023-03-11 13:47:51,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10581.3, 300 sec: 11024.5). Total num frames: 40927232. Throughput: 0: 10559.5. Samples: 40919056. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:47:51,346][22439] Avg episode reward: [(0, '1111.938')] [2023-03-11 13:47:54,333][22726] Updated weights for policy 0, policy_version 80000 (0.0005) [2023-03-11 13:47:56,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10513.1, 300 sec: 11010.6). Total num frames: 40976384. Throughput: 0: 10567.5. Samples: 40951096. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:47:56,346][22439] Avg episode reward: [(0, '1202.917')] [2023-03-11 13:47:58,415][22726] Updated weights for policy 0, policy_version 80080 (0.0005) [2023-03-11 13:48:01,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10513.1, 300 sec: 10996.7). Total num frames: 41029632. Throughput: 0: 10517.8. Samples: 41011628. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:48:01,346][22439] Avg episode reward: [(0, '1192.260')] [2023-03-11 13:48:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000080136_41029632.pth... [2023-03-11 13:48:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000079528_40718336.pth [2023-03-11 13:48:02,371][22726] Updated weights for policy 0, policy_version 80160 (0.0004) [2023-03-11 13:48:06,272][22726] Updated weights for policy 0, policy_version 80240 (0.0005) [2023-03-11 13:48:06,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10513.0, 300 sec: 10996.7). Total num frames: 41082880. Throughput: 0: 10471.5. Samples: 41074688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:48:06,346][22439] Avg episode reward: [(0, '1048.399')] [2023-03-11 13:48:10,240][22726] Updated weights for policy 0, policy_version 80320 (0.0005) [2023-03-11 13:48:11,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10513.1, 300 sec: 10982.8). Total num frames: 41132032. Throughput: 0: 10431.5. Samples: 41105020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:48:11,346][22439] Avg episode reward: [(0, '1438.262')] [2023-03-11 13:48:14,027][22726] Updated weights for policy 0, policy_version 80400 (0.0005) [2023-03-11 13:48:16,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10513.1, 300 sec: 10996.7). Total num frames: 41189376. Throughput: 0: 10441.2. Samples: 41168968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:48:16,346][22439] Avg episode reward: [(0, '1127.057')] [2023-03-11 13:48:16,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000080448_41189376.pth... [2023-03-11 13:48:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000079832_40873984.pth [2023-03-11 13:48:17,523][22726] Updated weights for policy 0, policy_version 80480 (0.0004) [2023-03-11 13:48:21,235][22726] Updated weights for policy 0, policy_version 80560 (0.0005) [2023-03-11 13:48:21,345][22439] Fps is (10 sec: 11468.8, 60 sec: 10581.3, 300 sec: 11010.6). Total num frames: 41246720. Throughput: 0: 10589.7. Samples: 41238536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:48:21,346][22439] Avg episode reward: [(0, '1061.063')] [2023-03-11 13:48:24,828][22726] Updated weights for policy 0, policy_version 80640 (0.0004) [2023-03-11 13:48:26,345][22439] Fps is (10 sec: 11468.9, 60 sec: 10649.6, 300 sec: 11024.5). Total num frames: 41304064. Throughput: 0: 10620.0. Samples: 41271296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:48:26,346][22439] Avg episode reward: [(0, '1562.890')] [2023-03-11 13:48:28,497][22726] Updated weights for policy 0, policy_version 80720 (0.0005) [2023-03-11 13:48:31,345][22439] Fps is (10 sec: 11059.1, 60 sec: 10649.6, 300 sec: 11010.6). Total num frames: 41357312. Throughput: 0: 10732.8. Samples: 41339012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:48:31,346][22439] Avg episode reward: [(0, '1426.518')] [2023-03-11 13:48:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000080776_41357312.pth... [2023-03-11 13:48:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000080136_41029632.pth [2023-03-11 13:48:32,188][22726] Updated weights for policy 0, policy_version 80800 (0.0004) [2023-03-11 13:48:35,838][22726] Updated weights for policy 0, policy_version 80880 (0.0005) [2023-03-11 13:48:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10786.1, 300 sec: 11010.6). Total num frames: 41414656. Throughput: 0: 10828.8. Samples: 41406352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:48:36,346][22439] Avg episode reward: [(0, '1456.526')] [2023-03-11 13:48:39,587][22726] Updated weights for policy 0, policy_version 80960 (0.0005) [2023-03-11 13:48:41,345][22439] Fps is (10 sec: 11059.3, 60 sec: 10786.1, 300 sec: 10996.7). Total num frames: 41467904. Throughput: 0: 10846.2. Samples: 41439176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:48:41,356][22439] Avg episode reward: [(0, '1568.733')] [2023-03-11 13:48:43,262][22726] Updated weights for policy 0, policy_version 81040 (0.0005) [2023-03-11 13:48:46,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10854.4, 300 sec: 10996.7). Total num frames: 41525248. Throughput: 0: 10966.8. Samples: 41505136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:48:46,356][22439] Avg episode reward: [(0, '1050.443')] [2023-03-11 13:48:46,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000081104_41525248.pth... [2023-03-11 13:48:46,363][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000080448_41189376.pth [2023-03-11 13:48:46,921][22726] Updated weights for policy 0, policy_version 81120 (0.0005) [2023-03-11 13:48:50,427][22726] Updated weights for policy 0, policy_version 81200 (0.0005) [2023-03-11 13:48:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 10922.7, 300 sec: 11010.6). Total num frames: 41582592. Throughput: 0: 11105.1. Samples: 41574416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:48:51,356][22439] Avg episode reward: [(0, '1222.938')] [2023-03-11 13:48:53,943][22726] Updated weights for policy 0, policy_version 81280 (0.0005) [2023-03-11 13:48:56,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11059.2, 300 sec: 11010.6). Total num frames: 41639936. Throughput: 0: 11200.5. Samples: 41609040. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:48:56,346][22439] Avg episode reward: [(0, '1314.180')] [2023-03-11 13:48:57,535][22726] Updated weights for policy 0, policy_version 81360 (0.0005) [2023-03-11 13:49:01,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11059.2, 300 sec: 10996.7). Total num frames: 41693184. Throughput: 0: 11286.8. Samples: 41676872. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:49:01,346][22439] Avg episode reward: [(0, '1220.025')] [2023-03-11 13:49:01,370][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000081440_41697280.pth... [2023-03-11 13:49:01,370][22726] Updated weights for policy 0, policy_version 81440 (0.0006) [2023-03-11 13:49:01,372][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000080776_41357312.pth [2023-03-11 13:49:05,232][22726] Updated weights for policy 0, policy_version 81520 (0.0005) [2023-03-11 13:49:06,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11059.2, 300 sec: 10982.8). Total num frames: 41746432. Throughput: 0: 11151.8. Samples: 41740368. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:49:06,356][22439] Avg episode reward: [(0, '1241.927')] [2023-03-11 13:49:09,179][22726] Updated weights for policy 0, policy_version 81600 (0.0006) [2023-03-11 13:49:11,345][22439] Fps is (10 sec: 10649.7, 60 sec: 11127.5, 300 sec: 10969.0). Total num frames: 41799680. Throughput: 0: 11109.1. Samples: 41771204. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:49:11,356][22439] Avg episode reward: [(0, '1415.815')] [2023-03-11 13:49:13,159][22726] Updated weights for policy 0, policy_version 81680 (0.0005) [2023-03-11 13:49:16,345][22439] Fps is (10 sec: 10649.5, 60 sec: 11059.2, 300 sec: 10955.1). Total num frames: 41852928. Throughput: 0: 10971.7. Samples: 41832740. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:49:16,357][22439] Avg episode reward: [(0, '1555.403')] [2023-03-11 13:49:16,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000081744_41852928.pth... [2023-03-11 13:49:16,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000081104_41525248.pth [2023-03-11 13:49:16,971][22726] Updated weights for policy 0, policy_version 81760 (0.0005) [2023-03-11 13:49:20,637][22726] Updated weights for policy 0, policy_version 81840 (0.0005) [2023-03-11 13:49:21,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10990.9, 300 sec: 10941.2). Total num frames: 41906176. Throughput: 0: 10961.5. Samples: 41899620. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:49:21,356][22439] Avg episode reward: [(0, '1796.615')] [2023-03-11 13:49:21,357][22682] Saving new best policy, reward=1796.615! [2023-03-11 13:49:24,388][22726] Updated weights for policy 0, policy_version 81920 (0.0005) [2023-03-11 13:49:26,345][22439] Fps is (10 sec: 11059.3, 60 sec: 10990.9, 300 sec: 10941.2). Total num frames: 41963520. Throughput: 0: 10956.9. Samples: 41932236. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:49:26,346][22439] Avg episode reward: [(0, '1822.273')] [2023-03-11 13:49:26,346][22682] Saving new best policy, reward=1822.273! [2023-03-11 13:49:28,042][22726] Updated weights for policy 0, policy_version 82000 (0.0005) [2023-03-11 13:49:31,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 10927.3). Total num frames: 42016768. Throughput: 0: 10990.3. Samples: 41999700. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:49:31,346][22439] Avg episode reward: [(0, '1592.340')] [2023-03-11 13:49:31,362][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000082072_42020864.pth... [2023-03-11 13:49:31,363][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000081440_41697280.pth [2023-03-11 13:49:31,757][22726] Updated weights for policy 0, policy_version 82080 (0.0005) [2023-03-11 13:49:35,526][22726] Updated weights for policy 0, policy_version 82160 (0.0005) [2023-03-11 13:49:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 10913.4). Total num frames: 42074112. Throughput: 0: 10904.9. Samples: 42065136. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:49:36,346][22439] Avg episode reward: [(0, '1504.868')] [2023-03-11 13:49:39,070][22726] Updated weights for policy 0, policy_version 82240 (0.0005) [2023-03-11 13:49:41,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11059.2, 300 sec: 10913.4). Total num frames: 42131456. Throughput: 0: 10896.8. Samples: 42099396. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:49:41,346][22439] Avg episode reward: [(0, '1470.952')] [2023-03-11 13:49:42,657][22726] Updated weights for policy 0, policy_version 82320 (0.0005) [2023-03-11 13:49:46,325][22726] Updated weights for policy 0, policy_version 82400 (0.0005) [2023-03-11 13:49:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11059.2, 300 sec: 10913.4). Total num frames: 42188800. Throughput: 0: 10910.4. Samples: 42167840. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:49:46,346][22439] Avg episode reward: [(0, '1426.569')] [2023-03-11 13:49:46,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000082400_42188800.pth... [2023-03-11 13:49:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000081744_41852928.pth [2023-03-11 13:49:49,855][22726] Updated weights for policy 0, policy_version 82480 (0.0005) [2023-03-11 13:49:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11059.2, 300 sec: 10899.5). Total num frames: 42246144. Throughput: 0: 11015.9. Samples: 42236084. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:49:51,346][22439] Avg episode reward: [(0, '1311.048')] [2023-03-11 13:49:53,497][22726] Updated weights for policy 0, policy_version 82560 (0.0005) [2023-03-11 13:49:56,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 10885.6). Total num frames: 42299392. Throughput: 0: 11092.3. Samples: 42270356. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:49:56,346][22439] Avg episode reward: [(0, '1392.701')] [2023-03-11 13:49:57,176][22726] Updated weights for policy 0, policy_version 82640 (0.0005) [2023-03-11 13:50:00,908][22726] Updated weights for policy 0, policy_version 82720 (0.0005) [2023-03-11 13:50:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 10885.6). Total num frames: 42356736. Throughput: 0: 11190.7. Samples: 42336320. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:50:01,346][22439] Avg episode reward: [(0, '1554.575')] [2023-03-11 13:50:01,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000082728_42356736.pth... [2023-03-11 13:50:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000082072_42020864.pth [2023-03-11 13:50:04,867][22726] Updated weights for policy 0, policy_version 82800 (0.0005) [2023-03-11 13:50:06,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10990.9, 300 sec: 10857.9). Total num frames: 42405888. Throughput: 0: 11115.0. Samples: 42399796. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:50:06,346][22439] Avg episode reward: [(0, '1399.257')] [2023-03-11 13:50:08,727][22726] Updated weights for policy 0, policy_version 82880 (0.0005) [2023-03-11 13:50:11,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10990.9, 300 sec: 10844.0). Total num frames: 42459136. Throughput: 0: 11085.4. Samples: 42431080. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:50:11,346][22439] Avg episode reward: [(0, '1205.570')] [2023-03-11 13:50:12,697][22726] Updated weights for policy 0, policy_version 82960 (0.0006) [2023-03-11 13:50:16,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10990.9, 300 sec: 10830.1). Total num frames: 42512384. Throughput: 0: 10985.9. Samples: 42494064. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:50:16,346][22439] Avg episode reward: [(0, '1445.255')] [2023-03-11 13:50:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000083032_42512384.pth... [2023-03-11 13:50:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000082400_42188800.pth [2023-03-11 13:50:16,558][22726] Updated weights for policy 0, policy_version 83040 (0.0005) [2023-03-11 13:50:20,539][22726] Updated weights for policy 0, policy_version 83120 (0.0005) [2023-03-11 13:50:21,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10990.9, 300 sec: 10816.2). Total num frames: 42565632. Throughput: 0: 10918.7. Samples: 42556476. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:50:21,346][22439] Avg episode reward: [(0, '1702.926')] [2023-03-11 13:50:24,441][22726] Updated weights for policy 0, policy_version 83200 (0.0005) [2023-03-11 13:50:26,345][22439] Fps is (10 sec: 10240.1, 60 sec: 10854.4, 300 sec: 10788.5). Total num frames: 42614784. Throughput: 0: 10859.7. Samples: 42588080. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:50:26,346][22439] Avg episode reward: [(0, '1244.254')] [2023-03-11 13:50:28,232][22726] Updated weights for policy 0, policy_version 83280 (0.0004) [2023-03-11 13:50:31,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10922.7, 300 sec: 10788.4). Total num frames: 42672128. Throughput: 0: 10770.9. Samples: 42652532. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 13:50:31,346][22439] Avg episode reward: [(0, '1265.051')] [2023-03-11 13:50:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000083344_42672128.pth... [2023-03-11 13:50:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000082728_42356736.pth [2023-03-11 13:50:31,799][22726] Updated weights for policy 0, policy_version 83360 (0.0005) [2023-03-11 13:50:35,409][22726] Updated weights for policy 0, policy_version 83440 (0.0004) [2023-03-11 13:50:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 10922.7, 300 sec: 10788.4). Total num frames: 42729472. Throughput: 0: 10783.6. Samples: 42721344. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:50:36,346][22439] Avg episode reward: [(0, '1409.612')] [2023-03-11 13:50:39,126][22726] Updated weights for policy 0, policy_version 83520 (0.0005) [2023-03-11 13:50:41,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10854.4, 300 sec: 10774.6). Total num frames: 42782720. Throughput: 0: 10750.1. Samples: 42754112. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:50:41,346][22439] Avg episode reward: [(0, '1495.914')] [2023-03-11 13:50:42,842][22726] Updated weights for policy 0, policy_version 83600 (0.0005) [2023-03-11 13:50:46,345][22439] Fps is (10 sec: 11059.1, 60 sec: 10854.4, 300 sec: 10788.4). Total num frames: 42840064. Throughput: 0: 10753.4. Samples: 42820224. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:50:46,346][22439] Avg episode reward: [(0, '1351.912')] [2023-03-11 13:50:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000083672_42840064.pth... [2023-03-11 13:50:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000083032_42512384.pth [2023-03-11 13:50:46,564][22726] Updated weights for policy 0, policy_version 83680 (0.0005) [2023-03-11 13:50:50,181][22726] Updated weights for policy 0, policy_version 83760 (0.0005) [2023-03-11 13:50:51,345][22439] Fps is (10 sec: 11468.9, 60 sec: 10854.4, 300 sec: 10816.2). Total num frames: 42897408. Throughput: 0: 10847.7. Samples: 42887940. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:50:51,346][22439] Avg episode reward: [(0, '1356.670')] [2023-03-11 13:50:53,813][22726] Updated weights for policy 0, policy_version 83840 (0.0005) [2023-03-11 13:50:56,345][22439] Fps is (10 sec: 11059.3, 60 sec: 10854.4, 300 sec: 10816.2). Total num frames: 42950656. Throughput: 0: 10906.2. Samples: 42921860. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:50:56,346][22439] Avg episode reward: [(0, '1780.243')] [2023-03-11 13:50:57,700][22726] Updated weights for policy 0, policy_version 83920 (0.0005) [2023-03-11 13:51:01,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10786.1, 300 sec: 10816.2). Total num frames: 43003904. Throughput: 0: 10908.7. Samples: 42984956. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:51:01,346][22439] Avg episode reward: [(0, '1498.277')] [2023-03-11 13:51:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000083992_43003904.pth... [2023-03-11 13:51:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000083344_42672128.pth [2023-03-11 13:51:01,631][22726] Updated weights for policy 0, policy_version 84000 (0.0006) [2023-03-11 13:51:05,532][22726] Updated weights for policy 0, policy_version 84080 (0.0006) [2023-03-11 13:51:06,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10854.4, 300 sec: 10830.1). Total num frames: 43057152. Throughput: 0: 10924.8. Samples: 43048092. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:51:06,346][22439] Avg episode reward: [(0, '1542.526')] [2023-03-11 13:51:09,325][22726] Updated weights for policy 0, policy_version 84160 (0.0005) [2023-03-11 13:51:11,345][22439] Fps is (10 sec: 10649.7, 60 sec: 10854.4, 300 sec: 10830.1). Total num frames: 43110400. Throughput: 0: 10954.0. Samples: 43081012. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:51:11,346][22439] Avg episode reward: [(0, '1659.746')] [2023-03-11 13:51:13,191][22726] Updated weights for policy 0, policy_version 84240 (0.0005) [2023-03-11 13:51:16,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10854.4, 300 sec: 10830.1). Total num frames: 43163648. Throughput: 0: 10932.1. Samples: 43144476. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:51:16,346][22439] Avg episode reward: [(0, '1308.528')] [2023-03-11 13:51:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000084304_43163648.pth... [2023-03-11 13:51:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000083672_42840064.pth [2023-03-11 13:51:16,909][22726] Updated weights for policy 0, policy_version 84320 (0.0005) [2023-03-11 13:51:20,720][22726] Updated weights for policy 0, policy_version 84400 (0.0005) [2023-03-11 13:51:21,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10854.4, 300 sec: 10816.2). Total num frames: 43216896. Throughput: 0: 10840.0. Samples: 43209144. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:51:21,346][22439] Avg episode reward: [(0, '1220.301')] [2023-03-11 13:51:24,672][22726] Updated weights for policy 0, policy_version 84480 (0.0005) [2023-03-11 13:51:26,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10922.7, 300 sec: 10802.3). Total num frames: 43270144. Throughput: 0: 10801.8. Samples: 43240192. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:51:26,346][22439] Avg episode reward: [(0, '1402.851')] [2023-03-11 13:51:28,445][22726] Updated weights for policy 0, policy_version 84560 (0.0005) [2023-03-11 13:51:31,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10854.4, 300 sec: 10802.3). Total num frames: 43323392. Throughput: 0: 10787.0. Samples: 43305640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:51:31,346][22439] Avg episode reward: [(0, '958.200')] [2023-03-11 13:51:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000084616_43323392.pth... [2023-03-11 13:51:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000083992_43003904.pth [2023-03-11 13:51:32,227][22726] Updated weights for policy 0, policy_version 84640 (0.0005) [2023-03-11 13:51:36,088][22726] Updated weights for policy 0, policy_version 84720 (0.0006) [2023-03-11 13:51:36,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10786.1, 300 sec: 10802.3). Total num frames: 43376640. Throughput: 0: 10690.3. Samples: 43369004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:51:36,346][22439] Avg episode reward: [(0, '1137.530')] [2023-03-11 13:51:39,764][22726] Updated weights for policy 0, policy_version 84800 (0.0004) [2023-03-11 13:51:41,345][22439] Fps is (10 sec: 11059.3, 60 sec: 10854.4, 300 sec: 10816.2). Total num frames: 43433984. Throughput: 0: 10712.8. Samples: 43403936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:51:41,346][22439] Avg episode reward: [(0, '981.160')] [2023-03-11 13:51:43,591][22726] Updated weights for policy 0, policy_version 84880 (0.0005) [2023-03-11 13:51:46,345][22439] Fps is (10 sec: 11059.1, 60 sec: 10786.1, 300 sec: 10830.1). Total num frames: 43487232. Throughput: 0: 10724.9. Samples: 43467576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:51:46,346][22439] Avg episode reward: [(0, '1471.018')] [2023-03-11 13:51:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000084936_43487232.pth... [2023-03-11 13:51:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000084304_43163648.pth [2023-03-11 13:51:47,456][22726] Updated weights for policy 0, policy_version 84960 (0.0005) [2023-03-11 13:51:51,312][22726] Updated weights for policy 0, policy_version 85040 (0.0005) [2023-03-11 13:51:51,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10717.9, 300 sec: 10830.1). Total num frames: 43540480. Throughput: 0: 10744.0. Samples: 43531572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:51:51,346][22439] Avg episode reward: [(0, '1214.885')] [2023-03-11 13:51:55,127][22726] Updated weights for policy 0, policy_version 85120 (0.0005) [2023-03-11 13:51:56,345][22439] Fps is (10 sec: 10649.7, 60 sec: 10717.9, 300 sec: 10830.1). Total num frames: 43593728. Throughput: 0: 10728.4. Samples: 43563788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:51:56,346][22439] Avg episode reward: [(0, '1038.336')] [2023-03-11 13:51:58,947][22726] Updated weights for policy 0, policy_version 85200 (0.0005) [2023-03-11 13:52:01,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10717.9, 300 sec: 10830.1). Total num frames: 43646976. Throughput: 0: 10733.3. Samples: 43627476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:52:01,346][22439] Avg episode reward: [(0, '1141.342')] [2023-03-11 13:52:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000085248_43646976.pth... [2023-03-11 13:52:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000084616_43323392.pth [2023-03-11 13:52:02,748][22726] Updated weights for policy 0, policy_version 85280 (0.0005) [2023-03-11 13:52:06,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10717.9, 300 sec: 10844.0). Total num frames: 43700224. Throughput: 0: 10732.3. Samples: 43692096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:52:06,346][22439] Avg episode reward: [(0, '1116.590')] [2023-03-11 13:52:06,616][22726] Updated weights for policy 0, policy_version 85360 (0.0005) [2023-03-11 13:52:10,547][22726] Updated weights for policy 0, policy_version 85440 (0.0005) [2023-03-11 13:52:11,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10717.9, 300 sec: 10830.1). Total num frames: 43753472. Throughput: 0: 10745.0. Samples: 43723716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:52:11,346][22439] Avg episode reward: [(0, '1302.113')] [2023-03-11 13:52:14,509][22726] Updated weights for policy 0, policy_version 85520 (0.0005) [2023-03-11 13:52:16,345][22439] Fps is (10 sec: 10239.9, 60 sec: 10649.6, 300 sec: 10816.2). Total num frames: 43802624. Throughput: 0: 10675.1. Samples: 43786020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:52:16,346][22439] Avg episode reward: [(0, '1423.162')] [2023-03-11 13:52:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000085552_43802624.pth... [2023-03-11 13:52:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000084936_43487232.pth [2023-03-11 13:52:18,380][22726] Updated weights for policy 0, policy_version 85600 (0.0005) [2023-03-11 13:52:21,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10649.6, 300 sec: 10816.2). Total num frames: 43855872. Throughput: 0: 10640.4. Samples: 43847824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:52:21,346][22439] Avg episode reward: [(0, '1224.749')] [2023-03-11 13:52:22,354][22726] Updated weights for policy 0, policy_version 85680 (0.0005) [2023-03-11 13:52:26,022][22726] Updated weights for policy 0, policy_version 85760 (0.0005) [2023-03-11 13:52:26,345][22439] Fps is (10 sec: 10649.7, 60 sec: 10649.6, 300 sec: 10816.2). Total num frames: 43909120. Throughput: 0: 10589.1. Samples: 43880448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:52:26,346][22439] Avg episode reward: [(0, '1571.971')] [2023-03-11 13:52:29,459][22726] Updated weights for policy 0, policy_version 85840 (0.0004) [2023-03-11 13:52:31,345][22439] Fps is (10 sec: 11468.8, 60 sec: 10786.1, 300 sec: 10857.9). Total num frames: 43970560. Throughput: 0: 10716.2. Samples: 43949804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:52:31,346][22439] Avg episode reward: [(0, '1113.497')] [2023-03-11 13:52:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000085880_43970560.pth... [2023-03-11 13:52:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000085248_43646976.pth [2023-03-11 13:52:33,007][22726] Updated weights for policy 0, policy_version 85920 (0.0005) [2023-03-11 13:52:36,345][22439] Fps is (10 sec: 11878.5, 60 sec: 10854.4, 300 sec: 10871.8). Total num frames: 44027904. Throughput: 0: 10819.2. Samples: 44018436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:52:36,346][22439] Avg episode reward: [(0, '1333.574')] [2023-03-11 13:52:36,659][22726] Updated weights for policy 0, policy_version 86000 (0.0005) [2023-03-11 13:52:40,360][22726] Updated weights for policy 0, policy_version 86080 (0.0005) [2023-03-11 13:52:41,345][22439] Fps is (10 sec: 11059.3, 60 sec: 10786.1, 300 sec: 10871.8). Total num frames: 44081152. Throughput: 0: 10859.8. Samples: 44052480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:52:41,346][22439] Avg episode reward: [(0, '1556.552')] [2023-03-11 13:52:44,075][22726] Updated weights for policy 0, policy_version 86160 (0.0005) [2023-03-11 13:52:46,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10786.1, 300 sec: 10871.8). Total num frames: 44134400. Throughput: 0: 10901.2. Samples: 44118028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:52:46,346][22439] Avg episode reward: [(0, '1172.596')] [2023-03-11 13:52:46,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000086208_44138496.pth... [2023-03-11 13:52:46,361][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000085552_43802624.pth [2023-03-11 13:52:47,928][22726] Updated weights for policy 0, policy_version 86240 (0.0005) [2023-03-11 13:52:51,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10786.1, 300 sec: 10885.6). Total num frames: 44187648. Throughput: 0: 10871.1. Samples: 44181296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:52:51,346][22439] Avg episode reward: [(0, '1320.307')] [2023-03-11 13:52:51,809][22726] Updated weights for policy 0, policy_version 86320 (0.0005) [2023-03-11 13:52:55,658][22726] Updated weights for policy 0, policy_version 86400 (0.0005) [2023-03-11 13:52:56,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10786.1, 300 sec: 10885.6). Total num frames: 44240896. Throughput: 0: 10870.7. Samples: 44212896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:52:56,346][22439] Avg episode reward: [(0, '1325.248')] [2023-03-11 13:52:59,525][22726] Updated weights for policy 0, policy_version 86480 (0.0005) [2023-03-11 13:53:01,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10786.1, 300 sec: 10885.6). Total num frames: 44294144. Throughput: 0: 10914.5. Samples: 44277172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:53:01,346][22439] Avg episode reward: [(0, '1274.713')] [2023-03-11 13:53:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000086512_44294144.pth... [2023-03-11 13:53:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000085880_43970560.pth [2023-03-11 13:53:03,428][22726] Updated weights for policy 0, policy_version 86560 (0.0005) [2023-03-11 13:53:06,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10786.1, 300 sec: 10899.5). Total num frames: 44347392. Throughput: 0: 10921.1. Samples: 44339272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:53:06,346][22439] Avg episode reward: [(0, '1390.286')] [2023-03-11 13:53:07,315][22726] Updated weights for policy 0, policy_version 86640 (0.0005) [2023-03-11 13:53:11,123][22726] Updated weights for policy 0, policy_version 86720 (0.0005) [2023-03-11 13:53:11,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10786.1, 300 sec: 10885.6). Total num frames: 44400640. Throughput: 0: 10924.3. Samples: 44372040. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:53:11,346][22439] Avg episode reward: [(0, '1029.820')] [2023-03-11 13:53:15,108][22726] Updated weights for policy 0, policy_version 86800 (0.0005) [2023-03-11 13:53:16,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10854.4, 300 sec: 10871.8). Total num frames: 44453888. Throughput: 0: 10776.4. Samples: 44434744. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:53:16,346][22439] Avg episode reward: [(0, '1676.546')] [2023-03-11 13:53:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000086824_44453888.pth... [2023-03-11 13:53:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000086208_44138496.pth [2023-03-11 13:53:18,921][22726] Updated weights for policy 0, policy_version 86880 (0.0005) [2023-03-11 13:53:21,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10854.4, 300 sec: 10857.9). Total num frames: 44507136. Throughput: 0: 10679.5. Samples: 44499016. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:53:21,346][22439] Avg episode reward: [(0, '1077.235')] [2023-03-11 13:53:22,665][22726] Updated weights for policy 0, policy_version 86960 (0.0005) [2023-03-11 13:53:26,345][22439] Fps is (10 sec: 10649.7, 60 sec: 10854.4, 300 sec: 10857.9). Total num frames: 44560384. Throughput: 0: 10649.6. Samples: 44531712. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:53:26,346][22439] Avg episode reward: [(0, '1415.690')] [2023-03-11 13:53:26,588][22726] Updated weights for policy 0, policy_version 87040 (0.0005) [2023-03-11 13:53:30,495][22726] Updated weights for policy 0, policy_version 87120 (0.0005) [2023-03-11 13:53:31,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10717.9, 300 sec: 10844.0). Total num frames: 44613632. Throughput: 0: 10577.1. Samples: 44593996. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:53:31,346][22439] Avg episode reward: [(0, '1414.626')] [2023-03-11 13:53:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000087136_44613632.pth... [2023-03-11 13:53:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000086512_44294144.pth [2023-03-11 13:53:34,321][22726] Updated weights for policy 0, policy_version 87200 (0.0005) [2023-03-11 13:53:36,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10649.6, 300 sec: 10844.0). Total num frames: 44666880. Throughput: 0: 10608.7. Samples: 44658688. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:53:36,346][22439] Avg episode reward: [(0, '1220.170')] [2023-03-11 13:53:37,924][22726] Updated weights for policy 0, policy_version 87280 (0.0004) [2023-03-11 13:53:41,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10717.9, 300 sec: 10844.0). Total num frames: 44724224. Throughput: 0: 10667.0. Samples: 44692912. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:53:41,346][22439] Avg episode reward: [(0, '1087.612')] [2023-03-11 13:53:41,555][22726] Updated weights for policy 0, policy_version 87360 (0.0005) [2023-03-11 13:53:45,004][22726] Updated weights for policy 0, policy_version 87440 (0.0004) [2023-03-11 13:53:46,345][22439] Fps is (10 sec: 11468.9, 60 sec: 10786.2, 300 sec: 10844.0). Total num frames: 44781568. Throughput: 0: 10768.2. Samples: 44761740. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:53:46,346][22439] Avg episode reward: [(0, '1192.317')] [2023-03-11 13:53:46,382][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000087472_44785664.pth... [2023-03-11 13:53:46,384][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000086824_44453888.pth [2023-03-11 13:53:48,500][22726] Updated weights for policy 0, policy_version 87520 (0.0004) [2023-03-11 13:53:51,345][22439] Fps is (10 sec: 11878.4, 60 sec: 10922.7, 300 sec: 10857.9). Total num frames: 44843008. Throughput: 0: 10958.5. Samples: 44832404. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:53:51,346][22439] Avg episode reward: [(0, '1464.798')] [2023-03-11 13:53:52,008][22726] Updated weights for policy 0, policy_version 87600 (0.0004) [2023-03-11 13:53:55,650][22726] Updated weights for policy 0, policy_version 87680 (0.0005) [2023-03-11 13:53:56,345][22439] Fps is (10 sec: 11468.8, 60 sec: 10922.7, 300 sec: 10857.9). Total num frames: 44896256. Throughput: 0: 11011.1. Samples: 44867540. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:53:56,346][22439] Avg episode reward: [(0, '1081.289')] [2023-03-11 13:53:59,263][22726] Updated weights for policy 0, policy_version 87760 (0.0005) [2023-03-11 13:54:01,345][22439] Fps is (10 sec: 11059.1, 60 sec: 10990.9, 300 sec: 10871.8). Total num frames: 44953600. Throughput: 0: 11117.7. Samples: 44935040. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:54:01,346][22439] Avg episode reward: [(0, '1225.603')] [2023-03-11 13:54:01,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000087800_44953600.pth... [2023-03-11 13:54:01,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000087136_44613632.pth [2023-03-11 13:54:02,814][22726] Updated weights for policy 0, policy_version 87840 (0.0004) [2023-03-11 13:54:06,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11059.2, 300 sec: 10885.6). Total num frames: 45010944. Throughput: 0: 11232.1. Samples: 45004460. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:54:06,346][22439] Avg episode reward: [(0, '1133.083')] [2023-03-11 13:54:06,349][22726] Updated weights for policy 0, policy_version 87920 (0.0004) [2023-03-11 13:54:09,868][22726] Updated weights for policy 0, policy_version 88000 (0.0005) [2023-03-11 13:54:11,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11195.7, 300 sec: 10913.4). Total num frames: 45072384. Throughput: 0: 11286.9. Samples: 45039624. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:54:11,346][22439] Avg episode reward: [(0, '1046.811')] [2023-03-11 13:54:13,387][22726] Updated weights for policy 0, policy_version 88080 (0.0004) [2023-03-11 13:54:16,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11264.0, 300 sec: 10927.3). Total num frames: 45129728. Throughput: 0: 11449.3. Samples: 45109216. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:54:16,346][22439] Avg episode reward: [(0, '1163.676')] [2023-03-11 13:54:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000088144_45129728.pth... [2023-03-11 13:54:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000087472_44785664.pth [2023-03-11 13:54:16,995][22726] Updated weights for policy 0, policy_version 88160 (0.0005) [2023-03-11 13:54:20,596][22726] Updated weights for policy 0, policy_version 88240 (0.0004) [2023-03-11 13:54:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11264.0, 300 sec: 10913.4). Total num frames: 45182976. Throughput: 0: 11511.9. Samples: 45176724. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:54:21,346][22439] Avg episode reward: [(0, '1176.077')] [2023-03-11 13:54:24,230][22726] Updated weights for policy 0, policy_version 88320 (0.0005) [2023-03-11 13:54:26,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11332.3, 300 sec: 10927.3). Total num frames: 45240320. Throughput: 0: 11512.1. Samples: 45210956. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:54:26,346][22439] Avg episode reward: [(0, '1377.670')] [2023-03-11 13:54:27,828][22726] Updated weights for policy 0, policy_version 88400 (0.0005) [2023-03-11 13:54:31,259][22726] Updated weights for policy 0, policy_version 88480 (0.0004) [2023-03-11 13:54:31,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 10941.2). Total num frames: 45301760. Throughput: 0: 11523.6. Samples: 45280304. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:54:31,346][22439] Avg episode reward: [(0, '1180.184')] [2023-03-11 13:54:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000088480_45301760.pth... [2023-03-11 13:54:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000087800_44953600.pth [2023-03-11 13:54:34,845][22726] Updated weights for policy 0, policy_version 88560 (0.0005) [2023-03-11 13:54:36,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 10941.2). Total num frames: 45359104. Throughput: 0: 11496.3. Samples: 45349736. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:54:36,346][22439] Avg episode reward: [(0, '1289.360')] [2023-03-11 13:54:38,430][22726] Updated weights for policy 0, policy_version 88640 (0.0004) [2023-03-11 13:54:41,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 10941.2). Total num frames: 45416448. Throughput: 0: 11469.8. Samples: 45383680. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:54:41,346][22439] Avg episode reward: [(0, '1387.646')] [2023-03-11 13:54:42,091][22726] Updated weights for policy 0, policy_version 88720 (0.0005) [2023-03-11 13:54:45,805][22726] Updated weights for policy 0, policy_version 88800 (0.0005) [2023-03-11 13:54:46,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11468.8, 300 sec: 10927.3). Total num frames: 45469696. Throughput: 0: 11459.7. Samples: 45450724. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:54:46,346][22439] Avg episode reward: [(0, '1130.050')] [2023-03-11 13:54:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000088808_45469696.pth... [2023-03-11 13:54:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000088144_45129728.pth [2023-03-11 13:54:49,491][22726] Updated weights for policy 0, policy_version 88880 (0.0005) [2023-03-11 13:54:51,345][22439] Fps is (10 sec: 10649.7, 60 sec: 11332.3, 300 sec: 10927.3). Total num frames: 45522944. Throughput: 0: 11386.2. Samples: 45516840. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:54:51,346][22439] Avg episode reward: [(0, '1054.839')] [2023-03-11 13:54:53,179][22726] Updated weights for policy 0, policy_version 88960 (0.0005) [2023-03-11 13:54:56,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11400.5, 300 sec: 10927.3). Total num frames: 45580288. Throughput: 0: 11356.4. Samples: 45550660. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 13:54:56,346][22439] Avg episode reward: [(0, '1003.882')] [2023-03-11 13:54:56,748][22726] Updated weights for policy 0, policy_version 89040 (0.0005) [2023-03-11 13:55:00,326][22726] Updated weights for policy 0, policy_version 89120 (0.0004) [2023-03-11 13:55:01,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11400.6, 300 sec: 10955.1). Total num frames: 45637632. Throughput: 0: 11324.6. Samples: 45618820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:55:01,346][22439] Avg episode reward: [(0, '1188.582')] [2023-03-11 13:55:01,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000089136_45637632.pth... [2023-03-11 13:55:01,349][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000088480_45301760.pth [2023-03-11 13:55:03,998][22726] Updated weights for policy 0, policy_version 89200 (0.0005) [2023-03-11 13:55:06,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11400.5, 300 sec: 10969.0). Total num frames: 45694976. Throughput: 0: 11336.1. Samples: 45686848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:55:06,346][22439] Avg episode reward: [(0, '1127.379')] [2023-03-11 13:55:07,660][22726] Updated weights for policy 0, policy_version 89280 (0.0005) [2023-03-11 13:55:11,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11264.0, 300 sec: 10968.9). Total num frames: 45748224. Throughput: 0: 11307.2. Samples: 45719780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:55:11,346][22439] Avg episode reward: [(0, '1287.291')] [2023-03-11 13:55:11,349][22726] Updated weights for policy 0, policy_version 89360 (0.0005) [2023-03-11 13:55:15,163][22726] Updated weights for policy 0, policy_version 89440 (0.0005) [2023-03-11 13:55:16,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11264.0, 300 sec: 10982.8). Total num frames: 45805568. Throughput: 0: 11218.8. Samples: 45785152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:55:16,346][22439] Avg episode reward: [(0, '1646.479')] [2023-03-11 13:55:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000089464_45805568.pth... [2023-03-11 13:55:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000088808_45469696.pth [2023-03-11 13:55:18,891][22726] Updated weights for policy 0, policy_version 89520 (0.0005) [2023-03-11 13:55:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11264.0, 300 sec: 10996.7). Total num frames: 45858816. Throughput: 0: 11132.6. Samples: 45850704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:55:21,356][22439] Avg episode reward: [(0, '1564.815')] [2023-03-11 13:55:22,727][22726] Updated weights for policy 0, policy_version 89600 (0.0005) [2023-03-11 13:55:26,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11195.7, 300 sec: 10982.8). Total num frames: 45912064. Throughput: 0: 11090.5. Samples: 45882752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:55:26,356][22439] Avg episode reward: [(0, '1711.795')] [2023-03-11 13:55:26,482][22726] Updated weights for policy 0, policy_version 89680 (0.0005) [2023-03-11 13:55:30,131][22726] Updated weights for policy 0, policy_version 89760 (0.0005) [2023-03-11 13:55:31,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 10982.8). Total num frames: 45969408. Throughput: 0: 11072.8. Samples: 45949000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:55:31,346][22439] Avg episode reward: [(0, '1326.589')] [2023-03-11 13:55:31,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000089784_45969408.pth... [2023-03-11 13:55:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000089136_45637632.pth [2023-03-11 13:55:33,751][22726] Updated weights for policy 0, policy_version 89840 (0.0004) [2023-03-11 13:55:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11127.5, 300 sec: 10996.7). Total num frames: 46026752. Throughput: 0: 11114.9. Samples: 46017012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:55:36,346][22439] Avg episode reward: [(0, '1533.511')] [2023-03-11 13:55:37,251][22726] Updated weights for policy 0, policy_version 89920 (0.0004) [2023-03-11 13:55:40,782][22726] Updated weights for policy 0, policy_version 90000 (0.0005) [2023-03-11 13:55:41,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11127.5, 300 sec: 10996.7). Total num frames: 46084096. Throughput: 0: 11148.0. Samples: 46052320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:55:41,346][22439] Avg episode reward: [(0, '1004.528')] [2023-03-11 13:55:44,360][22726] Updated weights for policy 0, policy_version 90080 (0.0004) [2023-03-11 13:55:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 10996.7). Total num frames: 46141440. Throughput: 0: 11168.3. Samples: 46121392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:55:46,346][22439] Avg episode reward: [(0, '1273.845')] [2023-03-11 13:55:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000090120_46141440.pth... [2023-03-11 13:55:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000089464_45805568.pth [2023-03-11 13:55:48,078][22726] Updated weights for policy 0, policy_version 90160 (0.0005) [2023-03-11 13:55:51,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11195.7, 300 sec: 10996.7). Total num frames: 46194688. Throughput: 0: 11109.3. Samples: 46186768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:55:51,346][22439] Avg episode reward: [(0, '1732.241')] [2023-03-11 13:55:51,899][22726] Updated weights for policy 0, policy_version 90240 (0.0005) [2023-03-11 13:55:55,563][22726] Updated weights for policy 0, policy_version 90320 (0.0005) [2023-03-11 13:55:56,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11010.6). Total num frames: 46252032. Throughput: 0: 11117.5. Samples: 46220068. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:55:56,346][22439] Avg episode reward: [(0, '1336.464')] [2023-03-11 13:55:59,227][22726] Updated weights for policy 0, policy_version 90400 (0.0005) [2023-03-11 13:56:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11010.6). Total num frames: 46305280. Throughput: 0: 11154.8. Samples: 46287120. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:56:01,346][22439] Avg episode reward: [(0, '1574.098')] [2023-03-11 13:56:01,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000090440_46305280.pth... [2023-03-11 13:56:01,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000089784_45969408.pth [2023-03-11 13:56:02,851][22726] Updated weights for policy 0, policy_version 90480 (0.0005) [2023-03-11 13:56:06,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11024.5). Total num frames: 46362624. Throughput: 0: 11194.2. Samples: 46354444. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:56:06,346][22439] Avg episode reward: [(0, '1303.322')] [2023-03-11 13:56:06,567][22726] Updated weights for policy 0, policy_version 90560 (0.0005) [2023-03-11 13:56:10,456][22726] Updated weights for policy 0, policy_version 90640 (0.0005) [2023-03-11 13:56:11,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11127.5, 300 sec: 11024.5). Total num frames: 46415872. Throughput: 0: 11205.1. Samples: 46386980. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:56:11,346][22439] Avg episode reward: [(0, '1438.645')] [2023-03-11 13:56:14,449][22726] Updated weights for policy 0, policy_version 90720 (0.0005) [2023-03-11 13:56:16,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10991.0, 300 sec: 11010.6). Total num frames: 46465024. Throughput: 0: 11103.3. Samples: 46448648. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:56:16,346][22439] Avg episode reward: [(0, '1582.230')] [2023-03-11 13:56:16,365][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000090760_46469120.pth... [2023-03-11 13:56:16,366][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000090120_46141440.pth [2023-03-11 13:56:18,195][22726] Updated weights for policy 0, policy_version 90800 (0.0005) [2023-03-11 13:56:21,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11059.2, 300 sec: 11024.5). Total num frames: 46522368. Throughput: 0: 11057.3. Samples: 46514592. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:56:21,346][22439] Avg episode reward: [(0, '1237.478')] [2023-03-11 13:56:21,827][22726] Updated weights for policy 0, policy_version 90880 (0.0005) [2023-03-11 13:56:25,748][22726] Updated weights for policy 0, policy_version 90960 (0.0005) [2023-03-11 13:56:26,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 11024.5). Total num frames: 46575616. Throughput: 0: 10995.8. Samples: 46547128. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:56:26,346][22439] Avg episode reward: [(0, '1722.720')] [2023-03-11 13:56:29,705][22726] Updated weights for policy 0, policy_version 91040 (0.0005) [2023-03-11 13:56:31,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10990.9, 300 sec: 11024.5). Total num frames: 46628864. Throughput: 0: 10842.4. Samples: 46609300. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:56:31,346][22439] Avg episode reward: [(0, '1799.339')] [2023-03-11 13:56:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000091072_46628864.pth... [2023-03-11 13:56:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000090440_46305280.pth [2023-03-11 13:56:33,607][22726] Updated weights for policy 0, policy_version 91120 (0.0005) [2023-03-11 13:56:36,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10922.7, 300 sec: 11010.6). Total num frames: 46682112. Throughput: 0: 10825.2. Samples: 46673900. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:56:36,346][22439] Avg episode reward: [(0, '1764.898')] [2023-03-11 13:56:37,441][22726] Updated weights for policy 0, policy_version 91200 (0.0004) [2023-03-11 13:56:41,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10786.1, 300 sec: 10996.7). Total num frames: 46731264. Throughput: 0: 10764.8. Samples: 46704484. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:56:41,346][22439] Avg episode reward: [(0, '1557.731')] [2023-03-11 13:56:41,457][22726] Updated weights for policy 0, policy_version 91280 (0.0005) [2023-03-11 13:56:45,325][22726] Updated weights for policy 0, policy_version 91360 (0.0005) [2023-03-11 13:56:46,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10717.9, 300 sec: 10996.7). Total num frames: 46784512. Throughput: 0: 10660.1. Samples: 46766824. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 13:56:46,346][22439] Avg episode reward: [(0, '1629.364')] [2023-03-11 13:56:46,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000091376_46784512.pth... [2023-03-11 13:56:46,353][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000090760_46469120.pth [2023-03-11 13:56:49,197][22726] Updated weights for policy 0, policy_version 91440 (0.0004) [2023-03-11 13:56:51,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10717.9, 300 sec: 10996.7). Total num frames: 46837760. Throughput: 0: 10559.9. Samples: 46829640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:56:51,346][22439] Avg episode reward: [(0, '1368.614')] [2023-03-11 13:56:52,994][22726] Updated weights for policy 0, policy_version 91520 (0.0005) [2023-03-11 13:56:56,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10649.6, 300 sec: 10996.7). Total num frames: 46891008. Throughput: 0: 10565.1. Samples: 46862408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:56:56,346][22439] Avg episode reward: [(0, '1422.020')] [2023-03-11 13:56:56,876][22726] Updated weights for policy 0, policy_version 91600 (0.0005) [2023-03-11 13:57:00,803][22726] Updated weights for policy 0, policy_version 91680 (0.0005) [2023-03-11 13:57:01,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10649.6, 300 sec: 10996.7). Total num frames: 46944256. Throughput: 0: 10625.0. Samples: 46926776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:57:01,346][22439] Avg episode reward: [(0, '1450.445')] [2023-03-11 13:57:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000091688_46944256.pth... [2023-03-11 13:57:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000091072_46628864.pth [2023-03-11 13:57:04,735][22726] Updated weights for policy 0, policy_version 91760 (0.0005) [2023-03-11 13:57:06,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10581.3, 300 sec: 10996.7). Total num frames: 46997504. Throughput: 0: 10547.1. Samples: 46989212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:57:06,346][22439] Avg episode reward: [(0, '1531.176')] [2023-03-11 13:57:08,498][22726] Updated weights for policy 0, policy_version 91840 (0.0005) [2023-03-11 13:57:11,345][22439] Fps is (10 sec: 10649.8, 60 sec: 10581.3, 300 sec: 11010.6). Total num frames: 47050752. Throughput: 0: 10546.1. Samples: 47021704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:57:11,346][22439] Avg episode reward: [(0, '1738.186')] [2023-03-11 13:57:12,092][22726] Updated weights for policy 0, policy_version 91920 (0.0005) [2023-03-11 13:57:15,899][22726] Updated weights for policy 0, policy_version 92000 (0.0005) [2023-03-11 13:57:16,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10717.9, 300 sec: 11024.5). Total num frames: 47108096. Throughput: 0: 10644.9. Samples: 47088320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:57:16,346][22439] Avg episode reward: [(0, '1834.045')] [2023-03-11 13:57:16,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000092008_47108096.pth... [2023-03-11 13:57:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000091376_46784512.pth [2023-03-11 13:57:16,351][22682] Saving new best policy, reward=1834.045! [2023-03-11 13:57:19,482][22726] Updated weights for policy 0, policy_version 92080 (0.0004) [2023-03-11 13:57:21,345][22439] Fps is (10 sec: 11468.8, 60 sec: 10717.9, 300 sec: 11038.4). Total num frames: 47165440. Throughput: 0: 10700.4. Samples: 47155416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:57:21,346][22439] Avg episode reward: [(0, '1667.019')] [2023-03-11 13:57:23,172][22726] Updated weights for policy 0, policy_version 92160 (0.0005) [2023-03-11 13:57:26,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10717.9, 300 sec: 11010.6). Total num frames: 47218688. Throughput: 0: 10766.6. Samples: 47188980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:57:26,346][22439] Avg episode reward: [(0, '1247.792')] [2023-03-11 13:57:27,031][22726] Updated weights for policy 0, policy_version 92240 (0.0005) [2023-03-11 13:57:31,003][22726] Updated weights for policy 0, policy_version 92320 (0.0005) [2023-03-11 13:57:31,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10649.6, 300 sec: 10982.8). Total num frames: 47267840. Throughput: 0: 10775.8. Samples: 47251736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:57:31,346][22439] Avg episode reward: [(0, '1333.847')] [2023-03-11 13:57:31,388][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000092328_47271936.pth... [2023-03-11 13:57:31,390][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000091688_46944256.pth [2023-03-11 13:57:34,924][22726] Updated weights for policy 0, policy_version 92400 (0.0005) [2023-03-11 13:57:36,345][22439] Fps is (10 sec: 10240.1, 60 sec: 10649.6, 300 sec: 10982.8). Total num frames: 47321088. Throughput: 0: 10765.1. Samples: 47314068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:57:36,346][22439] Avg episode reward: [(0, '1649.696')] [2023-03-11 13:57:38,841][22726] Updated weights for policy 0, policy_version 92480 (0.0005) [2023-03-11 13:57:41,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10717.9, 300 sec: 10982.8). Total num frames: 47374336. Throughput: 0: 10739.4. Samples: 47345680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:57:41,346][22439] Avg episode reward: [(0, '1591.841')] [2023-03-11 13:57:42,692][22726] Updated weights for policy 0, policy_version 92560 (0.0005) [2023-03-11 13:57:46,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10717.9, 300 sec: 10982.8). Total num frames: 47427584. Throughput: 0: 10719.6. Samples: 47409156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:57:46,346][22439] Avg episode reward: [(0, '1522.096')] [2023-03-11 13:57:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000092632_47427584.pth... [2023-03-11 13:57:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000092008_47108096.pth [2023-03-11 13:57:46,486][22726] Updated weights for policy 0, policy_version 92640 (0.0004) [2023-03-11 13:57:50,187][22726] Updated weights for policy 0, policy_version 92720 (0.0003) [2023-03-11 13:57:51,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10786.1, 300 sec: 10996.7). Total num frames: 47484928. Throughput: 0: 10807.8. Samples: 47475564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:57:51,346][22439] Avg episode reward: [(0, '1335.930')] [2023-03-11 13:57:53,920][22726] Updated weights for policy 0, policy_version 92800 (0.0003) [2023-03-11 13:57:56,345][22439] Fps is (10 sec: 11059.3, 60 sec: 10786.1, 300 sec: 10996.7). Total num frames: 47538176. Throughput: 0: 10830.8. Samples: 47509092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:57:56,346][22439] Avg episode reward: [(0, '1763.232')] [2023-03-11 13:57:57,780][22726] Updated weights for policy 0, policy_version 92880 (0.0003) [2023-03-11 13:58:01,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10786.2, 300 sec: 10996.7). Total num frames: 47591424. Throughput: 0: 10780.7. Samples: 47573452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:58:01,346][22439] Avg episode reward: [(0, '1896.640')] [2023-03-11 13:58:01,404][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000092960_47595520.pth... [2023-03-11 13:58:01,404][22726] Updated weights for policy 0, policy_version 92960 (0.0003) [2023-03-11 13:58:01,406][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000092328_47271936.pth [2023-03-11 13:58:01,406][22682] Saving new best policy, reward=1896.640! [2023-03-11 13:58:04,981][22726] Updated weights for policy 0, policy_version 93040 (0.0003) [2023-03-11 13:58:06,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10854.4, 300 sec: 11010.6). Total num frames: 47648768. Throughput: 0: 10798.6. Samples: 47641352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:58:06,346][22439] Avg episode reward: [(0, '1823.955')] [2023-03-11 13:58:08,866][22726] Updated weights for policy 0, policy_version 93120 (0.0003) [2023-03-11 13:58:11,345][22439] Fps is (10 sec: 11059.1, 60 sec: 10854.4, 300 sec: 11010.6). Total num frames: 47702016. Throughput: 0: 10763.8. Samples: 47673352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:58:11,346][22439] Avg episode reward: [(0, '1612.164')] [2023-03-11 13:58:12,681][22726] Updated weights for policy 0, policy_version 93200 (0.0004) [2023-03-11 13:58:16,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10786.1, 300 sec: 11010.6). Total num frames: 47755264. Throughput: 0: 10773.3. Samples: 47736536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:58:16,346][22439] Avg episode reward: [(0, '1442.028')] [2023-03-11 13:58:16,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000093272_47755264.pth... [2023-03-11 13:58:16,353][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000092632_47427584.pth [2023-03-11 13:58:16,688][22726] Updated weights for policy 0, policy_version 93280 (0.0004) [2023-03-11 13:58:20,525][22726] Updated weights for policy 0, policy_version 93360 (0.0005) [2023-03-11 13:58:21,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10717.9, 300 sec: 11010.6). Total num frames: 47808512. Throughput: 0: 10792.3. Samples: 47799720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:58:21,346][22439] Avg episode reward: [(0, '1381.102')] [2023-03-11 13:58:24,464][22726] Updated weights for policy 0, policy_version 93440 (0.0006) [2023-03-11 13:58:26,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10649.6, 300 sec: 10996.7). Total num frames: 47857664. Throughput: 0: 10761.2. Samples: 47829936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:58:26,346][22439] Avg episode reward: [(0, '1670.285')] [2023-03-11 13:58:28,241][22726] Updated weights for policy 0, policy_version 93520 (0.0006) [2023-03-11 13:58:31,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10786.1, 300 sec: 11010.6). Total num frames: 47915008. Throughput: 0: 10787.5. Samples: 47894592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:58:31,356][22439] Avg episode reward: [(0, '1490.788')] [2023-03-11 13:58:31,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000093584_47915008.pth... [2023-03-11 13:58:31,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000092960_47595520.pth [2023-03-11 13:58:32,075][22726] Updated weights for policy 0, policy_version 93600 (0.0005) [2023-03-11 13:58:35,714][22726] Updated weights for policy 0, policy_version 93680 (0.0005) [2023-03-11 13:58:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10786.1, 300 sec: 10996.7). Total num frames: 47968256. Throughput: 0: 10781.8. Samples: 47960744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:58:36,356][22439] Avg episode reward: [(0, '1510.694')] [2023-03-11 13:58:39,247][22726] Updated weights for policy 0, policy_version 93760 (0.0005) [2023-03-11 13:58:41,345][22439] Fps is (10 sec: 11059.4, 60 sec: 10854.4, 300 sec: 10996.7). Total num frames: 48025600. Throughput: 0: 10818.4. Samples: 47995920. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:58:41,356][22439] Avg episode reward: [(0, '1557.356')] [2023-03-11 13:58:42,817][22726] Updated weights for policy 0, policy_version 93840 (0.0005) [2023-03-11 13:58:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 10922.7, 300 sec: 10982.8). Total num frames: 48082944. Throughput: 0: 10906.6. Samples: 48064248. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:58:46,356][22439] Avg episode reward: [(0, '1752.886')] [2023-03-11 13:58:46,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000093912_48082944.pth... [2023-03-11 13:58:46,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000093272_47755264.pth [2023-03-11 13:58:46,464][22726] Updated weights for policy 0, policy_version 93920 (0.0005) [2023-03-11 13:58:50,256][22726] Updated weights for policy 0, policy_version 94000 (0.0005) [2023-03-11 13:58:51,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10854.4, 300 sec: 10982.8). Total num frames: 48136192. Throughput: 0: 10856.5. Samples: 48129892. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:58:51,356][22439] Avg episode reward: [(0, '1995.579')] [2023-03-11 13:58:51,356][22682] Saving new best policy, reward=1995.579! [2023-03-11 13:58:54,308][22726] Updated weights for policy 0, policy_version 94080 (0.0005) [2023-03-11 13:58:56,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10854.4, 300 sec: 10969.0). Total num frames: 48189440. Throughput: 0: 10831.5. Samples: 48160768. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:58:56,356][22439] Avg episode reward: [(0, '1694.101')] [2023-03-11 13:58:58,231][22726] Updated weights for policy 0, policy_version 94160 (0.0005) [2023-03-11 13:59:01,345][22439] Fps is (10 sec: 10239.9, 60 sec: 10786.1, 300 sec: 10941.2). Total num frames: 48238592. Throughput: 0: 10794.1. Samples: 48222272. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:59:01,356][22439] Avg episode reward: [(0, '1974.343')] [2023-03-11 13:59:01,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000094224_48242688.pth... [2023-03-11 13:59:01,361][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000093584_47915008.pth [2023-03-11 13:59:02,115][22726] Updated weights for policy 0, policy_version 94240 (0.0006) [2023-03-11 13:59:05,775][22726] Updated weights for policy 0, policy_version 94320 (0.0005) [2023-03-11 13:59:06,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10786.1, 300 sec: 10927.3). Total num frames: 48295936. Throughput: 0: 10846.6. Samples: 48287816. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:59:06,346][22439] Avg episode reward: [(0, '1672.154')] [2023-03-11 13:59:09,428][22726] Updated weights for policy 0, policy_version 94400 (0.0005) [2023-03-11 13:59:11,345][22439] Fps is (10 sec: 11468.8, 60 sec: 10854.4, 300 sec: 10927.3). Total num frames: 48353280. Throughput: 0: 10921.6. Samples: 48321408. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:59:11,346][22439] Avg episode reward: [(0, '1822.324')] [2023-03-11 13:59:13,062][22726] Updated weights for policy 0, policy_version 94480 (0.0005) [2023-03-11 13:59:16,345][22439] Fps is (10 sec: 11059.1, 60 sec: 10854.4, 300 sec: 10927.3). Total num frames: 48406528. Throughput: 0: 10980.9. Samples: 48388732. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:59:16,346][22439] Avg episode reward: [(0, '1873.814')] [2023-03-11 13:59:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000094544_48406528.pth... [2023-03-11 13:59:16,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000093912_48082944.pth [2023-03-11 13:59:16,769][22726] Updated weights for policy 0, policy_version 94560 (0.0005) [2023-03-11 13:59:20,358][22726] Updated weights for policy 0, policy_version 94640 (0.0005) [2023-03-11 13:59:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 10927.3). Total num frames: 48463872. Throughput: 0: 11008.9. Samples: 48456144. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:59:21,346][22439] Avg episode reward: [(0, '1804.656')] [2023-03-11 13:59:24,142][22726] Updated weights for policy 0, policy_version 94720 (0.0006) [2023-03-11 13:59:26,345][22439] Fps is (10 sec: 11059.3, 60 sec: 10990.9, 300 sec: 10899.5). Total num frames: 48517120. Throughput: 0: 10957.0. Samples: 48488988. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:59:26,346][22439] Avg episode reward: [(0, '1677.868')] [2023-03-11 13:59:28,119][22726] Updated weights for policy 0, policy_version 94800 (0.0005) [2023-03-11 13:59:31,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10922.7, 300 sec: 10885.6). Total num frames: 48570368. Throughput: 0: 10832.1. Samples: 48551692. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:59:31,346][22439] Avg episode reward: [(0, '1923.657')] [2023-03-11 13:59:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000094864_48570368.pth... [2023-03-11 13:59:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000094224_48242688.pth [2023-03-11 13:59:31,864][22726] Updated weights for policy 0, policy_version 94880 (0.0003) [2023-03-11 13:59:35,527][22726] Updated weights for policy 0, policy_version 94960 (0.0005) [2023-03-11 13:59:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 10885.6). Total num frames: 48627712. Throughput: 0: 10865.6. Samples: 48618844. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 13:59:36,356][22439] Avg episode reward: [(0, '1917.881')] [2023-03-11 13:59:39,174][22726] Updated weights for policy 0, policy_version 95040 (0.0005) [2023-03-11 13:59:41,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10922.6, 300 sec: 10885.6). Total num frames: 48680960. Throughput: 0: 10922.9. Samples: 48652300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:59:41,356][22439] Avg episode reward: [(0, '1817.212')] [2023-03-11 13:59:42,830][22726] Updated weights for policy 0, policy_version 95120 (0.0005) [2023-03-11 13:59:46,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 10899.5). Total num frames: 48738304. Throughput: 0: 11032.0. Samples: 48718712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:59:46,356][22439] Avg episode reward: [(0, '1875.164')] [2023-03-11 13:59:46,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000095192_48738304.pth... [2023-03-11 13:59:46,363][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000094544_48406528.pth [2023-03-11 13:59:46,515][22726] Updated weights for policy 0, policy_version 95200 (0.0005) [2023-03-11 13:59:50,234][22726] Updated weights for policy 0, policy_version 95280 (0.0005) [2023-03-11 13:59:51,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10922.6, 300 sec: 10885.6). Total num frames: 48791552. Throughput: 0: 11058.9. Samples: 48785468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:59:51,356][22439] Avg episode reward: [(0, '1681.592')] [2023-03-11 13:59:54,167][22726] Updated weights for policy 0, policy_version 95360 (0.0006) [2023-03-11 13:59:56,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10922.7, 300 sec: 10871.8). Total num frames: 48844800. Throughput: 0: 10997.1. Samples: 48816276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 13:59:56,346][22439] Avg episode reward: [(0, '1978.653')] [2023-03-11 13:59:58,028][22726] Updated weights for policy 0, policy_version 95440 (0.0005) [2023-03-11 14:00:01,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10990.9, 300 sec: 10857.9). Total num frames: 48898048. Throughput: 0: 10909.9. Samples: 48879676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:00:01,346][22439] Avg episode reward: [(0, '1780.751')] [2023-03-11 14:00:01,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000095504_48898048.pth... [2023-03-11 14:00:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000094864_48570368.pth [2023-03-11 14:00:02,076][22726] Updated weights for policy 0, policy_version 95520 (0.0006) [2023-03-11 14:00:05,845][22726] Updated weights for policy 0, policy_version 95600 (0.0005) [2023-03-11 14:00:06,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10922.7, 300 sec: 10857.9). Total num frames: 48951296. Throughput: 0: 10821.1. Samples: 48943092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:00:06,346][22439] Avg episode reward: [(0, '1671.091')] [2023-03-11 14:00:09,458][22726] Updated weights for policy 0, policy_version 95680 (0.0005) [2023-03-11 14:00:11,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 10857.9). Total num frames: 49008640. Throughput: 0: 10834.6. Samples: 48976544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:00:11,346][22439] Avg episode reward: [(0, '1867.891')] [2023-03-11 14:00:13,087][22726] Updated weights for policy 0, policy_version 95760 (0.0005) [2023-03-11 14:00:16,345][22439] Fps is (10 sec: 11059.1, 60 sec: 10922.7, 300 sec: 10857.9). Total num frames: 49061888. Throughput: 0: 10912.6. Samples: 49042760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:00:16,346][22439] Avg episode reward: [(0, '1902.378')] [2023-03-11 14:00:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000095824_49061888.pth... [2023-03-11 14:00:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000095192_48738304.pth [2023-03-11 14:00:17,076][22726] Updated weights for policy 0, policy_version 95840 (0.0006) [2023-03-11 14:00:20,692][22726] Updated weights for policy 0, policy_version 95920 (0.0005) [2023-03-11 14:00:21,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10854.4, 300 sec: 10857.9). Total num frames: 49115136. Throughput: 0: 10860.7. Samples: 49107576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:00:21,346][22439] Avg episode reward: [(0, '1657.530')] [2023-03-11 14:00:24,375][22726] Updated weights for policy 0, policy_version 96000 (0.0005) [2023-03-11 14:00:26,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10854.4, 300 sec: 10844.0). Total num frames: 49168384. Throughput: 0: 10890.5. Samples: 49142372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:00:26,346][22439] Avg episode reward: [(0, '1680.249')] [2023-03-11 14:00:28,260][22726] Updated weights for policy 0, policy_version 96080 (0.0006) [2023-03-11 14:00:31,345][22439] Fps is (10 sec: 11059.3, 60 sec: 10922.7, 300 sec: 10844.0). Total num frames: 49225728. Throughput: 0: 10813.8. Samples: 49205332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:00:31,346][22439] Avg episode reward: [(0, '1634.702')] [2023-03-11 14:00:31,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000096144_49225728.pth... [2023-03-11 14:00:31,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000095504_48898048.pth [2023-03-11 14:00:32,152][22726] Updated weights for policy 0, policy_version 96160 (0.0006) [2023-03-11 14:00:36,172][22726] Updated weights for policy 0, policy_version 96240 (0.0006) [2023-03-11 14:00:36,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10786.1, 300 sec: 10816.2). Total num frames: 49274880. Throughput: 0: 10705.7. Samples: 49267224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:00:36,346][22439] Avg episode reward: [(0, '1828.003')] [2023-03-11 14:00:40,017][22726] Updated weights for policy 0, policy_version 96320 (0.0006) [2023-03-11 14:00:41,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10786.1, 300 sec: 10802.3). Total num frames: 49328128. Throughput: 0: 10737.5. Samples: 49299464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:00:41,346][22439] Avg episode reward: [(0, '1632.208')] [2023-03-11 14:00:43,936][22726] Updated weights for policy 0, policy_version 96400 (0.0005) [2023-03-11 14:00:46,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10717.9, 300 sec: 10802.3). Total num frames: 49381376. Throughput: 0: 10718.3. Samples: 49362000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:00:46,346][22439] Avg episode reward: [(0, '1553.320')] [2023-03-11 14:00:46,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000096448_49381376.pth... [2023-03-11 14:00:46,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000095824_49061888.pth [2023-03-11 14:00:47,795][22726] Updated weights for policy 0, policy_version 96480 (0.0006) [2023-03-11 14:00:51,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10649.6, 300 sec: 10774.6). Total num frames: 49430528. Throughput: 0: 10711.1. Samples: 49425092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:00:51,346][22439] Avg episode reward: [(0, '1390.255')] [2023-03-11 14:00:51,767][22726] Updated weights for policy 0, policy_version 96560 (0.0006) [2023-03-11 14:00:55,573][22726] Updated weights for policy 0, policy_version 96640 (0.0006) [2023-03-11 14:00:56,345][22439] Fps is (10 sec: 10649.7, 60 sec: 10717.9, 300 sec: 10788.4). Total num frames: 49487872. Throughput: 0: 10664.2. Samples: 49456432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:00:56,346][22439] Avg episode reward: [(0, '1649.316')] [2023-03-11 14:00:59,501][22726] Updated weights for policy 0, policy_version 96720 (0.0006) [2023-03-11 14:01:01,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10649.6, 300 sec: 10760.7). Total num frames: 49537024. Throughput: 0: 10611.7. Samples: 49520284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:01:01,346][22439] Avg episode reward: [(0, '1873.169')] [2023-03-11 14:01:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000096752_49537024.pth... [2023-03-11 14:01:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000096144_49225728.pth [2023-03-11 14:01:03,451][22726] Updated weights for policy 0, policy_version 96800 (0.0006) [2023-03-11 14:01:06,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10649.6, 300 sec: 10760.7). Total num frames: 49590272. Throughput: 0: 10546.0. Samples: 49582144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:01:06,346][22439] Avg episode reward: [(0, '1482.779')] [2023-03-11 14:01:07,359][22726] Updated weights for policy 0, policy_version 96880 (0.0006) [2023-03-11 14:01:11,305][22726] Updated weights for policy 0, policy_version 96960 (0.0005) [2023-03-11 14:01:11,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10581.3, 300 sec: 10774.6). Total num frames: 49643520. Throughput: 0: 10480.4. Samples: 49613992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:01:11,346][22439] Avg episode reward: [(0, '1547.750')] [2023-03-11 14:01:15,103][22726] Updated weights for policy 0, policy_version 97040 (0.0006) [2023-03-11 14:01:16,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10581.3, 300 sec: 10760.7). Total num frames: 49696768. Throughput: 0: 10467.3. Samples: 49676360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:01:16,346][22439] Avg episode reward: [(0, '1384.057')] [2023-03-11 14:01:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000097064_49696768.pth... [2023-03-11 14:01:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000096448_49381376.pth [2023-03-11 14:01:18,872][22726] Updated weights for policy 0, policy_version 97120 (0.0005) [2023-03-11 14:01:21,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10581.3, 300 sec: 10760.7). Total num frames: 49750016. Throughput: 0: 10548.1. Samples: 49741888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:01:21,346][22439] Avg episode reward: [(0, '1219.471')] [2023-03-11 14:01:22,779][22726] Updated weights for policy 0, policy_version 97200 (0.0006) [2023-03-11 14:01:26,345][22439] Fps is (10 sec: 10649.7, 60 sec: 10581.3, 300 sec: 10760.7). Total num frames: 49803264. Throughput: 0: 10545.2. Samples: 49774000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:01:26,346][22439] Avg episode reward: [(0, '1608.303')] [2023-03-11 14:01:26,560][22726] Updated weights for policy 0, policy_version 97280 (0.0006) [2023-03-11 14:01:30,396][22726] Updated weights for policy 0, policy_version 97360 (0.0004) [2023-03-11 14:01:31,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10513.0, 300 sec: 10760.7). Total num frames: 49856512. Throughput: 0: 10589.4. Samples: 49838524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:01:31,346][22439] Avg episode reward: [(0, '1618.906')] [2023-03-11 14:01:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000097376_49856512.pth... [2023-03-11 14:01:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000096752_49537024.pth [2023-03-11 14:01:34,306][22726] Updated weights for policy 0, policy_version 97440 (0.0005) [2023-03-11 14:01:36,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10581.3, 300 sec: 10774.6). Total num frames: 49909760. Throughput: 0: 10588.3. Samples: 49901568. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:01:36,346][22439] Avg episode reward: [(0, '1417.000')] [2023-03-11 14:01:38,141][22726] Updated weights for policy 0, policy_version 97520 (0.0006) [2023-03-11 14:01:41,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10581.3, 300 sec: 10774.6). Total num frames: 49963008. Throughput: 0: 10607.9. Samples: 49933788. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:01:41,346][22439] Avg episode reward: [(0, '1725.257')] [2023-03-11 14:01:42,015][22726] Updated weights for policy 0, policy_version 97600 (0.0006) [2023-03-11 14:01:45,941][22726] Updated weights for policy 0, policy_version 97680 (0.0006) [2023-03-11 14:01:46,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10513.1, 300 sec: 10760.7). Total num frames: 50012160. Throughput: 0: 10581.4. Samples: 49996448. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:01:46,346][22439] Avg episode reward: [(0, '1282.098')] [2023-03-11 14:01:46,364][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000097688_50016256.pth... [2023-03-11 14:01:46,365][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000097064_49696768.pth [2023-03-11 14:01:49,880][22726] Updated weights for policy 0, policy_version 97760 (0.0006) [2023-03-11 14:01:51,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10581.3, 300 sec: 10760.7). Total num frames: 50065408. Throughput: 0: 10599.1. Samples: 50059104. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:01:51,346][22439] Avg episode reward: [(0, '1759.653')] [2023-03-11 14:01:53,756][22726] Updated weights for policy 0, policy_version 97840 (0.0005) [2023-03-11 14:01:56,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10513.1, 300 sec: 10760.7). Total num frames: 50118656. Throughput: 0: 10582.1. Samples: 50090188. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:01:56,346][22439] Avg episode reward: [(0, '1570.852')] [2023-03-11 14:01:57,711][22726] Updated weights for policy 0, policy_version 97920 (0.0005) [2023-03-11 14:02:01,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10581.3, 300 sec: 10760.7). Total num frames: 50171904. Throughput: 0: 10581.2. Samples: 50152516. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:02:01,346][22439] Avg episode reward: [(0, '1782.271')] [2023-03-11 14:02:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000097992_50171904.pth... [2023-03-11 14:02:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000097376_49856512.pth [2023-03-11 14:02:01,692][22726] Updated weights for policy 0, policy_version 98000 (0.0005) [2023-03-11 14:02:05,688][22726] Updated weights for policy 0, policy_version 98080 (0.0004) [2023-03-11 14:02:06,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10513.1, 300 sec: 10746.8). Total num frames: 50221056. Throughput: 0: 10499.4. Samples: 50214360. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:02:06,346][22439] Avg episode reward: [(0, '1721.914')] [2023-03-11 14:02:09,664][22726] Updated weights for policy 0, policy_version 98160 (0.0005) [2023-03-11 14:02:11,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10513.1, 300 sec: 10732.9). Total num frames: 50274304. Throughput: 0: 10480.7. Samples: 50245632. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:02:11,346][22439] Avg episode reward: [(0, '1532.185')] [2023-03-11 14:02:13,227][22726] Updated weights for policy 0, policy_version 98240 (0.0004) [2023-03-11 14:02:16,345][22439] Fps is (10 sec: 11059.1, 60 sec: 10581.3, 300 sec: 10732.9). Total num frames: 50331648. Throughput: 0: 10528.2. Samples: 50312292. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:02:16,346][22439] Avg episode reward: [(0, '1503.061')] [2023-03-11 14:02:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000098304_50331648.pth... [2023-03-11 14:02:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000097688_50016256.pth [2023-03-11 14:02:16,924][22726] Updated weights for policy 0, policy_version 98320 (0.0005) [2023-03-11 14:02:20,910][22726] Updated weights for policy 0, policy_version 98400 (0.0005) [2023-03-11 14:02:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10581.3, 300 sec: 10732.9). Total num frames: 50384896. Throughput: 0: 10543.3. Samples: 50376016. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:02:21,346][22439] Avg episode reward: [(0, '1746.404')] [2023-03-11 14:02:24,714][22726] Updated weights for policy 0, policy_version 98480 (0.0005) [2023-03-11 14:02:26,345][22439] Fps is (10 sec: 10649.7, 60 sec: 10581.3, 300 sec: 10746.8). Total num frames: 50438144. Throughput: 0: 10543.0. Samples: 50408224. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:02:26,346][22439] Avg episode reward: [(0, '1540.790')] [2023-03-11 14:02:28,631][22726] Updated weights for policy 0, policy_version 98560 (0.0005) [2023-03-11 14:02:31,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10513.1, 300 sec: 10732.9). Total num frames: 50487296. Throughput: 0: 10545.1. Samples: 50470976. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:02:31,346][22439] Avg episode reward: [(0, '1743.260')] [2023-03-11 14:02:31,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000098608_50487296.pth... [2023-03-11 14:02:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000097992_50171904.pth [2023-03-11 14:02:32,629][22726] Updated weights for policy 0, policy_version 98640 (0.0005) [2023-03-11 14:02:36,345][22439] Fps is (10 sec: 10240.0, 60 sec: 10513.1, 300 sec: 10732.9). Total num frames: 50540544. Throughput: 0: 10540.8. Samples: 50533440. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:02:36,346][22439] Avg episode reward: [(0, '1737.304')] [2023-03-11 14:02:36,456][22726] Updated weights for policy 0, policy_version 98720 (0.0005) [2023-03-11 14:02:40,335][22726] Updated weights for policy 0, policy_version 98800 (0.0005) [2023-03-11 14:02:41,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10513.1, 300 sec: 10732.9). Total num frames: 50593792. Throughput: 0: 10554.3. Samples: 50565132. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:02:41,346][22439] Avg episode reward: [(0, '1548.859')] [2023-03-11 14:02:44,049][22726] Updated weights for policy 0, policy_version 98880 (0.0005) [2023-03-11 14:02:46,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10649.6, 300 sec: 10732.9). Total num frames: 50651136. Throughput: 0: 10626.8. Samples: 50630720. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:02:46,346][22439] Avg episode reward: [(0, '1485.383')] [2023-03-11 14:02:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000098928_50651136.pth... [2023-03-11 14:02:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000098304_50331648.pth [2023-03-11 14:02:47,851][22726] Updated weights for policy 0, policy_version 98960 (0.0005) [2023-03-11 14:02:51,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10581.3, 300 sec: 10719.0). Total num frames: 50700288. Throughput: 0: 10686.1. Samples: 50695236. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:02:51,346][22439] Avg episode reward: [(0, '1734.635')] [2023-03-11 14:02:51,736][22726] Updated weights for policy 0, policy_version 99040 (0.0005) [2023-03-11 14:02:55,502][22726] Updated weights for policy 0, policy_version 99120 (0.0005) [2023-03-11 14:02:56,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10649.6, 300 sec: 10732.9). Total num frames: 50757632. Throughput: 0: 10683.5. Samples: 50726388. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:02:56,346][22439] Avg episode reward: [(0, '1679.305')] [2023-03-11 14:02:59,006][22726] Updated weights for policy 0, policy_version 99200 (0.0005) [2023-03-11 14:03:01,345][22439] Fps is (10 sec: 11468.7, 60 sec: 10717.9, 300 sec: 10732.9). Total num frames: 50814976. Throughput: 0: 10729.6. Samples: 50795124. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:03:01,346][22439] Avg episode reward: [(0, '1444.633')] [2023-03-11 14:03:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000099248_50814976.pth... [2023-03-11 14:03:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000098608_50487296.pth [2023-03-11 14:03:02,696][22726] Updated weights for policy 0, policy_version 99280 (0.0005) [2023-03-11 14:03:06,323][22726] Updated weights for policy 0, policy_version 99360 (0.0005) [2023-03-11 14:03:06,345][22439] Fps is (10 sec: 11468.8, 60 sec: 10854.4, 300 sec: 10746.8). Total num frames: 50872320. Throughput: 0: 10809.3. Samples: 50862436. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:03:06,346][22439] Avg episode reward: [(0, '1419.407')] [2023-03-11 14:03:09,909][22726] Updated weights for policy 0, policy_version 99440 (0.0005) [2023-03-11 14:03:11,345][22439] Fps is (10 sec: 11468.9, 60 sec: 10922.7, 300 sec: 10760.7). Total num frames: 50929664. Throughput: 0: 10859.4. Samples: 50896896. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:03:11,346][22439] Avg episode reward: [(0, '1506.142')] [2023-03-11 14:03:13,485][22726] Updated weights for policy 0, policy_version 99520 (0.0005) [2023-03-11 14:03:16,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10854.4, 300 sec: 10760.7). Total num frames: 50982912. Throughput: 0: 10970.9. Samples: 50964668. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:03:16,346][22439] Avg episode reward: [(0, '1321.690')] [2023-03-11 14:03:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000099576_50982912.pth... [2023-03-11 14:03:16,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000098928_50651136.pth [2023-03-11 14:03:17,132][22726] Updated weights for policy 0, policy_version 99600 (0.0005) [2023-03-11 14:03:20,655][22726] Updated weights for policy 0, policy_version 99680 (0.0005) [2023-03-11 14:03:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 10788.4). Total num frames: 51040256. Throughput: 0: 11112.2. Samples: 51033488. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:03:21,346][22439] Avg episode reward: [(0, '1610.244')] [2023-03-11 14:03:24,245][22726] Updated weights for policy 0, policy_version 99760 (0.0005) [2023-03-11 14:03:26,345][22439] Fps is (10 sec: 11468.9, 60 sec: 10990.9, 300 sec: 10788.5). Total num frames: 51097600. Throughput: 0: 11183.3. Samples: 51068380. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:03:26,346][22439] Avg episode reward: [(0, '1866.341')] [2023-03-11 14:03:27,885][22726] Updated weights for policy 0, policy_version 99840 (0.0005) [2023-03-11 14:03:31,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11127.5, 300 sec: 10802.3). Total num frames: 51154944. Throughput: 0: 11232.7. Samples: 51136192. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:03:31,346][22439] Avg episode reward: [(0, '1766.335')] [2023-03-11 14:03:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000099912_51154944.pth... [2023-03-11 14:03:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000099248_50814976.pth [2023-03-11 14:03:31,443][22726] Updated weights for policy 0, policy_version 99920 (0.0005) [2023-03-11 14:03:35,135][22726] Updated weights for policy 0, policy_version 100000 (0.0005) [2023-03-11 14:03:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 10802.3). Total num frames: 51212288. Throughput: 0: 11297.3. Samples: 51203616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:03:36,346][22439] Avg episode reward: [(0, '1741.917')] [2023-03-11 14:03:38,788][22726] Updated weights for policy 0, policy_version 100080 (0.0005) [2023-03-11 14:03:41,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 10802.3). Total num frames: 51269632. Throughput: 0: 11345.3. Samples: 51236928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:03:41,346][22439] Avg episode reward: [(0, '1747.282')] [2023-03-11 14:03:42,369][22726] Updated weights for policy 0, policy_version 100160 (0.0005) [2023-03-11 14:03:45,938][22726] Updated weights for policy 0, policy_version 100240 (0.0005) [2023-03-11 14:03:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 10816.2). Total num frames: 51326976. Throughput: 0: 11354.0. Samples: 51306052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:03:46,346][22439] Avg episode reward: [(0, '1548.127')] [2023-03-11 14:03:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000100248_51326976.pth... [2023-03-11 14:03:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000099576_50982912.pth [2023-03-11 14:03:49,603][22726] Updated weights for policy 0, policy_version 100320 (0.0005) [2023-03-11 14:03:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 10830.1). Total num frames: 51384320. Throughput: 0: 11364.5. Samples: 51373840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:03:51,346][22439] Avg episode reward: [(0, '1407.618')] [2023-03-11 14:03:53,095][22726] Updated weights for policy 0, policy_version 100400 (0.0005) [2023-03-11 14:03:56,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11400.5, 300 sec: 10857.9). Total num frames: 51441664. Throughput: 0: 11376.0. Samples: 51408816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:03:56,346][22439] Avg episode reward: [(0, '1520.610')] [2023-03-11 14:03:56,610][22726] Updated weights for policy 0, policy_version 100480 (0.0005) [2023-03-11 14:04:00,197][22726] Updated weights for policy 0, policy_version 100560 (0.0005) [2023-03-11 14:04:01,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 10857.9). Total num frames: 51499008. Throughput: 0: 11416.4. Samples: 51478404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:04:01,346][22439] Avg episode reward: [(0, '1635.088')] [2023-03-11 14:04:01,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000100584_51499008.pth... [2023-03-11 14:04:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000099912_51154944.pth [2023-03-11 14:04:03,730][22726] Updated weights for policy 0, policy_version 100640 (0.0005) [2023-03-11 14:04:06,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 10857.9). Total num frames: 51556352. Throughput: 0: 11436.9. Samples: 51548148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:04:06,346][22439] Avg episode reward: [(0, '1322.094')] [2023-03-11 14:04:07,219][22726] Updated weights for policy 0, policy_version 100720 (0.0005) [2023-03-11 14:04:10,827][22726] Updated weights for policy 0, policy_version 100800 (0.0005) [2023-03-11 14:04:11,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 10871.8). Total num frames: 51613696. Throughput: 0: 11429.7. Samples: 51582716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:04:11,346][22439] Avg episode reward: [(0, '1504.655')] [2023-03-11 14:04:14,725][22726] Updated weights for policy 0, policy_version 100880 (0.0006) [2023-03-11 14:04:16,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11400.5, 300 sec: 10857.9). Total num frames: 51666944. Throughput: 0: 11358.1. Samples: 51647308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:04:16,346][22439] Avg episode reward: [(0, '1488.121')] [2023-03-11 14:04:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000100912_51666944.pth... [2023-03-11 14:04:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000100248_51326976.pth [2023-03-11 14:04:18,576][22726] Updated weights for policy 0, policy_version 100960 (0.0005) [2023-03-11 14:04:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11400.5, 300 sec: 10871.8). Total num frames: 51724288. Throughput: 0: 11318.9. Samples: 51712964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:04:21,346][22439] Avg episode reward: [(0, '1379.548')] [2023-03-11 14:04:22,066][22726] Updated weights for policy 0, policy_version 101040 (0.0005) [2023-03-11 14:04:25,683][22726] Updated weights for policy 0, policy_version 101120 (0.0005) [2023-03-11 14:04:26,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 10871.8). Total num frames: 51777536. Throughput: 0: 11367.4. Samples: 51748460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:04:26,346][22439] Avg episode reward: [(0, '1547.064')] [2023-03-11 14:04:29,213][22726] Updated weights for policy 0, policy_version 101200 (0.0005) [2023-03-11 14:04:31,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11332.3, 300 sec: 10871.8). Total num frames: 51834880. Throughput: 0: 11352.7. Samples: 51816924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:04:31,346][22439] Avg episode reward: [(0, '1550.412')] [2023-03-11 14:04:31,355][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000101248_51838976.pth... [2023-03-11 14:04:31,356][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000100584_51499008.pth [2023-03-11 14:04:32,819][22726] Updated weights for policy 0, policy_version 101280 (0.0005) [2023-03-11 14:04:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 10885.6). Total num frames: 51892224. Throughput: 0: 11339.2. Samples: 51884104. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:04:36,346][22439] Avg episode reward: [(0, '1279.161')] [2023-03-11 14:04:36,449][22726] Updated weights for policy 0, policy_version 101360 (0.0005) [2023-03-11 14:04:39,982][22726] Updated weights for policy 0, policy_version 101440 (0.0005) [2023-03-11 14:04:41,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11400.5, 300 sec: 10899.5). Total num frames: 51953664. Throughput: 0: 11346.4. Samples: 51919404. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:04:41,346][22439] Avg episode reward: [(0, '1343.973')] [2023-03-11 14:04:43,456][22726] Updated weights for policy 0, policy_version 101520 (0.0005) [2023-03-11 14:04:46,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11400.5, 300 sec: 10913.4). Total num frames: 52011008. Throughput: 0: 11371.7. Samples: 51990132. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:04:46,346][22439] Avg episode reward: [(0, '1490.355')] [2023-03-11 14:04:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000101584_52011008.pth... [2023-03-11 14:04:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000100912_51666944.pth [2023-03-11 14:04:46,848][22726] Updated weights for policy 0, policy_version 101600 (0.0005) [2023-03-11 14:04:50,373][22726] Updated weights for policy 0, policy_version 101680 (0.0005) [2023-03-11 14:04:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 10927.3). Total num frames: 52068352. Throughput: 0: 11383.7. Samples: 52060412. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:04:51,346][22439] Avg episode reward: [(0, '1195.821')] [2023-03-11 14:04:53,983][22726] Updated weights for policy 0, policy_version 101760 (0.0005) [2023-03-11 14:04:56,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 10955.1). Total num frames: 52129792. Throughput: 0: 11381.4. Samples: 52094880. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:04:56,346][22439] Avg episode reward: [(0, '1387.948')] [2023-03-11 14:04:57,309][22726] Updated weights for policy 0, policy_version 101840 (0.0005) [2023-03-11 14:05:00,775][22726] Updated weights for policy 0, policy_version 101920 (0.0005) [2023-03-11 14:05:01,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11468.8, 300 sec: 10968.9). Total num frames: 52187136. Throughput: 0: 11562.7. Samples: 52167628. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:05:01,346][22439] Avg episode reward: [(0, '1200.027')] [2023-03-11 14:05:01,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000101928_52187136.pth... [2023-03-11 14:05:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000101248_51838976.pth [2023-03-11 14:05:04,522][22726] Updated weights for policy 0, policy_version 102000 (0.0005) [2023-03-11 14:05:06,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 10968.9). Total num frames: 52244480. Throughput: 0: 11585.3. Samples: 52234304. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:05:06,346][22439] Avg episode reward: [(0, '1363.210')] [2023-03-11 14:05:08,200][22726] Updated weights for policy 0, policy_version 102080 (0.0004) [2023-03-11 14:05:11,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11400.5, 300 sec: 10969.0). Total num frames: 52297728. Throughput: 0: 11540.6. Samples: 52267788. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:05:11,346][22439] Avg episode reward: [(0, '1248.013')] [2023-03-11 14:05:11,826][22726] Updated weights for policy 0, policy_version 102160 (0.0006) [2023-03-11 14:05:15,499][22726] Updated weights for policy 0, policy_version 102240 (0.0006) [2023-03-11 14:05:16,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11468.8, 300 sec: 10982.8). Total num frames: 52355072. Throughput: 0: 11513.8. Samples: 52335044. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:05:16,346][22439] Avg episode reward: [(0, '1283.582')] [2023-03-11 14:05:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000102256_52355072.pth... [2023-03-11 14:05:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000101584_52011008.pth [2023-03-11 14:05:18,974][22726] Updated weights for policy 0, policy_version 102320 (0.0005) [2023-03-11 14:05:21,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 10996.7). Total num frames: 52412416. Throughput: 0: 11579.3. Samples: 52405172. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:05:21,346][22439] Avg episode reward: [(0, '1327.097')] [2023-03-11 14:05:22,377][22726] Updated weights for policy 0, policy_version 102400 (0.0005) [2023-03-11 14:05:25,827][22726] Updated weights for policy 0, policy_version 102480 (0.0004) [2023-03-11 14:05:26,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11010.6). Total num frames: 52473856. Throughput: 0: 11599.0. Samples: 52441360. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:05:26,346][22439] Avg episode reward: [(0, '1358.196')] [2023-03-11 14:05:29,205][22726] Updated weights for policy 0, policy_version 102560 (0.0005) [2023-03-11 14:05:31,345][22439] Fps is (10 sec: 12287.8, 60 sec: 11673.6, 300 sec: 11052.3). Total num frames: 52535296. Throughput: 0: 11627.5. Samples: 52513372. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 14:05:31,346][22439] Avg episode reward: [(0, '1394.574')] [2023-03-11 14:05:31,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000102608_52535296.pth... [2023-03-11 14:05:31,353][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000101928_52187136.pth [2023-03-11 14:05:32,749][22726] Updated weights for policy 0, policy_version 102640 (0.0005) [2023-03-11 14:05:36,131][22726] Updated weights for policy 0, policy_version 102720 (0.0005) [2023-03-11 14:05:36,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11066.1). Total num frames: 52592640. Throughput: 0: 11644.5. Samples: 52584416. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:05:36,346][22439] Avg episode reward: [(0, '1333.798')] [2023-03-11 14:05:39,581][22726] Updated weights for policy 0, policy_version 102800 (0.0005) [2023-03-11 14:05:41,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11093.9). Total num frames: 52654080. Throughput: 0: 11673.6. Samples: 52620192. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:05:41,346][22439] Avg episode reward: [(0, '1140.723')] [2023-03-11 14:05:42,961][22726] Updated weights for policy 0, policy_version 102880 (0.0005) [2023-03-11 14:05:46,280][22726] Updated weights for policy 0, policy_version 102960 (0.0005) [2023-03-11 14:05:46,345][22439] Fps is (10 sec: 12287.9, 60 sec: 11741.9, 300 sec: 11135.6). Total num frames: 52715520. Throughput: 0: 11656.9. Samples: 52692188. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:05:46,346][22439] Avg episode reward: [(0, '1071.759')] [2023-03-11 14:05:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000102960_52715520.pth... [2023-03-11 14:05:46,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000102256_52355072.pth [2023-03-11 14:05:49,646][22726] Updated weights for policy 0, policy_version 103040 (0.0005) [2023-03-11 14:05:51,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11810.1, 300 sec: 11149.4). Total num frames: 52776960. Throughput: 0: 11814.7. Samples: 52765964. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:05:51,346][22439] Avg episode reward: [(0, '1129.584')] [2023-03-11 14:05:52,955][22726] Updated weights for policy 0, policy_version 103120 (0.0004) [2023-03-11 14:05:56,249][22726] Updated weights for policy 0, policy_version 103200 (0.0004) [2023-03-11 14:05:56,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 11191.1). Total num frames: 52838400. Throughput: 0: 11900.5. Samples: 52803312. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:05:56,346][22439] Avg episode reward: [(0, '881.657')] [2023-03-11 14:05:59,717][22726] Updated weights for policy 0, policy_version 103280 (0.0005) [2023-03-11 14:06:01,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11205.0). Total num frames: 52895744. Throughput: 0: 12011.9. Samples: 52875580. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:06:01,346][22439] Avg episode reward: [(0, '1140.119')] [2023-03-11 14:06:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000103312_52895744.pth... [2023-03-11 14:06:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000102608_52535296.pth [2023-03-11 14:06:03,138][22726] Updated weights for policy 0, policy_version 103360 (0.0004) [2023-03-11 14:06:06,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11232.8). Total num frames: 52957184. Throughput: 0: 12075.2. Samples: 52948556. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:06:06,346][22439] Avg episode reward: [(0, '1188.236')] [2023-03-11 14:06:06,510][22726] Updated weights for policy 0, policy_version 103440 (0.0004) [2023-03-11 14:06:09,827][22726] Updated weights for policy 0, policy_version 103520 (0.0004) [2023-03-11 14:06:11,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12014.9, 300 sec: 11260.5). Total num frames: 53018624. Throughput: 0: 12089.4. Samples: 52985384. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:06:11,346][22439] Avg episode reward: [(0, '1027.000')] [2023-03-11 14:06:13,085][22726] Updated weights for policy 0, policy_version 103600 (0.0004) [2023-03-11 14:06:16,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11288.3). Total num frames: 53080064. Throughput: 0: 12138.2. Samples: 53059592. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:06:16,346][22439] Avg episode reward: [(0, '1000.351')] [2023-03-11 14:06:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000103672_53080064.pth... [2023-03-11 14:06:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000102960_52715520.pth [2023-03-11 14:06:16,427][22726] Updated weights for policy 0, policy_version 103680 (0.0004) [2023-03-11 14:06:19,800][22726] Updated weights for policy 0, policy_version 103760 (0.0004) [2023-03-11 14:06:21,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11316.1). Total num frames: 53141504. Throughput: 0: 12190.1. Samples: 53132968. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:06:21,346][22439] Avg episode reward: [(0, '1102.501')] [2023-03-11 14:06:23,224][22726] Updated weights for policy 0, policy_version 103840 (0.0004) [2023-03-11 14:06:26,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11343.8). Total num frames: 53202944. Throughput: 0: 12186.8. Samples: 53168596. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:06:26,346][22439] Avg episode reward: [(0, '1323.231')] [2023-03-11 14:06:26,666][22726] Updated weights for policy 0, policy_version 103920 (0.0005) [2023-03-11 14:06:29,918][22726] Updated weights for policy 0, policy_version 104000 (0.0005) [2023-03-11 14:06:31,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12151.5, 300 sec: 11371.6). Total num frames: 53264384. Throughput: 0: 12208.0. Samples: 53241548. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:06:31,346][22439] Avg episode reward: [(0, '1117.016')] [2023-03-11 14:06:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000104032_53264384.pth... [2023-03-11 14:06:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000103312_52895744.pth [2023-03-11 14:06:33,237][22726] Updated weights for policy 0, policy_version 104080 (0.0004) [2023-03-11 14:06:36,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 11399.4). Total num frames: 53325824. Throughput: 0: 12213.3. Samples: 53315560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:06:36,346][22439] Avg episode reward: [(0, '1242.106')] [2023-03-11 14:06:36,641][22726] Updated weights for policy 0, policy_version 104160 (0.0004) [2023-03-11 14:06:40,033][22726] Updated weights for policy 0, policy_version 104240 (0.0004) [2023-03-11 14:06:41,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12219.8, 300 sec: 11441.0). Total num frames: 53387264. Throughput: 0: 12189.8. Samples: 53351852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:06:41,346][22439] Avg episode reward: [(0, '1178.375')] [2023-03-11 14:06:43,333][22726] Updated weights for policy 0, policy_version 104320 (0.0004) [2023-03-11 14:06:46,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11454.9). Total num frames: 53444608. Throughput: 0: 12214.6. Samples: 53425236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:06:46,346][22439] Avg episode reward: [(0, '1102.906')] [2023-03-11 14:06:46,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000104392_53448704.pth... [2023-03-11 14:06:46,361][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000103672_53080064.pth [2023-03-11 14:06:46,699][22726] Updated weights for policy 0, policy_version 104400 (0.0004) [2023-03-11 14:06:50,209][22726] Updated weights for policy 0, policy_version 104480 (0.0005) [2023-03-11 14:06:51,345][22439] Fps is (10 sec: 11878.3, 60 sec: 12151.5, 300 sec: 11482.7). Total num frames: 53506048. Throughput: 0: 12174.1. Samples: 53496392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:06:51,346][22439] Avg episode reward: [(0, '1163.256')] [2023-03-11 14:06:53,888][22726] Updated weights for policy 0, policy_version 104560 (0.0005) [2023-03-11 14:06:56,345][22439] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11482.7). Total num frames: 53559296. Throughput: 0: 12111.5. Samples: 53530400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:06:56,346][22439] Avg episode reward: [(0, '1514.699')] [2023-03-11 14:06:57,435][22726] Updated weights for policy 0, policy_version 104640 (0.0005) [2023-03-11 14:07:01,073][22726] Updated weights for policy 0, policy_version 104720 (0.0005) [2023-03-11 14:07:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 12014.9, 300 sec: 11510.5). Total num frames: 53616640. Throughput: 0: 11932.5. Samples: 53596556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:07:01,346][22439] Avg episode reward: [(0, '1497.044')] [2023-03-11 14:07:01,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000104720_53616640.pth... [2023-03-11 14:07:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000104032_53264384.pth [2023-03-11 14:07:04,502][22726] Updated weights for policy 0, policy_version 104800 (0.0005) [2023-03-11 14:07:06,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11538.2). Total num frames: 53678080. Throughput: 0: 11909.4. Samples: 53668892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:07:06,356][22439] Avg episode reward: [(0, '1314.834')] [2023-03-11 14:07:07,904][22726] Updated weights for policy 0, policy_version 104880 (0.0004) [2023-03-11 14:07:11,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 11538.2). Total num frames: 53735424. Throughput: 0: 11911.5. Samples: 53704612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:07:11,346][22439] Avg episode reward: [(0, '989.473')] [2023-03-11 14:07:11,388][22726] Updated weights for policy 0, policy_version 104960 (0.0005) [2023-03-11 14:07:14,785][22726] Updated weights for policy 0, policy_version 105040 (0.0005) [2023-03-11 14:07:16,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11566.0). Total num frames: 53796864. Throughput: 0: 11885.4. Samples: 53776392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:07:16,346][22439] Avg episode reward: [(0, '1582.418')] [2023-03-11 14:07:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000105072_53796864.pth... [2023-03-11 14:07:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000104392_53448704.pth [2023-03-11 14:07:18,174][22726] Updated weights for policy 0, policy_version 105120 (0.0004) [2023-03-11 14:07:21,345][22439] Fps is (10 sec: 11878.2, 60 sec: 11878.4, 300 sec: 11579.9). Total num frames: 53854208. Throughput: 0: 11822.6. Samples: 53847576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:07:21,356][22439] Avg episode reward: [(0, '1454.127')] [2023-03-11 14:07:21,752][22726] Updated weights for policy 0, policy_version 105200 (0.0005) [2023-03-11 14:07:25,609][22726] Updated weights for policy 0, policy_version 105280 (0.0005) [2023-03-11 14:07:26,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11741.8, 300 sec: 11593.8). Total num frames: 53907456. Throughput: 0: 11740.8. Samples: 53880192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:07:26,356][22439] Avg episode reward: [(0, '1545.480')] [2023-03-11 14:07:29,475][22726] Updated weights for policy 0, policy_version 105360 (0.0005) [2023-03-11 14:07:31,345][22439] Fps is (10 sec: 11059.4, 60 sec: 11673.6, 300 sec: 11607.6). Total num frames: 53964800. Throughput: 0: 11533.1. Samples: 53944224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:07:31,356][22439] Avg episode reward: [(0, '1413.791')] [2023-03-11 14:07:31,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000105400_53964800.pth... [2023-03-11 14:07:31,361][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000104720_53616640.pth [2023-03-11 14:07:33,005][22726] Updated weights for policy 0, policy_version 105440 (0.0004) [2023-03-11 14:07:36,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11621.5). Total num frames: 54022144. Throughput: 0: 11501.3. Samples: 54013952. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:07:36,356][22439] Avg episode reward: [(0, '1290.769')] [2023-03-11 14:07:36,488][22726] Updated weights for policy 0, policy_version 105520 (0.0005) [2023-03-11 14:07:39,973][22726] Updated weights for policy 0, policy_version 105600 (0.0004) [2023-03-11 14:07:41,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11621.5). Total num frames: 54079488. Throughput: 0: 11528.4. Samples: 54049180. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:07:41,346][22439] Avg episode reward: [(0, '1471.084')] [2023-03-11 14:07:43,560][22726] Updated weights for policy 0, policy_version 105680 (0.0005) [2023-03-11 14:07:46,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 11663.2). Total num frames: 54140928. Throughput: 0: 11592.8. Samples: 54118232. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:07:46,346][22439] Avg episode reward: [(0, '1518.074')] [2023-03-11 14:07:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000105744_54140928.pth... [2023-03-11 14:07:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000105072_53796864.pth [2023-03-11 14:07:46,958][22726] Updated weights for policy 0, policy_version 105760 (0.0004) [2023-03-11 14:07:50,647][22726] Updated weights for policy 0, policy_version 105840 (0.0004) [2023-03-11 14:07:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11649.3). Total num frames: 54194176. Throughput: 0: 11524.7. Samples: 54187504. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:07:51,346][22439] Avg episode reward: [(0, '1605.153')] [2023-03-11 14:07:54,583][22726] Updated weights for policy 0, policy_version 105920 (0.0004) [2023-03-11 14:07:56,345][22439] Fps is (10 sec: 10649.7, 60 sec: 11468.8, 300 sec: 11635.4). Total num frames: 54247424. Throughput: 0: 11427.6. Samples: 54218856. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:07:56,346][22439] Avg episode reward: [(0, '1530.456')] [2023-03-11 14:07:58,456][22726] Updated weights for policy 0, policy_version 106000 (0.0004) [2023-03-11 14:08:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11468.8, 300 sec: 11635.4). Total num frames: 54304768. Throughput: 0: 11269.5. Samples: 54283520. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:08:01,346][22439] Avg episode reward: [(0, '1417.067')] [2023-03-11 14:08:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000106064_54304768.pth... [2023-03-11 14:08:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000105400_53964800.pth [2023-03-11 14:08:02,048][22726] Updated weights for policy 0, policy_version 106080 (0.0005) [2023-03-11 14:08:05,914][22726] Updated weights for policy 0, policy_version 106160 (0.0005) [2023-03-11 14:08:06,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 11621.5). Total num frames: 54358016. Throughput: 0: 11140.7. Samples: 54348904. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:08:06,346][22439] Avg episode reward: [(0, '1525.759')] [2023-03-11 14:08:09,640][22726] Updated weights for policy 0, policy_version 106240 (0.0005) [2023-03-11 14:08:11,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11264.0, 300 sec: 11621.5). Total num frames: 54411264. Throughput: 0: 11145.2. Samples: 54381724. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:08:11,346][22439] Avg episode reward: [(0, '1461.266')] [2023-03-11 14:08:13,296][22726] Updated weights for policy 0, policy_version 106320 (0.0004) [2023-03-11 14:08:16,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11195.7, 300 sec: 11621.5). Total num frames: 54468608. Throughput: 0: 11209.6. Samples: 54448656. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:08:16,346][22439] Avg episode reward: [(0, '1220.679')] [2023-03-11 14:08:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000106384_54468608.pth... [2023-03-11 14:08:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000105744_54140928.pth [2023-03-11 14:08:16,931][22726] Updated weights for policy 0, policy_version 106400 (0.0005) [2023-03-11 14:08:20,656][22726] Updated weights for policy 0, policy_version 106480 (0.0004) [2023-03-11 14:08:21,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11127.5, 300 sec: 11607.6). Total num frames: 54521856. Throughput: 0: 11143.2. Samples: 54515396. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:08:21,346][22439] Avg episode reward: [(0, '1515.739')] [2023-03-11 14:08:24,495][22726] Updated weights for policy 0, policy_version 106560 (0.0005) [2023-03-11 14:08:26,345][22439] Fps is (10 sec: 10649.5, 60 sec: 11127.5, 300 sec: 11593.8). Total num frames: 54575104. Throughput: 0: 11071.6. Samples: 54547404. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:08:26,346][22439] Avg episode reward: [(0, '1559.260')] [2023-03-11 14:08:28,229][22726] Updated weights for policy 0, policy_version 106640 (0.0005) [2023-03-11 14:08:31,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11127.4, 300 sec: 11593.8). Total num frames: 54632448. Throughput: 0: 10997.2. Samples: 54613104. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:08:31,346][22439] Avg episode reward: [(0, '1460.350')] [2023-03-11 14:08:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000106704_54632448.pth... [2023-03-11 14:08:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000106064_54304768.pth [2023-03-11 14:08:31,869][22726] Updated weights for policy 0, policy_version 106720 (0.0003) [2023-03-11 14:08:35,412][22726] Updated weights for policy 0, policy_version 106800 (0.0003) [2023-03-11 14:08:36,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11127.5, 300 sec: 11593.8). Total num frames: 54689792. Throughput: 0: 10981.3. Samples: 54681664. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:08:36,346][22439] Avg episode reward: [(0, '1347.933')] [2023-03-11 14:08:39,142][22726] Updated weights for policy 0, policy_version 106880 (0.0005) [2023-03-11 14:08:41,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11059.2, 300 sec: 11579.9). Total num frames: 54743040. Throughput: 0: 11030.8. Samples: 54715244. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:08:41,346][22439] Avg episode reward: [(0, '1218.429')] [2023-03-11 14:08:43,012][22726] Updated weights for policy 0, policy_version 106960 (0.0005) [2023-03-11 14:08:46,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10922.7, 300 sec: 11566.0). Total num frames: 54796288. Throughput: 0: 11019.2. Samples: 54779384. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:08:46,346][22439] Avg episode reward: [(0, '1408.137')] [2023-03-11 14:08:46,372][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000107032_54800384.pth... [2023-03-11 14:08:46,373][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000106384_54468608.pth [2023-03-11 14:08:46,744][22726] Updated weights for policy 0, policy_version 107040 (0.0006) [2023-03-11 14:08:50,407][22726] Updated weights for policy 0, policy_version 107120 (0.0005) [2023-03-11 14:08:51,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 11566.0). Total num frames: 54853632. Throughput: 0: 11035.7. Samples: 54845512. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:08:51,346][22439] Avg episode reward: [(0, '1143.960')] [2023-03-11 14:08:54,064][22726] Updated weights for policy 0, policy_version 107200 (0.0005) [2023-03-11 14:08:56,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11059.2, 300 sec: 11566.0). Total num frames: 54910976. Throughput: 0: 11065.4. Samples: 54879668. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:08:56,346][22439] Avg episode reward: [(0, '1349.080')] [2023-03-11 14:08:57,784][22726] Updated weights for policy 0, policy_version 107280 (0.0005) [2023-03-11 14:09:01,315][22726] Updated weights for policy 0, policy_version 107360 (0.0005) [2023-03-11 14:09:01,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11059.2, 300 sec: 11566.0). Total num frames: 54968320. Throughput: 0: 11036.4. Samples: 54945292. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:09:01,346][22439] Avg episode reward: [(0, '1291.439')] [2023-03-11 14:09:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000107360_54968320.pth... [2023-03-11 14:09:01,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000106704_54632448.pth [2023-03-11 14:09:05,110][22726] Updated weights for policy 0, policy_version 107440 (0.0006) [2023-03-11 14:09:06,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 11552.1). Total num frames: 55021568. Throughput: 0: 11066.2. Samples: 55013372. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:09:06,346][22439] Avg episode reward: [(0, '1394.504')] [2023-03-11 14:09:08,860][22726] Updated weights for policy 0, policy_version 107520 (0.0006) [2023-03-11 14:09:11,345][22439] Fps is (10 sec: 10649.7, 60 sec: 11059.2, 300 sec: 11552.1). Total num frames: 55074816. Throughput: 0: 11083.2. Samples: 55046144. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:09:11,356][22439] Avg episode reward: [(0, '1296.946')] [2023-03-11 14:09:12,499][22726] Updated weights for policy 0, policy_version 107600 (0.0006) [2023-03-11 14:09:15,925][22726] Updated weights for policy 0, policy_version 107680 (0.0005) [2023-03-11 14:09:16,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11127.5, 300 sec: 11566.0). Total num frames: 55136256. Throughput: 0: 11142.0. Samples: 55114492. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:09:16,356][22439] Avg episode reward: [(0, '1437.908')] [2023-03-11 14:09:16,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000107688_55136256.pth... [2023-03-11 14:09:16,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000107032_54800384.pth [2023-03-11 14:09:19,579][22726] Updated weights for policy 0, policy_version 107760 (0.0005) [2023-03-11 14:09:21,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11195.8, 300 sec: 11579.9). Total num frames: 55193600. Throughput: 0: 11145.3. Samples: 55183204. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:09:21,356][22439] Avg episode reward: [(0, '1304.202')] [2023-03-11 14:09:23,059][22726] Updated weights for policy 0, policy_version 107840 (0.0005) [2023-03-11 14:09:26,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11579.9). Total num frames: 55250944. Throughput: 0: 11177.9. Samples: 55218248. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:09:26,356][22439] Avg episode reward: [(0, '1349.676')] [2023-03-11 14:09:26,474][22726] Updated weights for policy 0, policy_version 107920 (0.0005) [2023-03-11 14:09:29,790][22726] Updated weights for policy 0, policy_version 108000 (0.0005) [2023-03-11 14:09:31,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11332.3, 300 sec: 11593.8). Total num frames: 55312384. Throughput: 0: 11387.5. Samples: 55291820. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:09:31,356][22439] Avg episode reward: [(0, '1014.934')] [2023-03-11 14:09:31,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000108032_55312384.pth... [2023-03-11 14:09:31,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000107360_54968320.pth [2023-03-11 14:09:33,254][22726] Updated weights for policy 0, policy_version 108080 (0.0005) [2023-03-11 14:09:36,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11400.5, 300 sec: 11593.8). Total num frames: 55373824. Throughput: 0: 11487.5. Samples: 55362448. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-11 14:09:36,356][22439] Avg episode reward: [(0, '1102.224')] [2023-03-11 14:09:36,708][22726] Updated weights for policy 0, policy_version 108160 (0.0003) [2023-03-11 14:09:40,244][22726] Updated weights for policy 0, policy_version 108240 (0.0003) [2023-03-11 14:09:41,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 11593.8). Total num frames: 55431168. Throughput: 0: 11528.8. Samples: 55398464. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:09:41,356][22439] Avg episode reward: [(0, '1124.335')] [2023-03-11 14:09:43,716][22726] Updated weights for policy 0, policy_version 108320 (0.0003) [2023-03-11 14:09:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11593.8). Total num frames: 55488512. Throughput: 0: 11617.9. Samples: 55468096. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:09:46,356][22439] Avg episode reward: [(0, '1094.049')] [2023-03-11 14:09:46,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000108376_55488512.pth... [2023-03-11 14:09:46,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000107688_55136256.pth [2023-03-11 14:09:47,140][22726] Updated weights for policy 0, policy_version 108400 (0.0003) [2023-03-11 14:09:50,671][22726] Updated weights for policy 0, policy_version 108480 (0.0005) [2023-03-11 14:09:51,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11579.9). Total num frames: 55545856. Throughput: 0: 11672.7. Samples: 55538644. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:09:51,356][22439] Avg episode reward: [(0, '1129.410')] [2023-03-11 14:09:54,282][22726] Updated weights for policy 0, policy_version 108560 (0.0005) [2023-03-11 14:09:56,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11579.9). Total num frames: 55603200. Throughput: 0: 11704.6. Samples: 55572852. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:09:56,346][22439] Avg episode reward: [(0, '1157.670')] [2023-03-11 14:09:57,843][22726] Updated weights for policy 0, policy_version 108640 (0.0005) [2023-03-11 14:10:01,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11579.9). Total num frames: 55660544. Throughput: 0: 11695.6. Samples: 55640796. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:10:01,346][22439] Avg episode reward: [(0, '917.881')] [2023-03-11 14:10:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000108712_55660544.pth... [2023-03-11 14:10:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000108032_55312384.pth [2023-03-11 14:10:01,517][22726] Updated weights for policy 0, policy_version 108720 (0.0005) [2023-03-11 14:10:05,041][22726] Updated weights for policy 0, policy_version 108800 (0.0005) [2023-03-11 14:10:06,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11593.8). Total num frames: 55717888. Throughput: 0: 11701.2. Samples: 55709760. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:10:06,346][22439] Avg episode reward: [(0, '982.093')] [2023-03-11 14:10:08,649][22726] Updated weights for policy 0, policy_version 108880 (0.0005) [2023-03-11 14:10:11,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 11593.8). Total num frames: 55775232. Throughput: 0: 11682.3. Samples: 55743952. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:10:11,346][22439] Avg episode reward: [(0, '1470.069')] [2023-03-11 14:10:12,097][22726] Updated weights for policy 0, policy_version 108960 (0.0005) [2023-03-11 14:10:15,397][22726] Updated weights for policy 0, policy_version 109040 (0.0005) [2023-03-11 14:10:16,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11607.6). Total num frames: 55836672. Throughput: 0: 11654.1. Samples: 55816256. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:10:16,346][22439] Avg episode reward: [(0, '988.956')] [2023-03-11 14:10:16,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000109064_55840768.pth... [2023-03-11 14:10:16,361][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000108376_55488512.pth [2023-03-11 14:10:18,667][22726] Updated weights for policy 0, policy_version 109120 (0.0005) [2023-03-11 14:10:21,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11607.6). Total num frames: 55898112. Throughput: 0: 11726.4. Samples: 55890136. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:10:21,346][22439] Avg episode reward: [(0, '1015.073')] [2023-03-11 14:10:22,122][22726] Updated weights for policy 0, policy_version 109200 (0.0005) [2023-03-11 14:10:25,438][22726] Updated weights for policy 0, policy_version 109280 (0.0004) [2023-03-11 14:10:26,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11810.1, 300 sec: 11607.7). Total num frames: 55959552. Throughput: 0: 11740.4. Samples: 55926784. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:10:26,346][22439] Avg episode reward: [(0, '1034.982')] [2023-03-11 14:10:28,924][22726] Updated weights for policy 0, policy_version 109360 (0.0004) [2023-03-11 14:10:31,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11607.6). Total num frames: 56016896. Throughput: 0: 11780.8. Samples: 55998232. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:10:31,346][22439] Avg episode reward: [(0, '1578.507')] [2023-03-11 14:10:31,381][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000109416_56020992.pth... [2023-03-11 14:10:31,383][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000108712_55660544.pth [2023-03-11 14:10:32,424][22726] Updated weights for policy 0, policy_version 109440 (0.0004) [2023-03-11 14:10:35,832][22726] Updated weights for policy 0, policy_version 109520 (0.0005) [2023-03-11 14:10:36,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11607.7). Total num frames: 56078336. Throughput: 0: 11788.7. Samples: 56069136. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:10:36,356][22439] Avg episode reward: [(0, '1657.054')] [2023-03-11 14:10:39,296][22726] Updated weights for policy 0, policy_version 109600 (0.0005) [2023-03-11 14:10:41,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11741.9, 300 sec: 11593.8). Total num frames: 56135680. Throughput: 0: 11824.0. Samples: 56104932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:10:41,356][22439] Avg episode reward: [(0, '1430.975')] [2023-03-11 14:10:42,888][22726] Updated weights for policy 0, policy_version 109680 (0.0005) [2023-03-11 14:10:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11579.9). Total num frames: 56193024. Throughput: 0: 11840.2. Samples: 56173604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:10:46,346][22439] Avg episode reward: [(0, '1124.204')] [2023-03-11 14:10:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000109752_56193024.pth... [2023-03-11 14:10:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000109064_55840768.pth [2023-03-11 14:10:46,453][22726] Updated weights for policy 0, policy_version 109760 (0.0005) [2023-03-11 14:10:49,972][22726] Updated weights for policy 0, policy_version 109840 (0.0005) [2023-03-11 14:10:51,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11741.9, 300 sec: 11566.0). Total num frames: 56250368. Throughput: 0: 11852.4. Samples: 56243120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:10:51,346][22439] Avg episode reward: [(0, '1353.431')] [2023-03-11 14:10:53,510][22726] Updated weights for policy 0, policy_version 109920 (0.0005) [2023-03-11 14:10:56,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11579.9). Total num frames: 56311808. Throughput: 0: 11881.5. Samples: 56278620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:10:56,346][22439] Avg episode reward: [(0, '1258.554')] [2023-03-11 14:10:57,013][22726] Updated weights for policy 0, policy_version 110000 (0.0005) [2023-03-11 14:11:00,731][22726] Updated weights for policy 0, policy_version 110080 (0.0005) [2023-03-11 14:11:01,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11552.1). Total num frames: 56365056. Throughput: 0: 11780.3. Samples: 56346368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:11:01,346][22439] Avg episode reward: [(0, '1063.438')] [2023-03-11 14:11:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000110088_56365056.pth... [2023-03-11 14:11:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000109416_56020992.pth [2023-03-11 14:11:04,475][22726] Updated weights for policy 0, policy_version 110160 (0.0006) [2023-03-11 14:11:06,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11741.9, 300 sec: 11538.2). Total num frames: 56422400. Throughput: 0: 11613.2. Samples: 56412732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:11:06,346][22439] Avg episode reward: [(0, '1426.383')] [2023-03-11 14:11:08,007][22726] Updated weights for policy 0, policy_version 110240 (0.0005) [2023-03-11 14:11:11,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 11524.3). Total num frames: 56479744. Throughput: 0: 11572.6. Samples: 56447552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:11:11,346][22439] Avg episode reward: [(0, '1227.041')] [2023-03-11 14:11:11,349][22726] Updated weights for policy 0, policy_version 110320 (0.0005) [2023-03-11 14:11:14,655][22726] Updated weights for policy 0, policy_version 110400 (0.0005) [2023-03-11 14:11:16,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11741.9, 300 sec: 11524.3). Total num frames: 56541184. Throughput: 0: 11636.1. Samples: 56521856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:11:16,346][22439] Avg episode reward: [(0, '1062.562')] [2023-03-11 14:11:16,373][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000110440_56545280.pth... [2023-03-11 14:11:16,374][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000109752_56193024.pth [2023-03-11 14:11:18,205][22726] Updated weights for policy 0, policy_version 110480 (0.0006) [2023-03-11 14:11:21,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11510.5). Total num frames: 56598528. Throughput: 0: 11609.5. Samples: 56591564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:11:21,346][22439] Avg episode reward: [(0, '1245.454')] [2023-03-11 14:11:21,710][22726] Updated weights for policy 0, policy_version 110560 (0.0005) [2023-03-11 14:11:25,240][22726] Updated weights for policy 0, policy_version 110640 (0.0005) [2023-03-11 14:11:26,345][22439] Fps is (10 sec: 11878.6, 60 sec: 11673.6, 300 sec: 11510.5). Total num frames: 56659968. Throughput: 0: 11595.8. Samples: 56626744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:11:26,346][22439] Avg episode reward: [(0, '1205.547')] [2023-03-11 14:11:28,586][22726] Updated weights for policy 0, policy_version 110720 (0.0004) [2023-03-11 14:11:31,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11510.5). Total num frames: 56721408. Throughput: 0: 11684.2. Samples: 56699392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:11:31,346][22439] Avg episode reward: [(0, '966.514')] [2023-03-11 14:11:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000110784_56721408.pth... [2023-03-11 14:11:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000110088_56365056.pth [2023-03-11 14:11:31,982][22726] Updated weights for policy 0, policy_version 110800 (0.0004) [2023-03-11 14:11:35,598][22726] Updated weights for policy 0, policy_version 110880 (0.0005) [2023-03-11 14:11:36,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11496.6). Total num frames: 56778752. Throughput: 0: 11676.2. Samples: 56768548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:11:36,346][22439] Avg episode reward: [(0, '1232.539')] [2023-03-11 14:11:39,131][22726] Updated weights for policy 0, policy_version 110960 (0.0005) [2023-03-11 14:11:41,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11496.6). Total num frames: 56836096. Throughput: 0: 11660.2. Samples: 56803328. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:11:41,346][22439] Avg episode reward: [(0, '1006.699')] [2023-03-11 14:11:42,735][22726] Updated weights for policy 0, policy_version 111040 (0.0005) [2023-03-11 14:11:46,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11605.3, 300 sec: 11468.8). Total num frames: 56889344. Throughput: 0: 11683.1. Samples: 56872108. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:11:46,346][22439] Avg episode reward: [(0, '1221.173')] [2023-03-11 14:11:46,408][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000111120_56893440.pth... [2023-03-11 14:11:46,409][22726] Updated weights for policy 0, policy_version 111120 (0.0005) [2023-03-11 14:11:46,410][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000110440_56545280.pth [2023-03-11 14:11:50,112][22726] Updated weights for policy 0, policy_version 111200 (0.0005) [2023-03-11 14:11:51,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11605.3, 300 sec: 11482.7). Total num frames: 56946688. Throughput: 0: 11683.6. Samples: 56938496. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:11:51,346][22439] Avg episode reward: [(0, '1394.847')] [2023-03-11 14:11:53,848][22726] Updated weights for policy 0, policy_version 111280 (0.0005) [2023-03-11 14:11:56,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11468.8, 300 sec: 11468.8). Total num frames: 56999936. Throughput: 0: 11637.2. Samples: 56971228. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:11:56,346][22439] Avg episode reward: [(0, '1301.712')] [2023-03-11 14:11:57,424][22726] Updated weights for policy 0, policy_version 111360 (0.0005) [2023-03-11 14:12:00,918][22726] Updated weights for policy 0, policy_version 111440 (0.0004) [2023-03-11 14:12:01,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11468.8). Total num frames: 57061376. Throughput: 0: 11500.4. Samples: 57039372. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:12:01,346][22439] Avg episode reward: [(0, '1181.235')] [2023-03-11 14:12:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000111448_57061376.pth... [2023-03-11 14:12:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000110784_56721408.pth [2023-03-11 14:12:04,306][22726] Updated weights for policy 0, policy_version 111520 (0.0004) [2023-03-11 14:12:06,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 11482.7). Total num frames: 57122816. Throughput: 0: 11556.2. Samples: 57111592. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:12:06,346][22439] Avg episode reward: [(0, '1466.658')] [2023-03-11 14:12:07,703][22726] Updated weights for policy 0, policy_version 111600 (0.0004) [2023-03-11 14:12:11,106][22726] Updated weights for policy 0, policy_version 111680 (0.0004) [2023-03-11 14:12:11,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11468.8). Total num frames: 57180160. Throughput: 0: 11571.6. Samples: 57147464. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:12:11,346][22439] Avg episode reward: [(0, '1217.670')] [2023-03-11 14:12:14,538][22726] Updated weights for policy 0, policy_version 111760 (0.0004) [2023-03-11 14:12:16,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11605.4, 300 sec: 11468.8). Total num frames: 57237504. Throughput: 0: 11577.7. Samples: 57220388. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:12:16,346][22439] Avg episode reward: [(0, '1051.712')] [2023-03-11 14:12:16,405][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000111800_57241600.pth... [2023-03-11 14:12:16,406][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000111120_56893440.pth [2023-03-11 14:12:18,272][22726] Updated weights for policy 0, policy_version 111840 (0.0005) [2023-03-11 14:12:21,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11482.7). Total num frames: 57294848. Throughput: 0: 11514.9. Samples: 57286720. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:12:21,346][22439] Avg episode reward: [(0, '1335.349')] [2023-03-11 14:12:21,797][22726] Updated weights for policy 0, policy_version 111920 (0.0005) [2023-03-11 14:12:25,250][22726] Updated weights for policy 0, policy_version 112000 (0.0005) [2023-03-11 14:12:26,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11496.6). Total num frames: 57356288. Throughput: 0: 11540.2. Samples: 57322636. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:12:26,346][22439] Avg episode reward: [(0, '1192.071')] [2023-03-11 14:12:28,642][22726] Updated weights for policy 0, policy_version 112080 (0.0004) [2023-03-11 14:12:31,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 11496.6). Total num frames: 57413632. Throughput: 0: 11607.0. Samples: 57394424. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:12:31,346][22439] Avg episode reward: [(0, '1311.456')] [2023-03-11 14:12:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000112136_57413632.pth... [2023-03-11 14:12:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000111448_57061376.pth [2023-03-11 14:12:32,089][22726] Updated weights for policy 0, policy_version 112160 (0.0004) [2023-03-11 14:12:35,449][22726] Updated weights for policy 0, policy_version 112240 (0.0004) [2023-03-11 14:12:36,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11510.5). Total num frames: 57475072. Throughput: 0: 11741.3. Samples: 57466856. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:12:36,346][22439] Avg episode reward: [(0, '1033.653')] [2023-03-11 14:12:38,772][22726] Updated weights for policy 0, policy_version 112320 (0.0004) [2023-03-11 14:12:41,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11673.6, 300 sec: 11510.5). Total num frames: 57536512. Throughput: 0: 11833.9. Samples: 57503752. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:12:41,346][22439] Avg episode reward: [(0, '1217.806')] [2023-03-11 14:12:42,217][22726] Updated weights for policy 0, policy_version 112400 (0.0004) [2023-03-11 14:12:45,623][22726] Updated weights for policy 0, policy_version 112480 (0.0004) [2023-03-11 14:12:46,345][22439] Fps is (10 sec: 12287.9, 60 sec: 11810.1, 300 sec: 11538.2). Total num frames: 57597952. Throughput: 0: 11900.7. Samples: 57574904. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:12:46,346][22439] Avg episode reward: [(0, '1022.219')] [2023-03-11 14:12:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000112496_57597952.pth... [2023-03-11 14:12:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000111800_57241600.pth [2023-03-11 14:12:48,896][22726] Updated weights for policy 0, policy_version 112560 (0.0004) [2023-03-11 14:12:51,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11566.0). Total num frames: 57659392. Throughput: 0: 11977.7. Samples: 57650588. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:12:51,346][22439] Avg episode reward: [(0, '915.665')] [2023-03-11 14:12:52,125][22726] Updated weights for policy 0, policy_version 112640 (0.0004) [2023-03-11 14:12:55,488][22726] Updated weights for policy 0, policy_version 112720 (0.0004) [2023-03-11 14:12:56,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11579.9). Total num frames: 57720832. Throughput: 0: 11998.5. Samples: 57687396. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:12:56,346][22439] Avg episode reward: [(0, '1223.602')] [2023-03-11 14:12:58,808][22726] Updated weights for policy 0, policy_version 112800 (0.0004) [2023-03-11 14:13:01,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12014.9, 300 sec: 11607.6). Total num frames: 57782272. Throughput: 0: 12028.3. Samples: 57761660. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:13:01,346][22439] Avg episode reward: [(0, '1184.513')] [2023-03-11 14:13:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000112856_57782272.pth... [2023-03-11 14:13:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000112136_57413632.pth [2023-03-11 14:13:02,156][22726] Updated weights for policy 0, policy_version 112880 (0.0004) [2023-03-11 14:13:05,550][22726] Updated weights for policy 0, policy_version 112960 (0.0005) [2023-03-11 14:13:06,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11635.4). Total num frames: 57843712. Throughput: 0: 12169.5. Samples: 57834348. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:13:06,346][22439] Avg episode reward: [(0, '886.313')] [2023-03-11 14:13:08,848][22726] Updated weights for policy 0, policy_version 113040 (0.0005) [2023-03-11 14:13:11,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11649.3). Total num frames: 57905152. Throughput: 0: 12199.2. Samples: 57871600. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:13:11,346][22439] Avg episode reward: [(0, '916.705')] [2023-03-11 14:13:12,248][22726] Updated weights for policy 0, policy_version 113120 (0.0004) [2023-03-11 14:13:15,626][22726] Updated weights for policy 0, policy_version 113200 (0.0004) [2023-03-11 14:13:16,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 11677.1). Total num frames: 57966592. Throughput: 0: 12209.5. Samples: 57943848. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:13:16,346][22439] Avg episode reward: [(0, '974.455')] [2023-03-11 14:13:16,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000113216_57966592.pth... [2023-03-11 14:13:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000112496_57597952.pth [2023-03-11 14:13:19,007][22726] Updated weights for policy 0, policy_version 113280 (0.0004) [2023-03-11 14:13:21,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12219.7, 300 sec: 11704.8). Total num frames: 58028032. Throughput: 0: 12204.4. Samples: 58016052. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:13:21,346][22439] Avg episode reward: [(0, '1065.589')] [2023-03-11 14:13:22,342][22726] Updated weights for policy 0, policy_version 113360 (0.0005) [2023-03-11 14:13:25,558][22726] Updated weights for policy 0, policy_version 113440 (0.0004) [2023-03-11 14:13:26,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12219.7, 300 sec: 11718.7). Total num frames: 58089472. Throughput: 0: 12224.1. Samples: 58053836. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:13:26,346][22439] Avg episode reward: [(0, '929.227')] [2023-03-11 14:13:29,032][22726] Updated weights for policy 0, policy_version 113520 (0.0004) [2023-03-11 14:13:31,345][22439] Fps is (10 sec: 11878.2, 60 sec: 12219.7, 300 sec: 11718.7). Total num frames: 58146816. Throughput: 0: 12255.5. Samples: 58126400. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:13:31,346][22439] Avg episode reward: [(0, '1056.418')] [2023-03-11 14:13:31,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000113568_58146816.pth... [2023-03-11 14:13:31,353][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000112856_57782272.pth [2023-03-11 14:13:32,553][22726] Updated weights for policy 0, policy_version 113600 (0.0005) [2023-03-11 14:13:36,051][22726] Updated weights for policy 0, policy_version 113680 (0.0005) [2023-03-11 14:13:36,345][22439] Fps is (10 sec: 11468.9, 60 sec: 12151.5, 300 sec: 11732.6). Total num frames: 58204160. Throughput: 0: 12136.2. Samples: 58196716. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:13:36,346][22439] Avg episode reward: [(0, '780.092')] [2023-03-11 14:13:39,616][22726] Updated weights for policy 0, policy_version 113760 (0.0005) [2023-03-11 14:13:41,345][22439] Fps is (10 sec: 11469.0, 60 sec: 12083.2, 300 sec: 11746.5). Total num frames: 58261504. Throughput: 0: 12098.4. Samples: 58231824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:13:41,346][22439] Avg episode reward: [(0, '739.498')] [2023-03-11 14:13:43,275][22726] Updated weights for policy 0, policy_version 113840 (0.0004) [2023-03-11 14:13:46,345][22439] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 11760.4). Total num frames: 58322944. Throughput: 0: 11991.8. Samples: 58301292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:13:46,346][22439] Avg episode reward: [(0, '825.505')] [2023-03-11 14:13:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000113912_58322944.pth... [2023-03-11 14:13:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000113216_57966592.pth [2023-03-11 14:13:46,442][22726] Updated weights for policy 0, policy_version 113920 (0.0003) [2023-03-11 14:13:49,780][22726] Updated weights for policy 0, policy_version 114000 (0.0005) [2023-03-11 14:13:51,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12151.5, 300 sec: 11788.2). Total num frames: 58388480. Throughput: 0: 12042.4. Samples: 58376256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:13:51,346][22439] Avg episode reward: [(0, '1030.261')] [2023-03-11 14:13:52,973][22726] Updated weights for policy 0, policy_version 114080 (0.0004) [2023-03-11 14:13:56,213][22726] Updated weights for policy 0, policy_version 114160 (0.0004) [2023-03-11 14:13:56,345][22439] Fps is (10 sec: 12697.7, 60 sec: 12151.5, 300 sec: 11802.0). Total num frames: 58449920. Throughput: 0: 12053.0. Samples: 58413984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:13:56,346][22439] Avg episode reward: [(0, '709.441')] [2023-03-11 14:13:59,727][22726] Updated weights for policy 0, policy_version 114240 (0.0005) [2023-03-11 14:14:01,345][22439] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 11815.9). Total num frames: 58507264. Throughput: 0: 12076.1. Samples: 58487272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:14:01,346][22439] Avg episode reward: [(0, '1021.364')] [2023-03-11 14:14:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000114272_58507264.pth... [2023-03-11 14:14:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000113568_58146816.pth [2023-03-11 14:14:03,239][22726] Updated weights for policy 0, policy_version 114320 (0.0005) [2023-03-11 14:14:06,345][22439] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11829.8). Total num frames: 58564608. Throughput: 0: 12008.1. Samples: 58556416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:14:06,346][22439] Avg episode reward: [(0, '903.114')] [2023-03-11 14:14:06,754][22726] Updated weights for policy 0, policy_version 114400 (0.0004) [2023-03-11 14:14:10,047][22726] Updated weights for policy 0, policy_version 114480 (0.0004) [2023-03-11 14:14:11,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12083.2, 300 sec: 11843.7). Total num frames: 58630144. Throughput: 0: 11989.1. Samples: 58593344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:14:11,346][22439] Avg episode reward: [(0, '640.474')] [2023-03-11 14:14:13,268][22726] Updated weights for policy 0, policy_version 114560 (0.0003) [2023-03-11 14:14:16,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12083.2, 300 sec: 11857.6). Total num frames: 58691584. Throughput: 0: 12029.7. Samples: 58667736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:14:16,346][22439] Avg episode reward: [(0, '722.275')] [2023-03-11 14:14:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000114632_58691584.pth... [2023-03-11 14:14:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000113912_58322944.pth [2023-03-11 14:14:16,620][22726] Updated weights for policy 0, policy_version 114640 (0.0003) [2023-03-11 14:14:19,938][22726] Updated weights for policy 0, policy_version 114720 (0.0003) [2023-03-11 14:14:21,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12083.2, 300 sec: 11871.5). Total num frames: 58753024. Throughput: 0: 12127.5. Samples: 58742452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:14:21,346][22439] Avg episode reward: [(0, '853.260')] [2023-03-11 14:14:23,368][22726] Updated weights for policy 0, policy_version 114800 (0.0003) [2023-03-11 14:14:26,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11857.6). Total num frames: 58810368. Throughput: 0: 12136.0. Samples: 58777944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:14:26,346][22439] Avg episode reward: [(0, '988.892')] [2023-03-11 14:14:26,867][22726] Updated weights for policy 0, policy_version 114880 (0.0005) [2023-03-11 14:14:30,389][22726] Updated weights for policy 0, policy_version 114960 (0.0006) [2023-03-11 14:14:31,345][22439] Fps is (10 sec: 11468.7, 60 sec: 12014.9, 300 sec: 11843.7). Total num frames: 58867712. Throughput: 0: 12150.7. Samples: 58848072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:14:31,346][22439] Avg episode reward: [(0, '830.802')] [2023-03-11 14:14:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000114976_58867712.pth... [2023-03-11 14:14:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000114272_58507264.pth [2023-03-11 14:14:33,913][22726] Updated weights for policy 0, policy_version 115040 (0.0005) [2023-03-11 14:14:36,345][22439] Fps is (10 sec: 11468.9, 60 sec: 12014.9, 300 sec: 11843.7). Total num frames: 58925056. Throughput: 0: 12042.8. Samples: 58918180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:14:36,346][22439] Avg episode reward: [(0, '971.167')] [2023-03-11 14:14:37,429][22726] Updated weights for policy 0, policy_version 115120 (0.0005) [2023-03-11 14:14:40,999][22726] Updated weights for policy 0, policy_version 115200 (0.0005) [2023-03-11 14:14:41,345][22439] Fps is (10 sec: 11468.9, 60 sec: 12014.9, 300 sec: 11843.7). Total num frames: 58982400. Throughput: 0: 11989.0. Samples: 58953488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:14:41,346][22439] Avg episode reward: [(0, '851.273')] [2023-03-11 14:14:44,332][22726] Updated weights for policy 0, policy_version 115280 (0.0005) [2023-03-11 14:14:46,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11871.5). Total num frames: 59047936. Throughput: 0: 11929.5. Samples: 59024100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:14:46,346][22439] Avg episode reward: [(0, '893.787')] [2023-03-11 14:14:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000115328_59047936.pth... [2023-03-11 14:14:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000114632_58691584.pth [2023-03-11 14:14:47,657][22726] Updated weights for policy 0, policy_version 115360 (0.0005) [2023-03-11 14:14:50,979][22726] Updated weights for policy 0, policy_version 115440 (0.0005) [2023-03-11 14:14:51,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11885.3). Total num frames: 59109376. Throughput: 0: 12042.0. Samples: 59098308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:14:51,346][22439] Avg episode reward: [(0, '839.113')] [2023-03-11 14:14:54,198][22726] Updated weights for policy 0, policy_version 115520 (0.0005) [2023-03-11 14:14:56,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11899.2). Total num frames: 59170816. Throughput: 0: 12061.7. Samples: 59136120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:14:56,346][22439] Avg episode reward: [(0, '672.608')] [2023-03-11 14:14:57,499][22726] Updated weights for policy 0, policy_version 115600 (0.0005) [2023-03-11 14:15:00,666][22726] Updated weights for policy 0, policy_version 115680 (0.0004) [2023-03-11 14:15:01,345][22439] Fps is (10 sec: 12697.4, 60 sec: 12151.4, 300 sec: 11927.0). Total num frames: 59236352. Throughput: 0: 12093.6. Samples: 59211948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:15:01,346][22439] Avg episode reward: [(0, '798.543')] [2023-03-11 14:15:01,351][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000115696_59236352.pth... [2023-03-11 14:15:01,353][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000114976_58867712.pth [2023-03-11 14:15:03,930][22726] Updated weights for policy 0, policy_version 115760 (0.0004) [2023-03-11 14:15:06,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 11940.9). Total num frames: 59297792. Throughput: 0: 12126.0. Samples: 59288120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:15:06,356][22439] Avg episode reward: [(0, '885.031')] [2023-03-11 14:15:07,164][22726] Updated weights for policy 0, policy_version 115840 (0.0005) [2023-03-11 14:15:10,449][22726] Updated weights for policy 0, policy_version 115920 (0.0005) [2023-03-11 14:15:11,345][22439] Fps is (10 sec: 12288.2, 60 sec: 12151.5, 300 sec: 11940.9). Total num frames: 59359232. Throughput: 0: 12176.9. Samples: 59325904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:15:11,346][22439] Avg episode reward: [(0, '845.994')] [2023-03-11 14:15:13,688][22726] Updated weights for policy 0, policy_version 116000 (0.0005) [2023-03-11 14:15:16,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 11954.8). Total num frames: 59424768. Throughput: 0: 12295.3. Samples: 59401360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:15:16,356][22439] Avg episode reward: [(0, '725.408')] [2023-03-11 14:15:16,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000116064_59424768.pth... [2023-03-11 14:15:16,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000115328_59047936.pth [2023-03-11 14:15:16,892][22726] Updated weights for policy 0, policy_version 116080 (0.0005) [2023-03-11 14:15:20,144][22726] Updated weights for policy 0, policy_version 116160 (0.0005) [2023-03-11 14:15:21,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 11954.8). Total num frames: 59486208. Throughput: 0: 12433.8. Samples: 59477704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:15:21,346][22439] Avg episode reward: [(0, '692.611')] [2023-03-11 14:15:23,439][22726] Updated weights for policy 0, policy_version 116240 (0.0005) [2023-03-11 14:15:26,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 11968.7). Total num frames: 59547648. Throughput: 0: 12475.0. Samples: 59514864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:15:26,348][22439] Avg episode reward: [(0, '1015.604')] [2023-03-11 14:15:26,791][22726] Updated weights for policy 0, policy_version 116320 (0.0005) [2023-03-11 14:15:30,017][22726] Updated weights for policy 0, policy_version 116400 (0.0005) [2023-03-11 14:15:31,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 11982.5). Total num frames: 59613184. Throughput: 0: 12557.2. Samples: 59589176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:15:31,356][22439] Avg episode reward: [(0, '806.521')] [2023-03-11 14:15:31,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000116432_59613184.pth... [2023-03-11 14:15:31,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000115696_59236352.pth [2023-03-11 14:15:33,294][22726] Updated weights for policy 0, policy_version 116480 (0.0005) [2023-03-11 14:15:36,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 11996.4). Total num frames: 59674624. Throughput: 0: 12592.0. Samples: 59664948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:15:36,356][22439] Avg episode reward: [(0, '866.939')] [2023-03-11 14:15:36,505][22726] Updated weights for policy 0, policy_version 116560 (0.0005) [2023-03-11 14:15:39,785][22726] Updated weights for policy 0, policy_version 116640 (0.0005) [2023-03-11 14:15:41,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12010.3). Total num frames: 59736064. Throughput: 0: 12588.7. Samples: 59702612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:15:41,356][22439] Avg episode reward: [(0, '1011.897')] [2023-03-11 14:15:43,071][22726] Updated weights for policy 0, policy_version 116720 (0.0005) [2023-03-11 14:15:46,275][22726] Updated weights for policy 0, policy_version 116800 (0.0004) [2023-03-11 14:15:46,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12561.1, 300 sec: 12038.1). Total num frames: 59801600. Throughput: 0: 12569.5. Samples: 59777576. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 14:15:46,346][22439] Avg episode reward: [(0, '927.652')] [2023-03-11 14:15:46,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000116800_59801600.pth... [2023-03-11 14:15:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000116064_59424768.pth [2023-03-11 14:15:49,593][22726] Updated weights for policy 0, policy_version 116880 (0.0005) [2023-03-11 14:15:51,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12038.1). Total num frames: 59863040. Throughput: 0: 12551.9. Samples: 59852956. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 14:15:51,346][22439] Avg episode reward: [(0, '898.645')] [2023-03-11 14:15:52,868][22726] Updated weights for policy 0, policy_version 116960 (0.0005) [2023-03-11 14:15:56,148][22726] Updated weights for policy 0, policy_version 117040 (0.0005) [2023-03-11 14:15:56,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12065.8). Total num frames: 59924480. Throughput: 0: 12554.7. Samples: 59890864. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 14:15:56,346][22439] Avg episode reward: [(0, '1002.430')] [2023-03-11 14:15:59,439][22726] Updated weights for policy 0, policy_version 117120 (0.0005) [2023-03-11 14:16:01,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12492.8, 300 sec: 12079.7). Total num frames: 59985920. Throughput: 0: 12533.7. Samples: 59965376. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 14:16:01,346][22439] Avg episode reward: [(0, '741.350')] [2023-03-11 14:16:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000117160_59985920.pth... [2023-03-11 14:16:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000116432_59613184.pth [2023-03-11 14:16:02,758][22726] Updated weights for policy 0, policy_version 117200 (0.0005) [2023-03-11 14:16:06,229][22726] Updated weights for policy 0, policy_version 117280 (0.0005) [2023-03-11 14:16:06,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12093.6). Total num frames: 60047360. Throughput: 0: 12432.6. Samples: 60037172. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 14:16:06,346][22439] Avg episode reward: [(0, '855.330')] [2023-03-11 14:16:09,602][22726] Updated weights for policy 0, policy_version 117360 (0.0005) [2023-03-11 14:16:11,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12492.8, 300 sec: 12093.6). Total num frames: 60108800. Throughput: 0: 12421.7. Samples: 60073840. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 14:16:11,346][22439] Avg episode reward: [(0, '1136.382')] [2023-03-11 14:16:12,864][22726] Updated weights for policy 0, policy_version 117440 (0.0005) [2023-03-11 14:16:16,037][22726] Updated weights for policy 0, policy_version 117520 (0.0005) [2023-03-11 14:16:16,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12424.5, 300 sec: 12107.5). Total num frames: 60170240. Throughput: 0: 12458.9. Samples: 60149824. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 14:16:16,346][22439] Avg episode reward: [(0, '606.705')] [2023-03-11 14:16:16,368][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000117528_60174336.pth... [2023-03-11 14:16:16,370][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000116800_59801600.pth [2023-03-11 14:16:19,220][22726] Updated weights for policy 0, policy_version 117600 (0.0004) [2023-03-11 14:16:21,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12121.4). Total num frames: 60235776. Throughput: 0: 12488.8. Samples: 60226944. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 14:16:21,346][22439] Avg episode reward: [(0, '782.503')] [2023-03-11 14:16:22,515][22726] Updated weights for policy 0, policy_version 117680 (0.0005) [2023-03-11 14:16:25,713][22726] Updated weights for policy 0, policy_version 117760 (0.0005) [2023-03-11 14:16:26,345][22439] Fps is (10 sec: 13107.1, 60 sec: 12561.1, 300 sec: 12135.3). Total num frames: 60301312. Throughput: 0: 12473.1. Samples: 60263900. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 14:16:26,346][22439] Avg episode reward: [(0, '781.572')] [2023-03-11 14:16:28,978][22726] Updated weights for policy 0, policy_version 117840 (0.0004) [2023-03-11 14:16:31,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12149.2). Total num frames: 60362752. Throughput: 0: 12489.1. Samples: 60339584. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 14:16:31,346][22439] Avg episode reward: [(0, '959.525')] [2023-03-11 14:16:31,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000117896_60362752.pth... [2023-03-11 14:16:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000117160_59985920.pth [2023-03-11 14:16:32,136][22726] Updated weights for policy 0, policy_version 117920 (0.0004) [2023-03-11 14:16:35,303][22726] Updated weights for policy 0, policy_version 118000 (0.0005) [2023-03-11 14:16:36,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12176.9). Total num frames: 60428288. Throughput: 0: 12543.8. Samples: 60417428. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 14:16:36,346][22439] Avg episode reward: [(0, '862.032')] [2023-03-11 14:16:38,497][22726] Updated weights for policy 0, policy_version 118080 (0.0005) [2023-03-11 14:16:41,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12204.7). Total num frames: 60489728. Throughput: 0: 12566.0. Samples: 60456332. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 14:16:41,346][22439] Avg episode reward: [(0, '761.934')] [2023-03-11 14:16:41,737][22726] Updated weights for policy 0, policy_version 118160 (0.0004) [2023-03-11 14:16:44,901][22726] Updated weights for policy 0, policy_version 118240 (0.0004) [2023-03-11 14:16:46,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12232.5). Total num frames: 60555264. Throughput: 0: 12594.7. Samples: 60532136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:16:46,346][22439] Avg episode reward: [(0, '766.400')] [2023-03-11 14:16:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000118272_60555264.pth... [2023-03-11 14:16:46,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000117528_60174336.pth [2023-03-11 14:16:48,148][22726] Updated weights for policy 0, policy_version 118320 (0.0005) [2023-03-11 14:16:51,325][22726] Updated weights for policy 0, policy_version 118400 (0.0004) [2023-03-11 14:16:51,345][22439] Fps is (10 sec: 13107.2, 60 sec: 12629.3, 300 sec: 12274.1). Total num frames: 60620800. Throughput: 0: 12697.9. Samples: 60608576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:16:51,346][22439] Avg episode reward: [(0, '760.787')] [2023-03-11 14:16:54,533][22726] Updated weights for policy 0, policy_version 118480 (0.0004) [2023-03-11 14:16:56,345][22439] Fps is (10 sec: 12697.7, 60 sec: 12629.3, 300 sec: 12274.1). Total num frames: 60682240. Throughput: 0: 12747.4. Samples: 60647472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:16:56,346][22439] Avg episode reward: [(0, '817.490')] [2023-03-11 14:16:57,828][22726] Updated weights for policy 0, policy_version 118560 (0.0004) [2023-03-11 14:17:01,071][22726] Updated weights for policy 0, policy_version 118640 (0.0005) [2023-03-11 14:17:01,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12629.3, 300 sec: 12274.1). Total num frames: 60743680. Throughput: 0: 12741.8. Samples: 60723208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:17:01,346][22439] Avg episode reward: [(0, '1027.696')] [2023-03-11 14:17:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000118640_60743680.pth... [2023-03-11 14:17:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000117896_60362752.pth [2023-03-11 14:17:04,318][22726] Updated weights for policy 0, policy_version 118720 (0.0005) [2023-03-11 14:17:06,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12629.3, 300 sec: 12288.0). Total num frames: 60805120. Throughput: 0: 12670.0. Samples: 60797092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:17:06,363][22439] Avg episode reward: [(0, '732.570')] [2023-03-11 14:17:07,795][22726] Updated weights for policy 0, policy_version 118800 (0.0005) [2023-03-11 14:17:11,259][22726] Updated weights for policy 0, policy_version 118880 (0.0005) [2023-03-11 14:17:11,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12629.3, 300 sec: 12301.9). Total num frames: 60866560. Throughput: 0: 12655.0. Samples: 60833376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:17:11,356][22439] Avg episode reward: [(0, '921.238')] [2023-03-11 14:17:14,663][22726] Updated weights for policy 0, policy_version 118960 (0.0005) [2023-03-11 14:17:16,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12629.3, 300 sec: 12315.8). Total num frames: 60928000. Throughput: 0: 12545.3. Samples: 60904124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:17:16,346][22439] Avg episode reward: [(0, '780.939')] [2023-03-11 14:17:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000119000_60928000.pth... [2023-03-11 14:17:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000118272_60555264.pth [2023-03-11 14:17:17,797][22726] Updated weights for policy 0, policy_version 119040 (0.0005) [2023-03-11 14:17:21,103][22726] Updated weights for policy 0, policy_version 119120 (0.0005) [2023-03-11 14:17:21,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12315.8). Total num frames: 60989440. Throughput: 0: 12530.8. Samples: 60981312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:17:21,346][22439] Avg episode reward: [(0, '605.395')] [2023-03-11 14:17:24,536][22726] Updated weights for policy 0, policy_version 119200 (0.0006) [2023-03-11 14:17:26,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12492.8, 300 sec: 12329.7). Total num frames: 61050880. Throughput: 0: 12479.8. Samples: 61017920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:17:26,346][22439] Avg episode reward: [(0, '1010.038')] [2023-03-11 14:17:28,095][22726] Updated weights for policy 0, policy_version 119280 (0.0005) [2023-03-11 14:17:31,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 12315.8). Total num frames: 61108224. Throughput: 0: 12334.2. Samples: 61087172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:17:31,346][22439] Avg episode reward: [(0, '874.920')] [2023-03-11 14:17:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000119352_61108224.pth... [2023-03-11 14:17:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000118640_60743680.pth [2023-03-11 14:17:31,619][22726] Updated weights for policy 0, policy_version 119360 (0.0006) [2023-03-11 14:17:35,115][22726] Updated weights for policy 0, policy_version 119440 (0.0006) [2023-03-11 14:17:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 12288.0, 300 sec: 12301.9). Total num frames: 61165568. Throughput: 0: 12195.8. Samples: 61157388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:17:36,346][22439] Avg episode reward: [(0, '662.229')] [2023-03-11 14:17:38,515][22726] Updated weights for policy 0, policy_version 119520 (0.0005) [2023-03-11 14:17:41,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 12301.9). Total num frames: 61227008. Throughput: 0: 12133.0. Samples: 61193456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:17:41,346][22439] Avg episode reward: [(0, '726.998')] [2023-03-11 14:17:41,991][22726] Updated weights for policy 0, policy_version 119600 (0.0006) [2023-03-11 14:17:45,667][22726] Updated weights for policy 0, policy_version 119680 (0.0005) [2023-03-11 14:17:46,345][22439] Fps is (10 sec: 11468.7, 60 sec: 12083.2, 300 sec: 12274.1). Total num frames: 61280256. Throughput: 0: 12000.4. Samples: 61263224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:17:46,346][22439] Avg episode reward: [(0, '758.940')] [2023-03-11 14:17:46,397][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000119696_61284352.pth... [2023-03-11 14:17:46,399][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000119000_60928000.pth [2023-03-11 14:17:49,235][22726] Updated weights for policy 0, policy_version 119760 (0.0004) [2023-03-11 14:17:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 12274.1). Total num frames: 61341696. Throughput: 0: 11889.1. Samples: 61332100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:17:51,346][22439] Avg episode reward: [(0, '902.217')] [2023-03-11 14:17:52,558][22726] Updated weights for policy 0, policy_version 119840 (0.0005) [2023-03-11 14:17:55,837][22726] Updated weights for policy 0, policy_version 119920 (0.0005) [2023-03-11 14:17:56,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 12274.1). Total num frames: 61403136. Throughput: 0: 11906.4. Samples: 61369164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:17:56,346][22439] Avg episode reward: [(0, '719.901')] [2023-03-11 14:17:59,447][22726] Updated weights for policy 0, policy_version 120000 (0.0006) [2023-03-11 14:18:01,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12260.2). Total num frames: 61460480. Throughput: 0: 11908.3. Samples: 61440000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:18:01,346][22439] Avg episode reward: [(0, '808.850')] [2023-03-11 14:18:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000120040_61460480.pth... [2023-03-11 14:18:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000119352_61108224.pth [2023-03-11 14:18:03,014][22726] Updated weights for policy 0, policy_version 120080 (0.0006) [2023-03-11 14:18:06,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 12246.3). Total num frames: 61517824. Throughput: 0: 11740.7. Samples: 61509644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:18:06,346][22439] Avg episode reward: [(0, '754.401')] [2023-03-11 14:18:06,493][22726] Updated weights for policy 0, policy_version 120160 (0.0005) [2023-03-11 14:18:09,806][22726] Updated weights for policy 0, policy_version 120240 (0.0005) [2023-03-11 14:18:11,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 12246.3). Total num frames: 61579264. Throughput: 0: 11729.2. Samples: 61545736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:18:11,346][22439] Avg episode reward: [(0, '902.162')] [2023-03-11 14:18:13,124][22726] Updated weights for policy 0, policy_version 120320 (0.0005) [2023-03-11 14:18:16,228][22726] Updated weights for policy 0, policy_version 120400 (0.0004) [2023-03-11 14:18:16,345][22439] Fps is (10 sec: 12697.5, 60 sec: 11946.6, 300 sec: 12260.2). Total num frames: 61644800. Throughput: 0: 11854.4. Samples: 61620620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:18:16,346][22439] Avg episode reward: [(0, '677.886')] [2023-03-11 14:18:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000120400_61644800.pth... [2023-03-11 14:18:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000119696_61284352.pth [2023-03-11 14:18:19,552][22726] Updated weights for policy 0, policy_version 120480 (0.0005) [2023-03-11 14:18:21,345][22439] Fps is (10 sec: 12697.6, 60 sec: 11946.7, 300 sec: 12260.2). Total num frames: 61706240. Throughput: 0: 11977.6. Samples: 61696380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:18:21,346][22439] Avg episode reward: [(0, '885.933')] [2023-03-11 14:18:22,850][22726] Updated weights for policy 0, policy_version 120560 (0.0005) [2023-03-11 14:18:26,259][22726] Updated weights for policy 0, policy_version 120640 (0.0005) [2023-03-11 14:18:26,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 12274.1). Total num frames: 61767680. Throughput: 0: 12012.8. Samples: 61734032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:18:26,346][22439] Avg episode reward: [(0, '955.318')] [2023-03-11 14:18:29,814][22726] Updated weights for policy 0, policy_version 120720 (0.0006) [2023-03-11 14:18:31,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12274.1). Total num frames: 61825024. Throughput: 0: 12029.5. Samples: 61804552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:18:31,346][22439] Avg episode reward: [(0, '1045.542')] [2023-03-11 14:18:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000120752_61825024.pth... [2023-03-11 14:18:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000120040_61460480.pth [2023-03-11 14:18:33,360][22726] Updated weights for policy 0, policy_version 120800 (0.0006) [2023-03-11 14:18:36,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 12274.1). Total num frames: 61882368. Throughput: 0: 12046.1. Samples: 61874176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:18:36,346][22439] Avg episode reward: [(0, '733.574')] [2023-03-11 14:18:36,875][22726] Updated weights for policy 0, policy_version 120880 (0.0005) [2023-03-11 14:18:40,248][22726] Updated weights for policy 0, policy_version 120960 (0.0005) [2023-03-11 14:18:41,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12274.1). Total num frames: 61943808. Throughput: 0: 11986.1. Samples: 61908540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:18:41,346][22439] Avg episode reward: [(0, '669.575')] [2023-03-11 14:18:43,413][22726] Updated weights for policy 0, policy_version 121040 (0.0005) [2023-03-11 14:18:46,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 12260.2). Total num frames: 62005248. Throughput: 0: 12107.4. Samples: 61984832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:18:46,346][22439] Avg episode reward: [(0, '700.303')] [2023-03-11 14:18:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000121104_62005248.pth... [2023-03-11 14:18:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000120400_61644800.pth [2023-03-11 14:18:46,878][22726] Updated weights for policy 0, policy_version 121120 (0.0005) [2023-03-11 14:18:50,374][22726] Updated weights for policy 0, policy_version 121200 (0.0006) [2023-03-11 14:18:51,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 12246.3). Total num frames: 62062592. Throughput: 0: 12111.3. Samples: 62054652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:18:51,346][22439] Avg episode reward: [(0, '728.749')] [2023-03-11 14:18:53,968][22726] Updated weights for policy 0, policy_version 121280 (0.0005) [2023-03-11 14:18:56,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 12260.2). Total num frames: 62124032. Throughput: 0: 12058.7. Samples: 62088376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:18:56,346][22439] Avg episode reward: [(0, '1000.701')] [2023-03-11 14:18:57,281][22726] Updated weights for policy 0, policy_version 121360 (0.0005) [2023-03-11 14:19:00,852][22726] Updated weights for policy 0, policy_version 121440 (0.0006) [2023-03-11 14:19:01,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 12260.2). Total num frames: 62181376. Throughput: 0: 12007.7. Samples: 62160968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:19:01,346][22439] Avg episode reward: [(0, '957.476')] [2023-03-11 14:19:01,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000121448_62181376.pth... [2023-03-11 14:19:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000120752_61825024.pth [2023-03-11 14:19:04,324][22726] Updated weights for policy 0, policy_version 121520 (0.0006) [2023-03-11 14:19:06,345][22439] Fps is (10 sec: 11468.9, 60 sec: 12014.9, 300 sec: 12232.5). Total num frames: 62238720. Throughput: 0: 11871.4. Samples: 62230592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:19:06,346][22439] Avg episode reward: [(0, '704.321')] [2023-03-11 14:19:07,907][22726] Updated weights for policy 0, policy_version 121600 (0.0006) [2023-03-11 14:19:11,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 12218.6). Total num frames: 62296064. Throughput: 0: 11804.9. Samples: 62265252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:19:11,346][22439] Avg episode reward: [(0, '767.033')] [2023-03-11 14:19:11,459][22726] Updated weights for policy 0, policy_version 121680 (0.0005) [2023-03-11 14:19:15,032][22726] Updated weights for policy 0, policy_version 121760 (0.0006) [2023-03-11 14:19:16,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11810.2, 300 sec: 12204.7). Total num frames: 62353408. Throughput: 0: 11763.8. Samples: 62333924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:19:16,346][22439] Avg episode reward: [(0, '816.367')] [2023-03-11 14:19:16,409][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000121792_62357504.pth... [2023-03-11 14:19:16,412][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000121104_62005248.pth [2023-03-11 14:19:18,491][22726] Updated weights for policy 0, policy_version 121840 (0.0005) [2023-03-11 14:19:21,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 12218.6). Total num frames: 62414848. Throughput: 0: 11823.3. Samples: 62406224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:19:21,346][22439] Avg episode reward: [(0, '910.634')] [2023-03-11 14:19:21,781][22726] Updated weights for policy 0, policy_version 121920 (0.0005) [2023-03-11 14:19:25,045][22726] Updated weights for policy 0, policy_version 122000 (0.0005) [2023-03-11 14:19:26,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11810.2, 300 sec: 12232.5). Total num frames: 62476288. Throughput: 0: 11889.9. Samples: 62443584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:19:26,345][22439] Avg episode reward: [(0, '650.003')] [2023-03-11 14:19:28,286][22726] Updated weights for policy 0, policy_version 122080 (0.0005) [2023-03-11 14:19:31,345][22439] Fps is (10 sec: 12697.5, 60 sec: 11946.7, 300 sec: 12260.2). Total num frames: 62541824. Throughput: 0: 11866.2. Samples: 62518812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:19:31,346][22439] Avg episode reward: [(0, '696.707')] [2023-03-11 14:19:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000122152_62541824.pth... [2023-03-11 14:19:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000121448_62181376.pth [2023-03-11 14:19:31,592][22726] Updated weights for policy 0, policy_version 122160 (0.0005) [2023-03-11 14:19:34,887][22726] Updated weights for policy 0, policy_version 122240 (0.0005) [2023-03-11 14:19:36,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12014.9, 300 sec: 12274.1). Total num frames: 62603264. Throughput: 0: 11974.8. Samples: 62593516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:19:36,346][22439] Avg episode reward: [(0, '873.996')] [2023-03-11 14:19:38,196][22726] Updated weights for policy 0, policy_version 122320 (0.0005) [2023-03-11 14:19:41,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12014.9, 300 sec: 12260.2). Total num frames: 62664704. Throughput: 0: 12058.3. Samples: 62631000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:19:41,356][22439] Avg episode reward: [(0, '829.586')] [2023-03-11 14:19:41,529][22726] Updated weights for policy 0, policy_version 122400 (0.0005) [2023-03-11 14:19:44,856][22726] Updated weights for policy 0, policy_version 122480 (0.0005) [2023-03-11 14:19:46,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12014.9, 300 sec: 12260.2). Total num frames: 62726144. Throughput: 0: 12072.3. Samples: 62704220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:19:46,356][22439] Avg episode reward: [(0, '837.091')] [2023-03-11 14:19:46,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000122512_62726144.pth... [2023-03-11 14:19:46,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000121792_62357504.pth [2023-03-11 14:19:48,112][22726] Updated weights for policy 0, policy_version 122560 (0.0005) [2023-03-11 14:19:51,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 12260.2). Total num frames: 62787584. Throughput: 0: 12197.1. Samples: 62779464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:19:51,346][22439] Avg episode reward: [(0, '728.246')] [2023-03-11 14:19:51,394][22726] Updated weights for policy 0, policy_version 122640 (0.0005) [2023-03-11 14:19:54,874][22726] Updated weights for policy 0, policy_version 122720 (0.0005) [2023-03-11 14:19:56,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 12246.4). Total num frames: 62849024. Throughput: 0: 12228.2. Samples: 62815520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:19:56,346][22439] Avg episode reward: [(0, '924.538')] [2023-03-11 14:19:58,200][22726] Updated weights for policy 0, policy_version 122800 (0.0005) [2023-03-11 14:20:01,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12151.5, 300 sec: 12246.3). Total num frames: 62910464. Throughput: 0: 12348.7. Samples: 62889616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:20:01,346][22439] Avg episode reward: [(0, '900.896')] [2023-03-11 14:20:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000122872_62910464.pth... [2023-03-11 14:20:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000122152_62541824.pth [2023-03-11 14:20:01,509][22726] Updated weights for policy 0, policy_version 122880 (0.0004) [2023-03-11 14:20:04,903][22726] Updated weights for policy 0, policy_version 122960 (0.0005) [2023-03-11 14:20:06,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12246.3). Total num frames: 62971904. Throughput: 0: 12348.8. Samples: 62961920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:20:06,346][22439] Avg episode reward: [(0, '1111.399')] [2023-03-11 14:20:08,229][22726] Updated weights for policy 0, policy_version 123040 (0.0004) [2023-03-11 14:20:11,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 12232.5). Total num frames: 63033344. Throughput: 0: 12345.0. Samples: 62999108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:20:11,346][22439] Avg episode reward: [(0, '634.802')] [2023-03-11 14:20:11,506][22726] Updated weights for policy 0, policy_version 123120 (0.0004) [2023-03-11 14:20:14,881][22726] Updated weights for policy 0, policy_version 123200 (0.0004) [2023-03-11 14:20:16,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12356.2, 300 sec: 12232.5). Total num frames: 63094784. Throughput: 0: 12301.4. Samples: 63072376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:20:16,346][22439] Avg episode reward: [(0, '873.164')] [2023-03-11 14:20:16,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000123232_63094784.pth... [2023-03-11 14:20:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000122512_62726144.pth [2023-03-11 14:20:18,140][22726] Updated weights for policy 0, policy_version 123280 (0.0004) [2023-03-11 14:20:21,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12356.3, 300 sec: 12232.5). Total num frames: 63156224. Throughput: 0: 12322.8. Samples: 63148040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:20:21,346][22439] Avg episode reward: [(0, '686.881')] [2023-03-11 14:20:21,405][22726] Updated weights for policy 0, policy_version 123360 (0.0004) [2023-03-11 14:20:24,719][22726] Updated weights for policy 0, policy_version 123440 (0.0005) [2023-03-11 14:20:26,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 12218.6). Total num frames: 63217664. Throughput: 0: 12310.2. Samples: 63184960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:20:26,346][22439] Avg episode reward: [(0, '1029.687')] [2023-03-11 14:20:28,005][22726] Updated weights for policy 0, policy_version 123520 (0.0004) [2023-03-11 14:20:31,285][22726] Updated weights for policy 0, policy_version 123600 (0.0004) [2023-03-11 14:20:31,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12356.3, 300 sec: 12232.5). Total num frames: 63283200. Throughput: 0: 12358.2. Samples: 63260340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:20:31,346][22439] Avg episode reward: [(0, '815.876')] [2023-03-11 14:20:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000123600_63283200.pth... [2023-03-11 14:20:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000122872_62910464.pth [2023-03-11 14:20:34,753][22726] Updated weights for policy 0, policy_version 123680 (0.0005) [2023-03-11 14:20:36,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12218.6). Total num frames: 63340544. Throughput: 0: 12287.8. Samples: 63332416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:20:36,356][22439] Avg episode reward: [(0, '1041.986')] [2023-03-11 14:20:38,033][22726] Updated weights for policy 0, policy_version 123760 (0.0004) [2023-03-11 14:20:41,334][22726] Updated weights for policy 0, policy_version 123840 (0.0003) [2023-03-11 14:20:41,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12218.6). Total num frames: 63406080. Throughput: 0: 12311.7. Samples: 63369548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:20:41,356][22439] Avg episode reward: [(0, '812.212')] [2023-03-11 14:20:44,569][22726] Updated weights for policy 0, policy_version 123920 (0.0004) [2023-03-11 14:20:46,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12356.2, 300 sec: 12218.6). Total num frames: 63467520. Throughput: 0: 12342.0. Samples: 63445004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:20:46,346][22439] Avg episode reward: [(0, '930.859')] [2023-03-11 14:20:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000123960_63467520.pth... [2023-03-11 14:20:46,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000123232_63094784.pth [2023-03-11 14:20:47,875][22726] Updated weights for policy 0, policy_version 124000 (0.0005) [2023-03-11 14:20:51,177][22726] Updated weights for policy 0, policy_version 124080 (0.0004) [2023-03-11 14:20:51,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12218.6). Total num frames: 63528960. Throughput: 0: 12394.7. Samples: 63519680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:20:51,346][22439] Avg episode reward: [(0, '853.725')] [2023-03-11 14:20:54,562][22726] Updated weights for policy 0, policy_version 124160 (0.0005) [2023-03-11 14:20:56,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 12218.6). Total num frames: 63590400. Throughput: 0: 12394.7. Samples: 63556872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:20:56,346][22439] Avg episode reward: [(0, '859.181')] [2023-03-11 14:20:57,878][22726] Updated weights for policy 0, policy_version 124240 (0.0004) [2023-03-11 14:21:01,204][22726] Updated weights for policy 0, policy_version 124320 (0.0004) [2023-03-11 14:21:01,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12218.6). Total num frames: 63651840. Throughput: 0: 12403.8. Samples: 63630548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:21:01,346][22439] Avg episode reward: [(0, '886.966')] [2023-03-11 14:21:01,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000124320_63651840.pth... [2023-03-11 14:21:01,353][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000123600_63283200.pth [2023-03-11 14:21:04,918][22726] Updated weights for policy 0, policy_version 124400 (0.0005) [2023-03-11 14:21:06,345][22439] Fps is (10 sec: 11878.5, 60 sec: 12288.0, 300 sec: 12204.7). Total num frames: 63709184. Throughput: 0: 12229.3. Samples: 63698356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:21:06,345][22439] Avg episode reward: [(0, '1109.525')] [2023-03-11 14:21:08,533][22726] Updated weights for policy 0, policy_version 124480 (0.0005) [2023-03-11 14:21:11,345][22439] Fps is (10 sec: 11059.3, 60 sec: 12151.5, 300 sec: 12176.9). Total num frames: 63762432. Throughput: 0: 12175.3. Samples: 63732848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:21:11,346][22439] Avg episode reward: [(0, '1126.975')] [2023-03-11 14:21:12,049][22726] Updated weights for policy 0, policy_version 124560 (0.0004) [2023-03-11 14:21:15,282][22726] Updated weights for policy 0, policy_version 124640 (0.0004) [2023-03-11 14:21:16,345][22439] Fps is (10 sec: 11878.2, 60 sec: 12219.7, 300 sec: 12176.9). Total num frames: 63827968. Throughput: 0: 12095.5. Samples: 63804640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:21:16,346][22439] Avg episode reward: [(0, '908.457')] [2023-03-11 14:21:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000124664_63827968.pth... [2023-03-11 14:21:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000123960_63467520.pth [2023-03-11 14:21:18,538][22726] Updated weights for policy 0, policy_version 124720 (0.0004) [2023-03-11 14:21:21,345][22439] Fps is (10 sec: 12697.7, 60 sec: 12219.7, 300 sec: 12163.0). Total num frames: 63889408. Throughput: 0: 12166.0. Samples: 63879888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:21:21,346][22439] Avg episode reward: [(0, '1080.941')] [2023-03-11 14:21:21,972][22726] Updated weights for policy 0, policy_version 124800 (0.0004) [2023-03-11 14:21:25,270][22726] Updated weights for policy 0, policy_version 124880 (0.0004) [2023-03-11 14:21:26,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12219.7, 300 sec: 12163.0). Total num frames: 63950848. Throughput: 0: 12118.2. Samples: 63914868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:21:26,346][22439] Avg episode reward: [(0, '1083.290')] [2023-03-11 14:21:28,573][22726] Updated weights for policy 0, policy_version 124960 (0.0004) [2023-03-11 14:21:31,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12151.5, 300 sec: 12149.2). Total num frames: 64012288. Throughput: 0: 12113.4. Samples: 63990108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:21:31,346][22439] Avg episode reward: [(0, '982.187')] [2023-03-11 14:21:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000125024_64012288.pth... [2023-03-11 14:21:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000124320_63651840.pth [2023-03-11 14:21:31,857][22726] Updated weights for policy 0, policy_version 125040 (0.0003) [2023-03-11 14:21:35,234][22726] Updated weights for policy 0, policy_version 125120 (0.0004) [2023-03-11 14:21:36,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12149.2). Total num frames: 64073728. Throughput: 0: 12093.8. Samples: 64063900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:21:36,346][22439] Avg episode reward: [(0, '947.081')] [2023-03-11 14:21:38,611][22726] Updated weights for policy 0, policy_version 125200 (0.0004) [2023-03-11 14:21:41,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 12135.3). Total num frames: 64135168. Throughput: 0: 12064.8. Samples: 64099788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:21:41,346][22439] Avg episode reward: [(0, '1000.579')] [2023-03-11 14:21:41,932][22726] Updated weights for policy 0, policy_version 125280 (0.0004) [2023-03-11 14:21:45,235][22726] Updated weights for policy 0, policy_version 125360 (0.0004) [2023-03-11 14:21:46,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 12121.4). Total num frames: 64196608. Throughput: 0: 12082.6. Samples: 64174264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:21:46,346][22439] Avg episode reward: [(0, '914.180')] [2023-03-11 14:21:46,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000125384_64196608.pth... [2023-03-11 14:21:46,353][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000124664_63827968.pth [2023-03-11 14:21:48,538][22726] Updated weights for policy 0, policy_version 125440 (0.0004) [2023-03-11 14:21:51,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 12121.4). Total num frames: 64258048. Throughput: 0: 12215.6. Samples: 64248060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:21:51,346][22439] Avg episode reward: [(0, '892.857')] [2023-03-11 14:21:51,924][22726] Updated weights for policy 0, policy_version 125520 (0.0005) [2023-03-11 14:21:55,117][22726] Updated weights for policy 0, policy_version 125600 (0.0004) [2023-03-11 14:21:56,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 12121.4). Total num frames: 64319488. Throughput: 0: 12282.8. Samples: 64285576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:21:56,346][22439] Avg episode reward: [(0, '848.376')] [2023-03-11 14:21:58,305][22726] Updated weights for policy 0, policy_version 125680 (0.0003) [2023-03-11 14:22:01,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12219.7, 300 sec: 12135.3). Total num frames: 64385024. Throughput: 0: 12385.2. Samples: 64361976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:22:01,346][22439] Avg episode reward: [(0, '883.214')] [2023-03-11 14:22:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000125752_64385024.pth... [2023-03-11 14:22:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000125024_64012288.pth [2023-03-11 14:22:01,624][22726] Updated weights for policy 0, policy_version 125760 (0.0005) [2023-03-11 14:22:05,075][22726] Updated weights for policy 0, policy_version 125840 (0.0005) [2023-03-11 14:22:06,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12121.4). Total num frames: 64442368. Throughput: 0: 12319.1. Samples: 64434248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:22:06,346][22439] Avg episode reward: [(0, '1272.067')] [2023-03-11 14:22:08,269][22726] Updated weights for policy 0, policy_version 125920 (0.0004) [2023-03-11 14:22:11,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12424.5, 300 sec: 12135.3). Total num frames: 64507904. Throughput: 0: 12399.1. Samples: 64472828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:22:11,346][22439] Avg episode reward: [(0, '941.382')] [2023-03-11 14:22:11,632][22726] Updated weights for policy 0, policy_version 126000 (0.0005) [2023-03-11 14:22:14,902][22726] Updated weights for policy 0, policy_version 126080 (0.0003) [2023-03-11 14:22:16,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 12121.4). Total num frames: 64565248. Throughput: 0: 12380.5. Samples: 64547232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:22:16,346][22439] Avg episode reward: [(0, '918.999')] [2023-03-11 14:22:16,372][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000126112_64569344.pth... [2023-03-11 14:22:16,374][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000125384_64196608.pth [2023-03-11 14:22:18,507][22726] Updated weights for policy 0, policy_version 126160 (0.0005) [2023-03-11 14:22:21,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 12121.4). Total num frames: 64626688. Throughput: 0: 12271.4. Samples: 64616112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:22:21,346][22439] Avg episode reward: [(0, '967.631')] [2023-03-11 14:22:21,983][22726] Updated weights for policy 0, policy_version 126240 (0.0005) [2023-03-11 14:22:25,492][22726] Updated weights for policy 0, policy_version 126320 (0.0005) [2023-03-11 14:22:26,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12121.4). Total num frames: 64684032. Throughput: 0: 12256.6. Samples: 64651336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:22:26,346][22439] Avg episode reward: [(0, '779.095')] [2023-03-11 14:22:28,968][22726] Updated weights for policy 0, policy_version 126400 (0.0004) [2023-03-11 14:22:31,345][22439] Fps is (10 sec: 11878.3, 60 sec: 12219.7, 300 sec: 12135.3). Total num frames: 64745472. Throughput: 0: 12171.7. Samples: 64721992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:22:31,346][22439] Avg episode reward: [(0, '1043.560')] [2023-03-11 14:22:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000126456_64745472.pth... [2023-03-11 14:22:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000125752_64385024.pth [2023-03-11 14:22:32,241][22726] Updated weights for policy 0, policy_version 126480 (0.0004) [2023-03-11 14:22:35,629][22726] Updated weights for policy 0, policy_version 126560 (0.0004) [2023-03-11 14:22:36,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12219.7, 300 sec: 12135.3). Total num frames: 64806912. Throughput: 0: 12177.9. Samples: 64796064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:22:36,346][22439] Avg episode reward: [(0, '914.198')] [2023-03-11 14:22:39,217][22726] Updated weights for policy 0, policy_version 126640 (0.0005) [2023-03-11 14:22:41,345][22439] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 12135.3). Total num frames: 64860160. Throughput: 0: 12131.6. Samples: 64831496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:22:41,346][22439] Avg episode reward: [(0, '1050.203')] [2023-03-11 14:22:42,878][22726] Updated weights for policy 0, policy_version 126720 (0.0005) [2023-03-11 14:22:46,345][22439] Fps is (10 sec: 11059.1, 60 sec: 12014.9, 300 sec: 12121.4). Total num frames: 64917504. Throughput: 0: 11911.4. Samples: 64897988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:22:46,346][22439] Avg episode reward: [(0, '881.056')] [2023-03-11 14:22:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000126792_64917504.pth... [2023-03-11 14:22:46,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000126112_64569344.pth [2023-03-11 14:22:46,403][22726] Updated weights for policy 0, policy_version 126800 (0.0005) [2023-03-11 14:22:49,805][22726] Updated weights for policy 0, policy_version 126880 (0.0004) [2023-03-11 14:22:51,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 12121.4). Total num frames: 64978944. Throughput: 0: 11921.3. Samples: 64970708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:22:51,346][22439] Avg episode reward: [(0, '1146.430')] [2023-03-11 14:22:53,253][22726] Updated weights for policy 0, policy_version 126960 (0.0005) [2023-03-11 14:22:56,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12014.9, 300 sec: 12135.3). Total num frames: 65040384. Throughput: 0: 11841.5. Samples: 65005696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:22:56,346][22439] Avg episode reward: [(0, '1060.977')] [2023-03-11 14:22:56,549][22726] Updated weights for policy 0, policy_version 127040 (0.0004) [2023-03-11 14:23:00,071][22726] Updated weights for policy 0, policy_version 127120 (0.0005) [2023-03-11 14:23:01,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 12135.3). Total num frames: 65097728. Throughput: 0: 11781.9. Samples: 65077420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:23:01,346][22439] Avg episode reward: [(0, '1101.962')] [2023-03-11 14:23:01,372][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000127152_65101824.pth... [2023-03-11 14:23:01,374][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000126456_64745472.pth [2023-03-11 14:23:03,346][22726] Updated weights for policy 0, policy_version 127200 (0.0004) [2023-03-11 14:23:06,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 12135.3). Total num frames: 65159168. Throughput: 0: 11870.2. Samples: 65150272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:23:06,346][22439] Avg episode reward: [(0, '1018.796')] [2023-03-11 14:23:06,961][22726] Updated weights for policy 0, policy_version 127280 (0.0005) [2023-03-11 14:23:10,520][22726] Updated weights for policy 0, policy_version 127360 (0.0005) [2023-03-11 14:23:11,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11810.1, 300 sec: 12107.5). Total num frames: 65216512. Throughput: 0: 11838.0. Samples: 65184044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:23:11,346][22439] Avg episode reward: [(0, '1085.520')] [2023-03-11 14:23:13,903][22726] Updated weights for policy 0, policy_version 127440 (0.0004) [2023-03-11 14:23:16,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 12107.5). Total num frames: 65277952. Throughput: 0: 11868.5. Samples: 65256072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:23:16,346][22439] Avg episode reward: [(0, '1052.746')] [2023-03-11 14:23:16,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000127496_65277952.pth... [2023-03-11 14:23:16,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000126792_64917504.pth [2023-03-11 14:23:17,174][22726] Updated weights for policy 0, policy_version 127520 (0.0004) [2023-03-11 14:23:20,740][22726] Updated weights for policy 0, policy_version 127600 (0.0005) [2023-03-11 14:23:21,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 12093.6). Total num frames: 65335296. Throughput: 0: 11804.6. Samples: 65327272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:23:21,346][22439] Avg episode reward: [(0, '1120.394')] [2023-03-11 14:23:24,424][22726] Updated weights for policy 0, policy_version 127680 (0.0005) [2023-03-11 14:23:26,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 12093.6). Total num frames: 65392640. Throughput: 0: 11761.5. Samples: 65360764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:23:26,346][22439] Avg episode reward: [(0, '1233.794')] [2023-03-11 14:23:28,161][22726] Updated weights for policy 0, policy_version 127760 (0.0005) [2023-03-11 14:23:31,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11673.6, 300 sec: 12079.7). Total num frames: 65445888. Throughput: 0: 11760.3. Samples: 65427200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:23:31,346][22439] Avg episode reward: [(0, '1259.179')] [2023-03-11 14:23:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000127824_65445888.pth... [2023-03-11 14:23:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000127152_65101824.pth [2023-03-11 14:23:31,964][22726] Updated weights for policy 0, policy_version 127840 (0.0005) [2023-03-11 14:23:35,524][22726] Updated weights for policy 0, policy_version 127920 (0.0005) [2023-03-11 14:23:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11605.3, 300 sec: 12065.8). Total num frames: 65503232. Throughput: 0: 11630.2. Samples: 65494068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:23:36,346][22439] Avg episode reward: [(0, '1093.593')] [2023-03-11 14:23:39,217][22726] Updated weights for policy 0, policy_version 128000 (0.0005) [2023-03-11 14:23:41,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11605.3, 300 sec: 12038.1). Total num frames: 65556480. Throughput: 0: 11602.5. Samples: 65527808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:23:41,346][22439] Avg episode reward: [(0, '1105.784')] [2023-03-11 14:23:42,872][22726] Updated weights for policy 0, policy_version 128080 (0.0005) [2023-03-11 14:23:46,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11605.3, 300 sec: 12038.1). Total num frames: 65613824. Throughput: 0: 11492.4. Samples: 65594580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:23:46,346][22439] Avg episode reward: [(0, '1163.827')] [2023-03-11 14:23:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000128152_65613824.pth... [2023-03-11 14:23:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000127496_65277952.pth [2023-03-11 14:23:46,461][22726] Updated weights for policy 0, policy_version 128160 (0.0005) [2023-03-11 14:23:50,181][22726] Updated weights for policy 0, policy_version 128240 (0.0005) [2023-03-11 14:23:51,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 12024.2). Total num frames: 65671168. Throughput: 0: 11371.9. Samples: 65662008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:23:51,346][22439] Avg episode reward: [(0, '992.205')] [2023-03-11 14:23:53,953][22726] Updated weights for policy 0, policy_version 128320 (0.0005) [2023-03-11 14:23:56,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11400.5, 300 sec: 12010.3). Total num frames: 65724416. Throughput: 0: 11340.7. Samples: 65694376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:23:56,346][22439] Avg episode reward: [(0, '1141.670')] [2023-03-11 14:23:57,536][22726] Updated weights for policy 0, policy_version 128400 (0.0005) [2023-03-11 14:24:01,208][22726] Updated weights for policy 0, policy_version 128480 (0.0005) [2023-03-11 14:24:01,345][22439] Fps is (10 sec: 11059.0, 60 sec: 11400.5, 300 sec: 12010.3). Total num frames: 65781760. Throughput: 0: 11231.7. Samples: 65761500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:24:01,346][22439] Avg episode reward: [(0, '1164.455')] [2023-03-11 14:24:01,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000128480_65781760.pth... [2023-03-11 14:24:01,353][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000127824_65445888.pth [2023-03-11 14:24:04,813][22726] Updated weights for policy 0, policy_version 128560 (0.0005) [2023-03-11 14:24:06,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11332.3, 300 sec: 12010.3). Total num frames: 65839104. Throughput: 0: 11179.4. Samples: 65830344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:24:06,356][22439] Avg episode reward: [(0, '994.664')] [2023-03-11 14:24:08,428][22726] Updated weights for policy 0, policy_version 128640 (0.0005) [2023-03-11 14:24:11,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11332.3, 300 sec: 12010.3). Total num frames: 65896448. Throughput: 0: 11177.4. Samples: 65863744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:24:11,356][22439] Avg episode reward: [(0, '1084.134')] [2023-03-11 14:24:12,028][22726] Updated weights for policy 0, policy_version 128720 (0.0005) [2023-03-11 14:24:15,697][22726] Updated weights for policy 0, policy_version 128800 (0.0005) [2023-03-11 14:24:16,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11195.7, 300 sec: 11982.5). Total num frames: 65949696. Throughput: 0: 11216.4. Samples: 65931936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:24:16,356][22439] Avg episode reward: [(0, '1161.667')] [2023-03-11 14:24:16,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000128808_65949696.pth... [2023-03-11 14:24:16,363][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000128152_65613824.pth [2023-03-11 14:24:19,309][22726] Updated weights for policy 0, policy_version 128880 (0.0005) [2023-03-11 14:24:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.8, 300 sec: 11968.7). Total num frames: 66007040. Throughput: 0: 11219.0. Samples: 65998920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:24:21,356][22439] Avg episode reward: [(0, '1184.670')] [2023-03-11 14:24:22,920][22726] Updated weights for policy 0, policy_version 128960 (0.0005) [2023-03-11 14:24:26,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 11940.9). Total num frames: 66064384. Throughput: 0: 11218.8. Samples: 66032652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:24:26,356][22439] Avg episode reward: [(0, '1122.318')] [2023-03-11 14:24:26,517][22726] Updated weights for policy 0, policy_version 129040 (0.0005) [2023-03-11 14:24:29,888][22726] Updated weights for policy 0, policy_version 129120 (0.0004) [2023-03-11 14:24:31,345][22439] Fps is (10 sec: 11878.2, 60 sec: 11332.3, 300 sec: 11940.9). Total num frames: 66125824. Throughput: 0: 11308.4. Samples: 66103456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:24:31,356][22439] Avg episode reward: [(0, '1201.857')] [2023-03-11 14:24:31,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000129152_66125824.pth... [2023-03-11 14:24:31,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000128480_65781760.pth [2023-03-11 14:24:33,421][22726] Updated weights for policy 0, policy_version 129200 (0.0005) [2023-03-11 14:24:36,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11332.3, 300 sec: 11927.0). Total num frames: 66183168. Throughput: 0: 11377.4. Samples: 66173992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:24:36,356][22439] Avg episode reward: [(0, '1497.024')] [2023-03-11 14:24:36,853][22726] Updated weights for policy 0, policy_version 129280 (0.0004) [2023-03-11 14:24:40,220][22726] Updated weights for policy 0, policy_version 129360 (0.0004) [2023-03-11 14:24:41,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11468.8, 300 sec: 11927.0). Total num frames: 66244608. Throughput: 0: 11472.7. Samples: 66210648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:24:41,356][22439] Avg episode reward: [(0, '987.695')] [2023-03-11 14:24:43,575][22726] Updated weights for policy 0, policy_version 129440 (0.0004) [2023-03-11 14:24:46,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11468.8, 300 sec: 11913.1). Total num frames: 66301952. Throughput: 0: 11603.6. Samples: 66283660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:24:46,346][22439] Avg episode reward: [(0, '1085.786')] [2023-03-11 14:24:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000129504_66306048.pth... [2023-03-11 14:24:46,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000128808_65949696.pth [2023-03-11 14:24:47,071][22726] Updated weights for policy 0, policy_version 129520 (0.0005) [2023-03-11 14:24:50,400][22726] Updated weights for policy 0, policy_version 129600 (0.0004) [2023-03-11 14:24:51,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11537.1, 300 sec: 11913.1). Total num frames: 66363392. Throughput: 0: 11665.1. Samples: 66355272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:24:51,346][22439] Avg episode reward: [(0, '1162.305')] [2023-03-11 14:24:53,808][22726] Updated weights for policy 0, policy_version 129680 (0.0005) [2023-03-11 14:24:56,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11673.6, 300 sec: 11913.1). Total num frames: 66424832. Throughput: 0: 11740.2. Samples: 66392052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:24:56,346][22439] Avg episode reward: [(0, '1060.273')] [2023-03-11 14:24:57,284][22726] Updated weights for policy 0, policy_version 129760 (0.0005) [2023-03-11 14:25:00,725][22726] Updated weights for policy 0, policy_version 129840 (0.0004) [2023-03-11 14:25:01,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11899.2). Total num frames: 66482176. Throughput: 0: 11803.5. Samples: 66463096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:25:01,346][22439] Avg episode reward: [(0, '1120.521')] [2023-03-11 14:25:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000129848_66482176.pth... [2023-03-11 14:25:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000129152_66125824.pth [2023-03-11 14:25:04,176][22726] Updated weights for policy 0, policy_version 129920 (0.0004) [2023-03-11 14:25:06,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11741.9, 300 sec: 11899.2). Total num frames: 66543616. Throughput: 0: 11887.5. Samples: 66533856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:25:06,346][22439] Avg episode reward: [(0, '1035.548')] [2023-03-11 14:25:07,685][22726] Updated weights for policy 0, policy_version 130000 (0.0005) [2023-03-11 14:25:11,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 11871.5). Total num frames: 66596864. Throughput: 0: 11914.2. Samples: 66568792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:25:11,346][22439] Avg episode reward: [(0, '1111.331')] [2023-03-11 14:25:11,397][22726] Updated weights for policy 0, policy_version 130080 (0.0005) [2023-03-11 14:25:15,078][22726] Updated weights for policy 0, policy_version 130160 (0.0005) [2023-03-11 14:25:16,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11741.9, 300 sec: 11857.6). Total num frames: 66654208. Throughput: 0: 11792.0. Samples: 66634096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:25:16,346][22439] Avg episode reward: [(0, '1304.629')] [2023-03-11 14:25:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000130184_66654208.pth... [2023-03-11 14:25:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000129504_66306048.pth [2023-03-11 14:25:18,732][22726] Updated weights for policy 0, policy_version 130240 (0.0005) [2023-03-11 14:25:21,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11843.7). Total num frames: 66711552. Throughput: 0: 11743.8. Samples: 66702460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:25:21,346][22439] Avg episode reward: [(0, '1141.541')] [2023-03-11 14:25:22,436][22726] Updated weights for policy 0, policy_version 130320 (0.0005) [2023-03-11 14:25:26,199][22726] Updated weights for policy 0, policy_version 130400 (0.0005) [2023-03-11 14:25:26,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11673.6, 300 sec: 11802.0). Total num frames: 66764800. Throughput: 0: 11659.5. Samples: 66735328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:25:26,346][22439] Avg episode reward: [(0, '1168.123')] [2023-03-11 14:25:29,782][22726] Updated weights for policy 0, policy_version 130480 (0.0005) [2023-03-11 14:25:31,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11605.3, 300 sec: 11802.0). Total num frames: 66822144. Throughput: 0: 11511.6. Samples: 66801680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:25:31,346][22439] Avg episode reward: [(0, '836.467')] [2023-03-11 14:25:31,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000130512_66822144.pth... [2023-03-11 14:25:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000129848_66482176.pth [2023-03-11 14:25:33,473][22726] Updated weights for policy 0, policy_version 130560 (0.0005) [2023-03-11 14:25:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11760.4). Total num frames: 66875392. Throughput: 0: 11381.2. Samples: 66867428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:25:36,346][22439] Avg episode reward: [(0, '1177.176')] [2023-03-11 14:25:37,164][22726] Updated weights for policy 0, policy_version 130640 (0.0005) [2023-03-11 14:25:40,859][22726] Updated weights for policy 0, policy_version 130720 (0.0005) [2023-03-11 14:25:41,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11468.8, 300 sec: 11746.5). Total num frames: 66932736. Throughput: 0: 11347.0. Samples: 66902668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:25:41,346][22439] Avg episode reward: [(0, '970.200')] [2023-03-11 14:25:44,449][22726] Updated weights for policy 0, policy_version 130800 (0.0005) [2023-03-11 14:25:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11732.6). Total num frames: 66990080. Throughput: 0: 11255.9. Samples: 66969612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:25:46,346][22439] Avg episode reward: [(0, '1006.884')] [2023-03-11 14:25:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000130840_66990080.pth... [2023-03-11 14:25:46,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000130184_66654208.pth [2023-03-11 14:25:48,090][22726] Updated weights for policy 0, policy_version 130880 (0.0005) [2023-03-11 14:25:51,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 11704.8). Total num frames: 67043328. Throughput: 0: 11169.9. Samples: 67036500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:25:51,346][22439] Avg episode reward: [(0, '1044.141')] [2023-03-11 14:25:51,760][22726] Updated weights for policy 0, policy_version 130960 (0.0005) [2023-03-11 14:25:55,422][22726] Updated weights for policy 0, policy_version 131040 (0.0005) [2023-03-11 14:25:56,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11264.0, 300 sec: 11691.0). Total num frames: 67100672. Throughput: 0: 11147.9. Samples: 67070448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:25:56,346][22439] Avg episode reward: [(0, '1099.505')] [2023-03-11 14:25:59,228][22726] Updated weights for policy 0, policy_version 131120 (0.0005) [2023-03-11 14:26:01,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11195.7, 300 sec: 11677.1). Total num frames: 67153920. Throughput: 0: 11152.8. Samples: 67135972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:26:01,346][22439] Avg episode reward: [(0, '1008.171')] [2023-03-11 14:26:01,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000131160_67153920.pth... [2023-03-11 14:26:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000130512_66822144.pth [2023-03-11 14:26:02,856][22726] Updated weights for policy 0, policy_version 131200 (0.0005) [2023-03-11 14:26:06,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11691.0). Total num frames: 67211264. Throughput: 0: 11124.9. Samples: 67203080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:26:06,356][22439] Avg episode reward: [(0, '794.090')] [2023-03-11 14:26:06,580][22726] Updated weights for policy 0, policy_version 131280 (0.0005) [2023-03-11 14:26:10,271][22726] Updated weights for policy 0, policy_version 131360 (0.0005) [2023-03-11 14:26:11,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11127.5, 300 sec: 11649.3). Total num frames: 67264512. Throughput: 0: 11123.9. Samples: 67235904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:26:11,346][22439] Avg episode reward: [(0, '1126.352')] [2023-03-11 14:26:13,923][22726] Updated weights for policy 0, policy_version 131440 (0.0004) [2023-03-11 14:26:16,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11635.4). Total num frames: 67321856. Throughput: 0: 11137.6. Samples: 67302872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:26:16,346][22439] Avg episode reward: [(0, '954.411')] [2023-03-11 14:26:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000131488_67321856.pth... [2023-03-11 14:26:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000130840_66990080.pth [2023-03-11 14:26:17,629][22726] Updated weights for policy 0, policy_version 131520 (0.0003) [2023-03-11 14:26:21,260][22726] Updated weights for policy 0, policy_version 131600 (0.0005) [2023-03-11 14:26:21,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11127.5, 300 sec: 11621.5). Total num frames: 67379200. Throughput: 0: 11181.9. Samples: 67370612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:26:21,346][22439] Avg episode reward: [(0, '895.730')] [2023-03-11 14:26:24,859][22726] Updated weights for policy 0, policy_version 131680 (0.0005) [2023-03-11 14:26:26,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11593.8). Total num frames: 67432448. Throughput: 0: 11135.9. Samples: 67403784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:26:26,346][22439] Avg episode reward: [(0, '917.753')] [2023-03-11 14:26:28,636][22726] Updated weights for policy 0, policy_version 131760 (0.0005) [2023-03-11 14:26:31,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11127.5, 300 sec: 11579.9). Total num frames: 67489792. Throughput: 0: 11120.8. Samples: 67470048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:26:31,346][22439] Avg episode reward: [(0, '1037.464')] [2023-03-11 14:26:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000131816_67489792.pth... [2023-03-11 14:26:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000131160_67153920.pth [2023-03-11 14:26:32,337][22726] Updated weights for policy 0, policy_version 131840 (0.0005) [2023-03-11 14:26:35,914][22726] Updated weights for policy 0, policy_version 131920 (0.0005) [2023-03-11 14:26:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 11566.0). Total num frames: 67547136. Throughput: 0: 11136.7. Samples: 67537652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:26:36,346][22439] Avg episode reward: [(0, '929.303')] [2023-03-11 14:26:39,403][22726] Updated weights for policy 0, policy_version 132000 (0.0005) [2023-03-11 14:26:41,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 11552.1). Total num frames: 67604480. Throughput: 0: 11147.6. Samples: 67572092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:26:41,356][22439] Avg episode reward: [(0, '1101.999')] [2023-03-11 14:26:42,763][22726] Updated weights for policy 0, policy_version 132080 (0.0004) [2023-03-11 14:26:46,325][22726] Updated weights for policy 0, policy_version 132160 (0.0005) [2023-03-11 14:26:46,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11264.0, 300 sec: 11552.1). Total num frames: 67665920. Throughput: 0: 11294.0. Samples: 67644204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:26:46,356][22439] Avg episode reward: [(0, '817.719')] [2023-03-11 14:26:46,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000132160_67665920.pth... [2023-03-11 14:26:46,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000131488_67321856.pth [2023-03-11 14:26:49,859][22726] Updated weights for policy 0, policy_version 132240 (0.0004) [2023-03-11 14:26:51,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11264.0, 300 sec: 11524.3). Total num frames: 67719168. Throughput: 0: 11343.4. Samples: 67713532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:26:51,356][22439] Avg episode reward: [(0, '982.718')] [2023-03-11 14:26:53,647][22726] Updated weights for policy 0, policy_version 132320 (0.0005) [2023-03-11 14:26:56,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11264.0, 300 sec: 11496.6). Total num frames: 67776512. Throughput: 0: 11319.6. Samples: 67745284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:26:56,356][22439] Avg episode reward: [(0, '1144.173')] [2023-03-11 14:26:57,213][22726] Updated weights for policy 0, policy_version 132400 (0.0004) [2023-03-11 14:27:00,512][22726] Updated weights for policy 0, policy_version 132480 (0.0003) [2023-03-11 14:27:01,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11400.5, 300 sec: 11510.5). Total num frames: 67837952. Throughput: 0: 11430.9. Samples: 67817264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:27:01,356][22439] Avg episode reward: [(0, '1117.948')] [2023-03-11 14:27:01,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000132496_67837952.pth... [2023-03-11 14:27:01,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000131816_67489792.pth [2023-03-11 14:27:04,227][22726] Updated weights for policy 0, policy_version 132560 (0.0005) [2023-03-11 14:27:06,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11332.3, 300 sec: 11468.8). Total num frames: 67891200. Throughput: 0: 11400.2. Samples: 67883620. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:27:06,356][22439] Avg episode reward: [(0, '1081.476')] [2023-03-11 14:27:07,909][22726] Updated weights for policy 0, policy_version 132640 (0.0005) [2023-03-11 14:27:11,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11400.5, 300 sec: 11468.8). Total num frames: 67948544. Throughput: 0: 11410.2. Samples: 67917244. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:27:11,346][22439] Avg episode reward: [(0, '1180.354')] [2023-03-11 14:27:11,682][22726] Updated weights for policy 0, policy_version 132720 (0.0005) [2023-03-11 14:27:15,489][22726] Updated weights for policy 0, policy_version 132800 (0.0005) [2023-03-11 14:27:16,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 11441.0). Total num frames: 68001792. Throughput: 0: 11363.0. Samples: 67981384. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:27:16,346][22439] Avg episode reward: [(0, '1005.547')] [2023-03-11 14:27:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000132816_68001792.pth... [2023-03-11 14:27:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000132160_67665920.pth [2023-03-11 14:27:19,228][22726] Updated weights for policy 0, policy_version 132880 (0.0005) [2023-03-11 14:27:21,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11264.0, 300 sec: 11427.1). Total num frames: 68055040. Throughput: 0: 11324.3. Samples: 68047244. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:27:21,346][22439] Avg episode reward: [(0, '932.038')] [2023-03-11 14:27:22,971][22726] Updated weights for policy 0, policy_version 132960 (0.0005) [2023-03-11 14:27:26,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 11413.3). Total num frames: 68112384. Throughput: 0: 11301.5. Samples: 68080660. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:27:26,346][22439] Avg episode reward: [(0, '1037.024')] [2023-03-11 14:27:26,615][22726] Updated weights for policy 0, policy_version 133040 (0.0005) [2023-03-11 14:27:30,077][22726] Updated weights for policy 0, policy_version 133120 (0.0005) [2023-03-11 14:27:31,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11332.3, 300 sec: 11399.4). Total num frames: 68169728. Throughput: 0: 11239.9. Samples: 68150000. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:27:31,346][22439] Avg episode reward: [(0, '1189.077')] [2023-03-11 14:27:31,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000133144_68169728.pth... [2023-03-11 14:27:31,353][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000132496_67837952.pth [2023-03-11 14:27:33,617][22726] Updated weights for policy 0, policy_version 133200 (0.0005) [2023-03-11 14:27:36,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11332.3, 300 sec: 11413.3). Total num frames: 68227072. Throughput: 0: 11214.4. Samples: 68218180. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:27:36,346][22439] Avg episode reward: [(0, '906.756')] [2023-03-11 14:27:37,420][22726] Updated weights for policy 0, policy_version 133280 (0.0005) [2023-03-11 14:27:40,992][22726] Updated weights for policy 0, policy_version 133360 (0.0004) [2023-03-11 14:27:41,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11264.0, 300 sec: 11399.4). Total num frames: 68280320. Throughput: 0: 11236.7. Samples: 68250936. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:27:41,346][22439] Avg episode reward: [(0, '1220.349')] [2023-03-11 14:27:44,512][22726] Updated weights for policy 0, policy_version 133440 (0.0003) [2023-03-11 14:27:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11399.4). Total num frames: 68341760. Throughput: 0: 11187.6. Samples: 68320708. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:27:46,346][22439] Avg episode reward: [(0, '1379.065')] [2023-03-11 14:27:46,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000133480_68341760.pth... [2023-03-11 14:27:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000132816_68001792.pth [2023-03-11 14:27:47,920][22726] Updated weights for policy 0, policy_version 133520 (0.0004) [2023-03-11 14:27:51,302][22726] Updated weights for policy 0, policy_version 133600 (0.0004) [2023-03-11 14:27:51,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11400.5, 300 sec: 11399.4). Total num frames: 68403200. Throughput: 0: 11336.4. Samples: 68393760. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:27:51,346][22439] Avg episode reward: [(0, '992.049')] [2023-03-11 14:27:54,765][22726] Updated weights for policy 0, policy_version 133680 (0.0005) [2023-03-11 14:27:56,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11400.5, 300 sec: 11399.4). Total num frames: 68460544. Throughput: 0: 11346.7. Samples: 68427848. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:27:56,346][22439] Avg episode reward: [(0, '1310.580')] [2023-03-11 14:27:58,349][22726] Updated weights for policy 0, policy_version 133760 (0.0005) [2023-03-11 14:28:01,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11385.5). Total num frames: 68517888. Throughput: 0: 11482.6. Samples: 68498100. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:28:01,346][22439] Avg episode reward: [(0, '1306.775')] [2023-03-11 14:28:01,370][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000133832_68521984.pth... [2023-03-11 14:28:01,371][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000133144_68169728.pth [2023-03-11 14:28:01,696][22726] Updated weights for policy 0, policy_version 133840 (0.0005) [2023-03-11 14:28:05,408][22726] Updated weights for policy 0, policy_version 133920 (0.0005) [2023-03-11 14:28:06,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11385.5). Total num frames: 68575232. Throughput: 0: 11552.4. Samples: 68567104. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-11 14:28:06,346][22439] Avg episode reward: [(0, '1064.062')] [2023-03-11 14:28:09,208][22726] Updated weights for policy 0, policy_version 134000 (0.0006) [2023-03-11 14:28:11,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 11357.7). Total num frames: 68628480. Throughput: 0: 11536.9. Samples: 68599820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:28:11,346][22439] Avg episode reward: [(0, '1129.952')] [2023-03-11 14:28:13,147][22726] Updated weights for policy 0, policy_version 134080 (0.0005) [2023-03-11 14:28:16,345][22439] Fps is (10 sec: 10649.5, 60 sec: 11332.3, 300 sec: 11343.8). Total num frames: 68681728. Throughput: 0: 11374.5. Samples: 68661852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:28:16,346][22439] Avg episode reward: [(0, '1458.753')] [2023-03-11 14:28:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000134144_68681728.pth... [2023-03-11 14:28:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000133480_68341760.pth [2023-03-11 14:28:16,983][22726] Updated weights for policy 0, policy_version 134160 (0.0006) [2023-03-11 14:28:20,692][22726] Updated weights for policy 0, policy_version 134240 (0.0005) [2023-03-11 14:28:21,345][22439] Fps is (10 sec: 10649.7, 60 sec: 11332.3, 300 sec: 11330.0). Total num frames: 68734976. Throughput: 0: 11321.1. Samples: 68727628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:28:21,346][22439] Avg episode reward: [(0, '1432.464')] [2023-03-11 14:28:24,163][22726] Updated weights for policy 0, policy_version 134320 (0.0005) [2023-03-11 14:28:26,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11400.5, 300 sec: 11357.7). Total num frames: 68796416. Throughput: 0: 11385.3. Samples: 68763276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:28:26,346][22439] Avg episode reward: [(0, '1276.435')] [2023-03-11 14:28:27,724][22726] Updated weights for policy 0, policy_version 134400 (0.0005) [2023-03-11 14:28:31,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11332.3, 300 sec: 11343.8). Total num frames: 68849664. Throughput: 0: 11353.8. Samples: 68831628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:28:31,346][22439] Avg episode reward: [(0, '1338.330')] [2023-03-11 14:28:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000134472_68849664.pth... [2023-03-11 14:28:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000133832_68521984.pth [2023-03-11 14:28:31,464][22726] Updated weights for policy 0, policy_version 134480 (0.0005) [2023-03-11 14:28:35,192][22726] Updated weights for policy 0, policy_version 134560 (0.0005) [2023-03-11 14:28:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 11357.7). Total num frames: 68907008. Throughput: 0: 11195.0. Samples: 68897536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:28:36,346][22439] Avg episode reward: [(0, '1327.228')] [2023-03-11 14:28:38,943][22726] Updated weights for policy 0, policy_version 134640 (0.0004) [2023-03-11 14:28:41,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 11343.8). Total num frames: 68960256. Throughput: 0: 11172.0. Samples: 68930588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:28:41,346][22439] Avg episode reward: [(0, '1419.730')] [2023-03-11 14:28:42,804][22726] Updated weights for policy 0, policy_version 134720 (0.0005) [2023-03-11 14:28:46,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11195.7, 300 sec: 11329.9). Total num frames: 69013504. Throughput: 0: 11011.1. Samples: 68993600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:28:46,346][22439] Avg episode reward: [(0, '1307.230')] [2023-03-11 14:28:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000134792_69013504.pth... [2023-03-11 14:28:46,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000134144_68681728.pth [2023-03-11 14:28:46,675][22726] Updated weights for policy 0, policy_version 134800 (0.0005) [2023-03-11 14:28:50,217][22726] Updated weights for policy 0, policy_version 134880 (0.0004) [2023-03-11 14:28:51,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11127.5, 300 sec: 11343.8). Total num frames: 69070848. Throughput: 0: 10975.6. Samples: 69061008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:28:51,346][22439] Avg episode reward: [(0, '1237.735')] [2023-03-11 14:28:53,924][22726] Updated weights for policy 0, policy_version 134960 (0.0004) [2023-03-11 14:28:56,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11059.2, 300 sec: 11330.0). Total num frames: 69124096. Throughput: 0: 10987.2. Samples: 69094244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:28:56,346][22439] Avg episode reward: [(0, '1454.966')] [2023-03-11 14:28:57,525][22726] Updated weights for policy 0, policy_version 135040 (0.0004) [2023-03-11 14:29:01,093][22726] Updated weights for policy 0, policy_version 135120 (0.0004) [2023-03-11 14:29:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 11330.0). Total num frames: 69181440. Throughput: 0: 11122.3. Samples: 69162356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:29:01,346][22439] Avg episode reward: [(0, '1371.103')] [2023-03-11 14:29:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000135120_69181440.pth... [2023-03-11 14:29:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000134472_68849664.pth [2023-03-11 14:29:04,871][22726] Updated weights for policy 0, policy_version 135200 (0.0005) [2023-03-11 14:29:06,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11059.2, 300 sec: 11330.0). Total num frames: 69238784. Throughput: 0: 11124.2. Samples: 69228216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:29:06,346][22439] Avg episode reward: [(0, '1407.622')] [2023-03-11 14:29:08,569][22726] Updated weights for policy 0, policy_version 135280 (0.0003) [2023-03-11 14:29:11,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 11330.0). Total num frames: 69292032. Throughput: 0: 11075.8. Samples: 69261688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:29:11,346][22439] Avg episode reward: [(0, '1291.820')] [2023-03-11 14:29:12,220][22726] Updated weights for policy 0, policy_version 135360 (0.0004) [2023-03-11 14:29:16,065][22726] Updated weights for policy 0, policy_version 135440 (0.0005) [2023-03-11 14:29:16,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11059.2, 300 sec: 11316.1). Total num frames: 69345280. Throughput: 0: 11046.1. Samples: 69328704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:29:16,346][22439] Avg episode reward: [(0, '1421.362')] [2023-03-11 14:29:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000135440_69345280.pth... [2023-03-11 14:29:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000134792_69013504.pth [2023-03-11 14:29:19,847][22726] Updated weights for policy 0, policy_version 135520 (0.0005) [2023-03-11 14:29:21,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11059.2, 300 sec: 11302.2). Total num frames: 69398528. Throughput: 0: 11000.8. Samples: 69392572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:29:21,346][22439] Avg episode reward: [(0, '1239.193')] [2023-03-11 14:29:23,675][22726] Updated weights for policy 0, policy_version 135600 (0.0005) [2023-03-11 14:29:26,345][22439] Fps is (10 sec: 10649.7, 60 sec: 10922.7, 300 sec: 11274.4). Total num frames: 69451776. Throughput: 0: 10968.3. Samples: 69424160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:29:26,346][22439] Avg episode reward: [(0, '1521.764')] [2023-03-11 14:29:27,571][22726] Updated weights for policy 0, policy_version 135680 (0.0005) [2023-03-11 14:29:31,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10922.7, 300 sec: 11260.5). Total num frames: 69505024. Throughput: 0: 11000.9. Samples: 69488640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:29:31,346][22439] Avg episode reward: [(0, '1432.874')] [2023-03-11 14:29:31,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000135752_69505024.pth... [2023-03-11 14:29:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000135120_69181440.pth [2023-03-11 14:29:31,436][22726] Updated weights for policy 0, policy_version 135760 (0.0005) [2023-03-11 14:29:35,243][22726] Updated weights for policy 0, policy_version 135840 (0.0005) [2023-03-11 14:29:36,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10854.4, 300 sec: 11232.8). Total num frames: 69558272. Throughput: 0: 10914.7. Samples: 69552168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:29:36,346][22439] Avg episode reward: [(0, '1331.710')] [2023-03-11 14:29:38,972][22726] Updated weights for policy 0, policy_version 135920 (0.0005) [2023-03-11 14:29:41,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 11232.8). Total num frames: 69615616. Throughput: 0: 10906.4. Samples: 69585032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:29:41,346][22439] Avg episode reward: [(0, '1198.887')] [2023-03-11 14:29:42,760][22726] Updated weights for policy 0, policy_version 136000 (0.0005) [2023-03-11 14:29:46,345][22439] Fps is (10 sec: 11059.1, 60 sec: 10922.7, 300 sec: 11205.0). Total num frames: 69668864. Throughput: 0: 10844.4. Samples: 69650356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:29:46,346][22439] Avg episode reward: [(0, '1388.859')] [2023-03-11 14:29:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000136072_69668864.pth... [2023-03-11 14:29:46,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000135440_69345280.pth [2023-03-11 14:29:46,513][22726] Updated weights for policy 0, policy_version 136080 (0.0006) [2023-03-11 14:29:50,424][22726] Updated weights for policy 0, policy_version 136160 (0.0005) [2023-03-11 14:29:51,345][22439] Fps is (10 sec: 10649.7, 60 sec: 10854.4, 300 sec: 11177.2). Total num frames: 69722112. Throughput: 0: 10794.8. Samples: 69713984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:29:51,346][22439] Avg episode reward: [(0, '1521.247')] [2023-03-11 14:29:54,189][22726] Updated weights for policy 0, policy_version 136240 (0.0006) [2023-03-11 14:29:56,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10854.4, 300 sec: 11163.3). Total num frames: 69775360. Throughput: 0: 10777.9. Samples: 69746696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:29:56,346][22439] Avg episode reward: [(0, '1410.019')] [2023-03-11 14:29:58,005][22726] Updated weights for policy 0, policy_version 136320 (0.0005) [2023-03-11 14:30:01,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10786.1, 300 sec: 11135.6). Total num frames: 69828608. Throughput: 0: 10729.2. Samples: 69811516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:30:01,346][22439] Avg episode reward: [(0, '1393.231')] [2023-03-11 14:30:01,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000136384_69828608.pth... [2023-03-11 14:30:01,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000135752_69505024.pth [2023-03-11 14:30:01,756][22726] Updated weights for policy 0, policy_version 136400 (0.0005) [2023-03-11 14:30:05,657][22726] Updated weights for policy 0, policy_version 136480 (0.0005) [2023-03-11 14:30:06,345][22439] Fps is (10 sec: 10649.7, 60 sec: 10717.9, 300 sec: 11135.6). Total num frames: 69881856. Throughput: 0: 10724.2. Samples: 69875160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:30:06,346][22439] Avg episode reward: [(0, '1386.178')] [2023-03-11 14:30:09,359][22726] Updated weights for policy 0, policy_version 136560 (0.0005) [2023-03-11 14:30:11,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10786.1, 300 sec: 11135.6). Total num frames: 69939200. Throughput: 0: 10759.6. Samples: 69908344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:30:11,346][22439] Avg episode reward: [(0, '1138.880')] [2023-03-11 14:30:13,080][22726] Updated weights for policy 0, policy_version 136640 (0.0005) [2023-03-11 14:30:16,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10786.1, 300 sec: 11121.7). Total num frames: 69992448. Throughput: 0: 10799.7. Samples: 69974628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:30:16,346][22439] Avg episode reward: [(0, '1684.083')] [2023-03-11 14:30:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000136704_69992448.pth... [2023-03-11 14:30:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000136072_69668864.pth [2023-03-11 14:30:16,859][22726] Updated weights for policy 0, policy_version 136720 (0.0005) [2023-03-11 14:30:20,791][22726] Updated weights for policy 0, policy_version 136800 (0.0005) [2023-03-11 14:30:21,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10786.1, 300 sec: 11121.7). Total num frames: 70045696. Throughput: 0: 10786.8. Samples: 70037576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:30:21,346][22439] Avg episode reward: [(0, '1495.856')] [2023-03-11 14:30:24,736][22726] Updated weights for policy 0, policy_version 136880 (0.0005) [2023-03-11 14:30:26,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10786.1, 300 sec: 11107.8). Total num frames: 70098944. Throughput: 0: 10756.5. Samples: 70069072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:30:26,346][22439] Avg episode reward: [(0, '1439.059')] [2023-03-11 14:30:28,557][22726] Updated weights for policy 0, policy_version 136960 (0.0005) [2023-03-11 14:30:31,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10786.1, 300 sec: 11107.8). Total num frames: 70152192. Throughput: 0: 10707.1. Samples: 70132176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:30:31,346][22439] Avg episode reward: [(0, '1496.906')] [2023-03-11 14:30:31,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000137016_70152192.pth... [2023-03-11 14:30:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000136384_69828608.pth [2023-03-11 14:30:32,460][22726] Updated weights for policy 0, policy_version 137040 (0.0005) [2023-03-11 14:30:36,343][22726] Updated weights for policy 0, policy_version 137120 (0.0005) [2023-03-11 14:30:36,345][22439] Fps is (10 sec: 10649.7, 60 sec: 10786.1, 300 sec: 11093.9). Total num frames: 70205440. Throughput: 0: 10722.8. Samples: 70196508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:30:36,345][22439] Avg episode reward: [(0, '1530.898')] [2023-03-11 14:30:40,163][22726] Updated weights for policy 0, policy_version 137200 (0.0005) [2023-03-11 14:30:41,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10717.9, 300 sec: 11080.0). Total num frames: 70258688. Throughput: 0: 10695.3. Samples: 70227984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:30:41,346][22439] Avg episode reward: [(0, '1640.572')] [2023-03-11 14:30:43,913][22726] Updated weights for policy 0, policy_version 137280 (0.0005) [2023-03-11 14:30:46,345][22439] Fps is (10 sec: 10649.4, 60 sec: 10717.9, 300 sec: 11080.0). Total num frames: 70311936. Throughput: 0: 10693.4. Samples: 70292720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:30:46,346][22439] Avg episode reward: [(0, '1351.654')] [2023-03-11 14:30:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000137328_70311936.pth... [2023-03-11 14:30:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000136704_69992448.pth [2023-03-11 14:30:47,645][22726] Updated weights for policy 0, policy_version 137360 (0.0005) [2023-03-11 14:30:51,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10717.9, 300 sec: 11066.1). Total num frames: 70365184. Throughput: 0: 10716.1. Samples: 70357384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:30:51,346][22439] Avg episode reward: [(0, '1368.231')] [2023-03-11 14:30:51,517][22726] Updated weights for policy 0, policy_version 137440 (0.0006) [2023-03-11 14:30:55,280][22726] Updated weights for policy 0, policy_version 137520 (0.0005) [2023-03-11 14:30:56,345][22439] Fps is (10 sec: 11059.3, 60 sec: 10786.1, 300 sec: 11080.0). Total num frames: 70422528. Throughput: 0: 10699.5. Samples: 70389824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:30:56,346][22439] Avg episode reward: [(0, '1227.124')] [2023-03-11 14:30:58,897][22726] Updated weights for policy 0, policy_version 137600 (0.0004) [2023-03-11 14:31:01,345][22439] Fps is (10 sec: 11059.1, 60 sec: 10786.1, 300 sec: 11066.1). Total num frames: 70475776. Throughput: 0: 10723.7. Samples: 70457196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:31:01,346][22439] Avg episode reward: [(0, '1689.051')] [2023-03-11 14:31:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000137648_70475776.pth... [2023-03-11 14:31:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000137016_70152192.pth [2023-03-11 14:31:02,596][22726] Updated weights for policy 0, policy_version 137680 (0.0003) [2023-03-11 14:31:06,293][22726] Updated weights for policy 0, policy_version 137760 (0.0003) [2023-03-11 14:31:06,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10854.4, 300 sec: 11080.0). Total num frames: 70533120. Throughput: 0: 10822.1. Samples: 70524572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:31:06,346][22439] Avg episode reward: [(0, '1445.423')] [2023-03-11 14:31:09,880][22726] Updated weights for policy 0, policy_version 137840 (0.0004) [2023-03-11 14:31:11,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10786.1, 300 sec: 11066.1). Total num frames: 70586368. Throughput: 0: 10858.6. Samples: 70557708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:31:11,346][22439] Avg episode reward: [(0, '1122.969')] [2023-03-11 14:31:13,570][22726] Updated weights for policy 0, policy_version 137920 (0.0005) [2023-03-11 14:31:16,345][22439] Fps is (10 sec: 11059.1, 60 sec: 10854.4, 300 sec: 11066.1). Total num frames: 70643712. Throughput: 0: 10929.7. Samples: 70624012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:31:16,346][22439] Avg episode reward: [(0, '1468.141')] [2023-03-11 14:31:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000137976_70643712.pth... [2023-03-11 14:31:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000137328_70311936.pth [2023-03-11 14:31:17,226][22726] Updated weights for policy 0, policy_version 138000 (0.0005) [2023-03-11 14:31:20,908][22726] Updated weights for policy 0, policy_version 138080 (0.0004) [2023-03-11 14:31:21,345][22439] Fps is (10 sec: 11468.8, 60 sec: 10922.7, 300 sec: 11080.0). Total num frames: 70701056. Throughput: 0: 11017.7. Samples: 70692304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:31:21,346][22439] Avg episode reward: [(0, '1570.973')] [2023-03-11 14:31:24,555][22726] Updated weights for policy 0, policy_version 138160 (0.0003) [2023-03-11 14:31:26,345][22439] Fps is (10 sec: 11059.3, 60 sec: 10922.7, 300 sec: 11066.1). Total num frames: 70754304. Throughput: 0: 11060.3. Samples: 70725696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:31:26,346][22439] Avg episode reward: [(0, '1445.668')] [2023-03-11 14:31:28,360][22726] Updated weights for policy 0, policy_version 138240 (0.0003) [2023-03-11 14:31:31,345][22439] Fps is (10 sec: 10649.6, 60 sec: 10922.7, 300 sec: 11052.3). Total num frames: 70807552. Throughput: 0: 11066.9. Samples: 70790728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:31:31,346][22439] Avg episode reward: [(0, '1801.183')] [2023-03-11 14:31:31,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000138296_70807552.pth... [2023-03-11 14:31:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000137648_70475776.pth [2023-03-11 14:31:32,143][22726] Updated weights for policy 0, policy_version 138320 (0.0004) [2023-03-11 14:31:35,627][22726] Updated weights for policy 0, policy_version 138400 (0.0005) [2023-03-11 14:31:36,345][22439] Fps is (10 sec: 11059.3, 60 sec: 10990.9, 300 sec: 11052.3). Total num frames: 70864896. Throughput: 0: 11143.4. Samples: 70858836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:31:36,346][22439] Avg episode reward: [(0, '1427.752')] [2023-03-11 14:31:39,216][22726] Updated weights for policy 0, policy_version 138480 (0.0005) [2023-03-11 14:31:41,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11059.2, 300 sec: 11038.4). Total num frames: 70922240. Throughput: 0: 11173.3. Samples: 70892620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:31:41,346][22439] Avg episode reward: [(0, '1796.922')] [2023-03-11 14:31:42,736][22726] Updated weights for policy 0, policy_version 138560 (0.0004) [2023-03-11 14:31:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11127.5, 300 sec: 11052.3). Total num frames: 70979584. Throughput: 0: 11221.3. Samples: 70962152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:31:46,346][22439] Avg episode reward: [(0, '1362.726')] [2023-03-11 14:31:46,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000138632_70979584.pth... [2023-03-11 14:31:46,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000137976_70643712.pth [2023-03-11 14:31:46,442][22726] Updated weights for policy 0, policy_version 138640 (0.0005) [2023-03-11 14:31:50,179][22726] Updated weights for policy 0, policy_version 138720 (0.0004) [2023-03-11 14:31:51,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11195.7, 300 sec: 11052.3). Total num frames: 71036928. Throughput: 0: 11180.6. Samples: 71027700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:31:51,346][22439] Avg episode reward: [(0, '1782.226')] [2023-03-11 14:31:53,981][22726] Updated weights for policy 0, policy_version 138800 (0.0006) [2023-03-11 14:31:56,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11127.5, 300 sec: 11024.5). Total num frames: 71090176. Throughput: 0: 11166.2. Samples: 71060188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:31:56,346][22439] Avg episode reward: [(0, '1636.828')] [2023-03-11 14:31:57,896][22726] Updated weights for policy 0, policy_version 138880 (0.0006) [2023-03-11 14:32:01,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11127.5, 300 sec: 11024.5). Total num frames: 71143424. Throughput: 0: 11087.7. Samples: 71122956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:32:01,346][22439] Avg episode reward: [(0, '1682.429')] [2023-03-11 14:32:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000138952_71143424.pth... [2023-03-11 14:32:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000138296_70807552.pth [2023-03-11 14:32:01,700][22726] Updated weights for policy 0, policy_version 138960 (0.0004) [2023-03-11 14:32:05,416][22726] Updated weights for policy 0, policy_version 139040 (0.0003) [2023-03-11 14:32:06,345][22439] Fps is (10 sec: 10649.5, 60 sec: 11059.2, 300 sec: 11010.6). Total num frames: 71196672. Throughput: 0: 11027.5. Samples: 71188544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:32:06,346][22439] Avg episode reward: [(0, '1741.748')] [2023-03-11 14:32:08,952][22726] Updated weights for policy 0, policy_version 139120 (0.0003) [2023-03-11 14:32:11,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11024.5). Total num frames: 71254016. Throughput: 0: 11076.0. Samples: 71224116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:32:11,346][22439] Avg episode reward: [(0, '1321.696')] [2023-03-11 14:32:12,735][22726] Updated weights for policy 0, policy_version 139200 (0.0004) [2023-03-11 14:32:16,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11059.2, 300 sec: 11024.5). Total num frames: 71307264. Throughput: 0: 11057.1. Samples: 71288300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:32:16,346][22439] Avg episode reward: [(0, '1633.783')] [2023-03-11 14:32:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000139272_71307264.pth... [2023-03-11 14:32:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000138632_70979584.pth [2023-03-11 14:32:16,433][22726] Updated weights for policy 0, policy_version 139280 (0.0004) [2023-03-11 14:32:20,004][22726] Updated weights for policy 0, policy_version 139360 (0.0005) [2023-03-11 14:32:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 11024.5). Total num frames: 71364608. Throughput: 0: 11065.0. Samples: 71356760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:32:21,346][22439] Avg episode reward: [(0, '1386.849')] [2023-03-11 14:32:23,741][22726] Updated weights for policy 0, policy_version 139440 (0.0005) [2023-03-11 14:32:26,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11127.5, 300 sec: 11024.5). Total num frames: 71421952. Throughput: 0: 11036.2. Samples: 71389248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:32:26,346][22439] Avg episode reward: [(0, '1330.801')] [2023-03-11 14:32:27,196][22726] Updated weights for policy 0, policy_version 139520 (0.0004) [2023-03-11 14:32:30,760][22726] Updated weights for policy 0, policy_version 139600 (0.0004) [2023-03-11 14:32:31,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 11024.5). Total num frames: 71479296. Throughput: 0: 11065.5. Samples: 71460100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:32:31,346][22439] Avg episode reward: [(0, '1409.177')] [2023-03-11 14:32:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000139608_71479296.pth... [2023-03-11 14:32:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000138952_71143424.pth [2023-03-11 14:32:34,331][22726] Updated weights for policy 0, policy_version 139680 (0.0003) [2023-03-11 14:32:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 11038.4). Total num frames: 71536640. Throughput: 0: 11127.7. Samples: 71528448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:32:36,346][22439] Avg episode reward: [(0, '1563.367')] [2023-03-11 14:32:38,116][22726] Updated weights for policy 0, policy_version 139760 (0.0003) [2023-03-11 14:32:41,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11127.5, 300 sec: 11010.6). Total num frames: 71589888. Throughput: 0: 11131.6. Samples: 71561108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:32:41,346][22439] Avg episode reward: [(0, '1455.706')] [2023-03-11 14:32:41,849][22726] Updated weights for policy 0, policy_version 139840 (0.0004) [2023-03-11 14:32:45,512][22726] Updated weights for policy 0, policy_version 139920 (0.0003) [2023-03-11 14:32:46,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.4, 300 sec: 10996.7). Total num frames: 71647232. Throughput: 0: 11212.3. Samples: 71627508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:32:46,346][22439] Avg episode reward: [(0, '1443.483')] [2023-03-11 14:32:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000139936_71647232.pth... [2023-03-11 14:32:46,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000139272_71307264.pth [2023-03-11 14:32:49,357][22726] Updated weights for policy 0, policy_version 140000 (0.0005) [2023-03-11 14:32:51,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 10982.8). Total num frames: 71700480. Throughput: 0: 11183.1. Samples: 71691784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:32:51,346][22439] Avg episode reward: [(0, '1495.050')] [2023-03-11 14:32:53,085][22726] Updated weights for policy 0, policy_version 140080 (0.0005) [2023-03-11 14:32:56,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 10982.8). Total num frames: 71757824. Throughput: 0: 11132.2. Samples: 71725064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:32:56,346][22439] Avg episode reward: [(0, '1587.761')] [2023-03-11 14:32:56,637][22726] Updated weights for policy 0, policy_version 140160 (0.0005) [2023-03-11 14:33:00,124][22726] Updated weights for policy 0, policy_version 140240 (0.0004) [2023-03-11 14:33:01,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 10982.8). Total num frames: 71815168. Throughput: 0: 11254.5. Samples: 71794752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:33:01,346][22439] Avg episode reward: [(0, '1755.084')] [2023-03-11 14:33:01,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000140264_71815168.pth... [2023-03-11 14:33:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000139608_71479296.pth [2023-03-11 14:33:03,801][22726] Updated weights for policy 0, policy_version 140320 (0.0005) [2023-03-11 14:33:06,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11264.0, 300 sec: 10996.7). Total num frames: 71872512. Throughput: 0: 11232.4. Samples: 71862216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:33:06,346][22439] Avg episode reward: [(0, '1513.402')] [2023-03-11 14:33:07,515][22726] Updated weights for policy 0, policy_version 140400 (0.0005) [2023-03-11 14:33:11,164][22726] Updated weights for policy 0, policy_version 140480 (0.0005) [2023-03-11 14:33:11,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11195.7, 300 sec: 10996.7). Total num frames: 71925760. Throughput: 0: 11242.5. Samples: 71895160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:33:11,346][22439] Avg episode reward: [(0, '1642.018')] [2023-03-11 14:33:14,743][22726] Updated weights for policy 0, policy_version 140560 (0.0005) [2023-03-11 14:33:16,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11264.0, 300 sec: 11010.6). Total num frames: 71983104. Throughput: 0: 11179.1. Samples: 71963160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:33:16,346][22439] Avg episode reward: [(0, '1479.074')] [2023-03-11 14:33:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000140592_71983104.pth... [2023-03-11 14:33:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000139936_71647232.pth [2023-03-11 14:33:18,275][22726] Updated weights for policy 0, policy_version 140640 (0.0005) [2023-03-11 14:33:21,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 10996.7). Total num frames: 72040448. Throughput: 0: 11207.3. Samples: 72032776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:33:21,346][22439] Avg episode reward: [(0, '1368.154')] [2023-03-11 14:33:21,781][22726] Updated weights for policy 0, policy_version 140720 (0.0005) [2023-03-11 14:33:25,123][22726] Updated weights for policy 0, policy_version 140800 (0.0004) [2023-03-11 14:33:26,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11332.3, 300 sec: 11024.5). Total num frames: 72101888. Throughput: 0: 11272.0. Samples: 72068348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:33:26,346][22439] Avg episode reward: [(0, '1499.927')] [2023-03-11 14:33:28,839][22726] Updated weights for policy 0, policy_version 140880 (0.0005) [2023-03-11 14:33:31,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11010.6). Total num frames: 72155136. Throughput: 0: 11326.9. Samples: 72137220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:33:31,346][22439] Avg episode reward: [(0, '1413.734')] [2023-03-11 14:33:31,377][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000140936_72159232.pth... [2023-03-11 14:33:31,378][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000140264_71815168.pth [2023-03-11 14:33:32,480][22726] Updated weights for policy 0, policy_version 140960 (0.0005) [2023-03-11 14:33:35,942][22726] Updated weights for policy 0, policy_version 141040 (0.0005) [2023-03-11 14:33:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11038.4). Total num frames: 72216576. Throughput: 0: 11434.1. Samples: 72206320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:33:36,346][22439] Avg episode reward: [(0, '1508.669')] [2023-03-11 14:33:39,587][22726] Updated weights for policy 0, policy_version 141120 (0.0005) [2023-03-11 14:33:41,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11038.4). Total num frames: 72269824. Throughput: 0: 11468.8. Samples: 72241160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:33:41,346][22439] Avg episode reward: [(0, '1370.618')] [2023-03-11 14:33:43,420][22726] Updated weights for policy 0, policy_version 141200 (0.0006) [2023-03-11 14:33:46,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11264.0, 300 sec: 11024.5). Total num frames: 72323072. Throughput: 0: 11339.6. Samples: 72305036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:33:46,346][22439] Avg episode reward: [(0, '1629.351')] [2023-03-11 14:33:46,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000141256_72323072.pth... [2023-03-11 14:33:46,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000140592_71983104.pth [2023-03-11 14:33:47,193][22726] Updated weights for policy 0, policy_version 141280 (0.0005) [2023-03-11 14:33:50,981][22726] Updated weights for policy 0, policy_version 141360 (0.0005) [2023-03-11 14:33:51,345][22439] Fps is (10 sec: 10649.5, 60 sec: 11264.0, 300 sec: 11024.5). Total num frames: 72376320. Throughput: 0: 11290.5. Samples: 72370292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:33:51,346][22439] Avg episode reward: [(0, '1605.157')] [2023-03-11 14:33:54,851][22726] Updated weights for policy 0, policy_version 141440 (0.0006) [2023-03-11 14:33:56,345][22439] Fps is (10 sec: 10649.5, 60 sec: 11195.7, 300 sec: 11010.6). Total num frames: 72429568. Throughput: 0: 11259.0. Samples: 72401816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:33:56,346][22439] Avg episode reward: [(0, '1505.591')] [2023-03-11 14:33:58,671][22726] Updated weights for policy 0, policy_version 141520 (0.0006) [2023-03-11 14:34:01,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11195.7, 300 sec: 11010.6). Total num frames: 72486912. Throughput: 0: 11199.0. Samples: 72467116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:34:01,346][22439] Avg episode reward: [(0, '1420.166')] [2023-03-11 14:34:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000141576_72486912.pth... [2023-03-11 14:34:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000140936_72159232.pth [2023-03-11 14:34:02,201][22726] Updated weights for policy 0, policy_version 141600 (0.0005) [2023-03-11 14:34:05,883][22726] Updated weights for policy 0, policy_version 141680 (0.0004) [2023-03-11 14:34:06,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11195.7, 300 sec: 11024.5). Total num frames: 72544256. Throughput: 0: 11176.9. Samples: 72535736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:34:06,346][22439] Avg episode reward: [(0, '1591.468')] [2023-03-11 14:34:09,687][22726] Updated weights for policy 0, policy_version 141760 (0.0005) [2023-03-11 14:34:11,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11024.5). Total num frames: 72597504. Throughput: 0: 11112.9. Samples: 72568428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:34:11,346][22439] Avg episode reward: [(0, '1389.342')] [2023-03-11 14:34:13,532][22726] Updated weights for policy 0, policy_version 141840 (0.0006) [2023-03-11 14:34:16,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11127.5, 300 sec: 11024.5). Total num frames: 72650752. Throughput: 0: 10997.0. Samples: 72632084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:34:16,346][22439] Avg episode reward: [(0, '1287.543')] [2023-03-11 14:34:16,347][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000141896_72650752.pth... [2023-03-11 14:34:16,349][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000141256_72323072.pth [2023-03-11 14:34:17,139][22726] Updated weights for policy 0, policy_version 141920 (0.0005) [2023-03-11 14:34:20,657][22726] Updated weights for policy 0, policy_version 142000 (0.0005) [2023-03-11 14:34:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11038.4). Total num frames: 72708096. Throughput: 0: 11002.2. Samples: 72701420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:34:21,346][22439] Avg episode reward: [(0, '1629.566')] [2023-03-11 14:34:24,112][22726] Updated weights for policy 0, policy_version 142080 (0.0005) [2023-03-11 14:34:26,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11127.5, 300 sec: 11066.1). Total num frames: 72769536. Throughput: 0: 11013.8. Samples: 72736780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:34:26,346][22439] Avg episode reward: [(0, '1568.875')] [2023-03-11 14:34:27,744][22726] Updated weights for policy 0, policy_version 142160 (0.0005) [2023-03-11 14:34:31,296][22726] Updated weights for policy 0, policy_version 142240 (0.0005) [2023-03-11 14:34:31,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11195.7, 300 sec: 11080.0). Total num frames: 72826880. Throughput: 0: 11104.0. Samples: 72804716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:34:31,346][22439] Avg episode reward: [(0, '1373.659')] [2023-03-11 14:34:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000142240_72826880.pth... [2023-03-11 14:34:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000141576_72486912.pth [2023-03-11 14:34:35,113][22726] Updated weights for policy 0, policy_version 142320 (0.0005) [2023-03-11 14:34:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 11066.1). Total num frames: 72880128. Throughput: 0: 11145.2. Samples: 72871824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:34:36,356][22439] Avg episode reward: [(0, '1402.638')] [2023-03-11 14:34:38,854][22726] Updated weights for policy 0, policy_version 142400 (0.0005) [2023-03-11 14:34:41,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11127.5, 300 sec: 11080.0). Total num frames: 72937472. Throughput: 0: 11171.7. Samples: 72904540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:34:41,356][22439] Avg episode reward: [(0, '1310.001')] [2023-03-11 14:34:42,425][22726] Updated weights for policy 0, policy_version 142480 (0.0004) [2023-03-11 14:34:45,911][22726] Updated weights for policy 0, policy_version 142560 (0.0005) [2023-03-11 14:34:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 11093.9). Total num frames: 72994816. Throughput: 0: 11248.5. Samples: 72973300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:34:46,356][22439] Avg episode reward: [(0, '1219.393')] [2023-03-11 14:34:46,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000142568_72994816.pth... [2023-03-11 14:34:46,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000141896_72650752.pth [2023-03-11 14:34:49,644][22726] Updated weights for policy 0, policy_version 142640 (0.0005) [2023-03-11 14:34:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11107.8). Total num frames: 73052160. Throughput: 0: 11224.6. Samples: 73040844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:34:51,356][22439] Avg episode reward: [(0, '1230.338')] [2023-03-11 14:34:53,056][22726] Updated weights for policy 0, policy_version 142720 (0.0004) [2023-03-11 14:34:56,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11332.3, 300 sec: 11121.7). Total num frames: 73109504. Throughput: 0: 11295.9. Samples: 73076744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:34:56,346][22439] Avg episode reward: [(0, '1621.245')] [2023-03-11 14:34:56,571][22726] Updated weights for policy 0, policy_version 142800 (0.0004) [2023-03-11 14:35:00,367][22726] Updated weights for policy 0, policy_version 142880 (0.0006) [2023-03-11 14:35:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11264.0, 300 sec: 11121.7). Total num frames: 73162752. Throughput: 0: 11387.9. Samples: 73144540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:35:01,346][22439] Avg episode reward: [(0, '1352.790')] [2023-03-11 14:35:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000142896_73162752.pth... [2023-03-11 14:35:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000142240_72826880.pth [2023-03-11 14:35:04,104][22726] Updated weights for policy 0, policy_version 142960 (0.0005) [2023-03-11 14:35:06,345][22439] Fps is (10 sec: 10649.7, 60 sec: 11195.7, 300 sec: 11107.8). Total num frames: 73216000. Throughput: 0: 11312.2. Samples: 73210468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:35:06,346][22439] Avg episode reward: [(0, '1240.676')] [2023-03-11 14:35:07,855][22726] Updated weights for policy 0, policy_version 143040 (0.0005) [2023-03-11 14:35:11,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11264.0, 300 sec: 11121.7). Total num frames: 73273344. Throughput: 0: 11260.1. Samples: 73243484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:35:11,346][22439] Avg episode reward: [(0, '1191.525')] [2023-03-11 14:35:11,520][22726] Updated weights for policy 0, policy_version 143120 (0.0005) [2023-03-11 14:35:15,167][22726] Updated weights for policy 0, policy_version 143200 (0.0005) [2023-03-11 14:35:16,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11332.3, 300 sec: 11135.6). Total num frames: 73330688. Throughput: 0: 11234.6. Samples: 73310272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:35:16,346][22439] Avg episode reward: [(0, '1169.361')] [2023-03-11 14:35:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000143224_73330688.pth... [2023-03-11 14:35:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000142568_72994816.pth [2023-03-11 14:35:18,872][22726] Updated weights for policy 0, policy_version 143280 (0.0005) [2023-03-11 14:35:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11264.0, 300 sec: 11135.6). Total num frames: 73383936. Throughput: 0: 11199.8. Samples: 73375816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:35:21,346][22439] Avg episode reward: [(0, '1176.363')] [2023-03-11 14:35:22,640][22726] Updated weights for policy 0, policy_version 143360 (0.0005) [2023-03-11 14:35:26,241][22726] Updated weights for policy 0, policy_version 143440 (0.0005) [2023-03-11 14:35:26,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11149.5). Total num frames: 73441280. Throughput: 0: 11201.0. Samples: 73408584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:35:26,346][22439] Avg episode reward: [(0, '1239.252')] [2023-03-11 14:35:29,909][22726] Updated weights for policy 0, policy_version 143520 (0.0005) [2023-03-11 14:35:31,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11149.4). Total num frames: 73494528. Throughput: 0: 11199.3. Samples: 73477268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:35:31,346][22439] Avg episode reward: [(0, '1096.905')] [2023-03-11 14:35:31,356][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000143552_73498624.pth... [2023-03-11 14:35:31,358][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000142896_73162752.pth [2023-03-11 14:35:33,600][22726] Updated weights for policy 0, policy_version 143600 (0.0005) [2023-03-11 14:35:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11163.3). Total num frames: 73551872. Throughput: 0: 11175.6. Samples: 73543744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:35:36,356][22439] Avg episode reward: [(0, '926.104')] [2023-03-11 14:35:37,268][22726] Updated weights for policy 0, policy_version 143680 (0.0005) [2023-03-11 14:35:41,192][22726] Updated weights for policy 0, policy_version 143760 (0.0005) [2023-03-11 14:35:41,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11127.5, 300 sec: 11163.3). Total num frames: 73605120. Throughput: 0: 11104.8. Samples: 73576460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:35:41,346][22439] Avg episode reward: [(0, '1206.396')] [2023-03-11 14:35:44,989][22726] Updated weights for policy 0, policy_version 143840 (0.0005) [2023-03-11 14:35:46,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11059.2, 300 sec: 11163.3). Total num frames: 73658368. Throughput: 0: 11014.7. Samples: 73640200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:35:46,346][22439] Avg episode reward: [(0, '1446.243')] [2023-03-11 14:35:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000143864_73658368.pth... [2023-03-11 14:35:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000143224_73330688.pth [2023-03-11 14:35:48,548][22726] Updated weights for policy 0, policy_version 143920 (0.0005) [2023-03-11 14:35:51,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11059.2, 300 sec: 11163.3). Total num frames: 73715712. Throughput: 0: 11047.0. Samples: 73707584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:35:51,346][22439] Avg episode reward: [(0, '1241.697')] [2023-03-11 14:35:52,225][22726] Updated weights for policy 0, policy_version 144000 (0.0005) [2023-03-11 14:35:56,036][22726] Updated weights for policy 0, policy_version 144080 (0.0005) [2023-03-11 14:35:56,345][22439] Fps is (10 sec: 11059.3, 60 sec: 10990.9, 300 sec: 11163.3). Total num frames: 73768960. Throughput: 0: 11046.0. Samples: 73740552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:35:56,346][22439] Avg episode reward: [(0, '1332.382')] [2023-03-11 14:35:59,936][22726] Updated weights for policy 0, policy_version 144160 (0.0005) [2023-03-11 14:36:01,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10990.9, 300 sec: 11149.4). Total num frames: 73822208. Throughput: 0: 10999.4. Samples: 73805244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:36:01,346][22439] Avg episode reward: [(0, '1344.739')] [2023-03-11 14:36:01,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000144184_73822208.pth... [2023-03-11 14:36:01,353][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000143552_73498624.pth [2023-03-11 14:36:03,717][22726] Updated weights for policy 0, policy_version 144240 (0.0005) [2023-03-11 14:36:06,345][22439] Fps is (10 sec: 10649.5, 60 sec: 10990.9, 300 sec: 11149.5). Total num frames: 73875456. Throughput: 0: 10976.8. Samples: 73869772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:36:06,346][22439] Avg episode reward: [(0, '1182.907')] [2023-03-11 14:36:07,513][22726] Updated weights for policy 0, policy_version 144320 (0.0005) [2023-03-11 14:36:11,216][22726] Updated weights for policy 0, policy_version 144400 (0.0005) [2023-03-11 14:36:11,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 11149.5). Total num frames: 73932800. Throughput: 0: 10964.4. Samples: 73901984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:36:11,346][22439] Avg episode reward: [(0, '1121.494')] [2023-03-11 14:36:15,007][22726] Updated weights for policy 0, policy_version 144480 (0.0004) [2023-03-11 14:36:16,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 11135.6). Total num frames: 73986048. Throughput: 0: 10897.8. Samples: 73967668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:36:16,346][22439] Avg episode reward: [(0, '1410.902')] [2023-03-11 14:36:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000144504_73986048.pth... [2023-03-11 14:36:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000143864_73658368.pth [2023-03-11 14:36:18,655][22726] Updated weights for policy 0, policy_version 144560 (0.0005) [2023-03-11 14:36:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 11149.4). Total num frames: 74043392. Throughput: 0: 10883.6. Samples: 74033508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:36:21,346][22439] Avg episode reward: [(0, '1243.358')] [2023-03-11 14:36:22,320][22726] Updated weights for policy 0, policy_version 144640 (0.0005) [2023-03-11 14:36:25,814][22726] Updated weights for policy 0, policy_version 144720 (0.0005) [2023-03-11 14:36:26,345][22439] Fps is (10 sec: 11468.8, 60 sec: 10990.9, 300 sec: 11163.3). Total num frames: 74100736. Throughput: 0: 10941.5. Samples: 74068828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:36:26,346][22439] Avg episode reward: [(0, '1202.340')] [2023-03-11 14:36:29,415][22726] Updated weights for policy 0, policy_version 144800 (0.0005) [2023-03-11 14:36:31,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11059.2, 300 sec: 11163.3). Total num frames: 74158080. Throughput: 0: 11054.8. Samples: 74137664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:36:31,346][22439] Avg episode reward: [(0, '1034.469')] [2023-03-11 14:36:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000144840_74158080.pth... [2023-03-11 14:36:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000144184_73822208.pth [2023-03-11 14:36:33,184][22726] Updated weights for policy 0, policy_version 144880 (0.0005) [2023-03-11 14:36:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11059.2, 300 sec: 11163.3). Total num frames: 74215424. Throughput: 0: 11051.6. Samples: 74204908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:36:36,346][22439] Avg episode reward: [(0, '1135.666')] [2023-03-11 14:36:36,701][22726] Updated weights for policy 0, policy_version 144960 (0.0004) [2023-03-11 14:36:40,080][22726] Updated weights for policy 0, policy_version 145040 (0.0004) [2023-03-11 14:36:41,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11127.4, 300 sec: 11163.3). Total num frames: 74272768. Throughput: 0: 11099.2. Samples: 74240016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:36:41,346][22439] Avg episode reward: [(0, '1072.919')] [2023-03-11 14:36:43,572][22726] Updated weights for policy 0, policy_version 145120 (0.0005) [2023-03-11 14:36:46,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11195.7, 300 sec: 11163.3). Total num frames: 74330112. Throughput: 0: 11249.9. Samples: 74311488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:36:46,346][22439] Avg episode reward: [(0, '1101.131')] [2023-03-11 14:36:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000145184_74334208.pth... [2023-03-11 14:36:46,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000144504_73986048.pth [2023-03-11 14:36:47,096][22726] Updated weights for policy 0, policy_version 145200 (0.0005) [2023-03-11 14:36:50,793][22726] Updated weights for policy 0, policy_version 145280 (0.0005) [2023-03-11 14:36:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 11177.2). Total num frames: 74387456. Throughput: 0: 11323.5. Samples: 74379328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:36:51,346][22439] Avg episode reward: [(0, '1302.602')] [2023-03-11 14:36:54,539][22726] Updated weights for policy 0, policy_version 145360 (0.0005) [2023-03-11 14:36:56,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11195.7, 300 sec: 11177.2). Total num frames: 74440704. Throughput: 0: 11336.0. Samples: 74412104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:36:56,346][22439] Avg episode reward: [(0, '1380.953')] [2023-03-11 14:36:58,157][22726] Updated weights for policy 0, policy_version 145440 (0.0004) [2023-03-11 14:37:01,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11332.3, 300 sec: 11205.0). Total num frames: 74502144. Throughput: 0: 11393.9. Samples: 74480392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:37:01,346][22439] Avg episode reward: [(0, '1309.242')] [2023-03-11 14:37:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000145512_74502144.pth... [2023-03-11 14:37:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000144840_74158080.pth [2023-03-11 14:37:01,498][22726] Updated weights for policy 0, policy_version 145520 (0.0004) [2023-03-11 14:37:04,822][22726] Updated weights for policy 0, policy_version 145600 (0.0004) [2023-03-11 14:37:06,345][22439] Fps is (10 sec: 12287.9, 60 sec: 11468.8, 300 sec: 11218.9). Total num frames: 74563584. Throughput: 0: 11587.4. Samples: 74554940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:37:06,346][22439] Avg episode reward: [(0, '1169.099')] [2023-03-11 14:37:08,252][22726] Updated weights for policy 0, policy_version 145680 (0.0004) [2023-03-11 14:37:11,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 11232.8). Total num frames: 74620928. Throughput: 0: 11587.7. Samples: 74590272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:37:11,346][22439] Avg episode reward: [(0, '1220.519')] [2023-03-11 14:37:11,749][22726] Updated weights for policy 0, policy_version 145760 (0.0005) [2023-03-11 14:37:15,085][22726] Updated weights for policy 0, policy_version 145840 (0.0004) [2023-03-11 14:37:16,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 11246.6). Total num frames: 74682368. Throughput: 0: 11659.5. Samples: 74662344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:37:16,346][22439] Avg episode reward: [(0, '1127.306')] [2023-03-11 14:37:16,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000145864_74682368.pth... [2023-03-11 14:37:16,353][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000145184_74334208.pth [2023-03-11 14:37:18,748][22726] Updated weights for policy 0, policy_version 145920 (0.0005) [2023-03-11 14:37:21,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11246.6). Total num frames: 74739712. Throughput: 0: 11693.8. Samples: 74731128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:37:21,346][22439] Avg episode reward: [(0, '1400.928')] [2023-03-11 14:37:22,324][22726] Updated weights for policy 0, policy_version 146000 (0.0005) [2023-03-11 14:37:26,028][22726] Updated weights for policy 0, policy_version 146080 (0.0005) [2023-03-11 14:37:26,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11537.1, 300 sec: 11232.8). Total num frames: 74792960. Throughput: 0: 11650.5. Samples: 74764288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:37:26,346][22439] Avg episode reward: [(0, '1240.687')] [2023-03-11 14:37:29,816][22726] Updated weights for policy 0, policy_version 146160 (0.0005) [2023-03-11 14:37:31,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11232.8). Total num frames: 74850304. Throughput: 0: 11518.9. Samples: 74829836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:37:31,346][22439] Avg episode reward: [(0, '1263.936')] [2023-03-11 14:37:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000146192_74850304.pth... [2023-03-11 14:37:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000145512_74502144.pth [2023-03-11 14:37:33,543][22726] Updated weights for policy 0, policy_version 146240 (0.0005) [2023-03-11 14:37:36,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11246.6). Total num frames: 74907648. Throughput: 0: 11517.4. Samples: 74897612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:37:36,346][22439] Avg episode reward: [(0, '1112.038')] [2023-03-11 14:37:36,949][22726] Updated weights for policy 0, policy_version 146320 (0.0005) [2023-03-11 14:37:40,420][22726] Updated weights for policy 0, policy_version 146400 (0.0005) [2023-03-11 14:37:41,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11246.6). Total num frames: 74964992. Throughput: 0: 11575.7. Samples: 74933012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:37:41,346][22439] Avg episode reward: [(0, '1263.357')] [2023-03-11 14:37:43,836][22726] Updated weights for policy 0, policy_version 146480 (0.0005) [2023-03-11 14:37:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11260.5). Total num frames: 75022336. Throughput: 0: 11644.2. Samples: 75004380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:37:46,346][22439] Avg episode reward: [(0, '1249.405')] [2023-03-11 14:37:46,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000146536_75026432.pth... [2023-03-11 14:37:46,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000145864_74682368.pth [2023-03-11 14:37:47,466][22726] Updated weights for policy 0, policy_version 146560 (0.0005) [2023-03-11 14:37:51,037][22726] Updated weights for policy 0, policy_version 146640 (0.0005) [2023-03-11 14:37:51,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11260.5). Total num frames: 75079680. Throughput: 0: 11503.7. Samples: 75072608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:37:51,346][22439] Avg episode reward: [(0, '1191.292')] [2023-03-11 14:37:54,485][22726] Updated weights for policy 0, policy_version 146720 (0.0005) [2023-03-11 14:37:56,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11274.4). Total num frames: 75141120. Throughput: 0: 11506.5. Samples: 75108064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:37:56,346][22439] Avg episode reward: [(0, '1374.284')] [2023-03-11 14:37:57,968][22726] Updated weights for policy 0, policy_version 146800 (0.0005) [2023-03-11 14:38:01,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11274.4). Total num frames: 75198464. Throughput: 0: 11474.0. Samples: 75178672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:38:01,346][22439] Avg episode reward: [(0, '1146.657')] [2023-03-11 14:38:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000146872_75198464.pth... [2023-03-11 14:38:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000146192_74850304.pth [2023-03-11 14:38:01,492][22726] Updated weights for policy 0, policy_version 146880 (0.0005) [2023-03-11 14:38:05,243][22726] Updated weights for policy 0, policy_version 146960 (0.0006) [2023-03-11 14:38:06,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11468.8, 300 sec: 11274.4). Total num frames: 75251712. Throughput: 0: 11437.2. Samples: 75245800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:38:06,346][22439] Avg episode reward: [(0, '1322.318')] [2023-03-11 14:38:08,931][22726] Updated weights for policy 0, policy_version 147040 (0.0005) [2023-03-11 14:38:11,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11468.8, 300 sec: 11274.4). Total num frames: 75309056. Throughput: 0: 11423.0. Samples: 75278324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:38:11,346][22439] Avg episode reward: [(0, '1264.462')] [2023-03-11 14:38:12,752][22726] Updated weights for policy 0, policy_version 147120 (0.0005) [2023-03-11 14:38:16,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11332.3, 300 sec: 11260.5). Total num frames: 75362304. Throughput: 0: 11420.8. Samples: 75343772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:38:16,346][22439] Avg episode reward: [(0, '1210.748')] [2023-03-11 14:38:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000147192_75362304.pth... [2023-03-11 14:38:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000146536_75026432.pth [2023-03-11 14:38:16,458][22726] Updated weights for policy 0, policy_version 147200 (0.0005) [2023-03-11 14:38:20,275][22726] Updated weights for policy 0, policy_version 147280 (0.0006) [2023-03-11 14:38:21,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11264.0, 300 sec: 11232.8). Total num frames: 75415552. Throughput: 0: 11361.0. Samples: 75408856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:38:21,346][22439] Avg episode reward: [(0, '1380.471')] [2023-03-11 14:38:24,086][22726] Updated weights for policy 0, policy_version 147360 (0.0006) [2023-03-11 14:38:26,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11332.3, 300 sec: 11246.6). Total num frames: 75472896. Throughput: 0: 11286.7. Samples: 75440912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:38:26,346][22439] Avg episode reward: [(0, '1400.631')] [2023-03-11 14:38:27,816][22726] Updated weights for policy 0, policy_version 147440 (0.0006) [2023-03-11 14:38:31,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11264.0, 300 sec: 11218.9). Total num frames: 75526144. Throughput: 0: 11158.0. Samples: 75506492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:38:31,346][22439] Avg episode reward: [(0, '1251.148')] [2023-03-11 14:38:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000147512_75526144.pth... [2023-03-11 14:38:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000146872_75198464.pth [2023-03-11 14:38:31,551][22726] Updated weights for policy 0, policy_version 147520 (0.0006) [2023-03-11 14:38:35,277][22726] Updated weights for policy 0, policy_version 147600 (0.0006) [2023-03-11 14:38:36,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11195.7, 300 sec: 11218.9). Total num frames: 75579392. Throughput: 0: 11114.8. Samples: 75572772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:38:36,346][22439] Avg episode reward: [(0, '1048.671')] [2023-03-11 14:38:38,824][22726] Updated weights for policy 0, policy_version 147680 (0.0004) [2023-03-11 14:38:41,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11246.6). Total num frames: 75640832. Throughput: 0: 11108.3. Samples: 75607936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:38:41,346][22439] Avg episode reward: [(0, '1144.247')] [2023-03-11 14:38:42,251][22726] Updated weights for policy 0, policy_version 147760 (0.0003) [2023-03-11 14:38:45,702][22726] Updated weights for policy 0, policy_version 147840 (0.0003) [2023-03-11 14:38:46,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11264.0, 300 sec: 11260.5). Total num frames: 75698176. Throughput: 0: 11121.3. Samples: 75679128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:38:46,346][22439] Avg episode reward: [(0, '1096.086')] [2023-03-11 14:38:46,405][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000147856_75702272.pth... [2023-03-11 14:38:46,409][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000147192_75362304.pth [2023-03-11 14:38:49,126][22726] Updated weights for policy 0, policy_version 147920 (0.0004) [2023-03-11 14:38:51,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11332.3, 300 sec: 11288.3). Total num frames: 75759616. Throughput: 0: 11234.7. Samples: 75751360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:38:51,346][22439] Avg episode reward: [(0, '983.194')] [2023-03-11 14:38:52,632][22726] Updated weights for policy 0, policy_version 148000 (0.0003) [2023-03-11 14:38:56,149][22726] Updated weights for policy 0, policy_version 148080 (0.0004) [2023-03-11 14:38:56,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11264.0, 300 sec: 11288.3). Total num frames: 75816960. Throughput: 0: 11262.9. Samples: 75785156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:38:56,346][22439] Avg episode reward: [(0, '996.346')] [2023-03-11 14:38:59,553][22726] Updated weights for policy 0, policy_version 148160 (0.0003) [2023-03-11 14:39:01,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11332.3, 300 sec: 11302.2). Total num frames: 75878400. Throughput: 0: 11385.7. Samples: 75856128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:39:01,346][22439] Avg episode reward: [(0, '1078.400')] [2023-03-11 14:39:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000148200_75878400.pth... [2023-03-11 14:39:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000147512_75526144.pth [2023-03-11 14:39:03,009][22726] Updated weights for policy 0, policy_version 148240 (0.0005) [2023-03-11 14:39:06,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11400.5, 300 sec: 11316.1). Total num frames: 75935744. Throughput: 0: 11528.0. Samples: 75927616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:39:06,346][22439] Avg episode reward: [(0, '959.985')] [2023-03-11 14:39:06,428][22726] Updated weights for policy 0, policy_version 148320 (0.0005) [2023-03-11 14:39:10,110][22726] Updated weights for policy 0, policy_version 148400 (0.0005) [2023-03-11 14:39:11,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11330.0). Total num frames: 75993088. Throughput: 0: 11578.2. Samples: 75961932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:39:11,355][22439] Avg episode reward: [(0, '1092.840')] [2023-03-11 14:39:13,792][22726] Updated weights for policy 0, policy_version 148480 (0.0005) [2023-03-11 14:39:16,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11330.0). Total num frames: 76050432. Throughput: 0: 11611.3. Samples: 76029000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:39:16,356][22439] Avg episode reward: [(0, '1120.720')] [2023-03-11 14:39:16,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000148536_76050432.pth... [2023-03-11 14:39:16,363][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000147856_75702272.pth [2023-03-11 14:39:17,364][22726] Updated weights for policy 0, policy_version 148560 (0.0005) [2023-03-11 14:39:21,112][22726] Updated weights for policy 0, policy_version 148640 (0.0005) [2023-03-11 14:39:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11468.8, 300 sec: 11302.2). Total num frames: 76103680. Throughput: 0: 11617.5. Samples: 76095560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:39:21,346][22439] Avg episode reward: [(0, '994.277')] [2023-03-11 14:39:24,912][22726] Updated weights for policy 0, policy_version 148720 (0.0005) [2023-03-11 14:39:26,345][22439] Fps is (10 sec: 10649.7, 60 sec: 11400.5, 300 sec: 11288.3). Total num frames: 76156928. Throughput: 0: 11565.5. Samples: 76128384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:39:26,346][22439] Avg episode reward: [(0, '1147.014')] [2023-03-11 14:39:28,653][22726] Updated weights for policy 0, policy_version 148800 (0.0005) [2023-03-11 14:39:31,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11468.8, 300 sec: 11302.2). Total num frames: 76214272. Throughput: 0: 11438.6. Samples: 76193864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:39:31,346][22439] Avg episode reward: [(0, '1133.284')] [2023-03-11 14:39:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000148856_76214272.pth... [2023-03-11 14:39:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000148200_75878400.pth [2023-03-11 14:39:32,304][22726] Updated weights for policy 0, policy_version 148880 (0.0005) [2023-03-11 14:39:36,028][22726] Updated weights for policy 0, policy_version 148960 (0.0005) [2023-03-11 14:39:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11468.8, 300 sec: 11288.3). Total num frames: 76267520. Throughput: 0: 11330.4. Samples: 76261228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:39:36,346][22439] Avg episode reward: [(0, '1172.076')] [2023-03-11 14:39:39,741][22726] Updated weights for policy 0, policy_version 149040 (0.0005) [2023-03-11 14:39:41,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11400.5, 300 sec: 11288.3). Total num frames: 76324864. Throughput: 0: 11313.9. Samples: 76294280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:39:41,346][22439] Avg episode reward: [(0, '1163.907')] [2023-03-11 14:39:43,447][22726] Updated weights for policy 0, policy_version 149120 (0.0005) [2023-03-11 14:39:46,345][22439] Fps is (10 sec: 11059.0, 60 sec: 11332.2, 300 sec: 11274.4). Total num frames: 76378112. Throughput: 0: 11205.5. Samples: 76360376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:39:46,346][22439] Avg episode reward: [(0, '1008.753')] [2023-03-11 14:39:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000149176_76378112.pth... [2023-03-11 14:39:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000148536_76050432.pth [2023-03-11 14:39:47,180][22726] Updated weights for policy 0, policy_version 149200 (0.0005) [2023-03-11 14:39:50,859][22726] Updated weights for policy 0, policy_version 149280 (0.0005) [2023-03-11 14:39:51,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11264.0, 300 sec: 11274.4). Total num frames: 76435456. Throughput: 0: 11100.0. Samples: 76427116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:39:51,346][22439] Avg episode reward: [(0, '1086.734')] [2023-03-11 14:39:54,570][22726] Updated weights for policy 0, policy_version 149360 (0.0005) [2023-03-11 14:39:56,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11195.7, 300 sec: 11274.4). Total num frames: 76488704. Throughput: 0: 11059.0. Samples: 76459588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:39:56,346][22439] Avg episode reward: [(0, '1299.062')] [2023-03-11 14:39:58,331][22726] Updated weights for policy 0, policy_version 149440 (0.0005) [2023-03-11 14:40:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11288.3). Total num frames: 76546048. Throughput: 0: 11036.3. Samples: 76525632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:40:01,346][22439] Avg episode reward: [(0, '1130.173')] [2023-03-11 14:40:01,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000149504_76546048.pth... [2023-03-11 14:40:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000148856_76214272.pth [2023-03-11 14:40:02,047][22726] Updated weights for policy 0, policy_version 149520 (0.0004) [2023-03-11 14:40:05,668][22726] Updated weights for policy 0, policy_version 149600 (0.0005) [2023-03-11 14:40:06,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11059.2, 300 sec: 11274.4). Total num frames: 76599296. Throughput: 0: 11041.2. Samples: 76592412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:40:06,346][22439] Avg episode reward: [(0, '1143.402')] [2023-03-11 14:40:09,426][22726] Updated weights for policy 0, policy_version 149680 (0.0005) [2023-03-11 14:40:11,345][22439] Fps is (10 sec: 10649.7, 60 sec: 10990.9, 300 sec: 11260.5). Total num frames: 76652544. Throughput: 0: 11049.9. Samples: 76625628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:40:11,346][22439] Avg episode reward: [(0, '986.406')] [2023-03-11 14:40:13,258][22726] Updated weights for policy 0, policy_version 149760 (0.0005) [2023-03-11 14:40:16,345][22439] Fps is (10 sec: 11059.1, 60 sec: 10990.9, 300 sec: 11274.4). Total num frames: 76709888. Throughput: 0: 11013.7. Samples: 76689480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:40:16,346][22439] Avg episode reward: [(0, '1277.258')] [2023-03-11 14:40:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000149824_76709888.pth... [2023-03-11 14:40:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000149176_76378112.pth [2023-03-11 14:40:16,846][22726] Updated weights for policy 0, policy_version 149840 (0.0005) [2023-03-11 14:40:20,303][22726] Updated weights for policy 0, policy_version 149920 (0.0004) [2023-03-11 14:40:21,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11127.5, 300 sec: 11288.3). Total num frames: 76771328. Throughput: 0: 11087.5. Samples: 76760168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:40:21,346][22439] Avg episode reward: [(0, '1232.440')] [2023-03-11 14:40:23,725][22726] Updated weights for policy 0, policy_version 150000 (0.0004) [2023-03-11 14:40:26,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11195.7, 300 sec: 11302.2). Total num frames: 76828672. Throughput: 0: 11153.0. Samples: 76796164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:40:26,346][22439] Avg episode reward: [(0, '1450.114')] [2023-03-11 14:40:27,265][22726] Updated weights for policy 0, policy_version 150080 (0.0005) [2023-03-11 14:40:30,980][22726] Updated weights for policy 0, policy_version 150160 (0.0005) [2023-03-11 14:40:31,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11127.5, 300 sec: 11288.3). Total num frames: 76881920. Throughput: 0: 11226.1. Samples: 76865552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:40:31,346][22439] Avg episode reward: [(0, '1313.595')] [2023-03-11 14:40:31,363][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000150168_76886016.pth... [2023-03-11 14:40:31,365][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000149504_76546048.pth [2023-03-11 14:40:34,760][22726] Updated weights for policy 0, policy_version 150240 (0.0005) [2023-03-11 14:40:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11302.2). Total num frames: 76939264. Throughput: 0: 11198.0. Samples: 76931024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:40:36,346][22439] Avg episode reward: [(0, '1149.808')] [2023-03-11 14:40:38,413][22726] Updated weights for policy 0, policy_version 150320 (0.0005) [2023-03-11 14:40:41,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11195.7, 300 sec: 11316.1). Total num frames: 76996608. Throughput: 0: 11207.0. Samples: 76963904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:40:41,346][22439] Avg episode reward: [(0, '1098.611')] [2023-03-11 14:40:41,984][22726] Updated weights for policy 0, policy_version 150400 (0.0005) [2023-03-11 14:40:45,604][22726] Updated weights for policy 0, policy_version 150480 (0.0005) [2023-03-11 14:40:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11316.1). Total num frames: 77053952. Throughput: 0: 11248.3. Samples: 77031804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:40:46,346][22439] Avg episode reward: [(0, '1163.934')] [2023-03-11 14:40:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000150496_77053952.pth... [2023-03-11 14:40:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000149824_76709888.pth [2023-03-11 14:40:49,106][22726] Updated weights for policy 0, policy_version 150560 (0.0004) [2023-03-11 14:40:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11329.9). Total num frames: 77111296. Throughput: 0: 11349.0. Samples: 77103116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:40:51,346][22439] Avg episode reward: [(0, '1391.749')] [2023-03-11 14:40:52,524][22726] Updated weights for policy 0, policy_version 150640 (0.0004) [2023-03-11 14:40:55,857][22726] Updated weights for policy 0, policy_version 150720 (0.0004) [2023-03-11 14:40:56,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11400.5, 300 sec: 11357.7). Total num frames: 77172736. Throughput: 0: 11407.7. Samples: 77138976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:40:56,346][22439] Avg episode reward: [(0, '1305.380')] [2023-03-11 14:40:59,262][22726] Updated weights for policy 0, policy_version 150800 (0.0004) [2023-03-11 14:41:01,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11400.5, 300 sec: 11371.6). Total num frames: 77230080. Throughput: 0: 11600.9. Samples: 77211520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:41:01,346][22439] Avg episode reward: [(0, '1164.987')] [2023-03-11 14:41:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000150840_77230080.pth... [2023-03-11 14:41:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000150168_76886016.pth [2023-03-11 14:41:02,920][22726] Updated weights for policy 0, policy_version 150880 (0.0005) [2023-03-11 14:41:06,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11371.6). Total num frames: 77287424. Throughput: 0: 11560.0. Samples: 77280368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:41:06,346][22439] Avg episode reward: [(0, '1331.944')] [2023-03-11 14:41:06,357][22726] Updated weights for policy 0, policy_version 150960 (0.0004) [2023-03-11 14:41:09,759][22726] Updated weights for policy 0, policy_version 151040 (0.0005) [2023-03-11 14:41:11,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11399.4). Total num frames: 77348864. Throughput: 0: 11554.3. Samples: 77316108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:41:11,346][22439] Avg episode reward: [(0, '1070.320')] [2023-03-11 14:41:13,147][22726] Updated weights for policy 0, policy_version 151120 (0.0004) [2023-03-11 14:41:16,345][22439] Fps is (10 sec: 12287.9, 60 sec: 11673.6, 300 sec: 11413.3). Total num frames: 77410304. Throughput: 0: 11637.0. Samples: 77389216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:41:16,346][22439] Avg episode reward: [(0, '1262.458')] [2023-03-11 14:41:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000151192_77410304.pth... [2023-03-11 14:41:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000150496_77053952.pth [2023-03-11 14:41:16,525][22726] Updated weights for policy 0, policy_version 151200 (0.0004) [2023-03-11 14:41:19,870][22726] Updated weights for policy 0, policy_version 151280 (0.0004) [2023-03-11 14:41:21,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 11427.1). Total num frames: 77471744. Throughput: 0: 11812.1. Samples: 77462568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:41:21,346][22439] Avg episode reward: [(0, '1151.880')] [2023-03-11 14:41:23,267][22726] Updated weights for policy 0, policy_version 151360 (0.0005) [2023-03-11 14:41:26,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11741.9, 300 sec: 11441.0). Total num frames: 77533184. Throughput: 0: 11874.1. Samples: 77498240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:41:26,356][22439] Avg episode reward: [(0, '1194.583')] [2023-03-11 14:41:26,566][22726] Updated weights for policy 0, policy_version 151440 (0.0003) [2023-03-11 14:41:29,943][22726] Updated weights for policy 0, policy_version 151520 (0.0004) [2023-03-11 14:41:31,345][22439] Fps is (10 sec: 12287.9, 60 sec: 11878.4, 300 sec: 11454.9). Total num frames: 77594624. Throughput: 0: 12004.3. Samples: 77571996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:41:31,356][22439] Avg episode reward: [(0, '1117.547')] [2023-03-11 14:41:31,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000151552_77594624.pth... [2023-03-11 14:41:31,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000150840_77230080.pth [2023-03-11 14:41:33,404][22726] Updated weights for policy 0, policy_version 151600 (0.0005) [2023-03-11 14:41:36,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11810.2, 300 sec: 11441.0). Total num frames: 77647872. Throughput: 0: 11956.9. Samples: 77641176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:41:36,356][22439] Avg episode reward: [(0, '1054.269')] [2023-03-11 14:41:37,149][22726] Updated weights for policy 0, policy_version 151680 (0.0005) [2023-03-11 14:41:40,861][22726] Updated weights for policy 0, policy_version 151760 (0.0005) [2023-03-11 14:41:41,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11810.1, 300 sec: 11441.0). Total num frames: 77705216. Throughput: 0: 11898.8. Samples: 77674420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:41:41,346][22439] Avg episode reward: [(0, '1287.026')] [2023-03-11 14:41:44,563][22726] Updated weights for policy 0, policy_version 151840 (0.0005) [2023-03-11 14:41:46,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11741.9, 300 sec: 11427.1). Total num frames: 77758464. Throughput: 0: 11775.7. Samples: 77741424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:41:46,356][22439] Avg episode reward: [(0, '1038.690')] [2023-03-11 14:41:46,404][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000151880_77762560.pth... [2023-03-11 14:41:46,406][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000151192_77410304.pth [2023-03-11 14:41:48,251][22726] Updated weights for policy 0, policy_version 151920 (0.0005) [2023-03-11 14:41:51,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11741.9, 300 sec: 11441.0). Total num frames: 77815808. Throughput: 0: 11716.6. Samples: 77807616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:41:51,356][22439] Avg episode reward: [(0, '1296.417')] [2023-03-11 14:41:51,892][22726] Updated weights for policy 0, policy_version 152000 (0.0005) [2023-03-11 14:41:55,473][22726] Updated weights for policy 0, policy_version 152080 (0.0005) [2023-03-11 14:41:56,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11427.1). Total num frames: 77873152. Throughput: 0: 11679.1. Samples: 77841668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:41:56,356][22439] Avg episode reward: [(0, '1117.823')] [2023-03-11 14:41:59,163][22726] Updated weights for policy 0, policy_version 152160 (0.0005) [2023-03-11 14:42:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11605.4, 300 sec: 11399.4). Total num frames: 77926400. Throughput: 0: 11554.4. Samples: 77909164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:42:01,356][22439] Avg episode reward: [(0, '1278.546')] [2023-03-11 14:42:01,358][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000152200_77926400.pth... [2023-03-11 14:42:01,361][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000151552_77594624.pth [2023-03-11 14:42:02,878][22726] Updated weights for policy 0, policy_version 152240 (0.0006) [2023-03-11 14:42:06,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11605.3, 300 sec: 11399.4). Total num frames: 77983744. Throughput: 0: 11419.0. Samples: 77976424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:42:06,356][22439] Avg episode reward: [(0, '1191.306')] [2023-03-11 14:42:06,389][22726] Updated weights for policy 0, policy_version 152320 (0.0006) [2023-03-11 14:42:10,085][22726] Updated weights for policy 0, policy_version 152400 (0.0005) [2023-03-11 14:42:11,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11385.5). Total num frames: 78041088. Throughput: 0: 11397.5. Samples: 78011128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:42:11,356][22439] Avg episode reward: [(0, '1063.971')] [2023-03-11 14:42:13,774][22726] Updated weights for policy 0, policy_version 152480 (0.0006) [2023-03-11 14:42:16,345][22439] Fps is (10 sec: 11059.0, 60 sec: 11400.5, 300 sec: 11371.6). Total num frames: 78094336. Throughput: 0: 11228.3. Samples: 78077268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:42:16,356][22439] Avg episode reward: [(0, '1161.824')] [2023-03-11 14:42:16,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000152528_78094336.pth... [2023-03-11 14:42:16,363][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000151880_77762560.pth [2023-03-11 14:42:17,545][22726] Updated weights for policy 0, policy_version 152560 (0.0006) [2023-03-11 14:42:21,187][22726] Updated weights for policy 0, policy_version 152640 (0.0005) [2023-03-11 14:42:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 11385.5). Total num frames: 78151680. Throughput: 0: 11162.9. Samples: 78143508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:42:21,356][22439] Avg episode reward: [(0, '1364.974')] [2023-03-11 14:42:24,808][22726] Updated weights for policy 0, policy_version 152720 (0.0006) [2023-03-11 14:42:26,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11385.5). Total num frames: 78209024. Throughput: 0: 11179.0. Samples: 78177476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:42:26,356][22439] Avg episode reward: [(0, '1219.573')] [2023-03-11 14:42:28,480][22726] Updated weights for policy 0, policy_version 152800 (0.0006) [2023-03-11 14:42:31,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11371.6). Total num frames: 78262272. Throughput: 0: 11168.7. Samples: 78244016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:42:31,346][22439] Avg episode reward: [(0, '1184.157')] [2023-03-11 14:42:31,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000152856_78262272.pth... [2023-03-11 14:42:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000152200_77926400.pth [2023-03-11 14:42:32,157][22726] Updated weights for policy 0, policy_version 152880 (0.0005) [2023-03-11 14:42:35,797][22726] Updated weights for policy 0, policy_version 152960 (0.0006) [2023-03-11 14:42:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11371.6). Total num frames: 78319616. Throughput: 0: 11195.9. Samples: 78311432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:42:36,346][22439] Avg episode reward: [(0, '1034.174')] [2023-03-11 14:42:39,508][22726] Updated weights for policy 0, policy_version 153040 (0.0006) [2023-03-11 14:42:41,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11195.7, 300 sec: 11371.6). Total num frames: 78376960. Throughput: 0: 11170.5. Samples: 78344340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:42:41,346][22439] Avg episode reward: [(0, '1113.702')] [2023-03-11 14:42:43,077][22726] Updated weights for policy 0, policy_version 153120 (0.0005) [2023-03-11 14:42:46,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11357.7). Total num frames: 78430208. Throughput: 0: 11193.7. Samples: 78412880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:42:46,346][22439] Avg episode reward: [(0, '1082.388')] [2023-03-11 14:42:46,395][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000153192_78434304.pth... [2023-03-11 14:42:46,397][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000152528_78094336.pth [2023-03-11 14:42:46,767][22726] Updated weights for policy 0, policy_version 153200 (0.0006) [2023-03-11 14:42:50,364][22726] Updated weights for policy 0, policy_version 153280 (0.0006) [2023-03-11 14:42:51,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11343.8). Total num frames: 78487552. Throughput: 0: 11183.4. Samples: 78479676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:42:51,346][22439] Avg episode reward: [(0, '1196.430')] [2023-03-11 14:42:54,027][22726] Updated weights for policy 0, policy_version 153360 (0.0006) [2023-03-11 14:42:56,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11195.7, 300 sec: 11343.8). Total num frames: 78544896. Throughput: 0: 11170.6. Samples: 78513804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:42:56,346][22439] Avg episode reward: [(0, '1113.041')] [2023-03-11 14:42:57,543][22726] Updated weights for policy 0, policy_version 153440 (0.0005) [2023-03-11 14:43:00,979][22726] Updated weights for policy 0, policy_version 153520 (0.0005) [2023-03-11 14:43:01,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11332.2, 300 sec: 11371.6). Total num frames: 78606336. Throughput: 0: 11263.0. Samples: 78584104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:43:01,346][22439] Avg episode reward: [(0, '1334.047')] [2023-03-11 14:43:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000153528_78606336.pth... [2023-03-11 14:43:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000152856_78262272.pth [2023-03-11 14:43:04,445][22726] Updated weights for policy 0, policy_version 153600 (0.0005) [2023-03-11 14:43:06,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11357.7). Total num frames: 78659584. Throughput: 0: 11350.6. Samples: 78654284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:43:06,346][22439] Avg episode reward: [(0, '1275.198')] [2023-03-11 14:43:08,168][22726] Updated weights for policy 0, policy_version 153680 (0.0006) [2023-03-11 14:43:11,345][22439] Fps is (10 sec: 11059.4, 60 sec: 11264.0, 300 sec: 11371.6). Total num frames: 78716928. Throughput: 0: 11338.4. Samples: 78687704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:43:11,356][22439] Avg episode reward: [(0, '1028.780')] [2023-03-11 14:43:11,751][22726] Updated weights for policy 0, policy_version 153760 (0.0006) [2023-03-11 14:43:15,368][22726] Updated weights for policy 0, policy_version 153840 (0.0006) [2023-03-11 14:43:16,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11332.3, 300 sec: 11385.5). Total num frames: 78774272. Throughput: 0: 11365.2. Samples: 78755448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:43:16,356][22439] Avg episode reward: [(0, '1088.805')] [2023-03-11 14:43:16,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000153856_78774272.pth... [2023-03-11 14:43:16,363][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000153192_78434304.pth [2023-03-11 14:43:19,138][22726] Updated weights for policy 0, policy_version 153920 (0.0006) [2023-03-11 14:43:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11264.0, 300 sec: 11371.6). Total num frames: 78827520. Throughput: 0: 11311.9. Samples: 78820464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:43:21,356][22439] Avg episode reward: [(0, '1260.069')] [2023-03-11 14:43:22,896][22726] Updated weights for policy 0, policy_version 154000 (0.0006) [2023-03-11 14:43:26,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11264.0, 300 sec: 11385.5). Total num frames: 78884864. Throughput: 0: 11325.1. Samples: 78853968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:43:26,356][22439] Avg episode reward: [(0, '1110.011')] [2023-03-11 14:43:26,515][22726] Updated weights for policy 0, policy_version 154080 (0.0006) [2023-03-11 14:43:30,235][22726] Updated weights for policy 0, policy_version 154160 (0.0005) [2023-03-11 14:43:31,345][22439] Fps is (10 sec: 11468.6, 60 sec: 11332.3, 300 sec: 11399.4). Total num frames: 78942208. Throughput: 0: 11307.7. Samples: 78921728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:43:31,356][22439] Avg episode reward: [(0, '963.648')] [2023-03-11 14:43:31,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000154184_78942208.pth... [2023-03-11 14:43:31,361][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000153528_78606336.pth [2023-03-11 14:43:33,857][22726] Updated weights for policy 0, policy_version 154240 (0.0005) [2023-03-11 14:43:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11264.0, 300 sec: 11371.6). Total num frames: 78995456. Throughput: 0: 11303.3. Samples: 78988324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:43:36,356][22439] Avg episode reward: [(0, '1249.568')] [2023-03-11 14:43:37,407][22726] Updated weights for policy 0, policy_version 154320 (0.0005) [2023-03-11 14:43:41,068][22726] Updated weights for policy 0, policy_version 154400 (0.0005) [2023-03-11 14:43:41,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11264.0, 300 sec: 11371.6). Total num frames: 79052800. Throughput: 0: 11339.6. Samples: 79024084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:43:41,356][22439] Avg episode reward: [(0, '1268.110')] [2023-03-11 14:43:44,573][22726] Updated weights for policy 0, policy_version 154480 (0.0005) [2023-03-11 14:43:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11357.7). Total num frames: 79110144. Throughput: 0: 11287.7. Samples: 79092048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:43:46,356][22439] Avg episode reward: [(0, '1092.319')] [2023-03-11 14:43:46,418][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000154520_79114240.pth... [2023-03-11 14:43:46,420][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000153856_78774272.pth [2023-03-11 14:43:48,232][22726] Updated weights for policy 0, policy_version 154560 (0.0005) [2023-03-11 14:43:51,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11332.3, 300 sec: 11357.7). Total num frames: 79167488. Throughput: 0: 11222.5. Samples: 79159296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:43:51,356][22439] Avg episode reward: [(0, '1341.320')] [2023-03-11 14:43:51,957][22726] Updated weights for policy 0, policy_version 154640 (0.0005) [2023-03-11 14:43:55,596][22726] Updated weights for policy 0, policy_version 154720 (0.0005) [2023-03-11 14:43:56,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11343.8). Total num frames: 79224832. Throughput: 0: 11208.3. Samples: 79192080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:43:56,356][22439] Avg episode reward: [(0, '1246.274')] [2023-03-11 14:43:59,299][22726] Updated weights for policy 0, policy_version 154800 (0.0005) [2023-03-11 14:44:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11330.0). Total num frames: 79278080. Throughput: 0: 11190.1. Samples: 79259004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:44:01,356][22439] Avg episode reward: [(0, '1173.825')] [2023-03-11 14:44:01,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000154840_79278080.pth... [2023-03-11 14:44:01,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000154184_78942208.pth [2023-03-11 14:44:03,162][22726] Updated weights for policy 0, policy_version 154880 (0.0005) [2023-03-11 14:44:06,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11195.7, 300 sec: 11316.1). Total num frames: 79331328. Throughput: 0: 11171.9. Samples: 79323200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:44:06,356][22439] Avg episode reward: [(0, '1035.652')] [2023-03-11 14:44:06,893][22726] Updated weights for policy 0, policy_version 154960 (0.0005) [2023-03-11 14:44:10,565][22726] Updated weights for policy 0, policy_version 155040 (0.0005) [2023-03-11 14:44:11,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11316.1). Total num frames: 79388672. Throughput: 0: 11175.6. Samples: 79356872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:44:11,346][22439] Avg episode reward: [(0, '1213.021')] [2023-03-11 14:44:14,123][22726] Updated weights for policy 0, policy_version 155120 (0.0005) [2023-03-11 14:44:16,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11127.5, 300 sec: 11316.1). Total num frames: 79441920. Throughput: 0: 11193.7. Samples: 79425444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:44:16,346][22439] Avg episode reward: [(0, '1174.182')] [2023-03-11 14:44:16,384][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000155168_79446016.pth... [2023-03-11 14:44:16,387][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000154520_79114240.pth [2023-03-11 14:44:17,872][22726] Updated weights for policy 0, policy_version 155200 (0.0005) [2023-03-11 14:44:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11330.0). Total num frames: 79499264. Throughput: 0: 11173.6. Samples: 79491136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:44:21,346][22439] Avg episode reward: [(0, '1259.520')] [2023-03-11 14:44:21,520][22726] Updated weights for policy 0, policy_version 155280 (0.0005) [2023-03-11 14:44:25,122][22726] Updated weights for policy 0, policy_version 155360 (0.0005) [2023-03-11 14:44:26,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 11330.0). Total num frames: 79556608. Throughput: 0: 11139.4. Samples: 79525356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:44:26,346][22439] Avg episode reward: [(0, '1100.331')] [2023-03-11 14:44:28,742][22726] Updated weights for policy 0, policy_version 155440 (0.0005) [2023-03-11 14:44:31,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 11343.8). Total num frames: 79613952. Throughput: 0: 11139.1. Samples: 79593308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:44:31,346][22439] Avg episode reward: [(0, '1405.661')] [2023-03-11 14:44:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000155496_79613952.pth... [2023-03-11 14:44:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000154840_79278080.pth [2023-03-11 14:44:32,441][22726] Updated weights for policy 0, policy_version 155520 (0.0005) [2023-03-11 14:44:36,077][22726] Updated weights for policy 0, policy_version 155600 (0.0005) [2023-03-11 14:44:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11330.0). Total num frames: 79667200. Throughput: 0: 11124.3. Samples: 79659888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:44:36,346][22439] Avg episode reward: [(0, '1228.606')] [2023-03-11 14:44:39,839][22726] Updated weights for policy 0, policy_version 155680 (0.0005) [2023-03-11 14:44:41,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11343.8). Total num frames: 79724544. Throughput: 0: 11117.1. Samples: 79692348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:44:41,346][22439] Avg episode reward: [(0, '1434.716')] [2023-03-11 14:44:43,391][22726] Updated weights for policy 0, policy_version 155760 (0.0004) [2023-03-11 14:44:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 11343.8). Total num frames: 79781888. Throughput: 0: 11162.2. Samples: 79761304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:44:46,346][22439] Avg episode reward: [(0, '1383.864')] [2023-03-11 14:44:46,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000155824_79781888.pth... [2023-03-11 14:44:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000155168_79446016.pth [2023-03-11 14:44:47,094][22726] Updated weights for policy 0, policy_version 155840 (0.0005) [2023-03-11 14:44:50,793][22726] Updated weights for policy 0, policy_version 155920 (0.0005) [2023-03-11 14:44:51,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11343.8). Total num frames: 79835136. Throughput: 0: 11194.6. Samples: 79826956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:44:51,346][22439] Avg episode reward: [(0, '1290.500')] [2023-03-11 14:44:54,464][22726] Updated weights for policy 0, policy_version 156000 (0.0005) [2023-03-11 14:44:56,345][22439] Fps is (10 sec: 10649.6, 60 sec: 11059.2, 300 sec: 11330.0). Total num frames: 79888384. Throughput: 0: 11175.6. Samples: 79859776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:44:56,346][22439] Avg episode reward: [(0, '1211.457')] [2023-03-11 14:44:58,175][22726] Updated weights for policy 0, policy_version 156080 (0.0005) [2023-03-11 14:45:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11343.8). Total num frames: 79945728. Throughput: 0: 11137.9. Samples: 79926648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:45:01,346][22439] Avg episode reward: [(0, '1178.739')] [2023-03-11 14:45:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000156144_79945728.pth... [2023-03-11 14:45:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000155496_79613952.pth [2023-03-11 14:45:01,923][22726] Updated weights for policy 0, policy_version 156160 (0.0005) [2023-03-11 14:45:05,643][22726] Updated weights for policy 0, policy_version 156240 (0.0005) [2023-03-11 14:45:06,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11343.8). Total num frames: 79998976. Throughput: 0: 11141.9. Samples: 79992520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:45:06,356][22439] Avg episode reward: [(0, '1302.066')] [2023-03-11 14:45:09,449][22726] Updated weights for policy 0, policy_version 156320 (0.0005) [2023-03-11 14:45:11,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11343.8). Total num frames: 80056320. Throughput: 0: 11107.3. Samples: 80025184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:45:11,356][22439] Avg episode reward: [(0, '1211.193')] [2023-03-11 14:45:13,108][22726] Updated weights for policy 0, policy_version 156400 (0.0005) [2023-03-11 14:45:16,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11316.1). Total num frames: 80109568. Throughput: 0: 11089.6. Samples: 80092340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:45:16,356][22439] Avg episode reward: [(0, '1240.992')] [2023-03-11 14:45:16,388][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000156472_80113664.pth... [2023-03-11 14:45:16,391][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000155824_79781888.pth [2023-03-11 14:45:16,767][22726] Updated weights for policy 0, policy_version 156480 (0.0005) [2023-03-11 14:45:20,496][22726] Updated weights for policy 0, policy_version 156560 (0.0005) [2023-03-11 14:45:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11316.1). Total num frames: 80166912. Throughput: 0: 11077.4. Samples: 80158372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:45:21,346][22439] Avg episode reward: [(0, '1101.389')] [2023-03-11 14:45:24,184][22726] Updated weights for policy 0, policy_version 156640 (0.0005) [2023-03-11 14:45:26,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 11316.1). Total num frames: 80220160. Throughput: 0: 11093.4. Samples: 80191552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:45:26,346][22439] Avg episode reward: [(0, '1335.104')] [2023-03-11 14:45:27,900][22726] Updated weights for policy 0, policy_version 156720 (0.0005) [2023-03-11 14:45:31,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 11316.1). Total num frames: 80277504. Throughput: 0: 11016.2. Samples: 80257032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:45:31,346][22439] Avg episode reward: [(0, '1286.113')] [2023-03-11 14:45:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000156792_80277504.pth... [2023-03-11 14:45:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000156144_79945728.pth [2023-03-11 14:45:31,630][22726] Updated weights for policy 0, policy_version 156800 (0.0005) [2023-03-11 14:45:35,180][22726] Updated weights for policy 0, policy_version 156880 (0.0005) [2023-03-11 14:45:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11127.5, 300 sec: 11316.1). Total num frames: 80334848. Throughput: 0: 11082.1. Samples: 80325652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:45:36,346][22439] Avg episode reward: [(0, '1340.779')] [2023-03-11 14:45:38,838][22726] Updated weights for policy 0, policy_version 156960 (0.0005) [2023-03-11 14:45:41,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11059.2, 300 sec: 11302.2). Total num frames: 80388096. Throughput: 0: 11103.3. Samples: 80359424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:45:41,346][22439] Avg episode reward: [(0, '1217.208')] [2023-03-11 14:45:42,602][22726] Updated weights for policy 0, policy_version 157040 (0.0005) [2023-03-11 14:45:46,191][22726] Updated weights for policy 0, policy_version 157120 (0.0005) [2023-03-11 14:45:46,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11059.2, 300 sec: 11302.2). Total num frames: 80445440. Throughput: 0: 11075.0. Samples: 80425024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:45:46,346][22439] Avg episode reward: [(0, '1131.417')] [2023-03-11 14:45:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000157120_80445440.pth... [2023-03-11 14:45:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000156472_80113664.pth [2023-03-11 14:45:49,868][22726] Updated weights for policy 0, policy_version 157200 (0.0005) [2023-03-11 14:45:51,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11127.5, 300 sec: 11288.3). Total num frames: 80502784. Throughput: 0: 11119.9. Samples: 80492916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:45:51,346][22439] Avg episode reward: [(0, '1124.265')] [2023-03-11 14:45:53,495][22726] Updated weights for policy 0, policy_version 157280 (0.0005) [2023-03-11 14:45:56,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11274.4). Total num frames: 80556032. Throughput: 0: 11157.0. Samples: 80527248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:45:56,346][22439] Avg episode reward: [(0, '1153.586')] [2023-03-11 14:45:57,151][22726] Updated weights for policy 0, policy_version 157360 (0.0005) [2023-03-11 14:46:00,847][22726] Updated weights for policy 0, policy_version 157440 (0.0005) [2023-03-11 14:46:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11274.4). Total num frames: 80613376. Throughput: 0: 11128.4. Samples: 80593120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:46:01,346][22439] Avg episode reward: [(0, '1228.405')] [2023-03-11 14:46:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000157448_80613376.pth... [2023-03-11 14:46:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000156792_80277504.pth [2023-03-11 14:46:04,519][22726] Updated weights for policy 0, policy_version 157520 (0.0005) [2023-03-11 14:46:06,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11246.6). Total num frames: 80666624. Throughput: 0: 11142.5. Samples: 80659784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:46:06,346][22439] Avg episode reward: [(0, '1220.395')] [2023-03-11 14:46:08,173][22726] Updated weights for policy 0, policy_version 157600 (0.0005) [2023-03-11 14:46:11,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11127.5, 300 sec: 11232.8). Total num frames: 80723968. Throughput: 0: 11174.8. Samples: 80694416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:46:11,346][22439] Avg episode reward: [(0, '1123.902')] [2023-03-11 14:46:11,844][22726] Updated weights for policy 0, policy_version 157680 (0.0005) [2023-03-11 14:46:15,495][22726] Updated weights for policy 0, policy_version 157760 (0.0005) [2023-03-11 14:46:16,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11195.7, 300 sec: 11218.9). Total num frames: 80781312. Throughput: 0: 11197.0. Samples: 80760896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:46:16,346][22439] Avg episode reward: [(0, '1248.301')] [2023-03-11 14:46:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000157776_80781312.pth... [2023-03-11 14:46:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000157120_80445440.pth [2023-03-11 14:46:19,367][22726] Updated weights for policy 0, policy_version 157840 (0.0005) [2023-03-11 14:46:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11191.1). Total num frames: 80834560. Throughput: 0: 11119.5. Samples: 80826028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:46:21,346][22439] Avg episode reward: [(0, '1334.662')] [2023-03-11 14:46:23,067][22726] Updated weights for policy 0, policy_version 157920 (0.0005) [2023-03-11 14:46:26,345][22439] Fps is (10 sec: 10649.7, 60 sec: 11127.5, 300 sec: 11163.3). Total num frames: 80887808. Throughput: 0: 11104.9. Samples: 80859144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:46:26,346][22439] Avg episode reward: [(0, '1332.913')] [2023-03-11 14:46:26,763][22726] Updated weights for policy 0, policy_version 158000 (0.0005) [2023-03-11 14:46:30,445][22726] Updated weights for policy 0, policy_version 158080 (0.0005) [2023-03-11 14:46:31,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11127.5, 300 sec: 11177.2). Total num frames: 80945152. Throughput: 0: 11122.5. Samples: 80925536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:46:31,346][22439] Avg episode reward: [(0, '994.696')] [2023-03-11 14:46:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000158096_80945152.pth... [2023-03-11 14:46:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000157448_80613376.pth [2023-03-11 14:46:34,151][22726] Updated weights for policy 0, policy_version 158160 (0.0005) [2023-03-11 14:46:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 11163.3). Total num frames: 80998400. Throughput: 0: 11083.6. Samples: 80991676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:46:36,346][22439] Avg episode reward: [(0, '1161.642')] [2023-03-11 14:46:37,845][22726] Updated weights for policy 0, policy_version 158240 (0.0005) [2023-03-11 14:46:41,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11127.5, 300 sec: 11177.2). Total num frames: 81055744. Throughput: 0: 11067.0. Samples: 81025264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:46:41,346][22439] Avg episode reward: [(0, '1106.880')] [2023-03-11 14:46:41,491][22726] Updated weights for policy 0, policy_version 158320 (0.0005) [2023-03-11 14:46:45,252][22726] Updated weights for policy 0, policy_version 158400 (0.0005) [2023-03-11 14:46:46,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 11163.3). Total num frames: 81108992. Throughput: 0: 11095.4. Samples: 81092412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:46:46,346][22439] Avg episode reward: [(0, '1241.891')] [2023-03-11 14:46:46,374][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000158424_81113088.pth... [2023-03-11 14:46:46,375][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000157776_80781312.pth [2023-03-11 14:46:48,922][22726] Updated weights for policy 0, policy_version 158480 (0.0005) [2023-03-11 14:46:51,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11059.2, 300 sec: 11163.3). Total num frames: 81166336. Throughput: 0: 11076.3. Samples: 81158216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:46:51,346][22439] Avg episode reward: [(0, '1043.524')] [2023-03-11 14:46:52,627][22726] Updated weights for policy 0, policy_version 158560 (0.0005) [2023-03-11 14:46:56,321][22726] Updated weights for policy 0, policy_version 158640 (0.0005) [2023-03-11 14:46:56,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11127.5, 300 sec: 11177.2). Total num frames: 81223680. Throughput: 0: 11039.2. Samples: 81191180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:46:56,346][22439] Avg episode reward: [(0, '1279.343')] [2023-03-11 14:46:59,973][22726] Updated weights for policy 0, policy_version 158720 (0.0005) [2023-03-11 14:47:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 11163.3). Total num frames: 81276928. Throughput: 0: 11070.4. Samples: 81259064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:47:01,346][22439] Avg episode reward: [(0, '1269.913')] [2023-03-11 14:47:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000158744_81276928.pth... [2023-03-11 14:47:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000158096_80945152.pth [2023-03-11 14:47:03,648][22726] Updated weights for policy 0, policy_version 158800 (0.0005) [2023-03-11 14:47:06,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11163.3). Total num frames: 81334272. Throughput: 0: 11112.1. Samples: 81326072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:47:06,346][22439] Avg episode reward: [(0, '1419.758')] [2023-03-11 14:47:07,353][22726] Updated weights for policy 0, policy_version 158880 (0.0004) [2023-03-11 14:47:11,023][22726] Updated weights for policy 0, policy_version 158960 (0.0005) [2023-03-11 14:47:11,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 11163.3). Total num frames: 81387520. Throughput: 0: 11104.5. Samples: 81358848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:47:11,346][22439] Avg episode reward: [(0, '1180.676')] [2023-03-11 14:47:14,663][22726] Updated weights for policy 0, policy_version 159040 (0.0005) [2023-03-11 14:47:16,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 11163.3). Total num frames: 81444864. Throughput: 0: 11113.3. Samples: 81425632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:47:16,346][22439] Avg episode reward: [(0, '1263.984')] [2023-03-11 14:47:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000159072_81444864.pth... [2023-03-11 14:47:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000158424_81113088.pth [2023-03-11 14:47:18,296][22726] Updated weights for policy 0, policy_version 159120 (0.0005) [2023-03-11 14:47:21,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11127.5, 300 sec: 11163.3). Total num frames: 81502208. Throughput: 0: 11191.8. Samples: 81495308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:47:21,346][22439] Avg episode reward: [(0, '1204.946')] [2023-03-11 14:47:21,796][22726] Updated weights for policy 0, policy_version 159200 (0.0004) [2023-03-11 14:47:25,519][22726] Updated weights for policy 0, policy_version 159280 (0.0005) [2023-03-11 14:47:26,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 11177.2). Total num frames: 81559552. Throughput: 0: 11182.9. Samples: 81528496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:47:26,346][22439] Avg episode reward: [(0, '1336.169')] [2023-03-11 14:47:29,315][22726] Updated weights for policy 0, policy_version 159360 (0.0005) [2023-03-11 14:47:31,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11163.3). Total num frames: 81612800. Throughput: 0: 11132.3. Samples: 81593364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:47:31,346][22439] Avg episode reward: [(0, '1454.570')] [2023-03-11 14:47:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000159400_81612800.pth... [2023-03-11 14:47:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000158744_81276928.pth [2023-03-11 14:47:32,891][22726] Updated weights for policy 0, policy_version 159440 (0.0005) [2023-03-11 14:47:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11163.3). Total num frames: 81670144. Throughput: 0: 11172.5. Samples: 81660980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:47:36,346][22439] Avg episode reward: [(0, '1212.708')] [2023-03-11 14:47:36,665][22726] Updated weights for policy 0, policy_version 159520 (0.0005) [2023-03-11 14:47:40,437][22726] Updated weights for policy 0, policy_version 159600 (0.0005) [2023-03-11 14:47:41,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11163.3). Total num frames: 81723392. Throughput: 0: 11165.0. Samples: 81693604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:47:41,346][22439] Avg episode reward: [(0, '1321.749')] [2023-03-11 14:47:44,104][22726] Updated weights for policy 0, policy_version 159680 (0.0005) [2023-03-11 14:47:46,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11163.3). Total num frames: 81780736. Throughput: 0: 11137.6. Samples: 81760256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:47:46,346][22439] Avg episode reward: [(0, '1171.544')] [2023-03-11 14:47:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000159728_81780736.pth... [2023-03-11 14:47:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000159072_81444864.pth [2023-03-11 14:47:47,730][22726] Updated weights for policy 0, policy_version 159760 (0.0005) [2023-03-11 14:47:51,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11149.5). Total num frames: 81833984. Throughput: 0: 11149.9. Samples: 81827816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:47:51,346][22439] Avg episode reward: [(0, '1311.670')] [2023-03-11 14:47:51,360][22726] Updated weights for policy 0, policy_version 159840 (0.0005) [2023-03-11 14:47:54,964][22726] Updated weights for policy 0, policy_version 159920 (0.0005) [2023-03-11 14:47:56,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11135.6). Total num frames: 81891328. Throughput: 0: 11195.5. Samples: 81862644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:47:56,346][22439] Avg episode reward: [(0, '1215.918')] [2023-03-11 14:47:58,712][22726] Updated weights for policy 0, policy_version 160000 (0.0005) [2023-03-11 14:48:01,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11195.7, 300 sec: 11149.4). Total num frames: 81948672. Throughput: 0: 11169.6. Samples: 81928264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:48:01,346][22439] Avg episode reward: [(0, '1345.075')] [2023-03-11 14:48:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000160056_81948672.pth... [2023-03-11 14:48:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000159400_81612800.pth [2023-03-11 14:48:02,279][22726] Updated weights for policy 0, policy_version 160080 (0.0005) [2023-03-11 14:48:05,864][22726] Updated weights for policy 0, policy_version 160160 (0.0005) [2023-03-11 14:48:06,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 11149.4). Total num frames: 82006016. Throughput: 0: 11166.6. Samples: 81997804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:48:06,346][22439] Avg episode reward: [(0, '1152.824')] [2023-03-11 14:48:09,419][22726] Updated weights for policy 0, policy_version 160240 (0.0005) [2023-03-11 14:48:11,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11264.0, 300 sec: 11149.5). Total num frames: 82063360. Throughput: 0: 11178.0. Samples: 82031504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:48:11,346][22439] Avg episode reward: [(0, '1213.296')] [2023-03-11 14:48:13,146][22726] Updated weights for policy 0, policy_version 160320 (0.0005) [2023-03-11 14:48:16,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11195.7, 300 sec: 11149.4). Total num frames: 82116608. Throughput: 0: 11210.8. Samples: 82097852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:48:16,346][22439] Avg episode reward: [(0, '1452.168')] [2023-03-11 14:48:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000160384_82116608.pth... [2023-03-11 14:48:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000159728_81780736.pth [2023-03-11 14:48:16,889][22726] Updated weights for policy 0, policy_version 160400 (0.0005) [2023-03-11 14:48:20,408][22726] Updated weights for policy 0, policy_version 160480 (0.0005) [2023-03-11 14:48:21,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11195.7, 300 sec: 11149.4). Total num frames: 82173952. Throughput: 0: 11218.8. Samples: 82165824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:48:21,346][22439] Avg episode reward: [(0, '1325.706')] [2023-03-11 14:48:23,991][22726] Updated weights for policy 0, policy_version 160560 (0.0005) [2023-03-11 14:48:26,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 11149.5). Total num frames: 82231296. Throughput: 0: 11272.6. Samples: 82200872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:48:26,346][22439] Avg episode reward: [(0, '1471.003')] [2023-03-11 14:48:27,627][22726] Updated weights for policy 0, policy_version 160640 (0.0005) [2023-03-11 14:48:31,245][22726] Updated weights for policy 0, policy_version 160720 (0.0005) [2023-03-11 14:48:31,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11163.3). Total num frames: 82288640. Throughput: 0: 11286.9. Samples: 82268168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:48:31,346][22439] Avg episode reward: [(0, '1273.200')] [2023-03-11 14:48:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000160720_82288640.pth... [2023-03-11 14:48:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000160056_81948672.pth [2023-03-11 14:48:34,892][22726] Updated weights for policy 0, policy_version 160800 (0.0005) [2023-03-11 14:48:36,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11149.4). Total num frames: 82341888. Throughput: 0: 11291.8. Samples: 82335948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:48:36,346][22439] Avg episode reward: [(0, '1149.830')] [2023-03-11 14:48:38,574][22726] Updated weights for policy 0, policy_version 160880 (0.0005) [2023-03-11 14:48:41,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11264.0, 300 sec: 11149.5). Total num frames: 82399232. Throughput: 0: 11261.1. Samples: 82369392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:48:41,346][22439] Avg episode reward: [(0, '1062.161')] [2023-03-11 14:48:42,168][22726] Updated weights for policy 0, policy_version 160960 (0.0005) [2023-03-11 14:48:45,951][22726] Updated weights for policy 0, policy_version 161040 (0.0005) [2023-03-11 14:48:46,345][22439] Fps is (10 sec: 11468.6, 60 sec: 11264.0, 300 sec: 11149.4). Total num frames: 82456576. Throughput: 0: 11286.5. Samples: 82436160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:48:46,346][22439] Avg episode reward: [(0, '1260.349')] [2023-03-11 14:48:46,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000161048_82456576.pth... [2023-03-11 14:48:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000160384_82116608.pth [2023-03-11 14:48:49,628][22726] Updated weights for policy 0, policy_version 161120 (0.0005) [2023-03-11 14:48:51,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11264.0, 300 sec: 11135.6). Total num frames: 82509824. Throughput: 0: 11202.9. Samples: 82501936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:48:51,346][22439] Avg episode reward: [(0, '1150.076')] [2023-03-11 14:48:53,316][22726] Updated weights for policy 0, policy_version 161200 (0.0005) [2023-03-11 14:48:56,345][22439] Fps is (10 sec: 11059.4, 60 sec: 11264.0, 300 sec: 11149.5). Total num frames: 82567168. Throughput: 0: 11198.7. Samples: 82535444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:48:56,346][22439] Avg episode reward: [(0, '1360.757')] [2023-03-11 14:48:56,988][22726] Updated weights for policy 0, policy_version 161280 (0.0005) [2023-03-11 14:49:00,655][22726] Updated weights for policy 0, policy_version 161360 (0.0005) [2023-03-11 14:49:01,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11195.8, 300 sec: 11149.5). Total num frames: 82620416. Throughput: 0: 11238.3. Samples: 82603576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:49:01,346][22439] Avg episode reward: [(0, '1267.592')] [2023-03-11 14:49:01,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000161368_82620416.pth... [2023-03-11 14:49:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000160720_82288640.pth [2023-03-11 14:49:04,444][22726] Updated weights for policy 0, policy_version 161440 (0.0005) [2023-03-11 14:49:06,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11149.5). Total num frames: 82677760. Throughput: 0: 11191.7. Samples: 82669452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:49:06,346][22439] Avg episode reward: [(0, '1199.617')] [2023-03-11 14:49:07,870][22726] Updated weights for policy 0, policy_version 161520 (0.0005) [2023-03-11 14:49:11,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11195.7, 300 sec: 11163.3). Total num frames: 82735104. Throughput: 0: 11194.0. Samples: 82704600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:49:11,346][22439] Avg episode reward: [(0, '1305.031')] [2023-03-11 14:49:11,483][22726] Updated weights for policy 0, policy_version 161600 (0.0005) [2023-03-11 14:49:15,247][22726] Updated weights for policy 0, policy_version 161680 (0.0005) [2023-03-11 14:49:16,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11149.4). Total num frames: 82788352. Throughput: 0: 11190.5. Samples: 82771740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:49:16,346][22439] Avg episode reward: [(0, '1155.429')] [2023-03-11 14:49:16,358][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000161704_82792448.pth... [2023-03-11 14:49:16,360][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000161048_82456576.pth [2023-03-11 14:49:18,851][22726] Updated weights for policy 0, policy_version 161760 (0.0005) [2023-03-11 14:49:21,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11163.3). Total num frames: 82849792. Throughput: 0: 11194.6. Samples: 82839704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:49:21,346][22439] Avg episode reward: [(0, '1129.235')] [2023-03-11 14:49:22,243][22726] Updated weights for policy 0, policy_version 161840 (0.0004) [2023-03-11 14:49:25,727][22726] Updated weights for policy 0, policy_version 161920 (0.0004) [2023-03-11 14:49:26,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11264.0, 300 sec: 11163.3). Total num frames: 82907136. Throughput: 0: 11238.9. Samples: 82875140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:49:26,346][22439] Avg episode reward: [(0, '1183.181')] [2023-03-11 14:49:29,015][22726] Updated weights for policy 0, policy_version 162000 (0.0004) [2023-03-11 14:49:31,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11332.3, 300 sec: 11191.1). Total num frames: 82968576. Throughput: 0: 11388.0. Samples: 82948620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:49:31,346][22439] Avg episode reward: [(0, '1239.602')] [2023-03-11 14:49:31,380][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000162056_82972672.pth... [2023-03-11 14:49:31,381][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000161368_82620416.pth [2023-03-11 14:49:32,401][22726] Updated weights for policy 0, policy_version 162080 (0.0004) [2023-03-11 14:49:35,702][22726] Updated weights for policy 0, policy_version 162160 (0.0004) [2023-03-11 14:49:36,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11468.8, 300 sec: 11205.0). Total num frames: 83030016. Throughput: 0: 11554.7. Samples: 83021896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:49:36,346][22439] Avg episode reward: [(0, '1259.574')] [2023-03-11 14:49:39,026][22726] Updated weights for policy 0, policy_version 162240 (0.0004) [2023-03-11 14:49:41,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11537.1, 300 sec: 11218.9). Total num frames: 83091456. Throughput: 0: 11642.0. Samples: 83059332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:49:41,346][22439] Avg episode reward: [(0, '1546.442')] [2023-03-11 14:49:42,446][22726] Updated weights for policy 0, policy_version 162320 (0.0004) [2023-03-11 14:49:45,858][22726] Updated weights for policy 0, policy_version 162400 (0.0004) [2023-03-11 14:49:46,345][22439] Fps is (10 sec: 12287.9, 60 sec: 11605.4, 300 sec: 11246.6). Total num frames: 83152896. Throughput: 0: 11741.5. Samples: 83131944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:49:46,346][22439] Avg episode reward: [(0, '1369.143')] [2023-03-11 14:49:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000162408_83152896.pth... [2023-03-11 14:49:46,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000161704_82792448.pth [2023-03-11 14:49:49,428][22726] Updated weights for policy 0, policy_version 162480 (0.0005) [2023-03-11 14:49:51,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11260.5). Total num frames: 83210240. Throughput: 0: 11823.2. Samples: 83201496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:49:51,346][22439] Avg episode reward: [(0, '1362.851')] [2023-03-11 14:49:53,125][22726] Updated weights for policy 0, policy_version 162560 (0.0005) [2023-03-11 14:49:56,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11605.4, 300 sec: 11246.6). Total num frames: 83263488. Throughput: 0: 11778.2. Samples: 83234620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:49:56,346][22439] Avg episode reward: [(0, '1301.542')] [2023-03-11 14:49:56,792][22726] Updated weights for policy 0, policy_version 162640 (0.0005) [2023-03-11 14:50:00,541][22726] Updated weights for policy 0, policy_version 162720 (0.0005) [2023-03-11 14:50:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11673.6, 300 sec: 11260.5). Total num frames: 83320832. Throughput: 0: 11747.1. Samples: 83300360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:50:01,346][22439] Avg episode reward: [(0, '1284.843')] [2023-03-11 14:50:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000162736_83320832.pth... [2023-03-11 14:50:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000162056_82972672.pth [2023-03-11 14:50:04,277][22726] Updated weights for policy 0, policy_version 162800 (0.0005) [2023-03-11 14:50:06,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11605.3, 300 sec: 11246.6). Total num frames: 83374080. Throughput: 0: 11694.6. Samples: 83365960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:50:06,346][22439] Avg episode reward: [(0, '1136.008')] [2023-03-11 14:50:07,966][22726] Updated weights for policy 0, policy_version 162880 (0.0005) [2023-03-11 14:50:11,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11605.3, 300 sec: 11260.5). Total num frames: 83431424. Throughput: 0: 11657.5. Samples: 83399728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:50:11,346][22439] Avg episode reward: [(0, '1257.356')] [2023-03-11 14:50:11,536][22726] Updated weights for policy 0, policy_version 162960 (0.0005) [2023-03-11 14:50:15,165][22726] Updated weights for policy 0, policy_version 163040 (0.0005) [2023-03-11 14:50:16,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 11260.5). Total num frames: 83488768. Throughput: 0: 11548.2. Samples: 83468288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:50:16,346][22439] Avg episode reward: [(0, '1442.866')] [2023-03-11 14:50:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000163064_83488768.pth... [2023-03-11 14:50:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000162408_83152896.pth [2023-03-11 14:50:18,906][22726] Updated weights for policy 0, policy_version 163120 (0.0005) [2023-03-11 14:50:21,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11537.1, 300 sec: 11260.5). Total num frames: 83542016. Throughput: 0: 11394.5. Samples: 83534648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:50:21,346][22439] Avg episode reward: [(0, '1175.578')] [2023-03-11 14:50:22,398][22726] Updated weights for policy 0, policy_version 163200 (0.0005) [2023-03-11 14:50:25,803][22726] Updated weights for policy 0, policy_version 163280 (0.0004) [2023-03-11 14:50:26,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11274.4). Total num frames: 83603456. Throughput: 0: 11364.9. Samples: 83570752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:50:26,346][22439] Avg episode reward: [(0, '1102.433')] [2023-03-11 14:50:29,138][22726] Updated weights for policy 0, policy_version 163360 (0.0004) [2023-03-11 14:50:31,345][22439] Fps is (10 sec: 12287.9, 60 sec: 11605.3, 300 sec: 11288.3). Total num frames: 83664896. Throughput: 0: 11382.3. Samples: 83644148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:50:31,346][22439] Avg episode reward: [(0, '1090.214')] [2023-03-11 14:50:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000163408_83664896.pth... [2023-03-11 14:50:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000162736_83320832.pth [2023-03-11 14:50:32,526][22726] Updated weights for policy 0, policy_version 163440 (0.0004) [2023-03-11 14:50:35,965][22726] Updated weights for policy 0, policy_version 163520 (0.0005) [2023-03-11 14:50:36,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11605.3, 300 sec: 11316.1). Total num frames: 83726336. Throughput: 0: 11421.3. Samples: 83715456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:50:36,346][22439] Avg episode reward: [(0, '1183.112')] [2023-03-11 14:50:39,242][22726] Updated weights for policy 0, policy_version 163600 (0.0004) [2023-03-11 14:50:41,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11605.3, 300 sec: 11330.0). Total num frames: 83787776. Throughput: 0: 11521.0. Samples: 83753064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:50:41,346][22439] Avg episode reward: [(0, '1038.005')] [2023-03-11 14:50:42,869][22726] Updated weights for policy 0, policy_version 163680 (0.0005) [2023-03-11 14:50:46,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11316.1). Total num frames: 83841024. Throughput: 0: 11587.7. Samples: 83821808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:50:46,346][22439] Avg episode reward: [(0, '1239.277')] [2023-03-11 14:50:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000163752_83841024.pth... [2023-03-11 14:50:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000163064_83488768.pth [2023-03-11 14:50:46,437][22726] Updated weights for policy 0, policy_version 163760 (0.0005) [2023-03-11 14:50:50,069][22726] Updated weights for policy 0, policy_version 163840 (0.0005) [2023-03-11 14:50:51,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11468.8, 300 sec: 11330.0). Total num frames: 83898368. Throughput: 0: 11650.8. Samples: 83890248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:50:51,346][22439] Avg episode reward: [(0, '1297.029')] [2023-03-11 14:50:53,769][22726] Updated weights for policy 0, policy_version 163920 (0.0005) [2023-03-11 14:50:56,345][22439] Fps is (10 sec: 11059.4, 60 sec: 11468.8, 300 sec: 11316.1). Total num frames: 83951616. Throughput: 0: 11628.8. Samples: 83923024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:50:56,345][22439] Avg episode reward: [(0, '1313.345')] [2023-03-11 14:50:57,523][22726] Updated weights for policy 0, policy_version 164000 (0.0005) [2023-03-11 14:51:01,309][22726] Updated weights for policy 0, policy_version 164080 (0.0005) [2023-03-11 14:51:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11468.8, 300 sec: 11330.0). Total num frames: 84008960. Throughput: 0: 11562.1. Samples: 83988584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:51:01,346][22439] Avg episode reward: [(0, '1334.501')] [2023-03-11 14:51:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000164080_84008960.pth... [2023-03-11 14:51:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000163408_83664896.pth [2023-03-11 14:51:04,792][22726] Updated weights for policy 0, policy_version 164160 (0.0005) [2023-03-11 14:51:06,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11330.0). Total num frames: 84066304. Throughput: 0: 11619.0. Samples: 84057504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:51:06,346][22439] Avg episode reward: [(0, '1260.126')] [2023-03-11 14:51:08,237][22726] Updated weights for policy 0, policy_version 164240 (0.0004) [2023-03-11 14:51:11,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11343.8). Total num frames: 84127744. Throughput: 0: 11608.5. Samples: 84093136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:51:11,346][22439] Avg episode reward: [(0, '1309.278')] [2023-03-11 14:51:11,618][22726] Updated weights for policy 0, policy_version 164320 (0.0004) [2023-03-11 14:51:14,914][22726] Updated weights for policy 0, policy_version 164400 (0.0004) [2023-03-11 14:51:16,345][22439] Fps is (10 sec: 12287.9, 60 sec: 11673.6, 300 sec: 11371.6). Total num frames: 84189184. Throughput: 0: 11613.1. Samples: 84166736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:51:16,346][22439] Avg episode reward: [(0, '1210.771')] [2023-03-11 14:51:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000164432_84189184.pth... [2023-03-11 14:51:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000163752_83841024.pth [2023-03-11 14:51:18,261][22726] Updated weights for policy 0, policy_version 164480 (0.0005) [2023-03-11 14:51:21,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11810.1, 300 sec: 11399.4). Total num frames: 84250624. Throughput: 0: 11653.3. Samples: 84239856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:51:21,346][22439] Avg episode reward: [(0, '1211.748')] [2023-03-11 14:51:21,592][22726] Updated weights for policy 0, policy_version 164560 (0.0004) [2023-03-11 14:51:24,998][22726] Updated weights for policy 0, policy_version 164640 (0.0004) [2023-03-11 14:51:26,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11810.1, 300 sec: 11413.3). Total num frames: 84312064. Throughput: 0: 11640.3. Samples: 84276876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:51:26,346][22439] Avg episode reward: [(0, '1387.290')] [2023-03-11 14:51:28,388][22726] Updated weights for policy 0, policy_version 164720 (0.0005) [2023-03-11 14:51:31,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11427.1). Total num frames: 84369408. Throughput: 0: 11716.4. Samples: 84349044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:51:31,346][22439] Avg episode reward: [(0, '1385.927')] [2023-03-11 14:51:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000164784_84369408.pth... [2023-03-11 14:51:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000164080_84008960.pth [2023-03-11 14:51:31,776][22726] Updated weights for policy 0, policy_version 164800 (0.0005) [2023-03-11 14:51:35,138][22726] Updated weights for policy 0, policy_version 164880 (0.0004) [2023-03-11 14:51:36,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11441.0). Total num frames: 84430848. Throughput: 0: 11825.2. Samples: 84422380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:51:36,346][22439] Avg episode reward: [(0, '1319.417')] [2023-03-11 14:51:38,496][22726] Updated weights for policy 0, policy_version 164960 (0.0004) [2023-03-11 14:51:41,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11741.9, 300 sec: 11468.8). Total num frames: 84492288. Throughput: 0: 11907.6. Samples: 84458868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:51:41,346][22439] Avg episode reward: [(0, '1293.704')] [2023-03-11 14:51:41,792][22726] Updated weights for policy 0, policy_version 165040 (0.0005) [2023-03-11 14:51:45,328][22726] Updated weights for policy 0, policy_version 165120 (0.0005) [2023-03-11 14:51:46,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11468.8). Total num frames: 84549632. Throughput: 0: 12056.4. Samples: 84531120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:51:46,346][22439] Avg episode reward: [(0, '1279.708')] [2023-03-11 14:51:46,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000165136_84549632.pth... [2023-03-11 14:51:46,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000164432_84189184.pth [2023-03-11 14:51:48,903][22726] Updated weights for policy 0, policy_version 165200 (0.0005) [2023-03-11 14:51:51,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11482.7). Total num frames: 84611072. Throughput: 0: 12090.1. Samples: 84601560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:51:51,346][22439] Avg episode reward: [(0, '1318.893')] [2023-03-11 14:51:52,186][22726] Updated weights for policy 0, policy_version 165280 (0.0004) [2023-03-11 14:51:55,524][22726] Updated weights for policy 0, policy_version 165360 (0.0004) [2023-03-11 14:51:56,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11510.5). Total num frames: 84672512. Throughput: 0: 12127.6. Samples: 84638876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:51:56,346][22439] Avg episode reward: [(0, '959.973')] [2023-03-11 14:51:58,967][22726] Updated weights for policy 0, policy_version 165440 (0.0005) [2023-03-11 14:52:01,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11510.5). Total num frames: 84729856. Throughput: 0: 12087.2. Samples: 84710660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:52:01,346][22439] Avg episode reward: [(0, '1354.467')] [2023-03-11 14:52:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000165488_84729856.pth... [2023-03-11 14:52:01,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000164784_84369408.pth [2023-03-11 14:52:02,439][22726] Updated weights for policy 0, policy_version 165520 (0.0005) [2023-03-11 14:52:05,753][22726] Updated weights for policy 0, policy_version 165600 (0.0004) [2023-03-11 14:52:06,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11538.2). Total num frames: 84791296. Throughput: 0: 12072.4. Samples: 84783112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:52:06,346][22439] Avg episode reward: [(0, '1077.050')] [2023-03-11 14:52:09,100][22726] Updated weights for policy 0, policy_version 165680 (0.0004) [2023-03-11 14:52:11,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11552.1). Total num frames: 84852736. Throughput: 0: 12070.1. Samples: 84820032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:52:11,346][22439] Avg episode reward: [(0, '1254.304')] [2023-03-11 14:52:12,688][22726] Updated weights for policy 0, policy_version 165760 (0.0005) [2023-03-11 14:52:16,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11538.2). Total num frames: 84905984. Throughput: 0: 12002.6. Samples: 84889160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:52:16,346][22439] Avg episode reward: [(0, '1076.664')] [2023-03-11 14:52:16,384][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000165840_84910080.pth... [2023-03-11 14:52:16,385][22726] Updated weights for policy 0, policy_version 165840 (0.0005) [2023-03-11 14:52:16,387][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000165136_84549632.pth [2023-03-11 14:52:20,004][22726] Updated weights for policy 0, policy_version 165920 (0.0005) [2023-03-11 14:52:21,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11878.4, 300 sec: 11538.2). Total num frames: 84963328. Throughput: 0: 11847.7. Samples: 84955528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:52:21,346][22439] Avg episode reward: [(0, '1168.989')] [2023-03-11 14:52:23,569][22726] Updated weights for policy 0, policy_version 166000 (0.0005) [2023-03-11 14:52:26,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11552.1). Total num frames: 85020672. Throughput: 0: 11815.2. Samples: 84990552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:52:26,346][22439] Avg episode reward: [(0, '916.175')] [2023-03-11 14:52:27,235][22726] Updated weights for policy 0, policy_version 166080 (0.0005) [2023-03-11 14:52:30,859][22726] Updated weights for policy 0, policy_version 166160 (0.0005) [2023-03-11 14:52:31,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11552.1). Total num frames: 85078016. Throughput: 0: 11699.8. Samples: 85057612. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:52:31,346][22439] Avg episode reward: [(0, '1128.105')] [2023-03-11 14:52:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000166168_85078016.pth... [2023-03-11 14:52:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000165488_84729856.pth [2023-03-11 14:52:34,433][22726] Updated weights for policy 0, policy_version 166240 (0.0005) [2023-03-11 14:52:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11566.0). Total num frames: 85135360. Throughput: 0: 11674.4. Samples: 85126908. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:52:36,346][22439] Avg episode reward: [(0, '1263.442')] [2023-03-11 14:52:37,770][22726] Updated weights for policy 0, policy_version 166320 (0.0005) [2023-03-11 14:52:41,157][22726] Updated weights for policy 0, policy_version 166400 (0.0005) [2023-03-11 14:52:41,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11741.9, 300 sec: 11579.9). Total num frames: 85196800. Throughput: 0: 11670.2. Samples: 85164032. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:52:41,346][22439] Avg episode reward: [(0, '1277.436')] [2023-03-11 14:52:44,414][22726] Updated weights for policy 0, policy_version 166480 (0.0005) [2023-03-11 14:52:46,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 11607.6). Total num frames: 85258240. Throughput: 0: 11714.8. Samples: 85237824. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:52:46,346][22439] Avg episode reward: [(0, '1137.468')] [2023-03-11 14:52:46,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000166528_85262336.pth... [2023-03-11 14:52:46,360][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000165840_84910080.pth [2023-03-11 14:52:47,612][22726] Updated weights for policy 0, policy_version 166560 (0.0004) [2023-03-11 14:52:50,905][22726] Updated weights for policy 0, policy_version 166640 (0.0005) [2023-03-11 14:52:51,345][22439] Fps is (10 sec: 12697.6, 60 sec: 11878.4, 300 sec: 11635.4). Total num frames: 85323776. Throughput: 0: 11795.5. Samples: 85313908. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:52:51,346][22439] Avg episode reward: [(0, '1108.859')] [2023-03-11 14:52:54,193][22726] Updated weights for policy 0, policy_version 166720 (0.0005) [2023-03-11 14:52:56,345][22439] Fps is (10 sec: 12697.6, 60 sec: 11878.4, 300 sec: 11649.3). Total num frames: 85385216. Throughput: 0: 11805.3. Samples: 85351268. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:52:56,346][22439] Avg episode reward: [(0, '1327.930')] [2023-03-11 14:52:57,468][22726] Updated weights for policy 0, policy_version 166800 (0.0004) [2023-03-11 14:53:00,703][22726] Updated weights for policy 0, policy_version 166880 (0.0004) [2023-03-11 14:53:01,345][22439] Fps is (10 sec: 12697.4, 60 sec: 12014.9, 300 sec: 11677.1). Total num frames: 85450752. Throughput: 0: 11933.8. Samples: 85426184. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:53:01,346][22439] Avg episode reward: [(0, '1481.507')] [2023-03-11 14:53:01,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000166896_85450752.pth... [2023-03-11 14:53:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000166168_85078016.pth [2023-03-11 14:53:03,867][22726] Updated weights for policy 0, policy_version 166960 (0.0004) [2023-03-11 14:53:06,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11691.0). Total num frames: 85512192. Throughput: 0: 12182.9. Samples: 85503760. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:53:06,346][22439] Avg episode reward: [(0, '1006.062')] [2023-03-11 14:53:07,108][22726] Updated weights for policy 0, policy_version 167040 (0.0005) [2023-03-11 14:53:10,366][22726] Updated weights for policy 0, policy_version 167120 (0.0005) [2023-03-11 14:53:11,345][22439] Fps is (10 sec: 12697.8, 60 sec: 12083.2, 300 sec: 11732.6). Total num frames: 85577728. Throughput: 0: 12237.3. Samples: 85541232. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:53:11,346][22439] Avg episode reward: [(0, '1295.869')] [2023-03-11 14:53:13,602][22726] Updated weights for policy 0, policy_version 167200 (0.0004) [2023-03-11 14:53:16,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12219.7, 300 sec: 11746.5). Total num frames: 85639168. Throughput: 0: 12411.3. Samples: 85616120. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:53:16,346][22439] Avg episode reward: [(0, '1178.189')] [2023-03-11 14:53:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000167264_85639168.pth... [2023-03-11 14:53:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000166528_85262336.pth [2023-03-11 14:53:16,922][22726] Updated weights for policy 0, policy_version 167280 (0.0005) [2023-03-11 14:53:20,193][22726] Updated weights for policy 0, policy_version 167360 (0.0005) [2023-03-11 14:53:21,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 11760.4). Total num frames: 85700608. Throughput: 0: 12546.9. Samples: 85691520. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:53:21,346][22439] Avg episode reward: [(0, '1262.405')] [2023-03-11 14:53:23,586][22726] Updated weights for policy 0, policy_version 167440 (0.0005) [2023-03-11 14:53:26,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 11774.3). Total num frames: 85762048. Throughput: 0: 12521.9. Samples: 85727520. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:53:26,346][22439] Avg episode reward: [(0, '1190.679')] [2023-03-11 14:53:26,902][22726] Updated weights for policy 0, policy_version 167520 (0.0005) [2023-03-11 14:53:30,104][22726] Updated weights for policy 0, policy_version 167600 (0.0004) [2023-03-11 14:53:31,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 11802.0). Total num frames: 85823488. Throughput: 0: 12551.5. Samples: 85802640. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 14:53:31,346][22439] Avg episode reward: [(0, '1002.585')] [2023-03-11 14:53:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000167624_85823488.pth... [2023-03-11 14:53:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000166896_85450752.pth [2023-03-11 14:53:33,316][22726] Updated weights for policy 0, policy_version 167680 (0.0004) [2023-03-11 14:53:36,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 11829.8). Total num frames: 85889024. Throughput: 0: 12521.1. Samples: 85877360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:53:36,346][22439] Avg episode reward: [(0, '1238.930')] [2023-03-11 14:53:36,651][22726] Updated weights for policy 0, policy_version 167760 (0.0005) [2023-03-11 14:53:39,973][22726] Updated weights for policy 0, policy_version 167840 (0.0005) [2023-03-11 14:53:41,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 11843.7). Total num frames: 85950464. Throughput: 0: 12525.9. Samples: 85914932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:53:41,356][22439] Avg episode reward: [(0, '1196.219')] [2023-03-11 14:53:43,264][22726] Updated weights for policy 0, policy_version 167920 (0.0005) [2023-03-11 14:53:46,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12561.0, 300 sec: 11871.5). Total num frames: 86011904. Throughput: 0: 12525.9. Samples: 85989848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:53:46,356][22439] Avg episode reward: [(0, '1118.144')] [2023-03-11 14:53:46,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000167992_86011904.pth... [2023-03-11 14:53:46,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000167264_85639168.pth [2023-03-11 14:53:46,500][22726] Updated weights for policy 0, policy_version 168000 (0.0005) [2023-03-11 14:53:49,785][22726] Updated weights for policy 0, policy_version 168080 (0.0005) [2023-03-11 14:53:51,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 11885.3). Total num frames: 86073344. Throughput: 0: 12475.6. Samples: 86065164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:53:51,346][22439] Avg episode reward: [(0, '1166.678')] [2023-03-11 14:53:53,025][22726] Updated weights for policy 0, policy_version 168160 (0.0005) [2023-03-11 14:53:56,300][22726] Updated weights for policy 0, policy_version 168240 (0.0005) [2023-03-11 14:53:56,345][22439] Fps is (10 sec: 12697.7, 60 sec: 12561.1, 300 sec: 11927.0). Total num frames: 86138880. Throughput: 0: 12473.1. Samples: 86102524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:53:56,346][22439] Avg episode reward: [(0, '1094.559')] [2023-03-11 14:53:59,639][22726] Updated weights for policy 0, policy_version 168320 (0.0005) [2023-03-11 14:54:01,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12492.8, 300 sec: 11940.9). Total num frames: 86200320. Throughput: 0: 12468.4. Samples: 86177200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:54:01,346][22439] Avg episode reward: [(0, '1208.451')] [2023-03-11 14:54:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000168360_86200320.pth... [2023-03-11 14:54:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000167624_85823488.pth [2023-03-11 14:54:02,980][22726] Updated weights for policy 0, policy_version 168400 (0.0005) [2023-03-11 14:54:06,345][22439] Fps is (10 sec: 11878.5, 60 sec: 12424.5, 300 sec: 11940.9). Total num frames: 86257664. Throughput: 0: 12425.5. Samples: 86250668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:54:06,346][22439] Avg episode reward: [(0, '1193.121')] [2023-03-11 14:54:06,361][22726] Updated weights for policy 0, policy_version 168480 (0.0005) [2023-03-11 14:54:09,696][22726] Updated weights for policy 0, policy_version 168560 (0.0005) [2023-03-11 14:54:11,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12424.5, 300 sec: 11982.5). Total num frames: 86323200. Throughput: 0: 12439.6. Samples: 86287304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:54:11,346][22439] Avg episode reward: [(0, '1110.219')] [2023-03-11 14:54:12,951][22726] Updated weights for policy 0, policy_version 168640 (0.0005) [2023-03-11 14:54:16,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 11968.7). Total num frames: 86380544. Throughput: 0: 12409.0. Samples: 86361044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:54:16,346][22439] Avg episode reward: [(0, '1022.426')] [2023-03-11 14:54:16,362][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000168720_86384640.pth... [2023-03-11 14:54:16,363][22726] Updated weights for policy 0, policy_version 168720 (0.0005) [2023-03-11 14:54:16,364][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000167992_86011904.pth [2023-03-11 14:54:19,612][22726] Updated weights for policy 0, policy_version 168800 (0.0004) [2023-03-11 14:54:21,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 11996.4). Total num frames: 86446080. Throughput: 0: 12412.5. Samples: 86435924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:54:21,346][22439] Avg episode reward: [(0, '1233.557')] [2023-03-11 14:54:22,878][22726] Updated weights for policy 0, policy_version 168880 (0.0005) [2023-03-11 14:54:26,181][22726] Updated weights for policy 0, policy_version 168960 (0.0005) [2023-03-11 14:54:26,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 11996.4). Total num frames: 86507520. Throughput: 0: 12404.5. Samples: 86473136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:54:26,346][22439] Avg episode reward: [(0, '1225.239')] [2023-03-11 14:54:29,439][22726] Updated weights for policy 0, policy_version 169040 (0.0005) [2023-03-11 14:54:31,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 11996.4). Total num frames: 86568960. Throughput: 0: 12414.2. Samples: 86548488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:54:31,346][22439] Avg episode reward: [(0, '1331.290')] [2023-03-11 14:54:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000169080_86568960.pth... [2023-03-11 14:54:31,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000168360_86200320.pth [2023-03-11 14:54:32,696][22726] Updated weights for policy 0, policy_version 169120 (0.0004) [2023-03-11 14:54:35,919][22726] Updated weights for policy 0, policy_version 169200 (0.0004) [2023-03-11 14:54:36,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 12010.3). Total num frames: 86634496. Throughput: 0: 12424.6. Samples: 86624272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:54:36,346][22439] Avg episode reward: [(0, '1326.509')] [2023-03-11 14:54:39,276][22726] Updated weights for policy 0, policy_version 169280 (0.0005) [2023-03-11 14:54:41,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 12010.3). Total num frames: 86695936. Throughput: 0: 12392.0. Samples: 86660164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:54:41,346][22439] Avg episode reward: [(0, '1332.450')] [2023-03-11 14:54:42,565][22726] Updated weights for policy 0, policy_version 169360 (0.0005) [2023-03-11 14:54:45,841][22726] Updated weights for policy 0, policy_version 169440 (0.0004) [2023-03-11 14:54:46,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12024.2). Total num frames: 86757376. Throughput: 0: 12412.0. Samples: 86735740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:54:46,346][22439] Avg episode reward: [(0, '1457.500')] [2023-03-11 14:54:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000169448_86757376.pth... [2023-03-11 14:54:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000168720_86384640.pth [2023-03-11 14:54:49,220][22726] Updated weights for policy 0, policy_version 169520 (0.0005) [2023-03-11 14:54:51,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12052.0). Total num frames: 86818816. Throughput: 0: 12417.7. Samples: 86809464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:54:51,346][22439] Avg episode reward: [(0, '1333.025')] [2023-03-11 14:54:52,514][22726] Updated weights for policy 0, policy_version 169600 (0.0005) [2023-03-11 14:54:55,857][22726] Updated weights for policy 0, policy_version 169680 (0.0005) [2023-03-11 14:54:56,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 12065.8). Total num frames: 86880256. Throughput: 0: 12427.8. Samples: 86846556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:54:56,346][22439] Avg episode reward: [(0, '1342.117')] [2023-03-11 14:54:59,240][22726] Updated weights for policy 0, policy_version 169760 (0.0005) [2023-03-11 14:55:01,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12093.6). Total num frames: 86941696. Throughput: 0: 12408.9. Samples: 86919444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:55:01,346][22439] Avg episode reward: [(0, '1325.791')] [2023-03-11 14:55:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000169808_86941696.pth... [2023-03-11 14:55:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000169080_86568960.pth [2023-03-11 14:55:02,592][22726] Updated weights for policy 0, policy_version 169840 (0.0005) [2023-03-11 14:55:05,867][22726] Updated weights for policy 0, policy_version 169920 (0.0005) [2023-03-11 14:55:06,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12424.5, 300 sec: 12107.5). Total num frames: 87003136. Throughput: 0: 12391.0. Samples: 86993520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:55:06,346][22439] Avg episode reward: [(0, '1475.854')] [2023-03-11 14:55:09,131][22726] Updated weights for policy 0, policy_version 170000 (0.0005) [2023-03-11 14:55:11,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12121.4). Total num frames: 87064576. Throughput: 0: 12403.2. Samples: 87031280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:55:11,346][22439] Avg episode reward: [(0, '1337.692')] [2023-03-11 14:55:12,378][22726] Updated weights for policy 0, policy_version 170080 (0.0004) [2023-03-11 14:55:15,740][22726] Updated weights for policy 0, policy_version 170160 (0.0005) [2023-03-11 14:55:16,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12149.2). Total num frames: 87126016. Throughput: 0: 12380.3. Samples: 87105600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:55:16,346][22439] Avg episode reward: [(0, '1342.518')] [2023-03-11 14:55:16,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000170168_87126016.pth... [2023-03-11 14:55:16,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000169448_86757376.pth [2023-03-11 14:55:18,979][22726] Updated weights for policy 0, policy_version 170240 (0.0004) [2023-03-11 14:55:21,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 12163.0). Total num frames: 87191552. Throughput: 0: 12351.5. Samples: 87180088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:55:21,356][22439] Avg episode reward: [(0, '1117.239')] [2023-03-11 14:55:22,297][22726] Updated weights for policy 0, policy_version 170320 (0.0005) [2023-03-11 14:55:25,563][22726] Updated weights for policy 0, policy_version 170400 (0.0004) [2023-03-11 14:55:26,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 12163.0). Total num frames: 87252992. Throughput: 0: 12388.1. Samples: 87217628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:55:26,356][22439] Avg episode reward: [(0, '1131.465')] [2023-03-11 14:55:28,857][22726] Updated weights for policy 0, policy_version 170480 (0.0005) [2023-03-11 14:55:31,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 12163.0). Total num frames: 87314432. Throughput: 0: 12379.6. Samples: 87292824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:55:31,356][22439] Avg episode reward: [(0, '1130.338')] [2023-03-11 14:55:31,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000170536_87314432.pth... [2023-03-11 14:55:31,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000169808_86941696.pth [2023-03-11 14:55:32,135][22726] Updated weights for policy 0, policy_version 170560 (0.0005) [2023-03-11 14:55:35,395][22726] Updated weights for policy 0, policy_version 170640 (0.0004) [2023-03-11 14:55:36,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12163.0). Total num frames: 87375872. Throughput: 0: 12406.4. Samples: 87367752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:55:36,356][22439] Avg episode reward: [(0, '1109.538')] [2023-03-11 14:55:38,774][22726] Updated weights for policy 0, policy_version 170720 (0.0005) [2023-03-11 14:55:41,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 12190.8). Total num frames: 87437312. Throughput: 0: 12401.2. Samples: 87404608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:55:41,356][22439] Avg episode reward: [(0, '1237.598')] [2023-03-11 14:55:42,211][22726] Updated weights for policy 0, policy_version 170800 (0.0005) [2023-03-11 14:55:45,903][22726] Updated weights for policy 0, policy_version 170880 (0.0006) [2023-03-11 14:55:46,345][22439] Fps is (10 sec: 11878.3, 60 sec: 12288.0, 300 sec: 12190.8). Total num frames: 87494656. Throughput: 0: 12327.4. Samples: 87474176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:55:46,356][22439] Avg episode reward: [(0, '1126.488')] [2023-03-11 14:55:46,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000170888_87494656.pth... [2023-03-11 14:55:46,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000170168_87126016.pth [2023-03-11 14:55:49,184][22726] Updated weights for policy 0, policy_version 170960 (0.0005) [2023-03-11 14:55:51,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 12218.6). Total num frames: 87556096. Throughput: 0: 12276.0. Samples: 87545940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:55:51,356][22439] Avg episode reward: [(0, '1254.250')] [2023-03-11 14:55:52,741][22726] Updated weights for policy 0, policy_version 171040 (0.0005) [2023-03-11 14:55:56,224][22726] Updated weights for policy 0, policy_version 171120 (0.0006) [2023-03-11 14:55:56,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12218.6). Total num frames: 87613440. Throughput: 0: 12205.2. Samples: 87580512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:55:56,356][22439] Avg episode reward: [(0, '1184.087')] [2023-03-11 14:55:59,657][22726] Updated weights for policy 0, policy_version 171200 (0.0005) [2023-03-11 14:56:01,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12232.5). Total num frames: 87674880. Throughput: 0: 12119.1. Samples: 87650960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:56:01,347][22439] Avg episode reward: [(0, '1138.643')] [2023-03-11 14:56:01,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000171240_87674880.pth... [2023-03-11 14:56:01,353][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000170536_87314432.pth [2023-03-11 14:56:02,939][22726] Updated weights for policy 0, policy_version 171280 (0.0003) [2023-03-11 14:56:06,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12218.6). Total num frames: 87732224. Throughput: 0: 12089.1. Samples: 87724096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:56:06,356][22439] Avg episode reward: [(0, '1195.667')] [2023-03-11 14:56:06,403][22726] Updated weights for policy 0, policy_version 171360 (0.0003) [2023-03-11 14:56:09,885][22726] Updated weights for policy 0, policy_version 171440 (0.0003) [2023-03-11 14:56:11,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12218.6). Total num frames: 87793664. Throughput: 0: 12062.8. Samples: 87760456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:56:11,356][22439] Avg episode reward: [(0, '952.418')] [2023-03-11 14:56:13,357][22726] Updated weights for policy 0, policy_version 171520 (0.0004) [2023-03-11 14:56:16,345][22439] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 12204.7). Total num frames: 87851008. Throughput: 0: 11949.2. Samples: 87830536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:56:16,356][22439] Avg episode reward: [(0, '1246.626')] [2023-03-11 14:56:16,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000171584_87851008.pth... [2023-03-11 14:56:16,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000170888_87494656.pth [2023-03-11 14:56:16,913][22726] Updated weights for policy 0, policy_version 171600 (0.0005) [2023-03-11 14:56:20,396][22726] Updated weights for policy 0, policy_version 171680 (0.0004) [2023-03-11 14:56:21,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 12190.8). Total num frames: 87908352. Throughput: 0: 11832.9. Samples: 87900232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:56:21,346][22439] Avg episode reward: [(0, '1106.454')] [2023-03-11 14:56:23,830][22726] Updated weights for policy 0, policy_version 171760 (0.0003) [2023-03-11 14:56:26,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12204.7). Total num frames: 87969792. Throughput: 0: 11808.9. Samples: 87936008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:56:26,346][22439] Avg episode reward: [(0, '1165.676')] [2023-03-11 14:56:27,154][22726] Updated weights for policy 0, policy_version 171840 (0.0003) [2023-03-11 14:56:30,504][22726] Updated weights for policy 0, policy_version 171920 (0.0003) [2023-03-11 14:56:31,345][22439] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 12204.7). Total num frames: 88031232. Throughput: 0: 11923.8. Samples: 88010748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:56:31,346][22439] Avg episode reward: [(0, '1013.076')] [2023-03-11 14:56:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000171936_88031232.pth... [2023-03-11 14:56:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000171240_87674880.pth [2023-03-11 14:56:34,081][22726] Updated weights for policy 0, policy_version 172000 (0.0005) [2023-03-11 14:56:36,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 12190.8). Total num frames: 88088576. Throughput: 0: 11862.6. Samples: 88079756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:56:36,346][22439] Avg episode reward: [(0, '1127.397')] [2023-03-11 14:56:37,736][22726] Updated weights for policy 0, policy_version 172080 (0.0006) [2023-03-11 14:56:41,269][22726] Updated weights for policy 0, policy_version 172160 (0.0005) [2023-03-11 14:56:41,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 12190.8). Total num frames: 88145920. Throughput: 0: 11837.9. Samples: 88113216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:56:41,346][22439] Avg episode reward: [(0, '1100.972')] [2023-03-11 14:56:44,923][22726] Updated weights for policy 0, policy_version 172240 (0.0006) [2023-03-11 14:56:46,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11741.9, 300 sec: 12163.0). Total num frames: 88199168. Throughput: 0: 11804.0. Samples: 88182140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:56:46,346][22439] Avg episode reward: [(0, '1216.144')] [2023-03-11 14:56:46,379][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000172272_88203264.pth... [2023-03-11 14:56:46,381][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000171584_87851008.pth [2023-03-11 14:56:48,659][22726] Updated weights for policy 0, policy_version 172320 (0.0005) [2023-03-11 14:56:51,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11673.6, 300 sec: 12149.2). Total num frames: 88256512. Throughput: 0: 11649.3. Samples: 88248316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:56:51,346][22439] Avg episode reward: [(0, '1211.737')] [2023-03-11 14:56:52,315][22726] Updated weights for policy 0, policy_version 172400 (0.0006) [2023-03-11 14:56:55,945][22726] Updated weights for policy 0, policy_version 172480 (0.0006) [2023-03-11 14:56:56,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 12149.1). Total num frames: 88313856. Throughput: 0: 11571.2. Samples: 88281160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:56:56,346][22439] Avg episode reward: [(0, '1245.355')] [2023-03-11 14:56:59,576][22726] Updated weights for policy 0, policy_version 172560 (0.0006) [2023-03-11 14:57:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 12121.4). Total num frames: 88367104. Throughput: 0: 11530.2. Samples: 88349392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:57:01,346][22439] Avg episode reward: [(0, '1180.222')] [2023-03-11 14:57:01,407][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000172600_88371200.pth... [2023-03-11 14:57:01,408][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000171936_88031232.pth [2023-03-11 14:57:03,164][22726] Updated weights for policy 0, policy_version 172640 (0.0006) [2023-03-11 14:57:06,345][22439] Fps is (10 sec: 11059.4, 60 sec: 11537.1, 300 sec: 12107.5). Total num frames: 88424448. Throughput: 0: 11474.0. Samples: 88416560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:57:06,346][22439] Avg episode reward: [(0, '1303.618')] [2023-03-11 14:57:06,873][22726] Updated weights for policy 0, policy_version 172720 (0.0006) [2023-03-11 14:57:10,596][22726] Updated weights for policy 0, policy_version 172800 (0.0006) [2023-03-11 14:57:11,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11400.5, 300 sec: 12107.5). Total num frames: 88477696. Throughput: 0: 11429.6. Samples: 88450340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:57:11,346][22439] Avg episode reward: [(0, '1253.514')] [2023-03-11 14:57:14,141][22726] Updated weights for policy 0, policy_version 172880 (0.0004) [2023-03-11 14:57:16,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 12121.4). Total num frames: 88539136. Throughput: 0: 11281.0. Samples: 88518392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:57:16,346][22439] Avg episode reward: [(0, '1432.648')] [2023-03-11 14:57:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000172928_88539136.pth... [2023-03-11 14:57:16,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000172272_88203264.pth [2023-03-11 14:57:17,471][22726] Updated weights for policy 0, policy_version 172960 (0.0003) [2023-03-11 14:57:20,828][22726] Updated weights for policy 0, policy_version 173040 (0.0003) [2023-03-11 14:57:21,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11537.1, 300 sec: 12135.3). Total num frames: 88600576. Throughput: 0: 11380.9. Samples: 88591896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:57:21,346][22439] Avg episode reward: [(0, '1389.060')] [2023-03-11 14:57:24,245][22726] Updated weights for policy 0, policy_version 173120 (0.0005) [2023-03-11 14:57:26,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11537.1, 300 sec: 12149.2). Total num frames: 88662016. Throughput: 0: 11441.1. Samples: 88628064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:57:26,346][22439] Avg episode reward: [(0, '1114.572')] [2023-03-11 14:57:27,669][22726] Updated weights for policy 0, policy_version 173200 (0.0005) [2023-03-11 14:57:31,189][22726] Updated weights for policy 0, policy_version 173280 (0.0005) [2023-03-11 14:57:31,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 12149.1). Total num frames: 88719360. Throughput: 0: 11491.9. Samples: 88699276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:57:31,346][22439] Avg episode reward: [(0, '1219.642')] [2023-03-11 14:57:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000173280_88719360.pth... [2023-03-11 14:57:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000172600_88371200.pth [2023-03-11 14:57:34,786][22726] Updated weights for policy 0, policy_version 173360 (0.0005) [2023-03-11 14:57:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 12135.3). Total num frames: 88776704. Throughput: 0: 11559.9. Samples: 88768512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:57:36,346][22439] Avg episode reward: [(0, '1207.179')] [2023-03-11 14:57:38,274][22726] Updated weights for policy 0, policy_version 173440 (0.0003) [2023-03-11 14:57:41,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 12121.4). Total num frames: 88834048. Throughput: 0: 11598.5. Samples: 88803092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:57:41,346][22439] Avg episode reward: [(0, '1204.463')] [2023-03-11 14:57:41,841][22726] Updated weights for policy 0, policy_version 173520 (0.0004) [2023-03-11 14:57:45,262][22726] Updated weights for policy 0, policy_version 173600 (0.0005) [2023-03-11 14:57:46,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 12107.5). Total num frames: 88895488. Throughput: 0: 11624.3. Samples: 88872484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:57:46,346][22439] Avg episode reward: [(0, '1423.376')] [2023-03-11 14:57:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000173624_88895488.pth... [2023-03-11 14:57:46,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000172928_88539136.pth [2023-03-11 14:57:48,681][22726] Updated weights for policy 0, policy_version 173680 (0.0005) [2023-03-11 14:57:51,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 12093.6). Total num frames: 88952832. Throughput: 0: 11731.3. Samples: 88944468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 14:57:51,346][22439] Avg episode reward: [(0, '1279.131')] [2023-03-11 14:57:52,244][22726] Updated weights for policy 0, policy_version 173760 (0.0004) [2023-03-11 14:57:55,935][22726] Updated weights for policy 0, policy_version 173840 (0.0006) [2023-03-11 14:57:56,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11605.4, 300 sec: 12065.8). Total num frames: 89010176. Throughput: 0: 11714.2. Samples: 88977480. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:57:56,346][22439] Avg episode reward: [(0, '1185.729')] [2023-03-11 14:57:59,595][22726] Updated weights for policy 0, policy_version 173920 (0.0006) [2023-03-11 14:58:01,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11605.3, 300 sec: 12038.1). Total num frames: 89063424. Throughput: 0: 11705.7. Samples: 89045148. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:58:01,346][22439] Avg episode reward: [(0, '1423.945')] [2023-03-11 14:58:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000173952_89063424.pth... [2023-03-11 14:58:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000173280_88719360.pth [2023-03-11 14:58:03,211][22726] Updated weights for policy 0, policy_version 174000 (0.0006) [2023-03-11 14:58:06,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12024.2). Total num frames: 89124864. Throughput: 0: 11633.1. Samples: 89115384. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:58:06,346][22439] Avg episode reward: [(0, '1165.189')] [2023-03-11 14:58:06,557][22726] Updated weights for policy 0, policy_version 174080 (0.0005) [2023-03-11 14:58:09,826][22726] Updated weights for policy 0, policy_version 174160 (0.0004) [2023-03-11 14:58:11,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11810.1, 300 sec: 12024.2). Total num frames: 89186304. Throughput: 0: 11643.9. Samples: 89152040. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:58:11,346][22439] Avg episode reward: [(0, '1388.745')] [2023-03-11 14:58:13,213][22726] Updated weights for policy 0, policy_version 174240 (0.0004) [2023-03-11 14:58:16,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 12010.3). Total num frames: 89243648. Throughput: 0: 11680.0. Samples: 89224876. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:58:16,346][22439] Avg episode reward: [(0, '1204.952')] [2023-03-11 14:58:16,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000174312_89247744.pth... [2023-03-11 14:58:16,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000173624_88895488.pth [2023-03-11 14:58:16,683][22726] Updated weights for policy 0, policy_version 174320 (0.0004) [2023-03-11 14:58:20,096][22726] Updated weights for policy 0, policy_version 174400 (0.0003) [2023-03-11 14:58:21,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 12010.3). Total num frames: 89305088. Throughput: 0: 11742.3. Samples: 89296916. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:58:21,346][22439] Avg episode reward: [(0, '1405.955')] [2023-03-11 14:58:23,465][22726] Updated weights for policy 0, policy_version 174480 (0.0004) [2023-03-11 14:58:26,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 12010.3). Total num frames: 89366528. Throughput: 0: 11792.6. Samples: 89333760. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:58:26,346][22439] Avg episode reward: [(0, '1263.015')] [2023-03-11 14:58:26,812][22726] Updated weights for policy 0, policy_version 174560 (0.0003) [2023-03-11 14:58:30,130][22726] Updated weights for policy 0, policy_version 174640 (0.0003) [2023-03-11 14:58:31,345][22439] Fps is (10 sec: 12287.9, 60 sec: 11810.1, 300 sec: 11996.4). Total num frames: 89427968. Throughput: 0: 11884.3. Samples: 89407276. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:58:31,346][22439] Avg episode reward: [(0, '1089.192')] [2023-03-11 14:58:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000174664_89427968.pth... [2023-03-11 14:58:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000173952_89063424.pth [2023-03-11 14:58:33,526][22726] Updated weights for policy 0, policy_version 174720 (0.0004) [2023-03-11 14:58:36,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11982.5). Total num frames: 89485312. Throughput: 0: 11857.9. Samples: 89478072. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:58:36,346][22439] Avg episode reward: [(0, '1194.569')] [2023-03-11 14:58:37,156][22726] Updated weights for policy 0, policy_version 174800 (0.0005) [2023-03-11 14:58:40,721][22726] Updated weights for policy 0, policy_version 174880 (0.0005) [2023-03-11 14:58:41,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11968.7). Total num frames: 89542656. Throughput: 0: 11884.9. Samples: 89512300. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:58:41,346][22439] Avg episode reward: [(0, '1289.720')] [2023-03-11 14:58:44,281][22726] Updated weights for policy 0, policy_version 174960 (0.0005) [2023-03-11 14:58:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11954.8). Total num frames: 89600000. Throughput: 0: 11913.1. Samples: 89581236. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:58:46,346][22439] Avg episode reward: [(0, '1268.636')] [2023-03-11 14:58:46,411][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000175008_89604096.pth... [2023-03-11 14:58:46,413][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000174312_89247744.pth [2023-03-11 14:58:47,745][22726] Updated weights for policy 0, policy_version 175040 (0.0005) [2023-03-11 14:58:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11927.0). Total num frames: 89657344. Throughput: 0: 11912.2. Samples: 89651432. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:58:51,346][22439] Avg episode reward: [(0, '1432.489')] [2023-03-11 14:58:51,353][22726] Updated weights for policy 0, policy_version 175120 (0.0005) [2023-03-11 14:58:54,999][22726] Updated weights for policy 0, policy_version 175200 (0.0005) [2023-03-11 14:58:56,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 11913.1). Total num frames: 89714688. Throughput: 0: 11862.4. Samples: 89685848. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 14:58:56,346][22439] Avg episode reward: [(0, '1301.391')] [2023-03-11 14:58:58,592][22726] Updated weights for policy 0, policy_version 175280 (0.0005) [2023-03-11 14:59:01,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11913.1). Total num frames: 89772032. Throughput: 0: 11733.8. Samples: 89752896. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:59:01,346][22439] Avg episode reward: [(0, '1090.547')] [2023-03-11 14:59:01,352][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000175344_89776128.pth... [2023-03-11 14:59:01,353][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000174664_89427968.pth [2023-03-11 14:59:02,081][22726] Updated weights for policy 0, policy_version 175360 (0.0005) [2023-03-11 14:59:05,299][22726] Updated weights for policy 0, policy_version 175440 (0.0003) [2023-03-11 14:59:06,345][22439] Fps is (10 sec: 12287.9, 60 sec: 11878.4, 300 sec: 11913.1). Total num frames: 89837568. Throughput: 0: 11773.6. Samples: 89826728. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:59:06,346][22439] Avg episode reward: [(0, '1151.190')] [2023-03-11 14:59:08,632][22726] Updated weights for policy 0, policy_version 175520 (0.0004) [2023-03-11 14:59:11,345][22439] Fps is (10 sec: 12697.6, 60 sec: 11878.4, 300 sec: 11927.0). Total num frames: 89899008. Throughput: 0: 11764.6. Samples: 89863168. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:59:11,346][22439] Avg episode reward: [(0, '1040.000')] [2023-03-11 14:59:11,893][22726] Updated weights for policy 0, policy_version 175600 (0.0004) [2023-03-11 14:59:15,195][22726] Updated weights for policy 0, policy_version 175680 (0.0004) [2023-03-11 14:59:16,345][22439] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 11913.1). Total num frames: 89960448. Throughput: 0: 11822.0. Samples: 89939264. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:59:16,346][22439] Avg episode reward: [(0, '1273.881')] [2023-03-11 14:59:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000175704_89960448.pth... [2023-03-11 14:59:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000175008_89604096.pth [2023-03-11 14:59:18,637][22726] Updated weights for policy 0, policy_version 175760 (0.0005) [2023-03-11 14:59:21,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11913.1). Total num frames: 90021888. Throughput: 0: 11837.8. Samples: 90010772. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:59:21,346][22439] Avg episode reward: [(0, '1163.319')] [2023-03-11 14:59:22,004][22726] Updated weights for policy 0, policy_version 175840 (0.0004) [2023-03-11 14:59:25,341][22726] Updated weights for policy 0, policy_version 175920 (0.0004) [2023-03-11 14:59:26,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11913.1). Total num frames: 90083328. Throughput: 0: 11885.1. Samples: 90047128. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:59:26,346][22439] Avg episode reward: [(0, '1104.706')] [2023-03-11 14:59:28,618][22726] Updated weights for policy 0, policy_version 176000 (0.0005) [2023-03-11 14:59:31,345][22439] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 11899.2). Total num frames: 90144768. Throughput: 0: 12019.5. Samples: 90122112. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:59:31,346][22439] Avg episode reward: [(0, '1296.783')] [2023-03-11 14:59:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000176064_90144768.pth... [2023-03-11 14:59:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000175344_89776128.pth [2023-03-11 14:59:31,910][22726] Updated weights for policy 0, policy_version 176080 (0.0004) [2023-03-11 14:59:35,073][22726] Updated weights for policy 0, policy_version 176160 (0.0003) [2023-03-11 14:59:36,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12015.0, 300 sec: 11899.2). Total num frames: 90206208. Throughput: 0: 12148.5. Samples: 90198112. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:59:36,346][22439] Avg episode reward: [(0, '1170.350')] [2023-03-11 14:59:38,340][22726] Updated weights for policy 0, policy_version 176240 (0.0004) [2023-03-11 14:59:41,345][22439] Fps is (10 sec: 12697.7, 60 sec: 12151.5, 300 sec: 11913.1). Total num frames: 90271744. Throughput: 0: 12218.7. Samples: 90235688. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:59:41,346][22439] Avg episode reward: [(0, '1298.043')] [2023-03-11 14:59:41,576][22726] Updated weights for policy 0, policy_version 176320 (0.0004) [2023-03-11 14:59:45,148][22726] Updated weights for policy 0, policy_version 176400 (0.0005) [2023-03-11 14:59:46,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12151.5, 300 sec: 11899.2). Total num frames: 90329088. Throughput: 0: 12350.6. Samples: 90308672. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:59:46,346][22439] Avg episode reward: [(0, '1172.060')] [2023-03-11 14:59:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000176424_90329088.pth... [2023-03-11 14:59:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000175704_89960448.pth [2023-03-11 14:59:48,652][22726] Updated weights for policy 0, policy_version 176480 (0.0005) [2023-03-11 14:59:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 11885.3). Total num frames: 90386432. Throughput: 0: 12255.1. Samples: 90378208. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:59:51,346][22439] Avg episode reward: [(0, '1170.708')] [2023-03-11 14:59:52,212][22726] Updated weights for policy 0, policy_version 176560 (0.0005) [2023-03-11 14:59:55,844][22726] Updated weights for policy 0, policy_version 176640 (0.0005) [2023-03-11 14:59:56,345][22439] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 11871.5). Total num frames: 90443776. Throughput: 0: 12215.9. Samples: 90412884. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 14:59:56,346][22439] Avg episode reward: [(0, '1161.436')] [2023-03-11 14:59:59,421][22726] Updated weights for policy 0, policy_version 176720 (0.0005) [2023-03-11 15:00:01,345][22439] Fps is (10 sec: 11468.7, 60 sec: 12151.5, 300 sec: 11857.6). Total num frames: 90501120. Throughput: 0: 12032.0. Samples: 90480704. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 15:00:01,346][22439] Avg episode reward: [(0, '1214.512')] [2023-03-11 15:00:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000176760_90501120.pth... [2023-03-11 15:00:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000176064_90144768.pth [2023-03-11 15:00:03,021][22726] Updated weights for policy 0, policy_version 176800 (0.0005) [2023-03-11 15:00:06,345][22439] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11843.7). Total num frames: 90558464. Throughput: 0: 11966.6. Samples: 90549268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:00:06,346][22439] Avg episode reward: [(0, '1140.484')] [2023-03-11 15:00:06,619][22726] Updated weights for policy 0, policy_version 176880 (0.0005) [2023-03-11 15:00:10,317][22726] Updated weights for policy 0, policy_version 176960 (0.0005) [2023-03-11 15:00:11,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11878.4, 300 sec: 11815.9). Total num frames: 90611712. Throughput: 0: 11907.4. Samples: 90582960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:00:11,346][22439] Avg episode reward: [(0, '1096.659')] [2023-03-11 15:00:14,007][22726] Updated weights for policy 0, policy_version 177040 (0.0005) [2023-03-11 15:00:16,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11810.1, 300 sec: 11788.1). Total num frames: 90669056. Throughput: 0: 11713.9. Samples: 90649236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:00:16,346][22439] Avg episode reward: [(0, '1213.679')] [2023-03-11 15:00:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000177088_90669056.pth... [2023-03-11 15:00:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000176424_90329088.pth [2023-03-11 15:00:17,572][22726] Updated weights for policy 0, policy_version 177120 (0.0005) [2023-03-11 15:00:21,236][22726] Updated weights for policy 0, policy_version 177200 (0.0005) [2023-03-11 15:00:21,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11774.3). Total num frames: 90726400. Throughput: 0: 11548.9. Samples: 90717812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:00:21,346][22439] Avg episode reward: [(0, '1120.874')] [2023-03-11 15:00:24,736][22726] Updated weights for policy 0, policy_version 177280 (0.0005) [2023-03-11 15:00:26,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11760.4). Total num frames: 90783744. Throughput: 0: 11464.5. Samples: 90751592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:00:26,346][22439] Avg episode reward: [(0, '1079.189')] [2023-03-11 15:00:28,254][22726] Updated weights for policy 0, policy_version 177360 (0.0005) [2023-03-11 15:00:31,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 90841088. Throughput: 0: 11392.9. Samples: 90821352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:00:31,346][22439] Avg episode reward: [(0, '941.754')] [2023-03-11 15:00:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000177424_90841088.pth... [2023-03-11 15:00:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000176760_90501120.pth [2023-03-11 15:00:31,854][22726] Updated weights for policy 0, policy_version 177440 (0.0005) [2023-03-11 15:00:35,396][22726] Updated weights for policy 0, policy_version 177520 (0.0005) [2023-03-11 15:00:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 90898432. Throughput: 0: 11380.1. Samples: 90890312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:00:36,346][22439] Avg episode reward: [(0, '1130.724')] [2023-03-11 15:00:38,935][22726] Updated weights for policy 0, policy_version 177600 (0.0005) [2023-03-11 15:00:41,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11732.6). Total num frames: 90955776. Throughput: 0: 11393.7. Samples: 90925600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:00:41,346][22439] Avg episode reward: [(0, '999.857')] [2023-03-11 15:00:42,577][22726] Updated weights for policy 0, policy_version 177680 (0.0005) [2023-03-11 15:00:46,120][22726] Updated weights for policy 0, policy_version 177760 (0.0005) [2023-03-11 15:00:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11718.7). Total num frames: 91013120. Throughput: 0: 11394.8. Samples: 90993472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:00:46,346][22439] Avg episode reward: [(0, '1247.883')] [2023-03-11 15:00:46,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000177760_91013120.pth... [2023-03-11 15:00:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000177088_90669056.pth [2023-03-11 15:00:49,663][22726] Updated weights for policy 0, policy_version 177840 (0.0005) [2023-03-11 15:00:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11718.7). Total num frames: 91070464. Throughput: 0: 11401.7. Samples: 91062344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:00:51,346][22439] Avg episode reward: [(0, '1304.356')] [2023-03-11 15:00:53,358][22726] Updated weights for policy 0, policy_version 177920 (0.0005) [2023-03-11 15:00:56,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11400.5, 300 sec: 11704.8). Total num frames: 91127808. Throughput: 0: 11389.8. Samples: 91095500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:00:56,346][22439] Avg episode reward: [(0, '1215.129')] [2023-03-11 15:00:57,048][22726] Updated weights for policy 0, policy_version 178000 (0.0005) [2023-03-11 15:01:00,750][22726] Updated weights for policy 0, policy_version 178080 (0.0005) [2023-03-11 15:01:01,345][22439] Fps is (10 sec: 11059.1, 60 sec: 11332.3, 300 sec: 11691.0). Total num frames: 91181056. Throughput: 0: 11397.0. Samples: 91162100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:01:01,346][22439] Avg episode reward: [(0, '1266.911')] [2023-03-11 15:01:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000178088_91181056.pth... [2023-03-11 15:01:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000177424_90841088.pth [2023-03-11 15:01:04,368][22726] Updated weights for policy 0, policy_version 178160 (0.0005) [2023-03-11 15:01:06,345][22439] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 11677.1). Total num frames: 91238400. Throughput: 0: 11387.0. Samples: 91230228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:01:06,346][22439] Avg episode reward: [(0, '1023.899')] [2023-03-11 15:01:08,037][22726] Updated weights for policy 0, policy_version 178240 (0.0005) [2023-03-11 15:01:11,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11400.5, 300 sec: 11677.1). Total num frames: 91295744. Throughput: 0: 11369.3. Samples: 91263212. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:01:11,346][22439] Avg episode reward: [(0, '1090.118')] [2023-03-11 15:01:11,603][22726] Updated weights for policy 0, policy_version 178320 (0.0004) [2023-03-11 15:01:15,215][22726] Updated weights for policy 0, policy_version 178400 (0.0004) [2023-03-11 15:01:16,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11400.5, 300 sec: 11677.1). Total num frames: 91353088. Throughput: 0: 11361.2. Samples: 91332608. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:01:16,346][22439] Avg episode reward: [(0, '1104.187')] [2023-03-11 15:01:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000178424_91353088.pth... [2023-03-11 15:01:16,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000177760_91013120.pth [2023-03-11 15:01:18,856][22726] Updated weights for policy 0, policy_version 178480 (0.0004) [2023-03-11 15:01:21,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11663.2). Total num frames: 91410432. Throughput: 0: 11329.2. Samples: 91400124. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:01:21,346][22439] Avg episode reward: [(0, '1105.864')] [2023-03-11 15:01:22,348][22726] Updated weights for policy 0, policy_version 178560 (0.0003) [2023-03-11 15:01:25,937][22726] Updated weights for policy 0, policy_version 178640 (0.0004) [2023-03-11 15:01:26,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11400.5, 300 sec: 11649.3). Total num frames: 91467776. Throughput: 0: 11320.5. Samples: 91435024. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:01:26,346][22439] Avg episode reward: [(0, '1154.548')] [2023-03-11 15:01:29,523][22726] Updated weights for policy 0, policy_version 178720 (0.0005) [2023-03-11 15:01:31,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11400.5, 300 sec: 11649.3). Total num frames: 91525120. Throughput: 0: 11340.4. Samples: 91503788. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:01:31,346][22439] Avg episode reward: [(0, '948.935')] [2023-03-11 15:01:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000178760_91525120.pth... [2023-03-11 15:01:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000178088_91181056.pth [2023-03-11 15:01:32,996][22726] Updated weights for policy 0, policy_version 178800 (0.0005) [2023-03-11 15:01:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11649.3). Total num frames: 91582464. Throughput: 0: 11377.6. Samples: 91574336. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:01:36,346][22439] Avg episode reward: [(0, '1074.758')] [2023-03-11 15:01:36,480][22726] Updated weights for policy 0, policy_version 178880 (0.0005) [2023-03-11 15:01:40,075][22726] Updated weights for policy 0, policy_version 178960 (0.0005) [2023-03-11 15:01:41,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11400.5, 300 sec: 11663.2). Total num frames: 91639808. Throughput: 0: 11408.5. Samples: 91608884. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:01:41,346][22439] Avg episode reward: [(0, '1063.239')] [2023-03-11 15:01:43,728][22726] Updated weights for policy 0, policy_version 179040 (0.0005) [2023-03-11 15:01:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11663.2). Total num frames: 91697152. Throughput: 0: 11435.0. Samples: 91676672. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:01:46,346][22439] Avg episode reward: [(0, '1105.098')] [2023-03-11 15:01:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000179096_91697152.pth... [2023-03-11 15:01:46,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000178424_91353088.pth [2023-03-11 15:01:47,392][22726] Updated weights for policy 0, policy_version 179120 (0.0005) [2023-03-11 15:01:50,920][22726] Updated weights for policy 0, policy_version 179200 (0.0005) [2023-03-11 15:01:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11663.2). Total num frames: 91754496. Throughput: 0: 11428.3. Samples: 91744500. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:01:51,356][22439] Avg episode reward: [(0, '1110.193')] [2023-03-11 15:01:54,556][22726] Updated weights for policy 0, policy_version 179280 (0.0005) [2023-03-11 15:01:56,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11677.1). Total num frames: 91811840. Throughput: 0: 11463.6. Samples: 91779072. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:01:56,356][22439] Avg episode reward: [(0, '1307.190')] [2023-03-11 15:01:58,144][22726] Updated weights for policy 0, policy_version 179360 (0.0005) [2023-03-11 15:02:01,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11677.1). Total num frames: 91869184. Throughput: 0: 11440.5. Samples: 91847432. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:02:01,356][22439] Avg episode reward: [(0, '1251.021')] [2023-03-11 15:02:01,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000179432_91869184.pth... [2023-03-11 15:02:01,361][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000178760_91525120.pth [2023-03-11 15:02:01,695][22726] Updated weights for policy 0, policy_version 179440 (0.0005) [2023-03-11 15:02:05,156][22726] Updated weights for policy 0, policy_version 179520 (0.0005) [2023-03-11 15:02:06,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11691.0). Total num frames: 91926528. Throughput: 0: 11504.9. Samples: 91917844. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:02:06,356][22439] Avg episode reward: [(0, '1148.754')] [2023-03-11 15:02:08,676][22726] Updated weights for policy 0, policy_version 179600 (0.0005) [2023-03-11 15:02:11,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11677.1). Total num frames: 91983872. Throughput: 0: 11494.6. Samples: 91952280. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:02:11,356][22439] Avg episode reward: [(0, '1110.425')] [2023-03-11 15:02:12,218][22726] Updated weights for policy 0, policy_version 179680 (0.0005) [2023-03-11 15:02:15,761][22726] Updated weights for policy 0, policy_version 179760 (0.0005) [2023-03-11 15:02:16,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11663.2). Total num frames: 92041216. Throughput: 0: 11505.4. Samples: 92021532. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:02:16,356][22439] Avg episode reward: [(0, '1212.887')] [2023-03-11 15:02:16,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000179768_92041216.pth... [2023-03-11 15:02:16,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000179096_91697152.pth [2023-03-11 15:02:19,321][22726] Updated weights for policy 0, policy_version 179840 (0.0005) [2023-03-11 15:02:21,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11649.3). Total num frames: 92098560. Throughput: 0: 11484.9. Samples: 92091156. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 15:02:21,356][22439] Avg episode reward: [(0, '1013.876')] [2023-03-11 15:02:22,859][22726] Updated weights for policy 0, policy_version 179920 (0.0005) [2023-03-11 15:02:26,345][22439] Fps is (10 sec: 11469.0, 60 sec: 11468.8, 300 sec: 11649.3). Total num frames: 92155904. Throughput: 0: 11487.4. Samples: 92125816. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 15:02:26,346][22439] Avg episode reward: [(0, '1240.130')] [2023-03-11 15:02:26,397][22726] Updated weights for policy 0, policy_version 180000 (0.0005) [2023-03-11 15:02:30,021][22726] Updated weights for policy 0, policy_version 180080 (0.0004) [2023-03-11 15:02:31,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11649.3). Total num frames: 92213248. Throughput: 0: 11491.5. Samples: 92193788. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 15:02:31,346][22439] Avg episode reward: [(0, '1203.828')] [2023-03-11 15:02:31,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000180104_92213248.pth... [2023-03-11 15:02:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000179432_91869184.pth [2023-03-11 15:02:33,562][22726] Updated weights for policy 0, policy_version 180160 (0.0005) [2023-03-11 15:02:36,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11537.1, 300 sec: 11663.2). Total num frames: 92274688. Throughput: 0: 11533.2. Samples: 92263496. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 15:02:36,356][22439] Avg episode reward: [(0, '1055.448')] [2023-03-11 15:02:37,072][22726] Updated weights for policy 0, policy_version 180240 (0.0005) [2023-03-11 15:02:40,638][22726] Updated weights for policy 0, policy_version 180320 (0.0003) [2023-03-11 15:02:41,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 11649.3). Total num frames: 92332032. Throughput: 0: 11536.9. Samples: 92298232. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 15:02:41,346][22439] Avg episode reward: [(0, '1111.510')] [2023-03-11 15:02:44,140][22726] Updated weights for policy 0, policy_version 180400 (0.0005) [2023-03-11 15:02:46,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11649.3). Total num frames: 92389376. Throughput: 0: 11583.4. Samples: 92368684. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 15:02:46,346][22439] Avg episode reward: [(0, '1045.988')] [2023-03-11 15:02:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000180448_92389376.pth... [2023-03-11 15:02:46,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000179768_92041216.pth [2023-03-11 15:02:47,648][22726] Updated weights for policy 0, policy_version 180480 (0.0004) [2023-03-11 15:02:51,133][22726] Updated weights for policy 0, policy_version 180560 (0.0003) [2023-03-11 15:02:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11649.3). Total num frames: 92446720. Throughput: 0: 11572.2. Samples: 92438592. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 15:02:51,346][22439] Avg episode reward: [(0, '910.470')] [2023-03-11 15:02:54,679][22726] Updated weights for policy 0, policy_version 180640 (0.0005) [2023-03-11 15:02:56,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11663.2). Total num frames: 92504064. Throughput: 0: 11567.2. Samples: 92472804. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 15:02:56,346][22439] Avg episode reward: [(0, '1124.111')] [2023-03-11 15:02:58,175][22726] Updated weights for policy 0, policy_version 180720 (0.0005) [2023-03-11 15:03:01,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11649.3). Total num frames: 92561408. Throughput: 0: 11599.0. Samples: 92543484. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 15:03:01,346][22439] Avg episode reward: [(0, '1041.125')] [2023-03-11 15:03:01,400][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000180792_92565504.pth... [2023-03-11 15:03:01,401][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000180104_92213248.pth [2023-03-11 15:03:01,784][22726] Updated weights for policy 0, policy_version 180800 (0.0005) [2023-03-11 15:03:05,308][22726] Updated weights for policy 0, policy_version 180880 (0.0005) [2023-03-11 15:03:06,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11635.4). Total num frames: 92618752. Throughput: 0: 11566.1. Samples: 92611632. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 15:03:06,346][22439] Avg episode reward: [(0, '1143.170')] [2023-03-11 15:03:08,793][22726] Updated weights for policy 0, policy_version 180960 (0.0005) [2023-03-11 15:03:11,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11649.3). Total num frames: 92680192. Throughput: 0: 11591.4. Samples: 92647432. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 15:03:11,346][22439] Avg episode reward: [(0, '1182.036')] [2023-03-11 15:03:12,301][22726] Updated weights for policy 0, policy_version 181040 (0.0005) [2023-03-11 15:03:15,860][22726] Updated weights for policy 0, policy_version 181120 (0.0005) [2023-03-11 15:03:16,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11605.4, 300 sec: 11635.4). Total num frames: 92737536. Throughput: 0: 11629.6. Samples: 92717120. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 15:03:16,346][22439] Avg episode reward: [(0, '1066.006')] [2023-03-11 15:03:16,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000181128_92737536.pth... [2023-03-11 15:03:16,349][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000180448_92389376.pth [2023-03-11 15:03:19,355][22726] Updated weights for policy 0, policy_version 181200 (0.0005) [2023-03-11 15:03:21,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11621.5). Total num frames: 92794880. Throughput: 0: 11627.9. Samples: 92786752. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-11 15:03:21,346][22439] Avg episode reward: [(0, '1025.743')] [2023-03-11 15:03:22,901][22726] Updated weights for policy 0, policy_version 181280 (0.0005) [2023-03-11 15:03:26,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11607.6). Total num frames: 92852224. Throughput: 0: 11623.3. Samples: 92821280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:03:26,346][22439] Avg episode reward: [(0, '1048.051')] [2023-03-11 15:03:26,549][22726] Updated weights for policy 0, policy_version 181360 (0.0005) [2023-03-11 15:03:30,119][22726] Updated weights for policy 0, policy_version 181440 (0.0005) [2023-03-11 15:03:31,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11607.6). Total num frames: 92909568. Throughput: 0: 11566.0. Samples: 92889152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:03:31,346][22439] Avg episode reward: [(0, '1258.136')] [2023-03-11 15:03:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000181464_92909568.pth... [2023-03-11 15:03:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000180792_92565504.pth [2023-03-11 15:03:33,720][22726] Updated weights for policy 0, policy_version 181520 (0.0004) [2023-03-11 15:03:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11607.6). Total num frames: 92966912. Throughput: 0: 11554.3. Samples: 92958536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:03:36,346][22439] Avg episode reward: [(0, '1208.028')] [2023-03-11 15:03:37,223][22726] Updated weights for policy 0, policy_version 181600 (0.0005) [2023-03-11 15:03:40,679][22726] Updated weights for policy 0, policy_version 181680 (0.0005) [2023-03-11 15:03:41,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11607.6). Total num frames: 93024256. Throughput: 0: 11570.8. Samples: 92993488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:03:41,346][22439] Avg episode reward: [(0, '1128.671')] [2023-03-11 15:03:44,313][22726] Updated weights for policy 0, policy_version 181760 (0.0005) [2023-03-11 15:03:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11607.6). Total num frames: 93081600. Throughput: 0: 11530.4. Samples: 93062352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:03:46,346][22439] Avg episode reward: [(0, '1108.798')] [2023-03-11 15:03:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000181800_93081600.pth... [2023-03-11 15:03:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000181128_92737536.pth [2023-03-11 15:03:47,912][22726] Updated weights for policy 0, policy_version 181840 (0.0005) [2023-03-11 15:03:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11607.6). Total num frames: 93138944. Throughput: 0: 11540.3. Samples: 93130948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:03:51,356][22439] Avg episode reward: [(0, '1114.843')] [2023-03-11 15:03:51,525][22726] Updated weights for policy 0, policy_version 181920 (0.0005) [2023-03-11 15:03:55,099][22726] Updated weights for policy 0, policy_version 182000 (0.0005) [2023-03-11 15:03:56,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11607.6). Total num frames: 93196288. Throughput: 0: 11477.7. Samples: 93163928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:03:56,356][22439] Avg episode reward: [(0, '959.867')] [2023-03-11 15:03:58,695][22726] Updated weights for policy 0, policy_version 182080 (0.0005) [2023-03-11 15:04:01,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.0, 300 sec: 11579.9). Total num frames: 93253632. Throughput: 0: 11468.8. Samples: 93233216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:04:01,356][22439] Avg episode reward: [(0, '1060.746')] [2023-03-11 15:04:01,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000182136_93253632.pth... [2023-03-11 15:04:01,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000181464_92909568.pth [2023-03-11 15:04:02,302][22726] Updated weights for policy 0, policy_version 182160 (0.0005) [2023-03-11 15:04:05,768][22726] Updated weights for policy 0, policy_version 182240 (0.0005) [2023-03-11 15:04:06,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11566.0). Total num frames: 93310976. Throughput: 0: 11468.8. Samples: 93302848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:04:06,356][22439] Avg episode reward: [(0, '1217.026')] [2023-03-11 15:04:09,421][22726] Updated weights for policy 0, policy_version 182320 (0.0005) [2023-03-11 15:04:11,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11552.1). Total num frames: 93368320. Throughput: 0: 11447.2. Samples: 93336404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:04:11,356][22439] Avg episode reward: [(0, '1002.391')] [2023-03-11 15:04:12,928][22726] Updated weights for policy 0, policy_version 182400 (0.0005) [2023-03-11 15:04:16,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11538.2). Total num frames: 93425664. Throughput: 0: 11498.6. Samples: 93406592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:04:16,356][22439] Avg episode reward: [(0, '1206.948')] [2023-03-11 15:04:16,372][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000182480_93429760.pth... [2023-03-11 15:04:16,372][22726] Updated weights for policy 0, policy_version 182480 (0.0005) [2023-03-11 15:04:16,373][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000181800_93081600.pth [2023-03-11 15:04:19,981][22726] Updated weights for policy 0, policy_version 182560 (0.0005) [2023-03-11 15:04:21,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11524.3). Total num frames: 93483008. Throughput: 0: 11488.8. Samples: 93475532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:04:21,356][22439] Avg episode reward: [(0, '1094.541')] [2023-03-11 15:04:23,591][22726] Updated weights for policy 0, policy_version 182640 (0.0005) [2023-03-11 15:04:26,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11510.5). Total num frames: 93540352. Throughput: 0: 11478.9. Samples: 93510040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:04:26,356][22439] Avg episode reward: [(0, '1000.298')] [2023-03-11 15:04:27,126][22726] Updated weights for policy 0, policy_version 182720 (0.0005) [2023-03-11 15:04:30,697][22726] Updated weights for policy 0, policy_version 182800 (0.0005) [2023-03-11 15:04:31,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11496.6). Total num frames: 93597696. Throughput: 0: 11490.0. Samples: 93579400. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 15:04:31,356][22439] Avg episode reward: [(0, '1082.449')] [2023-03-11 15:04:31,391][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000182816_93601792.pth... [2023-03-11 15:04:31,392][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000182136_93253632.pth [2023-03-11 15:04:34,184][22726] Updated weights for policy 0, policy_version 182880 (0.0005) [2023-03-11 15:04:36,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 11482.7). Total num frames: 93659136. Throughput: 0: 11517.7. Samples: 93649244. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 15:04:36,356][22439] Avg episode reward: [(0, '1314.509')] [2023-03-11 15:04:37,751][22726] Updated weights for policy 0, policy_version 182960 (0.0005) [2023-03-11 15:04:41,232][22726] Updated weights for policy 0, policy_version 183040 (0.0005) [2023-03-11 15:04:41,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11537.1, 300 sec: 11482.7). Total num frames: 93716480. Throughput: 0: 11551.0. Samples: 93683724. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 15:04:41,356][22439] Avg episode reward: [(0, '1002.455')] [2023-03-11 15:04:44,814][22726] Updated weights for policy 0, policy_version 183120 (0.0005) [2023-03-11 15:04:46,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11482.7). Total num frames: 93773824. Throughput: 0: 11558.4. Samples: 93753344. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 15:04:46,356][22439] Avg episode reward: [(0, '1083.269')] [2023-03-11 15:04:46,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000183152_93773824.pth... [2023-03-11 15:04:46,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000182480_93429760.pth [2023-03-11 15:04:48,284][22726] Updated weights for policy 0, policy_version 183200 (0.0005) [2023-03-11 15:04:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11482.7). Total num frames: 93831168. Throughput: 0: 11558.4. Samples: 93822976. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 15:04:51,356][22439] Avg episode reward: [(0, '1095.337')] [2023-03-11 15:04:51,903][22726] Updated weights for policy 0, policy_version 183280 (0.0005) [2023-03-11 15:04:55,484][22726] Updated weights for policy 0, policy_version 183360 (0.0005) [2023-03-11 15:04:56,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11482.7). Total num frames: 93888512. Throughput: 0: 11560.3. Samples: 93856616. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 15:04:56,346][22439] Avg episode reward: [(0, '1122.517')] [2023-03-11 15:04:59,100][22726] Updated weights for policy 0, policy_version 183440 (0.0005) [2023-03-11 15:05:01,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11482.7). Total num frames: 93945856. Throughput: 0: 11528.5. Samples: 93925376. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 15:05:01,346][22439] Avg episode reward: [(0, '1019.010')] [2023-03-11 15:05:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000183488_93945856.pth... [2023-03-11 15:05:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000182816_93601792.pth [2023-03-11 15:05:02,660][22726] Updated weights for policy 0, policy_version 183520 (0.0005) [2023-03-11 15:05:06,176][22726] Updated weights for policy 0, policy_version 183600 (0.0005) [2023-03-11 15:05:06,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11496.6). Total num frames: 94003200. Throughput: 0: 11543.9. Samples: 93995008. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 15:05:06,346][22439] Avg episode reward: [(0, '1138.480')] [2023-03-11 15:05:09,739][22726] Updated weights for policy 0, policy_version 183680 (0.0005) [2023-03-11 15:05:11,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11496.6). Total num frames: 94060544. Throughput: 0: 11528.2. Samples: 94028808. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 15:05:11,346][22439] Avg episode reward: [(0, '937.123')] [2023-03-11 15:05:13,252][22726] Updated weights for policy 0, policy_version 183760 (0.0005) [2023-03-11 15:05:16,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11496.6). Total num frames: 94117888. Throughput: 0: 11532.8. Samples: 94098376. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 15:05:16,356][22439] Avg episode reward: [(0, '1193.461')] [2023-03-11 15:05:16,406][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000183832_94121984.pth... [2023-03-11 15:05:16,409][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000183152_93773824.pth [2023-03-11 15:05:16,776][22726] Updated weights for policy 0, policy_version 183840 (0.0005) [2023-03-11 15:05:20,319][22726] Updated weights for policy 0, policy_version 183920 (0.0005) [2023-03-11 15:05:21,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11496.6). Total num frames: 94175232. Throughput: 0: 11528.1. Samples: 94168008. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 15:05:21,356][22439] Avg episode reward: [(0, '831.753')] [2023-03-11 15:05:23,825][22726] Updated weights for policy 0, policy_version 184000 (0.0005) [2023-03-11 15:05:26,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11510.5). Total num frames: 94236672. Throughput: 0: 11559.6. Samples: 94203904. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 15:05:26,352][22439] Avg episode reward: [(0, '1179.187')] [2023-03-11 15:05:27,399][22726] Updated weights for policy 0, policy_version 184080 (0.0005) [2023-03-11 15:05:31,023][22726] Updated weights for policy 0, policy_version 184160 (0.0005) [2023-03-11 15:05:31,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11496.6). Total num frames: 94289920. Throughput: 0: 11527.4. Samples: 94272076. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 15:05:31,356][22439] Avg episode reward: [(0, '1272.112')] [2023-03-11 15:05:31,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000184168_94294016.pth... [2023-03-11 15:05:31,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000183488_93945856.pth [2023-03-11 15:05:34,583][22726] Updated weights for policy 0, policy_version 184240 (0.0005) [2023-03-11 15:05:36,345][22439] Fps is (10 sec: 11059.3, 60 sec: 11468.8, 300 sec: 11496.6). Total num frames: 94347264. Throughput: 0: 11489.2. Samples: 94339988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:05:36,356][22439] Avg episode reward: [(0, '998.734')] [2023-03-11 15:05:38,217][22726] Updated weights for policy 0, policy_version 184320 (0.0005) [2023-03-11 15:05:41,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11496.6). Total num frames: 94404608. Throughput: 0: 11509.7. Samples: 94374552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:05:41,346][22439] Avg episode reward: [(0, '1176.163')] [2023-03-11 15:05:41,811][22726] Updated weights for policy 0, policy_version 184400 (0.0005) [2023-03-11 15:05:45,384][22726] Updated weights for policy 0, policy_version 184480 (0.0005) [2023-03-11 15:05:46,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11496.6). Total num frames: 94461952. Throughput: 0: 11501.3. Samples: 94442932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:05:46,346][22439] Avg episode reward: [(0, '1356.015')] [2023-03-11 15:05:46,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000184496_94461952.pth... [2023-03-11 15:05:46,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000183832_94121984.pth [2023-03-11 15:05:48,891][22726] Updated weights for policy 0, policy_version 184560 (0.0005) [2023-03-11 15:05:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11496.6). Total num frames: 94519296. Throughput: 0: 11506.5. Samples: 94512800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:05:51,346][22439] Avg episode reward: [(0, '1110.467')] [2023-03-11 15:05:52,418][22726] Updated weights for policy 0, policy_version 184640 (0.0005) [2023-03-11 15:05:55,654][22726] Updated weights for policy 0, policy_version 184720 (0.0004) [2023-03-11 15:05:56,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11605.3, 300 sec: 11538.2). Total num frames: 94584832. Throughput: 0: 11538.3. Samples: 94548032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:05:56,346][22439] Avg episode reward: [(0, '1022.952')] [2023-03-11 15:05:58,914][22726] Updated weights for policy 0, policy_version 184800 (0.0004) [2023-03-11 15:06:01,345][22439] Fps is (10 sec: 12697.6, 60 sec: 11673.6, 300 sec: 11552.1). Total num frames: 94646272. Throughput: 0: 11680.9. Samples: 94624016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:06:01,346][22439] Avg episode reward: [(0, '1028.939')] [2023-03-11 15:06:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000184856_94646272.pth... [2023-03-11 15:06:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000184168_94294016.pth [2023-03-11 15:06:02,294][22726] Updated weights for policy 0, policy_version 184880 (0.0005) [2023-03-11 15:06:05,499][22726] Updated weights for policy 0, policy_version 184960 (0.0004) [2023-03-11 15:06:06,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11566.0). Total num frames: 94707712. Throughput: 0: 11793.8. Samples: 94698728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:06:06,346][22439] Avg episode reward: [(0, '994.161')] [2023-03-11 15:06:08,869][22726] Updated weights for policy 0, policy_version 185040 (0.0005) [2023-03-11 15:06:11,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11566.0). Total num frames: 94765056. Throughput: 0: 11814.8. Samples: 94735568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:06:11,346][22439] Avg episode reward: [(0, '1085.278')] [2023-03-11 15:06:12,408][22726] Updated weights for policy 0, policy_version 185120 (0.0005) [2023-03-11 15:06:15,984][22726] Updated weights for policy 0, policy_version 185200 (0.0005) [2023-03-11 15:06:16,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11566.0). Total num frames: 94822400. Throughput: 0: 11860.5. Samples: 94805800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:06:16,346][22439] Avg episode reward: [(0, '1218.697')] [2023-03-11 15:06:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000185208_94826496.pth... [2023-03-11 15:06:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000184496_94461952.pth [2023-03-11 15:06:19,525][22726] Updated weights for policy 0, policy_version 185280 (0.0005) [2023-03-11 15:06:21,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11579.9). Total num frames: 94883840. Throughput: 0: 11866.0. Samples: 94873960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:06:21,346][22439] Avg episode reward: [(0, '1174.187')] [2023-03-11 15:06:23,052][22726] Updated weights for policy 0, policy_version 185360 (0.0005) [2023-03-11 15:06:26,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11579.9). Total num frames: 94941184. Throughput: 0: 11865.1. Samples: 94908480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:06:26,346][22439] Avg episode reward: [(0, '1091.205')] [2023-03-11 15:06:26,623][22726] Updated weights for policy 0, policy_version 185440 (0.0005) [2023-03-11 15:06:30,053][22726] Updated weights for policy 0, policy_version 185520 (0.0005) [2023-03-11 15:06:31,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 11579.9). Total num frames: 94998528. Throughput: 0: 11901.6. Samples: 94978504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:06:31,346][22439] Avg episode reward: [(0, '1227.052')] [2023-03-11 15:06:31,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000185544_94998528.pth... [2023-03-11 15:06:31,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000184856_94646272.pth [2023-03-11 15:06:33,560][22726] Updated weights for policy 0, policy_version 185600 (0.0005) [2023-03-11 15:06:36,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 11579.9). Total num frames: 95055872. Throughput: 0: 11911.1. Samples: 95048800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:06:36,346][22439] Avg episode reward: [(0, '1141.059')] [2023-03-11 15:06:37,049][22726] Updated weights for policy 0, policy_version 185680 (0.0005) [2023-03-11 15:06:40,612][22726] Updated weights for policy 0, policy_version 185760 (0.0005) [2023-03-11 15:06:41,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 11593.8). Total num frames: 95117312. Throughput: 0: 11922.5. Samples: 95084544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:06:41,346][22439] Avg episode reward: [(0, '1083.223')] [2023-03-11 15:06:44,109][22726] Updated weights for policy 0, policy_version 185840 (0.0005) [2023-03-11 15:06:46,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 11593.8). Total num frames: 95174656. Throughput: 0: 11781.3. Samples: 95154176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:06:46,346][22439] Avg episode reward: [(0, '1106.421')] [2023-03-11 15:06:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000185888_95174656.pth... [2023-03-11 15:06:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000185208_94826496.pth [2023-03-11 15:06:47,664][22726] Updated weights for policy 0, policy_version 185920 (0.0005) [2023-03-11 15:06:51,121][22726] Updated weights for policy 0, policy_version 186000 (0.0005) [2023-03-11 15:06:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11593.8). Total num frames: 95232000. Throughput: 0: 11669.9. Samples: 95223872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:06:51,346][22439] Avg episode reward: [(0, '1110.939')] [2023-03-11 15:06:54,336][22726] Updated weights for policy 0, policy_version 186080 (0.0004) [2023-03-11 15:06:56,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11621.5). Total num frames: 95297536. Throughput: 0: 11676.2. Samples: 95260996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:06:56,346][22439] Avg episode reward: [(0, '1204.409')] [2023-03-11 15:06:57,577][22726] Updated weights for policy 0, policy_version 186160 (0.0004) [2023-03-11 15:07:00,745][22726] Updated weights for policy 0, policy_version 186240 (0.0004) [2023-03-11 15:07:01,345][22439] Fps is (10 sec: 12697.7, 60 sec: 11878.4, 300 sec: 11635.4). Total num frames: 95358976. Throughput: 0: 11837.3. Samples: 95338476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:07:01,346][22439] Avg episode reward: [(0, '1174.953')] [2023-03-11 15:07:01,364][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000186256_95363072.pth... [2023-03-11 15:07:01,365][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000185544_94998528.pth [2023-03-11 15:07:04,016][22726] Updated weights for policy 0, policy_version 186320 (0.0005) [2023-03-11 15:07:06,345][22439] Fps is (10 sec: 12697.6, 60 sec: 11946.7, 300 sec: 11663.2). Total num frames: 95424512. Throughput: 0: 11994.4. Samples: 95413708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:07:06,346][22439] Avg episode reward: [(0, '943.026')] [2023-03-11 15:07:07,225][22726] Updated weights for policy 0, policy_version 186400 (0.0005) [2023-03-11 15:07:10,411][22726] Updated weights for policy 0, policy_version 186480 (0.0004) [2023-03-11 15:07:11,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12014.9, 300 sec: 11677.1). Total num frames: 95485952. Throughput: 0: 12097.1. Samples: 95452848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:07:11,346][22439] Avg episode reward: [(0, '1029.929')] [2023-03-11 15:07:13,727][22726] Updated weights for policy 0, policy_version 186560 (0.0004) [2023-03-11 15:07:16,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11691.0). Total num frames: 95547392. Throughput: 0: 12188.4. Samples: 95526984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:07:16,346][22439] Avg episode reward: [(0, '1221.832')] [2023-03-11 15:07:16,363][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000186624_95551488.pth... [2023-03-11 15:07:16,364][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000185888_95174656.pth [2023-03-11 15:07:17,022][22726] Updated weights for policy 0, policy_version 186640 (0.0004) [2023-03-11 15:07:20,303][22726] Updated weights for policy 0, policy_version 186720 (0.0005) [2023-03-11 15:07:21,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 11718.7). Total num frames: 95612928. Throughput: 0: 12294.3. Samples: 95602044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:07:21,346][22439] Avg episode reward: [(0, '1008.395')] [2023-03-11 15:07:23,564][22726] Updated weights for policy 0, policy_version 186800 (0.0004) [2023-03-11 15:07:26,345][22439] Fps is (10 sec: 12697.7, 60 sec: 12219.7, 300 sec: 11732.6). Total num frames: 95674368. Throughput: 0: 12338.8. Samples: 95639792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:07:26,346][22439] Avg episode reward: [(0, '1138.604')] [2023-03-11 15:07:26,766][22726] Updated weights for policy 0, policy_version 186880 (0.0004) [2023-03-11 15:07:29,934][22726] Updated weights for policy 0, policy_version 186960 (0.0004) [2023-03-11 15:07:31,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12356.2, 300 sec: 11746.5). Total num frames: 95739904. Throughput: 0: 12504.1. Samples: 95716860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:07:31,346][22439] Avg episode reward: [(0, '1179.159')] [2023-03-11 15:07:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000186992_95739904.pth... [2023-03-11 15:07:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000186256_95363072.pth [2023-03-11 15:07:33,140][22726] Updated weights for policy 0, policy_version 187040 (0.0005) [2023-03-11 15:07:36,319][22726] Updated weights for policy 0, policy_version 187120 (0.0004) [2023-03-11 15:07:36,345][22439] Fps is (10 sec: 13107.2, 60 sec: 12492.8, 300 sec: 11774.3). Total num frames: 95805440. Throughput: 0: 12661.3. Samples: 95793632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:07:36,346][22439] Avg episode reward: [(0, '990.941')] [2023-03-11 15:07:39,868][22726] Updated weights for policy 0, policy_version 187200 (0.0005) [2023-03-11 15:07:41,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12424.5, 300 sec: 11774.3). Total num frames: 95862784. Throughput: 0: 12645.2. Samples: 95830028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:07:41,346][22439] Avg episode reward: [(0, '1242.939')] [2023-03-11 15:07:43,391][22726] Updated weights for policy 0, policy_version 187280 (0.0005) [2023-03-11 15:07:46,345][22439] Fps is (10 sec: 11468.7, 60 sec: 12424.5, 300 sec: 11774.3). Total num frames: 95920128. Throughput: 0: 12472.0. Samples: 95899720. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 15:07:46,346][22439] Avg episode reward: [(0, '964.315')] [2023-03-11 15:07:46,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000187344_95920128.pth... [2023-03-11 15:07:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000186624_95551488.pth [2023-03-11 15:07:46,932][22726] Updated weights for policy 0, policy_version 187360 (0.0005) [2023-03-11 15:07:50,384][22726] Updated weights for policy 0, policy_version 187440 (0.0005) [2023-03-11 15:07:51,345][22439] Fps is (10 sec: 11468.9, 60 sec: 12424.5, 300 sec: 11774.3). Total num frames: 95977472. Throughput: 0: 12347.8. Samples: 95969360. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 15:07:51,346][22439] Avg episode reward: [(0, '1140.759')] [2023-03-11 15:07:53,911][22726] Updated weights for policy 0, policy_version 187520 (0.0005) [2023-03-11 15:07:56,345][22439] Fps is (10 sec: 11468.9, 60 sec: 12288.0, 300 sec: 11774.3). Total num frames: 96034816. Throughput: 0: 12250.4. Samples: 96004116. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 15:07:56,356][22439] Avg episode reward: [(0, '1191.698')] [2023-03-11 15:07:57,451][22726] Updated weights for policy 0, policy_version 187600 (0.0005) [2023-03-11 15:08:00,886][22726] Updated weights for policy 0, policy_version 187680 (0.0004) [2023-03-11 15:08:01,345][22439] Fps is (10 sec: 11878.3, 60 sec: 12288.0, 300 sec: 11788.1). Total num frames: 96096256. Throughput: 0: 12157.5. Samples: 96074072. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 15:08:01,356][22439] Avg episode reward: [(0, '1323.518')] [2023-03-11 15:08:01,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000187688_96096256.pth... [2023-03-11 15:08:01,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000186992_95739904.pth [2023-03-11 15:08:04,084][22726] Updated weights for policy 0, policy_version 187760 (0.0004) [2023-03-11 15:08:06,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12219.8, 300 sec: 11788.2). Total num frames: 96157696. Throughput: 0: 12167.2. Samples: 96149568. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 15:08:06,356][22439] Avg episode reward: [(0, '1075.428')] [2023-03-11 15:08:07,364][22726] Updated weights for policy 0, policy_version 187840 (0.0004) [2023-03-11 15:08:10,663][22726] Updated weights for policy 0, policy_version 187920 (0.0004) [2023-03-11 15:08:11,345][22439] Fps is (10 sec: 12697.7, 60 sec: 12288.0, 300 sec: 11815.9). Total num frames: 96223232. Throughput: 0: 12163.0. Samples: 96187128. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 15:08:11,356][22439] Avg episode reward: [(0, '1017.125')] [2023-03-11 15:08:13,973][22726] Updated weights for policy 0, policy_version 188000 (0.0005) [2023-03-11 15:08:16,345][22439] Fps is (10 sec: 12697.4, 60 sec: 12288.0, 300 sec: 11829.8). Total num frames: 96284672. Throughput: 0: 12099.1. Samples: 96261320. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 15:08:16,356][22439] Avg episode reward: [(0, '1165.467')] [2023-03-11 15:08:16,359][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000188056_96284672.pth... [2023-03-11 15:08:16,362][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000187344_95920128.pth [2023-03-11 15:08:17,240][22726] Updated weights for policy 0, policy_version 188080 (0.0005) [2023-03-11 15:08:20,559][22726] Updated weights for policy 0, policy_version 188160 (0.0004) [2023-03-11 15:08:21,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 11843.7). Total num frames: 96346112. Throughput: 0: 12065.2. Samples: 96336564. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 15:08:21,356][22439] Avg episode reward: [(0, '1254.385')] [2023-03-11 15:08:23,894][22726] Updated weights for policy 0, policy_version 188240 (0.0004) [2023-03-11 15:08:26,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 11857.6). Total num frames: 96407552. Throughput: 0: 12089.1. Samples: 96374036. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 15:08:26,356][22439] Avg episode reward: [(0, '1248.043')] [2023-03-11 15:08:27,162][22726] Updated weights for policy 0, policy_version 188320 (0.0004) [2023-03-11 15:08:30,561][22726] Updated weights for policy 0, policy_version 188400 (0.0004) [2023-03-11 15:08:31,345][22439] Fps is (10 sec: 12287.9, 60 sec: 12151.5, 300 sec: 11871.5). Total num frames: 96468992. Throughput: 0: 12183.5. Samples: 96447976. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 15:08:31,356][22439] Avg episode reward: [(0, '1107.731')] [2023-03-11 15:08:31,360][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000188416_96468992.pth... [2023-03-11 15:08:31,363][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000187688_96096256.pth [2023-03-11 15:08:34,150][22726] Updated weights for policy 0, policy_version 188480 (0.0005) [2023-03-11 15:08:36,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11871.5). Total num frames: 96526336. Throughput: 0: 12151.8. Samples: 96516192. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 15:08:36,356][22439] Avg episode reward: [(0, '1046.637')] [2023-03-11 15:08:37,702][22726] Updated weights for policy 0, policy_version 188560 (0.0005) [2023-03-11 15:08:41,240][22726] Updated weights for policy 0, policy_version 188640 (0.0005) [2023-03-11 15:08:41,345][22439] Fps is (10 sec: 11468.9, 60 sec: 12014.9, 300 sec: 11871.5). Total num frames: 96583680. Throughput: 0: 12152.4. Samples: 96550976. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 15:08:41,346][22439] Avg episode reward: [(0, '1119.188')] [2023-03-11 15:08:44,726][22726] Updated weights for policy 0, policy_version 188720 (0.0005) [2023-03-11 15:08:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11871.5). Total num frames: 96641024. Throughput: 0: 12151.6. Samples: 96620892. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 15:08:46,346][22439] Avg episode reward: [(0, '1052.498')] [2023-03-11 15:08:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000188752_96641024.pth... [2023-03-11 15:08:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000188056_96284672.pth [2023-03-11 15:08:48,276][22726] Updated weights for policy 0, policy_version 188800 (0.0005) [2023-03-11 15:08:51,345][22439] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11871.5). Total num frames: 96698368. Throughput: 0: 12014.9. Samples: 96690240. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-11 15:08:51,346][22439] Avg episode reward: [(0, '1167.289')] [2023-03-11 15:08:51,852][22726] Updated weights for policy 0, policy_version 188880 (0.0005) [2023-03-11 15:08:55,363][22726] Updated weights for policy 0, policy_version 188960 (0.0005) [2023-03-11 15:08:56,345][22439] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11871.5). Total num frames: 96755712. Throughput: 0: 11953.0. Samples: 96725012. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 15:08:56,346][22439] Avg episode reward: [(0, '1070.227')] [2023-03-11 15:08:58,883][22726] Updated weights for policy 0, policy_version 189040 (0.0005) [2023-03-11 15:09:01,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11871.5). Total num frames: 96813056. Throughput: 0: 11861.4. Samples: 96795084. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 15:09:01,346][22439] Avg episode reward: [(0, '1307.992')] [2023-03-11 15:09:01,379][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000189096_96817152.pth... [2023-03-11 15:09:01,381][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000188416_96468992.pth [2023-03-11 15:09:02,391][22726] Updated weights for policy 0, policy_version 189120 (0.0005) [2023-03-11 15:09:05,919][22726] Updated weights for policy 0, policy_version 189200 (0.0005) [2023-03-11 15:09:06,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11946.6, 300 sec: 11885.3). Total num frames: 96874496. Throughput: 0: 11748.0. Samples: 96865224. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 15:09:06,346][22439] Avg episode reward: [(0, '1227.328')] [2023-03-11 15:09:09,436][22726] Updated weights for policy 0, policy_version 189280 (0.0005) [2023-03-11 15:09:11,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11885.3). Total num frames: 96931840. Throughput: 0: 11668.9. Samples: 96899136. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 15:09:11,346][22439] Avg episode reward: [(0, '1164.242')] [2023-03-11 15:09:12,991][22726] Updated weights for policy 0, policy_version 189360 (0.0005) [2023-03-11 15:09:16,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11885.3). Total num frames: 96989184. Throughput: 0: 11572.0. Samples: 96968716. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 15:09:16,346][22439] Avg episode reward: [(0, '1099.029')] [2023-03-11 15:09:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000189432_96989184.pth... [2023-03-11 15:09:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000188752_96641024.pth [2023-03-11 15:09:16,568][22726] Updated weights for policy 0, policy_version 189440 (0.0005) [2023-03-11 15:09:20,079][22726] Updated weights for policy 0, policy_version 189520 (0.0006) [2023-03-11 15:09:21,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11885.3). Total num frames: 97046528. Throughput: 0: 11603.4. Samples: 97038344. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 15:09:21,346][22439] Avg episode reward: [(0, '1294.831')] [2023-03-11 15:09:23,623][22726] Updated weights for policy 0, policy_version 189600 (0.0005) [2023-03-11 15:09:26,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11885.3). Total num frames: 97103872. Throughput: 0: 11592.7. Samples: 97072648. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 15:09:26,346][22439] Avg episode reward: [(0, '1211.629')] [2023-03-11 15:09:27,162][22726] Updated weights for policy 0, policy_version 189680 (0.0005) [2023-03-11 15:09:30,719][22726] Updated weights for policy 0, policy_version 189760 (0.0005) [2023-03-11 15:09:31,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11871.5). Total num frames: 97161216. Throughput: 0: 11589.3. Samples: 97142408. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 15:09:31,346][22439] Avg episode reward: [(0, '1088.713')] [2023-03-11 15:09:31,399][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000189776_97165312.pth... [2023-03-11 15:09:31,400][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000189096_96817152.pth [2023-03-11 15:09:34,200][22726] Updated weights for policy 0, policy_version 189840 (0.0005) [2023-03-11 15:09:36,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11605.4, 300 sec: 11885.3). Total num frames: 97222656. Throughput: 0: 11594.9. Samples: 97212008. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 15:09:36,346][22439] Avg episode reward: [(0, '1120.040')] [2023-03-11 15:09:37,672][22726] Updated weights for policy 0, policy_version 189920 (0.0005) [2023-03-11 15:09:41,087][22726] Updated weights for policy 0, policy_version 190000 (0.0005) [2023-03-11 15:09:41,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11885.3). Total num frames: 97280000. Throughput: 0: 11615.9. Samples: 97247728. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 15:09:41,346][22439] Avg episode reward: [(0, '1320.843')] [2023-03-11 15:09:44,524][22726] Updated weights for policy 0, policy_version 190080 (0.0005) [2023-03-11 15:09:46,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11899.2). Total num frames: 97341440. Throughput: 0: 11663.3. Samples: 97319932. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 15:09:46,346][22439] Avg episode reward: [(0, '1135.470')] [2023-03-11 15:09:46,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000190120_97341440.pth... [2023-03-11 15:09:46,350][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000189432_96989184.pth [2023-03-11 15:09:48,076][22726] Updated weights for policy 0, policy_version 190160 (0.0005) [2023-03-11 15:09:51,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 11899.2). Total num frames: 97398784. Throughput: 0: 11637.0. Samples: 97388888. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 15:09:51,346][22439] Avg episode reward: [(0, '1328.172')] [2023-03-11 15:09:51,619][22726] Updated weights for policy 0, policy_version 190240 (0.0005) [2023-03-11 15:09:55,123][22726] Updated weights for policy 0, policy_version 190320 (0.0005) [2023-03-11 15:09:56,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11899.2). Total num frames: 97456128. Throughput: 0: 11651.8. Samples: 97423468. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-11 15:09:56,346][22439] Avg episode reward: [(0, '1368.035')] [2023-03-11 15:09:58,572][22726] Updated weights for policy 0, policy_version 190400 (0.0005) [2023-03-11 15:10:01,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11741.9, 300 sec: 11913.1). Total num frames: 97517568. Throughput: 0: 11691.6. Samples: 97494840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:10:01,346][22439] Avg episode reward: [(0, '1352.187')] [2023-03-11 15:10:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000190464_97517568.pth... [2023-03-11 15:10:01,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000189776_97165312.pth [2023-03-11 15:10:02,023][22726] Updated weights for policy 0, policy_version 190480 (0.0005) [2023-03-11 15:10:05,561][22726] Updated weights for policy 0, policy_version 190560 (0.0005) [2023-03-11 15:10:06,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 11913.1). Total num frames: 97574912. Throughput: 0: 11705.4. Samples: 97565088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:10:06,346][22439] Avg episode reward: [(0, '1421.354')] [2023-03-11 15:10:09,125][22726] Updated weights for policy 0, policy_version 190640 (0.0005) [2023-03-11 15:10:11,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11913.1). Total num frames: 97632256. Throughput: 0: 11711.4. Samples: 97599664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:10:11,346][22439] Avg episode reward: [(0, '1077.200')] [2023-03-11 15:10:12,627][22726] Updated weights for policy 0, policy_version 190720 (0.0005) [2023-03-11 15:10:16,183][22726] Updated weights for policy 0, policy_version 190800 (0.0005) [2023-03-11 15:10:16,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 11913.1). Total num frames: 97689600. Throughput: 0: 11707.0. Samples: 97669224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:10:16,346][22439] Avg episode reward: [(0, '1251.043')] [2023-03-11 15:10:16,348][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000190800_97689600.pth... [2023-03-11 15:10:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000190120_97341440.pth [2023-03-11 15:10:19,716][22726] Updated weights for policy 0, policy_version 190880 (0.0005) [2023-03-11 15:10:21,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 11899.2). Total num frames: 97746944. Throughput: 0: 11707.0. Samples: 97738824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:10:21,346][22439] Avg episode reward: [(0, '1321.565')] [2023-03-11 15:10:23,163][22726] Updated weights for policy 0, policy_version 190960 (0.0005) [2023-03-11 15:10:26,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11927.0). Total num frames: 97808384. Throughput: 0: 11724.1. Samples: 97775312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:10:26,346][22439] Avg episode reward: [(0, '1190.823')] [2023-03-11 15:10:26,619][22726] Updated weights for policy 0, policy_version 191040 (0.0005) [2023-03-11 15:10:30,150][22726] Updated weights for policy 0, policy_version 191120 (0.0005) [2023-03-11 15:10:31,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11741.9, 300 sec: 11927.0). Total num frames: 97865728. Throughput: 0: 11674.1. Samples: 97845268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:10:31,346][22439] Avg episode reward: [(0, '1276.364')] [2023-03-11 15:10:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000191144_97865728.pth... [2023-03-11 15:10:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000190464_97517568.pth [2023-03-11 15:10:33,637][22726] Updated weights for policy 0, policy_version 191200 (0.0005) [2023-03-11 15:10:36,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11927.0). Total num frames: 97923072. Throughput: 0: 11690.1. Samples: 97914944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:10:36,346][22439] Avg episode reward: [(0, '1277.039')] [2023-03-11 15:10:37,164][22726] Updated weights for policy 0, policy_version 191280 (0.0005) [2023-03-11 15:10:40,693][22726] Updated weights for policy 0, policy_version 191360 (0.0005) [2023-03-11 15:10:41,345][22439] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 11927.0). Total num frames: 97980416. Throughput: 0: 11710.8. Samples: 97950452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:10:41,345][22439] Avg episode reward: [(0, '967.768')] [2023-03-11 15:10:44,243][22726] Updated weights for policy 0, policy_version 191440 (0.0005) [2023-03-11 15:10:46,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11927.0). Total num frames: 98037760. Throughput: 0: 11658.9. Samples: 98019492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:10:46,346][22439] Avg episode reward: [(0, '1335.934')] [2023-03-11 15:10:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000191480_98037760.pth... [2023-03-11 15:10:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000190800_97689600.pth [2023-03-11 15:10:47,850][22726] Updated weights for policy 0, policy_version 191520 (0.0005) [2023-03-11 15:10:51,239][22726] Updated weights for policy 0, policy_version 191600 (0.0005) [2023-03-11 15:10:51,345][22439] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11913.1). Total num frames: 98099200. Throughput: 0: 11659.4. Samples: 98089760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:10:51,346][22439] Avg episode reward: [(0, '1158.847')] [2023-03-11 15:10:54,796][22726] Updated weights for policy 0, policy_version 191680 (0.0005) [2023-03-11 15:10:56,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11899.2). Total num frames: 98156544. Throughput: 0: 11648.5. Samples: 98123848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:10:56,346][22439] Avg episode reward: [(0, '1285.851')] [2023-03-11 15:10:58,342][22726] Updated weights for policy 0, policy_version 191760 (0.0005) [2023-03-11 15:11:01,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11885.3). Total num frames: 98213888. Throughput: 0: 11649.9. Samples: 98193472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:11:01,346][22439] Avg episode reward: [(0, '1319.440')] [2023-03-11 15:11:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000191824_98213888.pth... [2023-03-11 15:11:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000191144_97865728.pth [2023-03-11 15:11:01,867][22726] Updated weights for policy 0, policy_version 191840 (0.0005) [2023-03-11 15:11:05,327][22726] Updated weights for policy 0, policy_version 191920 (0.0005) [2023-03-11 15:11:06,345][22439] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11885.3). Total num frames: 98271232. Throughput: 0: 11667.4. Samples: 98263860. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:11:06,346][22439] Avg episode reward: [(0, '1191.305')] [2023-03-11 15:11:08,815][22726] Updated weights for policy 0, policy_version 192000 (0.0005) [2023-03-11 15:11:11,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11899.2). Total num frames: 98332672. Throughput: 0: 11657.6. Samples: 98299904. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:11:11,346][22439] Avg episode reward: [(0, '1113.902')] [2023-03-11 15:11:12,284][22726] Updated weights for policy 0, policy_version 192080 (0.0005) [2023-03-11 15:11:15,854][22726] Updated weights for policy 0, policy_version 192160 (0.0005) [2023-03-11 15:11:16,345][22439] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11885.3). Total num frames: 98390016. Throughput: 0: 11651.8. Samples: 98369600. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:11:16,346][22439] Avg episode reward: [(0, '1066.224')] [2023-03-11 15:11:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000192168_98390016.pth... [2023-03-11 15:11:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000191480_98037760.pth [2023-03-11 15:11:19,312][22726] Updated weights for policy 0, policy_version 192240 (0.0005) [2023-03-11 15:11:21,345][22439] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11885.3). Total num frames: 98447360. Throughput: 0: 11651.0. Samples: 98439240. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:11:21,346][22439] Avg episode reward: [(0, '1265.477')] [2023-03-11 15:11:22,861][22726] Updated weights for policy 0, policy_version 192320 (0.0005) [2023-03-11 15:11:26,298][22726] Updated weights for policy 0, policy_version 192400 (0.0005) [2023-03-11 15:11:26,345][22439] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 11899.2). Total num frames: 98508800. Throughput: 0: 11658.9. Samples: 98475104. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:11:26,346][22439] Avg episode reward: [(0, '1237.755')] [2023-03-11 15:11:29,496][22726] Updated weights for policy 0, policy_version 192480 (0.0004) [2023-03-11 15:11:31,345][22439] Fps is (10 sec: 12287.9, 60 sec: 11741.9, 300 sec: 11913.1). Total num frames: 98570240. Throughput: 0: 11769.7. Samples: 98549128. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:11:31,346][22439] Avg episode reward: [(0, '1311.583')] [2023-03-11 15:11:31,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000192520_98570240.pth... [2023-03-11 15:11:31,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000191824_98213888.pth [2023-03-11 15:11:32,787][22726] Updated weights for policy 0, policy_version 192560 (0.0005) [2023-03-11 15:11:36,237][22726] Updated weights for policy 0, policy_version 192640 (0.0006) [2023-03-11 15:11:36,345][22439] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 11913.1). Total num frames: 98631680. Throughput: 0: 11846.6. Samples: 98622856. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:11:36,346][22439] Avg episode reward: [(0, '1391.380')] [2023-03-11 15:11:39,542][22726] Updated weights for policy 0, policy_version 192720 (0.0005) [2023-03-11 15:11:41,345][22439] Fps is (10 sec: 12288.1, 60 sec: 11878.4, 300 sec: 11927.0). Total num frames: 98693120. Throughput: 0: 11900.0. Samples: 98659348. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:11:41,346][22439] Avg episode reward: [(0, '1147.120')] [2023-03-11 15:11:42,764][22726] Updated weights for policy 0, policy_version 192800 (0.0005) [2023-03-11 15:11:45,982][22726] Updated weights for policy 0, policy_version 192880 (0.0005) [2023-03-11 15:11:46,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12014.9, 300 sec: 11954.8). Total num frames: 98758656. Throughput: 0: 12024.9. Samples: 98734592. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:11:46,346][22439] Avg episode reward: [(0, '1348.814')] [2023-03-11 15:11:46,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000192888_98758656.pth... [2023-03-11 15:11:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000192168_98390016.pth [2023-03-11 15:11:49,140][22726] Updated weights for policy 0, policy_version 192960 (0.0004) [2023-03-11 15:11:51,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11940.9). Total num frames: 98820096. Throughput: 0: 12178.9. Samples: 98811912. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:11:51,346][22439] Avg episode reward: [(0, '1256.700')] [2023-03-11 15:11:52,381][22726] Updated weights for policy 0, policy_version 193040 (0.0005) [2023-03-11 15:11:55,622][22726] Updated weights for policy 0, policy_version 193120 (0.0005) [2023-03-11 15:11:56,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 11954.8). Total num frames: 98885632. Throughput: 0: 12204.5. Samples: 98849104. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:11:56,346][22439] Avg episode reward: [(0, '1222.660')] [2023-03-11 15:11:58,742][22726] Updated weights for policy 0, policy_version 193200 (0.0004) [2023-03-11 15:12:01,345][22439] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 11940.9). Total num frames: 98947072. Throughput: 0: 12379.2. Samples: 98926664. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:12:01,346][22439] Avg episode reward: [(0, '1254.036')] [2023-03-11 15:12:01,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000193256_98947072.pth... [2023-03-11 15:12:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000192520_98570240.pth [2023-03-11 15:12:02,119][22726] Updated weights for policy 0, policy_version 193280 (0.0005) [2023-03-11 15:12:05,476][22726] Updated weights for policy 0, policy_version 193360 (0.0005) [2023-03-11 15:12:06,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 11940.9). Total num frames: 99008512. Throughput: 0: 12468.1. Samples: 99000304. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-11 15:12:06,346][22439] Avg episode reward: [(0, '1061.022')] [2023-03-11 15:12:08,866][22726] Updated weights for policy 0, policy_version 193440 (0.0004) [2023-03-11 15:12:11,345][22439] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 11940.9). Total num frames: 99069952. Throughput: 0: 12462.8. Samples: 99035928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:12:11,346][22439] Avg episode reward: [(0, '1288.100')] [2023-03-11 15:12:12,216][22726] Updated weights for policy 0, policy_version 193520 (0.0004) [2023-03-11 15:12:15,599][22726] Updated weights for policy 0, policy_version 193600 (0.0005) [2023-03-11 15:12:16,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 11927.0). Total num frames: 99131392. Throughput: 0: 12415.8. Samples: 99107840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:12:16,346][22439] Avg episode reward: [(0, '1022.637')] [2023-03-11 15:12:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000193616_99131392.pth... [2023-03-11 15:12:16,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000192888_98758656.pth [2023-03-11 15:12:18,984][22726] Updated weights for policy 0, policy_version 193680 (0.0005) [2023-03-11 15:12:21,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 11927.0). Total num frames: 99192832. Throughput: 0: 12429.7. Samples: 99182192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:12:21,346][22439] Avg episode reward: [(0, '1345.238')] [2023-03-11 15:12:22,251][22726] Updated weights for policy 0, policy_version 193760 (0.0005) [2023-03-11 15:12:25,608][22726] Updated weights for policy 0, policy_version 193840 (0.0004) [2023-03-11 15:12:26,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 11913.1). Total num frames: 99254272. Throughput: 0: 12450.3. Samples: 99219612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:12:26,346][22439] Avg episode reward: [(0, '1113.785')] [2023-03-11 15:12:28,983][22726] Updated weights for policy 0, policy_version 193920 (0.0004) [2023-03-11 15:12:31,345][22439] Fps is (10 sec: 11878.3, 60 sec: 12356.3, 300 sec: 11885.3). Total num frames: 99311616. Throughput: 0: 12383.4. Samples: 99291844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:12:31,346][22439] Avg episode reward: [(0, '1266.495')] [2023-03-11 15:12:31,412][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000193976_99315712.pth... [2023-03-11 15:12:31,414][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000193256_98947072.pth [2023-03-11 15:12:32,345][22726] Updated weights for policy 0, policy_version 194000 (0.0005) [2023-03-11 15:12:35,591][22726] Updated weights for policy 0, policy_version 194080 (0.0004) [2023-03-11 15:12:36,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 11913.1). Total num frames: 99377152. Throughput: 0: 12336.0. Samples: 99367032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:12:36,346][22439] Avg episode reward: [(0, '1293.330')] [2023-03-11 15:12:38,772][22726] Updated weights for policy 0, policy_version 194160 (0.0005) [2023-03-11 15:12:41,345][22439] Fps is (10 sec: 13107.2, 60 sec: 12492.8, 300 sec: 11940.9). Total num frames: 99442688. Throughput: 0: 12369.1. Samples: 99405712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:12:41,346][22439] Avg episode reward: [(0, '1404.376')] [2023-03-11 15:12:41,945][22726] Updated weights for policy 0, policy_version 194240 (0.0004) [2023-03-11 15:12:45,233][22726] Updated weights for policy 0, policy_version 194320 (0.0005) [2023-03-11 15:12:46,345][22439] Fps is (10 sec: 12697.5, 60 sec: 12424.5, 300 sec: 11954.8). Total num frames: 99504128. Throughput: 0: 12325.1. Samples: 99481296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:12:46,346][22439] Avg episode reward: [(0, '1136.622')] [2023-03-11 15:12:46,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000194344_99504128.pth... [2023-03-11 15:12:46,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000193616_99131392.pth [2023-03-11 15:12:48,456][22726] Updated weights for policy 0, policy_version 194400 (0.0004) [2023-03-11 15:12:51,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 11968.7). Total num frames: 99565568. Throughput: 0: 12366.5. Samples: 99556796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:12:51,346][22439] Avg episode reward: [(0, '1165.475')] [2023-03-11 15:12:51,903][22726] Updated weights for policy 0, policy_version 194480 (0.0005) [2023-03-11 15:12:55,355][22726] Updated weights for policy 0, policy_version 194560 (0.0005) [2023-03-11 15:12:56,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 11954.8). Total num frames: 99622912. Throughput: 0: 12332.2. Samples: 99590876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:12:56,346][22439] Avg episode reward: [(0, '1113.014')] [2023-03-11 15:12:58,849][22726] Updated weights for policy 0, policy_version 194640 (0.0005) [2023-03-11 15:13:01,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 11954.8). Total num frames: 99684352. Throughput: 0: 12351.8. Samples: 99663672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:13:01,346][22439] Avg episode reward: [(0, '1302.050')] [2023-03-11 15:13:01,350][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000194696_99684352.pth... [2023-03-11 15:13:01,352][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000193976_99315712.pth [2023-03-11 15:13:02,255][22726] Updated weights for policy 0, policy_version 194720 (0.0005) [2023-03-11 15:13:05,688][22726] Updated weights for policy 0, policy_version 194800 (0.0006) [2023-03-11 15:13:06,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 11927.0). Total num frames: 99741696. Throughput: 0: 12264.4. Samples: 99734092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:13:06,346][22439] Avg episode reward: [(0, '1231.572')] [2023-03-11 15:13:09,191][22726] Updated weights for policy 0, policy_version 194880 (0.0005) [2023-03-11 15:13:11,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 11927.0). Total num frames: 99803136. Throughput: 0: 12232.4. Samples: 99770072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:13:11,346][22439] Avg episode reward: [(0, '1175.946')] [2023-03-11 15:13:12,707][22726] Updated weights for policy 0, policy_version 194960 (0.0006) [2023-03-11 15:13:16,153][22726] Updated weights for policy 0, policy_version 195040 (0.0005) [2023-03-11 15:13:16,345][22439] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11913.1). Total num frames: 99860480. Throughput: 0: 12181.3. Samples: 99840000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-11 15:13:16,346][22439] Avg episode reward: [(0, '1133.256')] [2023-03-11 15:13:16,349][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000195040_99860480.pth... [2023-03-11 15:13:16,351][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000194344_99504128.pth [2023-03-11 15:13:19,487][22726] Updated weights for policy 0, policy_version 195120 (0.0004) [2023-03-11 15:13:21,345][22439] Fps is (10 sec: 11878.5, 60 sec: 12151.5, 300 sec: 11913.1). Total num frames: 99921920. Throughput: 0: 12148.8. Samples: 99913728. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 15:13:21,346][22439] Avg episode reward: [(0, '1185.455')] [2023-03-11 15:13:22,801][22726] Updated weights for policy 0, policy_version 195200 (0.0004) [2023-03-11 15:13:26,036][22726] Updated weights for policy 0, policy_version 195280 (0.0003) [2023-03-11 15:13:26,345][22439] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11913.1). Total num frames: 99983360. Throughput: 0: 12108.6. Samples: 99950600. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-11 15:13:26,346][22439] Avg episode reward: [(0, '1220.949')] [2023-03-11 15:13:27,667][22682] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000000 [2023-03-11 15:13:28,012][22682] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000000 [2023-03-11 15:13:28,013][22732] Stopping RolloutWorker_w5... [2023-03-11 15:13:28,013][22730] Stopping RolloutWorker_w3... [2023-03-11 15:13:28,013][22727] Stopping RolloutWorker_w1... [2023-03-11 15:13:28,014][22732] Loop rollout_proc5_evt_loop terminating... [2023-03-11 15:13:28,014][22730] Loop rollout_proc3_evt_loop terminating... [2023-03-11 15:13:28,013][22731] Stopping RolloutWorker_w4... [2023-03-11 15:13:28,013][22682] Stopping Batcher_0... [2023-03-11 15:13:28,013][22764] Stopping RolloutWorker_w6... [2023-03-11 15:13:28,014][22727] Loop rollout_proc1_evt_loop terminating... [2023-03-11 15:13:28,014][22815] Stopping RolloutWorker_w7... [2023-03-11 15:13:28,014][22731] Loop rollout_proc4_evt_loop terminating... [2023-03-11 15:13:28,014][22764] Loop rollout_proc6_evt_loop terminating... [2023-03-11 15:13:28,014][22815] Loop rollout_proc7_evt_loop terminating... [2023-03-11 15:13:28,014][22682] Loop batcher_evt_loop terminating... [2023-03-11 15:13:28,014][22729] Stopping RolloutWorker_w0... [2023-03-11 15:13:28,014][22728] Stopping RolloutWorker_w2... [2023-03-11 15:13:28,013][22439] Component RolloutWorker_w5 stopped! [2023-03-11 15:13:28,014][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000195328_100007936.pth... [2023-03-11 15:13:28,014][22729] Loop rollout_proc0_evt_loop terminating... [2023-03-11 15:13:28,014][22728] Loop rollout_proc2_evt_loop terminating... [2023-03-11 15:13:28,014][22439] Component RolloutWorker_w3 stopped! [2023-03-11 15:13:28,014][22439] Component RolloutWorker_w1 stopped! [2023-03-11 15:13:28,015][22439] Component Batcher_0 stopped! [2023-03-11 15:13:28,015][22439] Component RolloutWorker_w4 stopped! [2023-03-11 15:13:28,015][22439] Component RolloutWorker_w6 stopped! [2023-03-11 15:13:28,015][22682] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000194696_99684352.pth [2023-03-11 15:13:28,015][22439] Component RolloutWorker_w7 stopped! [2023-03-11 15:13:28,016][22439] Component RolloutWorker_w2 stopped! [2023-03-11 15:13:28,016][22682] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/soccer-v2/checkpoint_p0/checkpoint_000195328_100007936.pth... [2023-03-11 15:13:28,016][22439] Component RolloutWorker_w0 stopped! [2023-03-11 15:13:28,018][22682] Stopping LearnerWorker_p0... [2023-03-11 15:13:28,018][22682] Loop learner_proc0_evt_loop terminating... [2023-03-11 15:13:28,018][22439] Component LearnerWorker_p0 stopped! [2023-03-11 15:13:28,038][22726] Weights refcount: 2 0 [2023-03-11 15:13:28,039][22726] Stopping InferenceWorker_p0-w0... [2023-03-11 15:13:28,039][22726] Loop inference_proc0-0_evt_loop terminating... [2023-03-11 15:13:28,039][22439] Component InferenceWorker_p0-w0 stopped! [2023-03-11 15:13:28,040][22439] Waiting for process learner_proc0 to stop... [2023-03-11 15:13:28,449][22439] Waiting for process inference_proc0-0 to join... [2023-03-11 15:13:28,449][22439] Waiting for process rollout_proc0 to join... [2023-03-11 15:13:28,450][22439] Waiting for process rollout_proc1 to join... [2023-03-11 15:13:28,450][22439] Waiting for process rollout_proc2 to join... [2023-03-11 15:13:28,450][22439] Waiting for process rollout_proc3 to join... [2023-03-11 15:13:28,450][22439] Waiting for process rollout_proc4 to join... [2023-03-11 15:13:28,450][22439] Waiting for process rollout_proc5 to join... [2023-03-11 15:13:28,450][22439] Waiting for process rollout_proc6 to join... [2023-03-11 15:13:28,451][22439] Waiting for process rollout_proc7 to join... [2023-03-11 15:13:28,451][22439] Batcher 0 profile tree view: batching: 17.2932, releasing_batches: 14.7939 [2023-03-11 15:13:28,451][22439] InferenceWorker_p0-w0 profile tree view: wait_policy: 0.0001 wait_policy_total: 2991.4895 update_model: 96.8619 weight_update: 0.0004 one_step: 0.0013 handle_policy_step: 4960.8736 deserialize: 209.5192, stack: 50.8275, obs_to_device_normalize: 882.3582, forward: 2471.7989, send_messages: 366.7285 prepare_outputs: 551.9373 to_cpu: 85.7948 [2023-03-11 15:13:28,451][22439] Learner 0 profile tree view: misc: 0.0862, prepare_batch: 88.0623 train: 1152.2682 epoch_init: 0.3731, minibatch_init: 11.5259, losses_postprocess: 11.7801, kl_divergence: 4.2021, after_optimizer: 4.7755 calculate_losses: 475.2973 losses_init: 0.3687, forward_head: 234.5272, bptt_initial: 1.1882, bptt: 1.2986, tail: 112.2399, advantages_returns: 8.5681, losses: 103.2818 update: 628.9850 clip: 55.1097 [2023-03-11 15:13:28,451][22439] RolloutWorker_w0 profile tree view: wait_for_trajectories: 2.6896, enqueue_policy_requests: 124.8022, env_step: 5628.1247, overhead: 303.4566, complete_rollouts: 3.1604 save_policy_outputs: 321.0445 split_output_tensors: 158.1904 [2023-03-11 15:13:28,451][22439] RolloutWorker_w7 profile tree view: wait_for_trajectories: 2.6984, enqueue_policy_requests: 126.0381, env_step: 5587.9969, overhead: 304.7413, complete_rollouts: 3.3584 save_policy_outputs: 326.4844 split_output_tensors: 160.0915 [2023-03-11 15:13:28,452][22439] Loop Runner_EvtLoop terminating... [2023-03-11 15:13:28,452][22439] Runner profile tree view: main_loop: 8650.0125 [2023-03-11 15:13:28,452][22439] Collected {0: 100007936}, FPS: 11561.6