[2023-03-08 08:19:06,353][367454] Saving configuration to /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/config.json... [2023-03-08 08:19:06,368][367454] Rollout worker 0 uses device cpu [2023-03-08 08:19:06,369][367454] Rollout worker 1 uses device cpu [2023-03-08 08:19:06,369][367454] Rollout worker 2 uses device cpu [2023-03-08 08:19:06,369][367454] Rollout worker 3 uses device cpu [2023-03-08 08:19:06,369][367454] Rollout worker 4 uses device cpu [2023-03-08 08:19:06,369][367454] Rollout worker 5 uses device cpu [2023-03-08 08:19:06,369][367454] Rollout worker 6 uses device cpu [2023-03-08 08:19:06,370][367454] Rollout worker 7 uses device cpu [2023-03-08 08:19:06,370][367454] In synchronous mode, we only accumulate one batch. Setting num_batches_to_accumulate to 1 [2023-03-08 08:19:06,380][367454] InferenceWorker_p0-w0: min num requests: 2 [2023-03-08 08:19:06,396][367454] Starting all processes... [2023-03-08 08:19:06,397][367454] Starting process learner_proc0 [2023-03-08 08:19:06,446][367454] Starting all processes... [2023-03-08 08:19:06,490][367454] Starting process inference_proc0-0 [2023-03-08 08:19:06,491][367454] Starting process rollout_proc0 [2023-03-08 08:19:06,491][367454] Starting process rollout_proc1 [2023-03-08 08:19:06,491][367454] Starting process rollout_proc2 [2023-03-08 08:19:06,492][367454] Starting process rollout_proc3 [2023-03-08 08:19:06,492][367454] Starting process rollout_proc4 [2023-03-08 08:19:06,492][367454] Starting process rollout_proc5 [2023-03-08 08:19:06,492][367454] Starting process rollout_proc6 [2023-03-08 08:19:06,492][367454] Starting process rollout_proc7 [2023-03-08 08:19:07,913][367693] Starting seed is not provided [2023-03-08 08:19:07,913][367693] Initializing actor-critic model on device cpu [2023-03-08 08:19:07,913][367693] RunningMeanStd input shape: (39,) [2023-03-08 08:19:07,914][367693] RunningMeanStd input shape: (1,) [2023-03-08 08:19:07,988][367693] Created Actor Critic model with architecture: [2023-03-08 08:19:07,988][367693] ActorCriticSharedWeights( (obs_normalizer): ObservationNormalizer( (running_mean_std): RunningMeanStdDictInPlace( (running_mean_std): ModuleDict( (obs): RunningMeanStdInPlace() ) ) ) (returns_normalizer): RecursiveScriptModule(original_name=RunningMeanStdInPlace) (encoder): MultiInputEncoder( (encoders): ModuleDict( (obs): MlpEncoder( (mlp_head): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Linear) (1): RecursiveScriptModule(original_name=Tanh) (2): RecursiveScriptModule(original_name=Linear) (3): RecursiveScriptModule(original_name=Tanh) ) ) ) ) (core): ModelCoreIdentity() (decoder): MlpDecoder( (mlp): Identity() ) (critic_linear): Linear(in_features=64, out_features=1, bias=True) (action_parameterization): ActionParameterizationContinuousNonAdaptiveStddev( (distribution_linear): Linear(in_features=64, out_features=4, bias=True) ) ) [2023-03-08 08:19:07,989][367739] Worker 2 uses CPU cores [8, 9, 10, 11] [2023-03-08 08:19:08,034][367744] Worker 4 uses CPU cores [16, 17, 18, 19] [2023-03-08 08:19:08,175][367741] Worker 7 uses CPU cores [28, 29, 30, 31] [2023-03-08 08:19:08,300][367693] Using optimizer [2023-03-08 08:19:08,301][367693] No checkpoints found [2023-03-08 08:19:08,301][367693] Did not load from checkpoint, starting from scratch! [2023-03-08 08:19:08,301][367693] Initialized policy 0 weights for model version 0 [2023-03-08 08:19:08,302][367693] LearnerWorker_p0 finished initialization! [2023-03-08 08:19:08,302][367737] RunningMeanStd input shape: (39,) [2023-03-08 08:19:08,303][367737] RunningMeanStd input shape: (1,) [2023-03-08 08:19:08,358][367454] Inference worker 0-0 is ready! [2023-03-08 08:19:08,359][367454] All inference workers are ready! Signal rollout workers to start! [2023-03-08 08:19:08,394][367742] Worker 1 uses CPU cores [4, 5, 6, 7] [2023-03-08 08:19:08,443][367743] Worker 0 uses CPU cores [0, 1, 2, 3] [2023-03-08 08:19:08,569][367745] Worker 5 uses CPU cores [20, 21, 22, 23] [2023-03-08 08:19:08,581][367740] Worker 3 uses CPU cores [12, 13, 14, 15] [2023-03-08 08:19:08,723][367738] Worker 6 uses CPU cores [24, 25, 26, 27] [2023-03-08 08:19:09,272][367454] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 0. Throughput: 0: nan. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-08 08:19:11,940][367744] Decorrelating experience for 0 frames... [2023-03-08 08:19:11,945][367739] Decorrelating experience for 0 frames... [2023-03-08 08:19:11,950][367741] Decorrelating experience for 0 frames... [2023-03-08 08:19:11,952][367744] Decorrelating experience for 64 frames... [2023-03-08 08:19:11,957][367739] Decorrelating experience for 64 frames... [2023-03-08 08:19:11,962][367741] Decorrelating experience for 64 frames... [2023-03-08 08:19:11,985][367744] Decorrelating experience for 128 frames... [2023-03-08 08:19:11,990][367739] Decorrelating experience for 128 frames... [2023-03-08 08:19:11,995][367741] Decorrelating experience for 128 frames... [2023-03-08 08:19:12,038][367744] Decorrelating experience for 192 frames... [2023-03-08 08:19:12,042][367739] Decorrelating experience for 192 frames... [2023-03-08 08:19:12,047][367741] Decorrelating experience for 192 frames... [2023-03-08 08:19:12,059][367742] Decorrelating experience for 0 frames... [2023-03-08 08:19:12,064][367743] Decorrelating experience for 0 frames... [2023-03-08 08:19:12,071][367742] Decorrelating experience for 64 frames... [2023-03-08 08:19:12,076][367743] Decorrelating experience for 64 frames... [2023-03-08 08:19:12,103][367742] Decorrelating experience for 128 frames... [2023-03-08 08:19:12,109][367743] Decorrelating experience for 128 frames... [2023-03-08 08:19:12,155][367742] Decorrelating experience for 192 frames... [2023-03-08 08:19:12,161][367743] Decorrelating experience for 192 frames... [2023-03-08 08:19:12,182][367740] Decorrelating experience for 0 frames... [2023-03-08 08:19:12,194][367740] Decorrelating experience for 64 frames... [2023-03-08 08:19:12,209][367745] Decorrelating experience for 0 frames... [2023-03-08 08:19:12,221][367745] Decorrelating experience for 64 frames... [2023-03-08 08:19:12,227][367740] Decorrelating experience for 128 frames... [2023-03-08 08:19:12,253][367745] Decorrelating experience for 128 frames... [2023-03-08 08:19:12,280][367740] Decorrelating experience for 192 frames... [2023-03-08 08:19:12,306][367745] Decorrelating experience for 192 frames... [2023-03-08 08:19:12,320][367738] Decorrelating experience for 0 frames... [2023-03-08 08:19:12,332][367738] Decorrelating experience for 64 frames... [2023-03-08 08:19:12,365][367738] Decorrelating experience for 128 frames... [2023-03-08 08:19:12,417][367738] Decorrelating experience for 192 frames... [2023-03-08 08:19:14,272][367454] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-08 08:19:15,593][367744] Decorrelating experience for 256 frames... [2023-03-08 08:19:15,608][367739] Decorrelating experience for 256 frames... [2023-03-08 08:19:15,615][367741] Decorrelating experience for 256 frames... [2023-03-08 08:19:15,687][367744] Decorrelating experience for 320 frames... [2023-03-08 08:19:15,703][367739] Decorrelating experience for 320 frames... [2023-03-08 08:19:15,709][367741] Decorrelating experience for 320 frames... [2023-03-08 08:19:15,715][367742] Decorrelating experience for 256 frames... [2023-03-08 08:19:15,730][367743] Decorrelating experience for 256 frames... [2023-03-08 08:19:15,800][367744] Decorrelating experience for 384 frames... [2023-03-08 08:19:15,808][367742] Decorrelating experience for 320 frames... [2023-03-08 08:19:15,818][367739] Decorrelating experience for 384 frames... [2023-03-08 08:19:15,823][367741] Decorrelating experience for 384 frames... [2023-03-08 08:19:15,823][367743] Decorrelating experience for 320 frames... [2023-03-08 08:19:15,847][367740] Decorrelating experience for 256 frames... [2023-03-08 08:19:15,864][367745] Decorrelating experience for 256 frames... [2023-03-08 08:19:15,920][367742] Decorrelating experience for 384 frames... [2023-03-08 08:19:15,934][367744] Decorrelating experience for 448 frames... [2023-03-08 08:19:15,936][367743] Decorrelating experience for 384 frames... [2023-03-08 08:19:15,938][367740] Decorrelating experience for 320 frames... [2023-03-08 08:19:15,952][367739] Decorrelating experience for 448 frames... [2023-03-08 08:19:15,956][367745] Decorrelating experience for 320 frames... [2023-03-08 08:19:15,957][367741] Decorrelating experience for 448 frames... [2023-03-08 08:19:15,976][367738] Decorrelating experience for 256 frames... [2023-03-08 08:19:16,050][367740] Decorrelating experience for 384 frames... [2023-03-08 08:19:16,056][367742] Decorrelating experience for 448 frames... [2023-03-08 08:19:16,068][367743] Decorrelating experience for 448 frames... [2023-03-08 08:19:16,069][367738] Decorrelating experience for 320 frames... [2023-03-08 08:19:16,070][367745] Decorrelating experience for 384 frames... [2023-03-08 08:19:16,181][367740] Decorrelating experience for 448 frames... [2023-03-08 08:19:16,183][367738] Decorrelating experience for 384 frames... [2023-03-08 08:19:16,201][367745] Decorrelating experience for 448 frames... [2023-03-08 08:19:16,316][367738] Decorrelating experience for 448 frames... [2023-03-08 08:19:19,271][367454] Fps is (10 sec: 2867.2, 60 sec: 2867.2, 300 sec: 2867.2). Total num frames: 28672. Throughput: 0: 820.0. Samples: 8200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:19:19,272][367454] Avg episode reward: [(0, '900.378')] [2023-03-08 08:19:19,300][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000000064_32768.pth... [2023-03-08 08:19:19,895][367737] Updated weights for policy 0, policy_version 80 (0.0005) [2023-03-08 08:19:23,087][367737] Updated weights for policy 0, policy_version 160 (0.0005) [2023-03-08 08:19:24,271][367454] Fps is (10 sec: 9420.8, 60 sec: 6280.6, 300 sec: 6280.6). Total num frames: 94208. Throughput: 0: 5735.0. Samples: 86024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:19:24,272][367454] Avg episode reward: [(0, '2216.848')] [2023-03-08 08:19:26,271][367737] Updated weights for policy 0, policy_version 240 (0.0005) [2023-03-08 08:19:26,376][367454] Heartbeat connected on Batcher_0 [2023-03-08 08:19:26,378][367454] Heartbeat connected on LearnerWorker_p0 [2023-03-08 08:19:26,381][367454] Heartbeat connected on InferenceWorker_p0-w0 [2023-03-08 08:19:26,385][367454] Heartbeat connected on RolloutWorker_w0 [2023-03-08 08:19:26,387][367454] Heartbeat connected on RolloutWorker_w1 [2023-03-08 08:19:26,389][367454] Heartbeat connected on RolloutWorker_w2 [2023-03-08 08:19:26,391][367454] Heartbeat connected on RolloutWorker_w3 [2023-03-08 08:19:26,392][367454] Heartbeat connected on RolloutWorker_w4 [2023-03-08 08:19:26,394][367454] Heartbeat connected on RolloutWorker_w5 [2023-03-08 08:19:26,396][367454] Heartbeat connected on RolloutWorker_w6 [2023-03-08 08:19:26,398][367454] Heartbeat connected on RolloutWorker_w7 [2023-03-08 08:19:29,272][367454] Fps is (10 sec: 13107.1, 60 sec: 7987.2, 300 sec: 7987.2). Total num frames: 159744. Throughput: 0: 6219.0. Samples: 124380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:19:29,272][367454] Avg episode reward: [(0, '2548.227')] [2023-03-08 08:19:29,273][367693] Saving new best policy, reward=2548.227! [2023-03-08 08:19:29,451][367737] Updated weights for policy 0, policy_version 320 (0.0005) [2023-03-08 08:19:32,482][367737] Updated weights for policy 0, policy_version 400 (0.0004) [2023-03-08 08:19:34,272][367454] Fps is (10 sec: 13516.7, 60 sec: 9175.0, 300 sec: 9175.0). Total num frames: 229376. Throughput: 0: 8142.7. Samples: 203568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:19:34,272][367454] Avg episode reward: [(0, '2535.428')] [2023-03-08 08:19:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000000448_229376.pth... [2023-03-08 08:19:35,384][367737] Updated weights for policy 0, policy_version 480 (0.0004) [2023-03-08 08:19:38,257][367737] Updated weights for policy 0, policy_version 560 (0.0004) [2023-03-08 08:19:39,272][367454] Fps is (10 sec: 13926.4, 60 sec: 9966.9, 300 sec: 9966.9). Total num frames: 299008. Throughput: 0: 9612.5. Samples: 288376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:19:39,272][367454] Avg episode reward: [(0, '2734.851')] [2023-03-08 08:19:39,272][367693] Saving new best policy, reward=2734.851! [2023-03-08 08:19:41,200][367737] Updated weights for policy 0, policy_version 640 (0.0004) [2023-03-08 08:19:44,202][367737] Updated weights for policy 0, policy_version 720 (0.0004) [2023-03-08 08:19:44,272][367454] Fps is (10 sec: 13926.4, 60 sec: 10532.6, 300 sec: 10532.6). Total num frames: 368640. Throughput: 0: 9445.8. Samples: 330604. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:19:44,272][367454] Avg episode reward: [(0, '3571.339')] [2023-03-08 08:19:44,272][367693] Saving new best policy, reward=3571.339! [2023-03-08 08:19:47,161][367737] Updated weights for policy 0, policy_version 800 (0.0004) [2023-03-08 08:19:49,271][367454] Fps is (10 sec: 13516.8, 60 sec: 10854.4, 300 sec: 10854.4). Total num frames: 434176. Throughput: 0: 10324.6. Samples: 412984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:19:49,272][367454] Avg episode reward: [(0, '3834.346')] [2023-03-08 08:19:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000000856_438272.pth... [2023-03-08 08:19:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000000064_32768.pth [2023-03-08 08:19:49,277][367693] Saving new best policy, reward=3834.346! [2023-03-08 08:19:50,210][367737] Updated weights for policy 0, policy_version 880 (0.0004) [2023-03-08 08:19:53,599][367737] Updated weights for policy 0, policy_version 960 (0.0005) [2023-03-08 08:19:54,271][367454] Fps is (10 sec: 12697.7, 60 sec: 11013.7, 300 sec: 11013.7). Total num frames: 495616. Throughput: 0: 10875.2. Samples: 489384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:19:54,272][367454] Avg episode reward: [(0, '3549.413')] [2023-03-08 08:19:57,063][367737] Updated weights for policy 0, policy_version 1040 (0.0005) [2023-03-08 08:19:59,271][367454] Fps is (10 sec: 12288.0, 60 sec: 11141.1, 300 sec: 11141.1). Total num frames: 557056. Throughput: 0: 11652.5. Samples: 524360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:19:59,272][367454] Avg episode reward: [(0, '3798.012')] [2023-03-08 08:20:00,566][367737] Updated weights for policy 0, policy_version 1120 (0.0005) [2023-03-08 08:20:04,272][367454] Fps is (10 sec: 11468.6, 60 sec: 11096.4, 300 sec: 11096.4). Total num frames: 610304. Throughput: 0: 13016.1. Samples: 593928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:20:04,272][367454] Avg episode reward: [(0, '3756.698')] [2023-03-08 08:20:04,306][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000001200_614400.pth... [2023-03-08 08:20:04,307][367737] Updated weights for policy 0, policy_version 1200 (0.0005) [2023-03-08 08:20:04,308][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000000448_229376.pth [2023-03-08 08:20:07,960][367737] Updated weights for policy 0, policy_version 1280 (0.0005) [2023-03-08 08:20:09,271][367454] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11127.5). Total num frames: 667648. Throughput: 0: 12757.2. Samples: 660096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:20:09,282][367454] Avg episode reward: [(0, '3746.181')] [2023-03-08 08:20:11,417][367737] Updated weights for policy 0, policy_version 1360 (0.0005) [2023-03-08 08:20:14,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12151.4, 300 sec: 11216.7). Total num frames: 729088. Throughput: 0: 12709.9. Samples: 696328. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:20:14,283][367454] Avg episode reward: [(0, '3976.359')] [2023-03-08 08:20:14,283][367693] Saving new best policy, reward=3976.359! [2023-03-08 08:20:14,790][367737] Updated weights for policy 0, policy_version 1440 (0.0004) [2023-03-08 08:20:18,136][367737] Updated weights for policy 0, policy_version 1520 (0.0004) [2023-03-08 08:20:19,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12697.6, 300 sec: 11293.3). Total num frames: 790528. Throughput: 0: 12586.7. Samples: 769968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:20:19,283][367454] Avg episode reward: [(0, '3698.917')] [2023-03-08 08:20:19,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000001544_790528.pth... [2023-03-08 08:20:19,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000000856_438272.pth [2023-03-08 08:20:21,623][367737] Updated weights for policy 0, policy_version 1600 (0.0004) [2023-03-08 08:20:24,272][367454] Fps is (10 sec: 11878.6, 60 sec: 12561.1, 300 sec: 11305.0). Total num frames: 847872. Throughput: 0: 12257.0. Samples: 839940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:20:24,282][367454] Avg episode reward: [(0, '4087.604')] [2023-03-08 08:20:24,283][367693] Saving new best policy, reward=4087.604! [2023-03-08 08:20:25,101][367737] Updated weights for policy 0, policy_version 1680 (0.0004) [2023-03-08 08:20:28,491][367737] Updated weights for policy 0, policy_version 1760 (0.0004) [2023-03-08 08:20:29,272][367454] Fps is (10 sec: 11878.5, 60 sec: 12492.8, 300 sec: 11366.4). Total num frames: 909312. Throughput: 0: 12126.8. Samples: 876308. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:20:29,283][367454] Avg episode reward: [(0, '4171.568')] [2023-03-08 08:20:29,283][367693] Saving new best policy, reward=4171.568! [2023-03-08 08:20:31,916][367737] Updated weights for policy 0, policy_version 1840 (0.0004) [2023-03-08 08:20:34,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12356.3, 300 sec: 11420.6). Total num frames: 970752. Throughput: 0: 11889.7. Samples: 948020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:20:34,283][367454] Avg episode reward: [(0, '3937.923')] [2023-03-08 08:20:34,285][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000001896_970752.pth... [2023-03-08 08:20:34,287][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000001200_614400.pth [2023-03-08 08:20:35,319][367737] Updated weights for policy 0, policy_version 1920 (0.0004) [2023-03-08 08:20:38,801][367737] Updated weights for policy 0, policy_version 2000 (0.0005) [2023-03-08 08:20:39,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11423.3). Total num frames: 1028096. Throughput: 0: 11775.1. Samples: 1019264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:20:39,272][367454] Avg episode reward: [(0, '4066.246')] [2023-03-08 08:20:42,157][367737] Updated weights for policy 0, policy_version 2080 (0.0004) [2023-03-08 08:20:44,271][367454] Fps is (10 sec: 11878.5, 60 sec: 12015.0, 300 sec: 11468.8). Total num frames: 1089536. Throughput: 0: 11825.6. Samples: 1056512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:20:44,272][367454] Avg episode reward: [(0, '4139.865')] [2023-03-08 08:20:45,608][367737] Updated weights for policy 0, policy_version 2160 (0.0004) [2023-03-08 08:20:48,949][367737] Updated weights for policy 0, policy_version 2240 (0.0004) [2023-03-08 08:20:49,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11509.8). Total num frames: 1150976. Throughput: 0: 11862.7. Samples: 1127748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:20:49,272][367454] Avg episode reward: [(0, '4234.162')] [2023-03-08 08:20:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000002248_1150976.pth... [2023-03-08 08:20:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000001544_790528.pth [2023-03-08 08:20:49,278][367693] Saving new best policy, reward=4234.162! [2023-03-08 08:20:52,195][367737] Updated weights for policy 0, policy_version 2320 (0.0003) [2023-03-08 08:20:54,272][367454] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 11546.8). Total num frames: 1212416. Throughput: 0: 12051.3. Samples: 1202404. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:20:54,272][367454] Avg episode reward: [(0, '4168.756')] [2023-03-08 08:20:55,534][367737] Updated weights for policy 0, policy_version 2400 (0.0004) [2023-03-08 08:20:59,064][367737] Updated weights for policy 0, policy_version 2480 (0.0005) [2023-03-08 08:20:59,271][367454] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11543.3). Total num frames: 1269760. Throughput: 0: 12072.6. Samples: 1239592. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:20:59,272][367454] Avg episode reward: [(0, '4130.458')] [2023-03-08 08:21:02,621][367737] Updated weights for policy 0, policy_version 2560 (0.0005) [2023-03-08 08:21:04,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11540.0). Total num frames: 1327104. Throughput: 0: 11954.6. Samples: 1307924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:21:04,272][367454] Avg episode reward: [(0, '4256.347')] [2023-03-08 08:21:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000002592_1327104.pth... [2023-03-08 08:21:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000001896_970752.pth [2023-03-08 08:21:04,278][367693] Saving new best policy, reward=4256.347! [2023-03-08 08:21:06,176][367737] Updated weights for policy 0, policy_version 2640 (0.0005) [2023-03-08 08:21:09,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11537.1). Total num frames: 1384448. Throughput: 0: 11918.4. Samples: 1376268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:21:09,272][367454] Avg episode reward: [(0, '4014.934')] [2023-03-08 08:21:09,843][367737] Updated weights for policy 0, policy_version 2720 (0.0005) [2023-03-08 08:21:13,467][367737] Updated weights for policy 0, policy_version 2800 (0.0005) [2023-03-08 08:21:14,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11534.3). Total num frames: 1441792. Throughput: 0: 11864.5. Samples: 1410212. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:21:14,272][367454] Avg episode reward: [(0, '4038.488')] [2023-03-08 08:21:16,793][367737] Updated weights for policy 0, policy_version 2880 (0.0004) [2023-03-08 08:21:19,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 11563.3). Total num frames: 1503232. Throughput: 0: 11875.6. Samples: 1482424. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 08:21:19,272][367454] Avg episode reward: [(0, '4241.368')] [2023-03-08 08:21:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000002936_1503232.pth... [2023-03-08 08:21:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000002248_1150976.pth [2023-03-08 08:21:20,143][367737] Updated weights for policy 0, policy_version 2960 (0.0004) [2023-03-08 08:21:23,462][367737] Updated weights for policy 0, policy_version 3040 (0.0004) [2023-03-08 08:21:24,271][367454] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11590.2). Total num frames: 1564672. Throughput: 0: 11928.0. Samples: 1556024. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 08:21:24,272][367454] Avg episode reward: [(0, '4297.994')] [2023-03-08 08:21:24,272][367693] Saving new best policy, reward=4297.994! [2023-03-08 08:21:26,727][367737] Updated weights for policy 0, policy_version 3120 (0.0004) [2023-03-08 08:21:29,272][367454] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11615.1). Total num frames: 1626112. Throughput: 0: 11931.0. Samples: 1593408. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:21:29,272][367454] Avg episode reward: [(0, '4187.470')] [2023-03-08 08:21:30,047][367737] Updated weights for policy 0, policy_version 3200 (0.0004) [2023-03-08 08:21:33,286][367737] Updated weights for policy 0, policy_version 3280 (0.0004) [2023-03-08 08:21:34,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11666.5). Total num frames: 1691648. Throughput: 0: 12006.6. Samples: 1668044. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:21:34,272][367454] Avg episode reward: [(0, '3924.323')] [2023-03-08 08:21:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000003304_1691648.pth... [2023-03-08 08:21:34,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000002592_1327104.pth [2023-03-08 08:21:36,543][367737] Updated weights for policy 0, policy_version 3360 (0.0004) [2023-03-08 08:21:39,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12014.9, 300 sec: 11660.0). Total num frames: 1748992. Throughput: 0: 11994.9. Samples: 1742176. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:21:39,272][367454] Avg episode reward: [(0, '4287.842')] [2023-03-08 08:21:40,036][367737] Updated weights for policy 0, policy_version 3440 (0.0005) [2023-03-08 08:21:43,456][367737] Updated weights for policy 0, policy_version 3520 (0.0004) [2023-03-08 08:21:44,271][367454] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11680.2). Total num frames: 1810432. Throughput: 0: 11958.8. Samples: 1777736. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 08:21:44,272][367454] Avg episode reward: [(0, '4295.298')] [2023-03-08 08:21:46,982][367737] Updated weights for policy 0, policy_version 3600 (0.0005) [2023-03-08 08:21:49,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11673.6). Total num frames: 1867776. Throughput: 0: 11990.6. Samples: 1847500. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:21:49,272][367454] Avg episode reward: [(0, '4335.889')] [2023-03-08 08:21:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000003648_1867776.pth... [2023-03-08 08:21:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000002936_1503232.pth [2023-03-08 08:21:49,278][367693] Saving new best policy, reward=4335.889! [2023-03-08 08:21:50,517][367737] Updated weights for policy 0, policy_version 3680 (0.0005) [2023-03-08 08:21:54,036][367737] Updated weights for policy 0, policy_version 3760 (0.0005) [2023-03-08 08:21:54,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11667.4). Total num frames: 1925120. Throughput: 0: 12023.9. Samples: 1917344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:21:54,272][367454] Avg episode reward: [(0, '4353.595')] [2023-03-08 08:21:54,272][367693] Saving new best policy, reward=4353.595! [2023-03-08 08:21:57,425][367737] Updated weights for policy 0, policy_version 3840 (0.0005) [2023-03-08 08:21:59,271][367454] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 11685.7). Total num frames: 1986560. Throughput: 0: 12079.7. Samples: 1953800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:21:59,272][367454] Avg episode reward: [(0, '4254.964')] [2023-03-08 08:22:00,835][367737] Updated weights for policy 0, policy_version 3920 (0.0005) [2023-03-08 08:22:04,188][367737] Updated weights for policy 0, policy_version 4000 (0.0005) [2023-03-08 08:22:04,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12014.9, 300 sec: 11702.9). Total num frames: 2048000. Throughput: 0: 12091.9. Samples: 2026560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:22:04,272][367454] Avg episode reward: [(0, '4305.015')] [2023-03-08 08:22:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000004000_2048000.pth... [2023-03-08 08:22:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000003304_1691648.pth [2023-03-08 08:22:07,628][367737] Updated weights for policy 0, policy_version 4080 (0.0005) [2023-03-08 08:22:09,272][367454] Fps is (10 sec: 11878.3, 60 sec: 12014.9, 300 sec: 11696.4). Total num frames: 2105344. Throughput: 0: 12046.0. Samples: 2098096. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:22:09,272][367454] Avg episode reward: [(0, '4234.462')] [2023-03-08 08:22:11,228][367737] Updated weights for policy 0, policy_version 4160 (0.0005) [2023-03-08 08:22:14,272][367454] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11690.2). Total num frames: 2162688. Throughput: 0: 11964.6. Samples: 2131816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:22:14,272][367454] Avg episode reward: [(0, '4328.525')] [2023-03-08 08:22:14,780][367737] Updated weights for policy 0, policy_version 4240 (0.0005) [2023-03-08 08:22:18,318][367737] Updated weights for policy 0, policy_version 4320 (0.0005) [2023-03-08 08:22:19,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11946.7, 300 sec: 11684.4). Total num frames: 2220032. Throughput: 0: 11834.4. Samples: 2200592. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:22:19,272][367454] Avg episode reward: [(0, '4305.400')] [2023-03-08 08:22:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000004336_2220032.pth... [2023-03-08 08:22:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000003648_1867776.pth [2023-03-08 08:22:21,966][367737] Updated weights for policy 0, policy_version 4400 (0.0005) [2023-03-08 08:22:24,272][367454] Fps is (10 sec: 11468.9, 60 sec: 11878.4, 300 sec: 11678.9). Total num frames: 2277376. Throughput: 0: 11712.7. Samples: 2269248. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:22:24,272][367454] Avg episode reward: [(0, '3794.063')] [2023-03-08 08:22:25,506][367737] Updated weights for policy 0, policy_version 4480 (0.0005) [2023-03-08 08:22:29,191][367737] Updated weights for policy 0, policy_version 4560 (0.0005) [2023-03-08 08:22:29,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11673.6). Total num frames: 2334720. Throughput: 0: 11683.5. Samples: 2303496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:22:29,272][367454] Avg episode reward: [(0, '4321.142')] [2023-03-08 08:22:32,741][367737] Updated weights for policy 0, policy_version 4640 (0.0005) [2023-03-08 08:22:34,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11668.6). Total num frames: 2392064. Throughput: 0: 11647.9. Samples: 2371656. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:22:34,272][367454] Avg episode reward: [(0, '4164.603')] [2023-03-08 08:22:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000004672_2392064.pth... [2023-03-08 08:22:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000004000_2048000.pth [2023-03-08 08:22:36,325][367737] Updated weights for policy 0, policy_version 4720 (0.0005) [2023-03-08 08:22:39,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11663.8). Total num frames: 2449408. Throughput: 0: 11630.3. Samples: 2440708. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:22:39,272][367454] Avg episode reward: [(0, '4292.648')] [2023-03-08 08:22:39,919][367737] Updated weights for policy 0, policy_version 4800 (0.0005) [2023-03-08 08:22:43,517][367737] Updated weights for policy 0, policy_version 4880 (0.0005) [2023-03-08 08:22:44,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11659.3). Total num frames: 2506752. Throughput: 0: 11561.4. Samples: 2474064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:22:44,272][367454] Avg episode reward: [(0, '3832.165')] [2023-03-08 08:22:47,157][367737] Updated weights for policy 0, policy_version 4960 (0.0005) [2023-03-08 08:22:49,272][367454] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11636.4). Total num frames: 2560000. Throughput: 0: 11469.0. Samples: 2542664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:22:49,272][367454] Avg episode reward: [(0, '3715.194')] [2023-03-08 08:22:49,310][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000005008_2564096.pth... [2023-03-08 08:22:49,311][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000004336_2220032.pth [2023-03-08 08:22:50,777][367737] Updated weights for policy 0, policy_version 5040 (0.0005) [2023-03-08 08:22:54,272][367454] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11632.6). Total num frames: 2617344. Throughput: 0: 11367.3. Samples: 2609624. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:22:54,272][367454] Avg episode reward: [(0, '4003.221')] [2023-03-08 08:22:54,467][367737] Updated weights for policy 0, policy_version 5120 (0.0005) [2023-03-08 08:22:58,026][367737] Updated weights for policy 0, policy_version 5200 (0.0005) [2023-03-08 08:22:59,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11629.1). Total num frames: 2674688. Throughput: 0: 11374.0. Samples: 2643644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:22:59,272][367454] Avg episode reward: [(0, '3999.934')] [2023-03-08 08:23:01,664][367737] Updated weights for policy 0, policy_version 5280 (0.0005) [2023-03-08 08:23:04,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11400.5, 300 sec: 11625.7). Total num frames: 2732032. Throughput: 0: 11354.8. Samples: 2711560. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:23:04,272][367454] Avg episode reward: [(0, '4099.148')] [2023-03-08 08:23:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000005336_2732032.pth... [2023-03-08 08:23:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000004672_2392064.pth [2023-03-08 08:23:05,243][367737] Updated weights for policy 0, policy_version 5360 (0.0005) [2023-03-08 08:23:08,838][367737] Updated weights for policy 0, policy_version 5440 (0.0005) [2023-03-08 08:23:09,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11400.5, 300 sec: 11622.4). Total num frames: 2789376. Throughput: 0: 11369.0. Samples: 2780852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:23:09,272][367454] Avg episode reward: [(0, '3889.254')] [2023-03-08 08:23:12,422][367737] Updated weights for policy 0, policy_version 5520 (0.0005) [2023-03-08 08:23:14,272][367454] Fps is (10 sec: 11468.9, 60 sec: 11400.5, 300 sec: 11619.3). Total num frames: 2846720. Throughput: 0: 11358.9. Samples: 2814648. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:23:14,272][367454] Avg episode reward: [(0, '4226.685')] [2023-03-08 08:23:16,051][367737] Updated weights for policy 0, policy_version 5600 (0.0005) [2023-03-08 08:23:19,272][367454] Fps is (10 sec: 11059.1, 60 sec: 11332.3, 300 sec: 11599.9). Total num frames: 2899968. Throughput: 0: 11356.9. Samples: 2882716. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:23:19,272][367454] Avg episode reward: [(0, '4066.882')] [2023-03-08 08:23:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000005664_2899968.pth... [2023-03-08 08:23:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000005008_2564096.pth [2023-03-08 08:23:19,771][367737] Updated weights for policy 0, policy_version 5680 (0.0005) [2023-03-08 08:23:23,374][367737] Updated weights for policy 0, policy_version 5760 (0.0005) [2023-03-08 08:23:24,272][367454] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 11597.3). Total num frames: 2957312. Throughput: 0: 11299.6. Samples: 2949192. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:23:24,272][367454] Avg episode reward: [(0, '4302.294')] [2023-03-08 08:23:27,021][367737] Updated weights for policy 0, policy_version 5840 (0.0005) [2023-03-08 08:23:29,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11594.8). Total num frames: 3014656. Throughput: 0: 11309.5. Samples: 2982992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:23:29,272][367454] Avg episode reward: [(0, '4318.953')] [2023-03-08 08:23:30,610][367737] Updated weights for policy 0, policy_version 5920 (0.0005) [2023-03-08 08:23:34,112][367737] Updated weights for policy 0, policy_version 6000 (0.0005) [2023-03-08 08:23:34,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11332.3, 300 sec: 11592.5). Total num frames: 3072000. Throughput: 0: 11308.1. Samples: 3051528. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:23:34,272][367454] Avg episode reward: [(0, '4137.842')] [2023-03-08 08:23:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000006000_3072000.pth... [2023-03-08 08:23:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000005336_2732032.pth [2023-03-08 08:23:37,671][367737] Updated weights for policy 0, policy_version 6080 (0.0005) [2023-03-08 08:23:39,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11332.3, 300 sec: 11590.2). Total num frames: 3129344. Throughput: 0: 11368.7. Samples: 3121216. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:23:39,272][367454] Avg episode reward: [(0, '4291.682')] [2023-03-08 08:23:41,241][367737] Updated weights for policy 0, policy_version 6160 (0.0005) [2023-03-08 08:23:44,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11588.0). Total num frames: 3186688. Throughput: 0: 11379.6. Samples: 3155728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:23:44,272][367454] Avg episode reward: [(0, '4228.600')] [2023-03-08 08:23:44,851][367737] Updated weights for policy 0, policy_version 6240 (0.0005) [2023-03-08 08:23:48,459][367737] Updated weights for policy 0, policy_version 6320 (0.0005) [2023-03-08 08:23:49,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11400.5, 300 sec: 11585.8). Total num frames: 3244032. Throughput: 0: 11382.8. Samples: 3223788. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:23:49,272][367454] Avg episode reward: [(0, '3977.568')] [2023-03-08 08:23:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000006336_3244032.pth... [2023-03-08 08:23:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000005664_2899968.pth [2023-03-08 08:23:51,947][367737] Updated weights for policy 0, policy_version 6400 (0.0005) [2023-03-08 08:23:54,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11583.8). Total num frames: 3301376. Throughput: 0: 11386.7. Samples: 3293256. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:23:54,272][367454] Avg episode reward: [(0, '3798.000')] [2023-03-08 08:23:55,530][367737] Updated weights for policy 0, policy_version 6480 (0.0005) [2023-03-08 08:23:58,981][367737] Updated weights for policy 0, policy_version 6560 (0.0004) [2023-03-08 08:23:59,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11581.8). Total num frames: 3358720. Throughput: 0: 11406.6. Samples: 3327944. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:23:59,272][367454] Avg episode reward: [(0, '3703.493')] [2023-03-08 08:24:02,261][367737] Updated weights for policy 0, policy_version 6640 (0.0004) [2023-03-08 08:24:04,272][367454] Fps is (10 sec: 12287.9, 60 sec: 11537.1, 300 sec: 11607.6). Total num frames: 3424256. Throughput: 0: 11524.2. Samples: 3401304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:24:04,272][367454] Avg episode reward: [(0, '4027.797')] [2023-03-08 08:24:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000006688_3424256.pth... [2023-03-08 08:24:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000006000_3072000.pth [2023-03-08 08:24:05,552][367737] Updated weights for policy 0, policy_version 6720 (0.0004) [2023-03-08 08:24:08,891][367737] Updated weights for policy 0, policy_version 6800 (0.0005) [2023-03-08 08:24:09,272][367454] Fps is (10 sec: 12697.6, 60 sec: 11605.3, 300 sec: 11815.9). Total num frames: 3485696. Throughput: 0: 11694.9. Samples: 3475464. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:24:09,272][367454] Avg episode reward: [(0, '4012.630')] [2023-03-08 08:24:12,335][367737] Updated weights for policy 0, policy_version 6880 (0.0004) [2023-03-08 08:24:14,271][367454] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11913.1). Total num frames: 3543040. Throughput: 0: 11751.9. Samples: 3511828. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:24:14,272][367454] Avg episode reward: [(0, '4262.636')] [2023-03-08 08:24:15,802][367737] Updated weights for policy 0, policy_version 6960 (0.0004) [2023-03-08 08:24:19,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 11885.3). Total num frames: 3600384. Throughput: 0: 11791.2. Samples: 3582132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:24:19,272][367454] Avg episode reward: [(0, '4118.255')] [2023-03-08 08:24:19,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000007032_3600384.pth... [2023-03-08 08:24:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000006336_3244032.pth [2023-03-08 08:24:19,364][367737] Updated weights for policy 0, policy_version 7040 (0.0005) [2023-03-08 08:24:22,923][367737] Updated weights for policy 0, policy_version 7120 (0.0005) [2023-03-08 08:24:24,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 11857.6). Total num frames: 3657728. Throughput: 0: 11773.1. Samples: 3651008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:24:24,272][367454] Avg episode reward: [(0, '4193.281')] [2023-03-08 08:24:26,466][367737] Updated weights for policy 0, policy_version 7200 (0.0005) [2023-03-08 08:24:29,272][367454] Fps is (10 sec: 11468.6, 60 sec: 11673.6, 300 sec: 11815.9). Total num frames: 3715072. Throughput: 0: 11790.8. Samples: 3686316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:24:29,272][367454] Avg episode reward: [(0, '4047.053')] [2023-03-08 08:24:30,007][367737] Updated weights for policy 0, policy_version 7280 (0.0005) [2023-03-08 08:24:33,398][367737] Updated weights for policy 0, policy_version 7360 (0.0004) [2023-03-08 08:24:34,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11788.1). Total num frames: 3776512. Throughput: 0: 11827.6. Samples: 3756028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:24:34,272][367454] Avg episode reward: [(0, '3968.346')] [2023-03-08 08:24:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000007376_3776512.pth... [2023-03-08 08:24:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000006688_3424256.pth [2023-03-08 08:24:36,717][367737] Updated weights for policy 0, policy_version 7440 (0.0003) [2023-03-08 08:24:39,272][367454] Fps is (10 sec: 12288.1, 60 sec: 11810.1, 300 sec: 11760.4). Total num frames: 3837952. Throughput: 0: 11895.9. Samples: 3828572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:24:39,272][367454] Avg episode reward: [(0, '4169.780')] [2023-03-08 08:24:40,246][367737] Updated weights for policy 0, policy_version 7520 (0.0005) [2023-03-08 08:24:43,802][367737] Updated weights for policy 0, policy_version 7600 (0.0005) [2023-03-08 08:24:44,271][367454] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11732.6). Total num frames: 3895296. Throughput: 0: 11891.6. Samples: 3863064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:24:44,272][367454] Avg episode reward: [(0, '3986.205')] [2023-03-08 08:24:47,290][367737] Updated weights for policy 0, policy_version 7680 (0.0005) [2023-03-08 08:24:49,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11718.7). Total num frames: 3952640. Throughput: 0: 11822.4. Samples: 3933312. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 08:24:49,272][367454] Avg episode reward: [(0, '4182.208')] [2023-03-08 08:24:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000007720_3952640.pth... [2023-03-08 08:24:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000007032_3600384.pth [2023-03-08 08:24:50,821][367737] Updated weights for policy 0, policy_version 7760 (0.0005) [2023-03-08 08:24:54,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11704.8). Total num frames: 4009984. Throughput: 0: 11710.3. Samples: 4002428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:24:54,272][367454] Avg episode reward: [(0, '4199.449')] [2023-03-08 08:24:54,363][367737] Updated weights for policy 0, policy_version 7840 (0.0005) [2023-03-08 08:24:57,794][367737] Updated weights for policy 0, policy_version 7920 (0.0005) [2023-03-08 08:24:59,271][367454] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 11732.6). Total num frames: 4071424. Throughput: 0: 11707.3. Samples: 4038656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:24:59,272][367454] Avg episode reward: [(0, '4143.387')] [2023-03-08 08:25:01,166][367737] Updated weights for policy 0, policy_version 8000 (0.0004) [2023-03-08 08:25:04,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 11746.5). Total num frames: 4132864. Throughput: 0: 11767.5. Samples: 4111672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:25:04,272][367454] Avg episode reward: [(0, '4133.162')] [2023-03-08 08:25:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000008072_4132864.pth... [2023-03-08 08:25:04,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000007376_3776512.pth [2023-03-08 08:25:04,422][367737] Updated weights for policy 0, policy_version 8080 (0.0004) [2023-03-08 08:25:07,465][367737] Updated weights for policy 0, policy_version 8160 (0.0004) [2023-03-08 08:25:09,271][367454] Fps is (10 sec: 12697.6, 60 sec: 11878.4, 300 sec: 11760.4). Total num frames: 4198400. Throughput: 0: 11984.4. Samples: 4190304. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 08:25:09,272][367454] Avg episode reward: [(0, '3138.600')] [2023-03-08 08:25:10,627][367737] Updated weights for policy 0, policy_version 8240 (0.0003) [2023-03-08 08:25:13,745][367737] Updated weights for policy 0, policy_version 8320 (0.0003) [2023-03-08 08:25:14,272][367454] Fps is (10 sec: 13107.2, 60 sec: 12014.9, 300 sec: 11774.3). Total num frames: 4263936. Throughput: 0: 12066.3. Samples: 4229300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:25:14,272][367454] Avg episode reward: [(0, '3288.281')] [2023-03-08 08:25:16,980][367737] Updated weights for policy 0, policy_version 8400 (0.0003) [2023-03-08 08:25:19,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12083.2, 300 sec: 11788.2). Total num frames: 4325376. Throughput: 0: 12212.2. Samples: 4305576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:25:19,272][367454] Avg episode reward: [(0, '3812.357')] [2023-03-08 08:25:19,280][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000008456_4329472.pth... [2023-03-08 08:25:19,282][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000007720_3952640.pth [2023-03-08 08:25:20,272][367737] Updated weights for policy 0, policy_version 8480 (0.0003) [2023-03-08 08:25:23,599][367737] Updated weights for policy 0, policy_version 8560 (0.0003) [2023-03-08 08:25:24,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11788.1). Total num frames: 4386816. Throughput: 0: 12261.9. Samples: 4380356. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:25:24,283][367454] Avg episode reward: [(0, '4118.898')] [2023-03-08 08:25:26,990][367737] Updated weights for policy 0, policy_version 8640 (0.0004) [2023-03-08 08:25:29,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12288.0, 300 sec: 11802.0). Total num frames: 4452352. Throughput: 0: 12295.3. Samples: 4416352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:25:29,282][367454] Avg episode reward: [(0, '4144.119')] [2023-03-08 08:25:30,170][367737] Updated weights for policy 0, policy_version 8720 (0.0003) [2023-03-08 08:25:33,465][367737] Updated weights for policy 0, policy_version 8800 (0.0003) [2023-03-08 08:25:34,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 11815.9). Total num frames: 4513792. Throughput: 0: 12429.7. Samples: 4492648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:25:34,282][367454] Avg episode reward: [(0, '4242.935')] [2023-03-08 08:25:34,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000008816_4513792.pth... [2023-03-08 08:25:34,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000008072_4132864.pth [2023-03-08 08:25:36,795][367737] Updated weights for policy 0, policy_version 8880 (0.0003) [2023-03-08 08:25:39,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 11815.9). Total num frames: 4575232. Throughput: 0: 12527.7. Samples: 4566176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:25:39,272][367454] Avg episode reward: [(0, '4254.181')] [2023-03-08 08:25:40,204][367737] Updated weights for policy 0, policy_version 8960 (0.0003) [2023-03-08 08:25:43,602][367737] Updated weights for policy 0, policy_version 9040 (0.0003) [2023-03-08 08:25:44,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 11802.0). Total num frames: 4632576. Throughput: 0: 12521.1. Samples: 4602108. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:25:44,272][367454] Avg episode reward: [(0, '4293.343')] [2023-03-08 08:25:47,019][367737] Updated weights for policy 0, policy_version 9120 (0.0004) [2023-03-08 08:25:49,272][367454] Fps is (10 sec: 11878.3, 60 sec: 12356.3, 300 sec: 11802.0). Total num frames: 4694016. Throughput: 0: 12487.3. Samples: 4673600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:25:49,272][367454] Avg episode reward: [(0, '4150.145')] [2023-03-08 08:25:49,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000009168_4694016.pth... [2023-03-08 08:25:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000008456_4329472.pth [2023-03-08 08:25:50,624][367737] Updated weights for policy 0, policy_version 9200 (0.0005) [2023-03-08 08:25:54,206][367737] Updated weights for policy 0, policy_version 9280 (0.0005) [2023-03-08 08:25:54,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 11802.0). Total num frames: 4751360. Throughput: 0: 12261.5. Samples: 4742072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:25:54,272][367454] Avg episode reward: [(0, '4302.718')] [2023-03-08 08:25:57,795][367737] Updated weights for policy 0, policy_version 9360 (0.0004) [2023-03-08 08:25:59,271][367454] Fps is (10 sec: 11468.9, 60 sec: 12288.0, 300 sec: 11802.0). Total num frames: 4808704. Throughput: 0: 12159.5. Samples: 4776476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:25:59,272][367454] Avg episode reward: [(0, '4275.496')] [2023-03-08 08:26:01,193][367737] Updated weights for policy 0, policy_version 9440 (0.0004) [2023-03-08 08:26:04,272][367454] Fps is (10 sec: 11878.3, 60 sec: 12288.0, 300 sec: 11815.9). Total num frames: 4870144. Throughput: 0: 12070.8. Samples: 4848764. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:26:04,272][367454] Avg episode reward: [(0, '4219.829')] [2023-03-08 08:26:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000009512_4870144.pth... [2023-03-08 08:26:04,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000008816_4513792.pth [2023-03-08 08:26:04,410][367737] Updated weights for policy 0, policy_version 9520 (0.0004) [2023-03-08 08:26:07,804][367737] Updated weights for policy 0, policy_version 9600 (0.0005) [2023-03-08 08:26:09,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12219.7, 300 sec: 11829.8). Total num frames: 4931584. Throughput: 0: 12051.6. Samples: 4922680. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:26:09,272][367454] Avg episode reward: [(0, '4355.816')] [2023-03-08 08:26:09,273][367693] Saving new best policy, reward=4355.816! [2023-03-08 08:26:11,175][367737] Updated weights for policy 0, policy_version 9680 (0.0005) [2023-03-08 08:26:14,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11815.9). Total num frames: 4988928. Throughput: 0: 12064.5. Samples: 4959256. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:26:14,272][367454] Avg episode reward: [(0, '4359.820')] [2023-03-08 08:26:14,297][367693] Saving new best policy, reward=4359.820! [2023-03-08 08:26:14,635][367737] Updated weights for policy 0, policy_version 9760 (0.0005) [2023-03-08 08:26:17,988][367737] Updated weights for policy 0, policy_version 9840 (0.0005) [2023-03-08 08:26:19,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11815.9). Total num frames: 5050368. Throughput: 0: 11941.1. Samples: 5029996. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:26:19,272][367454] Avg episode reward: [(0, '4371.044')] [2023-03-08 08:26:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000009864_5050368.pth... [2023-03-08 08:26:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000009168_4694016.pth [2023-03-08 08:26:19,279][367693] Saving new best policy, reward=4371.044! [2023-03-08 08:26:21,381][367737] Updated weights for policy 0, policy_version 9920 (0.0005) [2023-03-08 08:26:24,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12083.2, 300 sec: 11815.9). Total num frames: 5111808. Throughput: 0: 11921.8. Samples: 5102656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:26:24,272][367454] Avg episode reward: [(0, '4349.695')] [2023-03-08 08:26:24,914][367737] Updated weights for policy 0, policy_version 10000 (0.0005) [2023-03-08 08:26:28,514][367737] Updated weights for policy 0, policy_version 10080 (0.0005) [2023-03-08 08:26:29,271][367454] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 11788.2). Total num frames: 5169152. Throughput: 0: 11874.4. Samples: 5136456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:26:29,272][367454] Avg episode reward: [(0, '4035.815')] [2023-03-08 08:26:32,054][367737] Updated weights for policy 0, policy_version 10160 (0.0005) [2023-03-08 08:26:34,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11788.1). Total num frames: 5226496. Throughput: 0: 11832.9. Samples: 5206080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:26:34,272][367454] Avg episode reward: [(0, '4117.133')] [2023-03-08 08:26:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000010208_5226496.pth... [2023-03-08 08:26:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000009512_4870144.pth [2023-03-08 08:26:35,559][367737] Updated weights for policy 0, policy_version 10240 (0.0004) [2023-03-08 08:26:39,006][367737] Updated weights for policy 0, policy_version 10320 (0.0005) [2023-03-08 08:26:39,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11774.3). Total num frames: 5283840. Throughput: 0: 11869.7. Samples: 5276208. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:26:39,272][367454] Avg episode reward: [(0, '4287.353')] [2023-03-08 08:26:42,399][367737] Updated weights for policy 0, policy_version 10400 (0.0005) [2023-03-08 08:26:44,271][367454] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 11788.2). Total num frames: 5345280. Throughput: 0: 11912.1. Samples: 5312520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:26:44,272][367454] Avg episode reward: [(0, '4283.338')] [2023-03-08 08:26:45,921][367737] Updated weights for policy 0, policy_version 10480 (0.0005) [2023-03-08 08:26:49,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11788.1). Total num frames: 5402624. Throughput: 0: 11875.0. Samples: 5383140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:26:49,272][367454] Avg episode reward: [(0, '4294.317')] [2023-03-08 08:26:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000010552_5402624.pth... [2023-03-08 08:26:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000009864_5050368.pth [2023-03-08 08:26:49,420][367737] Updated weights for policy 0, policy_version 10560 (0.0005) [2023-03-08 08:26:52,790][367737] Updated weights for policy 0, policy_version 10640 (0.0005) [2023-03-08 08:26:54,271][367454] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11788.1). Total num frames: 5464064. Throughput: 0: 11847.3. Samples: 5455808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:26:54,272][367454] Avg episode reward: [(0, '4160.541')] [2023-03-08 08:26:56,087][367737] Updated weights for policy 0, policy_version 10720 (0.0005) [2023-03-08 08:26:59,271][367454] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11788.2). Total num frames: 5525504. Throughput: 0: 11855.3. Samples: 5492744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:26:59,272][367454] Avg episode reward: [(0, '4227.431')] [2023-03-08 08:26:59,441][367737] Updated weights for policy 0, policy_version 10800 (0.0005) [2023-03-08 08:27:02,949][367737] Updated weights for policy 0, policy_version 10880 (0.0005) [2023-03-08 08:27:04,271][367454] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11788.2). Total num frames: 5582848. Throughput: 0: 11865.1. Samples: 5563924. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:27:04,272][367454] Avg episode reward: [(0, '4208.182')] [2023-03-08 08:27:04,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000010904_5582848.pth... [2023-03-08 08:27:04,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000010208_5226496.pth [2023-03-08 08:27:06,541][367737] Updated weights for policy 0, policy_version 10960 (0.0005) [2023-03-08 08:27:09,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 11788.2). Total num frames: 5640192. Throughput: 0: 11784.5. Samples: 5632960. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:27:09,272][367454] Avg episode reward: [(0, '4304.233')] [2023-03-08 08:27:10,082][367737] Updated weights for policy 0, policy_version 11040 (0.0005) [2023-03-08 08:27:13,504][367737] Updated weights for policy 0, policy_version 11120 (0.0005) [2023-03-08 08:27:14,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 11802.0). Total num frames: 5701632. Throughput: 0: 11819.3. Samples: 5668324. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:27:14,272][367454] Avg episode reward: [(0, '4102.446')] [2023-03-08 08:27:16,699][367737] Updated weights for policy 0, policy_version 11200 (0.0004) [2023-03-08 08:27:19,272][367454] Fps is (10 sec: 12697.5, 60 sec: 11946.7, 300 sec: 11829.8). Total num frames: 5767168. Throughput: 0: 11935.8. Samples: 5743192. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:27:19,272][367454] Avg episode reward: [(0, '4052.425')] [2023-03-08 08:27:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000011264_5767168.pth... [2023-03-08 08:27:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000010552_5402624.pth [2023-03-08 08:27:19,761][367737] Updated weights for policy 0, policy_version 11280 (0.0004) [2023-03-08 08:27:22,928][367737] Updated weights for policy 0, policy_version 11360 (0.0005) [2023-03-08 08:27:24,272][367454] Fps is (10 sec: 13107.2, 60 sec: 12014.9, 300 sec: 11857.6). Total num frames: 5832704. Throughput: 0: 12147.8. Samples: 5822860. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:27:24,272][367454] Avg episode reward: [(0, '4100.450')] [2023-03-08 08:27:26,138][367737] Updated weights for policy 0, policy_version 11440 (0.0005) [2023-03-08 08:27:29,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12083.2, 300 sec: 11871.5). Total num frames: 5894144. Throughput: 0: 12187.9. Samples: 5860976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:27:29,272][367454] Avg episode reward: [(0, '4010.415')] [2023-03-08 08:27:29,296][367737] Updated weights for policy 0, policy_version 11520 (0.0005) [2023-03-08 08:27:32,430][367737] Updated weights for policy 0, policy_version 11600 (0.0005) [2023-03-08 08:27:34,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 11899.2). Total num frames: 5959680. Throughput: 0: 12352.4. Samples: 5939000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:27:34,272][367454] Avg episode reward: [(0, '4171.077')] [2023-03-08 08:27:34,293][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000011648_5963776.pth... [2023-03-08 08:27:34,294][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000010904_5582848.pth [2023-03-08 08:27:35,642][367737] Updated weights for policy 0, policy_version 11680 (0.0005) [2023-03-08 08:27:39,035][367737] Updated weights for policy 0, policy_version 11760 (0.0005) [2023-03-08 08:27:39,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 11913.1). Total num frames: 6021120. Throughput: 0: 12382.0. Samples: 6013000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:27:39,272][367454] Avg episode reward: [(0, '4215.645')] [2023-03-08 08:27:42,395][367737] Updated weights for policy 0, policy_version 11840 (0.0005) [2023-03-08 08:27:44,272][367454] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 11940.9). Total num frames: 6082560. Throughput: 0: 12380.4. Samples: 6049864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:27:44,272][367454] Avg episode reward: [(0, '4243.709')] [2023-03-08 08:27:45,835][367737] Updated weights for policy 0, policy_version 11920 (0.0005) [2023-03-08 08:27:49,106][367737] Updated weights for policy 0, policy_version 12000 (0.0004) [2023-03-08 08:27:49,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12356.3, 300 sec: 11954.8). Total num frames: 6144000. Throughput: 0: 12408.9. Samples: 6122324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:27:49,272][367454] Avg episode reward: [(0, '4224.280')] [2023-03-08 08:27:49,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000012000_6144000.pth... [2023-03-08 08:27:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000011264_5767168.pth [2023-03-08 08:27:52,566][367737] Updated weights for policy 0, policy_version 12080 (0.0005) [2023-03-08 08:27:54,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 11968.7). Total num frames: 6205440. Throughput: 0: 12500.2. Samples: 6195468. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 08:27:54,272][367454] Avg episode reward: [(0, '4058.840')] [2023-03-08 08:27:55,959][367737] Updated weights for policy 0, policy_version 12160 (0.0005) [2023-03-08 08:27:59,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 11968.7). Total num frames: 6262784. Throughput: 0: 12512.6. Samples: 6231392. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 08:27:59,272][367454] Avg episode reward: [(0, '4211.855')] [2023-03-08 08:27:59,340][367737] Updated weights for policy 0, policy_version 12240 (0.0005) [2023-03-08 08:28:02,654][367737] Updated weights for policy 0, policy_version 12320 (0.0005) [2023-03-08 08:28:04,272][367454] Fps is (10 sec: 11878.3, 60 sec: 12356.2, 300 sec: 11982.5). Total num frames: 6324224. Throughput: 0: 12474.1. Samples: 6304528. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:28:04,272][367454] Avg episode reward: [(0, '4175.675')] [2023-03-08 08:28:04,301][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000012360_6328320.pth... [2023-03-08 08:28:04,303][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000011648_5963776.pth [2023-03-08 08:28:05,955][367737] Updated weights for policy 0, policy_version 12400 (0.0005) [2023-03-08 08:28:09,194][367737] Updated weights for policy 0, policy_version 12480 (0.0005) [2023-03-08 08:28:09,271][367454] Fps is (10 sec: 12697.7, 60 sec: 12492.8, 300 sec: 12010.3). Total num frames: 6389760. Throughput: 0: 12399.4. Samples: 6380832. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:28:09,272][367454] Avg episode reward: [(0, '3895.236')] [2023-03-08 08:28:12,524][367737] Updated weights for policy 0, policy_version 12560 (0.0005) [2023-03-08 08:28:14,271][367454] Fps is (10 sec: 12697.7, 60 sec: 12492.8, 300 sec: 12038.1). Total num frames: 6451200. Throughput: 0: 12351.9. Samples: 6416812. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:28:14,272][367454] Avg episode reward: [(0, '4119.370')] [2023-03-08 08:28:15,895][367737] Updated weights for policy 0, policy_version 12640 (0.0005) [2023-03-08 08:28:19,256][367737] Updated weights for policy 0, policy_version 12720 (0.0005) [2023-03-08 08:28:19,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12052.0). Total num frames: 6512640. Throughput: 0: 12258.9. Samples: 6490648. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:28:19,272][367454] Avg episode reward: [(0, '4125.324')] [2023-03-08 08:28:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000012720_6512640.pth... [2023-03-08 08:28:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000012000_6144000.pth [2023-03-08 08:28:22,428][367737] Updated weights for policy 0, policy_version 12800 (0.0005) [2023-03-08 08:28:24,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12065.8). Total num frames: 6574080. Throughput: 0: 12286.6. Samples: 6565896. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:28:24,272][367454] Avg episode reward: [(0, '4199.836')] [2023-03-08 08:28:25,683][367737] Updated weights for policy 0, policy_version 12880 (0.0004) [2023-03-08 08:28:28,893][367737] Updated weights for policy 0, policy_version 12960 (0.0005) [2023-03-08 08:28:29,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 12093.6). Total num frames: 6639616. Throughput: 0: 12288.7. Samples: 6602856. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:28:29,272][367454] Avg episode reward: [(0, '4223.971')] [2023-03-08 08:28:31,899][367737] Updated weights for policy 0, policy_version 13040 (0.0004) [2023-03-08 08:28:34,272][367454] Fps is (10 sec: 13516.7, 60 sec: 12492.8, 300 sec: 12135.3). Total num frames: 6709248. Throughput: 0: 12470.8. Samples: 6683508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:28:34,272][367454] Avg episode reward: [(0, '4259.854')] [2023-03-08 08:28:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000013104_6709248.pth... [2023-03-08 08:28:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000012360_6328320.pth [2023-03-08 08:28:34,775][367737] Updated weights for policy 0, policy_version 13120 (0.0004) [2023-03-08 08:28:37,750][367737] Updated weights for policy 0, policy_version 13200 (0.0004) [2023-03-08 08:28:39,272][367454] Fps is (10 sec: 13516.8, 60 sec: 12561.1, 300 sec: 12163.0). Total num frames: 6774784. Throughput: 0: 12693.2. Samples: 6766664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:28:39,272][367454] Avg episode reward: [(0, '4200.963')] [2023-03-08 08:28:40,752][367737] Updated weights for policy 0, policy_version 13280 (0.0004) [2023-03-08 08:28:43,608][367737] Updated weights for policy 0, policy_version 13360 (0.0004) [2023-03-08 08:28:44,272][367454] Fps is (10 sec: 13926.5, 60 sec: 12765.9, 300 sec: 12218.6). Total num frames: 6848512. Throughput: 0: 12827.7. Samples: 6808640. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 08:28:44,272][367454] Avg episode reward: [(0, '4174.926')] [2023-03-08 08:28:46,644][367737] Updated weights for policy 0, policy_version 13440 (0.0004) [2023-03-08 08:28:49,272][367454] Fps is (10 sec: 14336.0, 60 sec: 12902.4, 300 sec: 12260.2). Total num frames: 6918144. Throughput: 0: 13069.2. Samples: 6892644. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 08:28:49,272][367454] Avg episode reward: [(0, '4210.016')] [2023-03-08 08:28:49,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000013512_6918144.pth... [2023-03-08 08:28:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000012720_6512640.pth [2023-03-08 08:28:49,475][367737] Updated weights for policy 0, policy_version 13520 (0.0003) [2023-03-08 08:28:52,481][367737] Updated weights for policy 0, policy_version 13600 (0.0004) [2023-03-08 08:28:54,272][367454] Fps is (10 sec: 13516.8, 60 sec: 12970.7, 300 sec: 12288.0). Total num frames: 6983680. Throughput: 0: 13186.2. Samples: 6974212. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:28:54,272][367454] Avg episode reward: [(0, '4176.951')] [2023-03-08 08:28:55,681][367737] Updated weights for policy 0, policy_version 13680 (0.0004) [2023-03-08 08:28:58,538][367737] Updated weights for policy 0, policy_version 13760 (0.0004) [2023-03-08 08:28:59,272][367454] Fps is (10 sec: 13516.9, 60 sec: 13175.5, 300 sec: 12301.9). Total num frames: 7053312. Throughput: 0: 13264.5. Samples: 7013716. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:28:59,272][367454] Avg episode reward: [(0, '4360.802')] [2023-03-08 08:29:01,412][367737] Updated weights for policy 0, policy_version 13840 (0.0004) [2023-03-08 08:29:04,238][367737] Updated weights for policy 0, policy_version 13920 (0.0003) [2023-03-08 08:29:04,272][367454] Fps is (10 sec: 14335.9, 60 sec: 13380.3, 300 sec: 12343.5). Total num frames: 7127040. Throughput: 0: 13528.3. Samples: 7099420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:29:04,272][367454] Avg episode reward: [(0, '4380.335')] [2023-03-08 08:29:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000013920_7127040.pth... [2023-03-08 08:29:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000013104_6709248.pth [2023-03-08 08:29:04,278][367693] Saving new best policy, reward=4380.335! [2023-03-08 08:29:06,996][367737] Updated weights for policy 0, policy_version 14000 (0.0004) [2023-03-08 08:29:09,272][367454] Fps is (10 sec: 14745.6, 60 sec: 13516.8, 300 sec: 12399.1). Total num frames: 7200768. Throughput: 0: 13835.4. Samples: 7188488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:29:09,272][367454] Avg episode reward: [(0, '4295.541')] [2023-03-08 08:29:09,763][367737] Updated weights for policy 0, policy_version 14080 (0.0004) [2023-03-08 08:29:12,558][367737] Updated weights for policy 0, policy_version 14160 (0.0004) [2023-03-08 08:29:14,272][367454] Fps is (10 sec: 14745.7, 60 sec: 13721.6, 300 sec: 12454.6). Total num frames: 7274496. Throughput: 0: 14001.7. Samples: 7232932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:29:14,272][367454] Avg episode reward: [(0, '4365.467')] [2023-03-08 08:29:15,470][367737] Updated weights for policy 0, policy_version 14240 (0.0004) [2023-03-08 08:29:18,374][367737] Updated weights for policy 0, policy_version 14320 (0.0004) [2023-03-08 08:29:19,272][367454] Fps is (10 sec: 14335.9, 60 sec: 13858.1, 300 sec: 12496.3). Total num frames: 7344128. Throughput: 0: 14107.7. Samples: 7318356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:29:19,272][367454] Avg episode reward: [(0, '3561.470')] [2023-03-08 08:29:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000014344_7344128.pth... [2023-03-08 08:29:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000013512_6918144.pth [2023-03-08 08:29:21,292][367737] Updated weights for policy 0, policy_version 14400 (0.0004) [2023-03-08 08:29:24,271][367454] Fps is (10 sec: 13516.9, 60 sec: 13926.4, 300 sec: 12524.0). Total num frames: 7409664. Throughput: 0: 14108.3. Samples: 7401536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:29:24,272][367454] Avg episode reward: [(0, '4292.738')] [2023-03-08 08:29:24,300][367737] Updated weights for policy 0, policy_version 14480 (0.0004) [2023-03-08 08:29:27,213][367737] Updated weights for policy 0, policy_version 14560 (0.0004) [2023-03-08 08:29:29,271][367454] Fps is (10 sec: 13516.9, 60 sec: 13994.7, 300 sec: 12551.8). Total num frames: 7479296. Throughput: 0: 14086.1. Samples: 7442512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:29:29,272][367454] Avg episode reward: [(0, '4304.827')] [2023-03-08 08:29:30,276][367737] Updated weights for policy 0, policy_version 14640 (0.0004) [2023-03-08 08:29:33,308][367737] Updated weights for policy 0, policy_version 14720 (0.0004) [2023-03-08 08:29:34,272][367454] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 12579.6). Total num frames: 7548928. Throughput: 0: 14038.0. Samples: 7524352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:29:34,272][367454] Avg episode reward: [(0, '4229.226')] [2023-03-08 08:29:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000014744_7548928.pth... [2023-03-08 08:29:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000013920_7127040.pth [2023-03-08 08:29:36,439][367737] Updated weights for policy 0, policy_version 14800 (0.0005) [2023-03-08 08:29:39,271][367454] Fps is (10 sec: 13107.3, 60 sec: 13926.4, 300 sec: 12593.5). Total num frames: 7610368. Throughput: 0: 13970.3. Samples: 7602876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:29:39,272][367454] Avg episode reward: [(0, '4364.474')] [2023-03-08 08:29:39,604][367737] Updated weights for policy 0, policy_version 14880 (0.0005) [2023-03-08 08:29:42,865][367737] Updated weights for policy 0, policy_version 14960 (0.0005) [2023-03-08 08:29:44,271][367454] Fps is (10 sec: 12697.7, 60 sec: 13789.9, 300 sec: 12621.2). Total num frames: 7675904. Throughput: 0: 13924.5. Samples: 7640316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:29:44,272][367454] Avg episode reward: [(0, '4341.311')] [2023-03-08 08:29:45,986][367737] Updated weights for policy 0, policy_version 15040 (0.0005) [2023-03-08 08:29:49,132][367737] Updated weights for policy 0, policy_version 15120 (0.0005) [2023-03-08 08:29:49,272][367454] Fps is (10 sec: 13107.0, 60 sec: 13721.6, 300 sec: 12649.0). Total num frames: 7741440. Throughput: 0: 13769.4. Samples: 7719044. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:29:49,272][367454] Avg episode reward: [(0, '4298.007')] [2023-03-08 08:29:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000015120_7741440.pth... [2023-03-08 08:29:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000014344_7344128.pth [2023-03-08 08:29:52,238][367737] Updated weights for policy 0, policy_version 15200 (0.0004) [2023-03-08 08:29:54,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13721.6, 300 sec: 12662.9). Total num frames: 7806976. Throughput: 0: 13498.0. Samples: 7795896. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:29:54,272][367454] Avg episode reward: [(0, '4167.129')] [2023-03-08 08:29:55,463][367737] Updated weights for policy 0, policy_version 15280 (0.0005) [2023-03-08 08:29:58,329][367737] Updated weights for policy 0, policy_version 15360 (0.0004) [2023-03-08 08:29:59,272][367454] Fps is (10 sec: 13516.9, 60 sec: 13721.6, 300 sec: 12690.7). Total num frames: 7876608. Throughput: 0: 13412.7. Samples: 7836504. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:29:59,272][367454] Avg episode reward: [(0, '4339.572')] [2023-03-08 08:30:01,286][367737] Updated weights for policy 0, policy_version 15440 (0.0004) [2023-03-08 08:30:04,236][367737] Updated weights for policy 0, policy_version 15520 (0.0004) [2023-03-08 08:30:04,272][367454] Fps is (10 sec: 13926.3, 60 sec: 13653.3, 300 sec: 12704.5). Total num frames: 7946240. Throughput: 0: 13392.8. Samples: 7921032. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:30:04,272][367454] Avg episode reward: [(0, '4306.484')] [2023-03-08 08:30:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000015520_7946240.pth... [2023-03-08 08:30:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000014744_7548928.pth [2023-03-08 08:30:07,266][367737] Updated weights for policy 0, policy_version 15600 (0.0004) [2023-03-08 08:30:09,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13516.8, 300 sec: 12704.5). Total num frames: 8011776. Throughput: 0: 13356.3. Samples: 8002572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:30:09,272][367454] Avg episode reward: [(0, '4186.019')] [2023-03-08 08:30:10,339][367737] Updated weights for policy 0, policy_version 15680 (0.0005) [2023-03-08 08:30:13,305][367737] Updated weights for policy 0, policy_version 15760 (0.0004) [2023-03-08 08:30:14,272][367454] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 12732.3). Total num frames: 8081408. Throughput: 0: 13344.4. Samples: 8043012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:30:14,272][367454] Avg episode reward: [(0, '4382.855')] [2023-03-08 08:30:14,273][367693] Saving new best policy, reward=4382.855! [2023-03-08 08:30:16,157][367737] Updated weights for policy 0, policy_version 15840 (0.0004) [2023-03-08 08:30:19,090][367737] Updated weights for policy 0, policy_version 15920 (0.0003) [2023-03-08 08:30:19,272][367454] Fps is (10 sec: 13926.3, 60 sec: 13448.5, 300 sec: 12760.1). Total num frames: 8151040. Throughput: 0: 13385.0. Samples: 8126676. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:30:19,272][367454] Avg episode reward: [(0, '4112.534')] [2023-03-08 08:30:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000015920_8151040.pth... [2023-03-08 08:30:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000015120_7741440.pth [2023-03-08 08:30:22,028][367737] Updated weights for policy 0, policy_version 16000 (0.0004) [2023-03-08 08:30:24,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13516.8, 300 sec: 12774.0). Total num frames: 8220672. Throughput: 0: 13530.1. Samples: 8211732. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:30:24,272][367454] Avg episode reward: [(0, '4370.323')] [2023-03-08 08:30:24,902][367737] Updated weights for policy 0, policy_version 16080 (0.0004) [2023-03-08 08:30:27,812][367737] Updated weights for policy 0, policy_version 16160 (0.0003) [2023-03-08 08:30:29,271][367454] Fps is (10 sec: 13926.5, 60 sec: 13516.8, 300 sec: 12801.7). Total num frames: 8290304. Throughput: 0: 13638.3. Samples: 8254040. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:30:29,272][367454] Avg episode reward: [(0, '4173.438')] [2023-03-08 08:30:31,002][367737] Updated weights for policy 0, policy_version 16240 (0.0005) [2023-03-08 08:30:34,245][367737] Updated weights for policy 0, policy_version 16320 (0.0005) [2023-03-08 08:30:34,271][367454] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 12815.6). Total num frames: 8355840. Throughput: 0: 13625.2. Samples: 8332176. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:30:34,272][367454] Avg episode reward: [(0, '4296.503')] [2023-03-08 08:30:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000016320_8355840.pth... [2023-03-08 08:30:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000015520_7946240.pth [2023-03-08 08:30:37,502][367737] Updated weights for policy 0, policy_version 16400 (0.0005) [2023-03-08 08:30:39,271][367454] Fps is (10 sec: 12697.6, 60 sec: 13448.5, 300 sec: 12829.5). Total num frames: 8417280. Throughput: 0: 13597.7. Samples: 8407792. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:30:39,272][367454] Avg episode reward: [(0, '4262.603')] [2023-03-08 08:30:40,835][367737] Updated weights for policy 0, policy_version 16480 (0.0004) [2023-03-08 08:30:44,023][367737] Updated weights for policy 0, policy_version 16560 (0.0004) [2023-03-08 08:30:44,272][367454] Fps is (10 sec: 12288.0, 60 sec: 13380.3, 300 sec: 12829.5). Total num frames: 8478720. Throughput: 0: 13536.5. Samples: 8445648. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:30:44,272][367454] Avg episode reward: [(0, '4201.148')] [2023-03-08 08:30:47,467][367737] Updated weights for policy 0, policy_version 16640 (0.0005) [2023-03-08 08:30:49,272][367454] Fps is (10 sec: 12287.9, 60 sec: 13312.0, 300 sec: 12843.4). Total num frames: 8540160. Throughput: 0: 13302.1. Samples: 8519628. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:30:49,272][367454] Avg episode reward: [(0, '4303.761')] [2023-03-08 08:30:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000016680_8540160.pth... [2023-03-08 08:30:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000015920_8151040.pth [2023-03-08 08:30:50,905][367737] Updated weights for policy 0, policy_version 16720 (0.0005) [2023-03-08 08:30:54,272][367454] Fps is (10 sec: 11878.4, 60 sec: 13175.5, 300 sec: 12843.4). Total num frames: 8597504. Throughput: 0: 13040.9. Samples: 8589412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:30:54,272][367454] Avg episode reward: [(0, '4376.532')] [2023-03-08 08:30:54,424][367737] Updated weights for policy 0, policy_version 16800 (0.0005) [2023-03-08 08:30:57,859][367737] Updated weights for policy 0, policy_version 16880 (0.0004) [2023-03-08 08:30:59,271][367454] Fps is (10 sec: 11878.5, 60 sec: 13039.0, 300 sec: 12843.4). Total num frames: 8658944. Throughput: 0: 12952.6. Samples: 8625880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:30:59,272][367454] Avg episode reward: [(0, '4149.662')] [2023-03-08 08:31:01,285][367737] Updated weights for policy 0, policy_version 16960 (0.0005) [2023-03-08 08:31:04,272][367454] Fps is (10 sec: 11878.3, 60 sec: 12834.1, 300 sec: 12829.5). Total num frames: 8716288. Throughput: 0: 12688.3. Samples: 8697648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:31:04,272][367454] Avg episode reward: [(0, '4234.776')] [2023-03-08 08:31:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000017024_8716288.pth... [2023-03-08 08:31:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000016320_8355840.pth [2023-03-08 08:31:04,717][367737] Updated weights for policy 0, policy_version 17040 (0.0005) [2023-03-08 08:31:07,905][367737] Updated weights for policy 0, policy_version 17120 (0.0004) [2023-03-08 08:31:09,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12834.1, 300 sec: 12857.3). Total num frames: 8781824. Throughput: 0: 12437.8. Samples: 8771432. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:31:09,282][367454] Avg episode reward: [(0, '4375.198')] [2023-03-08 08:31:11,218][367737] Updated weights for policy 0, policy_version 17200 (0.0005) [2023-03-08 08:31:14,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 12857.3). Total num frames: 8843264. Throughput: 0: 12320.6. Samples: 8808468. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:31:14,272][367454] Avg episode reward: [(0, '4358.966')] [2023-03-08 08:31:14,510][367737] Updated weights for policy 0, policy_version 17280 (0.0004) [2023-03-08 08:31:17,793][367737] Updated weights for policy 0, policy_version 17360 (0.0005) [2023-03-08 08:31:19,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12561.1, 300 sec: 12857.3). Total num frames: 8904704. Throughput: 0: 12261.8. Samples: 8883960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:31:19,283][367454] Avg episode reward: [(0, '3905.289')] [2023-03-08 08:31:19,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000017392_8904704.pth... [2023-03-08 08:31:19,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000016680_8540160.pth [2023-03-08 08:31:21,172][367737] Updated weights for policy 0, policy_version 17440 (0.0005) [2023-03-08 08:31:24,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12871.2). Total num frames: 8966144. Throughput: 0: 12222.4. Samples: 8957800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:31:24,283][367454] Avg episode reward: [(0, '4144.262')] [2023-03-08 08:31:24,400][367737] Updated weights for policy 0, policy_version 17520 (0.0005) [2023-03-08 08:31:27,635][367737] Updated weights for policy 0, policy_version 17600 (0.0004) [2023-03-08 08:31:29,272][367454] Fps is (10 sec: 12697.7, 60 sec: 12356.3, 300 sec: 12898.9). Total num frames: 9031680. Throughput: 0: 12205.3. Samples: 8994888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:31:29,282][367454] Avg episode reward: [(0, '4195.116')] [2023-03-08 08:31:30,886][367737] Updated weights for policy 0, policy_version 17680 (0.0004) [2023-03-08 08:31:33,876][367737] Updated weights for policy 0, policy_version 17760 (0.0003) [2023-03-08 08:31:34,272][367454] Fps is (10 sec: 13107.2, 60 sec: 12356.3, 300 sec: 12926.7). Total num frames: 9097216. Throughput: 0: 12292.4. Samples: 9072784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:31:34,282][367454] Avg episode reward: [(0, '4132.987')] [2023-03-08 08:31:34,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000017768_9097216.pth... [2023-03-08 08:31:34,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000017024_8716288.pth [2023-03-08 08:31:37,051][367737] Updated weights for policy 0, policy_version 17840 (0.0004) [2023-03-08 08:31:39,271][367454] Fps is (10 sec: 12697.7, 60 sec: 12356.3, 300 sec: 12926.7). Total num frames: 9158656. Throughput: 0: 12473.3. Samples: 9150708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:31:39,282][367454] Avg episode reward: [(0, '4197.419')] [2023-03-08 08:31:40,302][367737] Updated weights for policy 0, policy_version 17920 (0.0005) [2023-03-08 08:31:43,584][367737] Updated weights for policy 0, policy_version 18000 (0.0005) [2023-03-08 08:31:44,271][367454] Fps is (10 sec: 12697.7, 60 sec: 12424.5, 300 sec: 12954.5). Total num frames: 9224192. Throughput: 0: 12488.6. Samples: 9187868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:31:44,282][367454] Avg episode reward: [(0, '4145.018')] [2023-03-08 08:31:46,828][367737] Updated weights for policy 0, policy_version 18080 (0.0005) [2023-03-08 08:31:49,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12424.5, 300 sec: 12954.5). Total num frames: 9285632. Throughput: 0: 12588.0. Samples: 9264108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:31:49,282][367454] Avg episode reward: [(0, '4297.674')] [2023-03-08 08:31:49,285][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000018136_9285632.pth... [2023-03-08 08:31:49,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000017392_8904704.pth [2023-03-08 08:31:50,158][367737] Updated weights for policy 0, policy_version 18160 (0.0005) [2023-03-08 08:31:53,414][367737] Updated weights for policy 0, policy_version 18240 (0.0005) [2023-03-08 08:31:54,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12968.4). Total num frames: 9351168. Throughput: 0: 12610.1. Samples: 9338888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:31:54,282][367454] Avg episode reward: [(0, '4224.203')] [2023-03-08 08:31:56,367][367737] Updated weights for policy 0, policy_version 18320 (0.0004) [2023-03-08 08:31:59,240][367737] Updated weights for policy 0, policy_version 18400 (0.0004) [2023-03-08 08:31:59,271][367454] Fps is (10 sec: 13516.8, 60 sec: 12697.6, 300 sec: 13010.0). Total num frames: 9420800. Throughput: 0: 12698.8. Samples: 9379912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:31:59,272][367454] Avg episode reward: [(0, '3714.482')] [2023-03-08 08:32:02,037][367737] Updated weights for policy 0, policy_version 18480 (0.0004) [2023-03-08 08:32:04,271][367454] Fps is (10 sec: 13926.4, 60 sec: 12902.4, 300 sec: 13051.7). Total num frames: 9490432. Throughput: 0: 12944.6. Samples: 9466468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:32:04,272][367454] Avg episode reward: [(0, '4261.453')] [2023-03-08 08:32:04,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000018544_9494528.pth... [2023-03-08 08:32:04,287][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000017768_9097216.pth [2023-03-08 08:32:04,916][367737] Updated weights for policy 0, policy_version 18560 (0.0004) [2023-03-08 08:32:07,820][367737] Updated weights for policy 0, policy_version 18640 (0.0004) [2023-03-08 08:32:09,271][367454] Fps is (10 sec: 13926.5, 60 sec: 12970.7, 300 sec: 13079.4). Total num frames: 9560064. Throughput: 0: 13203.1. Samples: 9551936. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:32:09,282][367454] Avg episode reward: [(0, '4308.668')] [2023-03-08 08:32:10,859][367737] Updated weights for policy 0, policy_version 18720 (0.0005) [2023-03-08 08:32:14,221][367737] Updated weights for policy 0, policy_version 18800 (0.0005) [2023-03-08 08:32:14,272][367454] Fps is (10 sec: 13516.7, 60 sec: 13038.9, 300 sec: 13079.4). Total num frames: 9625600. Throughput: 0: 13267.0. Samples: 9591904. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:32:14,282][367454] Avg episode reward: [(0, '4291.497')] [2023-03-08 08:32:17,456][367737] Updated weights for policy 0, policy_version 18880 (0.0005) [2023-03-08 08:32:19,272][367454] Fps is (10 sec: 13106.9, 60 sec: 13107.2, 300 sec: 13079.4). Total num frames: 9691136. Throughput: 0: 13188.9. Samples: 9666284. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:32:19,283][367454] Avg episode reward: [(0, '4358.465')] [2023-03-08 08:32:19,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000018928_9691136.pth... [2023-03-08 08:32:19,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000018136_9285632.pth [2023-03-08 08:32:20,598][367737] Updated weights for policy 0, policy_version 18960 (0.0005) [2023-03-08 08:32:23,791][367737] Updated weights for policy 0, policy_version 19040 (0.0005) [2023-03-08 08:32:24,272][367454] Fps is (10 sec: 12697.6, 60 sec: 13107.2, 300 sec: 13079.4). Total num frames: 9752576. Throughput: 0: 13177.3. Samples: 9743688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:32:24,283][367454] Avg episode reward: [(0, '4390.615')] [2023-03-08 08:32:24,283][367693] Saving new best policy, reward=4390.615! [2023-03-08 08:32:27,143][367737] Updated weights for policy 0, policy_version 19120 (0.0005) [2023-03-08 08:32:29,271][367454] Fps is (10 sec: 12697.7, 60 sec: 13107.2, 300 sec: 13079.4). Total num frames: 9818112. Throughput: 0: 13179.9. Samples: 9780964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:32:29,283][367454] Avg episode reward: [(0, '4232.690')] [2023-03-08 08:32:30,173][367737] Updated weights for policy 0, policy_version 19200 (0.0004) [2023-03-08 08:32:33,263][367737] Updated weights for policy 0, policy_version 19280 (0.0005) [2023-03-08 08:32:34,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13107.2, 300 sec: 13093.3). Total num frames: 9883648. Throughput: 0: 13228.3. Samples: 9859380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:32:34,283][367454] Avg episode reward: [(0, '4149.168')] [2023-03-08 08:32:34,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000019304_9883648.pth... [2023-03-08 08:32:34,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000018544_9494528.pth [2023-03-08 08:32:36,388][367737] Updated weights for policy 0, policy_version 19360 (0.0004) [2023-03-08 08:32:39,271][367454] Fps is (10 sec: 12697.6, 60 sec: 13107.2, 300 sec: 13093.3). Total num frames: 9945088. Throughput: 0: 13289.2. Samples: 9936904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:32:39,282][367454] Avg episode reward: [(0, '4349.992')] [2023-03-08 08:32:39,798][367737] Updated weights for policy 0, policy_version 19440 (0.0005) [2023-03-08 08:32:43,140][367737] Updated weights for policy 0, policy_version 19520 (0.0005) [2023-03-08 08:32:44,272][367454] Fps is (10 sec: 12288.0, 60 sec: 13038.9, 300 sec: 13093.3). Total num frames: 10006528. Throughput: 0: 13193.2. Samples: 9973608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:32:44,282][367454] Avg episode reward: [(0, '4336.993')] [2023-03-08 08:32:46,208][367737] Updated weights for policy 0, policy_version 19600 (0.0004) [2023-03-08 08:32:49,272][367454] Fps is (10 sec: 12287.9, 60 sec: 13038.9, 300 sec: 13093.3). Total num frames: 10067968. Throughput: 0: 12958.1. Samples: 10049584. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 08:32:49,283][367454] Avg episode reward: [(0, '4039.584')] [2023-03-08 08:32:49,290][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000019672_10072064.pth... [2023-03-08 08:32:49,292][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000018928_9691136.pth [2023-03-08 08:32:49,619][367737] Updated weights for policy 0, policy_version 19680 (0.0005) [2023-03-08 08:32:52,824][367737] Updated weights for policy 0, policy_version 19760 (0.0005) [2023-03-08 08:32:54,272][367454] Fps is (10 sec: 12697.6, 60 sec: 13038.9, 300 sec: 13121.1). Total num frames: 10133504. Throughput: 0: 12741.6. Samples: 10125308. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 08:32:54,272][367454] Avg episode reward: [(0, '4280.485')] [2023-03-08 08:32:55,889][367737] Updated weights for policy 0, policy_version 19840 (0.0005) [2023-03-08 08:32:58,913][367737] Updated weights for policy 0, policy_version 19920 (0.0004) [2023-03-08 08:32:59,272][367454] Fps is (10 sec: 13516.9, 60 sec: 13038.9, 300 sec: 13148.9). Total num frames: 10203136. Throughput: 0: 12729.4. Samples: 10164728. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 08:32:59,272][367454] Avg episode reward: [(0, '4157.808')] [2023-03-08 08:33:01,917][367737] Updated weights for policy 0, policy_version 20000 (0.0004) [2023-03-08 08:33:04,271][367454] Fps is (10 sec: 13516.9, 60 sec: 12970.7, 300 sec: 13148.9). Total num frames: 10268672. Throughput: 0: 12898.2. Samples: 10246700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:33:04,272][367454] Avg episode reward: [(0, '4230.404')] [2023-03-08 08:33:04,279][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000020064_10272768.pth... [2023-03-08 08:33:04,281][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000019304_9883648.pth [2023-03-08 08:33:04,869][367737] Updated weights for policy 0, policy_version 20080 (0.0003) [2023-03-08 08:33:08,070][367737] Updated weights for policy 0, policy_version 20160 (0.0005) [2023-03-08 08:33:09,271][367454] Fps is (10 sec: 13107.3, 60 sec: 12902.4, 300 sec: 13162.7). Total num frames: 10334208. Throughput: 0: 12940.8. Samples: 10326024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:33:09,272][367454] Avg episode reward: [(0, '4354.533')] [2023-03-08 08:33:11,444][367737] Updated weights for policy 0, policy_version 20240 (0.0005) [2023-03-08 08:33:14,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12834.2, 300 sec: 13162.7). Total num frames: 10395648. Throughput: 0: 12929.8. Samples: 10362804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:33:14,272][367454] Avg episode reward: [(0, '4323.041')] [2023-03-08 08:33:14,754][367737] Updated weights for policy 0, policy_version 20320 (0.0005) [2023-03-08 08:33:18,006][367737] Updated weights for policy 0, policy_version 20400 (0.0005) [2023-03-08 08:33:19,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12765.9, 300 sec: 13162.7). Total num frames: 10457088. Throughput: 0: 12835.4. Samples: 10436972. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:33:19,272][367454] Avg episode reward: [(0, '4084.777')] [2023-03-08 08:33:19,295][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000020432_10461184.pth... [2023-03-08 08:33:19,296][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000019672_10072064.pth [2023-03-08 08:33:21,251][367737] Updated weights for policy 0, policy_version 20480 (0.0005) [2023-03-08 08:33:24,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12834.1, 300 sec: 13162.7). Total num frames: 10522624. Throughput: 0: 12774.7. Samples: 10511764. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:33:24,272][367454] Avg episode reward: [(0, '3867.077')] [2023-03-08 08:33:24,580][367737] Updated weights for policy 0, policy_version 20560 (0.0005) [2023-03-08 08:33:27,844][367737] Updated weights for policy 0, policy_version 20640 (0.0005) [2023-03-08 08:33:29,271][367454] Fps is (10 sec: 12697.7, 60 sec: 12765.9, 300 sec: 13135.0). Total num frames: 10584064. Throughput: 0: 12793.3. Samples: 10549304. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:33:29,272][367454] Avg episode reward: [(0, '4108.566')] [2023-03-08 08:33:31,124][367737] Updated weights for policy 0, policy_version 20720 (0.0005) [2023-03-08 08:33:34,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12697.6, 300 sec: 13121.1). Total num frames: 10645504. Throughput: 0: 12780.5. Samples: 10624708. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:33:34,272][367454] Avg episode reward: [(0, '4169.664')] [2023-03-08 08:33:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000020792_10645504.pth... [2023-03-08 08:33:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000020064_10272768.pth [2023-03-08 08:33:34,450][367737] Updated weights for policy 0, policy_version 20800 (0.0005) [2023-03-08 08:33:37,625][367737] Updated weights for policy 0, policy_version 20880 (0.0004) [2023-03-08 08:33:39,272][367454] Fps is (10 sec: 12697.4, 60 sec: 12765.8, 300 sec: 13093.3). Total num frames: 10711040. Throughput: 0: 12771.9. Samples: 10700044. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:33:39,272][367454] Avg episode reward: [(0, '4300.436')] [2023-03-08 08:33:40,902][367737] Updated weights for policy 0, policy_version 20960 (0.0005) [2023-03-08 08:33:43,936][367737] Updated weights for policy 0, policy_version 21040 (0.0005) [2023-03-08 08:33:44,272][367454] Fps is (10 sec: 13107.3, 60 sec: 12834.1, 300 sec: 13079.4). Total num frames: 10776576. Throughput: 0: 12742.8. Samples: 10738156. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:33:44,272][367454] Avg episode reward: [(0, '3511.164')] [2023-03-08 08:33:46,868][367737] Updated weights for policy 0, policy_version 21120 (0.0004) [2023-03-08 08:33:49,272][367454] Fps is (10 sec: 13516.9, 60 sec: 12970.7, 300 sec: 13093.3). Total num frames: 10846208. Throughput: 0: 12765.6. Samples: 10821152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:33:49,272][367454] Avg episode reward: [(0, '4153.910')] [2023-03-08 08:33:49,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000021184_10846208.pth... [2023-03-08 08:33:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000020432_10461184.pth [2023-03-08 08:33:49,754][367737] Updated weights for policy 0, policy_version 21200 (0.0003) [2023-03-08 08:33:52,925][367737] Updated weights for policy 0, policy_version 21280 (0.0005) [2023-03-08 08:33:54,272][367454] Fps is (10 sec: 13516.8, 60 sec: 12970.7, 300 sec: 13079.4). Total num frames: 10911744. Throughput: 0: 12777.1. Samples: 10900992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:33:54,272][367454] Avg episode reward: [(0, '3453.147')] [2023-03-08 08:33:56,262][367737] Updated weights for policy 0, policy_version 21360 (0.0005) [2023-03-08 08:33:59,271][367454] Fps is (10 sec: 12697.7, 60 sec: 12834.1, 300 sec: 13037.8). Total num frames: 10973184. Throughput: 0: 12784.1. Samples: 10938088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:33:59,272][367454] Avg episode reward: [(0, '3436.418')] [2023-03-08 08:33:59,439][367737] Updated weights for policy 0, policy_version 21440 (0.0005) [2023-03-08 08:34:02,698][367737] Updated weights for policy 0, policy_version 21520 (0.0005) [2023-03-08 08:34:04,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12765.8, 300 sec: 12996.1). Total num frames: 11034624. Throughput: 0: 12827.5. Samples: 11014208. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:34:04,272][367454] Avg episode reward: [(0, '3613.400')] [2023-03-08 08:34:04,289][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000021560_11038720.pth... [2023-03-08 08:34:04,291][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000020792_10645504.pth [2023-03-08 08:34:05,982][367737] Updated weights for policy 0, policy_version 21600 (0.0005) [2023-03-08 08:34:09,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12697.6, 300 sec: 12954.5). Total num frames: 11096064. Throughput: 0: 12827.0. Samples: 11088976. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:34:09,272][367454] Avg episode reward: [(0, '4138.935')] [2023-03-08 08:34:09,321][367737] Updated weights for policy 0, policy_version 21680 (0.0005) [2023-03-08 08:34:12,625][367737] Updated weights for policy 0, policy_version 21760 (0.0005) [2023-03-08 08:34:14,271][367454] Fps is (10 sec: 12288.2, 60 sec: 12697.6, 300 sec: 12926.7). Total num frames: 11157504. Throughput: 0: 12797.2. Samples: 11125176. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:34:14,272][367454] Avg episode reward: [(0, '4258.155')] [2023-03-08 08:34:15,927][367737] Updated weights for policy 0, policy_version 21840 (0.0004) [2023-03-08 08:34:19,149][367737] Updated weights for policy 0, policy_version 21920 (0.0004) [2023-03-08 08:34:19,272][367454] Fps is (10 sec: 12697.4, 60 sec: 12765.9, 300 sec: 12926.7). Total num frames: 11223040. Throughput: 0: 12811.1. Samples: 11201208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:34:19,272][367454] Avg episode reward: [(0, '4360.043')] [2023-03-08 08:34:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000021920_11223040.pth... [2023-03-08 08:34:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000021184_10846208.pth [2023-03-08 08:34:22,408][367737] Updated weights for policy 0, policy_version 22000 (0.0005) [2023-03-08 08:34:24,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12697.6, 300 sec: 12898.9). Total num frames: 11284480. Throughput: 0: 12805.5. Samples: 11276288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:34:24,272][367454] Avg episode reward: [(0, '4215.546')] [2023-03-08 08:34:25,731][367737] Updated weights for policy 0, policy_version 22080 (0.0005) [2023-03-08 08:34:28,978][367737] Updated weights for policy 0, policy_version 22160 (0.0005) [2023-03-08 08:34:29,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12697.6, 300 sec: 12871.2). Total num frames: 11345920. Throughput: 0: 12779.1. Samples: 11313216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:34:29,272][367454] Avg episode reward: [(0, '4335.619')] [2023-03-08 08:34:32,287][367737] Updated weights for policy 0, policy_version 22240 (0.0005) [2023-03-08 08:34:34,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12765.9, 300 sec: 12885.0). Total num frames: 11411456. Throughput: 0: 12595.5. Samples: 11387948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:34:34,272][367454] Avg episode reward: [(0, '4214.008')] [2023-03-08 08:34:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000022288_11411456.pth... [2023-03-08 08:34:34,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000021560_11038720.pth [2023-03-08 08:34:35,591][367737] Updated weights for policy 0, policy_version 22320 (0.0005) [2023-03-08 08:34:38,950][367737] Updated weights for policy 0, policy_version 22400 (0.0005) [2023-03-08 08:34:39,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12629.4, 300 sec: 12857.3). Total num frames: 11468800. Throughput: 0: 12463.4. Samples: 11461844. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:34:39,272][367454] Avg episode reward: [(0, '4232.298')] [2023-03-08 08:34:42,288][367737] Updated weights for policy 0, policy_version 22480 (0.0005) [2023-03-08 08:34:44,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12629.3, 300 sec: 12857.3). Total num frames: 11534336. Throughput: 0: 12468.7. Samples: 11499180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:34:44,272][367454] Avg episode reward: [(0, '4355.173')] [2023-03-08 08:34:45,538][367737] Updated weights for policy 0, policy_version 22560 (0.0005) [2023-03-08 08:34:48,794][367737] Updated weights for policy 0, policy_version 22640 (0.0005) [2023-03-08 08:34:49,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12492.8, 300 sec: 12843.4). Total num frames: 11595776. Throughput: 0: 12465.2. Samples: 11575140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:34:49,272][367454] Avg episode reward: [(0, '4392.913')] [2023-03-08 08:34:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000022648_11595776.pth... [2023-03-08 08:34:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000021920_11223040.pth [2023-03-08 08:34:49,278][367693] Saving new best policy, reward=4392.913! [2023-03-08 08:34:51,992][367737] Updated weights for policy 0, policy_version 22720 (0.0004) [2023-03-08 08:34:54,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12829.5). Total num frames: 11661312. Throughput: 0: 12480.8. Samples: 11650612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:34:54,272][367454] Avg episode reward: [(0, '4340.188')] [2023-03-08 08:34:55,240][367737] Updated weights for policy 0, policy_version 22800 (0.0004) [2023-03-08 08:34:58,466][367737] Updated weights for policy 0, policy_version 22880 (0.0005) [2023-03-08 08:34:59,271][367454] Fps is (10 sec: 12697.7, 60 sec: 12492.8, 300 sec: 12801.7). Total num frames: 11722752. Throughput: 0: 12522.7. Samples: 11688700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:34:59,272][367454] Avg episode reward: [(0, '4067.508')] [2023-03-08 08:35:01,651][367737] Updated weights for policy 0, policy_version 22960 (0.0005) [2023-03-08 08:35:04,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12561.1, 300 sec: 12801.7). Total num frames: 11788288. Throughput: 0: 12531.3. Samples: 11765116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:35:04,272][367454] Avg episode reward: [(0, '4129.573')] [2023-03-08 08:35:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000023024_11788288.pth... [2023-03-08 08:35:04,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000022288_11411456.pth [2023-03-08 08:35:04,906][367737] Updated weights for policy 0, policy_version 23040 (0.0005) [2023-03-08 08:35:08,199][367737] Updated weights for policy 0, policy_version 23120 (0.0004) [2023-03-08 08:35:09,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12774.0). Total num frames: 11849728. Throughput: 0: 12530.1. Samples: 11840140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:35:09,272][367454] Avg episode reward: [(0, '4105.192')] [2023-03-08 08:35:11,587][367737] Updated weights for policy 0, policy_version 23200 (0.0005) [2023-03-08 08:35:14,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12561.1, 300 sec: 12746.2). Total num frames: 11911168. Throughput: 0: 12492.5. Samples: 11875380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:35:14,272][367454] Avg episode reward: [(0, '4090.660')] [2023-03-08 08:35:14,646][367737] Updated weights for policy 0, policy_version 23280 (0.0004) [2023-03-08 08:35:17,687][367737] Updated weights for policy 0, policy_version 23360 (0.0005) [2023-03-08 08:35:19,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12732.3). Total num frames: 11976704. Throughput: 0: 12630.0. Samples: 11956296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:35:19,272][367454] Avg episode reward: [(0, '4275.167')] [2023-03-08 08:35:19,277][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000023400_11980800.pth... [2023-03-08 08:35:19,280][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000022648_11595776.pth [2023-03-08 08:35:20,859][367737] Updated weights for policy 0, policy_version 23440 (0.0005) [2023-03-08 08:35:24,194][367737] Updated weights for policy 0, policy_version 23520 (0.0005) [2023-03-08 08:35:24,272][367454] Fps is (10 sec: 13107.2, 60 sec: 12629.3, 300 sec: 12718.4). Total num frames: 12042240. Throughput: 0: 12675.5. Samples: 12032244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:35:24,282][367454] Avg episode reward: [(0, '4230.371')] [2023-03-08 08:35:27,153][367737] Updated weights for policy 0, policy_version 23600 (0.0004) [2023-03-08 08:35:29,271][367454] Fps is (10 sec: 13516.8, 60 sec: 12765.9, 300 sec: 12732.3). Total num frames: 12111872. Throughput: 0: 12723.4. Samples: 12071732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:35:29,282][367454] Avg episode reward: [(0, '4271.675')] [2023-03-08 08:35:30,099][367737] Updated weights for policy 0, policy_version 23680 (0.0004) [2023-03-08 08:35:33,003][367737] Updated weights for policy 0, policy_version 23760 (0.0004) [2023-03-08 08:35:34,272][367454] Fps is (10 sec: 13926.3, 60 sec: 12834.1, 300 sec: 12760.1). Total num frames: 12181504. Throughput: 0: 12913.3. Samples: 12156240. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:35:34,283][367454] Avg episode reward: [(0, '4408.439')] [2023-03-08 08:35:34,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000023792_12181504.pth... [2023-03-08 08:35:34,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000023024_11788288.pth [2023-03-08 08:35:34,289][367693] Saving new best policy, reward=4408.439! [2023-03-08 08:35:35,917][367737] Updated weights for policy 0, policy_version 23840 (0.0004) [2023-03-08 08:35:38,774][367737] Updated weights for policy 0, policy_version 23920 (0.0004) [2023-03-08 08:35:39,272][367454] Fps is (10 sec: 13926.3, 60 sec: 13038.9, 300 sec: 12787.8). Total num frames: 12251136. Throughput: 0: 13122.0. Samples: 12241104. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:35:39,283][367454] Avg episode reward: [(0, '4396.876')] [2023-03-08 08:35:41,661][367737] Updated weights for policy 0, policy_version 24000 (0.0004) [2023-03-08 08:35:44,271][367454] Fps is (10 sec: 13926.6, 60 sec: 13107.2, 300 sec: 12815.6). Total num frames: 12320768. Throughput: 0: 13228.4. Samples: 12283976. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:35:44,282][367454] Avg episode reward: [(0, '4405.169')] [2023-03-08 08:35:44,882][367737] Updated weights for policy 0, policy_version 24080 (0.0004) [2023-03-08 08:35:48,093][367737] Updated weights for policy 0, policy_version 24160 (0.0005) [2023-03-08 08:35:49,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13107.2, 300 sec: 12829.5). Total num frames: 12382208. Throughput: 0: 13254.7. Samples: 12361576. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:35:49,272][367454] Avg episode reward: [(0, '3825.334')] [2023-03-08 08:35:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000024184_12382208.pth... [2023-03-08 08:35:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000023400_11980800.pth [2023-03-08 08:35:51,326][367737] Updated weights for policy 0, policy_version 24240 (0.0005) [2023-03-08 08:35:54,207][367737] Updated weights for policy 0, policy_version 24320 (0.0004) [2023-03-08 08:35:54,271][367454] Fps is (10 sec: 13107.2, 60 sec: 13175.5, 300 sec: 12857.3). Total num frames: 12451840. Throughput: 0: 13325.4. Samples: 12439784. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:35:54,272][367454] Avg episode reward: [(0, '4261.898')] [2023-03-08 08:35:57,184][367737] Updated weights for policy 0, policy_version 24400 (0.0004) [2023-03-08 08:35:59,271][367454] Fps is (10 sec: 13516.9, 60 sec: 13243.7, 300 sec: 12885.1). Total num frames: 12517376. Throughput: 0: 13476.9. Samples: 12481840. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:35:59,272][367454] Avg episode reward: [(0, '4259.951')] [2023-03-08 08:36:00,164][367737] Updated weights for policy 0, policy_version 24480 (0.0004) [2023-03-08 08:36:03,102][367737] Updated weights for policy 0, policy_version 24560 (0.0004) [2023-03-08 08:36:04,271][367454] Fps is (10 sec: 13516.8, 60 sec: 13312.0, 300 sec: 12898.9). Total num frames: 12587008. Throughput: 0: 13515.4. Samples: 12564488. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:36:04,272][367454] Avg episode reward: [(0, '4368.968')] [2023-03-08 08:36:04,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000024584_12587008.pth... [2023-03-08 08:36:04,276][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000023792_12181504.pth [2023-03-08 08:36:06,115][367737] Updated weights for policy 0, policy_version 24640 (0.0004) [2023-03-08 08:36:09,120][367737] Updated weights for policy 0, policy_version 24720 (0.0005) [2023-03-08 08:36:09,272][367454] Fps is (10 sec: 13926.3, 60 sec: 13448.5, 300 sec: 12926.7). Total num frames: 12656640. Throughput: 0: 13658.9. Samples: 12646896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:36:09,272][367454] Avg episode reward: [(0, '4401.778')] [2023-03-08 08:36:12,143][367737] Updated weights for policy 0, policy_version 24800 (0.0004) [2023-03-08 08:36:14,271][367454] Fps is (10 sec: 13926.4, 60 sec: 13585.1, 300 sec: 12954.5). Total num frames: 12726272. Throughput: 0: 13685.6. Samples: 12687584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:36:14,272][367454] Avg episode reward: [(0, '4230.709')] [2023-03-08 08:36:15,116][367737] Updated weights for policy 0, policy_version 24880 (0.0004) [2023-03-08 08:36:18,400][367737] Updated weights for policy 0, policy_version 24960 (0.0005) [2023-03-08 08:36:19,271][367454] Fps is (10 sec: 13107.3, 60 sec: 13516.8, 300 sec: 12954.5). Total num frames: 12787712. Throughput: 0: 13577.8. Samples: 12767240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:36:19,272][367454] Avg episode reward: [(0, '4282.671')] [2023-03-08 08:36:19,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000024976_12787712.pth... [2023-03-08 08:36:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000024184_12382208.pth [2023-03-08 08:36:21,596][367737] Updated weights for policy 0, policy_version 25040 (0.0005) [2023-03-08 08:36:24,272][367454] Fps is (10 sec: 12287.9, 60 sec: 13448.5, 300 sec: 12940.6). Total num frames: 12849152. Throughput: 0: 13334.8. Samples: 12841168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:36:24,272][367454] Avg episode reward: [(0, '3826.727')] [2023-03-08 08:36:24,994][367737] Updated weights for policy 0, policy_version 25120 (0.0005) [2023-03-08 08:36:28,326][367737] Updated weights for policy 0, policy_version 25200 (0.0005) [2023-03-08 08:36:29,272][367454] Fps is (10 sec: 12287.9, 60 sec: 13312.0, 300 sec: 12926.7). Total num frames: 12910592. Throughput: 0: 13206.8. Samples: 12878284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:36:29,272][367454] Avg episode reward: [(0, '3966.286')] [2023-03-08 08:36:31,727][367737] Updated weights for policy 0, policy_version 25280 (0.0004) [2023-03-08 08:36:34,271][367454] Fps is (10 sec: 12288.1, 60 sec: 13175.5, 300 sec: 12926.7). Total num frames: 12972032. Throughput: 0: 13112.2. Samples: 12951624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:36:34,272][367454] Avg episode reward: [(0, '3955.632')] [2023-03-08 08:36:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000025336_12972032.pth... [2023-03-08 08:36:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000024584_12587008.pth [2023-03-08 08:36:35,048][367737] Updated weights for policy 0, policy_version 25360 (0.0004) [2023-03-08 08:36:38,283][367737] Updated weights for policy 0, policy_version 25440 (0.0005) [2023-03-08 08:36:39,271][367454] Fps is (10 sec: 12697.7, 60 sec: 13107.2, 300 sec: 12926.7). Total num frames: 13037568. Throughput: 0: 13041.8. Samples: 13026664. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:36:39,272][367454] Avg episode reward: [(0, '4354.467')] [2023-03-08 08:36:41,509][367737] Updated weights for policy 0, policy_version 25520 (0.0005) [2023-03-08 08:36:44,271][367454] Fps is (10 sec: 12697.7, 60 sec: 12970.7, 300 sec: 12926.7). Total num frames: 13099008. Throughput: 0: 12958.7. Samples: 13064980. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:36:44,272][367454] Avg episode reward: [(0, '4288.385')] [2023-03-08 08:36:44,891][367737] Updated weights for policy 0, policy_version 25600 (0.0005) [2023-03-08 08:36:48,247][367737] Updated weights for policy 0, policy_version 25680 (0.0005) [2023-03-08 08:36:49,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12970.7, 300 sec: 12912.8). Total num frames: 13160448. Throughput: 0: 12729.2. Samples: 13137304. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:36:49,272][367454] Avg episode reward: [(0, '4252.565')] [2023-03-08 08:36:49,277][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000025704_13160448.pth... [2023-03-08 08:36:49,279][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000024976_12787712.pth [2023-03-08 08:36:51,530][367737] Updated weights for policy 0, policy_version 25760 (0.0005) [2023-03-08 08:36:54,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12834.1, 300 sec: 12885.0). Total num frames: 13221888. Throughput: 0: 12551.9. Samples: 13211732. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:36:54,272][367454] Avg episode reward: [(0, '4331.495')] [2023-03-08 08:36:54,918][367737] Updated weights for policy 0, policy_version 25840 (0.0005) [2023-03-08 08:36:58,128][367737] Updated weights for policy 0, policy_version 25920 (0.0005) [2023-03-08 08:36:59,271][367454] Fps is (10 sec: 12288.2, 60 sec: 12765.9, 300 sec: 12857.3). Total num frames: 13283328. Throughput: 0: 12487.7. Samples: 13249532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:36:59,272][367454] Avg episode reward: [(0, '4313.841')] [2023-03-08 08:37:01,420][367737] Updated weights for policy 0, policy_version 26000 (0.0005) [2023-03-08 08:37:04,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12629.3, 300 sec: 12829.5). Total num frames: 13344768. Throughput: 0: 12378.8. Samples: 13324288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:37:04,272][367454] Avg episode reward: [(0, '4316.803')] [2023-03-08 08:37:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000026064_13344768.pth... [2023-03-08 08:37:04,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000025336_12972032.pth [2023-03-08 08:37:04,766][367737] Updated weights for policy 0, policy_version 26080 (0.0005) [2023-03-08 08:37:08,008][367737] Updated weights for policy 0, policy_version 26160 (0.0005) [2023-03-08 08:37:09,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12492.8, 300 sec: 12815.6). Total num frames: 13406208. Throughput: 0: 12388.9. Samples: 13398668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:37:09,282][367454] Avg episode reward: [(0, '4386.014')] [2023-03-08 08:37:11,387][367737] Updated weights for policy 0, policy_version 26240 (0.0005) [2023-03-08 08:37:14,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 12801.7). Total num frames: 13467648. Throughput: 0: 12370.2. Samples: 13434944. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:37:14,282][367454] Avg episode reward: [(0, '4327.901')] [2023-03-08 08:37:14,830][367737] Updated weights for policy 0, policy_version 26320 (0.0005) [2023-03-08 08:37:18,119][367737] Updated weights for policy 0, policy_version 26400 (0.0005) [2023-03-08 08:37:19,271][367454] Fps is (10 sec: 12287.9, 60 sec: 12356.3, 300 sec: 12801.7). Total num frames: 13529088. Throughput: 0: 12377.4. Samples: 13508608. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:37:19,272][367454] Avg episode reward: [(0, '4235.496')] [2023-03-08 08:37:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000026424_13529088.pth... [2023-03-08 08:37:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000025704_13160448.pth [2023-03-08 08:37:21,428][367737] Updated weights for policy 0, policy_version 26480 (0.0005) [2023-03-08 08:37:24,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12787.9). Total num frames: 13590528. Throughput: 0: 12329.7. Samples: 13581500. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:37:24,282][367454] Avg episode reward: [(0, '4375.835')] [2023-03-08 08:37:24,905][367737] Updated weights for policy 0, policy_version 26560 (0.0005) [2023-03-08 08:37:28,271][367737] Updated weights for policy 0, policy_version 26640 (0.0005) [2023-03-08 08:37:29,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12356.3, 300 sec: 12774.0). Total num frames: 13651968. Throughput: 0: 12249.7. Samples: 13616216. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:37:29,282][367454] Avg episode reward: [(0, '4348.806')] [2023-03-08 08:37:31,614][367737] Updated weights for policy 0, policy_version 26720 (0.0005) [2023-03-08 08:37:34,271][367454] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 12760.1). Total num frames: 13709312. Throughput: 0: 12287.2. Samples: 13690228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:37:34,282][367454] Avg episode reward: [(0, '4319.338')] [2023-03-08 08:37:34,290][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000026784_13713408.pth... [2023-03-08 08:37:34,291][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000026064_13344768.pth [2023-03-08 08:37:34,974][367737] Updated weights for policy 0, policy_version 26800 (0.0005) [2023-03-08 08:37:38,066][367737] Updated weights for policy 0, policy_version 26880 (0.0004) [2023-03-08 08:37:39,271][367454] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 12774.0). Total num frames: 13774848. Throughput: 0: 12333.2. Samples: 13766728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:37:39,282][367454] Avg episode reward: [(0, '4320.752')] [2023-03-08 08:37:41,136][367737] Updated weights for policy 0, policy_version 26960 (0.0004) [2023-03-08 08:37:44,255][367737] Updated weights for policy 0, policy_version 27040 (0.0005) [2023-03-08 08:37:44,271][367454] Fps is (10 sec: 13516.8, 60 sec: 12424.5, 300 sec: 12801.7). Total num frames: 13844480. Throughput: 0: 12399.3. Samples: 13807500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:37:44,282][367454] Avg episode reward: [(0, '4238.368')] [2023-03-08 08:37:47,436][367737] Updated weights for policy 0, policy_version 27120 (0.0005) [2023-03-08 08:37:49,271][367454] Fps is (10 sec: 13107.2, 60 sec: 12424.6, 300 sec: 12787.9). Total num frames: 13905920. Throughput: 0: 12468.7. Samples: 13885380. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:37:49,282][367454] Avg episode reward: [(0, '4365.368')] [2023-03-08 08:37:49,301][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000027168_13910016.pth... [2023-03-08 08:37:49,303][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000026424_13529088.pth [2023-03-08 08:37:50,519][367737] Updated weights for policy 0, policy_version 27200 (0.0004) [2023-03-08 08:37:53,673][367737] Updated weights for policy 0, policy_version 27280 (0.0005) [2023-03-08 08:37:54,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12492.8, 300 sec: 12774.0). Total num frames: 13971456. Throughput: 0: 12548.2. Samples: 13963336. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:37:54,282][367454] Avg episode reward: [(0, '4254.947')] [2023-03-08 08:37:56,855][367737] Updated weights for policy 0, policy_version 27360 (0.0005) [2023-03-08 08:37:59,271][367454] Fps is (10 sec: 13107.2, 60 sec: 12561.1, 300 sec: 12774.0). Total num frames: 14036992. Throughput: 0: 12607.1. Samples: 14002264. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:37:59,282][367454] Avg episode reward: [(0, '4261.232')] [2023-03-08 08:38:00,069][367737] Updated weights for policy 0, policy_version 27440 (0.0005) [2023-03-08 08:38:03,231][367737] Updated weights for policy 0, policy_version 27520 (0.0004) [2023-03-08 08:38:04,272][367454] Fps is (10 sec: 13107.2, 60 sec: 12629.3, 300 sec: 12774.0). Total num frames: 14102528. Throughput: 0: 12661.5. Samples: 14078376. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:38:04,272][367454] Avg episode reward: [(0, '4316.201')] [2023-03-08 08:38:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000027544_14102528.pth... [2023-03-08 08:38:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000026784_13713408.pth [2023-03-08 08:38:06,271][367737] Updated weights for policy 0, policy_version 27600 (0.0004) [2023-03-08 08:38:09,271][367454] Fps is (10 sec: 13107.2, 60 sec: 12697.6, 300 sec: 12787.9). Total num frames: 14168064. Throughput: 0: 12845.2. Samples: 14159532. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:38:09,272][367454] Avg episode reward: [(0, '4303.256')] [2023-03-08 08:38:09,413][367737] Updated weights for policy 0, policy_version 27680 (0.0005) [2023-03-08 08:38:12,532][367737] Updated weights for policy 0, policy_version 27760 (0.0005) [2023-03-08 08:38:14,271][367454] Fps is (10 sec: 13107.4, 60 sec: 12765.9, 300 sec: 12801.7). Total num frames: 14233600. Throughput: 0: 12933.2. Samples: 14198212. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:38:14,272][367454] Avg episode reward: [(0, '4336.257')] [2023-03-08 08:38:15,620][367737] Updated weights for policy 0, policy_version 27840 (0.0004) [2023-03-08 08:38:18,730][367737] Updated weights for policy 0, policy_version 27920 (0.0004) [2023-03-08 08:38:19,271][367454] Fps is (10 sec: 13107.2, 60 sec: 12834.1, 300 sec: 12801.7). Total num frames: 14299136. Throughput: 0: 13055.5. Samples: 14277724. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:38:19,272][367454] Avg episode reward: [(0, '4295.503')] [2023-03-08 08:38:19,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000027928_14299136.pth... [2023-03-08 08:38:19,276][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000027168_13910016.pth [2023-03-08 08:38:21,822][367737] Updated weights for policy 0, policy_version 28000 (0.0005) [2023-03-08 08:38:24,271][367454] Fps is (10 sec: 13107.2, 60 sec: 12902.4, 300 sec: 12815.6). Total num frames: 14364672. Throughput: 0: 13107.2. Samples: 14356552. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:38:24,272][367454] Avg episode reward: [(0, '4067.501')] [2023-03-08 08:38:24,933][367737] Updated weights for policy 0, policy_version 28080 (0.0004) [2023-03-08 08:38:28,147][367737] Updated weights for policy 0, policy_version 28160 (0.0005) [2023-03-08 08:38:29,271][367454] Fps is (10 sec: 13107.2, 60 sec: 12970.7, 300 sec: 12829.5). Total num frames: 14430208. Throughput: 0: 13068.3. Samples: 14395572. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:38:29,272][367454] Avg episode reward: [(0, '4116.819')] [2023-03-08 08:38:31,583][367737] Updated weights for policy 0, policy_version 28240 (0.0005) [2023-03-08 08:38:34,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12970.7, 300 sec: 12801.7). Total num frames: 14487552. Throughput: 0: 12942.9. Samples: 14467812. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:38:34,272][367454] Avg episode reward: [(0, '3993.025')] [2023-03-08 08:38:34,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000028296_14487552.pth... [2023-03-08 08:38:34,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000027544_14102528.pth [2023-03-08 08:38:35,042][367737] Updated weights for policy 0, policy_version 28320 (0.0005) [2023-03-08 08:38:38,465][367737] Updated weights for policy 0, policy_version 28400 (0.0005) [2023-03-08 08:38:39,271][367454] Fps is (10 sec: 11878.4, 60 sec: 12902.4, 300 sec: 12787.9). Total num frames: 14548992. Throughput: 0: 12821.8. Samples: 14540316. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:38:39,272][367454] Avg episode reward: [(0, '4013.200')] [2023-03-08 08:38:41,878][367737] Updated weights for policy 0, policy_version 28480 (0.0005) [2023-03-08 08:38:44,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12765.9, 300 sec: 12760.1). Total num frames: 14610432. Throughput: 0: 12752.7. Samples: 14576136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:38:44,272][367454] Avg episode reward: [(0, '4209.459')] [2023-03-08 08:38:45,152][367737] Updated weights for policy 0, policy_version 28560 (0.0005) [2023-03-08 08:38:48,568][367737] Updated weights for policy 0, policy_version 28640 (0.0005) [2023-03-08 08:38:49,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12765.8, 300 sec: 12746.2). Total num frames: 14671872. Throughput: 0: 12699.1. Samples: 14649836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:38:49,272][367454] Avg episode reward: [(0, '4243.820')] [2023-03-08 08:38:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000028656_14671872.pth... [2023-03-08 08:38:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000027928_14299136.pth [2023-03-08 08:38:51,861][367737] Updated weights for policy 0, policy_version 28720 (0.0004) [2023-03-08 08:38:54,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12697.6, 300 sec: 12746.2). Total num frames: 14733312. Throughput: 0: 12563.2. Samples: 14724876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:38:54,272][367454] Avg episode reward: [(0, '4226.323')] [2023-03-08 08:38:55,043][367737] Updated weights for policy 0, policy_version 28800 (0.0004) [2023-03-08 08:38:58,224][367737] Updated weights for policy 0, policy_version 28880 (0.0004) [2023-03-08 08:38:59,272][367454] Fps is (10 sec: 12697.7, 60 sec: 12697.6, 300 sec: 12760.1). Total num frames: 14798848. Throughput: 0: 12549.4. Samples: 14762936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:38:59,272][367454] Avg episode reward: [(0, '4262.860')] [2023-03-08 08:39:01,390][367737] Updated weights for policy 0, policy_version 28960 (0.0004) [2023-03-08 08:39:04,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12760.1). Total num frames: 14860288. Throughput: 0: 12490.9. Samples: 14839816. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:39:04,272][367454] Avg episode reward: [(0, '4255.995')] [2023-03-08 08:39:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000029024_14860288.pth... [2023-03-08 08:39:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000028296_14487552.pth [2023-03-08 08:39:04,836][367737] Updated weights for policy 0, policy_version 29040 (0.0005) [2023-03-08 08:39:08,017][367737] Updated weights for policy 0, policy_version 29120 (0.0005) [2023-03-08 08:39:09,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12774.0). Total num frames: 14925824. Throughput: 0: 12386.6. Samples: 14913952. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:39:09,272][367454] Avg episode reward: [(0, '4290.759')] [2023-03-08 08:39:11,096][367737] Updated weights for policy 0, policy_version 29200 (0.0004) [2023-03-08 08:39:14,271][367454] Fps is (10 sec: 12697.7, 60 sec: 12561.1, 300 sec: 12760.1). Total num frames: 14987264. Throughput: 0: 12420.3. Samples: 14954488. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:39:14,272][367454] Avg episode reward: [(0, '4364.812')] [2023-03-08 08:39:14,378][367737] Updated weights for policy 0, policy_version 29280 (0.0005) [2023-03-08 08:39:17,887][367737] Updated weights for policy 0, policy_version 29360 (0.0005) [2023-03-08 08:39:19,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12492.8, 300 sec: 12760.1). Total num frames: 15048704. Throughput: 0: 12438.2. Samples: 15027532. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:39:19,272][367454] Avg episode reward: [(0, '4361.922')] [2023-03-08 08:39:19,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000029392_15048704.pth... [2023-03-08 08:39:19,276][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000028656_14671872.pth [2023-03-08 08:39:21,364][367737] Updated weights for policy 0, policy_version 29440 (0.0005) [2023-03-08 08:39:24,271][367454] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 12746.2). Total num frames: 15106048. Throughput: 0: 12376.5. Samples: 15097260. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:39:24,272][367454] Avg episode reward: [(0, '4308.496')] [2023-03-08 08:39:24,855][367737] Updated weights for policy 0, policy_version 29520 (0.0005) [2023-03-08 08:39:28,341][367737] Updated weights for policy 0, policy_version 29600 (0.0005) [2023-03-08 08:39:29,272][367454] Fps is (10 sec: 11468.7, 60 sec: 12219.7, 300 sec: 12718.4). Total num frames: 15163392. Throughput: 0: 12349.7. Samples: 15131872. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:39:29,272][367454] Avg episode reward: [(0, '4300.065')] [2023-03-08 08:39:31,547][367737] Updated weights for policy 0, policy_version 29680 (0.0005) [2023-03-08 08:39:34,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12746.2). Total num frames: 15228928. Throughput: 0: 12390.1. Samples: 15207392. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:39:34,272][367454] Avg episode reward: [(0, '4265.826')] [2023-03-08 08:39:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000029744_15228928.pth... [2023-03-08 08:39:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000029024_14860288.pth [2023-03-08 08:39:34,782][367737] Updated weights for policy 0, policy_version 29760 (0.0004) [2023-03-08 08:39:38,296][367737] Updated weights for policy 0, policy_version 29840 (0.0005) [2023-03-08 08:39:39,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12718.4). Total num frames: 15286272. Throughput: 0: 12315.9. Samples: 15279092. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:39:39,272][367454] Avg episode reward: [(0, '4283.815')] [2023-03-08 08:39:41,714][367737] Updated weights for policy 0, policy_version 29920 (0.0004) [2023-03-08 08:39:44,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 12718.4). Total num frames: 15347712. Throughput: 0: 12274.9. Samples: 15315308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:39:44,272][367454] Avg episode reward: [(0, '4304.983')] [2023-03-08 08:39:45,268][367737] Updated weights for policy 0, policy_version 30000 (0.0005) [2023-03-08 08:39:48,824][367737] Updated weights for policy 0, policy_version 30080 (0.0005) [2023-03-08 08:39:49,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12690.7). Total num frames: 15405056. Throughput: 0: 12106.0. Samples: 15384588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:39:49,272][367454] Avg episode reward: [(0, '4324.322')] [2023-03-08 08:39:49,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000030088_15405056.pth... [2023-03-08 08:39:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000029392_15048704.pth [2023-03-08 08:39:52,431][367737] Updated weights for policy 0, policy_version 30160 (0.0005) [2023-03-08 08:39:54,272][367454] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 12676.8). Total num frames: 15462400. Throughput: 0: 11988.1. Samples: 15453416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:39:54,272][367454] Avg episode reward: [(0, '4099.359')] [2023-03-08 08:39:55,932][367737] Updated weights for policy 0, policy_version 30240 (0.0005) [2023-03-08 08:39:59,272][367454] Fps is (10 sec: 11468.9, 60 sec: 12014.9, 300 sec: 12649.0). Total num frames: 15519744. Throughput: 0: 11856.2. Samples: 15488016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:39:59,272][367454] Avg episode reward: [(0, '3918.231')] [2023-03-08 08:39:59,514][367737] Updated weights for policy 0, policy_version 30320 (0.0006) [2023-03-08 08:40:03,167][367737] Updated weights for policy 0, policy_version 30400 (0.0006) [2023-03-08 08:40:04,272][367454] Fps is (10 sec: 11468.6, 60 sec: 11946.6, 300 sec: 12635.1). Total num frames: 15577088. Throughput: 0: 11757.2. Samples: 15556608. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:40:04,272][367454] Avg episode reward: [(0, '4283.376')] [2023-03-08 08:40:04,277][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000030424_15577088.pth... [2023-03-08 08:40:04,279][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000029744_15228928.pth [2023-03-08 08:40:06,660][367737] Updated weights for policy 0, policy_version 30480 (0.0004) [2023-03-08 08:40:09,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 12621.2). Total num frames: 15634432. Throughput: 0: 11756.5. Samples: 15626304. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:40:09,272][367454] Avg episode reward: [(0, '4217.170')] [2023-03-08 08:40:10,019][367737] Updated weights for policy 0, policy_version 30560 (0.0004) [2023-03-08 08:40:13,418][367737] Updated weights for policy 0, policy_version 30640 (0.0004) [2023-03-08 08:40:14,272][367454] Fps is (10 sec: 11878.6, 60 sec: 11810.1, 300 sec: 12607.3). Total num frames: 15695872. Throughput: 0: 11821.5. Samples: 15663840. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:40:14,272][367454] Avg episode reward: [(0, '4250.405')] [2023-03-08 08:40:17,031][367737] Updated weights for policy 0, policy_version 30720 (0.0006) [2023-03-08 08:40:19,272][367454] Fps is (10 sec: 11878.2, 60 sec: 11741.8, 300 sec: 12579.6). Total num frames: 15753216. Throughput: 0: 11675.9. Samples: 15732808. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:40:19,272][367454] Avg episode reward: [(0, '4239.302')] [2023-03-08 08:40:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000030768_15753216.pth... [2023-03-08 08:40:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000030088_15405056.pth [2023-03-08 08:40:20,659][367737] Updated weights for policy 0, policy_version 30800 (0.0006) [2023-03-08 08:40:24,078][367737] Updated weights for policy 0, policy_version 30880 (0.0005) [2023-03-08 08:40:24,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 12537.9). Total num frames: 15810560. Throughput: 0: 11629.8. Samples: 15802432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:40:24,272][367454] Avg episode reward: [(0, '4361.877')] [2023-03-08 08:40:27,520][367737] Updated weights for policy 0, policy_version 30960 (0.0006) [2023-03-08 08:40:29,271][367454] Fps is (10 sec: 11878.6, 60 sec: 11810.1, 300 sec: 12510.2). Total num frames: 15872000. Throughput: 0: 11630.9. Samples: 15838696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:40:29,272][367454] Avg episode reward: [(0, '3995.738')] [2023-03-08 08:40:30,943][367737] Updated weights for policy 0, policy_version 31040 (0.0005) [2023-03-08 08:40:34,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 12468.5). Total num frames: 15929344. Throughput: 0: 11665.7. Samples: 15909544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:40:34,272][367454] Avg episode reward: [(0, '4145.280')] [2023-03-08 08:40:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000031112_15929344.pth... [2023-03-08 08:40:34,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000030424_15577088.pth [2023-03-08 08:40:34,454][367737] Updated weights for policy 0, policy_version 31120 (0.0006) [2023-03-08 08:40:37,907][367737] Updated weights for policy 0, policy_version 31200 (0.0006) [2023-03-08 08:40:39,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 12440.7). Total num frames: 15990784. Throughput: 0: 11707.7. Samples: 15980264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:40:39,272][367454] Avg episode reward: [(0, '4277.915')] [2023-03-08 08:40:41,387][367737] Updated weights for policy 0, policy_version 31280 (0.0006) [2023-03-08 08:40:44,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 12426.8). Total num frames: 16048128. Throughput: 0: 11720.2. Samples: 16015424. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:40:44,272][367454] Avg episode reward: [(0, '4232.165')] [2023-03-08 08:40:44,890][367737] Updated weights for policy 0, policy_version 31360 (0.0006) [2023-03-08 08:40:48,375][367737] Updated weights for policy 0, policy_version 31440 (0.0006) [2023-03-08 08:40:49,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12385.2). Total num frames: 16105472. Throughput: 0: 11769.7. Samples: 16086240. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:40:49,272][367454] Avg episode reward: [(0, '4264.951')] [2023-03-08 08:40:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000031456_16105472.pth... [2023-03-08 08:40:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000030768_15753216.pth [2023-03-08 08:40:51,913][367737] Updated weights for policy 0, policy_version 31520 (0.0005) [2023-03-08 08:40:54,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 12371.3). Total num frames: 16166912. Throughput: 0: 11799.0. Samples: 16157260. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:40:54,272][367454] Avg episode reward: [(0, '4176.305')] [2023-03-08 08:40:55,249][367737] Updated weights for policy 0, policy_version 31600 (0.0004) [2023-03-08 08:40:58,525][367737] Updated weights for policy 0, policy_version 31680 (0.0004) [2023-03-08 08:40:59,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 12343.5). Total num frames: 16228352. Throughput: 0: 11748.8. Samples: 16192536. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:40:59,272][367454] Avg episode reward: [(0, '4354.852')] [2023-03-08 08:41:01,892][367737] Updated weights for policy 0, policy_version 31760 (0.0004) [2023-03-08 08:41:04,271][367454] Fps is (10 sec: 11878.4, 60 sec: 11810.2, 300 sec: 12301.9). Total num frames: 16285696. Throughput: 0: 11884.1. Samples: 16267592. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:41:04,272][367454] Avg episode reward: [(0, '4333.005')] [2023-03-08 08:41:04,336][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000031816_16289792.pth... [2023-03-08 08:41:04,339][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000031112_15929344.pth [2023-03-08 08:41:05,254][367737] Updated weights for policy 0, policy_version 31840 (0.0005) [2023-03-08 08:41:08,461][367737] Updated weights for policy 0, policy_version 31920 (0.0004) [2023-03-08 08:41:09,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 12288.0). Total num frames: 16351232. Throughput: 0: 11992.2. Samples: 16342080. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:41:09,272][367454] Avg episode reward: [(0, '4289.253')] [2023-03-08 08:41:11,633][367737] Updated weights for policy 0, policy_version 32000 (0.0005) [2023-03-08 08:41:14,272][367454] Fps is (10 sec: 13107.2, 60 sec: 12014.9, 300 sec: 12301.9). Total num frames: 16416768. Throughput: 0: 12038.3. Samples: 16380420. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:41:14,272][367454] Avg episode reward: [(0, '4363.023')] [2023-03-08 08:41:14,723][367737] Updated weights for policy 0, policy_version 32080 (0.0004) [2023-03-08 08:41:17,909][367737] Updated weights for policy 0, policy_version 32160 (0.0004) [2023-03-08 08:41:19,272][367454] Fps is (10 sec: 13107.2, 60 sec: 12151.5, 300 sec: 12315.8). Total num frames: 16482304. Throughput: 0: 12221.3. Samples: 16459500. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:41:19,272][367454] Avg episode reward: [(0, '4342.845')] [2023-03-08 08:41:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000032192_16482304.pth... [2023-03-08 08:41:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000031456_16105472.pth [2023-03-08 08:41:21,114][367737] Updated weights for policy 0, policy_version 32240 (0.0004) [2023-03-08 08:41:24,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 12315.8). Total num frames: 16543744. Throughput: 0: 12341.3. Samples: 16535624. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:41:24,272][367454] Avg episode reward: [(0, '4301.638')] [2023-03-08 08:41:24,339][367737] Updated weights for policy 0, policy_version 32320 (0.0005) [2023-03-08 08:41:27,528][367737] Updated weights for policy 0, policy_version 32400 (0.0004) [2023-03-08 08:41:29,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 12329.7). Total num frames: 16609280. Throughput: 0: 12405.1. Samples: 16573652. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:41:29,272][367454] Avg episode reward: [(0, '4333.465')] [2023-03-08 08:41:30,738][367737] Updated weights for policy 0, policy_version 32480 (0.0005) [2023-03-08 08:41:33,878][367737] Updated weights for policy 0, policy_version 32560 (0.0004) [2023-03-08 08:41:34,272][367454] Fps is (10 sec: 13107.1, 60 sec: 12424.5, 300 sec: 12329.6). Total num frames: 16674816. Throughput: 0: 12552.5. Samples: 16651104. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:41:34,272][367454] Avg episode reward: [(0, '4382.296')] [2023-03-08 08:41:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000032568_16674816.pth... [2023-03-08 08:41:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000031816_16289792.pth [2023-03-08 08:41:37,037][367737] Updated weights for policy 0, policy_version 32640 (0.0004) [2023-03-08 08:41:39,272][367454] Fps is (10 sec: 13107.2, 60 sec: 12492.8, 300 sec: 12343.5). Total num frames: 16740352. Throughput: 0: 12717.3. Samples: 16729540. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:41:39,272][367454] Avg episode reward: [(0, '4232.936')] [2023-03-08 08:41:40,151][367737] Updated weights for policy 0, policy_version 32720 (0.0004) [2023-03-08 08:41:43,335][367737] Updated weights for policy 0, policy_version 32800 (0.0004) [2023-03-08 08:41:44,271][367454] Fps is (10 sec: 12697.8, 60 sec: 12561.1, 300 sec: 12343.5). Total num frames: 16801792. Throughput: 0: 12809.5. Samples: 16768964. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:41:44,272][367454] Avg episode reward: [(0, '4036.475')] [2023-03-08 08:41:46,502][367737] Updated weights for policy 0, policy_version 32880 (0.0005) [2023-03-08 08:41:49,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12697.6, 300 sec: 12357.4). Total num frames: 16867328. Throughput: 0: 12869.2. Samples: 16846708. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:41:49,272][367454] Avg episode reward: [(0, '4054.340')] [2023-03-08 08:41:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000032944_16867328.pth... [2023-03-08 08:41:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000032192_16482304.pth [2023-03-08 08:41:49,713][367737] Updated weights for policy 0, policy_version 32960 (0.0005) [2023-03-08 08:41:52,890][367737] Updated weights for policy 0, policy_version 33040 (0.0005) [2023-03-08 08:41:54,272][367454] Fps is (10 sec: 13107.2, 60 sec: 12765.9, 300 sec: 12371.3). Total num frames: 16932864. Throughput: 0: 12917.0. Samples: 16923344. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:41:54,272][367454] Avg episode reward: [(0, '4186.262')] [2023-03-08 08:41:56,073][367737] Updated weights for policy 0, policy_version 33120 (0.0004) [2023-03-08 08:41:59,252][367737] Updated weights for policy 0, policy_version 33200 (0.0004) [2023-03-08 08:41:59,272][367454] Fps is (10 sec: 13107.2, 60 sec: 12834.1, 300 sec: 12385.2). Total num frames: 16998400. Throughput: 0: 12915.1. Samples: 16961600. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:41:59,272][367454] Avg episode reward: [(0, '4310.896')] [2023-03-08 08:42:02,395][367737] Updated weights for policy 0, policy_version 33280 (0.0004) [2023-03-08 08:42:04,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12902.4, 300 sec: 12385.2). Total num frames: 17059840. Throughput: 0: 12887.2. Samples: 17039424. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:42:04,272][367454] Avg episode reward: [(0, '4333.507')] [2023-03-08 08:42:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000033320_17059840.pth... [2023-03-08 08:42:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000032568_16674816.pth [2023-03-08 08:42:05,706][367737] Updated weights for policy 0, policy_version 33360 (0.0004) [2023-03-08 08:42:08,930][367737] Updated weights for policy 0, policy_version 33440 (0.0004) [2023-03-08 08:42:09,271][367454] Fps is (10 sec: 12697.7, 60 sec: 12902.4, 300 sec: 12399.1). Total num frames: 17125376. Throughput: 0: 12860.3. Samples: 17114336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:42:09,272][367454] Avg episode reward: [(0, '4226.900')] [2023-03-08 08:42:12,163][367737] Updated weights for policy 0, policy_version 33520 (0.0005) [2023-03-08 08:42:14,271][367454] Fps is (10 sec: 12697.7, 60 sec: 12834.1, 300 sec: 12399.1). Total num frames: 17186816. Throughput: 0: 12865.4. Samples: 17152596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:42:14,272][367454] Avg episode reward: [(0, '4329.524')] [2023-03-08 08:42:15,353][367737] Updated weights for policy 0, policy_version 33600 (0.0004) [2023-03-08 08:42:18,634][367737] Updated weights for policy 0, policy_version 33680 (0.0005) [2023-03-08 08:42:19,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12834.1, 300 sec: 12413.0). Total num frames: 17252352. Throughput: 0: 12821.5. Samples: 17228068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:42:19,272][367454] Avg episode reward: [(0, '4285.496')] [2023-03-08 08:42:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000033696_17252352.pth... [2023-03-08 08:42:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000032944_16867328.pth [2023-03-08 08:42:21,814][367737] Updated weights for policy 0, policy_version 33760 (0.0005) [2023-03-08 08:42:24,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12834.1, 300 sec: 12413.0). Total num frames: 17313792. Throughput: 0: 12806.9. Samples: 17305848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:42:24,282][367454] Avg episode reward: [(0, '4357.225')] [2023-03-08 08:42:24,948][367737] Updated weights for policy 0, policy_version 33840 (0.0004) [2023-03-08 08:42:28,120][367737] Updated weights for policy 0, policy_version 33920 (0.0005) [2023-03-08 08:42:29,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12834.1, 300 sec: 12440.7). Total num frames: 17379328. Throughput: 0: 12798.9. Samples: 17344916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:42:29,283][367454] Avg episode reward: [(0, '4339.897')] [2023-03-08 08:42:31,265][367737] Updated weights for policy 0, policy_version 34000 (0.0005) [2023-03-08 08:42:34,272][367454] Fps is (10 sec: 13107.1, 60 sec: 12834.1, 300 sec: 12440.7). Total num frames: 17444864. Throughput: 0: 12807.5. Samples: 17423044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:42:34,282][367454] Avg episode reward: [(0, '4362.620')] [2023-03-08 08:42:34,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000034072_17444864.pth... [2023-03-08 08:42:34,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000033320_17059840.pth [2023-03-08 08:42:34,592][367737] Updated weights for policy 0, policy_version 34080 (0.0005) [2023-03-08 08:42:38,128][367737] Updated weights for policy 0, policy_version 34160 (0.0005) [2023-03-08 08:42:39,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12697.6, 300 sec: 12399.1). Total num frames: 17502208. Throughput: 0: 12675.6. Samples: 17493748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:42:39,282][367454] Avg episode reward: [(0, '4370.716')] [2023-03-08 08:42:41,336][367737] Updated weights for policy 0, policy_version 34240 (0.0005) [2023-03-08 08:42:44,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12765.9, 300 sec: 12413.0). Total num frames: 17567744. Throughput: 0: 12659.5. Samples: 17531276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:42:44,282][367454] Avg episode reward: [(0, '4065.823')] [2023-03-08 08:42:44,396][367737] Updated weights for policy 0, policy_version 34320 (0.0004) [2023-03-08 08:42:47,338][367737] Updated weights for policy 0, policy_version 34400 (0.0004) [2023-03-08 08:42:49,272][367454] Fps is (10 sec: 13516.8, 60 sec: 12834.1, 300 sec: 12426.8). Total num frames: 17637376. Throughput: 0: 12751.2. Samples: 17613228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:42:49,282][367454] Avg episode reward: [(0, '3925.857')] [2023-03-08 08:42:49,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000034448_17637376.pth... [2023-03-08 08:42:49,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000033696_17252352.pth [2023-03-08 08:42:50,353][367737] Updated weights for policy 0, policy_version 34480 (0.0004) [2023-03-08 08:42:53,427][367737] Updated weights for policy 0, policy_version 34560 (0.0005) [2023-03-08 08:42:54,272][367454] Fps is (10 sec: 13516.8, 60 sec: 12834.1, 300 sec: 12426.8). Total num frames: 17702912. Throughput: 0: 12897.4. Samples: 17694720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:42:54,283][367454] Avg episode reward: [(0, '4026.348')] [2023-03-08 08:42:56,442][367737] Updated weights for policy 0, policy_version 34640 (0.0004) [2023-03-08 08:42:59,272][367454] Fps is (10 sec: 13516.8, 60 sec: 12902.4, 300 sec: 12440.7). Total num frames: 17772544. Throughput: 0: 12946.7. Samples: 17735196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:42:59,282][367454] Avg episode reward: [(0, '4382.669')] [2023-03-08 08:42:59,544][367737] Updated weights for policy 0, policy_version 34720 (0.0005) [2023-03-08 08:43:02,593][367737] Updated weights for policy 0, policy_version 34800 (0.0004) [2023-03-08 08:43:04,272][367454] Fps is (10 sec: 13516.7, 60 sec: 12970.7, 300 sec: 12440.7). Total num frames: 17838080. Throughput: 0: 13043.0. Samples: 17815004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:43:04,283][367454] Avg episode reward: [(0, '4300.049')] [2023-03-08 08:43:04,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000034840_17838080.pth... [2023-03-08 08:43:04,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000034072_17444864.pth [2023-03-08 08:43:05,692][367737] Updated weights for policy 0, policy_version 34880 (0.0005) [2023-03-08 08:43:09,003][367737] Updated weights for policy 0, policy_version 34960 (0.0005) [2023-03-08 08:43:09,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12902.4, 300 sec: 12426.8). Total num frames: 17899520. Throughput: 0: 13021.2. Samples: 17891804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:43:09,282][367454] Avg episode reward: [(0, '4385.355')] [2023-03-08 08:43:12,041][367737] Updated weights for policy 0, policy_version 35040 (0.0004) [2023-03-08 08:43:14,271][367454] Fps is (10 sec: 13107.3, 60 sec: 13038.9, 300 sec: 12440.7). Total num frames: 17969152. Throughput: 0: 13049.3. Samples: 17932136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:43:14,282][367454] Avg episode reward: [(0, '4318.865')] [2023-03-08 08:43:15,283][367737] Updated weights for policy 0, policy_version 35120 (0.0005) [2023-03-08 08:43:18,683][367737] Updated weights for policy 0, policy_version 35200 (0.0005) [2023-03-08 08:43:19,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12902.4, 300 sec: 12413.0). Total num frames: 18026496. Throughput: 0: 12985.3. Samples: 18007380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:43:19,282][367454] Avg episode reward: [(0, '4195.783')] [2023-03-08 08:43:19,284][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000035208_18026496.pth... [2023-03-08 08:43:19,286][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000034448_17637376.pth [2023-03-08 08:43:21,736][367737] Updated weights for policy 0, policy_version 35280 (0.0005) [2023-03-08 08:43:24,272][367454] Fps is (10 sec: 12697.6, 60 sec: 13038.9, 300 sec: 12426.8). Total num frames: 18096128. Throughput: 0: 13151.5. Samples: 18085564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:43:24,272][367454] Avg episode reward: [(0, '4368.475')] [2023-03-08 08:43:24,845][367737] Updated weights for policy 0, policy_version 35360 (0.0004) [2023-03-08 08:43:28,174][367737] Updated weights for policy 0, policy_version 35440 (0.0005) [2023-03-08 08:43:29,272][367454] Fps is (10 sec: 13107.1, 60 sec: 12970.7, 300 sec: 12440.7). Total num frames: 18157568. Throughput: 0: 13175.8. Samples: 18124188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:43:29,272][367454] Avg episode reward: [(0, '4391.242')] [2023-03-08 08:43:31,446][367737] Updated weights for policy 0, policy_version 35520 (0.0004) [2023-03-08 08:43:34,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12902.4, 300 sec: 12440.7). Total num frames: 18219008. Throughput: 0: 13003.8. Samples: 18198400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:43:34,272][367454] Avg episode reward: [(0, '4398.205')] [2023-03-08 08:43:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000035584_18219008.pth... [2023-03-08 08:43:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000034840_17838080.pth [2023-03-08 08:43:34,852][367737] Updated weights for policy 0, policy_version 35600 (0.0005) [2023-03-08 08:43:38,235][367737] Updated weights for policy 0, policy_version 35680 (0.0005) [2023-03-08 08:43:39,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12970.7, 300 sec: 12440.7). Total num frames: 18280448. Throughput: 0: 12791.6. Samples: 18270344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:43:39,272][367454] Avg episode reward: [(0, '4271.935')] [2023-03-08 08:43:41,480][367737] Updated weights for policy 0, policy_version 35760 (0.0004) [2023-03-08 08:43:44,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12902.4, 300 sec: 12440.7). Total num frames: 18341888. Throughput: 0: 12746.2. Samples: 18308776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:43:44,272][367454] Avg episode reward: [(0, '4356.242')] [2023-03-08 08:43:44,911][367737] Updated weights for policy 0, policy_version 35840 (0.0004) [2023-03-08 08:43:48,309][367737] Updated weights for policy 0, policy_version 35920 (0.0005) [2023-03-08 08:43:49,272][367454] Fps is (10 sec: 11878.3, 60 sec: 12697.6, 300 sec: 12426.8). Total num frames: 18399232. Throughput: 0: 12535.3. Samples: 18379092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:43:49,272][367454] Avg episode reward: [(0, '4326.003')] [2023-03-08 08:43:49,289][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000035944_18403328.pth... [2023-03-08 08:43:49,290][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000035208_18026496.pth [2023-03-08 08:43:51,540][367737] Updated weights for policy 0, policy_version 36000 (0.0005) [2023-03-08 08:43:54,271][367454] Fps is (10 sec: 11878.5, 60 sec: 12629.3, 300 sec: 12413.0). Total num frames: 18460672. Throughput: 0: 12482.7. Samples: 18453524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:43:54,272][367454] Avg episode reward: [(0, '4391.831')] [2023-03-08 08:43:54,937][367737] Updated weights for policy 0, policy_version 36080 (0.0004) [2023-03-08 08:43:58,075][367737] Updated weights for policy 0, policy_version 36160 (0.0004) [2023-03-08 08:43:59,272][367454] Fps is (10 sec: 12697.7, 60 sec: 12561.1, 300 sec: 12426.8). Total num frames: 18526208. Throughput: 0: 12445.7. Samples: 18492192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:43:59,272][367454] Avg episode reward: [(0, '4361.107')] [2023-03-08 08:44:01,268][367737] Updated weights for policy 0, policy_version 36240 (0.0004) [2023-03-08 08:44:04,271][367454] Fps is (10 sec: 13107.2, 60 sec: 12561.1, 300 sec: 12426.8). Total num frames: 18591744. Throughput: 0: 12496.2. Samples: 18569708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:44:04,272][367454] Avg episode reward: [(0, '4359.000')] [2023-03-08 08:44:04,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000036312_18591744.pth... [2023-03-08 08:44:04,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000035584_18219008.pth [2023-03-08 08:44:04,463][367737] Updated weights for policy 0, policy_version 36320 (0.0004) [2023-03-08 08:44:07,632][367737] Updated weights for policy 0, policy_version 36400 (0.0004) [2023-03-08 08:44:09,272][367454] Fps is (10 sec: 13107.2, 60 sec: 12629.3, 300 sec: 12440.7). Total num frames: 18657280. Throughput: 0: 12475.1. Samples: 18646944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:44:09,272][367454] Avg episode reward: [(0, '4335.799')] [2023-03-08 08:44:10,857][367737] Updated weights for policy 0, policy_version 36480 (0.0004) [2023-03-08 08:44:14,047][367737] Updated weights for policy 0, policy_version 36560 (0.0005) [2023-03-08 08:44:14,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12440.7). Total num frames: 18718720. Throughput: 0: 12449.9. Samples: 18684432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:44:14,272][367454] Avg episode reward: [(0, '4373.670')] [2023-03-08 08:44:17,159][367737] Updated weights for policy 0, policy_version 36640 (0.0004) [2023-03-08 08:44:19,271][367454] Fps is (10 sec: 12697.7, 60 sec: 12629.3, 300 sec: 12468.5). Total num frames: 18784256. Throughput: 0: 12547.8. Samples: 18763048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:44:19,272][367454] Avg episode reward: [(0, '4348.795')] [2023-03-08 08:44:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000036688_18784256.pth... [2023-03-08 08:44:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000035944_18403328.pth [2023-03-08 08:44:20,387][367737] Updated weights for policy 0, policy_version 36720 (0.0003) [2023-03-08 08:44:23,635][367737] Updated weights for policy 0, policy_version 36800 (0.0004) [2023-03-08 08:44:24,272][367454] Fps is (10 sec: 13107.2, 60 sec: 12561.1, 300 sec: 12496.3). Total num frames: 18849792. Throughput: 0: 12629.2. Samples: 18838656. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:44:24,272][367454] Avg episode reward: [(0, '4312.699')] [2023-03-08 08:44:26,997][367737] Updated weights for policy 0, policy_version 36880 (0.0005) [2023-03-08 08:44:29,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12468.5). Total num frames: 18907136. Throughput: 0: 12582.2. Samples: 18874976. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:44:29,272][367454] Avg episode reward: [(0, '4235.383')] [2023-03-08 08:44:30,508][367737] Updated weights for policy 0, policy_version 36960 (0.0005) [2023-03-08 08:44:33,981][367737] Updated weights for policy 0, policy_version 37040 (0.0006) [2023-03-08 08:44:34,271][367454] Fps is (10 sec: 11468.8, 60 sec: 12424.6, 300 sec: 12468.5). Total num frames: 18964480. Throughput: 0: 12594.1. Samples: 18945824. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:44:34,272][367454] Avg episode reward: [(0, '4046.704')] [2023-03-08 08:44:34,325][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000037048_18968576.pth... [2023-03-08 08:44:34,327][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000036312_18591744.pth [2023-03-08 08:44:37,484][367737] Updated weights for policy 0, policy_version 37120 (0.0006) [2023-03-08 08:44:39,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 12468.5). Total num frames: 19025920. Throughput: 0: 12513.5. Samples: 19016632. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:44:39,282][367454] Avg episode reward: [(0, '3985.074')] [2023-03-08 08:44:40,995][367737] Updated weights for policy 0, policy_version 37200 (0.0005) [2023-03-08 08:44:44,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 12468.5). Total num frames: 19083264. Throughput: 0: 12413.1. Samples: 19050780. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:44:44,282][367454] Avg episode reward: [(0, '3893.076')] [2023-03-08 08:44:44,398][367737] Updated weights for policy 0, policy_version 37280 (0.0006) [2023-03-08 08:44:47,864][367737] Updated weights for policy 0, policy_version 37360 (0.0005) [2023-03-08 08:44:49,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 12482.4). Total num frames: 19144704. Throughput: 0: 12311.5. Samples: 19123724. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:44:49,272][367454] Avg episode reward: [(0, '4107.009')] [2023-03-08 08:44:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000037392_19144704.pth... [2023-03-08 08:44:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000036688_18784256.pth [2023-03-08 08:44:51,370][367737] Updated weights for policy 0, policy_version 37440 (0.0006) [2023-03-08 08:44:54,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 12482.4). Total num frames: 19202048. Throughput: 0: 12153.8. Samples: 19193864. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:44:54,282][367454] Avg episode reward: [(0, '4102.855')] [2023-03-08 08:44:54,774][367737] Updated weights for policy 0, policy_version 37520 (0.0005) [2023-03-08 08:44:58,142][367737] Updated weights for policy 0, policy_version 37600 (0.0005) [2023-03-08 08:44:59,271][367454] Fps is (10 sec: 11878.5, 60 sec: 12288.0, 300 sec: 12496.3). Total num frames: 19263488. Throughput: 0: 12136.2. Samples: 19230560. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:44:59,282][367454] Avg episode reward: [(0, '4285.530')] [2023-03-08 08:45:01,520][367737] Updated weights for policy 0, policy_version 37680 (0.0006) [2023-03-08 08:45:04,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12510.2). Total num frames: 19324928. Throughput: 0: 12003.3. Samples: 19303196. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:45:04,282][367454] Avg episode reward: [(0, '4164.952')] [2023-03-08 08:45:04,285][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000037744_19324928.pth... [2023-03-08 08:45:04,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000037048_18968576.pth [2023-03-08 08:45:04,827][367737] Updated weights for policy 0, policy_version 37760 (0.0005) [2023-03-08 08:45:08,202][367737] Updated weights for policy 0, policy_version 37840 (0.0006) [2023-03-08 08:45:09,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 12510.2). Total num frames: 19386368. Throughput: 0: 11956.8. Samples: 19376712. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:45:09,282][367454] Avg episode reward: [(0, '4308.496')] [2023-03-08 08:45:11,349][367737] Updated weights for policy 0, policy_version 37920 (0.0005) [2023-03-08 08:45:14,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 12537.9). Total num frames: 19451904. Throughput: 0: 12006.0. Samples: 19415248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:45:14,282][367454] Avg episode reward: [(0, '4016.518')] [2023-03-08 08:45:14,471][367737] Updated weights for policy 0, policy_version 38000 (0.0004) [2023-03-08 08:45:17,439][367737] Updated weights for policy 0, policy_version 38080 (0.0003) [2023-03-08 08:45:19,272][367454] Fps is (10 sec: 13516.8, 60 sec: 12288.0, 300 sec: 12579.6). Total num frames: 19521536. Throughput: 0: 12234.5. Samples: 19496376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:45:19,282][367454] Avg episode reward: [(0, '4284.775')] [2023-03-08 08:45:19,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000038128_19521536.pth... [2023-03-08 08:45:19,290][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000037392_19144704.pth [2023-03-08 08:45:20,473][367737] Updated weights for policy 0, policy_version 38160 (0.0003) [2023-03-08 08:45:23,396][367737] Updated weights for policy 0, policy_version 38240 (0.0004) [2023-03-08 08:45:24,272][367454] Fps is (10 sec: 13516.8, 60 sec: 12288.0, 300 sec: 12593.5). Total num frames: 19587072. Throughput: 0: 12495.8. Samples: 19578944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:45:24,282][367454] Avg episode reward: [(0, '4052.264')] [2023-03-08 08:45:26,509][367737] Updated weights for policy 0, policy_version 38320 (0.0005) [2023-03-08 08:45:29,271][367454] Fps is (10 sec: 12697.7, 60 sec: 12356.3, 300 sec: 12607.4). Total num frames: 19648512. Throughput: 0: 12632.0. Samples: 19619220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:45:29,282][367454] Avg episode reward: [(0, '3713.819')] [2023-03-08 08:45:29,922][367737] Updated weights for policy 0, policy_version 38400 (0.0006) [2023-03-08 08:45:32,970][367737] Updated weights for policy 0, policy_version 38480 (0.0005) [2023-03-08 08:45:34,272][367454] Fps is (10 sec: 13107.2, 60 sec: 12561.1, 300 sec: 12635.1). Total num frames: 19718144. Throughput: 0: 12665.6. Samples: 19693676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:45:34,282][367454] Avg episode reward: [(0, '4279.828')] [2023-03-08 08:45:34,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000038512_19718144.pth... [2023-03-08 08:45:34,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000037744_19324928.pth [2023-03-08 08:45:35,947][367737] Updated weights for policy 0, policy_version 38560 (0.0005) [2023-03-08 08:45:38,935][367737] Updated weights for policy 0, policy_version 38640 (0.0005) [2023-03-08 08:45:39,272][367454] Fps is (10 sec: 13926.3, 60 sec: 12697.6, 300 sec: 12676.8). Total num frames: 19787776. Throughput: 0: 12926.4. Samples: 19775552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:45:39,272][367454] Avg episode reward: [(0, '4281.506')] [2023-03-08 08:45:41,769][367737] Updated weights for policy 0, policy_version 38720 (0.0005) [2023-03-08 08:45:44,271][367454] Fps is (10 sec: 13926.5, 60 sec: 12902.4, 300 sec: 12718.4). Total num frames: 19857408. Throughput: 0: 13077.4. Samples: 19819044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:45:44,272][367454] Avg episode reward: [(0, '3861.337')] [2023-03-08 08:45:44,637][367737] Updated weights for policy 0, policy_version 38800 (0.0005) [2023-03-08 08:45:47,492][367737] Updated weights for policy 0, policy_version 38880 (0.0004) [2023-03-08 08:45:49,271][367454] Fps is (10 sec: 14336.0, 60 sec: 13107.2, 300 sec: 12760.1). Total num frames: 19931136. Throughput: 0: 13382.1. Samples: 19905388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:45:49,272][367454] Avg episode reward: [(0, '4265.107')] [2023-03-08 08:45:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000038928_19931136.pth... [2023-03-08 08:45:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000038128_19521536.pth [2023-03-08 08:45:50,369][367737] Updated weights for policy 0, policy_version 38960 (0.0004) [2023-03-08 08:45:53,354][367737] Updated weights for policy 0, policy_version 39040 (0.0005) [2023-03-08 08:45:54,272][367454] Fps is (10 sec: 14336.0, 60 sec: 13312.0, 300 sec: 12787.9). Total num frames: 20000768. Throughput: 0: 13597.4. Samples: 19988596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:45:54,272][367454] Avg episode reward: [(0, '4256.388')] [2023-03-08 08:45:56,408][367737] Updated weights for policy 0, policy_version 39120 (0.0004) [2023-03-08 08:45:59,271][367454] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 12815.6). Total num frames: 20066304. Throughput: 0: 13648.9. Samples: 20029448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:45:59,272][367454] Avg episode reward: [(0, '3754.906')] [2023-03-08 08:45:59,424][367737] Updated weights for policy 0, policy_version 39200 (0.0004) [2023-03-08 08:46:02,688][367737] Updated weights for policy 0, policy_version 39280 (0.0005) [2023-03-08 08:46:04,272][367454] Fps is (10 sec: 12697.6, 60 sec: 13380.3, 300 sec: 12801.7). Total num frames: 20127744. Throughput: 0: 13580.8. Samples: 20107512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:46:04,272][367454] Avg episode reward: [(0, '3892.525')] [2023-03-08 08:46:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000039312_20127744.pth... [2023-03-08 08:46:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000038512_19718144.pth [2023-03-08 08:46:05,991][367737] Updated weights for policy 0, policy_version 39360 (0.0005) [2023-03-08 08:46:09,272][367454] Fps is (10 sec: 12288.0, 60 sec: 13380.3, 300 sec: 12787.9). Total num frames: 20189184. Throughput: 0: 13404.5. Samples: 20182148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:46:09,272][367454] Avg episode reward: [(0, '3882.296')] [2023-03-08 08:46:09,341][367737] Updated weights for policy 0, policy_version 39440 (0.0005) [2023-03-08 08:46:12,831][367737] Updated weights for policy 0, policy_version 39520 (0.0006) [2023-03-08 08:46:14,272][367454] Fps is (10 sec: 12288.0, 60 sec: 13312.0, 300 sec: 12774.0). Total num frames: 20250624. Throughput: 0: 13300.6. Samples: 20217748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:46:14,283][367454] Avg episode reward: [(0, '4185.507')] [2023-03-08 08:46:16,263][367737] Updated weights for policy 0, policy_version 39600 (0.0005) [2023-03-08 08:46:19,271][367454] Fps is (10 sec: 11878.5, 60 sec: 13107.2, 300 sec: 12760.1). Total num frames: 20307968. Throughput: 0: 13229.5. Samples: 20289004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:46:19,282][367454] Avg episode reward: [(0, '4118.715')] [2023-03-08 08:46:19,338][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000039672_20312064.pth... [2023-03-08 08:46:19,339][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000038928_19931136.pth [2023-03-08 08:46:19,700][367737] Updated weights for policy 0, policy_version 39680 (0.0006) [2023-03-08 08:46:23,045][367737] Updated weights for policy 0, policy_version 39760 (0.0005) [2023-03-08 08:46:24,272][367454] Fps is (10 sec: 11878.4, 60 sec: 13038.9, 300 sec: 12746.2). Total num frames: 20369408. Throughput: 0: 13016.4. Samples: 20361288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:46:24,282][367454] Avg episode reward: [(0, '4092.925')] [2023-03-08 08:46:26,156][367737] Updated weights for policy 0, policy_version 39840 (0.0004) [2023-03-08 08:46:29,167][367737] Updated weights for policy 0, policy_version 39920 (0.0003) [2023-03-08 08:46:29,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13175.4, 300 sec: 12760.1). Total num frames: 20439040. Throughput: 0: 12944.9. Samples: 20401564. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:46:29,286][367454] Avg episode reward: [(0, '4272.953')] [2023-03-08 08:46:32,189][367737] Updated weights for policy 0, policy_version 40000 (0.0003) [2023-03-08 08:46:34,272][367454] Fps is (10 sec: 13516.7, 60 sec: 13107.2, 300 sec: 12760.1). Total num frames: 20504576. Throughput: 0: 12834.5. Samples: 20482940. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:46:34,283][367454] Avg episode reward: [(0, '4157.016')] [2023-03-08 08:46:34,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000040048_20504576.pth... [2023-03-08 08:46:34,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000039312_20127744.pth [2023-03-08 08:46:35,364][367737] Updated weights for policy 0, policy_version 40080 (0.0004) [2023-03-08 08:46:38,555][367737] Updated weights for policy 0, policy_version 40160 (0.0004) [2023-03-08 08:46:39,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13038.9, 300 sec: 12774.0). Total num frames: 20570112. Throughput: 0: 12703.6. Samples: 20560260. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:46:39,283][367454] Avg episode reward: [(0, '4234.614')] [2023-03-08 08:46:41,902][367737] Updated weights for policy 0, policy_version 40240 (0.0004) [2023-03-08 08:46:44,272][367454] Fps is (10 sec: 12697.7, 60 sec: 12902.4, 300 sec: 12760.1). Total num frames: 20631552. Throughput: 0: 12608.7. Samples: 20596840. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:46:44,272][367454] Avg episode reward: [(0, '4230.071')] [2023-03-08 08:46:45,104][367737] Updated weights for policy 0, policy_version 40320 (0.0004) [2023-03-08 08:46:48,206][367737] Updated weights for policy 0, policy_version 40400 (0.0003) [2023-03-08 08:46:49,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12765.9, 300 sec: 12760.1). Total num frames: 20697088. Throughput: 0: 12594.6. Samples: 20674268. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:46:49,272][367454] Avg episode reward: [(0, '3940.873')] [2023-03-08 08:46:49,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000040424_20697088.pth... [2023-03-08 08:46:49,279][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000039672_20312064.pth [2023-03-08 08:46:51,644][367737] Updated weights for policy 0, policy_version 40480 (0.0005) [2023-03-08 08:46:54,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12732.3). Total num frames: 20754432. Throughput: 0: 12536.8. Samples: 20746304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:46:54,272][367454] Avg episode reward: [(0, '4011.588')] [2023-03-08 08:46:55,130][367737] Updated weights for policy 0, policy_version 40560 (0.0005) [2023-03-08 08:46:58,440][367737] Updated weights for policy 0, policy_version 40640 (0.0005) [2023-03-08 08:46:59,271][367454] Fps is (10 sec: 11878.5, 60 sec: 12492.8, 300 sec: 12732.3). Total num frames: 20815872. Throughput: 0: 12543.9. Samples: 20782224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:46:59,272][367454] Avg episode reward: [(0, '4189.407')] [2023-03-08 08:47:01,523][367737] Updated weights for policy 0, policy_version 40720 (0.0003) [2023-03-08 08:47:04,272][367454] Fps is (10 sec: 13107.2, 60 sec: 12629.3, 300 sec: 12746.2). Total num frames: 20885504. Throughput: 0: 12708.2. Samples: 20860872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:47:04,272][367454] Avg episode reward: [(0, '4015.330')] [2023-03-08 08:47:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000040792_20885504.pth... [2023-03-08 08:47:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000040048_20504576.pth [2023-03-08 08:47:04,566][367737] Updated weights for policy 0, policy_version 40800 (0.0003) [2023-03-08 08:47:07,658][367737] Updated weights for policy 0, policy_version 40880 (0.0003) [2023-03-08 08:47:09,271][367454] Fps is (10 sec: 13107.2, 60 sec: 12629.3, 300 sec: 12746.2). Total num frames: 20946944. Throughput: 0: 12850.7. Samples: 20939568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:47:09,272][367454] Avg episode reward: [(0, '3593.003')] [2023-03-08 08:47:10,935][367737] Updated weights for policy 0, policy_version 40960 (0.0003) [2023-03-08 08:47:14,056][367737] Updated weights for policy 0, policy_version 41040 (0.0004) [2023-03-08 08:47:14,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 12746.2). Total num frames: 21012480. Throughput: 0: 12790.0. Samples: 20977112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:47:14,272][367454] Avg episode reward: [(0, '3777.491')] [2023-03-08 08:47:17,160][367737] Updated weights for policy 0, policy_version 41120 (0.0004) [2023-03-08 08:47:19,271][367454] Fps is (10 sec: 13107.2, 60 sec: 12834.1, 300 sec: 12760.1). Total num frames: 21078016. Throughput: 0: 12752.8. Samples: 21056816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:47:19,272][367454] Avg episode reward: [(0, '4197.004')] [2023-03-08 08:47:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000041168_21078016.pth... [2023-03-08 08:47:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000040424_20697088.pth [2023-03-08 08:47:20,540][367737] Updated weights for policy 0, policy_version 41200 (0.0005) [2023-03-08 08:47:23,966][367737] Updated weights for policy 0, policy_version 41280 (0.0006) [2023-03-08 08:47:24,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12765.9, 300 sec: 12732.3). Total num frames: 21135360. Throughput: 0: 12630.9. Samples: 21128652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:47:24,272][367454] Avg episode reward: [(0, '4147.019')] [2023-03-08 08:47:27,402][367737] Updated weights for policy 0, policy_version 41360 (0.0005) [2023-03-08 08:47:29,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12629.3, 300 sec: 12718.4). Total num frames: 21196800. Throughput: 0: 12606.8. Samples: 21164144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:47:29,272][367454] Avg episode reward: [(0, '4038.052')] [2023-03-08 08:47:30,558][367737] Updated weights for policy 0, policy_version 41440 (0.0003) [2023-03-08 08:47:33,635][367737] Updated weights for policy 0, policy_version 41520 (0.0003) [2023-03-08 08:47:34,271][367454] Fps is (10 sec: 12697.7, 60 sec: 12629.4, 300 sec: 12746.2). Total num frames: 21262336. Throughput: 0: 12597.3. Samples: 21241144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:47:34,272][367454] Avg episode reward: [(0, '4132.783')] [2023-03-08 08:47:34,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000041536_21266432.pth... [2023-03-08 08:47:34,276][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000040792_20885504.pth [2023-03-08 08:47:37,004][367737] Updated weights for policy 0, policy_version 41600 (0.0005) [2023-03-08 08:47:39,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12732.3). Total num frames: 21323776. Throughput: 0: 12652.3. Samples: 21315656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:47:39,272][367454] Avg episode reward: [(0, '4291.448')] [2023-03-08 08:47:40,323][367737] Updated weights for policy 0, policy_version 41680 (0.0005) [2023-03-08 08:47:43,382][367737] Updated weights for policy 0, policy_version 41760 (0.0003) [2023-03-08 08:47:44,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12718.4). Total num frames: 21389312. Throughput: 0: 12734.5. Samples: 21355276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:47:44,272][367454] Avg episode reward: [(0, '4371.915')] [2023-03-08 08:47:46,659][367737] Updated weights for policy 0, policy_version 41840 (0.0005) [2023-03-08 08:47:49,272][367454] Fps is (10 sec: 12697.4, 60 sec: 12561.0, 300 sec: 12704.5). Total num frames: 21450752. Throughput: 0: 12671.2. Samples: 21431076. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:47:49,272][367454] Avg episode reward: [(0, '4159.242')] [2023-03-08 08:47:49,306][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000041904_21454848.pth... [2023-03-08 08:47:49,307][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000041168_21078016.pth [2023-03-08 08:47:49,955][367737] Updated weights for policy 0, policy_version 41920 (0.0005) [2023-03-08 08:47:53,194][367737] Updated weights for policy 0, policy_version 42000 (0.0005) [2023-03-08 08:47:54,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 12690.7). Total num frames: 21516288. Throughput: 0: 12609.1. Samples: 21506976. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:47:54,272][367454] Avg episode reward: [(0, '4245.775')] [2023-03-08 08:47:56,339][367737] Updated weights for policy 0, policy_version 42080 (0.0004) [2023-03-08 08:47:59,272][367454] Fps is (10 sec: 13107.4, 60 sec: 12765.9, 300 sec: 12690.7). Total num frames: 21581824. Throughput: 0: 12627.3. Samples: 21545340. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:47:59,272][367454] Avg episode reward: [(0, '4354.665')] [2023-03-08 08:47:59,400][367737] Updated weights for policy 0, policy_version 42160 (0.0004) [2023-03-08 08:48:02,683][367737] Updated weights for policy 0, policy_version 42240 (0.0005) [2023-03-08 08:48:04,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12690.7). Total num frames: 21643264. Throughput: 0: 12579.9. Samples: 21622912. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:48:04,272][367454] Avg episode reward: [(0, '4301.738')] [2023-03-08 08:48:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000042272_21643264.pth... [2023-03-08 08:48:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000041536_21266432.pth [2023-03-08 08:48:05,942][367737] Updated weights for policy 0, policy_version 42320 (0.0005) [2023-03-08 08:48:09,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12629.3, 300 sec: 12662.9). Total num frames: 21704704. Throughput: 0: 12639.5. Samples: 21697428. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 08:48:09,272][367454] Avg episode reward: [(0, '4270.703')] [2023-03-08 08:48:09,290][367737] Updated weights for policy 0, policy_version 42400 (0.0005) [2023-03-08 08:48:12,680][367737] Updated weights for policy 0, policy_version 42480 (0.0005) [2023-03-08 08:48:14,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12676.8). Total num frames: 21766144. Throughput: 0: 12664.3. Samples: 21734036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:48:14,272][367454] Avg episode reward: [(0, '3540.474')] [2023-03-08 08:48:16,058][367737] Updated weights for policy 0, policy_version 42560 (0.0005) [2023-03-08 08:48:19,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12649.0). Total num frames: 21827584. Throughput: 0: 12577.1. Samples: 21807112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:48:19,272][367454] Avg episode reward: [(0, '4010.618')] [2023-03-08 08:48:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000042632_21827584.pth... [2023-03-08 08:48:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000041904_21454848.pth [2023-03-08 08:48:19,376][367737] Updated weights for policy 0, policy_version 42640 (0.0004) [2023-03-08 08:48:22,454][367737] Updated weights for policy 0, policy_version 42720 (0.0003) [2023-03-08 08:48:24,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12662.9). Total num frames: 21893120. Throughput: 0: 12656.5. Samples: 21885196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:48:24,272][367454] Avg episode reward: [(0, '4200.907')] [2023-03-08 08:48:25,554][367737] Updated weights for policy 0, policy_version 42800 (0.0005) [2023-03-08 08:48:28,636][367737] Updated weights for policy 0, policy_version 42880 (0.0005) [2023-03-08 08:48:29,272][367454] Fps is (10 sec: 13516.8, 60 sec: 12765.9, 300 sec: 12690.7). Total num frames: 21962752. Throughput: 0: 12639.5. Samples: 21924056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:48:29,272][367454] Avg episode reward: [(0, '4309.732')] [2023-03-08 08:48:31,745][367737] Updated weights for policy 0, policy_version 42960 (0.0005) [2023-03-08 08:48:34,271][367454] Fps is (10 sec: 13516.8, 60 sec: 12765.9, 300 sec: 12704.5). Total num frames: 22028288. Throughput: 0: 12749.5. Samples: 22004800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:48:34,272][367454] Avg episode reward: [(0, '4258.306')] [2023-03-08 08:48:34,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000043024_22028288.pth... [2023-03-08 08:48:34,276][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000042272_21643264.pth [2023-03-08 08:48:34,641][367737] Updated weights for policy 0, policy_version 43040 (0.0005) [2023-03-08 08:48:37,641][367737] Updated weights for policy 0, policy_version 43120 (0.0005) [2023-03-08 08:48:39,272][367454] Fps is (10 sec: 13516.8, 60 sec: 12902.4, 300 sec: 12732.3). Total num frames: 22097920. Throughput: 0: 12903.7. Samples: 22087644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:48:39,272][367454] Avg episode reward: [(0, '4072.073')] [2023-03-08 08:48:40,613][367737] Updated weights for policy 0, policy_version 43200 (0.0004) [2023-03-08 08:48:43,585][367737] Updated weights for policy 0, policy_version 43280 (0.0004) [2023-03-08 08:48:44,272][367454] Fps is (10 sec: 13926.3, 60 sec: 12970.7, 300 sec: 12774.0). Total num frames: 22167552. Throughput: 0: 12982.6. Samples: 22129556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:48:44,272][367454] Avg episode reward: [(0, '4306.135')] [2023-03-08 08:48:46,603][367737] Updated weights for policy 0, policy_version 43360 (0.0003) [2023-03-08 08:48:49,272][367454] Fps is (10 sec: 13516.7, 60 sec: 13039.0, 300 sec: 12787.8). Total num frames: 22233088. Throughput: 0: 13068.2. Samples: 22210984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:48:49,272][367454] Avg episode reward: [(0, '4200.695')] [2023-03-08 08:48:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000043424_22233088.pth... [2023-03-08 08:48:49,276][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000042632_21827584.pth [2023-03-08 08:48:49,627][367737] Updated weights for policy 0, policy_version 43440 (0.0003) [2023-03-08 08:48:52,567][367737] Updated weights for policy 0, policy_version 43520 (0.0003) [2023-03-08 08:48:54,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13107.2, 300 sec: 12801.7). Total num frames: 22302720. Throughput: 0: 13239.4. Samples: 22293200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:48:54,272][367454] Avg episode reward: [(0, '3652.527')] [2023-03-08 08:48:55,659][367737] Updated weights for policy 0, policy_version 43600 (0.0003) [2023-03-08 08:48:58,687][367737] Updated weights for policy 0, policy_version 43680 (0.0003) [2023-03-08 08:48:59,271][367454] Fps is (10 sec: 13517.0, 60 sec: 13107.2, 300 sec: 12801.7). Total num frames: 22368256. Throughput: 0: 13309.7. Samples: 22332972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:48:59,272][367454] Avg episode reward: [(0, '4019.277')] [2023-03-08 08:49:01,792][367737] Updated weights for policy 0, policy_version 43760 (0.0003) [2023-03-08 08:49:04,272][367454] Fps is (10 sec: 13516.7, 60 sec: 13243.7, 300 sec: 12815.6). Total num frames: 22437888. Throughput: 0: 13472.5. Samples: 22413376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:49:04,272][367454] Avg episode reward: [(0, '3737.978')] [2023-03-08 08:49:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000043824_22437888.pth... [2023-03-08 08:49:04,279][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000043024_22028288.pth [2023-03-08 08:49:04,787][367737] Updated weights for policy 0, policy_version 43840 (0.0004) [2023-03-08 08:49:07,757][367737] Updated weights for policy 0, policy_version 43920 (0.0004) [2023-03-08 08:49:09,271][367454] Fps is (10 sec: 13926.4, 60 sec: 13380.3, 300 sec: 12843.4). Total num frames: 22507520. Throughput: 0: 13558.0. Samples: 22495304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:49:09,272][367454] Avg episode reward: [(0, '4138.898')] [2023-03-08 08:49:10,767][367737] Updated weights for policy 0, policy_version 44000 (0.0005) [2023-03-08 08:49:13,699][367737] Updated weights for policy 0, policy_version 44080 (0.0005) [2023-03-08 08:49:14,271][367454] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 12843.4). Total num frames: 22573056. Throughput: 0: 13621.4. Samples: 22537020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:49:14,272][367454] Avg episode reward: [(0, '4083.300')] [2023-03-08 08:49:16,659][367737] Updated weights for policy 0, policy_version 44160 (0.0004) [2023-03-08 08:49:19,271][367454] Fps is (10 sec: 13516.8, 60 sec: 13585.1, 300 sec: 12857.3). Total num frames: 22642688. Throughput: 0: 13674.6. Samples: 22620156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:49:19,272][367454] Avg episode reward: [(0, '4093.316')] [2023-03-08 08:49:19,298][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000044232_22646784.pth... [2023-03-08 08:49:19,299][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000043424_22233088.pth [2023-03-08 08:49:19,636][367737] Updated weights for policy 0, policy_version 44240 (0.0004) [2023-03-08 08:49:22,775][367737] Updated weights for policy 0, policy_version 44320 (0.0005) [2023-03-08 08:49:24,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13585.0, 300 sec: 12885.0). Total num frames: 22708224. Throughput: 0: 13610.0. Samples: 22700096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:49:24,272][367454] Avg episode reward: [(0, '4302.171')] [2023-03-08 08:49:25,895][367737] Updated weights for policy 0, policy_version 44400 (0.0006) [2023-03-08 08:49:28,974][367737] Updated weights for policy 0, policy_version 44480 (0.0005) [2023-03-08 08:49:29,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13516.8, 300 sec: 12912.8). Total num frames: 22773760. Throughput: 0: 13552.3. Samples: 22739408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:49:29,272][367454] Avg episode reward: [(0, '4281.604')] [2023-03-08 08:49:32,065][367737] Updated weights for policy 0, policy_version 44560 (0.0005) [2023-03-08 08:49:34,272][367454] Fps is (10 sec: 13516.7, 60 sec: 13585.0, 300 sec: 12940.6). Total num frames: 22843392. Throughput: 0: 13509.0. Samples: 22818888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:49:34,272][367454] Avg episode reward: [(0, '4099.094')] [2023-03-08 08:49:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000044616_22843392.pth... [2023-03-08 08:49:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000043824_22437888.pth [2023-03-08 08:49:35,172][367737] Updated weights for policy 0, policy_version 44640 (0.0005) [2023-03-08 08:49:38,055][367737] Updated weights for policy 0, policy_version 44720 (0.0004) [2023-03-08 08:49:39,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13585.1, 300 sec: 12982.2). Total num frames: 22913024. Throughput: 0: 13512.8. Samples: 22901276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:49:39,272][367454] Avg episode reward: [(0, '4058.447')] [2023-03-08 08:49:41,000][367737] Updated weights for policy 0, policy_version 44800 (0.0004) [2023-03-08 08:49:43,941][367737] Updated weights for policy 0, policy_version 44880 (0.0004) [2023-03-08 08:49:44,272][367454] Fps is (10 sec: 13926.5, 60 sec: 13585.1, 300 sec: 13010.0). Total num frames: 22982656. Throughput: 0: 13551.6. Samples: 22942796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:49:44,272][367454] Avg episode reward: [(0, '4293.001')] [2023-03-08 08:49:46,865][367737] Updated weights for policy 0, policy_version 44960 (0.0004) [2023-03-08 08:49:49,272][367454] Fps is (10 sec: 13926.3, 60 sec: 13653.3, 300 sec: 13051.7). Total num frames: 23052288. Throughput: 0: 13640.1. Samples: 23027180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:49:49,272][367454] Avg episode reward: [(0, '4307.187')] [2023-03-08 08:49:49,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000045024_23052288.pth... [2023-03-08 08:49:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000044232_22646784.pth [2023-03-08 08:49:49,826][367737] Updated weights for policy 0, policy_version 45040 (0.0004) [2023-03-08 08:49:52,682][367737] Updated weights for policy 0, policy_version 45120 (0.0005) [2023-03-08 08:49:54,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13653.3, 300 sec: 13079.4). Total num frames: 23121920. Throughput: 0: 13709.1. Samples: 23112216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:49:54,272][367454] Avg episode reward: [(0, '4362.788')] [2023-03-08 08:49:55,557][367737] Updated weights for policy 0, policy_version 45200 (0.0005) [2023-03-08 08:49:58,343][367737] Updated weights for policy 0, policy_version 45280 (0.0004) [2023-03-08 08:49:59,272][367454] Fps is (10 sec: 14336.1, 60 sec: 13789.8, 300 sec: 13121.1). Total num frames: 23195648. Throughput: 0: 13727.5. Samples: 23154760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:49:59,272][367454] Avg episode reward: [(0, '4302.360')] [2023-03-08 08:50:01,183][367737] Updated weights for policy 0, policy_version 45360 (0.0005) [2023-03-08 08:50:04,100][367737] Updated weights for policy 0, policy_version 45440 (0.0005) [2023-03-08 08:50:04,272][367454] Fps is (10 sec: 14335.9, 60 sec: 13789.9, 300 sec: 13148.9). Total num frames: 23265280. Throughput: 0: 13797.4. Samples: 23241040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:50:04,272][367454] Avg episode reward: [(0, '3896.968')] [2023-03-08 08:50:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000045440_23265280.pth... [2023-03-08 08:50:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000044616_22843392.pth [2023-03-08 08:50:06,948][367737] Updated weights for policy 0, policy_version 45520 (0.0004) [2023-03-08 08:50:09,272][367454] Fps is (10 sec: 14336.0, 60 sec: 13858.1, 300 sec: 13176.6). Total num frames: 23339008. Throughput: 0: 13947.3. Samples: 23327724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:50:09,272][367454] Avg episode reward: [(0, '4311.661')] [2023-03-08 08:50:09,665][367737] Updated weights for policy 0, policy_version 45600 (0.0004) [2023-03-08 08:50:12,439][367737] Updated weights for policy 0, policy_version 45680 (0.0005) [2023-03-08 08:50:14,272][367454] Fps is (10 sec: 15155.3, 60 sec: 14062.9, 300 sec: 13204.4). Total num frames: 23416832. Throughput: 0: 14054.0. Samples: 23371840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:50:14,272][367454] Avg episode reward: [(0, '4278.296')] [2023-03-08 08:50:14,971][367737] Updated weights for policy 0, policy_version 45760 (0.0004) [2023-03-08 08:50:17,657][367737] Updated weights for policy 0, policy_version 45840 (0.0004) [2023-03-08 08:50:19,272][367454] Fps is (10 sec: 15564.7, 60 sec: 14199.4, 300 sec: 13246.0). Total num frames: 23494656. Throughput: 0: 14380.1. Samples: 23465992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:50:19,272][367454] Avg episode reward: [(0, '4371.440')] [2023-03-08 08:50:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000045888_23494656.pth... [2023-03-08 08:50:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000045024_23052288.pth [2023-03-08 08:50:20,223][367737] Updated weights for policy 0, policy_version 45920 (0.0004) [2023-03-08 08:50:22,831][367737] Updated weights for policy 0, policy_version 46000 (0.0004) [2023-03-08 08:50:24,272][367454] Fps is (10 sec: 15564.8, 60 sec: 14404.3, 300 sec: 13301.6). Total num frames: 23572480. Throughput: 0: 14644.0. Samples: 23560256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:50:24,272][367454] Avg episode reward: [(0, '4325.186')] [2023-03-08 08:50:25,513][367737] Updated weights for policy 0, policy_version 46080 (0.0005) [2023-03-08 08:50:28,169][367737] Updated weights for policy 0, policy_version 46160 (0.0004) [2023-03-08 08:50:29,272][367454] Fps is (10 sec: 15564.8, 60 sec: 14609.1, 300 sec: 13329.4). Total num frames: 23650304. Throughput: 0: 14740.8. Samples: 23606132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:50:29,272][367454] Avg episode reward: [(0, '4278.278')] [2023-03-08 08:50:30,821][367737] Updated weights for policy 0, policy_version 46240 (0.0004) [2023-03-08 08:50:33,503][367737] Updated weights for policy 0, policy_version 46320 (0.0004) [2023-03-08 08:50:34,271][367454] Fps is (10 sec: 15564.9, 60 sec: 14745.6, 300 sec: 13357.1). Total num frames: 23728128. Throughput: 0: 14939.7. Samples: 23699464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:50:34,272][367454] Avg episode reward: [(0, '4206.897')] [2023-03-08 08:50:34,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000046344_23728128.pth... [2023-03-08 08:50:34,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000045440_23265280.pth [2023-03-08 08:50:36,157][367737] Updated weights for policy 0, policy_version 46400 (0.0004) [2023-03-08 08:50:38,812][367737] Updated weights for policy 0, policy_version 46480 (0.0004) [2023-03-08 08:50:39,272][367454] Fps is (10 sec: 15155.2, 60 sec: 14813.9, 300 sec: 13371.0). Total num frames: 23801856. Throughput: 0: 15086.8. Samples: 23791120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:50:39,272][367454] Avg episode reward: [(0, '4175.869')] [2023-03-08 08:50:41,456][367737] Updated weights for policy 0, policy_version 46560 (0.0004) [2023-03-08 08:50:44,216][367737] Updated weights for policy 0, policy_version 46640 (0.0004) [2023-03-08 08:50:44,272][367454] Fps is (10 sec: 15155.1, 60 sec: 14950.4, 300 sec: 13384.9). Total num frames: 23879680. Throughput: 0: 15177.5. Samples: 23837748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:50:44,272][367454] Avg episode reward: [(0, '4046.199')] [2023-03-08 08:50:46,907][367737] Updated weights for policy 0, policy_version 46720 (0.0004) [2023-03-08 08:50:49,272][367454] Fps is (10 sec: 15155.2, 60 sec: 15018.7, 300 sec: 13398.8). Total num frames: 23953408. Throughput: 0: 15273.5. Samples: 23928348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:50:49,272][367454] Avg episode reward: [(0, '3981.567')] [2023-03-08 08:50:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000046784_23953408.pth... [2023-03-08 08:50:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000045888_23494656.pth [2023-03-08 08:50:49,662][367737] Updated weights for policy 0, policy_version 46800 (0.0004) [2023-03-08 08:50:52,374][367737] Updated weights for policy 0, policy_version 46880 (0.0005) [2023-03-08 08:50:54,271][367454] Fps is (10 sec: 14745.7, 60 sec: 15087.0, 300 sec: 13426.6). Total num frames: 24027136. Throughput: 0: 15340.4. Samples: 24018040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:50:54,272][367454] Avg episode reward: [(0, '4086.998')] [2023-03-08 08:50:55,095][367737] Updated weights for policy 0, policy_version 46960 (0.0004) [2023-03-08 08:50:57,790][367737] Updated weights for policy 0, policy_version 47040 (0.0004) [2023-03-08 08:50:59,271][367454] Fps is (10 sec: 15155.3, 60 sec: 15155.2, 300 sec: 13482.1). Total num frames: 24104960. Throughput: 0: 15372.9. Samples: 24063620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:50:59,272][367454] Avg episode reward: [(0, '3956.223')] [2023-03-08 08:51:00,524][367737] Updated weights for policy 0, policy_version 47120 (0.0004) [2023-03-08 08:51:03,265][367737] Updated weights for policy 0, policy_version 47200 (0.0004) [2023-03-08 08:51:04,272][367454] Fps is (10 sec: 15155.0, 60 sec: 15223.5, 300 sec: 13523.7). Total num frames: 24178688. Throughput: 0: 15280.7. Samples: 24153624. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:51:04,272][367454] Avg episode reward: [(0, '4138.978')] [2023-03-08 08:51:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000047224_24178688.pth... [2023-03-08 08:51:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000046344_23728128.pth [2023-03-08 08:51:06,019][367737] Updated weights for policy 0, policy_version 47280 (0.0004) [2023-03-08 08:51:08,757][367737] Updated weights for policy 0, policy_version 47360 (0.0004) [2023-03-08 08:51:09,272][367454] Fps is (10 sec: 14745.5, 60 sec: 15223.5, 300 sec: 13565.4). Total num frames: 24252416. Throughput: 0: 15171.3. Samples: 24242964. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:51:09,272][367454] Avg episode reward: [(0, '4408.584')] [2023-03-08 08:51:09,273][367693] Saving new best policy, reward=4408.584! [2023-03-08 08:51:11,591][367737] Updated weights for policy 0, policy_version 47440 (0.0005) [2023-03-08 08:51:14,271][367454] Fps is (10 sec: 14745.7, 60 sec: 15155.2, 300 sec: 13620.9). Total num frames: 24326144. Throughput: 0: 15107.2. Samples: 24285956. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:51:14,272][367454] Avg episode reward: [(0, '4140.086')] [2023-03-08 08:51:14,462][367737] Updated weights for policy 0, policy_version 47520 (0.0005) [2023-03-08 08:51:17,258][367737] Updated weights for policy 0, policy_version 47600 (0.0004) [2023-03-08 08:51:19,272][367454] Fps is (10 sec: 14745.5, 60 sec: 15086.9, 300 sec: 13662.6). Total num frames: 24399872. Throughput: 0: 14968.4. Samples: 24373044. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:51:19,272][367454] Avg episode reward: [(0, '4084.896')] [2023-03-08 08:51:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000047656_24399872.pth... [2023-03-08 08:51:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000046784_23953408.pth [2023-03-08 08:51:20,024][367737] Updated weights for policy 0, policy_version 47680 (0.0004) [2023-03-08 08:51:22,943][367737] Updated weights for policy 0, policy_version 47760 (0.0004) [2023-03-08 08:51:24,271][367454] Fps is (10 sec: 14745.6, 60 sec: 15018.7, 300 sec: 13676.5). Total num frames: 24473600. Throughput: 0: 14863.4. Samples: 24459972. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:51:24,272][367454] Avg episode reward: [(0, '3809.996')] [2023-03-08 08:51:25,612][367737] Updated weights for policy 0, policy_version 47840 (0.0003) [2023-03-08 08:51:28,435][367737] Updated weights for policy 0, policy_version 47920 (0.0004) [2023-03-08 08:51:29,272][367454] Fps is (10 sec: 14336.1, 60 sec: 14882.1, 300 sec: 13690.4). Total num frames: 24543232. Throughput: 0: 14859.6. Samples: 24506432. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:51:29,272][367454] Avg episode reward: [(0, '4076.527')] [2023-03-08 08:51:31,262][367737] Updated weights for policy 0, policy_version 48000 (0.0003) [2023-03-08 08:51:34,092][367737] Updated weights for policy 0, policy_version 48080 (0.0003) [2023-03-08 08:51:34,272][367454] Fps is (10 sec: 14335.9, 60 sec: 14813.8, 300 sec: 13718.1). Total num frames: 24616960. Throughput: 0: 14758.0. Samples: 24592456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:51:34,272][367454] Avg episode reward: [(0, '3828.603')] [2023-03-08 08:51:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000048080_24616960.pth... [2023-03-08 08:51:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000047224_24178688.pth [2023-03-08 08:51:36,947][367737] Updated weights for policy 0, policy_version 48160 (0.0003) [2023-03-08 08:51:39,271][367454] Fps is (10 sec: 14336.1, 60 sec: 14745.6, 300 sec: 13745.9). Total num frames: 24686592. Throughput: 0: 14674.7. Samples: 24678400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:51:39,272][367454] Avg episode reward: [(0, '3445.772')] [2023-03-08 08:51:39,871][367737] Updated weights for policy 0, policy_version 48240 (0.0005) [2023-03-08 08:51:42,891][367737] Updated weights for policy 0, policy_version 48320 (0.0005) [2023-03-08 08:51:44,272][367454] Fps is (10 sec: 13926.5, 60 sec: 14609.1, 300 sec: 13759.8). Total num frames: 24756224. Throughput: 0: 14572.3. Samples: 24719372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:51:44,272][367454] Avg episode reward: [(0, '3899.363')] [2023-03-08 08:51:46,042][367737] Updated weights for policy 0, policy_version 48400 (0.0005) [2023-03-08 08:51:48,826][367737] Updated weights for policy 0, policy_version 48480 (0.0003) [2023-03-08 08:51:49,272][367454] Fps is (10 sec: 13926.3, 60 sec: 14540.8, 300 sec: 13801.4). Total num frames: 24825856. Throughput: 0: 14388.8. Samples: 24801120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:51:49,272][367454] Avg episode reward: [(0, '4204.173')] [2023-03-08 08:51:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000048488_24825856.pth... [2023-03-08 08:51:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000047656_24399872.pth [2023-03-08 08:51:51,630][367737] Updated weights for policy 0, policy_version 48560 (0.0004) [2023-03-08 08:51:54,272][367454] Fps is (10 sec: 13926.4, 60 sec: 14472.5, 300 sec: 13829.2). Total num frames: 24895488. Throughput: 0: 14285.5. Samples: 24885812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:51:54,272][367454] Avg episode reward: [(0, '4268.899')] [2023-03-08 08:51:54,698][367737] Updated weights for policy 0, policy_version 48640 (0.0005) [2023-03-08 08:51:57,823][367737] Updated weights for policy 0, policy_version 48720 (0.0005) [2023-03-08 08:51:59,271][367454] Fps is (10 sec: 13516.9, 60 sec: 14267.7, 300 sec: 13815.3). Total num frames: 24961024. Throughput: 0: 14214.3. Samples: 24925600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:51:59,272][367454] Avg episode reward: [(0, '3814.444')] [2023-03-08 08:52:00,894][367737] Updated weights for policy 0, policy_version 48800 (0.0005) [2023-03-08 08:52:04,043][367737] Updated weights for policy 0, policy_version 48880 (0.0006) [2023-03-08 08:52:04,271][367454] Fps is (10 sec: 13107.2, 60 sec: 14131.2, 300 sec: 13829.2). Total num frames: 25026560. Throughput: 0: 14062.3. Samples: 25005848. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:52:04,272][367454] Avg episode reward: [(0, '4266.056')] [2023-03-08 08:52:04,338][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000048888_25030656.pth... [2023-03-08 08:52:04,340][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000048080_24616960.pth [2023-03-08 08:52:07,080][367737] Updated weights for policy 0, policy_version 48960 (0.0005) [2023-03-08 08:52:09,272][367454] Fps is (10 sec: 13516.7, 60 sec: 14062.9, 300 sec: 13843.1). Total num frames: 25096192. Throughput: 0: 13872.1. Samples: 25084216. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:52:09,272][367454] Avg episode reward: [(0, '4035.731')] [2023-03-08 08:52:10,219][367737] Updated weights for policy 0, policy_version 49040 (0.0005) [2023-03-08 08:52:13,382][367737] Updated weights for policy 0, policy_version 49120 (0.0005) [2023-03-08 08:52:14,271][367454] Fps is (10 sec: 13107.3, 60 sec: 13858.1, 300 sec: 13829.2). Total num frames: 25157632. Throughput: 0: 13743.0. Samples: 25124864. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:52:14,272][367454] Avg episode reward: [(0, '3847.476')] [2023-03-08 08:52:16,330][367737] Updated weights for policy 0, policy_version 49200 (0.0005) [2023-03-08 08:52:19,159][367737] Updated weights for policy 0, policy_version 49280 (0.0003) [2023-03-08 08:52:19,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13858.1, 300 sec: 13884.7). Total num frames: 25231360. Throughput: 0: 13647.6. Samples: 25206600. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:52:19,272][367454] Avg episode reward: [(0, '3983.828')] [2023-03-08 08:52:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000049280_25231360.pth... [2023-03-08 08:52:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000048488_24825856.pth [2023-03-08 08:52:21,984][367737] Updated weights for policy 0, policy_version 49360 (0.0003) [2023-03-08 08:52:24,272][367454] Fps is (10 sec: 14745.5, 60 sec: 13858.1, 300 sec: 13926.4). Total num frames: 25305088. Throughput: 0: 13653.5. Samples: 25292808. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:52:24,272][367454] Avg episode reward: [(0, '3997.533')] [2023-03-08 08:52:24,816][367737] Updated weights for policy 0, policy_version 49440 (0.0004) [2023-03-08 08:52:27,963][367737] Updated weights for policy 0, policy_version 49520 (0.0006) [2023-03-08 08:52:29,272][367454] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13926.4). Total num frames: 25370624. Throughput: 0: 13653.2. Samples: 25333768. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 08:52:29,272][367454] Avg episode reward: [(0, '4002.440')] [2023-03-08 08:52:31,162][367737] Updated weights for policy 0, policy_version 49600 (0.0005) [2023-03-08 08:52:34,242][367737] Updated weights for policy 0, policy_version 49680 (0.0005) [2023-03-08 08:52:34,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13653.3, 300 sec: 13940.3). Total num frames: 25436160. Throughput: 0: 13567.3. Samples: 25411648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:52:34,272][367454] Avg episode reward: [(0, '4001.089')] [2023-03-08 08:52:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000049680_25436160.pth... [2023-03-08 08:52:34,280][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000048888_25030656.pth [2023-03-08 08:52:36,950][367737] Updated weights for policy 0, policy_version 49760 (0.0004) [2023-03-08 08:52:39,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13721.6, 300 sec: 13968.1). Total num frames: 25509888. Throughput: 0: 13625.2. Samples: 25498948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:52:39,272][367454] Avg episode reward: [(0, '4085.557')] [2023-03-08 08:52:39,666][367737] Updated weights for policy 0, policy_version 49840 (0.0004) [2023-03-08 08:52:42,466][367737] Updated weights for policy 0, policy_version 49920 (0.0005) [2023-03-08 08:52:44,271][367454] Fps is (10 sec: 14745.7, 60 sec: 13789.9, 300 sec: 14009.7). Total num frames: 25583616. Throughput: 0: 13721.7. Samples: 25543076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:52:44,272][367454] Avg episode reward: [(0, '4224.740')] [2023-03-08 08:52:45,224][367737] Updated weights for policy 0, policy_version 50000 (0.0005) [2023-03-08 08:52:47,889][367737] Updated weights for policy 0, policy_version 50080 (0.0004) [2023-03-08 08:52:49,272][367454] Fps is (10 sec: 15155.2, 60 sec: 13926.4, 300 sec: 14051.4). Total num frames: 25661440. Throughput: 0: 13939.7. Samples: 25633136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:52:49,272][367454] Avg episode reward: [(0, '4117.776')] [2023-03-08 08:52:49,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000050120_25661440.pth... [2023-03-08 08:52:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000049280_25231360.pth [2023-03-08 08:52:50,537][367737] Updated weights for policy 0, policy_version 50160 (0.0004) [2023-03-08 08:52:53,150][367737] Updated weights for policy 0, policy_version 50240 (0.0004) [2023-03-08 08:52:54,272][367454] Fps is (10 sec: 15564.8, 60 sec: 14062.9, 300 sec: 14093.0). Total num frames: 25739264. Throughput: 0: 14283.6. Samples: 25726976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:52:54,272][367454] Avg episode reward: [(0, '4098.817')] [2023-03-08 08:52:55,745][367737] Updated weights for policy 0, policy_version 50320 (0.0004) [2023-03-08 08:52:58,429][367737] Updated weights for policy 0, policy_version 50400 (0.0004) [2023-03-08 08:52:59,272][367454] Fps is (10 sec: 15564.8, 60 sec: 14267.7, 300 sec: 14148.6). Total num frames: 25817088. Throughput: 0: 14426.7. Samples: 25774068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:52:59,272][367454] Avg episode reward: [(0, '4158.248')] [2023-03-08 08:53:00,982][367737] Updated weights for policy 0, policy_version 50480 (0.0004) [2023-03-08 08:53:03,990][367737] Updated weights for policy 0, policy_version 50560 (0.0005) [2023-03-08 08:53:04,272][367454] Fps is (10 sec: 14745.5, 60 sec: 14336.0, 300 sec: 14176.3). Total num frames: 25886720. Throughput: 0: 14636.9. Samples: 25865260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:53:04,272][367454] Avg episode reward: [(0, '4085.347')] [2023-03-08 08:53:04,298][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000050568_25890816.pth... [2023-03-08 08:53:04,299][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000049680_25436160.pth [2023-03-08 08:53:07,036][367737] Updated weights for policy 0, policy_version 50640 (0.0005) [2023-03-08 08:53:09,272][367454] Fps is (10 sec: 13926.4, 60 sec: 14336.0, 300 sec: 14204.1). Total num frames: 25956352. Throughput: 0: 14508.1. Samples: 25945672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:53:09,272][367454] Avg episode reward: [(0, '4105.237')] [2023-03-08 08:53:10,035][367737] Updated weights for policy 0, policy_version 50720 (0.0005) [2023-03-08 08:53:12,994][367737] Updated weights for policy 0, policy_version 50800 (0.0005) [2023-03-08 08:53:14,272][367454] Fps is (10 sec: 13926.4, 60 sec: 14472.5, 300 sec: 14231.9). Total num frames: 26025984. Throughput: 0: 14519.2. Samples: 25987132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:53:14,272][367454] Avg episode reward: [(0, '4014.238')] [2023-03-08 08:53:15,950][367737] Updated weights for policy 0, policy_version 50880 (0.0005) [2023-03-08 08:53:18,982][367737] Updated weights for policy 0, policy_version 50960 (0.0006) [2023-03-08 08:53:19,272][367454] Fps is (10 sec: 13926.4, 60 sec: 14404.3, 300 sec: 14245.7). Total num frames: 26095616. Throughput: 0: 14646.9. Samples: 26070760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:53:19,272][367454] Avg episode reward: [(0, '3716.136')] [2023-03-08 08:53:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000050968_26095616.pth... [2023-03-08 08:53:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000050120_25661440.pth [2023-03-08 08:53:21,850][367737] Updated weights for policy 0, policy_version 51040 (0.0005) [2023-03-08 08:53:24,271][367454] Fps is (10 sec: 13926.6, 60 sec: 14336.0, 300 sec: 14245.8). Total num frames: 26165248. Throughput: 0: 14535.2. Samples: 26153032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:53:24,272][367454] Avg episode reward: [(0, '4097.354')] [2023-03-08 08:53:24,646][367737] Updated weights for policy 0, policy_version 51120 (0.0005) [2023-03-08 08:53:27,418][367737] Updated weights for policy 0, policy_version 51200 (0.0005) [2023-03-08 08:53:29,272][367454] Fps is (10 sec: 14336.0, 60 sec: 14472.5, 300 sec: 14273.5). Total num frames: 26238976. Throughput: 0: 14607.1. Samples: 26200396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:53:29,272][367454] Avg episode reward: [(0, '4372.482')] [2023-03-08 08:53:30,482][367737] Updated weights for policy 0, policy_version 51280 (0.0005) [2023-03-08 08:53:33,612][367737] Updated weights for policy 0, policy_version 51360 (0.0005) [2023-03-08 08:53:34,272][367454] Fps is (10 sec: 13926.2, 60 sec: 14472.5, 300 sec: 14259.6). Total num frames: 26304512. Throughput: 0: 14385.1. Samples: 26280464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:53:34,272][367454] Avg episode reward: [(0, '4196.342')] [2023-03-08 08:53:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000051376_26304512.pth... [2023-03-08 08:53:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000050568_25890816.pth [2023-03-08 08:53:36,578][367737] Updated weights for policy 0, policy_version 51440 (0.0005) [2023-03-08 08:53:39,272][367454] Fps is (10 sec: 13516.8, 60 sec: 14404.3, 300 sec: 14259.6). Total num frames: 26374144. Throughput: 0: 14108.7. Samples: 26361868. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:53:39,272][367454] Avg episode reward: [(0, '4058.975')] [2023-03-08 08:53:39,457][367737] Updated weights for policy 0, policy_version 51520 (0.0005) [2023-03-08 08:53:42,048][367737] Updated weights for policy 0, policy_version 51600 (0.0004) [2023-03-08 08:53:44,272][367454] Fps is (10 sec: 14336.1, 60 sec: 14404.3, 300 sec: 14287.4). Total num frames: 26447872. Throughput: 0: 14097.2. Samples: 26408440. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:53:44,272][367454] Avg episode reward: [(0, '3985.275')] [2023-03-08 08:53:44,844][367737] Updated weights for policy 0, policy_version 51680 (0.0005) [2023-03-08 08:53:47,433][367737] Updated weights for policy 0, policy_version 51760 (0.0004) [2023-03-08 08:53:49,271][367454] Fps is (10 sec: 15155.3, 60 sec: 14404.3, 300 sec: 14315.2). Total num frames: 26525696. Throughput: 0: 14116.3. Samples: 26500492. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:53:49,272][367454] Avg episode reward: [(0, '4209.564')] [2023-03-08 08:53:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000051808_26525696.pth... [2023-03-08 08:53:49,276][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000050968_26095616.pth [2023-03-08 08:53:50,226][367737] Updated weights for policy 0, policy_version 51840 (0.0005) [2023-03-08 08:53:53,119][367737] Updated weights for policy 0, policy_version 51920 (0.0005) [2023-03-08 08:53:54,271][367454] Fps is (10 sec: 15155.2, 60 sec: 14336.0, 300 sec: 14342.9). Total num frames: 26599424. Throughput: 0: 14256.2. Samples: 26587200. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:53:54,272][367454] Avg episode reward: [(0, '4250.648')] [2023-03-08 08:53:55,824][367737] Updated weights for policy 0, policy_version 52000 (0.0005) [2023-03-08 08:53:58,470][367737] Updated weights for policy 0, policy_version 52080 (0.0004) [2023-03-08 08:53:59,271][367454] Fps is (10 sec: 15155.2, 60 sec: 14336.0, 300 sec: 14370.7). Total num frames: 26677248. Throughput: 0: 14345.4. Samples: 26632676. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:53:59,272][367454] Avg episode reward: [(0, '4277.655')] [2023-03-08 08:54:01,152][367737] Updated weights for policy 0, policy_version 52160 (0.0004) [2023-03-08 08:54:03,876][367737] Updated weights for policy 0, policy_version 52240 (0.0005) [2023-03-08 08:54:04,271][367454] Fps is (10 sec: 15155.2, 60 sec: 14404.3, 300 sec: 14384.6). Total num frames: 26750976. Throughput: 0: 14534.1. Samples: 26724796. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 08:54:04,272][367454] Avg episode reward: [(0, '4232.424')] [2023-03-08 08:54:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000052248_26750976.pth... [2023-03-08 08:54:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000051376_26304512.pth [2023-03-08 08:54:06,672][367737] Updated weights for policy 0, policy_version 52320 (0.0005) [2023-03-08 08:54:09,271][367454] Fps is (10 sec: 14745.6, 60 sec: 14472.5, 300 sec: 14412.4). Total num frames: 26824704. Throughput: 0: 14681.5. Samples: 26813700. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:54:09,272][367454] Avg episode reward: [(0, '4271.314')] [2023-03-08 08:54:09,349][367737] Updated weights for policy 0, policy_version 52400 (0.0004) [2023-03-08 08:54:12,190][367737] Updated weights for policy 0, policy_version 52480 (0.0004) [2023-03-08 08:54:14,271][367454] Fps is (10 sec: 14745.6, 60 sec: 14540.8, 300 sec: 14426.2). Total num frames: 26898432. Throughput: 0: 14603.3. Samples: 26857544. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:54:14,272][367454] Avg episode reward: [(0, '4048.625')] [2023-03-08 08:54:15,008][367737] Updated weights for policy 0, policy_version 52560 (0.0004) [2023-03-08 08:54:17,851][367737] Updated weights for policy 0, policy_version 52640 (0.0003) [2023-03-08 08:54:19,272][367454] Fps is (10 sec: 14745.5, 60 sec: 14609.1, 300 sec: 14454.0). Total num frames: 26972160. Throughput: 0: 14766.8. Samples: 26944968. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:54:19,272][367454] Avg episode reward: [(0, '4325.612')] [2023-03-08 08:54:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000052680_26972160.pth... [2023-03-08 08:54:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000051808_26525696.pth [2023-03-08 08:54:20,583][367737] Updated weights for policy 0, policy_version 52720 (0.0003) [2023-03-08 08:54:23,332][367737] Updated weights for policy 0, policy_version 52800 (0.0003) [2023-03-08 08:54:24,271][367454] Fps is (10 sec: 14745.6, 60 sec: 14677.3, 300 sec: 14481.8). Total num frames: 27045888. Throughput: 0: 14940.2. Samples: 27034176. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:54:24,272][367454] Avg episode reward: [(0, '4353.560')] [2023-03-08 08:54:26,295][367737] Updated weights for policy 0, policy_version 52880 (0.0004) [2023-03-08 08:54:29,143][367737] Updated weights for policy 0, policy_version 52960 (0.0003) [2023-03-08 08:54:29,271][367454] Fps is (10 sec: 14336.1, 60 sec: 14609.1, 300 sec: 14481.8). Total num frames: 27115520. Throughput: 0: 14827.0. Samples: 27075656. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:54:29,272][367454] Avg episode reward: [(0, '4313.696')] [2023-03-08 08:54:31,854][367737] Updated weights for policy 0, policy_version 53040 (0.0003) [2023-03-08 08:54:34,271][367454] Fps is (10 sec: 14336.0, 60 sec: 14745.6, 300 sec: 14495.7). Total num frames: 27189248. Throughput: 0: 14761.2. Samples: 27164744. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:54:34,282][367454] Avg episode reward: [(0, '4301.529')] [2023-03-08 08:54:34,285][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000053104_27189248.pth... [2023-03-08 08:54:34,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000052248_26750976.pth [2023-03-08 08:54:34,707][367737] Updated weights for policy 0, policy_version 53120 (0.0004) [2023-03-08 08:54:37,711][367737] Updated weights for policy 0, policy_version 53200 (0.0006) [2023-03-08 08:54:39,272][367454] Fps is (10 sec: 14335.9, 60 sec: 14745.6, 300 sec: 14495.7). Total num frames: 27258880. Throughput: 0: 14661.7. Samples: 27246976. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 08:54:39,272][367454] Avg episode reward: [(0, '4264.550')] [2023-03-08 08:54:40,794][367737] Updated weights for policy 0, policy_version 53280 (0.0005) [2023-03-08 08:54:43,867][367737] Updated weights for policy 0, policy_version 53360 (0.0005) [2023-03-08 08:54:44,272][367454] Fps is (10 sec: 13516.7, 60 sec: 14609.1, 300 sec: 14481.8). Total num frames: 27324416. Throughput: 0: 14553.0. Samples: 27287560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:54:44,272][367454] Avg episode reward: [(0, '4039.906')] [2023-03-08 08:54:46,914][367737] Updated weights for policy 0, policy_version 53440 (0.0005) [2023-03-08 08:54:49,271][367454] Fps is (10 sec: 13107.2, 60 sec: 14404.3, 300 sec: 14467.9). Total num frames: 27389952. Throughput: 0: 14281.8. Samples: 27367476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:54:49,272][367454] Avg episode reward: [(0, '4176.490')] [2023-03-08 08:54:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000053496_27389952.pth... [2023-03-08 08:54:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000052680_26972160.pth [2023-03-08 08:54:49,989][367737] Updated weights for policy 0, policy_version 53520 (0.0005) [2023-03-08 08:54:53,144][367737] Updated weights for policy 0, policy_version 53600 (0.0005) [2023-03-08 08:54:54,272][367454] Fps is (10 sec: 13107.2, 60 sec: 14267.7, 300 sec: 14440.1). Total num frames: 27455488. Throughput: 0: 14077.2. Samples: 27447176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:54:54,272][367454] Avg episode reward: [(0, '3466.294')] [2023-03-08 08:54:56,061][367737] Updated weights for policy 0, policy_version 53680 (0.0005) [2023-03-08 08:54:58,870][367737] Updated weights for policy 0, policy_version 53760 (0.0004) [2023-03-08 08:54:59,271][367454] Fps is (10 sec: 13926.4, 60 sec: 14199.5, 300 sec: 14454.0). Total num frames: 27529216. Throughput: 0: 14020.5. Samples: 27488464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:54:59,272][367454] Avg episode reward: [(0, '3811.366')] [2023-03-08 08:55:01,637][367737] Updated weights for policy 0, policy_version 53840 (0.0004) [2023-03-08 08:55:04,272][367454] Fps is (10 sec: 14745.5, 60 sec: 14199.4, 300 sec: 14454.0). Total num frames: 27602944. Throughput: 0: 14042.6. Samples: 27576884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:55:04,272][367454] Avg episode reward: [(0, '4001.828')] [2023-03-08 08:55:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000053912_27602944.pth... [2023-03-08 08:55:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000053104_27189248.pth [2023-03-08 08:55:04,435][367737] Updated weights for policy 0, policy_version 53920 (0.0005) [2023-03-08 08:55:07,134][367737] Updated weights for policy 0, policy_version 54000 (0.0004) [2023-03-08 08:55:09,272][367454] Fps is (10 sec: 14745.5, 60 sec: 14199.5, 300 sec: 14440.1). Total num frames: 27676672. Throughput: 0: 14072.8. Samples: 27667452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:55:09,272][367454] Avg episode reward: [(0, '3965.821')] [2023-03-08 08:55:09,879][367737] Updated weights for policy 0, policy_version 54080 (0.0004) [2023-03-08 08:55:12,839][367737] Updated weights for policy 0, policy_version 54160 (0.0005) [2023-03-08 08:55:14,272][367454] Fps is (10 sec: 14335.9, 60 sec: 14131.2, 300 sec: 14412.4). Total num frames: 27746304. Throughput: 0: 14085.5. Samples: 27709504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:55:14,272][367454] Avg episode reward: [(0, '4319.446')] [2023-03-08 08:55:15,817][367737] Updated weights for policy 0, policy_version 54240 (0.0005) [2023-03-08 08:55:18,679][367737] Updated weights for policy 0, policy_version 54320 (0.0005) [2023-03-08 08:55:19,272][367454] Fps is (10 sec: 14335.9, 60 sec: 14131.2, 300 sec: 14398.5). Total num frames: 27820032. Throughput: 0: 13932.8. Samples: 27791720. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 08:55:19,272][367454] Avg episode reward: [(0, '4119.326')] [2023-03-08 08:55:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000054336_27820032.pth... [2023-03-08 08:55:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000053496_27389952.pth [2023-03-08 08:55:21,487][367737] Updated weights for policy 0, policy_version 54400 (0.0005) [2023-03-08 08:55:24,272][367454] Fps is (10 sec: 14336.1, 60 sec: 14062.9, 300 sec: 14370.7). Total num frames: 27889664. Throughput: 0: 14018.3. Samples: 27877800. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 08:55:24,272][367454] Avg episode reward: [(0, '4209.809')] [2023-03-08 08:55:24,554][367737] Updated weights for policy 0, policy_version 54480 (0.0005) [2023-03-08 08:55:27,499][367737] Updated weights for policy 0, policy_version 54560 (0.0005) [2023-03-08 08:55:29,271][367454] Fps is (10 sec: 13516.9, 60 sec: 13994.7, 300 sec: 14329.1). Total num frames: 27955200. Throughput: 0: 14028.7. Samples: 27918852. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 08:55:29,272][367454] Avg episode reward: [(0, '4235.806')] [2023-03-08 08:55:30,388][367737] Updated weights for policy 0, policy_version 54640 (0.0005) [2023-03-08 08:55:33,114][367737] Updated weights for policy 0, policy_version 54720 (0.0004) [2023-03-08 08:55:34,272][367454] Fps is (10 sec: 14336.1, 60 sec: 14062.9, 300 sec: 14342.9). Total num frames: 28033024. Throughput: 0: 14166.9. Samples: 28004988. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 08:55:34,272][367454] Avg episode reward: [(0, '4162.315')] [2023-03-08 08:55:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000054752_28033024.pth... [2023-03-08 08:55:34,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000053912_27602944.pth [2023-03-08 08:55:35,769][367737] Updated weights for policy 0, policy_version 54800 (0.0003) [2023-03-08 08:55:38,457][367737] Updated weights for policy 0, policy_version 54880 (0.0004) [2023-03-08 08:55:39,271][367454] Fps is (10 sec: 15564.7, 60 sec: 14199.5, 300 sec: 14342.9). Total num frames: 28110848. Throughput: 0: 14450.6. Samples: 28097452. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 08:55:39,272][367454] Avg episode reward: [(0, '4309.661')] [2023-03-08 08:55:41,042][367737] Updated weights for policy 0, policy_version 54960 (0.0003) [2023-03-08 08:55:43,832][367737] Updated weights for policy 0, policy_version 55040 (0.0005) [2023-03-08 08:55:44,271][367454] Fps is (10 sec: 15155.3, 60 sec: 14336.0, 300 sec: 14342.9). Total num frames: 28184576. Throughput: 0: 14579.4. Samples: 28144536. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 08:55:44,272][367454] Avg episode reward: [(0, '4219.380')] [2023-03-08 08:55:46,500][367737] Updated weights for policy 0, policy_version 55120 (0.0003) [2023-03-08 08:55:49,178][367737] Updated weights for policy 0, policy_version 55200 (0.0003) [2023-03-08 08:55:49,272][367454] Fps is (10 sec: 15155.2, 60 sec: 14540.8, 300 sec: 14356.8). Total num frames: 28262400. Throughput: 0: 14636.6. Samples: 28235532. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 08:55:49,272][367454] Avg episode reward: [(0, '4276.289')] [2023-03-08 08:55:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000055200_28262400.pth... [2023-03-08 08:55:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000054336_27820032.pth [2023-03-08 08:55:51,813][367737] Updated weights for policy 0, policy_version 55280 (0.0003) [2023-03-08 08:55:54,271][367454] Fps is (10 sec: 15564.8, 60 sec: 14745.6, 300 sec: 14356.8). Total num frames: 28340224. Throughput: 0: 14681.2. Samples: 28328104. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:55:54,272][367454] Avg episode reward: [(0, '4409.773')] [2023-03-08 08:55:54,272][367693] Saving new best policy, reward=4409.773! [2023-03-08 08:55:54,396][367737] Updated weights for policy 0, policy_version 55360 (0.0003) [2023-03-08 08:55:57,137][367737] Updated weights for policy 0, policy_version 55440 (0.0004) [2023-03-08 08:55:59,272][367454] Fps is (10 sec: 15564.6, 60 sec: 14813.8, 300 sec: 14370.7). Total num frames: 28418048. Throughput: 0: 14757.1. Samples: 28373576. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:55:59,272][367454] Avg episode reward: [(0, '4257.296')] [2023-03-08 08:55:59,741][367737] Updated weights for policy 0, policy_version 55520 (0.0003) [2023-03-08 08:56:02,408][367737] Updated weights for policy 0, policy_version 55600 (0.0004) [2023-03-08 08:56:04,272][367454] Fps is (10 sec: 15155.2, 60 sec: 14813.9, 300 sec: 14370.7). Total num frames: 28491776. Throughput: 0: 15009.1. Samples: 28467128. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:56:04,272][367454] Avg episode reward: [(0, '4233.230')] [2023-03-08 08:56:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000055648_28491776.pth... [2023-03-08 08:56:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000054752_28033024.pth [2023-03-08 08:56:05,072][367737] Updated weights for policy 0, policy_version 55680 (0.0004) [2023-03-08 08:56:07,781][367737] Updated weights for policy 0, policy_version 55760 (0.0004) [2023-03-08 08:56:09,272][367454] Fps is (10 sec: 15155.4, 60 sec: 14882.1, 300 sec: 14384.6). Total num frames: 28569600. Throughput: 0: 15104.0. Samples: 28557480. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:56:09,282][367454] Avg episode reward: [(0, '4181.667')] [2023-03-08 08:56:10,469][367737] Updated weights for policy 0, policy_version 55840 (0.0004) [2023-03-08 08:56:13,078][367737] Updated weights for policy 0, policy_version 55920 (0.0003) [2023-03-08 08:56:14,272][367454] Fps is (10 sec: 15564.8, 60 sec: 15018.7, 300 sec: 14398.5). Total num frames: 28647424. Throughput: 0: 15239.9. Samples: 28604648. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:56:14,282][367454] Avg episode reward: [(0, '4184.211')] [2023-03-08 08:56:15,669][367737] Updated weights for policy 0, policy_version 56000 (0.0004) [2023-03-08 08:56:18,243][367737] Updated weights for policy 0, policy_version 56080 (0.0003) [2023-03-08 08:56:19,272][367454] Fps is (10 sec: 15564.7, 60 sec: 15086.9, 300 sec: 14412.4). Total num frames: 28725248. Throughput: 0: 15443.2. Samples: 28699932. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:56:19,283][367454] Avg episode reward: [(0, '4159.804')] [2023-03-08 08:56:19,291][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000056112_28729344.pth... [2023-03-08 08:56:19,293][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000055200_28262400.pth [2023-03-08 08:56:20,912][367737] Updated weights for policy 0, policy_version 56160 (0.0004) [2023-03-08 08:56:23,537][367737] Updated weights for policy 0, policy_version 56240 (0.0003) [2023-03-08 08:56:24,272][367454] Fps is (10 sec: 15564.8, 60 sec: 15223.5, 300 sec: 14440.1). Total num frames: 28803072. Throughput: 0: 15447.4. Samples: 28792584. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:56:24,282][367454] Avg episode reward: [(0, '4189.353')] [2023-03-08 08:56:26,180][367737] Updated weights for policy 0, policy_version 56320 (0.0004) [2023-03-08 08:56:28,789][367737] Updated weights for policy 0, policy_version 56400 (0.0004) [2023-03-08 08:56:29,272][367454] Fps is (10 sec: 15564.9, 60 sec: 15428.3, 300 sec: 14454.0). Total num frames: 28880896. Throughput: 0: 15443.1. Samples: 28839476. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:56:29,282][367454] Avg episode reward: [(0, '4163.582')] [2023-03-08 08:56:31,408][367737] Updated weights for policy 0, policy_version 56480 (0.0003) [2023-03-08 08:56:34,031][367737] Updated weights for policy 0, policy_version 56560 (0.0003) [2023-03-08 08:56:34,272][367454] Fps is (10 sec: 15564.8, 60 sec: 15428.3, 300 sec: 14481.8). Total num frames: 28958720. Throughput: 0: 15505.9. Samples: 28933296. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:56:34,282][367454] Avg episode reward: [(0, '4070.283')] [2023-03-08 08:56:34,310][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000056568_28962816.pth... [2023-03-08 08:56:34,311][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000055648_28491776.pth [2023-03-08 08:56:36,699][367737] Updated weights for policy 0, policy_version 56640 (0.0004) [2023-03-08 08:56:39,272][367454] Fps is (10 sec: 15564.8, 60 sec: 15428.3, 300 sec: 14509.6). Total num frames: 29036544. Throughput: 0: 15521.6. Samples: 29026576. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:56:39,282][367454] Avg episode reward: [(0, '4188.699')] [2023-03-08 08:56:39,327][367737] Updated weights for policy 0, policy_version 56720 (0.0004) [2023-03-08 08:56:42,039][367737] Updated weights for policy 0, policy_version 56800 (0.0004) [2023-03-08 08:56:44,272][367454] Fps is (10 sec: 15155.2, 60 sec: 15428.3, 300 sec: 14523.4). Total num frames: 29110272. Throughput: 0: 15546.3. Samples: 29073156. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:56:44,282][367454] Avg episode reward: [(0, '4026.809')] [2023-03-08 08:56:44,992][367737] Updated weights for policy 0, policy_version 56880 (0.0005) [2023-03-08 08:56:47,870][367737] Updated weights for policy 0, policy_version 56960 (0.0005) [2023-03-08 08:56:49,272][367454] Fps is (10 sec: 14745.6, 60 sec: 15360.0, 300 sec: 14537.3). Total num frames: 29184000. Throughput: 0: 15308.9. Samples: 29156028. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:56:49,282][367454] Avg episode reward: [(0, '4246.314')] [2023-03-08 08:56:49,285][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000057000_29184000.pth... [2023-03-08 08:56:49,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000056112_28729344.pth [2023-03-08 08:56:50,507][367737] Updated weights for policy 0, policy_version 57040 (0.0004) [2023-03-08 08:56:53,164][367737] Updated weights for policy 0, policy_version 57120 (0.0004) [2023-03-08 08:56:54,272][367454] Fps is (10 sec: 15155.2, 60 sec: 15360.0, 300 sec: 14579.0). Total num frames: 29261824. Throughput: 0: 15375.6. Samples: 29249380. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:56:54,282][367454] Avg episode reward: [(0, '4356.945')] [2023-03-08 08:56:55,864][367737] Updated weights for policy 0, policy_version 57200 (0.0004) [2023-03-08 08:56:58,616][367737] Updated weights for policy 0, policy_version 57280 (0.0004) [2023-03-08 08:56:59,271][367454] Fps is (10 sec: 15155.3, 60 sec: 15291.8, 300 sec: 14606.8). Total num frames: 29335552. Throughput: 0: 15332.5. Samples: 29294608. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:56:59,272][367454] Avg episode reward: [(0, '4371.916')] [2023-03-08 08:57:01,576][367737] Updated weights for policy 0, policy_version 57360 (0.0005) [2023-03-08 08:57:04,272][367454] Fps is (10 sec: 13926.4, 60 sec: 15155.2, 300 sec: 14592.9). Total num frames: 29401088. Throughput: 0: 15116.9. Samples: 29380192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:57:04,272][367454] Avg episode reward: [(0, '4394.268')] [2023-03-08 08:57:04,295][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000057432_29405184.pth... [2023-03-08 08:57:04,298][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000056568_28962816.pth [2023-03-08 08:57:04,612][367737] Updated weights for policy 0, policy_version 57440 (0.0005) [2023-03-08 08:57:07,603][367737] Updated weights for policy 0, policy_version 57520 (0.0005) [2023-03-08 08:57:09,272][367454] Fps is (10 sec: 13516.7, 60 sec: 15018.7, 300 sec: 14620.6). Total num frames: 29470720. Throughput: 0: 14851.4. Samples: 29460896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:57:09,272][367454] Avg episode reward: [(0, '4389.942')] [2023-03-08 08:57:10,562][367737] Updated weights for policy 0, policy_version 57600 (0.0005) [2023-03-08 08:57:13,582][367737] Updated weights for policy 0, policy_version 57680 (0.0005) [2023-03-08 08:57:14,272][367454] Fps is (10 sec: 13926.4, 60 sec: 14882.1, 300 sec: 14606.8). Total num frames: 29540352. Throughput: 0: 14754.8. Samples: 29503444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:57:14,272][367454] Avg episode reward: [(0, '4379.074')] [2023-03-08 08:57:16,562][367737] Updated weights for policy 0, policy_version 57760 (0.0005) [2023-03-08 08:57:19,271][367454] Fps is (10 sec: 13926.5, 60 sec: 14745.6, 300 sec: 14592.9). Total num frames: 29609984. Throughput: 0: 14491.4. Samples: 29585408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:57:19,272][367454] Avg episode reward: [(0, '4372.002')] [2023-03-08 08:57:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000057832_29609984.pth... [2023-03-08 08:57:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000057000_29184000.pth [2023-03-08 08:57:19,554][367737] Updated weights for policy 0, policy_version 57840 (0.0005) [2023-03-08 08:57:22,503][367737] Updated weights for policy 0, policy_version 57920 (0.0005) [2023-03-08 08:57:24,271][367454] Fps is (10 sec: 13926.5, 60 sec: 14609.1, 300 sec: 14606.8). Total num frames: 29679616. Throughput: 0: 14251.9. Samples: 29667912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:57:24,272][367454] Avg episode reward: [(0, '4329.159')] [2023-03-08 08:57:25,339][367737] Updated weights for policy 0, policy_version 58000 (0.0005) [2023-03-08 08:57:28,319][367737] Updated weights for policy 0, policy_version 58080 (0.0005) [2023-03-08 08:57:29,271][367454] Fps is (10 sec: 13926.4, 60 sec: 14472.5, 300 sec: 14620.6). Total num frames: 29749248. Throughput: 0: 14188.0. Samples: 29711616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:57:29,272][367454] Avg episode reward: [(0, '4260.578')] [2023-03-08 08:57:31,303][367737] Updated weights for policy 0, policy_version 58160 (0.0005) [2023-03-08 08:57:34,271][367454] Fps is (10 sec: 13516.8, 60 sec: 14267.8, 300 sec: 14592.9). Total num frames: 29814784. Throughput: 0: 14163.2. Samples: 29793372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:57:34,272][367454] Avg episode reward: [(0, '4173.546')] [2023-03-08 08:57:34,291][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000058240_29818880.pth... [2023-03-08 08:57:34,291][367737] Updated weights for policy 0, policy_version 58240 (0.0005) [2023-03-08 08:57:34,292][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000057432_29405184.pth [2023-03-08 08:57:37,366][367737] Updated weights for policy 0, policy_version 58320 (0.0005) [2023-03-08 08:57:39,272][367454] Fps is (10 sec: 13516.7, 60 sec: 14131.2, 300 sec: 14579.0). Total num frames: 29884416. Throughput: 0: 13898.0. Samples: 29874792. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:57:39,272][367454] Avg episode reward: [(0, '3775.918')] [2023-03-08 08:57:40,302][367737] Updated weights for policy 0, policy_version 58400 (0.0005) [2023-03-08 08:57:43,330][367737] Updated weights for policy 0, policy_version 58480 (0.0005) [2023-03-08 08:57:44,271][367454] Fps is (10 sec: 13926.4, 60 sec: 14062.9, 300 sec: 14551.2). Total num frames: 29954048. Throughput: 0: 13804.1. Samples: 29915792. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:57:44,272][367454] Avg episode reward: [(0, '3709.519')] [2023-03-08 08:57:46,319][367737] Updated weights for policy 0, policy_version 58560 (0.0005) [2023-03-08 08:57:49,272][367454] Fps is (10 sec: 13516.7, 60 sec: 13926.4, 300 sec: 14509.6). Total num frames: 30019584. Throughput: 0: 13695.5. Samples: 29996492. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:57:49,272][367454] Avg episode reward: [(0, '4144.886')] [2023-03-08 08:57:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000058632_30019584.pth... [2023-03-08 08:57:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000057832_29609984.pth [2023-03-08 08:57:49,410][367737] Updated weights for policy 0, policy_version 58640 (0.0005) [2023-03-08 08:57:52,496][367737] Updated weights for policy 0, policy_version 58720 (0.0005) [2023-03-08 08:57:54,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13721.6, 300 sec: 14467.9). Total num frames: 30085120. Throughput: 0: 13688.4. Samples: 30076872. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:57:54,272][367454] Avg episode reward: [(0, '4060.258')] [2023-03-08 08:57:55,596][367737] Updated weights for policy 0, policy_version 58800 (0.0005) [2023-03-08 08:57:58,610][367737] Updated weights for policy 0, policy_version 58880 (0.0004) [2023-03-08 08:57:59,271][367454] Fps is (10 sec: 13517.0, 60 sec: 13653.3, 300 sec: 14467.9). Total num frames: 30154752. Throughput: 0: 13627.9. Samples: 30116696. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:57:59,272][367454] Avg episode reward: [(0, '4063.372')] [2023-03-08 08:58:01,834][367737] Updated weights for policy 0, policy_version 58960 (0.0005) [2023-03-08 08:58:04,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13585.1, 300 sec: 14440.1). Total num frames: 30216192. Throughput: 0: 13553.9. Samples: 30195336. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:58:04,272][367454] Avg episode reward: [(0, '3608.578')] [2023-03-08 08:58:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000059016_30216192.pth... [2023-03-08 08:58:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000058240_29818880.pth [2023-03-08 08:58:05,163][367737] Updated weights for policy 0, policy_version 59040 (0.0005) [2023-03-08 08:58:08,315][367737] Updated weights for policy 0, policy_version 59120 (0.0005) [2023-03-08 08:58:09,272][367454] Fps is (10 sec: 12697.5, 60 sec: 13516.8, 300 sec: 14426.3). Total num frames: 30281728. Throughput: 0: 13384.2. Samples: 30270200. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 08:58:09,272][367454] Avg episode reward: [(0, '3523.629')] [2023-03-08 08:58:11,384][367737] Updated weights for policy 0, policy_version 59200 (0.0005) [2023-03-08 08:58:14,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 14412.4). Total num frames: 30347264. Throughput: 0: 13307.7. Samples: 30310464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:58:14,272][367454] Avg episode reward: [(0, '4073.986')] [2023-03-08 08:58:14,336][367737] Updated weights for policy 0, policy_version 59280 (0.0005) [2023-03-08 08:58:17,363][367737] Updated weights for policy 0, policy_version 59360 (0.0004) [2023-03-08 08:58:19,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 14412.4). Total num frames: 30416896. Throughput: 0: 13311.5. Samples: 30392392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:58:19,272][367454] Avg episode reward: [(0, '4064.785')] [2023-03-08 08:58:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000059408_30416896.pth... [2023-03-08 08:58:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000058632_30019584.pth [2023-03-08 08:58:20,323][367737] Updated weights for policy 0, policy_version 59440 (0.0005) [2023-03-08 08:58:23,283][367737] Updated weights for policy 0, policy_version 59520 (0.0005) [2023-03-08 08:58:24,271][367454] Fps is (10 sec: 13926.5, 60 sec: 13448.5, 300 sec: 14398.5). Total num frames: 30486528. Throughput: 0: 13350.9. Samples: 30475580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:58:24,272][367454] Avg episode reward: [(0, '4091.545')] [2023-03-08 08:58:26,229][367737] Updated weights for policy 0, policy_version 59600 (0.0005) [2023-03-08 08:58:29,261][367737] Updated weights for policy 0, policy_version 59680 (0.0005) [2023-03-08 08:58:29,272][367454] Fps is (10 sec: 13926.3, 60 sec: 13448.5, 300 sec: 14412.4). Total num frames: 30556160. Throughput: 0: 13373.7. Samples: 30517608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:58:29,272][367454] Avg episode reward: [(0, '4195.089')] [2023-03-08 08:58:32,205][367737] Updated weights for policy 0, policy_version 59760 (0.0005) [2023-03-08 08:58:34,272][367454] Fps is (10 sec: 13926.3, 60 sec: 13516.8, 300 sec: 14412.4). Total num frames: 30625792. Throughput: 0: 13411.6. Samples: 30600012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:58:34,272][367454] Avg episode reward: [(0, '4204.363')] [2023-03-08 08:58:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000059816_30625792.pth... [2023-03-08 08:58:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000059016_30216192.pth [2023-03-08 08:58:35,003][367737] Updated weights for policy 0, policy_version 59840 (0.0004) [2023-03-08 08:58:37,610][367737] Updated weights for policy 0, policy_version 59920 (0.0003) [2023-03-08 08:58:39,272][367454] Fps is (10 sec: 14745.6, 60 sec: 13653.3, 300 sec: 14426.3). Total num frames: 30703616. Throughput: 0: 13656.2. Samples: 30691400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:58:39,272][367454] Avg episode reward: [(0, '4184.236')] [2023-03-08 08:58:40,186][367737] Updated weights for policy 0, policy_version 60000 (0.0004) [2023-03-08 08:58:43,096][367737] Updated weights for policy 0, policy_version 60080 (0.0004) [2023-03-08 08:58:44,271][367454] Fps is (10 sec: 14745.8, 60 sec: 13653.3, 300 sec: 14398.5). Total num frames: 30773248. Throughput: 0: 13795.0. Samples: 30737472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:58:44,272][367454] Avg episode reward: [(0, '3956.586')] [2023-03-08 08:58:46,147][367737] Updated weights for policy 0, policy_version 60160 (0.0004) [2023-03-08 08:58:49,076][367737] Updated weights for policy 0, policy_version 60240 (0.0004) [2023-03-08 08:58:49,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13721.6, 300 sec: 14384.6). Total num frames: 30842880. Throughput: 0: 13859.1. Samples: 30818996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:58:49,272][367454] Avg episode reward: [(0, '3938.124')] [2023-03-08 08:58:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000060240_30842880.pth... [2023-03-08 08:58:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000059408_30416896.pth [2023-03-08 08:58:51,648][367737] Updated weights for policy 0, policy_version 60320 (0.0003) [2023-03-08 08:58:54,272][367454] Fps is (10 sec: 14745.5, 60 sec: 13926.4, 300 sec: 14384.6). Total num frames: 30920704. Throughput: 0: 14236.0. Samples: 30910820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:58:54,272][367454] Avg episode reward: [(0, '3759.862')] [2023-03-08 08:58:54,333][367737] Updated weights for policy 0, policy_version 60400 (0.0004) [2023-03-08 08:58:57,186][367737] Updated weights for policy 0, policy_version 60480 (0.0004) [2023-03-08 08:58:58,519][367693] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000005 [2023-03-08 08:58:59,271][367454] Fps is (10 sec: 15564.9, 60 sec: 14062.9, 300 sec: 14398.5). Total num frames: 30998528. Throughput: 0: 14322.6. Samples: 30954980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:58:59,272][367454] Avg episode reward: [(0, '3927.179')] [2023-03-08 08:58:59,792][367737] Updated weights for policy 0, policy_version 60560 (0.0003) [2023-03-08 08:59:02,638][367737] Updated weights for policy 0, policy_version 60640 (0.0004) [2023-03-08 08:59:04,272][367454] Fps is (10 sec: 14745.5, 60 sec: 14199.5, 300 sec: 14384.6). Total num frames: 31068160. Throughput: 0: 14480.1. Samples: 31043996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:59:04,272][367454] Avg episode reward: [(0, '3321.148')] [2023-03-08 08:59:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000060680_31068160.pth... [2023-03-08 08:59:04,279][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000059816_30625792.pth [2023-03-08 08:59:05,807][367737] Updated weights for policy 0, policy_version 60720 (0.0005) [2023-03-08 08:59:08,903][367737] Updated weights for policy 0, policy_version 60800 (0.0005) [2023-03-08 08:59:09,271][367454] Fps is (10 sec: 13516.8, 60 sec: 14199.5, 300 sec: 14356.8). Total num frames: 31133696. Throughput: 0: 14381.4. Samples: 31122744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:59:09,272][367454] Avg episode reward: [(0, '2977.670')] [2023-03-08 08:59:12,040][367737] Updated weights for policy 0, policy_version 60880 (0.0005) [2023-03-08 08:59:14,272][367454] Fps is (10 sec: 13107.2, 60 sec: 14199.5, 300 sec: 14329.1). Total num frames: 31199232. Throughput: 0: 14327.8. Samples: 31162360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:59:14,272][367454] Avg episode reward: [(0, '2888.774')] [2023-03-08 08:59:15,244][367737] Updated weights for policy 0, policy_version 60960 (0.0005) [2023-03-08 08:59:18,508][367737] Updated weights for policy 0, policy_version 61040 (0.0005) [2023-03-08 08:59:19,272][367454] Fps is (10 sec: 12697.5, 60 sec: 14062.9, 300 sec: 14287.4). Total num frames: 31260672. Throughput: 0: 14215.6. Samples: 31239716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:59:19,272][367454] Avg episode reward: [(0, '2629.873')] [2023-03-08 08:59:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000061056_31260672.pth... [2023-03-08 08:59:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000060240_30842880.pth [2023-03-08 08:59:21,646][367737] Updated weights for policy 0, policy_version 61120 (0.0005) [2023-03-08 08:59:24,272][367454] Fps is (10 sec: 12697.6, 60 sec: 13994.7, 300 sec: 14273.5). Total num frames: 31326208. Throughput: 0: 13855.8. Samples: 31314912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 08:59:24,272][367454] Avg episode reward: [(0, '2365.542')] [2023-03-08 08:59:24,862][367737] Updated weights for policy 0, policy_version 61200 (0.0005) [2023-03-08 08:59:28,079][367737] Updated weights for policy 0, policy_version 61280 (0.0005) [2023-03-08 08:59:29,272][367454] Fps is (10 sec: 12697.6, 60 sec: 13858.1, 300 sec: 14231.9). Total num frames: 31387648. Throughput: 0: 13720.1. Samples: 31354880. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:59:29,272][367454] Avg episode reward: [(0, '2481.355')] [2023-03-08 08:59:31,199][367737] Updated weights for policy 0, policy_version 61360 (0.0005) [2023-03-08 08:59:34,271][367454] Fps is (10 sec: 12697.7, 60 sec: 13789.9, 300 sec: 14218.0). Total num frames: 31453184. Throughput: 0: 13637.3. Samples: 31432676. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:59:34,282][367454] Avg episode reward: [(0, '2728.630')] [2023-03-08 08:59:34,323][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000061440_31457280.pth... [2023-03-08 08:59:34,323][367737] Updated weights for policy 0, policy_version 61440 (0.0005) [2023-03-08 08:59:34,324][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000060680_31068160.pth [2023-03-08 08:59:37,496][367737] Updated weights for policy 0, policy_version 61520 (0.0005) [2023-03-08 08:59:39,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13585.1, 300 sec: 14218.0). Total num frames: 31518720. Throughput: 0: 13326.8. Samples: 31510528. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:59:39,283][367454] Avg episode reward: [(0, '2770.371')] [2023-03-08 08:59:40,599][367737] Updated weights for policy 0, policy_version 61600 (0.0005) [2023-03-08 08:59:43,686][367737] Updated weights for policy 0, policy_version 61680 (0.0005) [2023-03-08 08:59:44,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13516.8, 300 sec: 14218.0). Total num frames: 31584256. Throughput: 0: 13220.9. Samples: 31549920. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:59:44,283][367454] Avg episode reward: [(0, '2719.845')] [2023-03-08 08:59:46,774][367737] Updated weights for policy 0, policy_version 61760 (0.0005) [2023-03-08 08:59:49,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 14218.0). Total num frames: 31649792. Throughput: 0: 13007.2. Samples: 31629320. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:59:49,282][367454] Avg episode reward: [(0, '2639.955')] [2023-03-08 08:59:49,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000061816_31649792.pth... [2023-03-08 08:59:49,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000061056_31260672.pth [2023-03-08 08:59:49,970][367737] Updated weights for policy 0, policy_version 61840 (0.0005) [2023-03-08 08:59:53,043][367737] Updated weights for policy 0, policy_version 61920 (0.0005) [2023-03-08 08:59:54,271][367454] Fps is (10 sec: 13516.9, 60 sec: 13312.0, 300 sec: 14204.1). Total num frames: 31719424. Throughput: 0: 12994.8. Samples: 31707512. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:59:54,272][367454] Avg episode reward: [(0, '2883.525')] [2023-03-08 08:59:55,908][367737] Updated weights for policy 0, policy_version 62000 (0.0005) [2023-03-08 08:59:59,000][367737] Updated weights for policy 0, policy_version 62080 (0.0005) [2023-03-08 08:59:59,271][367454] Fps is (10 sec: 13516.9, 60 sec: 13107.2, 300 sec: 14176.3). Total num frames: 31784960. Throughput: 0: 13075.6. Samples: 31750760. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 08:59:59,282][367454] Avg episode reward: [(0, '3252.606')] [2023-03-08 09:00:02,015][367737] Updated weights for policy 0, policy_version 62160 (0.0005) [2023-03-08 09:00:04,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13107.2, 300 sec: 14162.4). Total num frames: 31854592. Throughput: 0: 13126.1. Samples: 31830388. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:00:04,282][367454] Avg episode reward: [(0, '2797.682')] [2023-03-08 09:00:04,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000062216_31854592.pth... [2023-03-08 09:00:04,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000061440_31457280.pth [2023-03-08 09:00:05,164][367737] Updated weights for policy 0, policy_version 62240 (0.0005) [2023-03-08 09:00:07,886][367737] Updated weights for policy 0, policy_version 62320 (0.0004) [2023-03-08 09:00:09,272][367454] Fps is (10 sec: 14335.9, 60 sec: 13243.7, 300 sec: 14176.3). Total num frames: 31928320. Throughput: 0: 13358.2. Samples: 31916032. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:00:09,283][367454] Avg episode reward: [(0, '3074.537')] [2023-03-08 09:00:10,528][367737] Updated weights for policy 0, policy_version 62400 (0.0003) [2023-03-08 09:00:13,187][367737] Updated weights for policy 0, policy_version 62480 (0.0003) [2023-03-08 09:00:14,272][367454] Fps is (10 sec: 14745.5, 60 sec: 13380.3, 300 sec: 14176.3). Total num frames: 32002048. Throughput: 0: 13499.0. Samples: 31962336. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:00:14,283][367454] Avg episode reward: [(0, '3272.121')] [2023-03-08 09:00:15,949][367737] Updated weights for policy 0, policy_version 62560 (0.0004) [2023-03-08 09:00:18,657][367737] Updated weights for policy 0, policy_version 62640 (0.0004) [2023-03-08 09:00:19,272][367454] Fps is (10 sec: 15155.2, 60 sec: 13653.3, 300 sec: 14204.1). Total num frames: 32079872. Throughput: 0: 13755.5. Samples: 32051676. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:00:19,282][367454] Avg episode reward: [(0, '3065.904')] [2023-03-08 09:00:19,285][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000062656_32079872.pth... [2023-03-08 09:00:19,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000061816_31649792.pth [2023-03-08 09:00:21,304][367737] Updated weights for policy 0, policy_version 62720 (0.0004) [2023-03-08 09:00:23,935][367737] Updated weights for policy 0, policy_version 62800 (0.0003) [2023-03-08 09:00:24,271][367454] Fps is (10 sec: 15564.9, 60 sec: 13858.1, 300 sec: 14245.7). Total num frames: 32157696. Throughput: 0: 14098.1. Samples: 32144940. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:00:24,282][367454] Avg episode reward: [(0, '3095.613')] [2023-03-08 09:00:26,665][367737] Updated weights for policy 0, policy_version 62880 (0.0004) [2023-03-08 09:00:29,271][367454] Fps is (10 sec: 15155.2, 60 sec: 14063.0, 300 sec: 14231.9). Total num frames: 32231424. Throughput: 0: 14234.6. Samples: 32190476. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:00:29,272][367454] Avg episode reward: [(0, '3196.179')] [2023-03-08 09:00:29,389][367737] Updated weights for policy 0, policy_version 62960 (0.0004) [2023-03-08 09:00:32,094][367737] Updated weights for policy 0, policy_version 63040 (0.0004) [2023-03-08 09:00:34,271][367454] Fps is (10 sec: 15155.2, 60 sec: 14267.7, 300 sec: 14231.9). Total num frames: 32309248. Throughput: 0: 14474.0. Samples: 32280648. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:00:34,272][367454] Avg episode reward: [(0, '3242.066')] [2023-03-08 09:00:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000063104_32309248.pth... [2023-03-08 09:00:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000062216_31854592.pth [2023-03-08 09:00:34,752][367737] Updated weights for policy 0, policy_version 63120 (0.0003) [2023-03-08 09:00:37,436][367737] Updated weights for policy 0, policy_version 63200 (0.0004) [2023-03-08 09:00:39,271][367454] Fps is (10 sec: 15155.2, 60 sec: 14404.3, 300 sec: 14231.9). Total num frames: 32382976. Throughput: 0: 14760.8. Samples: 32371748. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:00:39,272][367454] Avg episode reward: [(0, '3400.153')] [2023-03-08 09:00:40,156][367737] Updated weights for policy 0, policy_version 63280 (0.0004) [2023-03-08 09:00:42,877][367737] Updated weights for policy 0, policy_version 63360 (0.0004) [2023-03-08 09:00:44,271][367454] Fps is (10 sec: 15155.2, 60 sec: 14609.1, 300 sec: 14231.9). Total num frames: 32460800. Throughput: 0: 14819.6. Samples: 32417640. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:00:44,272][367454] Avg episode reward: [(0, '3688.411')] [2023-03-08 09:00:45,582][367737] Updated weights for policy 0, policy_version 63440 (0.0004) [2023-03-08 09:00:48,269][367737] Updated weights for policy 0, policy_version 63520 (0.0003) [2023-03-08 09:00:49,272][367454] Fps is (10 sec: 15155.1, 60 sec: 14745.6, 300 sec: 14218.0). Total num frames: 32534528. Throughput: 0: 15080.0. Samples: 32508988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:00:49,272][367454] Avg episode reward: [(0, '3323.267')] [2023-03-08 09:00:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000063544_32534528.pth... [2023-03-08 09:00:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000062656_32079872.pth [2023-03-08 09:00:51,139][367737] Updated weights for policy 0, policy_version 63600 (0.0004) [2023-03-08 09:00:53,980][367737] Updated weights for policy 0, policy_version 63680 (0.0004) [2023-03-08 09:00:54,271][367454] Fps is (10 sec: 14745.6, 60 sec: 14813.9, 300 sec: 14204.1). Total num frames: 32608256. Throughput: 0: 15101.2. Samples: 32595584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:00:54,272][367454] Avg episode reward: [(0, '3220.703')] [2023-03-08 09:00:56,645][367737] Updated weights for policy 0, policy_version 63760 (0.0004) [2023-03-08 09:00:59,271][367454] Fps is (10 sec: 14745.7, 60 sec: 14950.4, 300 sec: 14204.1). Total num frames: 32681984. Throughput: 0: 15083.4. Samples: 32641088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:00:59,272][367454] Avg episode reward: [(0, '3143.960')] [2023-03-08 09:00:59,348][367737] Updated weights for policy 0, policy_version 63840 (0.0003) [2023-03-08 09:01:01,971][367737] Updated weights for policy 0, policy_version 63920 (0.0003) [2023-03-08 09:01:04,272][367454] Fps is (10 sec: 15155.1, 60 sec: 15086.9, 300 sec: 14204.1). Total num frames: 32759808. Throughput: 0: 15140.4. Samples: 32732996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:01:04,272][367454] Avg episode reward: [(0, '3067.483')] [2023-03-08 09:01:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000063984_32759808.pth... [2023-03-08 09:01:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000063104_32309248.pth [2023-03-08 09:01:04,664][367737] Updated weights for policy 0, policy_version 64000 (0.0004) [2023-03-08 09:01:07,378][367737] Updated weights for policy 0, policy_version 64080 (0.0004) [2023-03-08 09:01:09,272][367454] Fps is (10 sec: 15155.1, 60 sec: 15086.9, 300 sec: 14190.2). Total num frames: 32833536. Throughput: 0: 15086.6. Samples: 32823836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:01:09,272][367454] Avg episode reward: [(0, '3074.463')] [2023-03-08 09:01:10,170][367737] Updated weights for policy 0, policy_version 64160 (0.0004) [2023-03-08 09:01:12,905][367737] Updated weights for policy 0, policy_version 64240 (0.0004) [2023-03-08 09:01:14,271][367454] Fps is (10 sec: 14745.8, 60 sec: 15087.0, 300 sec: 14176.3). Total num frames: 32907264. Throughput: 0: 15063.7. Samples: 32868340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:01:14,272][367454] Avg episode reward: [(0, '3119.015')] [2023-03-08 09:01:15,749][367737] Updated weights for policy 0, policy_version 64320 (0.0004) [2023-03-08 09:01:18,559][367737] Updated weights for policy 0, policy_version 64400 (0.0004) [2023-03-08 09:01:19,272][367454] Fps is (10 sec: 14745.6, 60 sec: 15018.7, 300 sec: 14162.4). Total num frames: 32980992. Throughput: 0: 15006.1. Samples: 32955924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:01:19,272][367454] Avg episode reward: [(0, '3465.606')] [2023-03-08 09:01:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000064416_32980992.pth... [2023-03-08 09:01:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000063544_32534528.pth [2023-03-08 09:01:21,337][367737] Updated weights for policy 0, policy_version 64480 (0.0003) [2023-03-08 09:01:24,124][367737] Updated weights for policy 0, policy_version 64560 (0.0003) [2023-03-08 09:01:24,272][367454] Fps is (10 sec: 14745.5, 60 sec: 14950.4, 300 sec: 14148.6). Total num frames: 33054720. Throughput: 0: 14929.7. Samples: 33043584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:01:24,272][367454] Avg episode reward: [(0, '3408.966')] [2023-03-08 09:01:27,074][367737] Updated weights for policy 0, policy_version 64640 (0.0004) [2023-03-08 09:01:29,271][367454] Fps is (10 sec: 14336.0, 60 sec: 14882.1, 300 sec: 14120.8). Total num frames: 33124352. Throughput: 0: 14885.5. Samples: 33087488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:01:29,272][367454] Avg episode reward: [(0, '3146.078')] [2023-03-08 09:01:30,214][367737] Updated weights for policy 0, policy_version 64720 (0.0005) [2023-03-08 09:01:33,398][367737] Updated weights for policy 0, policy_version 64800 (0.0005) [2023-03-08 09:01:34,271][367454] Fps is (10 sec: 13107.2, 60 sec: 14609.1, 300 sec: 14065.2). Total num frames: 33185792. Throughput: 0: 14576.7. Samples: 33164940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:01:34,272][367454] Avg episode reward: [(0, '2918.730')] [2023-03-08 09:01:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000064816_33185792.pth... [2023-03-08 09:01:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000063984_32759808.pth [2023-03-08 09:01:36,543][367737] Updated weights for policy 0, policy_version 64880 (0.0005) [2023-03-08 09:01:39,272][367454] Fps is (10 sec: 12697.5, 60 sec: 14472.5, 300 sec: 14037.5). Total num frames: 33251328. Throughput: 0: 14390.0. Samples: 33243136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:01:39,272][367454] Avg episode reward: [(0, '3083.946')] [2023-03-08 09:01:39,707][367737] Updated weights for policy 0, policy_version 64960 (0.0005) [2023-03-08 09:01:42,773][367737] Updated weights for policy 0, policy_version 65040 (0.0005) [2023-03-08 09:01:44,271][367454] Fps is (10 sec: 13516.8, 60 sec: 14336.0, 300 sec: 14023.6). Total num frames: 33320960. Throughput: 0: 14249.3. Samples: 33282308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:01:44,272][367454] Avg episode reward: [(0, '2946.462')] [2023-03-08 09:01:45,600][367737] Updated weights for policy 0, policy_version 65120 (0.0004) [2023-03-08 09:01:48,333][367737] Updated weights for policy 0, policy_version 65200 (0.0003) [2023-03-08 09:01:49,272][367454] Fps is (10 sec: 14335.9, 60 sec: 14336.0, 300 sec: 14009.7). Total num frames: 33394688. Throughput: 0: 14113.7. Samples: 33368112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:01:49,272][367454] Avg episode reward: [(0, '2947.928')] [2023-03-08 09:01:49,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000065224_33394688.pth... [2023-03-08 09:01:49,279][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000064416_32980992.pth [2023-03-08 09:01:51,135][367737] Updated weights for policy 0, policy_version 65280 (0.0004) [2023-03-08 09:01:53,981][367737] Updated weights for policy 0, policy_version 65360 (0.0004) [2023-03-08 09:01:54,271][367454] Fps is (10 sec: 14745.6, 60 sec: 14336.0, 300 sec: 14009.7). Total num frames: 33468416. Throughput: 0: 14051.1. Samples: 33456136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:01:54,272][367454] Avg episode reward: [(0, '3281.079')] [2023-03-08 09:01:56,733][367737] Updated weights for policy 0, policy_version 65440 (0.0004) [2023-03-08 09:01:59,272][367454] Fps is (10 sec: 14745.7, 60 sec: 14336.0, 300 sec: 14037.5). Total num frames: 33542144. Throughput: 0: 14044.9. Samples: 33500360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:01:59,272][367454] Avg episode reward: [(0, '3269.643')] [2023-03-08 09:01:59,520][367737] Updated weights for policy 0, policy_version 65520 (0.0004) [2023-03-08 09:02:02,347][367737] Updated weights for policy 0, policy_version 65600 (0.0004) [2023-03-08 09:02:04,272][367454] Fps is (10 sec: 13926.1, 60 sec: 14131.2, 300 sec: 14023.6). Total num frames: 33607680. Throughput: 0: 14034.2. Samples: 33587464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:02:04,272][367454] Avg episode reward: [(0, '3222.907')] [2023-03-08 09:02:04,308][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000065648_33611776.pth... [2023-03-08 09:02:04,310][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000064816_33185792.pth [2023-03-08 09:02:05,595][367737] Updated weights for policy 0, policy_version 65680 (0.0005) [2023-03-08 09:02:08,776][367737] Updated weights for policy 0, policy_version 65760 (0.0005) [2023-03-08 09:02:09,271][367454] Fps is (10 sec: 13107.3, 60 sec: 13994.7, 300 sec: 14009.7). Total num frames: 33673216. Throughput: 0: 13809.8. Samples: 33665024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:02:09,272][367454] Avg episode reward: [(0, '3332.487')] [2023-03-08 09:02:11,846][367737] Updated weights for policy 0, policy_version 65840 (0.0005) [2023-03-08 09:02:14,272][367454] Fps is (10 sec: 13107.3, 60 sec: 13858.1, 300 sec: 13995.8). Total num frames: 33738752. Throughput: 0: 13707.7. Samples: 33704336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:02:14,272][367454] Avg episode reward: [(0, '3314.998')] [2023-03-08 09:02:14,945][367737] Updated weights for policy 0, policy_version 65920 (0.0005) [2023-03-08 09:02:18,042][367737] Updated weights for policy 0, policy_version 66000 (0.0005) [2023-03-08 09:02:19,271][367454] Fps is (10 sec: 13107.2, 60 sec: 13721.6, 300 sec: 13981.9). Total num frames: 33804288. Throughput: 0: 13752.6. Samples: 33783808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:02:19,272][367454] Avg episode reward: [(0, '3446.689')] [2023-03-08 09:02:19,280][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000066032_33808384.pth... [2023-03-08 09:02:19,282][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000065224_33394688.pth [2023-03-08 09:02:21,199][367737] Updated weights for policy 0, policy_version 66080 (0.0005) [2023-03-08 09:02:24,271][367454] Fps is (10 sec: 13107.4, 60 sec: 13585.1, 300 sec: 13968.1). Total num frames: 33869824. Throughput: 0: 13744.4. Samples: 33861632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:02:24,272][367454] Avg episode reward: [(0, '3252.845')] [2023-03-08 09:02:24,403][367737] Updated weights for policy 0, policy_version 66160 (0.0005) [2023-03-08 09:02:27,519][367737] Updated weights for policy 0, policy_version 66240 (0.0005) [2023-03-08 09:02:29,271][367454] Fps is (10 sec: 13107.2, 60 sec: 13516.8, 300 sec: 13968.1). Total num frames: 33935360. Throughput: 0: 13724.7. Samples: 33899920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:02:29,272][367454] Avg episode reward: [(0, '3062.395')] [2023-03-08 09:02:30,680][367737] Updated weights for policy 0, policy_version 66320 (0.0005) [2023-03-08 09:02:33,857][367737] Updated weights for policy 0, policy_version 66400 (0.0005) [2023-03-08 09:02:34,271][367454] Fps is (10 sec: 13107.2, 60 sec: 13585.1, 300 sec: 13954.2). Total num frames: 34000896. Throughput: 0: 13551.2. Samples: 33977916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:02:34,272][367454] Avg episode reward: [(0, '2923.555')] [2023-03-08 09:02:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000066408_34000896.pth... [2023-03-08 09:02:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000065648_33611776.pth [2023-03-08 09:02:36,963][367737] Updated weights for policy 0, policy_version 66480 (0.0005) [2023-03-08 09:02:39,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13585.1, 300 sec: 13940.3). Total num frames: 34066432. Throughput: 0: 13324.9. Samples: 34055756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:02:39,272][367454] Avg episode reward: [(0, '2897.877')] [2023-03-08 09:02:40,098][367737] Updated weights for policy 0, policy_version 66560 (0.0005) [2023-03-08 09:02:43,314][367737] Updated weights for policy 0, policy_version 66640 (0.0005) [2023-03-08 09:02:44,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13516.8, 300 sec: 13940.3). Total num frames: 34131968. Throughput: 0: 13218.1. Samples: 34095176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:02:44,272][367454] Avg episode reward: [(0, '2955.059')] [2023-03-08 09:02:46,473][367737] Updated weights for policy 0, policy_version 66720 (0.0005) [2023-03-08 09:02:49,271][367454] Fps is (10 sec: 12697.6, 60 sec: 13312.0, 300 sec: 13926.4). Total num frames: 34193408. Throughput: 0: 13010.4. Samples: 34172928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:02:49,272][367454] Avg episode reward: [(0, '3248.537')] [2023-03-08 09:02:49,326][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000066792_34197504.pth... [2023-03-08 09:02:49,328][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000066032_33808384.pth [2023-03-08 09:02:49,643][367737] Updated weights for policy 0, policy_version 66800 (0.0004) [2023-03-08 09:02:52,650][367737] Updated weights for policy 0, policy_version 66880 (0.0003) [2023-03-08 09:02:54,271][367454] Fps is (10 sec: 13107.3, 60 sec: 13243.7, 300 sec: 13926.4). Total num frames: 34263040. Throughput: 0: 13055.8. Samples: 34252536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:02:54,272][367454] Avg episode reward: [(0, '3210.594')] [2023-03-08 09:02:55,727][367737] Updated weights for policy 0, policy_version 66960 (0.0004) [2023-03-08 09:02:58,826][367737] Updated weights for policy 0, policy_version 67040 (0.0005) [2023-03-08 09:02:59,271][367454] Fps is (10 sec: 13516.9, 60 sec: 13107.2, 300 sec: 13940.3). Total num frames: 34328576. Throughput: 0: 13070.0. Samples: 34292484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:02:59,272][367454] Avg episode reward: [(0, '3107.792')] [2023-03-08 09:03:01,852][367737] Updated weights for policy 0, policy_version 67120 (0.0003) [2023-03-08 09:03:04,272][367454] Fps is (10 sec: 13107.0, 60 sec: 13107.2, 300 sec: 13940.3). Total num frames: 34394112. Throughput: 0: 13101.2. Samples: 34373364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:03:04,272][367454] Avg episode reward: [(0, '3199.457')] [2023-03-08 09:03:04,332][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000067184_34398208.pth... [2023-03-08 09:03:04,334][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000066408_34000896.pth [2023-03-08 09:03:04,956][367737] Updated weights for policy 0, policy_version 67200 (0.0003) [2023-03-08 09:03:07,869][367737] Updated weights for policy 0, policy_version 67280 (0.0004) [2023-03-08 09:03:09,272][367454] Fps is (10 sec: 13926.3, 60 sec: 13243.7, 300 sec: 13968.1). Total num frames: 34467840. Throughput: 0: 13189.8. Samples: 34455176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:03:09,272][367454] Avg episode reward: [(0, '3158.340')] [2023-03-08 09:03:10,750][367737] Updated weights for policy 0, policy_version 67360 (0.0004) [2023-03-08 09:03:13,943][367737] Updated weights for policy 0, policy_version 67440 (0.0005) [2023-03-08 09:03:14,272][367454] Fps is (10 sec: 13926.5, 60 sec: 13243.8, 300 sec: 13954.2). Total num frames: 34533376. Throughput: 0: 13257.8. Samples: 34496520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:03:14,272][367454] Avg episode reward: [(0, '3154.139')] [2023-03-08 09:03:17,108][367737] Updated weights for policy 0, policy_version 67520 (0.0005) [2023-03-08 09:03:19,272][367454] Fps is (10 sec: 12697.5, 60 sec: 13175.4, 300 sec: 13926.4). Total num frames: 34594816. Throughput: 0: 13253.7. Samples: 34574336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:03:19,272][367454] Avg episode reward: [(0, '3665.079')] [2023-03-08 09:03:19,339][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000067576_34598912.pth... [2023-03-08 09:03:19,341][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000066792_34197504.pth [2023-03-08 09:03:20,331][367737] Updated weights for policy 0, policy_version 67600 (0.0005) [2023-03-08 09:03:23,500][367737] Updated weights for policy 0, policy_version 67680 (0.0005) [2023-03-08 09:03:24,272][367454] Fps is (10 sec: 12697.6, 60 sec: 13175.5, 300 sec: 13912.5). Total num frames: 34660352. Throughput: 0: 13241.7. Samples: 34651632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:03:24,272][367454] Avg episode reward: [(0, '3296.366')] [2023-03-08 09:03:26,546][367737] Updated weights for policy 0, policy_version 67760 (0.0005) [2023-03-08 09:03:29,272][367454] Fps is (10 sec: 13107.4, 60 sec: 13175.5, 300 sec: 13898.6). Total num frames: 34725888. Throughput: 0: 13243.0. Samples: 34691112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:03:29,272][367454] Avg episode reward: [(0, '3123.907')] [2023-03-08 09:03:29,664][367737] Updated weights for policy 0, policy_version 67840 (0.0005) [2023-03-08 09:03:32,847][367737] Updated weights for policy 0, policy_version 67920 (0.0005) [2023-03-08 09:03:34,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13175.4, 300 sec: 13857.0). Total num frames: 34791424. Throughput: 0: 13253.6. Samples: 34769340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:03:34,272][367454] Avg episode reward: [(0, '3159.293')] [2023-03-08 09:03:34,294][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000067960_34795520.pth... [2023-03-08 09:03:34,296][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000067184_34398208.pth [2023-03-08 09:03:35,693][367737] Updated weights for policy 0, policy_version 68000 (0.0004) [2023-03-08 09:03:38,541][367737] Updated weights for policy 0, policy_version 68080 (0.0004) [2023-03-08 09:03:39,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13312.0, 300 sec: 13870.9). Total num frames: 34865152. Throughput: 0: 13391.0. Samples: 34855132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:03:39,272][367454] Avg episode reward: [(0, '3099.554')] [2023-03-08 09:03:41,298][367737] Updated weights for policy 0, policy_version 68160 (0.0004) [2023-03-08 09:03:44,272][367454] Fps is (10 sec: 14336.1, 60 sec: 13380.3, 300 sec: 13870.9). Total num frames: 34934784. Throughput: 0: 13480.9. Samples: 34899124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:03:44,272][367454] Avg episode reward: [(0, '2876.384')] [2023-03-08 09:03:44,432][367737] Updated weights for policy 0, policy_version 68240 (0.0005) [2023-03-08 09:03:47,478][367737] Updated weights for policy 0, policy_version 68320 (0.0005) [2023-03-08 09:03:49,272][367454] Fps is (10 sec: 13516.6, 60 sec: 13448.5, 300 sec: 13829.2). Total num frames: 35000320. Throughput: 0: 13464.8. Samples: 34979280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:03:49,272][367454] Avg episode reward: [(0, '2932.131')] [2023-03-08 09:03:49,300][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000068368_35004416.pth... [2023-03-08 09:03:49,301][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000067576_34598912.pth [2023-03-08 09:03:50,478][367737] Updated weights for policy 0, policy_version 68400 (0.0005) [2023-03-08 09:03:53,499][367737] Updated weights for policy 0, policy_version 68480 (0.0005) [2023-03-08 09:03:54,271][367454] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13801.4). Total num frames: 35069952. Throughput: 0: 13461.2. Samples: 35060928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:03:54,272][367454] Avg episode reward: [(0, '2749.964')] [2023-03-08 09:03:56,604][367737] Updated weights for policy 0, policy_version 68560 (0.0005) [2023-03-08 09:03:59,272][367454] Fps is (10 sec: 13517.0, 60 sec: 13448.5, 300 sec: 13787.6). Total num frames: 35135488. Throughput: 0: 13409.0. Samples: 35099924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:03:59,272][367454] Avg episode reward: [(0, '2839.192')] [2023-03-08 09:03:59,735][367737] Updated weights for policy 0, policy_version 68640 (0.0005) [2023-03-08 09:04:02,804][367737] Updated weights for policy 0, policy_version 68720 (0.0005) [2023-03-08 09:04:04,272][367454] Fps is (10 sec: 13107.0, 60 sec: 13448.5, 300 sec: 13787.5). Total num frames: 35201024. Throughput: 0: 13461.8. Samples: 35180116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:04:04,272][367454] Avg episode reward: [(0, '2902.261')] [2023-03-08 09:04:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000068752_35201024.pth... [2023-03-08 09:04:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000067960_34795520.pth [2023-03-08 09:04:05,888][367737] Updated weights for policy 0, policy_version 68800 (0.0005) [2023-03-08 09:04:08,975][367737] Updated weights for policy 0, policy_version 68880 (0.0005) [2023-03-08 09:04:09,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13312.0, 300 sec: 13787.6). Total num frames: 35266560. Throughput: 0: 13484.4. Samples: 35258432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:04:09,272][367454] Avg episode reward: [(0, '2718.928')] [2023-03-08 09:04:12,114][367737] Updated weights for policy 0, policy_version 68960 (0.0005) [2023-03-08 09:04:14,272][367454] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13815.3). Total num frames: 35336192. Throughput: 0: 13497.9. Samples: 35298516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:04:14,272][367454] Avg episode reward: [(0, '2763.473')] [2023-03-08 09:04:15,124][367737] Updated weights for policy 0, policy_version 69040 (0.0005) [2023-03-08 09:04:18,163][367737] Updated weights for policy 0, policy_version 69120 (0.0005) [2023-03-08 09:04:19,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13815.3). Total num frames: 35401728. Throughput: 0: 13543.8. Samples: 35378812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:04:19,272][367454] Avg episode reward: [(0, '2687.451')] [2023-03-08 09:04:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000069144_35401728.pth... [2023-03-08 09:04:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000068368_35004416.pth [2023-03-08 09:04:21,270][367737] Updated weights for policy 0, policy_version 69200 (0.0005) [2023-03-08 09:04:24,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13829.2). Total num frames: 35467264. Throughput: 0: 13420.9. Samples: 35459072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:04:24,272][367454] Avg episode reward: [(0, '2719.581')] [2023-03-08 09:04:24,340][367737] Updated weights for policy 0, policy_version 69280 (0.0005) [2023-03-08 09:04:27,406][367737] Updated weights for policy 0, policy_version 69360 (0.0005) [2023-03-08 09:04:29,272][367454] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13843.1). Total num frames: 35536896. Throughput: 0: 13340.2. Samples: 35499432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:04:29,272][367454] Avg episode reward: [(0, '2486.391')] [2023-03-08 09:04:30,389][367737] Updated weights for policy 0, policy_version 69440 (0.0005) [2023-03-08 09:04:33,372][367737] Updated weights for policy 0, policy_version 69520 (0.0005) [2023-03-08 09:04:34,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13585.1, 300 sec: 13857.0). Total num frames: 35606528. Throughput: 0: 13376.8. Samples: 35581236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:04:34,272][367454] Avg episode reward: [(0, '2476.334')] [2023-03-08 09:04:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000069544_35606528.pth... [2023-03-08 09:04:34,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000068752_35201024.pth [2023-03-08 09:04:36,369][367737] Updated weights for policy 0, policy_version 69600 (0.0005) [2023-03-08 09:04:39,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13857.0). Total num frames: 35672064. Throughput: 0: 13381.2. Samples: 35663084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:04:39,272][367454] Avg episode reward: [(0, '2583.674')] [2023-03-08 09:04:39,362][367737] Updated weights for policy 0, policy_version 69680 (0.0005) [2023-03-08 09:04:42,361][367737] Updated weights for policy 0, policy_version 69760 (0.0005) [2023-03-08 09:04:44,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13870.9). Total num frames: 35741696. Throughput: 0: 13427.6. Samples: 35704164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:04:44,272][367454] Avg episode reward: [(0, '2350.031')] [2023-03-08 09:04:45,188][367737] Updated weights for policy 0, policy_version 69840 (0.0004) [2023-03-08 09:04:47,972][367737] Updated weights for policy 0, policy_version 69920 (0.0004) [2023-03-08 09:04:49,272][367454] Fps is (10 sec: 14335.9, 60 sec: 13585.1, 300 sec: 13884.7). Total num frames: 35815424. Throughput: 0: 13572.0. Samples: 35790856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:04:49,272][367454] Avg episode reward: [(0, '2334.790')] [2023-03-08 09:04:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000069952_35815424.pth... [2023-03-08 09:04:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000069144_35401728.pth [2023-03-08 09:04:50,747][367737] Updated weights for policy 0, policy_version 70000 (0.0004) [2023-03-08 09:04:53,545][367737] Updated weights for policy 0, policy_version 70080 (0.0004) [2023-03-08 09:04:54,272][367454] Fps is (10 sec: 14745.6, 60 sec: 13653.3, 300 sec: 13912.5). Total num frames: 35889152. Throughput: 0: 13792.8. Samples: 35879108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:04:54,272][367454] Avg episode reward: [(0, '2390.420')] [2023-03-08 09:04:56,560][367737] Updated weights for policy 0, policy_version 70160 (0.0004) [2023-03-08 09:04:59,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13653.3, 300 sec: 13898.6). Total num frames: 35954688. Throughput: 0: 13807.9. Samples: 35919872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:04:59,272][367454] Avg episode reward: [(0, '2412.839')] [2023-03-08 09:04:59,650][367737] Updated weights for policy 0, policy_version 70240 (0.0003) [2023-03-08 09:05:02,631][367737] Updated weights for policy 0, policy_version 70320 (0.0004) [2023-03-08 09:05:04,272][367454] Fps is (10 sec: 13516.7, 60 sec: 13721.6, 300 sec: 13884.7). Total num frames: 36024320. Throughput: 0: 13818.2. Samples: 36000632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:05:04,272][367454] Avg episode reward: [(0, '2298.323')] [2023-03-08 09:05:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000070360_36024320.pth... [2023-03-08 09:05:04,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000069544_35606528.pth [2023-03-08 09:05:05,700][367737] Updated weights for policy 0, policy_version 70400 (0.0005) [2023-03-08 09:05:08,780][367737] Updated weights for policy 0, policy_version 70480 (0.0005) [2023-03-08 09:05:09,272][367454] Fps is (10 sec: 13516.9, 60 sec: 13721.6, 300 sec: 13857.0). Total num frames: 36089856. Throughput: 0: 13805.3. Samples: 36080312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:05:09,272][367454] Avg episode reward: [(0, '2313.203')] [2023-03-08 09:05:11,889][367737] Updated weights for policy 0, policy_version 70560 (0.0005) [2023-03-08 09:05:14,271][367454] Fps is (10 sec: 13107.4, 60 sec: 13653.4, 300 sec: 13815.3). Total num frames: 36155392. Throughput: 0: 13786.6. Samples: 36119828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:05:14,272][367454] Avg episode reward: [(0, '2373.413')] [2023-03-08 09:05:15,000][367737] Updated weights for policy 0, policy_version 70640 (0.0005) [2023-03-08 09:05:18,093][367737] Updated weights for policy 0, policy_version 70720 (0.0005) [2023-03-08 09:05:19,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13721.6, 300 sec: 13787.5). Total num frames: 36225024. Throughput: 0: 13760.3. Samples: 36200448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:05:19,272][367454] Avg episode reward: [(0, '2364.385')] [2023-03-08 09:05:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000070752_36225024.pth... [2023-03-08 09:05:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000069952_35815424.pth [2023-03-08 09:05:21,110][367737] Updated weights for policy 0, policy_version 70800 (0.0005) [2023-03-08 09:05:24,214][367737] Updated weights for policy 0, policy_version 70880 (0.0005) [2023-03-08 09:05:24,271][367454] Fps is (10 sec: 13516.8, 60 sec: 13721.6, 300 sec: 13759.8). Total num frames: 36290560. Throughput: 0: 13705.5. Samples: 36279832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:05:24,272][367454] Avg episode reward: [(0, '2194.043')] [2023-03-08 09:05:27,290][367737] Updated weights for policy 0, policy_version 70960 (0.0004) [2023-03-08 09:05:29,271][367454] Fps is (10 sec: 13107.3, 60 sec: 13653.3, 300 sec: 13718.1). Total num frames: 36356096. Throughput: 0: 13669.6. Samples: 36319296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:05:29,272][367454] Avg episode reward: [(0, '2368.683')] [2023-03-08 09:05:30,300][367737] Updated weights for policy 0, policy_version 71040 (0.0005) [2023-03-08 09:05:33,396][367737] Updated weights for policy 0, policy_version 71120 (0.0005) [2023-03-08 09:05:34,271][367454] Fps is (10 sec: 13107.2, 60 sec: 13585.1, 300 sec: 13690.4). Total num frames: 36421632. Throughput: 0: 13547.9. Samples: 36400508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:05:34,272][367454] Avg episode reward: [(0, '2249.645')] [2023-03-08 09:05:34,329][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000071144_36425728.pth... [2023-03-08 09:05:34,331][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000070360_36024320.pth [2023-03-08 09:05:36,531][367737] Updated weights for policy 0, policy_version 71200 (0.0005) [2023-03-08 09:05:39,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13585.1, 300 sec: 13648.7). Total num frames: 36487168. Throughput: 0: 13331.8. Samples: 36479040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:05:39,272][367454] Avg episode reward: [(0, '2204.061')] [2023-03-08 09:05:39,650][367737] Updated weights for policy 0, policy_version 71280 (0.0004) [2023-03-08 09:05:42,788][367737] Updated weights for policy 0, policy_version 71360 (0.0005) [2023-03-08 09:05:44,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13516.8, 300 sec: 13620.9). Total num frames: 36552704. Throughput: 0: 13310.8. Samples: 36518856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:05:44,272][367454] Avg episode reward: [(0, '2070.558')] [2023-03-08 09:05:45,902][367737] Updated weights for policy 0, policy_version 71440 (0.0005) [2023-03-08 09:05:48,875][367737] Updated weights for policy 0, policy_version 71520 (0.0004) [2023-03-08 09:05:49,271][367454] Fps is (10 sec: 13516.8, 60 sec: 13448.6, 300 sec: 13607.1). Total num frames: 36622336. Throughput: 0: 13279.0. Samples: 36598184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:05:49,272][367454] Avg episode reward: [(0, '2036.526')] [2023-03-08 09:05:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000071528_36622336.pth... [2023-03-08 09:05:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000070752_36225024.pth [2023-03-08 09:05:51,972][367737] Updated weights for policy 0, policy_version 71600 (0.0005) [2023-03-08 09:05:54,271][367454] Fps is (10 sec: 13516.9, 60 sec: 13312.0, 300 sec: 13579.3). Total num frames: 36687872. Throughput: 0: 13275.4. Samples: 36677704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:05:54,272][367454] Avg episode reward: [(0, '2353.873')] [2023-03-08 09:05:55,153][367737] Updated weights for policy 0, policy_version 71680 (0.0005) [2023-03-08 09:05:58,380][367737] Updated weights for policy 0, policy_version 71760 (0.0005) [2023-03-08 09:05:59,271][367454] Fps is (10 sec: 12697.7, 60 sec: 13243.8, 300 sec: 13523.7). Total num frames: 36749312. Throughput: 0: 13260.4. Samples: 36716544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:05:59,272][367454] Avg episode reward: [(0, '2240.687')] [2023-03-08 09:06:01,430][367737] Updated weights for policy 0, policy_version 71840 (0.0005) [2023-03-08 09:06:04,271][367454] Fps is (10 sec: 13107.2, 60 sec: 13243.8, 300 sec: 13509.9). Total num frames: 36818944. Throughput: 0: 13199.7. Samples: 36794432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:06:04,272][367454] Avg episode reward: [(0, '2101.926')] [2023-03-08 09:06:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000071912_36818944.pth... [2023-03-08 09:06:04,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000071144_36425728.pth [2023-03-08 09:06:04,592][367737] Updated weights for policy 0, policy_version 71920 (0.0005) [2023-03-08 09:06:07,376][367737] Updated weights for policy 0, policy_version 72000 (0.0004) [2023-03-08 09:06:09,271][367454] Fps is (10 sec: 13926.3, 60 sec: 13312.0, 300 sec: 13496.0). Total num frames: 36888576. Throughput: 0: 13317.2. Samples: 36879108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:06:09,272][367454] Avg episode reward: [(0, '2158.370')] [2023-03-08 09:06:10,189][367737] Updated weights for policy 0, policy_version 72080 (0.0004) [2023-03-08 09:06:13,003][367737] Updated weights for policy 0, policy_version 72160 (0.0004) [2023-03-08 09:06:14,271][367454] Fps is (10 sec: 14336.0, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 36962304. Throughput: 0: 13380.4. Samples: 36921416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:06:14,272][367454] Avg episode reward: [(0, '1976.437')] [2023-03-08 09:06:16,062][367737] Updated weights for policy 0, policy_version 72240 (0.0005) [2023-03-08 09:06:19,244][367737] Updated weights for policy 0, policy_version 72320 (0.0003) [2023-03-08 09:06:19,272][367454] Fps is (10 sec: 13926.3, 60 sec: 13380.3, 300 sec: 13468.2). Total num frames: 37027840. Throughput: 0: 13396.2. Samples: 37003336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:06:19,272][367454] Avg episode reward: [(0, '2160.164')] [2023-03-08 09:06:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000072320_37027840.pth... [2023-03-08 09:06:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000071528_36622336.pth [2023-03-08 09:06:22,414][367737] Updated weights for policy 0, policy_version 72400 (0.0005) [2023-03-08 09:06:24,272][367454] Fps is (10 sec: 12697.5, 60 sec: 13312.0, 300 sec: 13440.4). Total num frames: 37089280. Throughput: 0: 13380.5. Samples: 37081164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:06:24,272][367454] Avg episode reward: [(0, '2070.777')] [2023-03-08 09:06:25,472][367737] Updated weights for policy 0, policy_version 72480 (0.0004) [2023-03-08 09:06:28,577][367737] Updated weights for policy 0, policy_version 72560 (0.0004) [2023-03-08 09:06:29,271][367454] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13468.2). Total num frames: 37158912. Throughput: 0: 13404.7. Samples: 37122068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:06:29,272][367454] Avg episode reward: [(0, '1999.349')] [2023-03-08 09:06:31,834][367737] Updated weights for policy 0, policy_version 72640 (0.0005) [2023-03-08 09:06:34,272][367454] Fps is (10 sec: 13516.9, 60 sec: 13380.3, 300 sec: 13468.2). Total num frames: 37224448. Throughput: 0: 13367.2. Samples: 37199708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:06:34,272][367454] Avg episode reward: [(0, '1966.453')] [2023-03-08 09:06:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000072704_37224448.pth... [2023-03-08 09:06:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000071912_36818944.pth [2023-03-08 09:06:34,819][367737] Updated weights for policy 0, policy_version 72720 (0.0003) [2023-03-08 09:06:37,902][367737] Updated weights for policy 0, policy_version 72800 (0.0005) [2023-03-08 09:06:39,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13454.3). Total num frames: 37289984. Throughput: 0: 13384.7. Samples: 37280016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:06:39,272][367454] Avg episode reward: [(0, '1919.727')] [2023-03-08 09:06:41,088][367737] Updated weights for policy 0, policy_version 72880 (0.0005) [2023-03-08 09:06:44,087][367737] Updated weights for policy 0, policy_version 72960 (0.0005) [2023-03-08 09:06:44,271][367454] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 37355520. Throughput: 0: 13380.4. Samples: 37318664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:06:44,272][367454] Avg episode reward: [(0, '1976.817')] [2023-03-08 09:06:47,143][367737] Updated weights for policy 0, policy_version 73040 (0.0005) [2023-03-08 09:06:49,271][367454] Fps is (10 sec: 13107.3, 60 sec: 13312.0, 300 sec: 13398.8). Total num frames: 37421056. Throughput: 0: 13464.3. Samples: 37400324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:06:49,282][367454] Avg episode reward: [(0, '2031.685')] [2023-03-08 09:06:49,285][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000073088_37421056.pth... [2023-03-08 09:06:49,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000072320_37027840.pth [2023-03-08 09:06:50,271][367737] Updated weights for policy 0, policy_version 73120 (0.0005) [2023-03-08 09:06:53,390][367737] Updated weights for policy 0, policy_version 73200 (0.0005) [2023-03-08 09:06:54,271][367454] Fps is (10 sec: 13107.3, 60 sec: 13312.0, 300 sec: 13371.0). Total num frames: 37486592. Throughput: 0: 13319.0. Samples: 37478464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:06:54,282][367454] Avg episode reward: [(0, '2129.055')] [2023-03-08 09:06:56,500][367737] Updated weights for policy 0, policy_version 73280 (0.0005) [2023-03-08 09:06:59,271][367454] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 37556224. Throughput: 0: 13270.2. Samples: 37518576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:06:59,282][367454] Avg episode reward: [(0, '2023.096')] [2023-03-08 09:06:59,538][367737] Updated weights for policy 0, policy_version 73360 (0.0005) [2023-03-08 09:07:02,521][367737] Updated weights for policy 0, policy_version 73440 (0.0005) [2023-03-08 09:07:04,272][367454] Fps is (10 sec: 13926.3, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 37625856. Throughput: 0: 13239.2. Samples: 37599100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:07:04,282][367454] Avg episode reward: [(0, '2107.928')] [2023-03-08 09:07:04,285][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000073488_37625856.pth... [2023-03-08 09:07:04,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000072704_37224448.pth [2023-03-08 09:07:05,253][367737] Updated weights for policy 0, policy_version 73520 (0.0004) [2023-03-08 09:07:07,933][367737] Updated weights for policy 0, policy_version 73600 (0.0004) [2023-03-08 09:07:09,272][367454] Fps is (10 sec: 14335.9, 60 sec: 13516.8, 300 sec: 13426.6). Total num frames: 37699584. Throughput: 0: 13542.9. Samples: 37690596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:07:09,283][367454] Avg episode reward: [(0, '2123.273')] [2023-03-08 09:07:10,675][367737] Updated weights for policy 0, policy_version 73680 (0.0004) [2023-03-08 09:07:13,381][367737] Updated weights for policy 0, policy_version 73760 (0.0004) [2023-03-08 09:07:14,271][367454] Fps is (10 sec: 15155.3, 60 sec: 13585.1, 300 sec: 13468.2). Total num frames: 37777408. Throughput: 0: 13619.6. Samples: 37734952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:07:14,282][367454] Avg episode reward: [(0, '1964.139')] [2023-03-08 09:07:16,034][367737] Updated weights for policy 0, policy_version 73840 (0.0003) [2023-03-08 09:07:18,805][367737] Updated weights for policy 0, policy_version 73920 (0.0004) [2023-03-08 09:07:19,272][367454] Fps is (10 sec: 15155.1, 60 sec: 13721.6, 300 sec: 13496.0). Total num frames: 37851136. Throughput: 0: 13925.1. Samples: 37826336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:07:19,283][367454] Avg episode reward: [(0, '1924.848')] [2023-03-08 09:07:19,314][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000073936_37855232.pth... [2023-03-08 09:07:19,316][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000073088_37421056.pth [2023-03-08 09:07:21,452][367737] Updated weights for policy 0, policy_version 74000 (0.0004) [2023-03-08 09:07:24,075][367737] Updated weights for policy 0, policy_version 74080 (0.0003) [2023-03-08 09:07:24,272][367454] Fps is (10 sec: 15155.1, 60 sec: 13994.7, 300 sec: 13537.6). Total num frames: 37928960. Throughput: 0: 14192.5. Samples: 37918680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:07:24,272][367454] Avg episode reward: [(0, '1900.013')] [2023-03-08 09:07:27,007][367737] Updated weights for policy 0, policy_version 74160 (0.0005) [2023-03-08 09:07:29,272][367454] Fps is (10 sec: 14745.7, 60 sec: 13994.7, 300 sec: 13551.5). Total num frames: 37998592. Throughput: 0: 14291.7. Samples: 37961792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:07:29,272][367454] Avg episode reward: [(0, '1898.526')] [2023-03-08 09:07:30,087][367737] Updated weights for policy 0, policy_version 74240 (0.0005) [2023-03-08 09:07:33,150][367737] Updated weights for policy 0, policy_version 74320 (0.0005) [2023-03-08 09:07:34,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13994.7, 300 sec: 13551.5). Total num frames: 38064128. Throughput: 0: 14252.1. Samples: 38041672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:07:34,272][367454] Avg episode reward: [(0, '1863.699')] [2023-03-08 09:07:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000074344_38064128.pth... [2023-03-08 09:07:34,279][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000073488_37625856.pth [2023-03-08 09:07:36,172][367737] Updated weights for policy 0, policy_version 74400 (0.0005) [2023-03-08 09:07:38,931][367737] Updated weights for policy 0, policy_version 74480 (0.0004) [2023-03-08 09:07:39,272][367454] Fps is (10 sec: 13926.4, 60 sec: 14131.2, 300 sec: 13579.3). Total num frames: 38137856. Throughput: 0: 14381.7. Samples: 38125640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:07:39,283][367454] Avg episode reward: [(0, '1845.115')] [2023-03-08 09:07:41,634][367737] Updated weights for policy 0, policy_version 74560 (0.0004) [2023-03-08 09:07:44,272][367454] Fps is (10 sec: 14745.6, 60 sec: 14267.7, 300 sec: 13620.9). Total num frames: 38211584. Throughput: 0: 14492.3. Samples: 38170732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:07:44,283][367454] Avg episode reward: [(0, '1860.193')] [2023-03-08 09:07:44,408][367737] Updated weights for policy 0, policy_version 74640 (0.0004) [2023-03-08 09:07:47,060][367737] Updated weights for policy 0, policy_version 74720 (0.0004) [2023-03-08 09:07:49,272][367454] Fps is (10 sec: 15155.2, 60 sec: 14472.5, 300 sec: 13648.7). Total num frames: 38289408. Throughput: 0: 14722.1. Samples: 38261596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:07:49,283][367454] Avg episode reward: [(0, '1929.564')] [2023-03-08 09:07:49,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000074784_38289408.pth... [2023-03-08 09:07:49,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000073936_37855232.pth [2023-03-08 09:07:49,721][367737] Updated weights for policy 0, policy_version 74800 (0.0004) [2023-03-08 09:07:52,426][367737] Updated weights for policy 0, policy_version 74880 (0.0004) [2023-03-08 09:07:54,272][367454] Fps is (10 sec: 15155.2, 60 sec: 14609.0, 300 sec: 13676.5). Total num frames: 38363136. Throughput: 0: 14729.8. Samples: 38353436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:07:54,283][367454] Avg episode reward: [(0, '2020.125')] [2023-03-08 09:07:55,107][367737] Updated weights for policy 0, policy_version 74960 (0.0003) [2023-03-08 09:07:57,774][367737] Updated weights for policy 0, policy_version 75040 (0.0004) [2023-03-08 09:07:59,272][367454] Fps is (10 sec: 15155.1, 60 sec: 14745.6, 300 sec: 13718.1). Total num frames: 38440960. Throughput: 0: 14770.0. Samples: 38399604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:07:59,283][367454] Avg episode reward: [(0, '2263.829')] [2023-03-08 09:08:00,475][367737] Updated weights for policy 0, policy_version 75120 (0.0004) [2023-03-08 09:08:03,235][367737] Updated weights for policy 0, policy_version 75200 (0.0004) [2023-03-08 09:08:04,272][367454] Fps is (10 sec: 15155.2, 60 sec: 14813.9, 300 sec: 13718.1). Total num frames: 38514688. Throughput: 0: 14750.8. Samples: 38490120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:08:04,272][367454] Avg episode reward: [(0, '2249.491')] [2023-03-08 09:08:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000075224_38514688.pth... [2023-03-08 09:08:04,276][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000074344_38064128.pth [2023-03-08 09:08:05,977][367737] Updated weights for policy 0, policy_version 75280 (0.0004) [2023-03-08 09:08:08,689][367737] Updated weights for policy 0, policy_version 75360 (0.0004) [2023-03-08 09:08:09,271][367454] Fps is (10 sec: 15155.3, 60 sec: 14882.1, 300 sec: 13759.8). Total num frames: 38592512. Throughput: 0: 14701.3. Samples: 38580236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:08:09,282][367454] Avg episode reward: [(0, '2397.752')] [2023-03-08 09:08:11,387][367737] Updated weights for policy 0, policy_version 75440 (0.0004) [2023-03-08 09:08:14,138][367737] Updated weights for policy 0, policy_version 75520 (0.0004) [2023-03-08 09:08:14,272][367454] Fps is (10 sec: 15155.3, 60 sec: 14813.9, 300 sec: 13801.4). Total num frames: 38666240. Throughput: 0: 14745.6. Samples: 38625344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:08:14,282][367454] Avg episode reward: [(0, '2477.166')] [2023-03-08 09:08:16,861][367737] Updated weights for policy 0, policy_version 75600 (0.0004) [2023-03-08 09:08:19,272][367454] Fps is (10 sec: 15155.0, 60 sec: 14882.1, 300 sec: 13843.1). Total num frames: 38744064. Throughput: 0: 14973.0. Samples: 38715456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:08:19,283][367454] Avg episode reward: [(0, '2542.693')] [2023-03-08 09:08:19,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000075672_38744064.pth... [2023-03-08 09:08:19,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000074784_38289408.pth [2023-03-08 09:08:19,523][367737] Updated weights for policy 0, policy_version 75680 (0.0003) [2023-03-08 09:08:22,277][367737] Updated weights for policy 0, policy_version 75760 (0.0004) [2023-03-08 09:08:24,271][367454] Fps is (10 sec: 15155.3, 60 sec: 14813.9, 300 sec: 13870.9). Total num frames: 38817792. Throughput: 0: 15109.5. Samples: 38805568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:08:24,282][367454] Avg episode reward: [(0, '2322.010')] [2023-03-08 09:08:25,050][367737] Updated weights for policy 0, policy_version 75840 (0.0004) [2023-03-08 09:08:27,865][367737] Updated weights for policy 0, policy_version 75920 (0.0004) [2023-03-08 09:08:29,271][367454] Fps is (10 sec: 14336.2, 60 sec: 14813.9, 300 sec: 13884.8). Total num frames: 38887424. Throughput: 0: 15088.4. Samples: 38849708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:08:29,282][367454] Avg episode reward: [(0, '2303.683')] [2023-03-08 09:08:30,636][367737] Updated weights for policy 0, policy_version 76000 (0.0004) [2023-03-08 09:08:33,388][367737] Updated weights for policy 0, policy_version 76080 (0.0004) [2023-03-08 09:08:34,272][367454] Fps is (10 sec: 14745.4, 60 sec: 15018.7, 300 sec: 13898.6). Total num frames: 38965248. Throughput: 0: 15034.4. Samples: 38938144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:08:34,283][367454] Avg episode reward: [(0, '2505.516')] [2023-03-08 09:08:34,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000076104_38965248.pth... [2023-03-08 09:08:34,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000075224_38514688.pth [2023-03-08 09:08:36,397][367737] Updated weights for policy 0, policy_version 76160 (0.0003) [2023-03-08 09:08:39,272][367454] Fps is (10 sec: 14335.9, 60 sec: 14882.1, 300 sec: 13884.7). Total num frames: 39030784. Throughput: 0: 14824.4. Samples: 39020536. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:08:39,272][367454] Avg episode reward: [(0, '2957.568')] [2023-03-08 09:08:39,561][367737] Updated weights for policy 0, policy_version 76240 (0.0004) [2023-03-08 09:08:42,750][367737] Updated weights for policy 0, policy_version 76320 (0.0005) [2023-03-08 09:08:44,271][367454] Fps is (10 sec: 12697.7, 60 sec: 14677.4, 300 sec: 13870.9). Total num frames: 39092224. Throughput: 0: 14663.6. Samples: 39059464. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:08:44,272][367454] Avg episode reward: [(0, '3024.038')] [2023-03-08 09:08:46,039][367737] Updated weights for policy 0, policy_version 76400 (0.0005) [2023-03-08 09:08:49,271][367454] Fps is (10 sec: 12288.1, 60 sec: 14404.3, 300 sec: 13843.1). Total num frames: 39153664. Throughput: 0: 14297.3. Samples: 39133496. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:08:49,272][367454] Avg episode reward: [(0, '2971.576')] [2023-03-08 09:08:49,274][367737] Updated weights for policy 0, policy_version 76480 (0.0004) [2023-03-08 09:08:49,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000076480_39157760.pth... [2023-03-08 09:08:49,276][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000075672_38744064.pth [2023-03-08 09:08:52,474][367737] Updated weights for policy 0, policy_version 76560 (0.0004) [2023-03-08 09:08:54,272][367454] Fps is (10 sec: 12697.5, 60 sec: 14267.7, 300 sec: 13843.1). Total num frames: 39219200. Throughput: 0: 14017.1. Samples: 39211008. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:08:54,272][367454] Avg episode reward: [(0, '3096.986')] [2023-03-08 09:08:55,707][367737] Updated weights for policy 0, policy_version 76640 (0.0005) [2023-03-08 09:08:58,902][367737] Updated weights for policy 0, policy_version 76720 (0.0005) [2023-03-08 09:08:59,272][367454] Fps is (10 sec: 13107.1, 60 sec: 14062.9, 300 sec: 13843.1). Total num frames: 39284736. Throughput: 0: 13863.0. Samples: 39249180. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:08:59,272][367454] Avg episode reward: [(0, '3228.819')] [2023-03-08 09:09:02,207][367737] Updated weights for policy 0, policy_version 76800 (0.0004) [2023-03-08 09:09:04,271][367454] Fps is (10 sec: 12288.1, 60 sec: 13789.9, 300 sec: 13815.3). Total num frames: 39342080. Throughput: 0: 13523.8. Samples: 39324024. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:09:04,272][367454] Avg episode reward: [(0, '2818.695')] [2023-03-08 09:09:04,319][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000076848_39346176.pth... [2023-03-08 09:09:04,321][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000076104_38965248.pth [2023-03-08 09:09:05,720][367737] Updated weights for policy 0, policy_version 76880 (0.0005) [2023-03-08 09:09:09,180][367737] Updated weights for policy 0, policy_version 76960 (0.0005) [2023-03-08 09:09:09,271][367454] Fps is (10 sec: 11878.4, 60 sec: 13516.8, 300 sec: 13787.6). Total num frames: 39403520. Throughput: 0: 13101.5. Samples: 39395136. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:09:09,272][367454] Avg episode reward: [(0, '2539.233')] [2023-03-08 09:09:12,646][367737] Updated weights for policy 0, policy_version 77040 (0.0005) [2023-03-08 09:09:14,271][367454] Fps is (10 sec: 11878.4, 60 sec: 13243.7, 300 sec: 13759.8). Total num frames: 39460864. Throughput: 0: 12908.2. Samples: 39430576. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:09:14,272][367454] Avg episode reward: [(0, '2170.356')] [2023-03-08 09:09:16,114][367737] Updated weights for policy 0, policy_version 77120 (0.0005) [2023-03-08 09:09:19,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12970.7, 300 sec: 13745.9). Total num frames: 39522304. Throughput: 0: 12520.2. Samples: 39501552. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:09:19,272][367454] Avg episode reward: [(0, '2147.861')] [2023-03-08 09:09:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000077192_39522304.pth... [2023-03-08 09:09:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000076480_39157760.pth [2023-03-08 09:09:19,536][367737] Updated weights for policy 0, policy_version 77200 (0.0005) [2023-03-08 09:09:22,905][367737] Updated weights for policy 0, policy_version 77280 (0.0005) [2023-03-08 09:09:24,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12765.9, 300 sec: 13718.1). Total num frames: 39583744. Throughput: 0: 12278.9. Samples: 39573084. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:09:24,272][367454] Avg episode reward: [(0, '1990.731')] [2023-03-08 09:09:26,117][367737] Updated weights for policy 0, policy_version 77360 (0.0004) [2023-03-08 09:09:29,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12629.3, 300 sec: 13690.4). Total num frames: 39645184. Throughput: 0: 12285.9. Samples: 39612332. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:09:29,272][367454] Avg episode reward: [(0, '1917.729')] [2023-03-08 09:09:29,285][367737] Updated weights for policy 0, policy_version 77440 (0.0004) [2023-03-08 09:09:32,391][367737] Updated weights for policy 0, policy_version 77520 (0.0004) [2023-03-08 09:09:34,272][367454] Fps is (10 sec: 13107.0, 60 sec: 12492.8, 300 sec: 13704.2). Total num frames: 39714816. Throughput: 0: 12373.5. Samples: 39690304. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:09:34,272][367454] Avg episode reward: [(0, '1871.824')] [2023-03-08 09:09:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000077568_39714816.pth... [2023-03-08 09:09:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000076848_39346176.pth [2023-03-08 09:09:35,592][367737] Updated weights for policy 0, policy_version 77600 (0.0004) [2023-03-08 09:09:38,977][367737] Updated weights for policy 0, policy_version 77680 (0.0005) [2023-03-08 09:09:39,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12356.3, 300 sec: 13662.6). Total num frames: 39772160. Throughput: 0: 12296.5. Samples: 39764348. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:09:39,272][367454] Avg episode reward: [(0, '1957.746')] [2023-03-08 09:09:42,411][367737] Updated weights for policy 0, policy_version 77760 (0.0005) [2023-03-08 09:09:44,272][367454] Fps is (10 sec: 11878.5, 60 sec: 12356.3, 300 sec: 13620.9). Total num frames: 39833600. Throughput: 0: 12260.5. Samples: 39800904. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:09:44,272][367454] Avg episode reward: [(0, '1885.300')] [2023-03-08 09:09:45,774][367737] Updated weights for policy 0, policy_version 77840 (0.0005) [2023-03-08 09:09:48,863][367737] Updated weights for policy 0, policy_version 77920 (0.0005) [2023-03-08 09:09:49,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 13593.2). Total num frames: 39899136. Throughput: 0: 12251.8. Samples: 39875356. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:09:49,272][367454] Avg episode reward: [(0, '1988.425')] [2023-03-08 09:09:49,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000077928_39899136.pth... [2023-03-08 09:09:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000077192_39522304.pth [2023-03-08 09:09:51,862][367737] Updated weights for policy 0, policy_version 78000 (0.0004) [2023-03-08 09:09:54,272][367454] Fps is (10 sec: 13516.8, 60 sec: 12492.8, 300 sec: 13607.1). Total num frames: 39968768. Throughput: 0: 12486.2. Samples: 39957016. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:09:54,283][367454] Avg episode reward: [(0, '1925.143')] [2023-03-08 09:09:54,902][367737] Updated weights for policy 0, policy_version 78080 (0.0004) [2023-03-08 09:09:57,938][367737] Updated weights for policy 0, policy_version 78160 (0.0004) [2023-03-08 09:09:59,272][367454] Fps is (10 sec: 13516.8, 60 sec: 12492.8, 300 sec: 13593.2). Total num frames: 40034304. Throughput: 0: 12597.0. Samples: 39997440. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:09:59,282][367454] Avg episode reward: [(0, '1917.325')] [2023-03-08 09:10:01,053][367737] Updated weights for policy 0, policy_version 78240 (0.0005) [2023-03-08 09:10:04,070][367737] Updated weights for policy 0, policy_version 78320 (0.0004) [2023-03-08 09:10:04,272][367454] Fps is (10 sec: 13107.1, 60 sec: 12629.3, 300 sec: 13593.2). Total num frames: 40099840. Throughput: 0: 12783.2. Samples: 40076796. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:10:04,283][367454] Avg episode reward: [(0, '1929.305')] [2023-03-08 09:10:04,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000078320_40099840.pth... [2023-03-08 09:10:04,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000077568_39714816.pth [2023-03-08 09:10:07,083][367737] Updated weights for policy 0, policy_version 78400 (0.0004) [2023-03-08 09:10:09,272][367454] Fps is (10 sec: 13107.2, 60 sec: 12697.6, 300 sec: 13593.2). Total num frames: 40165376. Throughput: 0: 12987.5. Samples: 40157524. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:10:09,282][367454] Avg episode reward: [(0, '1958.242')] [2023-03-08 09:10:10,228][367737] Updated weights for policy 0, policy_version 78480 (0.0005) [2023-03-08 09:10:13,138][367737] Updated weights for policy 0, policy_version 78560 (0.0003) [2023-03-08 09:10:14,272][367454] Fps is (10 sec: 13516.9, 60 sec: 12902.4, 300 sec: 13593.2). Total num frames: 40235008. Throughput: 0: 13017.0. Samples: 40198096. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:10:14,282][367454] Avg episode reward: [(0, '1904.526')] [2023-03-08 09:10:16,202][367737] Updated weights for policy 0, policy_version 78640 (0.0004) [2023-03-08 09:10:19,227][367737] Updated weights for policy 0, policy_version 78720 (0.0004) [2023-03-08 09:10:19,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13038.9, 300 sec: 13607.0). Total num frames: 40304640. Throughput: 0: 13106.0. Samples: 40280072. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:10:19,283][367454] Avg episode reward: [(0, '1921.820')] [2023-03-08 09:10:19,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000078720_40304640.pth... [2023-03-08 09:10:19,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000077928_39899136.pth [2023-03-08 09:10:22,251][367737] Updated weights for policy 0, policy_version 78800 (0.0004) [2023-03-08 09:10:24,272][367454] Fps is (10 sec: 13516.7, 60 sec: 13107.2, 300 sec: 13607.0). Total num frames: 40370176. Throughput: 0: 13278.7. Samples: 40361892. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:10:24,283][367454] Avg episode reward: [(0, '2049.561')] [2023-03-08 09:10:25,151][367737] Updated weights for policy 0, policy_version 78880 (0.0004) [2023-03-08 09:10:28,137][367737] Updated weights for policy 0, policy_version 78960 (0.0004) [2023-03-08 09:10:29,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13243.7, 300 sec: 13620.9). Total num frames: 40439808. Throughput: 0: 13392.8. Samples: 40403580. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:10:29,283][367454] Avg episode reward: [(0, '1932.286')] [2023-03-08 09:10:31,272][367737] Updated weights for policy 0, policy_version 79040 (0.0005) [2023-03-08 09:10:34,271][367454] Fps is (10 sec: 13107.3, 60 sec: 13107.2, 300 sec: 13607.1). Total num frames: 40501248. Throughput: 0: 13492.2. Samples: 40482504. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:10:34,282][367454] Avg episode reward: [(0, '1900.712')] [2023-03-08 09:10:34,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000079112_40505344.pth... [2023-03-08 09:10:34,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000078320_40099840.pth [2023-03-08 09:10:34,587][367737] Updated weights for policy 0, policy_version 79120 (0.0005) [2023-03-08 09:10:37,819][367737] Updated weights for policy 0, policy_version 79200 (0.0004) [2023-03-08 09:10:39,271][367454] Fps is (10 sec: 12697.7, 60 sec: 13243.7, 300 sec: 13607.1). Total num frames: 40566784. Throughput: 0: 13352.0. Samples: 40557856. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:10:39,282][367454] Avg episode reward: [(0, '1991.452')] [2023-03-08 09:10:41,004][367737] Updated weights for policy 0, policy_version 79280 (0.0005) [2023-03-08 09:10:44,258][367737] Updated weights for policy 0, policy_version 79360 (0.0005) [2023-03-08 09:10:44,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13312.0, 300 sec: 13593.2). Total num frames: 40632320. Throughput: 0: 13304.9. Samples: 40596160. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:10:44,283][367454] Avg episode reward: [(0, '1991.238')] [2023-03-08 09:10:47,522][367737] Updated weights for policy 0, policy_version 79440 (0.0004) [2023-03-08 09:10:49,271][367454] Fps is (10 sec: 12697.6, 60 sec: 13243.7, 300 sec: 13579.3). Total num frames: 40693760. Throughput: 0: 13223.6. Samples: 40671856. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:10:49,272][367454] Avg episode reward: [(0, '2021.190')] [2023-03-08 09:10:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000079480_40693760.pth... [2023-03-08 09:10:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000078720_40304640.pth [2023-03-08 09:10:50,831][367737] Updated weights for policy 0, policy_version 79520 (0.0005) [2023-03-08 09:10:54,080][367737] Updated weights for policy 0, policy_version 79600 (0.0005) [2023-03-08 09:10:54,271][367454] Fps is (10 sec: 12288.1, 60 sec: 13107.2, 300 sec: 13579.3). Total num frames: 40755200. Throughput: 0: 13099.8. Samples: 40747016. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:10:54,272][367454] Avg episode reward: [(0, '2002.616')] [2023-03-08 09:10:57,383][367737] Updated weights for policy 0, policy_version 79680 (0.0005) [2023-03-08 09:10:59,271][367454] Fps is (10 sec: 12288.0, 60 sec: 13038.9, 300 sec: 13551.5). Total num frames: 40816640. Throughput: 0: 13015.5. Samples: 40783792. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:10:59,272][367454] Avg episode reward: [(0, '1929.651')] [2023-03-08 09:11:00,665][367737] Updated weights for policy 0, policy_version 79760 (0.0005) [2023-03-08 09:11:03,994][367737] Updated weights for policy 0, policy_version 79840 (0.0005) [2023-03-08 09:11:04,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12970.7, 300 sec: 13523.7). Total num frames: 40878080. Throughput: 0: 12836.9. Samples: 40857732. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:11:04,272][367454] Avg episode reward: [(0, '1900.024')] [2023-03-08 09:11:04,307][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000079848_40882176.pth... [2023-03-08 09:11:04,309][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000079112_40505344.pth [2023-03-08 09:11:07,213][367737] Updated weights for policy 0, policy_version 79920 (0.0005) [2023-03-08 09:11:09,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12970.7, 300 sec: 13496.0). Total num frames: 40943616. Throughput: 0: 12711.9. Samples: 40933928. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:11:09,272][367454] Avg episode reward: [(0, '1960.382')] [2023-03-08 09:11:10,526][367737] Updated weights for policy 0, policy_version 80000 (0.0005) [2023-03-08 09:11:13,742][367737] Updated weights for policy 0, policy_version 80080 (0.0005) [2023-03-08 09:11:14,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12834.1, 300 sec: 13482.1). Total num frames: 41005056. Throughput: 0: 12624.1. Samples: 40971664. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:11:14,272][367454] Avg episode reward: [(0, '1972.528')] [2023-03-08 09:11:16,968][367737] Updated weights for policy 0, policy_version 80160 (0.0005) [2023-03-08 09:11:19,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12765.9, 300 sec: 13496.0). Total num frames: 41070592. Throughput: 0: 12559.8. Samples: 41047696. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:11:19,272][367454] Avg episode reward: [(0, '1921.184')] [2023-03-08 09:11:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000080216_41070592.pth... [2023-03-08 09:11:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000079480_40693760.pth [2023-03-08 09:11:20,109][367737] Updated weights for policy 0, policy_version 80240 (0.0005) [2023-03-08 09:11:23,346][367737] Updated weights for policy 0, policy_version 80320 (0.0005) [2023-03-08 09:11:24,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 13468.2). Total num frames: 41132032. Throughput: 0: 12583.1. Samples: 41124096. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:11:24,272][367454] Avg episode reward: [(0, '1996.778')] [2023-03-08 09:11:26,676][367737] Updated weights for policy 0, policy_version 80400 (0.0005) [2023-03-08 09:11:29,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 13468.2). Total num frames: 41197568. Throughput: 0: 12556.5. Samples: 41161204. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:11:29,272][367454] Avg episode reward: [(0, '1954.971')] [2023-03-08 09:11:29,731][367737] Updated weights for policy 0, policy_version 80480 (0.0004) [2023-03-08 09:11:32,922][367737] Updated weights for policy 0, policy_version 80560 (0.0005) [2023-03-08 09:11:34,272][367454] Fps is (10 sec: 13107.1, 60 sec: 12697.6, 300 sec: 13468.2). Total num frames: 41263104. Throughput: 0: 12614.2. Samples: 41239496. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:11:34,272][367454] Avg episode reward: [(0, '1868.351')] [2023-03-08 09:11:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000080592_41263104.pth... [2023-03-08 09:11:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000079848_40882176.pth [2023-03-08 09:11:36,140][367737] Updated weights for policy 0, policy_version 80640 (0.0005) [2023-03-08 09:11:39,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 13454.3). Total num frames: 41324544. Throughput: 0: 12645.9. Samples: 41316084. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:11:39,272][367454] Avg episode reward: [(0, '1937.413')] [2023-03-08 09:11:39,450][367737] Updated weights for policy 0, policy_version 80720 (0.0004) [2023-03-08 09:11:42,599][367737] Updated weights for policy 0, policy_version 80800 (0.0005) [2023-03-08 09:11:44,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 13454.3). Total num frames: 41390080. Throughput: 0: 12667.4. Samples: 41353824. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:11:44,272][367454] Avg episode reward: [(0, '1915.182')] [2023-03-08 09:11:45,434][367737] Updated weights for policy 0, policy_version 80880 (0.0003) [2023-03-08 09:11:48,294][367737] Updated weights for policy 0, policy_version 80960 (0.0004) [2023-03-08 09:11:49,272][367454] Fps is (10 sec: 13926.4, 60 sec: 12834.1, 300 sec: 13482.1). Total num frames: 41463808. Throughput: 0: 12905.1. Samples: 41438464. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 09:11:49,272][367454] Avg episode reward: [(0, '1882.448')] [2023-03-08 09:11:49,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000080984_41463808.pth... [2023-03-08 09:11:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000080216_41070592.pth [2023-03-08 09:11:51,067][367737] Updated weights for policy 0, policy_version 81040 (0.0004) [2023-03-08 09:11:53,907][367737] Updated weights for policy 0, policy_version 81120 (0.0004) [2023-03-08 09:11:54,271][367454] Fps is (10 sec: 14745.7, 60 sec: 13038.9, 300 sec: 13496.0). Total num frames: 41537536. Throughput: 0: 13157.1. Samples: 41525996. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 09:11:54,272][367454] Avg episode reward: [(0, '1987.644')] [2023-03-08 09:11:56,816][367737] Updated weights for policy 0, policy_version 81200 (0.0004) [2023-03-08 09:11:59,271][367454] Fps is (10 sec: 14336.1, 60 sec: 13175.5, 300 sec: 13496.0). Total num frames: 41607168. Throughput: 0: 13263.5. Samples: 41568520. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 09:11:59,272][367454] Avg episode reward: [(0, '1974.340')] [2023-03-08 09:11:59,593][367737] Updated weights for policy 0, policy_version 81280 (0.0004) [2023-03-08 09:12:02,374][367737] Updated weights for policy 0, policy_version 81360 (0.0004) [2023-03-08 09:12:04,272][367454] Fps is (10 sec: 14335.9, 60 sec: 13380.3, 300 sec: 13496.0). Total num frames: 41680896. Throughput: 0: 13526.4. Samples: 41656384. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 09:12:04,272][367454] Avg episode reward: [(0, '1953.669')] [2023-03-08 09:12:04,308][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000081416_41684992.pth... [2023-03-08 09:12:04,310][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000080592_41263104.pth [2023-03-08 09:12:05,175][367737] Updated weights for policy 0, policy_version 81440 (0.0004) [2023-03-08 09:12:07,935][367737] Updated weights for policy 0, policy_version 81520 (0.0004) [2023-03-08 09:12:09,271][367454] Fps is (10 sec: 14745.6, 60 sec: 13516.8, 300 sec: 13482.1). Total num frames: 41754624. Throughput: 0: 13803.2. Samples: 41745240. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 09:12:09,272][367454] Avg episode reward: [(0, '1903.171')] [2023-03-08 09:12:10,664][367737] Updated weights for policy 0, policy_version 81600 (0.0003) [2023-03-08 09:12:13,437][367737] Updated weights for policy 0, policy_version 81680 (0.0004) [2023-03-08 09:12:14,271][367454] Fps is (10 sec: 14745.6, 60 sec: 13721.6, 300 sec: 13482.1). Total num frames: 41828352. Throughput: 0: 13977.3. Samples: 41790184. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 09:12:14,272][367454] Avg episode reward: [(0, '2022.741')] [2023-03-08 09:12:16,157][367737] Updated weights for policy 0, policy_version 81760 (0.0004) [2023-03-08 09:12:18,940][367737] Updated weights for policy 0, policy_version 81840 (0.0004) [2023-03-08 09:12:19,272][367454] Fps is (10 sec: 15155.1, 60 sec: 13926.4, 300 sec: 13482.1). Total num frames: 41906176. Throughput: 0: 14222.4. Samples: 41879504. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 09:12:19,272][367454] Avg episode reward: [(0, '1920.916')] [2023-03-08 09:12:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000081848_41906176.pth... [2023-03-08 09:12:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000080984_41463808.pth [2023-03-08 09:12:21,643][367737] Updated weights for policy 0, policy_version 81920 (0.0003) [2023-03-08 09:12:24,271][367454] Fps is (10 sec: 14745.6, 60 sec: 14062.9, 300 sec: 13482.1). Total num frames: 41975808. Throughput: 0: 14479.0. Samples: 41967636. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 09:12:24,272][367454] Avg episode reward: [(0, '1913.367')] [2023-03-08 09:12:24,570][367737] Updated weights for policy 0, policy_version 82000 (0.0004) [2023-03-08 09:12:27,634][367737] Updated weights for policy 0, policy_version 82080 (0.0005) [2023-03-08 09:12:29,271][367454] Fps is (10 sec: 13926.5, 60 sec: 14131.2, 300 sec: 13496.0). Total num frames: 42045440. Throughput: 0: 14550.1. Samples: 42008576. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 09:12:29,272][367454] Avg episode reward: [(0, '2048.719')] [2023-03-08 09:12:30,771][367737] Updated weights for policy 0, policy_version 82160 (0.0005) [2023-03-08 09:12:33,895][367737] Updated weights for policy 0, policy_version 82240 (0.0005) [2023-03-08 09:12:34,272][367454] Fps is (10 sec: 13516.7, 60 sec: 14131.2, 300 sec: 13468.2). Total num frames: 42110976. Throughput: 0: 14421.7. Samples: 42087440. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 09:12:34,272][367454] Avg episode reward: [(0, '1866.864')] [2023-03-08 09:12:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000082248_42110976.pth... [2023-03-08 09:12:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000081416_41684992.pth [2023-03-08 09:12:36,952][367737] Updated weights for policy 0, policy_version 82320 (0.0005) [2023-03-08 09:12:39,272][367454] Fps is (10 sec: 13107.1, 60 sec: 14199.5, 300 sec: 13440.4). Total num frames: 42176512. Throughput: 0: 14259.1. Samples: 42167656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:12:39,272][367454] Avg episode reward: [(0, '1963.818')] [2023-03-08 09:12:40,064][367737] Updated weights for policy 0, policy_version 82400 (0.0005) [2023-03-08 09:12:43,088][367737] Updated weights for policy 0, policy_version 82480 (0.0004) [2023-03-08 09:12:44,272][367454] Fps is (10 sec: 13107.2, 60 sec: 14199.5, 300 sec: 13398.8). Total num frames: 42242048. Throughput: 0: 14211.1. Samples: 42208020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:12:44,272][367454] Avg episode reward: [(0, '2109.970')] [2023-03-08 09:12:46,254][367737] Updated weights for policy 0, policy_version 82560 (0.0005) [2023-03-08 09:12:49,272][367454] Fps is (10 sec: 13107.2, 60 sec: 14062.9, 300 sec: 13371.0). Total num frames: 42307584. Throughput: 0: 13993.5. Samples: 42286092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:12:49,272][367454] Avg episode reward: [(0, '2001.010')] [2023-03-08 09:12:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000082632_42307584.pth... [2023-03-08 09:12:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000081848_41906176.pth [2023-03-08 09:12:49,376][367737] Updated weights for policy 0, policy_version 82640 (0.0005) [2023-03-08 09:12:52,515][367737] Updated weights for policy 0, policy_version 82720 (0.0005) [2023-03-08 09:12:54,271][367454] Fps is (10 sec: 13107.3, 60 sec: 13926.4, 300 sec: 13329.4). Total num frames: 42373120. Throughput: 0: 13765.2. Samples: 42364676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:12:54,272][367454] Avg episode reward: [(0, '1967.818')] [2023-03-08 09:12:55,672][367737] Updated weights for policy 0, policy_version 82800 (0.0005) [2023-03-08 09:12:58,883][367737] Updated weights for policy 0, policy_version 82880 (0.0005) [2023-03-08 09:12:59,271][367454] Fps is (10 sec: 13107.2, 60 sec: 13858.1, 300 sec: 13301.6). Total num frames: 42438656. Throughput: 0: 13602.1. Samples: 42402280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:12:59,272][367454] Avg episode reward: [(0, '1980.405')] [2023-03-08 09:13:01,963][367737] Updated weights for policy 0, policy_version 82960 (0.0005) [2023-03-08 09:13:04,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13721.6, 300 sec: 13259.9). Total num frames: 42504192. Throughput: 0: 13374.6. Samples: 42481360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:13:04,272][367454] Avg episode reward: [(0, '1900.717')] [2023-03-08 09:13:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000083016_42504192.pth... [2023-03-08 09:13:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000082248_42110976.pth [2023-03-08 09:13:05,035][367737] Updated weights for policy 0, policy_version 83040 (0.0005) [2023-03-08 09:13:08,128][367737] Updated weights for policy 0, policy_version 83120 (0.0005) [2023-03-08 09:13:09,271][367454] Fps is (10 sec: 13107.2, 60 sec: 13585.1, 300 sec: 13232.2). Total num frames: 42569728. Throughput: 0: 13198.1. Samples: 42561552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:13:09,272][367454] Avg episode reward: [(0, '1922.074')] [2023-03-08 09:13:11,222][367737] Updated weights for policy 0, policy_version 83200 (0.0005) [2023-03-08 09:13:14,186][367737] Updated weights for policy 0, policy_version 83280 (0.0004) [2023-03-08 09:13:14,272][367454] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13204.4). Total num frames: 42639360. Throughput: 0: 13161.1. Samples: 42600824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:13:14,272][367454] Avg episode reward: [(0, '1955.023')] [2023-03-08 09:13:16,937][367737] Updated weights for policy 0, policy_version 83360 (0.0004) [2023-03-08 09:13:19,271][367454] Fps is (10 sec: 13926.4, 60 sec: 13380.3, 300 sec: 13190.5). Total num frames: 42708992. Throughput: 0: 13326.1. Samples: 42687112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:13:19,272][367454] Avg episode reward: [(0, '1897.794')] [2023-03-08 09:13:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000083416_42708992.pth... [2023-03-08 09:13:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000082632_42307584.pth [2023-03-08 09:13:19,999][367737] Updated weights for policy 0, policy_version 83440 (0.0004) [2023-03-08 09:13:23,168][367737] Updated weights for policy 0, policy_version 83520 (0.0005) [2023-03-08 09:13:24,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13312.0, 300 sec: 13176.6). Total num frames: 42774528. Throughput: 0: 13293.9. Samples: 42765880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:13:24,272][367454] Avg episode reward: [(0, '1875.370')] [2023-03-08 09:13:26,256][367737] Updated weights for policy 0, policy_version 83600 (0.0005) [2023-03-08 09:13:29,271][367454] Fps is (10 sec: 13107.2, 60 sec: 13243.7, 300 sec: 13135.0). Total num frames: 42840064. Throughput: 0: 13263.3. Samples: 42804868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:13:29,272][367454] Avg episode reward: [(0, '1841.231')] [2023-03-08 09:13:29,295][367737] Updated weights for policy 0, policy_version 83680 (0.0005) [2023-03-08 09:13:32,263][367737] Updated weights for policy 0, policy_version 83760 (0.0004) [2023-03-08 09:13:34,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13312.0, 300 sec: 13148.9). Total num frames: 42909696. Throughput: 0: 13352.5. Samples: 42886956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:13:34,272][367454] Avg episode reward: [(0, '2002.955')] [2023-03-08 09:13:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000083808_42909696.pth... [2023-03-08 09:13:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000083016_42504192.pth [2023-03-08 09:13:35,356][367737] Updated weights for policy 0, policy_version 83840 (0.0005) [2023-03-08 09:13:38,505][367737] Updated weights for policy 0, policy_version 83920 (0.0005) [2023-03-08 09:13:39,271][367454] Fps is (10 sec: 13516.7, 60 sec: 13312.0, 300 sec: 13162.7). Total num frames: 42975232. Throughput: 0: 13354.7. Samples: 42965640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:13:39,272][367454] Avg episode reward: [(0, '2038.107')] [2023-03-08 09:13:41,388][367737] Updated weights for policy 0, policy_version 84000 (0.0004) [2023-03-08 09:13:44,271][367454] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13190.5). Total num frames: 43044864. Throughput: 0: 13461.9. Samples: 43008064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:13:44,272][367454] Avg episode reward: [(0, '1990.188')] [2023-03-08 09:13:44,344][367737] Updated weights for policy 0, policy_version 84080 (0.0005) [2023-03-08 09:13:47,399][367737] Updated weights for policy 0, policy_version 84160 (0.0005) [2023-03-08 09:13:49,272][367454] Fps is (10 sec: 13926.1, 60 sec: 13448.5, 300 sec: 13204.4). Total num frames: 43114496. Throughput: 0: 13523.7. Samples: 43089928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:13:49,273][367454] Avg episode reward: [(0, '1991.452')] [2023-03-08 09:13:49,278][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000084208_43114496.pth... [2023-03-08 09:13:49,280][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000083416_42708992.pth [2023-03-08 09:13:50,546][367737] Updated weights for policy 0, policy_version 84240 (0.0005) [2023-03-08 09:13:53,650][367737] Updated weights for policy 0, policy_version 84320 (0.0004) [2023-03-08 09:13:54,272][367454] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13204.4). Total num frames: 43180032. Throughput: 0: 13480.1. Samples: 43168160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:13:54,272][367454] Avg episode reward: [(0, '1858.737')] [2023-03-08 09:13:56,738][367737] Updated weights for policy 0, policy_version 84400 (0.0004) [2023-03-08 09:13:59,272][367454] Fps is (10 sec: 13107.5, 60 sec: 13448.5, 300 sec: 13232.2). Total num frames: 43245568. Throughput: 0: 13508.6. Samples: 43208712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:13:59,272][367454] Avg episode reward: [(0, '1887.127')] [2023-03-08 09:13:59,819][367737] Updated weights for policy 0, policy_version 84480 (0.0005) [2023-03-08 09:14:02,930][367737] Updated weights for policy 0, policy_version 84560 (0.0005) [2023-03-08 09:14:04,271][367454] Fps is (10 sec: 13107.3, 60 sec: 13448.6, 300 sec: 13246.0). Total num frames: 43311104. Throughput: 0: 13332.3. Samples: 43287064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:14:04,272][367454] Avg episode reward: [(0, '1852.463')] [2023-03-08 09:14:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000084592_43311104.pth... [2023-03-08 09:14:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000083808_42909696.pth [2023-03-08 09:14:06,053][367737] Updated weights for policy 0, policy_version 84640 (0.0004) [2023-03-08 09:14:09,150][367737] Updated weights for policy 0, policy_version 84720 (0.0005) [2023-03-08 09:14:09,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13273.8). Total num frames: 43376640. Throughput: 0: 13360.4. Samples: 43367096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:14:09,272][367454] Avg episode reward: [(0, '1865.987')] [2023-03-08 09:14:12,228][367737] Updated weights for policy 0, policy_version 84800 (0.0005) [2023-03-08 09:14:14,271][367454] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13287.7). Total num frames: 43442176. Throughput: 0: 13348.0. Samples: 43405528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:14:14,272][367454] Avg episode reward: [(0, '1914.764')] [2023-03-08 09:14:15,245][367737] Updated weights for policy 0, policy_version 84880 (0.0005) [2023-03-08 09:14:18,171][367737] Updated weights for policy 0, policy_version 84960 (0.0005) [2023-03-08 09:14:19,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13380.3, 300 sec: 13315.5). Total num frames: 43511808. Throughput: 0: 13371.4. Samples: 43488668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:14:19,272][367454] Avg episode reward: [(0, '1947.673')] [2023-03-08 09:14:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000084984_43511808.pth... [2023-03-08 09:14:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000084208_43114496.pth [2023-03-08 09:14:21,190][367737] Updated weights for policy 0, policy_version 85040 (0.0005) [2023-03-08 09:14:24,199][367737] Updated weights for policy 0, policy_version 85120 (0.0005) [2023-03-08 09:14:24,272][367454] Fps is (10 sec: 13926.3, 60 sec: 13448.5, 300 sec: 13343.2). Total num frames: 43581440. Throughput: 0: 13435.7. Samples: 43570248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:14:24,272][367454] Avg episode reward: [(0, '1925.678')] [2023-03-08 09:14:27,175][367737] Updated weights for policy 0, policy_version 85200 (0.0005) [2023-03-08 09:14:29,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13329.4). Total num frames: 43646976. Throughput: 0: 13391.8. Samples: 43610696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:14:29,272][367454] Avg episode reward: [(0, '1935.697')] [2023-03-08 09:14:30,283][367737] Updated weights for policy 0, policy_version 85280 (0.0005) [2023-03-08 09:14:33,302][367737] Updated weights for policy 0, policy_version 85360 (0.0004) [2023-03-08 09:14:34,272][367454] Fps is (10 sec: 13516.7, 60 sec: 13448.5, 300 sec: 13371.0). Total num frames: 43716608. Throughput: 0: 13380.3. Samples: 43692040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:14:34,272][367454] Avg episode reward: [(0, '1924.198')] [2023-03-08 09:14:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000085384_43716608.pth... [2023-03-08 09:14:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000084592_43311104.pth [2023-03-08 09:14:36,287][367737] Updated weights for policy 0, policy_version 85440 (0.0005) [2023-03-08 09:14:39,271][367454] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13384.9). Total num frames: 43782144. Throughput: 0: 13463.5. Samples: 43774016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:14:39,272][367454] Avg episode reward: [(0, '1908.955')] [2023-03-08 09:14:39,279][367737] Updated weights for policy 0, policy_version 85520 (0.0005) [2023-03-08 09:14:42,231][367737] Updated weights for policy 0, policy_version 85600 (0.0005) [2023-03-08 09:14:44,272][367454] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13398.8). Total num frames: 43851776. Throughput: 0: 13472.5. Samples: 43814976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:14:44,272][367454] Avg episode reward: [(0, '1893.622')] [2023-03-08 09:14:45,279][367737] Updated weights for policy 0, policy_version 85680 (0.0005) [2023-03-08 09:14:48,282][367737] Updated weights for policy 0, policy_version 85760 (0.0005) [2023-03-08 09:14:49,272][367454] Fps is (10 sec: 13926.1, 60 sec: 13448.6, 300 sec: 13398.8). Total num frames: 43921408. Throughput: 0: 13550.8. Samples: 43896852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:14:49,272][367454] Avg episode reward: [(0, '1923.768')] [2023-03-08 09:14:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000085784_43921408.pth... [2023-03-08 09:14:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000084984_43511808.pth [2023-03-08 09:14:51,364][367737] Updated weights for policy 0, policy_version 85840 (0.0005) [2023-03-08 09:14:54,271][367454] Fps is (10 sec: 13516.9, 60 sec: 13448.6, 300 sec: 13398.8). Total num frames: 43986944. Throughput: 0: 13580.7. Samples: 43978228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:14:54,272][367454] Avg episode reward: [(0, '1875.248')] [2023-03-08 09:14:54,332][367737] Updated weights for policy 0, policy_version 85920 (0.0005) [2023-03-08 09:14:57,288][367737] Updated weights for policy 0, policy_version 86000 (0.0005) [2023-03-08 09:14:59,271][367454] Fps is (10 sec: 13517.1, 60 sec: 13516.8, 300 sec: 13412.7). Total num frames: 44056576. Throughput: 0: 13649.0. Samples: 44019732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:14:59,272][367454] Avg episode reward: [(0, '1853.149')] [2023-03-08 09:15:00,279][367737] Updated weights for policy 0, policy_version 86080 (0.0005) [2023-03-08 09:15:03,284][367737] Updated weights for policy 0, policy_version 86160 (0.0005) [2023-03-08 09:15:04,271][367454] Fps is (10 sec: 13926.4, 60 sec: 13585.1, 300 sec: 13426.6). Total num frames: 44126208. Throughput: 0: 13622.9. Samples: 44101696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:15:04,272][367454] Avg episode reward: [(0, '1806.491')] [2023-03-08 09:15:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000086184_44126208.pth... [2023-03-08 09:15:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000085384_43716608.pth [2023-03-08 09:15:06,186][367737] Updated weights for policy 0, policy_version 86240 (0.0004) [2023-03-08 09:15:09,179][367737] Updated weights for policy 0, policy_version 86320 (0.0005) [2023-03-08 09:15:09,272][367454] Fps is (10 sec: 13926.3, 60 sec: 13653.3, 300 sec: 13426.5). Total num frames: 44195840. Throughput: 0: 13655.1. Samples: 44184728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:15:09,272][367454] Avg episode reward: [(0, '1863.014')] [2023-03-08 09:15:12,152][367737] Updated weights for policy 0, policy_version 86400 (0.0005) [2023-03-08 09:15:14,271][367454] Fps is (10 sec: 13926.3, 60 sec: 13721.6, 300 sec: 13426.6). Total num frames: 44265472. Throughput: 0: 13678.7. Samples: 44226236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:15:14,272][367454] Avg episode reward: [(0, '1842.630')] [2023-03-08 09:15:15,146][367737] Updated weights for policy 0, policy_version 86480 (0.0005) [2023-03-08 09:15:18,034][367737] Updated weights for policy 0, policy_version 86560 (0.0005) [2023-03-08 09:15:19,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13721.6, 300 sec: 13440.4). Total num frames: 44335104. Throughput: 0: 13710.1. Samples: 44308992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:15:19,272][367454] Avg episode reward: [(0, '1810.882')] [2023-03-08 09:15:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000086592_44335104.pth... [2023-03-08 09:15:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000085784_43921408.pth [2023-03-08 09:15:20,592][367737] Updated weights for policy 0, policy_version 86640 (0.0003) [2023-03-08 09:15:23,125][367737] Updated weights for policy 0, policy_version 86720 (0.0004) [2023-03-08 09:15:24,272][367454] Fps is (10 sec: 15155.2, 60 sec: 13926.4, 300 sec: 13482.1). Total num frames: 44417024. Throughput: 0: 14017.4. Samples: 44404800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:15:24,272][367454] Avg episode reward: [(0, '1752.113')] [2023-03-08 09:15:25,780][367737] Updated weights for policy 0, policy_version 86800 (0.0004) [2023-03-08 09:15:28,666][367737] Updated weights for policy 0, policy_version 86880 (0.0004) [2023-03-08 09:15:29,271][367454] Fps is (10 sec: 15564.9, 60 sec: 14062.9, 300 sec: 13523.7). Total num frames: 44490752. Throughput: 0: 14120.4. Samples: 44450392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:15:29,277][367454] Avg episode reward: [(0, '1784.326')] [2023-03-08 09:15:31,607][367737] Updated weights for policy 0, policy_version 86960 (0.0005) [2023-03-08 09:15:34,272][367454] Fps is (10 sec: 14335.7, 60 sec: 14062.9, 300 sec: 13537.6). Total num frames: 44560384. Throughput: 0: 14178.5. Samples: 44534884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:15:34,283][367454] Avg episode reward: [(0, '1761.673')] [2023-03-08 09:15:34,287][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000087032_44560384.pth... [2023-03-08 09:15:34,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000086184_44126208.pth [2023-03-08 09:15:34,535][367737] Updated weights for policy 0, policy_version 87040 (0.0005) [2023-03-08 09:15:37,586][367737] Updated weights for policy 0, policy_version 87120 (0.0005) [2023-03-08 09:15:39,272][367454] Fps is (10 sec: 13516.8, 60 sec: 14062.9, 300 sec: 13537.6). Total num frames: 44625920. Throughput: 0: 14179.8. Samples: 44616320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:15:39,282][367454] Avg episode reward: [(0, '1838.357')] [2023-03-08 09:15:40,514][367737] Updated weights for policy 0, policy_version 87200 (0.0005) [2023-03-08 09:15:43,515][367737] Updated weights for policy 0, policy_version 87280 (0.0005) [2023-03-08 09:15:44,272][367454] Fps is (10 sec: 13517.0, 60 sec: 14062.9, 300 sec: 13565.4). Total num frames: 44695552. Throughput: 0: 14199.3. Samples: 44658700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:15:44,272][367454] Avg episode reward: [(0, '1797.573')] [2023-03-08 09:15:46,437][367737] Updated weights for policy 0, policy_version 87360 (0.0004) [2023-03-08 09:15:49,272][367454] Fps is (10 sec: 13926.3, 60 sec: 14063.0, 300 sec: 13593.2). Total num frames: 44765184. Throughput: 0: 14218.1. Samples: 44741512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:15:49,272][367454] Avg episode reward: [(0, '1747.784')] [2023-03-08 09:15:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000087432_44765184.pth... [2023-03-08 09:15:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000086592_44335104.pth [2023-03-08 09:15:49,342][367737] Updated weights for policy 0, policy_version 87440 (0.0004) [2023-03-08 09:15:52,390][367737] Updated weights for policy 0, policy_version 87520 (0.0004) [2023-03-08 09:15:54,271][367454] Fps is (10 sec: 13926.6, 60 sec: 14131.2, 300 sec: 13620.9). Total num frames: 44834816. Throughput: 0: 14199.9. Samples: 44823724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:15:54,272][367454] Avg episode reward: [(0, '1762.758')] [2023-03-08 09:15:55,540][367737] Updated weights for policy 0, policy_version 87600 (0.0005) [2023-03-08 09:15:58,532][367737] Updated weights for policy 0, policy_version 87680 (0.0005) [2023-03-08 09:15:59,271][367454] Fps is (10 sec: 13516.9, 60 sec: 14062.9, 300 sec: 13634.8). Total num frames: 44900352. Throughput: 0: 14161.2. Samples: 44863488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:15:59,272][367454] Avg episode reward: [(0, '1764.592')] [2023-03-08 09:16:01,542][367737] Updated weights for policy 0, policy_version 87760 (0.0005) [2023-03-08 09:16:04,272][367454] Fps is (10 sec: 13107.0, 60 sec: 13994.6, 300 sec: 13634.8). Total num frames: 44965888. Throughput: 0: 14142.6. Samples: 44945408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:16:04,272][367454] Avg episode reward: [(0, '1847.594')] [2023-03-08 09:16:04,303][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000087832_44969984.pth... [2023-03-08 09:16:04,304][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000087032_44560384.pth [2023-03-08 09:16:04,591][367737] Updated weights for policy 0, policy_version 87840 (0.0005) [2023-03-08 09:16:07,480][367737] Updated weights for policy 0, policy_version 87920 (0.0005) [2023-03-08 09:16:09,272][367454] Fps is (10 sec: 13516.7, 60 sec: 13994.7, 300 sec: 13662.6). Total num frames: 45035520. Throughput: 0: 13834.0. Samples: 45027328. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:16:09,272][367454] Avg episode reward: [(0, '1752.093')] [2023-03-08 09:16:10,527][367737] Updated weights for policy 0, policy_version 88000 (0.0005) [2023-03-08 09:16:13,556][367737] Updated weights for policy 0, policy_version 88080 (0.0004) [2023-03-08 09:16:14,272][367454] Fps is (10 sec: 13926.6, 60 sec: 13994.7, 300 sec: 13676.5). Total num frames: 45105152. Throughput: 0: 13731.0. Samples: 45068288. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:16:14,283][367454] Avg episode reward: [(0, '1872.085')] [2023-03-08 09:16:16,483][367737] Updated weights for policy 0, policy_version 88160 (0.0004) [2023-03-08 09:16:19,271][367454] Fps is (10 sec: 13926.4, 60 sec: 13994.7, 300 sec: 13704.2). Total num frames: 45174784. Throughput: 0: 13675.3. Samples: 45150272. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:16:19,282][367454] Avg episode reward: [(0, '1827.972')] [2023-03-08 09:16:19,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000088232_45174784.pth... [2023-03-08 09:16:19,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000087432_44765184.pth [2023-03-08 09:16:19,498][367737] Updated weights for policy 0, policy_version 88240 (0.0004) [2023-03-08 09:16:22,425][367737] Updated weights for policy 0, policy_version 88320 (0.0005) [2023-03-08 09:16:24,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 13718.1). Total num frames: 45244416. Throughput: 0: 13705.1. Samples: 45233048. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:16:24,282][367454] Avg episode reward: [(0, '1845.890')] [2023-03-08 09:16:25,477][367737] Updated weights for policy 0, policy_version 88400 (0.0005) [2023-03-08 09:16:28,372][367737] Updated weights for policy 0, policy_version 88480 (0.0005) [2023-03-08 09:16:29,271][367454] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13718.1). Total num frames: 45309952. Throughput: 0: 13664.6. Samples: 45273604. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:16:29,272][367454] Avg episode reward: [(0, '1869.900')] [2023-03-08 09:16:31,353][367737] Updated weights for policy 0, policy_version 88560 (0.0005) [2023-03-08 09:16:34,271][367454] Fps is (10 sec: 13516.9, 60 sec: 13653.4, 300 sec: 13745.9). Total num frames: 45379584. Throughput: 0: 13676.2. Samples: 45356940. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:16:34,282][367454] Avg episode reward: [(0, '1823.660')] [2023-03-08 09:16:34,338][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000088640_45383680.pth... [2023-03-08 09:16:34,339][367737] Updated weights for policy 0, policy_version 88640 (0.0005) [2023-03-08 09:16:34,341][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000087832_44969984.pth [2023-03-08 09:16:37,451][367737] Updated weights for policy 0, policy_version 88720 (0.0005) [2023-03-08 09:16:39,272][367454] Fps is (10 sec: 13926.3, 60 sec: 13721.6, 300 sec: 13759.8). Total num frames: 45449216. Throughput: 0: 13644.4. Samples: 45437724. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:16:39,283][367454] Avg episode reward: [(0, '1850.533')] [2023-03-08 09:16:40,475][367737] Updated weights for policy 0, policy_version 88800 (0.0005) [2023-03-08 09:16:43,461][367737] Updated weights for policy 0, policy_version 88880 (0.0005) [2023-03-08 09:16:44,272][367454] Fps is (10 sec: 13516.7, 60 sec: 13653.3, 300 sec: 13732.0). Total num frames: 45514752. Throughput: 0: 13655.0. Samples: 45477964. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:16:44,282][367454] Avg episode reward: [(0, '1802.330')] [2023-03-08 09:16:46,546][367737] Updated weights for policy 0, policy_version 88960 (0.0005) [2023-03-08 09:16:49,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13718.1). Total num frames: 45584384. Throughput: 0: 13643.8. Samples: 45559380. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:16:49,282][367454] Avg episode reward: [(0, '1891.797')] [2023-03-08 09:16:49,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000089032_45584384.pth... [2023-03-08 09:16:49,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000088232_45174784.pth [2023-03-08 09:16:49,515][367737] Updated weights for policy 0, policy_version 89040 (0.0005) [2023-03-08 09:16:52,400][367737] Updated weights for policy 0, policy_version 89120 (0.0004) [2023-03-08 09:16:54,271][367454] Fps is (10 sec: 13926.5, 60 sec: 13653.3, 300 sec: 13718.1). Total num frames: 45654016. Throughput: 0: 13661.6. Samples: 45642100. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:16:54,282][367454] Avg episode reward: [(0, '1953.771')] [2023-03-08 09:16:55,424][367737] Updated weights for policy 0, policy_version 89200 (0.0005) [2023-03-08 09:16:58,328][367737] Updated weights for policy 0, policy_version 89280 (0.0005) [2023-03-08 09:16:59,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13721.6, 300 sec: 13704.2). Total num frames: 45723648. Throughput: 0: 13699.9. Samples: 45684784. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:16:59,272][367454] Avg episode reward: [(0, '1869.296')] [2023-03-08 09:17:01,242][367737] Updated weights for policy 0, policy_version 89360 (0.0005) [2023-03-08 09:17:04,272][367454] Fps is (10 sec: 13516.7, 60 sec: 13721.6, 300 sec: 13676.5). Total num frames: 45789184. Throughput: 0: 13738.9. Samples: 45768524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:17:04,272][367454] Avg episode reward: [(0, '1995.526')] [2023-03-08 09:17:04,308][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000089440_45793280.pth... [2023-03-08 09:17:04,308][367737] Updated weights for policy 0, policy_version 89440 (0.0005) [2023-03-08 09:17:04,309][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000088640_45383680.pth [2023-03-08 09:17:07,298][367737] Updated weights for policy 0, policy_version 89520 (0.0005) [2023-03-08 09:17:09,272][367454] Fps is (10 sec: 13516.9, 60 sec: 13721.6, 300 sec: 13662.6). Total num frames: 45858816. Throughput: 0: 13677.7. Samples: 45848544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:17:09,272][367454] Avg episode reward: [(0, '2028.345')] [2023-03-08 09:17:10,391][367737] Updated weights for policy 0, policy_version 89600 (0.0005) [2023-03-08 09:17:13,332][367737] Updated weights for policy 0, policy_version 89680 (0.0005) [2023-03-08 09:17:14,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13721.6, 300 sec: 13634.8). Total num frames: 45928448. Throughput: 0: 13686.0. Samples: 45889476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:17:14,272][367454] Avg episode reward: [(0, '1981.585')] [2023-03-08 09:17:16,276][367737] Updated weights for policy 0, policy_version 89760 (0.0005) [2023-03-08 09:17:19,271][367454] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13620.9). Total num frames: 45993984. Throughput: 0: 13664.3. Samples: 45971832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:17:19,272][367454] Avg episode reward: [(0, '1986.172')] [2023-03-08 09:17:19,331][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000089840_45998080.pth... [2023-03-08 09:17:19,332][367737] Updated weights for policy 0, policy_version 89840 (0.0006) [2023-03-08 09:17:19,334][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000089032_45584384.pth [2023-03-08 09:17:22,276][367737] Updated weights for policy 0, policy_version 89920 (0.0005) [2023-03-08 09:17:24,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13620.9). Total num frames: 46063616. Throughput: 0: 13698.3. Samples: 46054148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:17:24,272][367454] Avg episode reward: [(0, '1944.258')] [2023-03-08 09:17:25,283][367737] Updated weights for policy 0, policy_version 90000 (0.0006) [2023-03-08 09:17:28,280][367737] Updated weights for policy 0, policy_version 90080 (0.0005) [2023-03-08 09:17:29,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13721.6, 300 sec: 13634.8). Total num frames: 46133248. Throughput: 0: 13742.7. Samples: 46096384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:17:29,272][367454] Avg episode reward: [(0, '1981.756')] [2023-03-08 09:17:31,276][367737] Updated weights for policy 0, policy_version 90160 (0.0005) [2023-03-08 09:17:34,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13634.8). Total num frames: 46198784. Throughput: 0: 13738.2. Samples: 46177600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:17:34,272][367454] Avg episode reward: [(0, '1996.662')] [2023-03-08 09:17:34,292][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000090240_46202880.pth... [2023-03-08 09:17:34,293][367737] Updated weights for policy 0, policy_version 90240 (0.0005) [2023-03-08 09:17:34,293][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000089440_45793280.pth [2023-03-08 09:17:37,190][367737] Updated weights for policy 0, policy_version 90320 (0.0005) [2023-03-08 09:17:39,271][367454] Fps is (10 sec: 13516.9, 60 sec: 13653.4, 300 sec: 13648.7). Total num frames: 46268416. Throughput: 0: 13736.3. Samples: 46260232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:17:39,272][367454] Avg episode reward: [(0, '2031.296')] [2023-03-08 09:17:40,279][367737] Updated weights for policy 0, policy_version 90400 (0.0005) [2023-03-08 09:17:43,366][367737] Updated weights for policy 0, policy_version 90480 (0.0005) [2023-03-08 09:17:44,272][367454] Fps is (10 sec: 13926.5, 60 sec: 13721.6, 300 sec: 13662.6). Total num frames: 46338048. Throughput: 0: 13674.9. Samples: 46300152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:17:44,272][367454] Avg episode reward: [(0, '2030.987')] [2023-03-08 09:17:46,391][367737] Updated weights for policy 0, policy_version 90560 (0.0005) [2023-03-08 09:17:49,272][367454] Fps is (10 sec: 13516.6, 60 sec: 13653.3, 300 sec: 13662.6). Total num frames: 46403584. Throughput: 0: 13594.0. Samples: 46380256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:17:49,272][367454] Avg episode reward: [(0, '2086.338')] [2023-03-08 09:17:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000090632_46403584.pth... [2023-03-08 09:17:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000089840_45998080.pth [2023-03-08 09:17:49,404][367737] Updated weights for policy 0, policy_version 90640 (0.0005) [2023-03-08 09:17:52,295][367737] Updated weights for policy 0, policy_version 90720 (0.0005) [2023-03-08 09:17:54,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13653.3, 300 sec: 13676.5). Total num frames: 46473216. Throughput: 0: 13649.5. Samples: 46462772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:17:54,272][367454] Avg episode reward: [(0, '2042.170')] [2023-03-08 09:17:55,433][367737] Updated weights for policy 0, policy_version 90800 (0.0005) [2023-03-08 09:17:58,603][367737] Updated weights for policy 0, policy_version 90880 (0.0005) [2023-03-08 09:17:59,271][367454] Fps is (10 sec: 13516.9, 60 sec: 13585.1, 300 sec: 13676.5). Total num frames: 46538752. Throughput: 0: 13612.9. Samples: 46502056. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:17:59,272][367454] Avg episode reward: [(0, '2045.522')] [2023-03-08 09:18:01,399][367737] Updated weights for policy 0, policy_version 90960 (0.0005) [2023-03-08 09:18:04,171][367737] Updated weights for policy 0, policy_version 91040 (0.0004) [2023-03-08 09:18:04,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13721.6, 300 sec: 13704.2). Total num frames: 46612480. Throughput: 0: 13624.0. Samples: 46584912. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:18:04,272][367454] Avg episode reward: [(0, '2050.781')] [2023-03-08 09:18:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000091040_46612480.pth... [2023-03-08 09:18:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000090240_46202880.pth [2023-03-08 09:18:06,950][367737] Updated weights for policy 0, policy_version 91120 (0.0004) [2023-03-08 09:18:09,272][367454] Fps is (10 sec: 14336.0, 60 sec: 13721.6, 300 sec: 13704.2). Total num frames: 46682112. Throughput: 0: 13751.6. Samples: 46672968. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:18:09,272][367454] Avg episode reward: [(0, '2029.449')] [2023-03-08 09:18:09,918][367737] Updated weights for policy 0, policy_version 91200 (0.0005) [2023-03-08 09:18:12,923][367737] Updated weights for policy 0, policy_version 91280 (0.0005) [2023-03-08 09:18:14,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13721.6, 300 sec: 13704.2). Total num frames: 46751744. Throughput: 0: 13744.4. Samples: 46714880. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:18:14,272][367454] Avg episode reward: [(0, '1966.891')] [2023-03-08 09:18:15,649][367737] Updated weights for policy 0, policy_version 91360 (0.0004) [2023-03-08 09:18:18,390][367737] Updated weights for policy 0, policy_version 91440 (0.0004) [2023-03-08 09:18:19,272][367454] Fps is (10 sec: 14745.6, 60 sec: 13926.4, 300 sec: 13745.9). Total num frames: 46829568. Throughput: 0: 13863.3. Samples: 46801448. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:18:19,272][367454] Avg episode reward: [(0, '1983.497')] [2023-03-08 09:18:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000091464_46829568.pth... [2023-03-08 09:18:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000090632_46403584.pth [2023-03-08 09:18:21,049][367737] Updated weights for policy 0, policy_version 91520 (0.0004) [2023-03-08 09:18:23,734][367737] Updated weights for policy 0, policy_version 91600 (0.0004) [2023-03-08 09:18:24,271][367454] Fps is (10 sec: 15155.2, 60 sec: 13994.7, 300 sec: 13773.7). Total num frames: 46903296. Throughput: 0: 14096.3. Samples: 46894568. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:18:24,272][367454] Avg episode reward: [(0, '2148.476')] [2023-03-08 09:18:26,391][367737] Updated weights for policy 0, policy_version 91680 (0.0004) [2023-03-08 09:18:29,134][367737] Updated weights for policy 0, policy_version 91760 (0.0004) [2023-03-08 09:18:29,271][367454] Fps is (10 sec: 15155.3, 60 sec: 14131.2, 300 sec: 13801.4). Total num frames: 46981120. Throughput: 0: 14223.8. Samples: 46940224. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:18:29,272][367454] Avg episode reward: [(0, '2009.728')] [2023-03-08 09:18:31,779][367737] Updated weights for policy 0, policy_version 91840 (0.0004) [2023-03-08 09:18:34,271][367454] Fps is (10 sec: 15155.2, 60 sec: 14267.8, 300 sec: 13829.2). Total num frames: 47054848. Throughput: 0: 14447.3. Samples: 47030384. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:18:34,272][367454] Avg episode reward: [(0, '2149.613')] [2023-03-08 09:18:34,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000091904_47054848.pth... [2023-03-08 09:18:34,276][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000091040_46612480.pth [2023-03-08 09:18:34,578][367737] Updated weights for policy 0, policy_version 91920 (0.0005) [2023-03-08 09:18:37,278][367737] Updated weights for policy 0, policy_version 92000 (0.0004) [2023-03-08 09:18:39,272][367454] Fps is (10 sec: 15155.1, 60 sec: 14404.2, 300 sec: 13857.0). Total num frames: 47132672. Throughput: 0: 14613.5. Samples: 47120380. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:18:39,272][367454] Avg episode reward: [(0, '2008.867')] [2023-03-08 09:18:40,025][367737] Updated weights for policy 0, policy_version 92080 (0.0004) [2023-03-08 09:18:42,809][367737] Updated weights for policy 0, policy_version 92160 (0.0004) [2023-03-08 09:18:44,271][367454] Fps is (10 sec: 15155.2, 60 sec: 14472.5, 300 sec: 13870.9). Total num frames: 47206400. Throughput: 0: 14741.9. Samples: 47165440. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:18:44,272][367454] Avg episode reward: [(0, '1906.692')] [2023-03-08 09:18:45,603][367737] Updated weights for policy 0, policy_version 92240 (0.0004) [2023-03-08 09:18:48,724][367737] Updated weights for policy 0, policy_version 92320 (0.0005) [2023-03-08 09:18:49,272][367454] Fps is (10 sec: 13926.4, 60 sec: 14472.5, 300 sec: 13870.9). Total num frames: 47271936. Throughput: 0: 14812.3. Samples: 47251464. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:18:49,272][367454] Avg episode reward: [(0, '1981.972')] [2023-03-08 09:18:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000092328_47271936.pth... [2023-03-08 09:18:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000091464_46829568.pth [2023-03-08 09:18:51,900][367737] Updated weights for policy 0, policy_version 92400 (0.0005) [2023-03-08 09:18:54,271][367454] Fps is (10 sec: 13107.2, 60 sec: 14404.3, 300 sec: 13870.9). Total num frames: 47337472. Throughput: 0: 14584.9. Samples: 47329288. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:18:54,272][367454] Avg episode reward: [(0, '1989.579')] [2023-03-08 09:18:54,968][367737] Updated weights for policy 0, policy_version 92480 (0.0005) [2023-03-08 09:18:58,028][367737] Updated weights for policy 0, policy_version 92560 (0.0005) [2023-03-08 09:18:59,272][367454] Fps is (10 sec: 13516.7, 60 sec: 14472.5, 300 sec: 13884.7). Total num frames: 47407104. Throughput: 0: 14544.4. Samples: 47369380. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:18:59,272][367454] Avg episode reward: [(0, '1891.550')] [2023-03-08 09:19:01,006][367737] Updated weights for policy 0, policy_version 92640 (0.0005) [2023-03-08 09:19:03,637][367737] Updated weights for policy 0, policy_version 92720 (0.0004) [2023-03-08 09:19:04,272][367454] Fps is (10 sec: 14335.9, 60 sec: 14472.5, 300 sec: 13912.5). Total num frames: 47480832. Throughput: 0: 14471.8. Samples: 47452680. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:19:04,272][367454] Avg episode reward: [(0, '1925.946')] [2023-03-08 09:19:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000092736_47480832.pth... [2023-03-08 09:19:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000091904_47054848.pth [2023-03-08 09:19:06,379][367737] Updated weights for policy 0, policy_version 92800 (0.0003) [2023-03-08 09:19:09,084][367737] Updated weights for policy 0, policy_version 92880 (0.0003) [2023-03-08 09:19:09,272][367454] Fps is (10 sec: 14745.7, 60 sec: 14540.8, 300 sec: 13940.3). Total num frames: 47554560. Throughput: 0: 14428.1. Samples: 47543832. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:19:09,272][367454] Avg episode reward: [(0, '2009.325')] [2023-03-08 09:19:11,799][367737] Updated weights for policy 0, policy_version 92960 (0.0004) [2023-03-08 09:19:14,272][367454] Fps is (10 sec: 15155.3, 60 sec: 14677.3, 300 sec: 13968.1). Total num frames: 47632384. Throughput: 0: 14423.3. Samples: 47589272. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:19:14,272][367454] Avg episode reward: [(0, '2121.327')] [2023-03-08 09:19:14,545][367737] Updated weights for policy 0, policy_version 93040 (0.0005) [2023-03-08 09:19:17,256][367737] Updated weights for policy 0, policy_version 93120 (0.0003) [2023-03-08 09:19:19,272][367454] Fps is (10 sec: 15155.1, 60 sec: 14609.1, 300 sec: 13981.9). Total num frames: 47706112. Throughput: 0: 14426.6. Samples: 47679584. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:19:19,272][367454] Avg episode reward: [(0, '2085.936')] [2023-03-08 09:19:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000093176_47706112.pth... [2023-03-08 09:19:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000092328_47271936.pth [2023-03-08 09:19:19,895][367737] Updated weights for policy 0, policy_version 93200 (0.0003) [2023-03-08 09:19:22,544][367737] Updated weights for policy 0, policy_version 93280 (0.0003) [2023-03-08 09:19:24,271][367454] Fps is (10 sec: 15155.3, 60 sec: 14677.3, 300 sec: 14023.6). Total num frames: 47783936. Throughput: 0: 14499.3. Samples: 47772848. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:19:24,272][367454] Avg episode reward: [(0, '2068.538')] [2023-03-08 09:19:25,095][367737] Updated weights for policy 0, policy_version 93360 (0.0003) [2023-03-08 09:19:27,716][367737] Updated weights for policy 0, policy_version 93440 (0.0003) [2023-03-08 09:19:29,271][367454] Fps is (10 sec: 15564.9, 60 sec: 14677.3, 300 sec: 14051.4). Total num frames: 47861760. Throughput: 0: 14565.0. Samples: 47820864. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:19:29,272][367454] Avg episode reward: [(0, '2058.859')] [2023-03-08 09:19:30,316][367737] Updated weights for policy 0, policy_version 93520 (0.0004) [2023-03-08 09:19:33,000][367737] Updated weights for policy 0, policy_version 93600 (0.0004) [2023-03-08 09:19:34,272][367454] Fps is (10 sec: 15564.7, 60 sec: 14745.6, 300 sec: 14093.0). Total num frames: 47939584. Throughput: 0: 14720.8. Samples: 47913900. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:19:34,272][367454] Avg episode reward: [(0, '2081.341')] [2023-03-08 09:19:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000093632_47939584.pth... [2023-03-08 09:19:34,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000092736_47480832.pth [2023-03-08 09:19:35,693][367737] Updated weights for policy 0, policy_version 93680 (0.0004) [2023-03-08 09:19:38,299][367737] Updated weights for policy 0, policy_version 93760 (0.0004) [2023-03-08 09:19:39,272][367454] Fps is (10 sec: 15564.8, 60 sec: 14745.6, 300 sec: 14120.8). Total num frames: 48017408. Throughput: 0: 15046.6. Samples: 48006384. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:19:39,272][367454] Avg episode reward: [(0, '2098.952')] [2023-03-08 09:19:40,958][367737] Updated weights for policy 0, policy_version 93840 (0.0004) [2023-03-08 09:19:43,641][367737] Updated weights for policy 0, policy_version 93920 (0.0004) [2023-03-08 09:19:44,271][367454] Fps is (10 sec: 15564.9, 60 sec: 14813.9, 300 sec: 14148.6). Total num frames: 48095232. Throughput: 0: 15181.5. Samples: 48052544. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:19:44,272][367454] Avg episode reward: [(0, '2022.907')] [2023-03-08 09:19:46,247][367737] Updated weights for policy 0, policy_version 94000 (0.0004) [2023-03-08 09:19:48,906][367737] Updated weights for policy 0, policy_version 94080 (0.0004) [2023-03-08 09:19:49,272][367454] Fps is (10 sec: 15564.7, 60 sec: 15018.7, 300 sec: 14190.2). Total num frames: 48173056. Throughput: 0: 15391.7. Samples: 48145308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:19:49,272][367454] Avg episode reward: [(0, '2174.413')] [2023-03-08 09:19:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000094088_48173056.pth... [2023-03-08 09:19:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000093176_47706112.pth [2023-03-08 09:19:51,510][367737] Updated weights for policy 0, policy_version 94160 (0.0004) [2023-03-08 09:19:54,159][367737] Updated weights for policy 0, policy_version 94240 (0.0004) [2023-03-08 09:19:54,272][367454] Fps is (10 sec: 15564.8, 60 sec: 15223.5, 300 sec: 14218.0). Total num frames: 48250880. Throughput: 0: 15440.7. Samples: 48238664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:19:54,272][367454] Avg episode reward: [(0, '2436.946')] [2023-03-08 09:19:56,881][367737] Updated weights for policy 0, policy_version 94320 (0.0004) [2023-03-08 09:19:59,271][367454] Fps is (10 sec: 15155.4, 60 sec: 15291.8, 300 sec: 14231.9). Total num frames: 48324608. Throughput: 0: 15437.4. Samples: 48283956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:19:59,272][367454] Avg episode reward: [(0, '2457.393')] [2023-03-08 09:19:59,593][367737] Updated weights for policy 0, policy_version 94400 (0.0004) [2023-03-08 09:20:02,239][367737] Updated weights for policy 0, policy_version 94480 (0.0004) [2023-03-08 09:20:04,272][367454] Fps is (10 sec: 15155.2, 60 sec: 15360.0, 300 sec: 14259.6). Total num frames: 48402432. Throughput: 0: 15475.6. Samples: 48375984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:20:04,272][367454] Avg episode reward: [(0, '2411.080')] [2023-03-08 09:20:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000094536_48402432.pth... [2023-03-08 09:20:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000093632_47939584.pth [2023-03-08 09:20:04,969][367737] Updated weights for policy 0, policy_version 94560 (0.0004) [2023-03-08 09:20:07,648][367737] Updated weights for policy 0, policy_version 94640 (0.0004) [2023-03-08 09:20:09,272][367454] Fps is (10 sec: 15564.7, 60 sec: 15428.3, 300 sec: 14287.4). Total num frames: 48480256. Throughput: 0: 15441.9. Samples: 48467736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:20:09,272][367454] Avg episode reward: [(0, '2459.948')] [2023-03-08 09:20:10,333][367737] Updated weights for policy 0, policy_version 94720 (0.0004) [2023-03-08 09:20:13,020][367737] Updated weights for policy 0, policy_version 94800 (0.0004) [2023-03-08 09:20:14,272][367454] Fps is (10 sec: 15155.3, 60 sec: 15360.0, 300 sec: 14301.3). Total num frames: 48553984. Throughput: 0: 15375.3. Samples: 48512752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:20:14,272][367454] Avg episode reward: [(0, '2564.641')] [2023-03-08 09:20:15,777][367737] Updated weights for policy 0, policy_version 94880 (0.0005) [2023-03-08 09:20:18,592][367737] Updated weights for policy 0, policy_version 94960 (0.0005) [2023-03-08 09:20:19,272][367454] Fps is (10 sec: 14745.6, 60 sec: 15360.0, 300 sec: 14273.5). Total num frames: 48627712. Throughput: 0: 15308.9. Samples: 48602800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:20:19,272][367454] Avg episode reward: [(0, '2694.511')] [2023-03-08 09:20:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000094976_48627712.pth... [2023-03-08 09:20:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000094088_48173056.pth [2023-03-08 09:20:21,359][367737] Updated weights for policy 0, policy_version 95040 (0.0005) [2023-03-08 09:20:24,167][367737] Updated weights for policy 0, policy_version 95120 (0.0005) [2023-03-08 09:20:24,272][367454] Fps is (10 sec: 14745.6, 60 sec: 15291.7, 300 sec: 14273.5). Total num frames: 48701440. Throughput: 0: 15174.3. Samples: 48689228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:20:24,272][367454] Avg episode reward: [(0, '2580.679')] [2023-03-08 09:20:26,882][367737] Updated weights for policy 0, policy_version 95200 (0.0004) [2023-03-08 09:20:29,272][367454] Fps is (10 sec: 14745.7, 60 sec: 15223.5, 300 sec: 14287.4). Total num frames: 48775168. Throughput: 0: 15157.2. Samples: 48734620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:20:29,272][367454] Avg episode reward: [(0, '2513.727')] [2023-03-08 09:20:29,708][367737] Updated weights for policy 0, policy_version 95280 (0.0005) [2023-03-08 09:20:32,428][367737] Updated weights for policy 0, policy_version 95360 (0.0004) [2023-03-08 09:20:34,272][367454] Fps is (10 sec: 14745.6, 60 sec: 15155.2, 300 sec: 14315.2). Total num frames: 48848896. Throughput: 0: 15088.0. Samples: 48824268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:20:34,272][367454] Avg episode reward: [(0, '2530.299')] [2023-03-08 09:20:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000095408_48848896.pth... [2023-03-08 09:20:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000094536_48402432.pth [2023-03-08 09:20:35,222][367737] Updated weights for policy 0, policy_version 95440 (0.0005) [2023-03-08 09:20:38,012][367737] Updated weights for policy 0, policy_version 95520 (0.0004) [2023-03-08 09:20:39,272][367454] Fps is (10 sec: 14745.6, 60 sec: 15086.9, 300 sec: 14329.1). Total num frames: 48922624. Throughput: 0: 14957.5. Samples: 48911752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:20:39,272][367454] Avg episode reward: [(0, '2752.531')] [2023-03-08 09:20:40,820][367737] Updated weights for policy 0, policy_version 95600 (0.0004) [2023-03-08 09:20:43,879][367737] Updated weights for policy 0, policy_version 95680 (0.0005) [2023-03-08 09:20:44,272][367454] Fps is (10 sec: 14336.0, 60 sec: 14950.4, 300 sec: 14329.1). Total num frames: 48992256. Throughput: 0: 14922.4. Samples: 48955464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:20:44,272][367454] Avg episode reward: [(0, '2988.375')] [2023-03-08 09:20:46,843][367737] Updated weights for policy 0, policy_version 95760 (0.0005) [2023-03-08 09:20:49,272][367454] Fps is (10 sec: 13516.7, 60 sec: 14745.6, 300 sec: 14315.2). Total num frames: 49057792. Throughput: 0: 14677.1. Samples: 49036456. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:20:49,272][367454] Avg episode reward: [(0, '2878.067')] [2023-03-08 09:20:49,338][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000095824_49061888.pth... [2023-03-08 09:20:49,339][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000094976_48627712.pth [2023-03-08 09:20:49,995][367737] Updated weights for policy 0, policy_version 95840 (0.0005) [2023-03-08 09:20:53,163][367737] Updated weights for policy 0, policy_version 95920 (0.0005) [2023-03-08 09:20:54,272][367454] Fps is (10 sec: 13107.2, 60 sec: 14540.8, 300 sec: 14315.2). Total num frames: 49123328. Throughput: 0: 14372.6. Samples: 49114504. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:20:54,272][367454] Avg episode reward: [(0, '2804.151')] [2023-03-08 09:20:56,224][367737] Updated weights for policy 0, policy_version 96000 (0.0005) [2023-03-08 09:20:59,272][367454] Fps is (10 sec: 13107.3, 60 sec: 14404.3, 300 sec: 14315.2). Total num frames: 49188864. Throughput: 0: 14263.5. Samples: 49154608. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:20:59,282][367454] Avg episode reward: [(0, '2632.250')] [2023-03-08 09:20:59,375][367737] Updated weights for policy 0, policy_version 96080 (0.0006) [2023-03-08 09:21:02,334][367737] Updated weights for policy 0, policy_version 96160 (0.0005) [2023-03-08 09:21:04,272][367454] Fps is (10 sec: 13926.3, 60 sec: 14336.0, 300 sec: 14329.1). Total num frames: 49262592. Throughput: 0: 14035.4. Samples: 49234392. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:21:04,283][367454] Avg episode reward: [(0, '2831.876')] [2023-03-08 09:21:04,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000096216_49262592.pth... [2023-03-08 09:21:04,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000095408_48848896.pth [2023-03-08 09:21:05,156][367737] Updated weights for policy 0, policy_version 96240 (0.0005) [2023-03-08 09:21:08,253][367737] Updated weights for policy 0, policy_version 96320 (0.0005) [2023-03-08 09:21:09,272][367454] Fps is (10 sec: 13926.4, 60 sec: 14131.2, 300 sec: 14315.2). Total num frames: 49328128. Throughput: 0: 13966.2. Samples: 49317708. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:21:09,282][367454] Avg episode reward: [(0, '2696.571')] [2023-03-08 09:21:11,384][367737] Updated weights for policy 0, policy_version 96400 (0.0006) [2023-03-08 09:21:14,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13994.7, 300 sec: 14301.3). Total num frames: 49393664. Throughput: 0: 13827.6. Samples: 49356864. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:21:14,283][367454] Avg episode reward: [(0, '2657.006')] [2023-03-08 09:21:14,492][367737] Updated weights for policy 0, policy_version 96480 (0.0005) [2023-03-08 09:21:17,335][367737] Updated weights for policy 0, policy_version 96560 (0.0004) [2023-03-08 09:21:19,272][367454] Fps is (10 sec: 13926.3, 60 sec: 13994.7, 300 sec: 14315.2). Total num frames: 49467392. Throughput: 0: 13665.0. Samples: 49439192. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:21:19,283][367454] Avg episode reward: [(0, '2558.266')] [2023-03-08 09:21:19,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000096616_49467392.pth... [2023-03-08 09:21:19,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000095824_49061888.pth [2023-03-08 09:21:20,032][367737] Updated weights for policy 0, policy_version 96640 (0.0004) [2023-03-08 09:21:22,800][367737] Updated weights for policy 0, policy_version 96720 (0.0004) [2023-03-08 09:21:24,272][367454] Fps is (10 sec: 14745.6, 60 sec: 13994.7, 300 sec: 14342.9). Total num frames: 49541120. Throughput: 0: 13714.5. Samples: 49528904. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:21:24,282][367454] Avg episode reward: [(0, '2520.220')] [2023-03-08 09:21:25,600][367737] Updated weights for policy 0, policy_version 96800 (0.0004) [2023-03-08 09:21:28,499][367737] Updated weights for policy 0, policy_version 96880 (0.0004) [2023-03-08 09:21:29,272][367454] Fps is (10 sec: 14336.1, 60 sec: 13926.4, 300 sec: 14342.9). Total num frames: 49610752. Throughput: 0: 13735.9. Samples: 49573580. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:21:29,283][367454] Avg episode reward: [(0, '2627.660')] [2023-03-08 09:21:31,639][367737] Updated weights for policy 0, policy_version 96960 (0.0006) [2023-03-08 09:21:34,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 14342.9). Total num frames: 49680384. Throughput: 0: 13743.8. Samples: 49654928. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:21:34,282][367454] Avg episode reward: [(0, '2650.219')] [2023-03-08 09:21:34,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000097032_49680384.pth... [2023-03-08 09:21:34,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000096216_49262592.pth [2023-03-08 09:21:34,379][367737] Updated weights for policy 0, policy_version 97040 (0.0004) [2023-03-08 09:21:37,372][367737] Updated weights for policy 0, policy_version 97120 (0.0005) [2023-03-08 09:21:39,271][367454] Fps is (10 sec: 13926.4, 60 sec: 13789.9, 300 sec: 14356.8). Total num frames: 49750016. Throughput: 0: 13853.3. Samples: 49737904. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:21:39,282][367454] Avg episode reward: [(0, '2767.654')] [2023-03-08 09:21:40,544][367737] Updated weights for policy 0, policy_version 97200 (0.0005) [2023-03-08 09:21:43,662][367737] Updated weights for policy 0, policy_version 97280 (0.0005) [2023-03-08 09:21:44,271][367454] Fps is (10 sec: 13107.3, 60 sec: 13653.3, 300 sec: 14329.1). Total num frames: 49811456. Throughput: 0: 13862.9. Samples: 49778436. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:21:44,282][367454] Avg episode reward: [(0, '2720.308')] [2023-03-08 09:21:46,818][367737] Updated weights for policy 0, policy_version 97360 (0.0006) [2023-03-08 09:21:49,272][367454] Fps is (10 sec: 12697.6, 60 sec: 13653.3, 300 sec: 14315.2). Total num frames: 49876992. Throughput: 0: 13814.7. Samples: 49856052. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:21:49,272][367454] Avg episode reward: [(0, '2678.159')] [2023-03-08 09:21:49,330][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000097424_49881088.pth... [2023-03-08 09:21:49,332][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000096616_49467392.pth [2023-03-08 09:21:49,928][367737] Updated weights for policy 0, policy_version 97440 (0.0005) [2023-03-08 09:21:53,118][367737] Updated weights for policy 0, policy_version 97520 (0.0005) [2023-03-08 09:21:54,271][367454] Fps is (10 sec: 13107.2, 60 sec: 13653.3, 300 sec: 14301.3). Total num frames: 49942528. Throughput: 0: 13703.4. Samples: 49934360. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:21:54,272][367454] Avg episode reward: [(0, '2544.413')] [2023-03-08 09:21:56,314][367737] Updated weights for policy 0, policy_version 97600 (0.0005) [2023-03-08 09:21:59,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13653.3, 300 sec: 14301.3). Total num frames: 50008064. Throughput: 0: 13663.9. Samples: 49971740. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:21:59,272][367454] Avg episode reward: [(0, '2600.085')] [2023-03-08 09:21:59,562][367737] Updated weights for policy 0, policy_version 97680 (0.0006) [2023-03-08 09:22:02,698][367737] Updated weights for policy 0, policy_version 97760 (0.0005) [2023-03-08 09:22:04,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13516.8, 300 sec: 14287.4). Total num frames: 50073600. Throughput: 0: 13553.4. Samples: 50049096. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:22:04,272][367454] Avg episode reward: [(0, '2776.445')] [2023-03-08 09:22:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000097800_50073600.pth... [2023-03-08 09:22:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000097032_49680384.pth [2023-03-08 09:22:05,754][367737] Updated weights for policy 0, policy_version 97840 (0.0005) [2023-03-08 09:22:08,899][367737] Updated weights for policy 0, policy_version 97920 (0.0005) [2023-03-08 09:22:09,272][367454] Fps is (10 sec: 13107.3, 60 sec: 13516.8, 300 sec: 14273.5). Total num frames: 50139136. Throughput: 0: 13310.0. Samples: 50127852. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:22:09,272][367454] Avg episode reward: [(0, '2611.751')] [2023-03-08 09:22:11,991][367737] Updated weights for policy 0, policy_version 98000 (0.0005) [2023-03-08 09:22:14,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13516.8, 300 sec: 14273.5). Total num frames: 50204672. Throughput: 0: 13209.2. Samples: 50167996. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:22:14,272][367454] Avg episode reward: [(0, '2713.895')] [2023-03-08 09:22:15,220][367737] Updated weights for policy 0, policy_version 98080 (0.0006) [2023-03-08 09:22:18,298][367737] Updated weights for policy 0, policy_version 98160 (0.0005) [2023-03-08 09:22:19,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 14259.6). Total num frames: 50270208. Throughput: 0: 13135.5. Samples: 50246028. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:22:19,272][367454] Avg episode reward: [(0, '2799.467')] [2023-03-08 09:22:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000098184_50270208.pth... [2023-03-08 09:22:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000097424_49881088.pth [2023-03-08 09:22:21,498][367737] Updated weights for policy 0, policy_version 98240 (0.0005) [2023-03-08 09:22:24,272][367454] Fps is (10 sec: 12697.7, 60 sec: 13175.5, 300 sec: 14231.9). Total num frames: 50331648. Throughput: 0: 13013.9. Samples: 50323528. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:22:24,272][367454] Avg episode reward: [(0, '2796.525')] [2023-03-08 09:22:24,622][367737] Updated weights for policy 0, policy_version 98320 (0.0005) [2023-03-08 09:22:27,778][367737] Updated weights for policy 0, policy_version 98400 (0.0006) [2023-03-08 09:22:29,272][367454] Fps is (10 sec: 12697.7, 60 sec: 13107.2, 300 sec: 14231.9). Total num frames: 50397184. Throughput: 0: 13010.8. Samples: 50363924. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:22:29,272][367454] Avg episode reward: [(0, '2689.366')] [2023-03-08 09:22:31,015][367737] Updated weights for policy 0, policy_version 98480 (0.0005) [2023-03-08 09:22:34,015][367737] Updated weights for policy 0, policy_version 98560 (0.0005) [2023-03-08 09:22:34,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13038.9, 300 sec: 14218.0). Total num frames: 50462720. Throughput: 0: 12976.0. Samples: 50439972. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:22:34,272][367454] Avg episode reward: [(0, '2935.275')] [2023-03-08 09:22:34,301][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000098568_50466816.pth... [2023-03-08 09:22:34,302][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000097800_50073600.pth [2023-03-08 09:22:36,918][367737] Updated weights for policy 0, policy_version 98640 (0.0005) [2023-03-08 09:22:39,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13107.2, 300 sec: 14231.9). Total num frames: 50536448. Throughput: 0: 13115.8. Samples: 50524572. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:22:39,272][367454] Avg episode reward: [(0, '3092.994')] [2023-03-08 09:22:39,737][367737] Updated weights for policy 0, policy_version 98720 (0.0004) [2023-03-08 09:22:42,573][367737] Updated weights for policy 0, policy_version 98800 (0.0004) [2023-03-08 09:22:44,272][367454] Fps is (10 sec: 14745.6, 60 sec: 13312.0, 300 sec: 14259.6). Total num frames: 50610176. Throughput: 0: 13266.2. Samples: 50568716. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:22:44,272][367454] Avg episode reward: [(0, '3019.494')] [2023-03-08 09:22:45,285][367737] Updated weights for policy 0, policy_version 98880 (0.0004) [2023-03-08 09:22:48,111][367737] Updated weights for policy 0, policy_version 98960 (0.0005) [2023-03-08 09:22:49,272][367454] Fps is (10 sec: 14745.6, 60 sec: 13448.5, 300 sec: 14273.5). Total num frames: 50683904. Throughput: 0: 13503.6. Samples: 50656756. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:22:49,272][367454] Avg episode reward: [(0, '2718.141')] [2023-03-08 09:22:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000098992_50683904.pth... [2023-03-08 09:22:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000098184_50270208.pth [2023-03-08 09:22:50,876][367737] Updated weights for policy 0, policy_version 99040 (0.0004) [2023-03-08 09:22:53,853][367737] Updated weights for policy 0, policy_version 99120 (0.0005) [2023-03-08 09:22:54,271][367454] Fps is (10 sec: 14336.1, 60 sec: 13516.8, 300 sec: 14287.4). Total num frames: 50753536. Throughput: 0: 13682.1. Samples: 50743544. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:22:54,272][367454] Avg episode reward: [(0, '2824.735')] [2023-03-08 09:22:56,694][367737] Updated weights for policy 0, policy_version 99200 (0.0005) [2023-03-08 09:22:59,271][367454] Fps is (10 sec: 13926.5, 60 sec: 13585.1, 300 sec: 14273.5). Total num frames: 50823168. Throughput: 0: 13741.6. Samples: 50786368. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:22:59,272][367454] Avg episode reward: [(0, '2600.275')] [2023-03-08 09:22:59,658][367737] Updated weights for policy 0, policy_version 99280 (0.0005) [2023-03-08 09:23:02,459][367737] Updated weights for policy 0, policy_version 99360 (0.0005) [2023-03-08 09:23:04,272][367454] Fps is (10 sec: 14335.9, 60 sec: 13721.6, 300 sec: 14287.4). Total num frames: 50896896. Throughput: 0: 13906.7. Samples: 50871828. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:23:04,272][367454] Avg episode reward: [(0, '2670.945')] [2023-03-08 09:23:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000099408_50896896.pth... [2023-03-08 09:23:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000098568_50466816.pth [2023-03-08 09:23:05,277][367737] Updated weights for policy 0, policy_version 99440 (0.0004) [2023-03-08 09:23:08,090][367737] Updated weights for policy 0, policy_version 99520 (0.0004) [2023-03-08 09:23:09,272][367454] Fps is (10 sec: 14745.5, 60 sec: 13858.1, 300 sec: 14301.3). Total num frames: 50970624. Throughput: 0: 14108.8. Samples: 50958424. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:23:09,282][367454] Avg episode reward: [(0, '2411.853')] [2023-03-08 09:23:11,079][367737] Updated weights for policy 0, policy_version 99600 (0.0004) [2023-03-08 09:23:13,904][367737] Updated weights for policy 0, policy_version 99680 (0.0004) [2023-03-08 09:23:14,272][367454] Fps is (10 sec: 14336.1, 60 sec: 13926.4, 300 sec: 14273.5). Total num frames: 51040256. Throughput: 0: 14121.0. Samples: 50999368. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:23:14,272][367454] Avg episode reward: [(0, '2338.053')] [2023-03-08 09:23:16,669][367737] Updated weights for policy 0, policy_version 99760 (0.0004) [2023-03-08 09:23:19,272][367454] Fps is (10 sec: 14336.0, 60 sec: 14063.0, 300 sec: 14273.5). Total num frames: 51113984. Throughput: 0: 14393.1. Samples: 51087660. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:23:19,282][367454] Avg episode reward: [(0, '2365.060')] [2023-03-08 09:23:19,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000099832_51113984.pth... [2023-03-08 09:23:19,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000098992_50683904.pth [2023-03-08 09:23:19,396][367737] Updated weights for policy 0, policy_version 99840 (0.0004) [2023-03-08 09:23:22,276][367737] Updated weights for policy 0, policy_version 99920 (0.0004) [2023-03-08 09:23:24,272][367454] Fps is (10 sec: 14745.6, 60 sec: 14267.7, 300 sec: 14259.6). Total num frames: 51187712. Throughput: 0: 14465.0. Samples: 51175496. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:23:24,283][367454] Avg episode reward: [(0, '2675.490')] [2023-03-08 09:23:24,980][367737] Updated weights for policy 0, policy_version 100000 (0.0004) [2023-03-08 09:23:27,776][367737] Updated weights for policy 0, policy_version 100080 (0.0004) [2023-03-08 09:23:29,272][367454] Fps is (10 sec: 14745.6, 60 sec: 14404.3, 300 sec: 14259.6). Total num frames: 51261440. Throughput: 0: 14485.9. Samples: 51220584. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:23:29,272][367454] Avg episode reward: [(0, '2705.593')] [2023-03-08 09:23:30,583][367737] Updated weights for policy 0, policy_version 100160 (0.0004) [2023-03-08 09:23:33,418][367737] Updated weights for policy 0, policy_version 100240 (0.0004) [2023-03-08 09:23:34,272][367454] Fps is (10 sec: 14336.0, 60 sec: 14472.5, 300 sec: 14231.9). Total num frames: 51331072. Throughput: 0: 14480.8. Samples: 51308392. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:23:34,272][367454] Avg episode reward: [(0, '3048.288')] [2023-03-08 09:23:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000100256_51331072.pth... [2023-03-08 09:23:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000099408_50896896.pth [2023-03-08 09:23:36,596][367737] Updated weights for policy 0, policy_version 100320 (0.0005) [2023-03-08 09:23:39,272][367454] Fps is (10 sec: 13516.8, 60 sec: 14336.0, 300 sec: 14204.1). Total num frames: 51396608. Throughput: 0: 14320.3. Samples: 51387956. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:23:39,282][367454] Avg episode reward: [(0, '2739.006')] [2023-03-08 09:23:39,703][367737] Updated weights for policy 0, policy_version 100400 (0.0005) [2023-03-08 09:23:42,787][367737] Updated weights for policy 0, policy_version 100480 (0.0005) [2023-03-08 09:23:44,271][367454] Fps is (10 sec: 13107.3, 60 sec: 14199.5, 300 sec: 14204.1). Total num frames: 51462144. Throughput: 0: 14251.3. Samples: 51427676. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:23:44,281][367454] Avg episode reward: [(0, '2513.934')] [2023-03-08 09:23:45,963][367737] Updated weights for policy 0, policy_version 100560 (0.0005) [2023-03-08 09:23:49,118][367737] Updated weights for policy 0, policy_version 100640 (0.0005) [2023-03-08 09:23:49,272][367454] Fps is (10 sec: 13107.1, 60 sec: 14062.9, 300 sec: 14204.1). Total num frames: 51527680. Throughput: 0: 14067.4. Samples: 51504860. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:23:49,283][367454] Avg episode reward: [(0, '2605.095')] [2023-03-08 09:23:49,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000100640_51527680.pth... [2023-03-08 09:23:49,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000099832_51113984.pth [2023-03-08 09:23:52,204][367737] Updated weights for policy 0, policy_version 100720 (0.0005) [2023-03-08 09:23:54,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13994.7, 300 sec: 14190.2). Total num frames: 51593216. Throughput: 0: 13925.9. Samples: 51585088. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:23:54,283][367454] Avg episode reward: [(0, '2842.775')] [2023-03-08 09:23:55,256][367737] Updated weights for policy 0, policy_version 100800 (0.0005) [2023-03-08 09:23:58,361][367737] Updated weights for policy 0, policy_version 100880 (0.0005) [2023-03-08 09:23:59,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13926.4, 300 sec: 14162.4). Total num frames: 51658752. Throughput: 0: 13898.8. Samples: 51624812. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:23:59,282][367454] Avg episode reward: [(0, '2874.086')] [2023-03-08 09:24:01,586][367737] Updated weights for policy 0, policy_version 100960 (0.0005) [2023-03-08 09:24:04,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13789.9, 300 sec: 14134.7). Total num frames: 51724288. Throughput: 0: 13670.6. Samples: 51702836. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:24:04,283][367454] Avg episode reward: [(0, '3113.546')] [2023-03-08 09:24:04,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000101024_51724288.pth... [2023-03-08 09:24:04,287][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000100256_51331072.pth [2023-03-08 09:24:04,668][367737] Updated weights for policy 0, policy_version 101040 (0.0005) [2023-03-08 09:24:07,948][367737] Updated weights for policy 0, policy_version 101120 (0.0005) [2023-03-08 09:24:09,271][367454] Fps is (10 sec: 13107.3, 60 sec: 13653.3, 300 sec: 14093.0). Total num frames: 51789824. Throughput: 0: 13419.7. Samples: 51779380. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:24:09,282][367454] Avg episode reward: [(0, '3153.918')] [2023-03-08 09:24:11,003][367737] Updated weights for policy 0, policy_version 101200 (0.0004) [2023-03-08 09:24:14,138][367737] Updated weights for policy 0, policy_version 101280 (0.0005) [2023-03-08 09:24:14,271][367454] Fps is (10 sec: 13107.3, 60 sec: 13585.1, 300 sec: 14065.2). Total num frames: 51855360. Throughput: 0: 13307.9. Samples: 51819440. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:24:14,272][367454] Avg episode reward: [(0, '3176.757')] [2023-03-08 09:24:17,313][367737] Updated weights for policy 0, policy_version 101360 (0.0005) [2023-03-08 09:24:19,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 14023.6). Total num frames: 51920896. Throughput: 0: 13082.0. Samples: 51897084. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:24:19,272][367454] Avg episode reward: [(0, '3034.503')] [2023-03-08 09:24:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000101408_51920896.pth... [2023-03-08 09:24:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000100640_51527680.pth [2023-03-08 09:24:20,490][367737] Updated weights for policy 0, policy_version 101440 (0.0005) [2023-03-08 09:24:23,628][367737] Updated weights for policy 0, policy_version 101520 (0.0004) [2023-03-08 09:24:24,271][367454] Fps is (10 sec: 13107.2, 60 sec: 13312.0, 300 sec: 13981.9). Total num frames: 51986432. Throughput: 0: 13040.6. Samples: 51974784. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:24:24,272][367454] Avg episode reward: [(0, '2818.809')] [2023-03-08 09:24:26,899][367737] Updated weights for policy 0, policy_version 101600 (0.0005) [2023-03-08 09:24:29,271][367454] Fps is (10 sec: 12697.7, 60 sec: 13107.2, 300 sec: 13926.4). Total num frames: 52047872. Throughput: 0: 12991.8. Samples: 52012308. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:24:29,272][367454] Avg episode reward: [(0, '3126.580')] [2023-03-08 09:24:29,998][367737] Updated weights for policy 0, policy_version 101680 (0.0005) [2023-03-08 09:24:33,160][367737] Updated weights for policy 0, policy_version 101760 (0.0005) [2023-03-08 09:24:34,272][367454] Fps is (10 sec: 12697.6, 60 sec: 13038.9, 300 sec: 13884.7). Total num frames: 52113408. Throughput: 0: 13043.8. Samples: 52091832. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:24:34,272][367454] Avg episode reward: [(0, '3113.667')] [2023-03-08 09:24:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000101784_52113408.pth... [2023-03-08 09:24:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000101024_51724288.pth [2023-03-08 09:24:36,406][367737] Updated weights for policy 0, policy_version 101840 (0.0005) [2023-03-08 09:24:39,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13038.9, 300 sec: 13843.1). Total num frames: 52178944. Throughput: 0: 12941.9. Samples: 52167476. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:24:39,272][367454] Avg episode reward: [(0, '3016.883')] [2023-03-08 09:24:39,541][367737] Updated weights for policy 0, policy_version 101920 (0.0005) [2023-03-08 09:24:42,670][367737] Updated weights for policy 0, policy_version 102000 (0.0005) [2023-03-08 09:24:44,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13038.9, 300 sec: 13801.4). Total num frames: 52244480. Throughput: 0: 12951.4. Samples: 52207624. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:24:44,272][367454] Avg episode reward: [(0, '3167.830')] [2023-03-08 09:24:45,756][367737] Updated weights for policy 0, policy_version 102080 (0.0004) [2023-03-08 09:24:48,834][367737] Updated weights for policy 0, policy_version 102160 (0.0004) [2023-03-08 09:24:49,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13038.9, 300 sec: 13759.8). Total num frames: 52310016. Throughput: 0: 12997.7. Samples: 52287732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:24:49,272][367454] Avg episode reward: [(0, '3088.189')] [2023-03-08 09:24:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000102168_52310016.pth... [2023-03-08 09:24:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000101408_51920896.pth [2023-03-08 09:24:52,048][367737] Updated weights for policy 0, policy_version 102240 (0.0004) [2023-03-08 09:24:54,271][367454] Fps is (10 sec: 13107.3, 60 sec: 13038.9, 300 sec: 13732.0). Total num frames: 52375552. Throughput: 0: 13009.2. Samples: 52364796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:24:54,272][367454] Avg episode reward: [(0, '3104.105')] [2023-03-08 09:24:55,158][367737] Updated weights for policy 0, policy_version 102320 (0.0004) [2023-03-08 09:24:58,347][367737] Updated weights for policy 0, policy_version 102400 (0.0005) [2023-03-08 09:24:59,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13038.9, 300 sec: 13690.4). Total num frames: 52441088. Throughput: 0: 12995.2. Samples: 52404224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:24:59,272][367454] Avg episode reward: [(0, '2711.332')] [2023-03-08 09:25:01,378][367737] Updated weights for policy 0, policy_version 102480 (0.0005) [2023-03-08 09:25:04,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13038.9, 300 sec: 13648.7). Total num frames: 52506624. Throughput: 0: 13026.2. Samples: 52483260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:25:04,272][367454] Avg episode reward: [(0, '2587.892')] [2023-03-08 09:25:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000102552_52506624.pth... [2023-03-08 09:25:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000101784_52113408.pth [2023-03-08 09:25:04,483][367737] Updated weights for policy 0, policy_version 102560 (0.0005) [2023-03-08 09:25:07,694][367737] Updated weights for policy 0, policy_version 102640 (0.0005) [2023-03-08 09:25:09,271][367454] Fps is (10 sec: 12697.7, 60 sec: 12970.7, 300 sec: 13607.1). Total num frames: 52568064. Throughput: 0: 13023.8. Samples: 52560852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:25:09,272][367454] Avg episode reward: [(0, '2820.151')] [2023-03-08 09:25:10,867][367737] Updated weights for policy 0, policy_version 102720 (0.0005) [2023-03-08 09:25:14,092][367737] Updated weights for policy 0, policy_version 102800 (0.0005) [2023-03-08 09:25:14,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12970.7, 300 sec: 13579.3). Total num frames: 52633600. Throughput: 0: 13050.6. Samples: 52599584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:25:14,272][367454] Avg episode reward: [(0, '2880.134')] [2023-03-08 09:25:17,266][367737] Updated weights for policy 0, policy_version 102880 (0.0005) [2023-03-08 09:25:19,272][367454] Fps is (10 sec: 13107.1, 60 sec: 12970.7, 300 sec: 13551.5). Total num frames: 52699136. Throughput: 0: 12982.9. Samples: 52676064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:25:19,272][367454] Avg episode reward: [(0, '2776.636')] [2023-03-08 09:25:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000102928_52699136.pth... [2023-03-08 09:25:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000102168_52310016.pth [2023-03-08 09:25:20,278][367737] Updated weights for policy 0, policy_version 102960 (0.0004) [2023-03-08 09:25:23,356][367737] Updated weights for policy 0, policy_version 103040 (0.0005) [2023-03-08 09:25:24,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13038.9, 300 sec: 13537.6). Total num frames: 52768768. Throughput: 0: 13090.9. Samples: 52756564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:25:24,272][367454] Avg episode reward: [(0, '2724.333')] [2023-03-08 09:25:26,506][367737] Updated weights for policy 0, policy_version 103120 (0.0005) [2023-03-08 09:25:29,271][367454] Fps is (10 sec: 13107.3, 60 sec: 13038.9, 300 sec: 13496.0). Total num frames: 52830208. Throughput: 0: 13078.2. Samples: 52796140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:25:29,272][367454] Avg episode reward: [(0, '2991.268')] [2023-03-08 09:25:29,691][367737] Updated weights for policy 0, policy_version 103200 (0.0005) [2023-03-08 09:25:32,907][367737] Updated weights for policy 0, policy_version 103280 (0.0005) [2023-03-08 09:25:34,272][367454] Fps is (10 sec: 12697.5, 60 sec: 13038.9, 300 sec: 13468.2). Total num frames: 52895744. Throughput: 0: 12994.7. Samples: 52872496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:25:34,272][367454] Avg episode reward: [(0, '2923.582')] [2023-03-08 09:25:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000103312_52895744.pth... [2023-03-08 09:25:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000102552_52506624.pth [2023-03-08 09:25:36,060][367737] Updated weights for policy 0, policy_version 103360 (0.0005) [2023-03-08 09:25:39,271][367454] Fps is (10 sec: 12697.7, 60 sec: 12970.7, 300 sec: 13440.4). Total num frames: 52957184. Throughput: 0: 12992.4. Samples: 52949452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:25:39,272][367454] Avg episode reward: [(0, '2982.759')] [2023-03-08 09:25:39,307][367737] Updated weights for policy 0, policy_version 103440 (0.0005) [2023-03-08 09:25:42,548][367737] Updated weights for policy 0, policy_version 103520 (0.0005) [2023-03-08 09:25:44,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12970.7, 300 sec: 13440.4). Total num frames: 53022720. Throughput: 0: 12971.0. Samples: 52987920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:25:44,272][367454] Avg episode reward: [(0, '2742.538')] [2023-03-08 09:25:45,710][367737] Updated weights for policy 0, policy_version 103600 (0.0004) [2023-03-08 09:25:48,874][367737] Updated weights for policy 0, policy_version 103680 (0.0004) [2023-03-08 09:25:49,272][367454] Fps is (10 sec: 13107.1, 60 sec: 12970.7, 300 sec: 13440.4). Total num frames: 53088256. Throughput: 0: 12946.2. Samples: 53065840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:25:49,272][367454] Avg episode reward: [(0, '2658.312')] [2023-03-08 09:25:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000103688_53088256.pth... [2023-03-08 09:25:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000102928_52699136.pth [2023-03-08 09:25:52,082][367737] Updated weights for policy 0, policy_version 103760 (0.0004) [2023-03-08 09:25:54,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12902.4, 300 sec: 13426.5). Total num frames: 53149696. Throughput: 0: 12904.8. Samples: 53141568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:25:54,272][367454] Avg episode reward: [(0, '2805.122')] [2023-03-08 09:25:55,255][367737] Updated weights for policy 0, policy_version 103840 (0.0005) [2023-03-08 09:25:58,406][367737] Updated weights for policy 0, policy_version 103920 (0.0005) [2023-03-08 09:25:59,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12902.4, 300 sec: 13398.8). Total num frames: 53215232. Throughput: 0: 12911.7. Samples: 53180612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:25:59,272][367454] Avg episode reward: [(0, '2902.552')] [2023-03-08 09:26:01,602][367737] Updated weights for policy 0, policy_version 104000 (0.0005) [2023-03-08 09:26:04,272][367454] Fps is (10 sec: 13107.1, 60 sec: 12902.4, 300 sec: 13398.8). Total num frames: 53280768. Throughput: 0: 12937.3. Samples: 53258244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:26:04,272][367454] Avg episode reward: [(0, '3030.463')] [2023-03-08 09:26:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000104064_53280768.pth... [2023-03-08 09:26:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000103312_52895744.pth [2023-03-08 09:26:04,795][367737] Updated weights for policy 0, policy_version 104080 (0.0004) [2023-03-08 09:26:07,959][367737] Updated weights for policy 0, policy_version 104160 (0.0005) [2023-03-08 09:26:09,271][367454] Fps is (10 sec: 13107.3, 60 sec: 12970.7, 300 sec: 13398.8). Total num frames: 53346304. Throughput: 0: 12872.6. Samples: 53335832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:26:09,272][367454] Avg episode reward: [(0, '2899.451')] [2023-03-08 09:26:11,011][367737] Updated weights for policy 0, policy_version 104240 (0.0004) [2023-03-08 09:26:14,156][367737] Updated weights for policy 0, policy_version 104320 (0.0005) [2023-03-08 09:26:14,272][367454] Fps is (10 sec: 13107.3, 60 sec: 12970.7, 300 sec: 13371.0). Total num frames: 53411840. Throughput: 0: 12883.1. Samples: 53375880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:26:14,272][367454] Avg episode reward: [(0, '2855.659')] [2023-03-08 09:26:17,331][367737] Updated weights for policy 0, policy_version 104400 (0.0005) [2023-03-08 09:26:19,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12902.4, 300 sec: 13329.4). Total num frames: 53473280. Throughput: 0: 12907.4. Samples: 53453328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:26:19,272][367454] Avg episode reward: [(0, '3023.951')] [2023-03-08 09:26:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000104448_53477376.pth... [2023-03-08 09:26:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000103688_53088256.pth [2023-03-08 09:26:20,563][367737] Updated weights for policy 0, policy_version 104480 (0.0005) [2023-03-08 09:26:23,687][367737] Updated weights for policy 0, policy_version 104560 (0.0005) [2023-03-08 09:26:24,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12834.1, 300 sec: 13315.5). Total num frames: 53538816. Throughput: 0: 12916.3. Samples: 53530688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:26:24,272][367454] Avg episode reward: [(0, '2841.776')] [2023-03-08 09:26:26,810][367737] Updated weights for policy 0, policy_version 104640 (0.0005) [2023-03-08 09:26:29,271][367454] Fps is (10 sec: 13107.4, 60 sec: 12902.4, 300 sec: 13301.6). Total num frames: 53604352. Throughput: 0: 12957.6. Samples: 53571012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:26:29,272][367454] Avg episode reward: [(0, '3117.478')] [2023-03-08 09:26:29,967][367737] Updated weights for policy 0, policy_version 104720 (0.0005) [2023-03-08 09:26:32,935][367737] Updated weights for policy 0, policy_version 104800 (0.0005) [2023-03-08 09:26:34,271][367454] Fps is (10 sec: 13516.8, 60 sec: 12970.7, 300 sec: 13301.6). Total num frames: 53673984. Throughput: 0: 12978.9. Samples: 53649892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:26:34,272][367454] Avg episode reward: [(0, '2898.698')] [2023-03-08 09:26:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000104832_53673984.pth... [2023-03-08 09:26:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000104064_53280768.pth [2023-03-08 09:26:35,999][367737] Updated weights for policy 0, policy_version 104880 (0.0005) [2023-03-08 09:26:39,099][367737] Updated weights for policy 0, policy_version 104960 (0.0005) [2023-03-08 09:26:39,271][367454] Fps is (10 sec: 13516.7, 60 sec: 13038.9, 300 sec: 13315.5). Total num frames: 53739520. Throughput: 0: 13079.8. Samples: 53730160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:26:39,272][367454] Avg episode reward: [(0, '2861.574')] [2023-03-08 09:26:42,348][367737] Updated weights for policy 0, policy_version 105040 (0.0004) [2023-03-08 09:26:44,271][367454] Fps is (10 sec: 13107.3, 60 sec: 13039.0, 300 sec: 13315.5). Total num frames: 53805056. Throughput: 0: 13064.0. Samples: 53768492. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:26:44,272][367454] Avg episode reward: [(0, '2698.617')] [2023-03-08 09:26:45,546][367737] Updated weights for policy 0, policy_version 105120 (0.0005) [2023-03-08 09:26:48,691][367737] Updated weights for policy 0, policy_version 105200 (0.0005) [2023-03-08 09:26:49,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12970.7, 300 sec: 13301.6). Total num frames: 53866496. Throughput: 0: 13061.9. Samples: 53846028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:26:49,272][367454] Avg episode reward: [(0, '2937.834')] [2023-03-08 09:26:49,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000105208_53866496.pth... [2023-03-08 09:26:49,279][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000104448_53477376.pth [2023-03-08 09:26:51,680][367737] Updated weights for policy 0, policy_version 105280 (0.0004) [2023-03-08 09:26:54,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13107.2, 300 sec: 13315.5). Total num frames: 53936128. Throughput: 0: 13100.5. Samples: 53925356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:26:54,272][367454] Avg episode reward: [(0, '3197.392')] [2023-03-08 09:26:54,882][367737] Updated weights for policy 0, policy_version 105360 (0.0005) [2023-03-08 09:26:58,211][367737] Updated weights for policy 0, policy_version 105440 (0.0005) [2023-03-08 09:26:59,272][367454] Fps is (10 sec: 13107.3, 60 sec: 13038.9, 300 sec: 13301.6). Total num frames: 53997568. Throughput: 0: 13049.0. Samples: 53963084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:26:59,272][367454] Avg episode reward: [(0, '3199.332')] [2023-03-08 09:27:01,312][367737] Updated weights for policy 0, policy_version 105520 (0.0005) [2023-03-08 09:27:04,272][367454] Fps is (10 sec: 12697.5, 60 sec: 13038.9, 300 sec: 13301.6). Total num frames: 54063104. Throughput: 0: 13045.8. Samples: 54040388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:27:04,272][367454] Avg episode reward: [(0, '3148.791')] [2023-03-08 09:27:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000105592_54063104.pth... [2023-03-08 09:27:04,279][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000104832_53673984.pth [2023-03-08 09:27:04,464][367737] Updated weights for policy 0, policy_version 105600 (0.0005) [2023-03-08 09:27:07,639][367737] Updated weights for policy 0, policy_version 105680 (0.0005) [2023-03-08 09:27:09,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13038.9, 300 sec: 13301.6). Total num frames: 54128640. Throughput: 0: 13050.1. Samples: 54117944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:27:09,272][367454] Avg episode reward: [(0, '3065.029')] [2023-03-08 09:27:10,807][367737] Updated weights for policy 0, policy_version 105760 (0.0005) [2023-03-08 09:27:13,956][367737] Updated weights for policy 0, policy_version 105840 (0.0005) [2023-03-08 09:27:14,272][367454] Fps is (10 sec: 13107.3, 60 sec: 13038.9, 300 sec: 13301.6). Total num frames: 54194176. Throughput: 0: 13028.9. Samples: 54157312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:27:14,272][367454] Avg episode reward: [(0, '2984.564')] [2023-03-08 09:27:17,056][367737] Updated weights for policy 0, policy_version 105920 (0.0005) [2023-03-08 09:27:19,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13107.2, 300 sec: 13315.5). Total num frames: 54259712. Throughput: 0: 13006.8. Samples: 54235200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:27:19,272][367454] Avg episode reward: [(0, '3139.371')] [2023-03-08 09:27:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000105976_54259712.pth... [2023-03-08 09:27:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000105208_53866496.pth [2023-03-08 09:27:20,092][367737] Updated weights for policy 0, policy_version 106000 (0.0005) [2023-03-08 09:27:22,871][367737] Updated weights for policy 0, policy_version 106080 (0.0004) [2023-03-08 09:27:24,271][367454] Fps is (10 sec: 13516.9, 60 sec: 13175.5, 300 sec: 13329.4). Total num frames: 54329344. Throughput: 0: 13120.2. Samples: 54320568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:27:24,272][367454] Avg episode reward: [(0, '3117.214')] [2023-03-08 09:27:25,796][367737] Updated weights for policy 0, policy_version 106160 (0.0003) [2023-03-08 09:27:28,775][367737] Updated weights for policy 0, policy_version 106240 (0.0005) [2023-03-08 09:27:29,272][367454] Fps is (10 sec: 13926.5, 60 sec: 13243.7, 300 sec: 13343.2). Total num frames: 54398976. Throughput: 0: 13205.4. Samples: 54362736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:27:29,272][367454] Avg episode reward: [(0, '2911.261')] [2023-03-08 09:27:32,062][367737] Updated weights for policy 0, policy_version 106320 (0.0005) [2023-03-08 09:27:34,272][367454] Fps is (10 sec: 13107.0, 60 sec: 13107.2, 300 sec: 13301.6). Total num frames: 54460416. Throughput: 0: 13199.4. Samples: 54440000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:27:34,272][367454] Avg episode reward: [(0, '3118.896')] [2023-03-08 09:27:34,311][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000106376_54464512.pth... [2023-03-08 09:27:34,312][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000105592_54063104.pth [2023-03-08 09:27:35,252][367737] Updated weights for policy 0, policy_version 106400 (0.0005) [2023-03-08 09:27:38,375][367737] Updated weights for policy 0, policy_version 106480 (0.0005) [2023-03-08 09:27:39,272][367454] Fps is (10 sec: 12697.6, 60 sec: 13107.2, 300 sec: 13273.8). Total num frames: 54525952. Throughput: 0: 13166.0. Samples: 54517824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:27:39,272][367454] Avg episode reward: [(0, '3041.448')] [2023-03-08 09:27:41,574][367737] Updated weights for policy 0, policy_version 106560 (0.0005) [2023-03-08 09:27:44,272][367454] Fps is (10 sec: 13107.3, 60 sec: 13107.2, 300 sec: 13246.0). Total num frames: 54591488. Throughput: 0: 13178.7. Samples: 54556124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:27:44,272][367454] Avg episode reward: [(0, '3044.177')] [2023-03-08 09:27:44,938][367737] Updated weights for policy 0, policy_version 106640 (0.0005) [2023-03-08 09:27:48,176][367737] Updated weights for policy 0, policy_version 106720 (0.0005) [2023-03-08 09:27:49,271][367454] Fps is (10 sec: 12697.6, 60 sec: 13107.2, 300 sec: 13218.3). Total num frames: 54652928. Throughput: 0: 13131.9. Samples: 54631324. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:27:49,272][367454] Avg episode reward: [(0, '3200.205')] [2023-03-08 09:27:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000106744_54652928.pth... [2023-03-08 09:27:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000105976_54259712.pth [2023-03-08 09:27:51,240][367737] Updated weights for policy 0, policy_version 106800 (0.0004) [2023-03-08 09:27:54,189][367737] Updated weights for policy 0, policy_version 106880 (0.0004) [2023-03-08 09:27:54,271][367454] Fps is (10 sec: 13107.2, 60 sec: 13107.2, 300 sec: 13218.3). Total num frames: 54722560. Throughput: 0: 13176.2. Samples: 54710872. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:27:54,272][367454] Avg episode reward: [(0, '3146.583')] [2023-03-08 09:27:57,140][367737] Updated weights for policy 0, policy_version 106960 (0.0004) [2023-03-08 09:27:59,271][367454] Fps is (10 sec: 13926.4, 60 sec: 13243.7, 300 sec: 13204.4). Total num frames: 54792192. Throughput: 0: 13232.7. Samples: 54752784. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:27:59,272][367454] Avg episode reward: [(0, '2983.529')] [2023-03-08 09:28:00,130][367737] Updated weights for policy 0, policy_version 107040 (0.0004) [2023-03-08 09:28:03,154][367737] Updated weights for policy 0, policy_version 107120 (0.0004) [2023-03-08 09:28:04,272][367454] Fps is (10 sec: 13516.6, 60 sec: 13243.7, 300 sec: 13176.6). Total num frames: 54857728. Throughput: 0: 13356.9. Samples: 54836260. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:28:04,272][367454] Avg episode reward: [(0, '2886.671')] [2023-03-08 09:28:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000107144_54857728.pth... [2023-03-08 09:28:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000106376_54464512.pth [2023-03-08 09:28:06,295][367737] Updated weights for policy 0, policy_version 107200 (0.0005) [2023-03-08 09:28:09,271][367454] Fps is (10 sec: 13107.3, 60 sec: 13243.7, 300 sec: 13162.7). Total num frames: 54923264. Throughput: 0: 13153.9. Samples: 54912492. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:28:09,272][367454] Avg episode reward: [(0, '2776.975')] [2023-03-08 09:28:09,559][367737] Updated weights for policy 0, policy_version 107280 (0.0004) [2023-03-08 09:28:12,784][367737] Updated weights for policy 0, policy_version 107360 (0.0005) [2023-03-08 09:28:14,271][367454] Fps is (10 sec: 12697.8, 60 sec: 13175.5, 300 sec: 13121.1). Total num frames: 54984704. Throughput: 0: 13083.8. Samples: 54951508. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:28:14,272][367454] Avg episode reward: [(0, '2938.165')] [2023-03-08 09:28:15,835][367737] Updated weights for policy 0, policy_version 107440 (0.0005) [2023-03-08 09:28:18,939][367737] Updated weights for policy 0, policy_version 107520 (0.0005) [2023-03-08 09:28:19,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13243.7, 300 sec: 13107.2). Total num frames: 55054336. Throughput: 0: 13105.8. Samples: 55029760. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:28:19,272][367454] Avg episode reward: [(0, '2839.672')] [2023-03-08 09:28:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000107528_55054336.pth... [2023-03-08 09:28:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000106744_54652928.pth [2023-03-08 09:28:21,855][367737] Updated weights for policy 0, policy_version 107600 (0.0004) [2023-03-08 09:28:24,271][367454] Fps is (10 sec: 13926.3, 60 sec: 13243.7, 300 sec: 13093.3). Total num frames: 55123968. Throughput: 0: 13215.5. Samples: 55112520. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:28:24,272][367454] Avg episode reward: [(0, '2941.898')] [2023-03-08 09:28:24,713][367737] Updated weights for policy 0, policy_version 107680 (0.0004) [2023-03-08 09:28:27,487][367737] Updated weights for policy 0, policy_version 107760 (0.0004) [2023-03-08 09:28:29,272][367454] Fps is (10 sec: 14336.1, 60 sec: 13312.0, 300 sec: 13107.2). Total num frames: 55197696. Throughput: 0: 13350.7. Samples: 55156904. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:28:29,272][367454] Avg episode reward: [(0, '2735.043')] [2023-03-08 09:28:30,328][367737] Updated weights for policy 0, policy_version 107840 (0.0003) [2023-03-08 09:28:33,150][367737] Updated weights for policy 0, policy_version 107920 (0.0003) [2023-03-08 09:28:34,272][367454] Fps is (10 sec: 14335.9, 60 sec: 13448.5, 300 sec: 13121.1). Total num frames: 55267328. Throughput: 0: 13613.4. Samples: 55243928. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:28:34,272][367454] Avg episode reward: [(0, '2925.973')] [2023-03-08 09:28:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000107944_55267328.pth... [2023-03-08 09:28:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000107144_54857728.pth [2023-03-08 09:28:36,127][367737] Updated weights for policy 0, policy_version 108000 (0.0005) [2023-03-08 09:28:38,950][367737] Updated weights for policy 0, policy_version 108080 (0.0003) [2023-03-08 09:28:39,272][367454] Fps is (10 sec: 14336.0, 60 sec: 13585.1, 300 sec: 13148.9). Total num frames: 55341056. Throughput: 0: 13732.6. Samples: 55328840. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:28:39,282][367454] Avg episode reward: [(0, '2614.505')] [2023-03-08 09:28:41,824][367737] Updated weights for policy 0, policy_version 108160 (0.0004) [2023-03-08 09:28:44,271][367454] Fps is (10 sec: 14336.1, 60 sec: 13653.3, 300 sec: 13162.7). Total num frames: 55410688. Throughput: 0: 13754.4. Samples: 55371732. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:28:44,282][367454] Avg episode reward: [(0, '2841.037')] [2023-03-08 09:28:44,805][367737] Updated weights for policy 0, policy_version 108240 (0.0004) [2023-03-08 09:28:47,740][367737] Updated weights for policy 0, policy_version 108320 (0.0004) [2023-03-08 09:28:49,272][367454] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13176.6). Total num frames: 55480320. Throughput: 0: 13764.1. Samples: 55455644. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:28:49,282][367454] Avg episode reward: [(0, '2780.365')] [2023-03-08 09:28:49,285][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000108360_55480320.pth... [2023-03-08 09:28:49,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000107528_55054336.pth [2023-03-08 09:28:50,567][367737] Updated weights for policy 0, policy_version 108400 (0.0004) [2023-03-08 09:28:53,373][367737] Updated weights for policy 0, policy_version 108480 (0.0003) [2023-03-08 09:28:54,272][367454] Fps is (10 sec: 14335.9, 60 sec: 13858.1, 300 sec: 13204.4). Total num frames: 55554048. Throughput: 0: 13985.1. Samples: 55541824. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:28:54,282][367454] Avg episode reward: [(0, '2777.710')] [2023-03-08 09:28:56,216][367737] Updated weights for policy 0, policy_version 108560 (0.0004) [2023-03-08 09:28:59,048][367737] Updated weights for policy 0, policy_version 108640 (0.0004) [2023-03-08 09:28:59,271][367454] Fps is (10 sec: 14336.2, 60 sec: 13858.2, 300 sec: 13218.3). Total num frames: 55623680. Throughput: 0: 14083.4. Samples: 55585260. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:28:59,282][367454] Avg episode reward: [(0, '2933.204')] [2023-03-08 09:29:01,893][367737] Updated weights for policy 0, policy_version 108720 (0.0004) [2023-03-08 09:29:04,272][367454] Fps is (10 sec: 14336.0, 60 sec: 13994.7, 300 sec: 13246.0). Total num frames: 55697408. Throughput: 0: 14279.7. Samples: 55672348. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:29:04,272][367454] Avg episode reward: [(0, '2911.474')] [2023-03-08 09:29:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000108784_55697408.pth... [2023-03-08 09:29:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000107944_55267328.pth [2023-03-08 09:29:04,763][367737] Updated weights for policy 0, policy_version 108800 (0.0003) [2023-03-08 09:29:07,523][367737] Updated weights for policy 0, policy_version 108880 (0.0003) [2023-03-08 09:29:09,272][367454] Fps is (10 sec: 14745.5, 60 sec: 14131.2, 300 sec: 13273.8). Total num frames: 55771136. Throughput: 0: 14363.1. Samples: 55758860. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:29:09,272][367454] Avg episode reward: [(0, '3037.649')] [2023-03-08 09:29:10,423][367737] Updated weights for policy 0, policy_version 108960 (0.0003) [2023-03-08 09:29:13,207][367737] Updated weights for policy 0, policy_version 109040 (0.0003) [2023-03-08 09:29:14,272][367454] Fps is (10 sec: 14336.0, 60 sec: 14267.7, 300 sec: 13287.7). Total num frames: 55840768. Throughput: 0: 14322.9. Samples: 55801436. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:29:14,272][367454] Avg episode reward: [(0, '2825.118')] [2023-03-08 09:29:16,046][367737] Updated weights for policy 0, policy_version 109120 (0.0003) [2023-03-08 09:29:18,912][367737] Updated weights for policy 0, policy_version 109200 (0.0003) [2023-03-08 09:29:19,272][367454] Fps is (10 sec: 14335.9, 60 sec: 14336.0, 300 sec: 13315.5). Total num frames: 55914496. Throughput: 0: 14321.1. Samples: 55888376. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:29:19,272][367454] Avg episode reward: [(0, '3060.493')] [2023-03-08 09:29:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000109208_55914496.pth... [2023-03-08 09:29:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000108360_55480320.pth [2023-03-08 09:29:21,807][367737] Updated weights for policy 0, policy_version 109280 (0.0003) [2023-03-08 09:29:24,272][367454] Fps is (10 sec: 13926.4, 60 sec: 14267.7, 300 sec: 13329.4). Total num frames: 55980032. Throughput: 0: 14286.7. Samples: 55971740. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:29:24,272][367454] Avg episode reward: [(0, '3229.492')] [2023-03-08 09:29:25,033][367737] Updated weights for policy 0, policy_version 109360 (0.0005) [2023-03-08 09:29:28,329][367737] Updated weights for policy 0, policy_version 109440 (0.0005) [2023-03-08 09:29:29,272][367454] Fps is (10 sec: 12697.6, 60 sec: 14062.9, 300 sec: 13315.5). Total num frames: 56041472. Throughput: 0: 14156.9. Samples: 56008792. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:29:29,272][367454] Avg episode reward: [(0, '3089.358')] [2023-03-08 09:29:31,532][367737] Updated weights for policy 0, policy_version 109520 (0.0004) [2023-03-08 09:29:34,272][367454] Fps is (10 sec: 12697.5, 60 sec: 13994.7, 300 sec: 13315.5). Total num frames: 56107008. Throughput: 0: 14019.8. Samples: 56086536. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:29:34,272][367454] Avg episode reward: [(0, '3203.460')] [2023-03-08 09:29:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000109584_56107008.pth... [2023-03-08 09:29:34,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000108784_55697408.pth [2023-03-08 09:29:34,639][367737] Updated weights for policy 0, policy_version 109600 (0.0004) [2023-03-08 09:29:37,850][367737] Updated weights for policy 0, policy_version 109680 (0.0005) [2023-03-08 09:29:39,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13858.1, 300 sec: 13315.5). Total num frames: 56172544. Throughput: 0: 13817.4. Samples: 56163608. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:29:39,272][367454] Avg episode reward: [(0, '3422.842')] [2023-03-08 09:29:41,110][367737] Updated weights for policy 0, policy_version 109760 (0.0005) [2023-03-08 09:29:44,272][367454] Fps is (10 sec: 12697.7, 60 sec: 13721.6, 300 sec: 13301.6). Total num frames: 56233984. Throughput: 0: 13687.7. Samples: 56201208. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 09:29:44,272][367454] Avg episode reward: [(0, '3195.777')] [2023-03-08 09:29:44,368][367737] Updated weights for policy 0, policy_version 109840 (0.0005) [2023-03-08 09:29:47,610][367737] Updated weights for policy 0, policy_version 109920 (0.0005) [2023-03-08 09:29:49,272][367454] Fps is (10 sec: 12697.6, 60 sec: 13653.3, 300 sec: 13301.6). Total num frames: 56299520. Throughput: 0: 13421.5. Samples: 56276316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:29:49,272][367454] Avg episode reward: [(0, '3149.397')] [2023-03-08 09:29:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000109960_56299520.pth... [2023-03-08 09:29:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000109208_55914496.pth [2023-03-08 09:29:50,810][367737] Updated weights for policy 0, policy_version 110000 (0.0005) [2023-03-08 09:29:54,113][367737] Updated weights for policy 0, policy_version 110080 (0.0005) [2023-03-08 09:29:54,271][367454] Fps is (10 sec: 12697.7, 60 sec: 13448.5, 300 sec: 13287.7). Total num frames: 56360960. Throughput: 0: 13198.1. Samples: 56352776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:29:54,272][367454] Avg episode reward: [(0, '3144.266')] [2023-03-08 09:29:57,428][367737] Updated weights for policy 0, policy_version 110160 (0.0005) [2023-03-08 09:29:59,271][367454] Fps is (10 sec: 12288.1, 60 sec: 13312.0, 300 sec: 13273.8). Total num frames: 56422400. Throughput: 0: 13070.6. Samples: 56389612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:29:59,272][367454] Avg episode reward: [(0, '3243.307')] [2023-03-08 09:30:00,635][367737] Updated weights for policy 0, policy_version 110240 (0.0005) [2023-03-08 09:30:03,747][367737] Updated weights for policy 0, policy_version 110320 (0.0005) [2023-03-08 09:30:04,271][367454] Fps is (10 sec: 12697.6, 60 sec: 13175.5, 300 sec: 13287.7). Total num frames: 56487936. Throughput: 0: 12821.4. Samples: 56465336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:30:04,272][367454] Avg episode reward: [(0, '3179.870')] [2023-03-08 09:30:04,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000110328_56487936.pth... [2023-03-08 09:30:04,276][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000109584_56107008.pth [2023-03-08 09:30:06,607][367737] Updated weights for policy 0, policy_version 110400 (0.0003) [2023-03-08 09:30:09,272][367454] Fps is (10 sec: 13516.7, 60 sec: 13107.2, 300 sec: 13301.6). Total num frames: 56557568. Throughput: 0: 12768.0. Samples: 56546300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:30:09,272][367454] Avg episode reward: [(0, '3196.695')] [2023-03-08 09:30:09,801][367737] Updated weights for policy 0, policy_version 110480 (0.0005) [2023-03-08 09:30:12,870][367737] Updated weights for policy 0, policy_version 110560 (0.0004) [2023-03-08 09:30:14,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13038.9, 300 sec: 13301.6). Total num frames: 56623104. Throughput: 0: 12843.3. Samples: 56586740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:30:14,272][367454] Avg episode reward: [(0, '3233.957')] [2023-03-08 09:30:16,142][367737] Updated weights for policy 0, policy_version 110640 (0.0005) [2023-03-08 09:30:19,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12834.1, 300 sec: 13273.8). Total num frames: 56684544. Throughput: 0: 12832.2. Samples: 56663984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:30:19,283][367454] Avg episode reward: [(0, '3442.562')] [2023-03-08 09:30:19,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000110712_56684544.pth... [2023-03-08 09:30:19,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000109960_56299520.pth [2023-03-08 09:30:19,385][367737] Updated weights for policy 0, policy_version 110720 (0.0005) [2023-03-08 09:30:22,386][367737] Updated weights for policy 0, policy_version 110800 (0.0003) [2023-03-08 09:30:24,272][367454] Fps is (10 sec: 13107.2, 60 sec: 12902.4, 300 sec: 13301.6). Total num frames: 56754176. Throughput: 0: 12877.8. Samples: 56743108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:30:24,283][367454] Avg episode reward: [(0, '3300.326')] [2023-03-08 09:30:25,407][367737] Updated weights for policy 0, policy_version 110880 (0.0003) [2023-03-08 09:30:28,432][367737] Updated weights for policy 0, policy_version 110960 (0.0003) [2023-03-08 09:30:29,271][367454] Fps is (10 sec: 13517.0, 60 sec: 12970.7, 300 sec: 13301.6). Total num frames: 56819712. Throughput: 0: 12933.7. Samples: 56783224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:30:29,282][367454] Avg episode reward: [(0, '3272.931')] [2023-03-08 09:30:31,582][367737] Updated weights for policy 0, policy_version 111040 (0.0005) [2023-03-08 09:30:34,271][367454] Fps is (10 sec: 13107.2, 60 sec: 12970.7, 300 sec: 13315.5). Total num frames: 56885248. Throughput: 0: 13051.1. Samples: 56863616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:30:34,282][367454] Avg episode reward: [(0, '3228.113')] [2023-03-08 09:30:34,287][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000111112_56889344.pth... [2023-03-08 09:30:34,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000110328_56487936.pth [2023-03-08 09:30:34,588][367737] Updated weights for policy 0, policy_version 111120 (0.0004) [2023-03-08 09:30:37,637][367737] Updated weights for policy 0, policy_version 111200 (0.0005) [2023-03-08 09:30:39,272][367454] Fps is (10 sec: 13516.7, 60 sec: 13038.9, 300 sec: 13329.4). Total num frames: 56954880. Throughput: 0: 13159.9. Samples: 56944972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:30:39,272][367454] Avg episode reward: [(0, '3378.386')] [2023-03-08 09:30:40,534][367737] Updated weights for policy 0, policy_version 111280 (0.0004) [2023-03-08 09:30:43,425][367737] Updated weights for policy 0, policy_version 111360 (0.0004) [2023-03-08 09:30:44,271][367454] Fps is (10 sec: 13926.4, 60 sec: 13175.5, 300 sec: 13343.2). Total num frames: 57024512. Throughput: 0: 13291.1. Samples: 56987712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:30:44,282][367454] Avg episode reward: [(0, '3349.417')] [2023-03-08 09:30:46,406][367737] Updated weights for policy 0, policy_version 111440 (0.0004) [2023-03-08 09:30:49,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13243.7, 300 sec: 13371.0). Total num frames: 57094144. Throughput: 0: 13454.5. Samples: 57070788. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:30:49,272][367454] Avg episode reward: [(0, '3277.898')] [2023-03-08 09:30:49,294][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000111520_57098240.pth... [2023-03-08 09:30:49,294][367737] Updated weights for policy 0, policy_version 111520 (0.0004) [2023-03-08 09:30:49,295][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000110712_56684544.pth [2023-03-08 09:30:52,311][367737] Updated weights for policy 0, policy_version 111600 (0.0005) [2023-03-08 09:30:54,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13380.3, 300 sec: 13384.9). Total num frames: 57163776. Throughput: 0: 13494.9. Samples: 57153572. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:30:54,272][367454] Avg episode reward: [(0, '3261.348')] [2023-03-08 09:30:55,325][367737] Updated weights for policy 0, policy_version 111680 (0.0005) [2023-03-08 09:30:58,227][367737] Updated weights for policy 0, policy_version 111760 (0.0004) [2023-03-08 09:30:59,271][367454] Fps is (10 sec: 13926.4, 60 sec: 13516.8, 300 sec: 13398.8). Total num frames: 57233408. Throughput: 0: 13538.6. Samples: 57195976. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:30:59,272][367454] Avg episode reward: [(0, '3252.509')] [2023-03-08 09:31:01,206][367737] Updated weights for policy 0, policy_version 111840 (0.0004) [2023-03-08 09:31:04,115][367737] Updated weights for policy 0, policy_version 111920 (0.0004) [2023-03-08 09:31:04,272][367454] Fps is (10 sec: 13926.3, 60 sec: 13585.0, 300 sec: 13412.7). Total num frames: 57303040. Throughput: 0: 13656.7. Samples: 57278536. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:31:04,272][367454] Avg episode reward: [(0, '3294.873')] [2023-03-08 09:31:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000111920_57303040.pth... [2023-03-08 09:31:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000111112_56889344.pth [2023-03-08 09:31:07,123][367737] Updated weights for policy 0, policy_version 112000 (0.0005) [2023-03-08 09:31:09,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13585.1, 300 sec: 13426.5). Total num frames: 57372672. Throughput: 0: 13741.9. Samples: 57361492. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:31:09,272][367454] Avg episode reward: [(0, '3038.425')] [2023-03-08 09:31:10,091][367737] Updated weights for policy 0, policy_version 112080 (0.0004) [2023-03-08 09:31:13,233][367737] Updated weights for policy 0, policy_version 112160 (0.0004) [2023-03-08 09:31:14,272][367454] Fps is (10 sec: 13516.9, 60 sec: 13585.1, 300 sec: 13440.4). Total num frames: 57438208. Throughput: 0: 13748.6. Samples: 57401912. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:31:14,272][367454] Avg episode reward: [(0, '3115.904')] [2023-03-08 09:31:16,240][367737] Updated weights for policy 0, policy_version 112240 (0.0005) [2023-03-08 09:31:19,244][367737] Updated weights for policy 0, policy_version 112320 (0.0004) [2023-03-08 09:31:19,272][367454] Fps is (10 sec: 13516.7, 60 sec: 13721.6, 300 sec: 13454.3). Total num frames: 57507840. Throughput: 0: 13766.6. Samples: 57483112. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:31:19,272][367454] Avg episode reward: [(0, '3499.314')] [2023-03-08 09:31:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000112320_57507840.pth... [2023-03-08 09:31:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000111520_57098240.pth [2023-03-08 09:31:22,182][367737] Updated weights for policy 0, policy_version 112400 (0.0004) [2023-03-08 09:31:24,271][367454] Fps is (10 sec: 13926.4, 60 sec: 13721.6, 300 sec: 13468.2). Total num frames: 57577472. Throughput: 0: 13800.6. Samples: 57566000. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:31:24,272][367454] Avg episode reward: [(0, '3383.566')] [2023-03-08 09:31:25,065][367737] Updated weights for policy 0, policy_version 112480 (0.0004) [2023-03-08 09:31:27,833][367737] Updated weights for policy 0, policy_version 112560 (0.0004) [2023-03-08 09:31:29,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13789.8, 300 sec: 13468.2). Total num frames: 57647104. Throughput: 0: 13824.3. Samples: 57609808. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:31:29,272][367454] Avg episode reward: [(0, '3355.814')] [2023-03-08 09:31:30,817][367737] Updated weights for policy 0, policy_version 112640 (0.0005) [2023-03-08 09:31:33,892][367737] Updated weights for policy 0, policy_version 112720 (0.0005) [2023-03-08 09:31:34,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13482.1). Total num frames: 57716736. Throughput: 0: 13809.9. Samples: 57692232. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:31:34,272][367454] Avg episode reward: [(0, '3351.634')] [2023-03-08 09:31:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000112728_57716736.pth... [2023-03-08 09:31:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000111920_57303040.pth [2023-03-08 09:31:36,823][367737] Updated weights for policy 0, policy_version 112800 (0.0004) [2023-03-08 09:31:39,271][367454] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13496.0). Total num frames: 57786368. Throughput: 0: 13794.7. Samples: 57774332. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:31:39,282][367454] Avg episode reward: [(0, '3285.256')] [2023-03-08 09:31:39,810][367737] Updated weights for policy 0, policy_version 112880 (0.0004) [2023-03-08 09:31:42,824][367737] Updated weights for policy 0, policy_version 112960 (0.0005) [2023-03-08 09:31:44,271][367454] Fps is (10 sec: 13516.9, 60 sec: 13789.9, 300 sec: 13509.9). Total num frames: 57851904. Throughput: 0: 13760.6. Samples: 57815204. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:31:44,282][367454] Avg episode reward: [(0, '3133.027')] [2023-03-08 09:31:45,692][367737] Updated weights for policy 0, policy_version 113040 (0.0005) [2023-03-08 09:31:48,658][367737] Updated weights for policy 0, policy_version 113120 (0.0005) [2023-03-08 09:31:49,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13523.7). Total num frames: 57925632. Throughput: 0: 13816.6. Samples: 57900280. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:31:49,282][367454] Avg episode reward: [(0, '3237.296')] [2023-03-08 09:31:49,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000113136_57925632.pth... [2023-03-08 09:31:49,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000112320_57507840.pth [2023-03-08 09:31:51,721][367737] Updated weights for policy 0, policy_version 113200 (0.0005) [2023-03-08 09:31:54,272][367454] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13537.6). Total num frames: 57991168. Throughput: 0: 13786.0. Samples: 57981864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:31:54,282][367454] Avg episode reward: [(0, '3389.427')] [2023-03-08 09:31:54,694][367737] Updated weights for policy 0, policy_version 113280 (0.0005) [2023-03-08 09:31:57,618][367737] Updated weights for policy 0, policy_version 113360 (0.0004) [2023-03-08 09:31:59,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13789.9, 300 sec: 13551.5). Total num frames: 58060800. Throughput: 0: 13821.3. Samples: 58023872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:31:59,272][367454] Avg episode reward: [(0, '3153.037')] [2023-03-08 09:32:00,651][367737] Updated weights for policy 0, policy_version 113440 (0.0005) [2023-03-08 09:32:03,616][367737] Updated weights for policy 0, policy_version 113520 (0.0004) [2023-03-08 09:32:04,272][367454] Fps is (10 sec: 13926.3, 60 sec: 13789.9, 300 sec: 13565.4). Total num frames: 58130432. Throughput: 0: 13835.8. Samples: 58105724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:32:04,282][367454] Avg episode reward: [(0, '3217.465')] [2023-03-08 09:32:04,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000113536_58130432.pth... [2023-03-08 09:32:04,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000112728_57716736.pth [2023-03-08 09:32:06,520][367737] Updated weights for policy 0, policy_version 113600 (0.0004) [2023-03-08 09:32:09,271][367454] Fps is (10 sec: 13926.5, 60 sec: 13789.9, 300 sec: 13579.3). Total num frames: 58200064. Throughput: 0: 13878.0. Samples: 58190508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:32:09,282][367454] Avg episode reward: [(0, '3031.218')] [2023-03-08 09:32:09,379][367737] Updated weights for policy 0, policy_version 113680 (0.0004) [2023-03-08 09:32:12,421][367737] Updated weights for policy 0, policy_version 113760 (0.0005) [2023-03-08 09:32:14,272][367454] Fps is (10 sec: 13926.5, 60 sec: 13858.1, 300 sec: 13593.2). Total num frames: 58269696. Throughput: 0: 13813.2. Samples: 58231400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:32:14,282][367454] Avg episode reward: [(0, '3086.935')] [2023-03-08 09:32:15,265][367737] Updated weights for policy 0, policy_version 113840 (0.0004) [2023-03-08 09:32:18,121][367737] Updated weights for policy 0, policy_version 113920 (0.0004) [2023-03-08 09:32:19,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13593.2). Total num frames: 58339328. Throughput: 0: 13879.8. Samples: 58316824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:32:19,282][367454] Avg episode reward: [(0, '3033.486')] [2023-03-08 09:32:19,317][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000113952_58343424.pth... [2023-03-08 09:32:19,319][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000113136_57925632.pth [2023-03-08 09:32:21,041][367737] Updated weights for policy 0, policy_version 114000 (0.0005) [2023-03-08 09:32:24,259][367737] Updated weights for policy 0, policy_version 114080 (0.0005) [2023-03-08 09:32:24,271][367454] Fps is (10 sec: 13926.4, 60 sec: 13858.1, 300 sec: 13593.2). Total num frames: 58408960. Throughput: 0: 13856.7. Samples: 58397884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:32:24,282][367454] Avg episode reward: [(0, '3215.185')] [2023-03-08 09:32:27,478][367737] Updated weights for policy 0, policy_version 114160 (0.0005) [2023-03-08 09:32:29,271][367454] Fps is (10 sec: 13107.3, 60 sec: 13721.6, 300 sec: 13593.2). Total num frames: 58470400. Throughput: 0: 13800.4. Samples: 58436224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:32:29,282][367454] Avg episode reward: [(0, '3148.001')] [2023-03-08 09:32:30,838][367737] Updated weights for policy 0, policy_version 114240 (0.0005) [2023-03-08 09:32:34,028][367737] Updated weights for policy 0, policy_version 114320 (0.0005) [2023-03-08 09:32:34,271][367454] Fps is (10 sec: 12288.0, 60 sec: 13585.1, 300 sec: 13579.3). Total num frames: 58531840. Throughput: 0: 13553.3. Samples: 58510180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:32:34,282][367454] Avg episode reward: [(0, '3196.966')] [2023-03-08 09:32:34,284][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000114320_58531840.pth... [2023-03-08 09:32:34,287][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000113536_58130432.pth [2023-03-08 09:32:36,948][367737] Updated weights for policy 0, policy_version 114400 (0.0004) [2023-03-08 09:32:39,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13585.1, 300 sec: 13593.2). Total num frames: 58601472. Throughput: 0: 13585.5. Samples: 58593212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:32:39,283][367454] Avg episode reward: [(0, '3272.339')] [2023-03-08 09:32:39,892][367737] Updated weights for policy 0, policy_version 114480 (0.0004) [2023-03-08 09:32:42,744][367737] Updated weights for policy 0, policy_version 114560 (0.0004) [2023-03-08 09:32:44,272][367454] Fps is (10 sec: 14335.8, 60 sec: 13721.6, 300 sec: 13634.8). Total num frames: 58675200. Throughput: 0: 13567.4. Samples: 58634408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:32:44,272][367454] Avg episode reward: [(0, '3327.576')] [2023-03-08 09:32:45,887][367737] Updated weights for policy 0, policy_version 114640 (0.0005) [2023-03-08 09:32:49,055][367737] Updated weights for policy 0, policy_version 114720 (0.0005) [2023-03-08 09:32:49,272][367454] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13607.0). Total num frames: 58736640. Throughput: 0: 13558.0. Samples: 58715832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:32:49,272][367454] Avg episode reward: [(0, '3329.447')] [2023-03-08 09:32:49,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000114720_58736640.pth... [2023-03-08 09:32:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000113952_58343424.pth [2023-03-08 09:32:52,050][367737] Updated weights for policy 0, policy_version 114800 (0.0005) [2023-03-08 09:32:54,272][367454] Fps is (10 sec: 13107.4, 60 sec: 13585.1, 300 sec: 13607.1). Total num frames: 58806272. Throughput: 0: 13435.6. Samples: 58795112. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:32:54,272][367454] Avg episode reward: [(0, '2938.307')] [2023-03-08 09:32:55,100][367737] Updated weights for policy 0, policy_version 114880 (0.0005) [2023-03-08 09:32:58,103][367737] Updated weights for policy 0, policy_version 114960 (0.0005) [2023-03-08 09:32:59,272][367454] Fps is (10 sec: 13516.9, 60 sec: 13516.8, 300 sec: 13607.1). Total num frames: 58871808. Throughput: 0: 13430.2. Samples: 58835760. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:32:59,272][367454] Avg episode reward: [(0, '3091.435')] [2023-03-08 09:33:01,143][367737] Updated weights for policy 0, policy_version 115040 (0.0005) [2023-03-08 09:33:04,078][367737] Updated weights for policy 0, policy_version 115120 (0.0004) [2023-03-08 09:33:04,272][367454] Fps is (10 sec: 13516.7, 60 sec: 13516.8, 300 sec: 13620.9). Total num frames: 58941440. Throughput: 0: 13352.1. Samples: 58917668. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:33:04,272][367454] Avg episode reward: [(0, '3315.323')] [2023-03-08 09:33:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000115120_58941440.pth... [2023-03-08 09:33:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000114320_58531840.pth [2023-03-08 09:33:07,033][367737] Updated weights for policy 0, policy_version 115200 (0.0004) [2023-03-08 09:33:09,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13634.8). Total num frames: 59006976. Throughput: 0: 13361.3. Samples: 58999144. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:33:09,272][367454] Avg episode reward: [(0, '3437.353')] [2023-03-08 09:33:10,298][367737] Updated weights for policy 0, policy_version 115280 (0.0005) [2023-03-08 09:33:13,579][367737] Updated weights for policy 0, policy_version 115360 (0.0005) [2023-03-08 09:33:14,271][367454] Fps is (10 sec: 13107.4, 60 sec: 13380.3, 300 sec: 13620.9). Total num frames: 59072512. Throughput: 0: 13350.2. Samples: 59036984. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:33:14,272][367454] Avg episode reward: [(0, '3287.862')] [2023-03-08 09:33:16,883][367737] Updated weights for policy 0, policy_version 115440 (0.0005) [2023-03-08 09:33:19,272][367454] Fps is (10 sec: 12697.5, 60 sec: 13243.7, 300 sec: 13593.2). Total num frames: 59133952. Throughput: 0: 13377.7. Samples: 59112180. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:33:19,272][367454] Avg episode reward: [(0, '3412.148')] [2023-03-08 09:33:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000115496_59133952.pth... [2023-03-08 09:33:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000114720_58736640.pth [2023-03-08 09:33:20,147][367737] Updated weights for policy 0, policy_version 115520 (0.0005) [2023-03-08 09:33:23,308][367737] Updated weights for policy 0, policy_version 115600 (0.0005) [2023-03-08 09:33:24,272][367454] Fps is (10 sec: 12697.5, 60 sec: 13175.5, 300 sec: 13565.4). Total num frames: 59199488. Throughput: 0: 13214.9. Samples: 59187884. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:33:24,272][367454] Avg episode reward: [(0, '3531.749')] [2023-03-08 09:33:26,190][367737] Updated weights for policy 0, policy_version 115680 (0.0004) [2023-03-08 09:33:29,135][367737] Updated weights for policy 0, policy_version 115760 (0.0004) [2023-03-08 09:33:29,271][367454] Fps is (10 sec: 13517.0, 60 sec: 13312.0, 300 sec: 13565.4). Total num frames: 59269120. Throughput: 0: 13266.1. Samples: 59231380. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:33:29,272][367454] Avg episode reward: [(0, '3256.441')] [2023-03-08 09:33:32,113][367737] Updated weights for policy 0, policy_version 115840 (0.0004) [2023-03-08 09:33:34,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13448.5, 300 sec: 13551.5). Total num frames: 59338752. Throughput: 0: 13296.7. Samples: 59314184. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:33:34,272][367454] Avg episode reward: [(0, '3613.998')] [2023-03-08 09:33:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000115896_59338752.pth... [2023-03-08 09:33:34,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000115120_58941440.pth [2023-03-08 09:33:35,165][367737] Updated weights for policy 0, policy_version 115920 (0.0005) [2023-03-08 09:33:38,055][367737] Updated weights for policy 0, policy_version 116000 (0.0005) [2023-03-08 09:33:39,272][367454] Fps is (10 sec: 13926.3, 60 sec: 13448.5, 300 sec: 13551.5). Total num frames: 59408384. Throughput: 0: 13361.0. Samples: 59396356. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:33:39,272][367454] Avg episode reward: [(0, '3270.196')] [2023-03-08 09:33:40,910][367737] Updated weights for policy 0, policy_version 116080 (0.0004) [2023-03-08 09:33:43,861][367737] Updated weights for policy 0, policy_version 116160 (0.0005) [2023-03-08 09:33:44,272][367454] Fps is (10 sec: 13926.4, 60 sec: 13380.3, 300 sec: 13551.5). Total num frames: 59478016. Throughput: 0: 13426.3. Samples: 59439944. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:33:44,272][367454] Avg episode reward: [(0, '3474.852')] [2023-03-08 09:33:46,732][367737] Updated weights for policy 0, policy_version 116240 (0.0004) [2023-03-08 09:33:49,272][367454] Fps is (10 sec: 13926.3, 60 sec: 13516.8, 300 sec: 13537.6). Total num frames: 59547648. Throughput: 0: 13469.9. Samples: 59523812. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 09:33:49,272][367454] Avg episode reward: [(0, '3571.587')] [2023-03-08 09:33:49,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000116304_59547648.pth... [2023-03-08 09:33:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000115496_59133952.pth [2023-03-08 09:33:49,651][367737] Updated weights for policy 0, policy_version 116320 (0.0004) [2023-03-08 09:33:52,807][367737] Updated weights for policy 0, policy_version 116400 (0.0005) [2023-03-08 09:33:54,272][367454] Fps is (10 sec: 13516.8, 60 sec: 13448.5, 300 sec: 13523.7). Total num frames: 59613184. Throughput: 0: 13463.5. Samples: 59605000. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:33:54,272][367454] Avg episode reward: [(0, '3571.105')] [2023-03-08 09:33:55,906][367737] Updated weights for policy 0, policy_version 116480 (0.0004) [2023-03-08 09:33:58,972][367737] Updated weights for policy 0, policy_version 116560 (0.0004) [2023-03-08 09:33:59,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 13496.0). Total num frames: 59678720. Throughput: 0: 13498.7. Samples: 59644428. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:33:59,272][367454] Avg episode reward: [(0, '3462.286')] [2023-03-08 09:34:02,184][367737] Updated weights for policy 0, policy_version 116640 (0.0005) [2023-03-08 09:34:04,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13380.3, 300 sec: 13468.2). Total num frames: 59744256. Throughput: 0: 13569.2. Samples: 59722792. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:34:04,272][367454] Avg episode reward: [(0, '3527.832')] [2023-03-08 09:34:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000116688_59744256.pth... [2023-03-08 09:34:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000115896_59338752.pth [2023-03-08 09:34:05,263][367737] Updated weights for policy 0, policy_version 116720 (0.0004) [2023-03-08 09:34:08,372][367737] Updated weights for policy 0, policy_version 116800 (0.0005) [2023-03-08 09:34:09,272][367454] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 13454.3). Total num frames: 59809792. Throughput: 0: 13639.6. Samples: 59801664. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:34:09,272][367454] Avg episode reward: [(0, '3522.281')] [2023-03-08 09:34:11,438][367737] Updated weights for policy 0, policy_version 116880 (0.0005) [2023-03-08 09:34:14,272][367454] Fps is (10 sec: 13516.9, 60 sec: 13448.5, 300 sec: 13440.4). Total num frames: 59879424. Throughput: 0: 13573.0. Samples: 59842168. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:34:14,272][367454] Avg episode reward: [(0, '3462.009')] [2023-03-08 09:34:14,567][367737] Updated weights for policy 0, policy_version 116960 (0.0005) [2023-03-08 09:34:17,598][367737] Updated weights for policy 0, policy_version 117040 (0.0005) [2023-03-08 09:34:19,272][367454] Fps is (10 sec: 13107.1, 60 sec: 13448.5, 300 sec: 13426.5). Total num frames: 59940864. Throughput: 0: 13505.6. Samples: 59921936. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:34:19,272][367454] Avg episode reward: [(0, '3555.822')] [2023-03-08 09:34:19,338][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000117080_59944960.pth... [2023-03-08 09:34:19,340][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000116304_59547648.pth [2023-03-08 09:34:20,971][367737] Updated weights for policy 0, policy_version 117120 (0.0005) [2023-03-08 09:34:24,271][367454] Fps is (10 sec: 12288.1, 60 sec: 13380.3, 300 sec: 13426.6). Total num frames: 60002304. Throughput: 0: 13296.9. Samples: 59994716. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:34:24,272][367454] Avg episode reward: [(0, '3677.461')] [2023-03-08 09:34:24,274][367737] Updated weights for policy 0, policy_version 117200 (0.0005) [2023-03-08 09:34:27,326][367737] Updated weights for policy 0, policy_version 117280 (0.0003) [2023-03-08 09:34:29,272][367454] Fps is (10 sec: 13107.3, 60 sec: 13380.3, 300 sec: 13440.4). Total num frames: 60071936. Throughput: 0: 13226.5. Samples: 60035136. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:34:29,272][367454] Avg episode reward: [(0, '3389.306')] [2023-03-08 09:34:30,406][367737] Updated weights for policy 0, policy_version 117360 (0.0003) [2023-03-08 09:34:33,751][367737] Updated weights for policy 0, policy_version 117440 (0.0005) [2023-03-08 09:34:34,272][367454] Fps is (10 sec: 13107.0, 60 sec: 13243.7, 300 sec: 13426.5). Total num frames: 60133376. Throughput: 0: 13090.9. Samples: 60112904. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:34:34,272][367454] Avg episode reward: [(0, '3348.959')] [2023-03-08 09:34:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000117448_60133376.pth... [2023-03-08 09:34:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000116688_59744256.pth [2023-03-08 09:34:37,049][367737] Updated weights for policy 0, policy_version 117520 (0.0005) [2023-03-08 09:34:39,272][367454] Fps is (10 sec: 12697.6, 60 sec: 13175.5, 300 sec: 13440.4). Total num frames: 60198912. Throughput: 0: 12942.0. Samples: 60187388. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:34:39,272][367454] Avg episode reward: [(0, '3686.395')] [2023-03-08 09:34:40,144][367737] Updated weights for policy 0, policy_version 117600 (0.0003) [2023-03-08 09:34:43,371][367737] Updated weights for policy 0, policy_version 117680 (0.0005) [2023-03-08 09:34:44,272][367454] Fps is (10 sec: 12697.6, 60 sec: 13038.9, 300 sec: 13426.5). Total num frames: 60260352. Throughput: 0: 12960.4. Samples: 60227648. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:34:44,272][367454] Avg episode reward: [(0, '3486.392')] [2023-03-08 09:34:46,697][367737] Updated weights for policy 0, policy_version 117760 (0.0005) [2023-03-08 09:34:49,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12902.4, 300 sec: 13426.5). Total num frames: 60321792. Throughput: 0: 12861.4. Samples: 60301556. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:34:49,272][367454] Avg episode reward: [(0, '3443.731')] [2023-03-08 09:34:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000117816_60321792.pth... [2023-03-08 09:34:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000117080_59944960.pth [2023-03-08 09:34:50,048][367737] Updated weights for policy 0, policy_version 117840 (0.0005) [2023-03-08 09:34:53,510][367737] Updated weights for policy 0, policy_version 117920 (0.0005) [2023-03-08 09:34:54,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12834.1, 300 sec: 13426.5). Total num frames: 60383232. Throughput: 0: 12720.6. Samples: 60374092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:34:54,272][367454] Avg episode reward: [(0, '3675.246')] [2023-03-08 09:34:56,854][367737] Updated weights for policy 0, policy_version 118000 (0.0005) [2023-03-08 09:34:59,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12765.9, 300 sec: 13412.7). Total num frames: 60444672. Throughput: 0: 12638.0. Samples: 60410880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:34:59,272][367454] Avg episode reward: [(0, '3707.761')] [2023-03-08 09:35:00,227][367737] Updated weights for policy 0, policy_version 118080 (0.0005) [2023-03-08 09:35:03,694][367737] Updated weights for policy 0, policy_version 118160 (0.0005) [2023-03-08 09:35:04,271][367454] Fps is (10 sec: 11878.4, 60 sec: 12629.4, 300 sec: 13371.0). Total num frames: 60502016. Throughput: 0: 12458.7. Samples: 60482576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:35:04,272][367454] Avg episode reward: [(0, '3806.510')] [2023-03-08 09:35:04,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000118168_60502016.pth... [2023-03-08 09:35:04,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000117448_60133376.pth [2023-03-08 09:35:07,126][367737] Updated weights for policy 0, policy_version 118240 (0.0005) [2023-03-08 09:35:09,271][367454] Fps is (10 sec: 11878.4, 60 sec: 12561.1, 300 sec: 13357.1). Total num frames: 60563456. Throughput: 0: 12442.1. Samples: 60554612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:35:09,272][367454] Avg episode reward: [(0, '3824.390')] [2023-03-08 09:35:10,599][367737] Updated weights for policy 0, policy_version 118320 (0.0005) [2023-03-08 09:35:13,948][367737] Updated weights for policy 0, policy_version 118400 (0.0005) [2023-03-08 09:35:14,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 13357.1). Total num frames: 60624896. Throughput: 0: 12312.6. Samples: 60589204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:35:14,272][367454] Avg episode reward: [(0, '3773.961')] [2023-03-08 09:35:17,427][367737] Updated weights for policy 0, policy_version 118480 (0.0004) [2023-03-08 09:35:19,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 13315.5). Total num frames: 60682240. Throughput: 0: 12196.8. Samples: 60661760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:35:19,272][367454] Avg episode reward: [(0, '3780.585')] [2023-03-08 09:35:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000118520_60682240.pth... [2023-03-08 09:35:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000117816_60321792.pth [2023-03-08 09:35:20,909][367737] Updated weights for policy 0, policy_version 118560 (0.0005) [2023-03-08 09:35:24,271][367454] Fps is (10 sec: 11468.8, 60 sec: 12288.0, 300 sec: 13287.7). Total num frames: 60739584. Throughput: 0: 12100.9. Samples: 60731928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:35:24,272][367454] Avg episode reward: [(0, '3435.139')] [2023-03-08 09:35:24,374][367737] Updated weights for policy 0, policy_version 118640 (0.0005) [2023-03-08 09:35:27,887][367737] Updated weights for policy 0, policy_version 118720 (0.0005) [2023-03-08 09:35:29,271][367454] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 13259.9). Total num frames: 60796928. Throughput: 0: 12006.3. Samples: 60767932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:35:29,272][367454] Avg episode reward: [(0, '3509.778')] [2023-03-08 09:35:31,423][367737] Updated weights for policy 0, policy_version 118800 (0.0005) [2023-03-08 09:35:34,272][367454] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 13232.2). Total num frames: 60858368. Throughput: 0: 11898.9. Samples: 60837008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:35:34,272][367454] Avg episode reward: [(0, '3241.041')] [2023-03-08 09:35:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000118864_60858368.pth... [2023-03-08 09:35:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000118168_60502016.pth [2023-03-08 09:35:34,841][367737] Updated weights for policy 0, policy_version 118880 (0.0005) [2023-03-08 09:35:38,264][367737] Updated weights for policy 0, policy_version 118960 (0.0005) [2023-03-08 09:35:39,271][367454] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 13190.5). Total num frames: 60915712. Throughput: 0: 11889.4. Samples: 60909116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:35:39,272][367454] Avg episode reward: [(0, '3395.025')] [2023-03-08 09:35:41,903][367737] Updated weights for policy 0, policy_version 119040 (0.0005) [2023-03-08 09:35:44,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 13148.9). Total num frames: 60973056. Throughput: 0: 11829.3. Samples: 60943200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:35:44,272][367454] Avg episode reward: [(0, '3554.881')] [2023-03-08 09:35:45,475][367737] Updated weights for policy 0, policy_version 119120 (0.0004) [2023-03-08 09:35:48,999][367737] Updated weights for policy 0, policy_version 119200 (0.0005) [2023-03-08 09:35:49,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 13107.2). Total num frames: 61030400. Throughput: 0: 11759.1. Samples: 61011736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:35:49,272][367454] Avg episode reward: [(0, '3498.089')] [2023-03-08 09:35:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000119200_61030400.pth... [2023-03-08 09:35:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000118520_60682240.pth [2023-03-08 09:35:52,524][367737] Updated weights for policy 0, policy_version 119280 (0.0005) [2023-03-08 09:35:54,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11741.9, 300 sec: 13065.5). Total num frames: 61087744. Throughput: 0: 11701.1. Samples: 61081164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:35:54,272][367454] Avg episode reward: [(0, '3275.603')] [2023-03-08 09:35:56,110][367737] Updated weights for policy 0, policy_version 119360 (0.0005) [2023-03-08 09:35:59,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 13023.9). Total num frames: 61145088. Throughput: 0: 11713.9. Samples: 61116332. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:35:59,272][367454] Avg episode reward: [(0, '3131.268')] [2023-03-08 09:35:59,774][367737] Updated weights for policy 0, policy_version 119440 (0.0005) [2023-03-08 09:36:03,460][367737] Updated weights for policy 0, policy_version 119520 (0.0005) [2023-03-08 09:36:04,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 12982.2). Total num frames: 61202432. Throughput: 0: 11564.5. Samples: 61182164. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:36:04,272][367454] Avg episode reward: [(0, '3475.090')] [2023-03-08 09:36:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000119536_61202432.pth... [2023-03-08 09:36:04,279][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000118864_60858368.pth [2023-03-08 09:36:07,003][367737] Updated weights for policy 0, policy_version 119600 (0.0005) [2023-03-08 09:36:09,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12954.5). Total num frames: 61259776. Throughput: 0: 11548.1. Samples: 61251592. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:36:09,272][367454] Avg episode reward: [(0, '3472.012')] [2023-03-08 09:36:10,504][367737] Updated weights for policy 0, policy_version 119680 (0.0005) [2023-03-08 09:36:14,095][367737] Updated weights for policy 0, policy_version 119760 (0.0005) [2023-03-08 09:36:14,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 12912.8). Total num frames: 61317120. Throughput: 0: 11526.1. Samples: 61286608. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:36:14,272][367454] Avg episode reward: [(0, '3608.230')] [2023-03-08 09:36:17,559][367737] Updated weights for policy 0, policy_version 119840 (0.0005) [2023-03-08 09:36:19,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 12871.2). Total num frames: 61374464. Throughput: 0: 11545.3. Samples: 61356548. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:36:19,272][367454] Avg episode reward: [(0, '3488.280')] [2023-03-08 09:36:19,310][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000119880_61378560.pth... [2023-03-08 09:36:19,312][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000119200_61030400.pth [2023-03-08 09:36:21,048][367737] Updated weights for policy 0, policy_version 119920 (0.0005) [2023-03-08 09:36:24,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 12843.4). Total num frames: 61435904. Throughput: 0: 11504.0. Samples: 61426796. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:36:24,272][367454] Avg episode reward: [(0, '3668.990')] [2023-03-08 09:36:24,586][367737] Updated weights for policy 0, policy_version 120000 (0.0005) [2023-03-08 09:36:28,051][367737] Updated weights for policy 0, policy_version 120080 (0.0003) [2023-03-08 09:36:29,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 12801.7). Total num frames: 61493248. Throughput: 0: 11498.6. Samples: 61460636. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:36:29,272][367454] Avg episode reward: [(0, '3743.181')] [2023-03-08 09:36:31,722][367737] Updated weights for policy 0, policy_version 120160 (0.0005) [2023-03-08 09:36:34,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 12760.1). Total num frames: 61550592. Throughput: 0: 11519.5. Samples: 61530112. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:36:34,272][367454] Avg episode reward: [(0, '3372.265')] [2023-03-08 09:36:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000120216_61550592.pth... [2023-03-08 09:36:34,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000119536_61202432.pth [2023-03-08 09:36:35,255][367737] Updated weights for policy 0, policy_version 120240 (0.0005) [2023-03-08 09:36:38,796][367737] Updated weights for policy 0, policy_version 120320 (0.0005) [2023-03-08 09:36:39,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 12732.3). Total num frames: 61607936. Throughput: 0: 11522.8. Samples: 61599688. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:36:39,282][367454] Avg episode reward: [(0, '3411.030')] [2023-03-08 09:36:42,304][367737] Updated weights for policy 0, policy_version 120400 (0.0005) [2023-03-08 09:36:44,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 12676.8). Total num frames: 61665280. Throughput: 0: 11506.1. Samples: 61634108. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:36:44,282][367454] Avg episode reward: [(0, '3627.356')] [2023-03-08 09:36:45,839][367737] Updated weights for policy 0, policy_version 120480 (0.0005) [2023-03-08 09:36:49,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 12649.0). Total num frames: 61722624. Throughput: 0: 11589.0. Samples: 61703668. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:36:49,282][367454] Avg episode reward: [(0, '3934.444')] [2023-03-08 09:36:49,327][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000120560_61726720.pth... [2023-03-08 09:36:49,328][367737] Updated weights for policy 0, policy_version 120560 (0.0005) [2023-03-08 09:36:49,330][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000119880_61378560.pth [2023-03-08 09:36:52,936][367737] Updated weights for policy 0, policy_version 120640 (0.0005) [2023-03-08 09:36:54,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 12607.4). Total num frames: 61779968. Throughput: 0: 11573.2. Samples: 61772384. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 09:36:54,282][367454] Avg episode reward: [(0, '3734.884')] [2023-03-08 09:36:56,335][367737] Updated weights for policy 0, policy_version 120720 (0.0005) [2023-03-08 09:36:59,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 12579.6). Total num frames: 61841408. Throughput: 0: 11610.3. Samples: 61809072. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:36:59,282][367454] Avg episode reward: [(0, '4054.487')] [2023-03-08 09:36:59,746][367737] Updated weights for policy 0, policy_version 120800 (0.0005) [2023-03-08 09:37:03,235][367737] Updated weights for policy 0, policy_version 120880 (0.0005) [2023-03-08 09:37:04,271][367454] Fps is (10 sec: 11878.3, 60 sec: 11605.4, 300 sec: 12537.9). Total num frames: 61898752. Throughput: 0: 11656.9. Samples: 61881108. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:37:04,282][367454] Avg episode reward: [(0, '4129.763')] [2023-03-08 09:37:04,285][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000120904_61902848.pth... [2023-03-08 09:37:04,287][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000120216_61550592.pth [2023-03-08 09:37:06,737][367737] Updated weights for policy 0, policy_version 120960 (0.0005) [2023-03-08 09:37:09,271][367454] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 12510.2). Total num frames: 61960192. Throughput: 0: 11660.6. Samples: 61951524. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:37:09,282][367454] Avg episode reward: [(0, '4090.399')] [2023-03-08 09:37:10,143][367737] Updated weights for policy 0, policy_version 121040 (0.0005) [2023-03-08 09:37:13,678][367737] Updated weights for policy 0, policy_version 121120 (0.0005) [2023-03-08 09:37:14,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 12468.5). Total num frames: 62017536. Throughput: 0: 11705.3. Samples: 61987376. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:37:14,283][367454] Avg episode reward: [(0, '4187.315')] [2023-03-08 09:37:17,203][367737] Updated weights for policy 0, policy_version 121200 (0.0005) [2023-03-08 09:37:19,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 12426.8). Total num frames: 62074880. Throughput: 0: 11707.4. Samples: 62056944. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:37:19,283][367454] Avg episode reward: [(0, '3817.789')] [2023-03-08 09:37:19,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000121248_62078976.pth... [2023-03-08 09:37:19,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000120560_61726720.pth [2023-03-08 09:37:20,622][367737] Updated weights for policy 0, policy_version 121280 (0.0005) [2023-03-08 09:37:24,106][367737] Updated weights for policy 0, policy_version 121360 (0.0005) [2023-03-08 09:37:24,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 12426.8). Total num frames: 62136320. Throughput: 0: 11743.4. Samples: 62128140. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:37:24,282][367454] Avg episode reward: [(0, '3969.692')] [2023-03-08 09:37:27,643][367737] Updated weights for policy 0, policy_version 121440 (0.0005) [2023-03-08 09:37:29,272][367454] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 12413.0). Total num frames: 62193664. Throughput: 0: 11750.1. Samples: 62162864. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:37:29,282][367454] Avg episode reward: [(0, '3940.083')] [2023-03-08 09:37:31,260][367737] Updated weights for policy 0, policy_version 121520 (0.0005) [2023-03-08 09:37:34,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12371.3). Total num frames: 62251008. Throughput: 0: 11718.2. Samples: 62230988. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:37:34,282][367454] Avg episode reward: [(0, '3964.914')] [2023-03-08 09:37:34,285][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000121584_62251008.pth... [2023-03-08 09:37:34,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000120904_61902848.pth [2023-03-08 09:37:34,774][367737] Updated weights for policy 0, policy_version 121600 (0.0005) [2023-03-08 09:37:38,424][367737] Updated weights for policy 0, policy_version 121680 (0.0005) [2023-03-08 09:37:39,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12315.8). Total num frames: 62308352. Throughput: 0: 11728.5. Samples: 62300168. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:37:39,272][367454] Avg episode reward: [(0, '3671.502')] [2023-03-08 09:37:41,971][367737] Updated weights for policy 0, policy_version 121760 (0.0005) [2023-03-08 09:37:44,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 12301.9). Total num frames: 62365696. Throughput: 0: 11653.4. Samples: 62333476. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:37:44,272][367454] Avg episode reward: [(0, '3900.190')] [2023-03-08 09:37:45,566][367737] Updated weights for policy 0, policy_version 121840 (0.0004) [2023-03-08 09:37:49,209][367737] Updated weights for policy 0, policy_version 121920 (0.0005) [2023-03-08 09:37:49,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12260.2). Total num frames: 62423040. Throughput: 0: 11588.1. Samples: 62402572. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:37:49,272][367454] Avg episode reward: [(0, '3737.687')] [2023-03-08 09:37:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000121920_62423040.pth... [2023-03-08 09:37:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000121248_62078976.pth [2023-03-08 09:37:52,841][367737] Updated weights for policy 0, policy_version 122000 (0.0005) [2023-03-08 09:37:54,271][367454] Fps is (10 sec: 11059.2, 60 sec: 11605.3, 300 sec: 12218.6). Total num frames: 62476288. Throughput: 0: 11539.3. Samples: 62470792. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:37:54,272][367454] Avg episode reward: [(0, '3822.358')] [2023-03-08 09:37:56,438][367737] Updated weights for policy 0, policy_version 122080 (0.0005) [2023-03-08 09:37:59,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12190.8). Total num frames: 62537728. Throughput: 0: 11501.9. Samples: 62504960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:37:59,272][367454] Avg episode reward: [(0, '4002.570')] [2023-03-08 09:37:59,902][367737] Updated weights for policy 0, policy_version 122160 (0.0005) [2023-03-08 09:38:03,256][367737] Updated weights for policy 0, policy_version 122240 (0.0004) [2023-03-08 09:38:04,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 12163.0). Total num frames: 62595072. Throughput: 0: 11559.1. Samples: 62577104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:38:04,272][367454] Avg episode reward: [(0, '4111.094')] [2023-03-08 09:38:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000122256_62595072.pth... [2023-03-08 09:38:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000121584_62251008.pth [2023-03-08 09:38:06,917][367737] Updated weights for policy 0, policy_version 122320 (0.0005) [2023-03-08 09:38:09,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 12135.3). Total num frames: 62652416. Throughput: 0: 11470.1. Samples: 62644296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:38:09,272][367454] Avg episode reward: [(0, '3958.683')] [2023-03-08 09:38:10,476][367737] Updated weights for policy 0, policy_version 122400 (0.0005) [2023-03-08 09:38:13,988][367737] Updated weights for policy 0, policy_version 122480 (0.0005) [2023-03-08 09:38:14,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 12121.4). Total num frames: 62709760. Throughput: 0: 11487.6. Samples: 62679804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:38:14,272][367454] Avg episode reward: [(0, '4071.360')] [2023-03-08 09:38:17,536][367737] Updated weights for policy 0, policy_version 122560 (0.0005) [2023-03-08 09:38:19,271][367454] Fps is (10 sec: 11878.4, 60 sec: 11605.4, 300 sec: 12107.5). Total num frames: 62771200. Throughput: 0: 11524.5. Samples: 62749588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:38:19,272][367454] Avg episode reward: [(0, '4057.161')] [2023-03-08 09:38:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000122600_62771200.pth... [2023-03-08 09:38:19,279][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000121920_62423040.pth [2023-03-08 09:38:21,027][367737] Updated weights for policy 0, policy_version 122640 (0.0005) [2023-03-08 09:38:24,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 12052.0). Total num frames: 62824448. Throughput: 0: 11526.3. Samples: 62818852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:38:24,272][367454] Avg episode reward: [(0, '4205.104')] [2023-03-08 09:38:24,671][367737] Updated weights for policy 0, policy_version 122720 (0.0005) [2023-03-08 09:38:28,261][367737] Updated weights for policy 0, policy_version 122800 (0.0005) [2023-03-08 09:38:29,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 12024.2). Total num frames: 62885888. Throughput: 0: 11540.8. Samples: 62852812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:38:29,272][367454] Avg episode reward: [(0, '4176.983')] [2023-03-08 09:38:31,562][367737] Updated weights for policy 0, policy_version 122880 (0.0005) [2023-03-08 09:38:34,272][367454] Fps is (10 sec: 12287.9, 60 sec: 11605.3, 300 sec: 11996.4). Total num frames: 62947328. Throughput: 0: 11611.9. Samples: 62925108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:38:34,272][367454] Avg episode reward: [(0, '4220.103')] [2023-03-08 09:38:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000122944_62947328.pth... [2023-03-08 09:38:34,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000122256_62595072.pth [2023-03-08 09:38:34,854][367737] Updated weights for policy 0, policy_version 122960 (0.0005) [2023-03-08 09:38:38,035][367737] Updated weights for policy 0, policy_version 123040 (0.0005) [2023-03-08 09:38:39,271][367454] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 11968.7). Total num frames: 63008768. Throughput: 0: 11774.4. Samples: 63000640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:38:39,272][367454] Avg episode reward: [(0, '4227.335')] [2023-03-08 09:38:41,242][367737] Updated weights for policy 0, policy_version 123120 (0.0004) [2023-03-08 09:38:44,271][367454] Fps is (10 sec: 12697.7, 60 sec: 11810.1, 300 sec: 11954.8). Total num frames: 63074304. Throughput: 0: 11877.3. Samples: 63039436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:38:44,272][367454] Avg episode reward: [(0, '4141.163')] [2023-03-08 09:38:44,416][367737] Updated weights for policy 0, policy_version 123200 (0.0005) [2023-03-08 09:38:47,703][367737] Updated weights for policy 0, policy_version 123280 (0.0004) [2023-03-08 09:38:49,271][367454] Fps is (10 sec: 12697.6, 60 sec: 11878.4, 300 sec: 11940.9). Total num frames: 63135744. Throughput: 0: 11963.2. Samples: 63115448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:38:49,272][367454] Avg episode reward: [(0, '4010.602')] [2023-03-08 09:38:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000123312_63135744.pth... [2023-03-08 09:38:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000122600_62771200.pth [2023-03-08 09:38:51,040][367737] Updated weights for policy 0, policy_version 123360 (0.0004) [2023-03-08 09:38:54,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11927.0). Total num frames: 63197184. Throughput: 0: 12087.8. Samples: 63188248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:38:54,272][367454] Avg episode reward: [(0, '4211.874')] [2023-03-08 09:38:54,483][367737] Updated weights for policy 0, policy_version 123440 (0.0005) [2023-03-08 09:38:57,851][367737] Updated weights for policy 0, policy_version 123520 (0.0005) [2023-03-08 09:38:59,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11913.1). Total num frames: 63258624. Throughput: 0: 12109.4. Samples: 63224728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:38:59,272][367454] Avg episode reward: [(0, '4231.233')] [2023-03-08 09:39:01,316][367737] Updated weights for policy 0, policy_version 123600 (0.0005) [2023-03-08 09:39:04,271][367454] Fps is (10 sec: 11878.4, 60 sec: 12015.0, 300 sec: 11885.3). Total num frames: 63315968. Throughput: 0: 12141.9. Samples: 63295972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:39:04,272][367454] Avg episode reward: [(0, '4309.065')] [2023-03-08 09:39:04,299][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000123672_63320064.pth... [2023-03-08 09:39:04,302][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000122944_62947328.pth [2023-03-08 09:39:04,606][367737] Updated weights for policy 0, policy_version 123680 (0.0004) [2023-03-08 09:39:08,002][367737] Updated weights for policy 0, policy_version 123760 (0.0005) [2023-03-08 09:39:09,271][367454] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11857.6). Total num frames: 63377408. Throughput: 0: 12231.9. Samples: 63369288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:39:09,272][367454] Avg episode reward: [(0, '4296.441')] [2023-03-08 09:39:11,434][367737] Updated weights for policy 0, policy_version 123840 (0.0005) [2023-03-08 09:39:14,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11857.6). Total num frames: 63438848. Throughput: 0: 12294.9. Samples: 63406080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:39:14,272][367454] Avg episode reward: [(0, '4318.103')] [2023-03-08 09:39:14,936][367737] Updated weights for policy 0, policy_version 123920 (0.0005) [2023-03-08 09:39:18,435][367737] Updated weights for policy 0, policy_version 124000 (0.0005) [2023-03-08 09:39:19,271][367454] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11843.7). Total num frames: 63496192. Throughput: 0: 12235.8. Samples: 63475720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:39:19,272][367454] Avg episode reward: [(0, '4444.158')] [2023-03-08 09:39:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000124016_63496192.pth... [2023-03-08 09:39:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000123312_63135744.pth [2023-03-08 09:39:19,278][367693] Saving new best policy, reward=4444.158! [2023-03-08 09:39:22,002][367737] Updated weights for policy 0, policy_version 124080 (0.0005) [2023-03-08 09:39:24,271][367454] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 11802.0). Total num frames: 63553536. Throughput: 0: 12104.0. Samples: 63545320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:39:24,272][367454] Avg episode reward: [(0, '4238.943')] [2023-03-08 09:39:25,586][367737] Updated weights for policy 0, policy_version 124160 (0.0006) [2023-03-08 09:39:29,050][367737] Updated weights for policy 0, policy_version 124240 (0.0005) [2023-03-08 09:39:29,271][367454] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 11788.2). Total num frames: 63610880. Throughput: 0: 11992.3. Samples: 63579088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:39:29,272][367454] Avg episode reward: [(0, '4387.322')] [2023-03-08 09:39:32,596][367737] Updated weights for policy 0, policy_version 124320 (0.0006) [2023-03-08 09:39:34,271][367454] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11760.4). Total num frames: 63668224. Throughput: 0: 11874.9. Samples: 63649816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:39:34,272][367454] Avg episode reward: [(0, '4351.930')] [2023-03-08 09:39:34,338][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000124360_63672320.pth... [2023-03-08 09:39:34,340][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000123672_63320064.pth [2023-03-08 09:39:35,933][367737] Updated weights for policy 0, policy_version 124400 (0.0005) [2023-03-08 09:39:39,214][367737] Updated weights for policy 0, policy_version 124480 (0.0005) [2023-03-08 09:39:39,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11774.3). Total num frames: 63733760. Throughput: 0: 11895.9. Samples: 63723564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:39:39,272][367454] Avg episode reward: [(0, '4224.119')] [2023-03-08 09:39:42,488][367737] Updated weights for policy 0, policy_version 124560 (0.0004) [2023-03-08 09:39:44,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12014.9, 300 sec: 11774.3). Total num frames: 63795200. Throughput: 0: 11948.3. Samples: 63762404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:39:44,283][367454] Avg episode reward: [(0, '4416.650')] [2023-03-08 09:39:45,896][367737] Updated weights for policy 0, policy_version 124640 (0.0005) [2023-03-08 09:39:49,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11760.4). Total num frames: 63852544. Throughput: 0: 11926.8. Samples: 63832680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:39:49,282][367454] Avg episode reward: [(0, '4222.036')] [2023-03-08 09:39:49,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000124712_63852544.pth... [2023-03-08 09:39:49,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000124016_63496192.pth [2023-03-08 09:39:49,405][367737] Updated weights for policy 0, policy_version 124720 (0.0005) [2023-03-08 09:39:52,676][367737] Updated weights for policy 0, policy_version 124800 (0.0004) [2023-03-08 09:39:54,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11760.4). Total num frames: 63913984. Throughput: 0: 11929.6. Samples: 63906120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:39:54,282][367454] Avg episode reward: [(0, '4377.731')] [2023-03-08 09:39:55,949][367737] Updated weights for policy 0, policy_version 124880 (0.0004) [2023-03-08 09:39:59,129][367737] Updated weights for policy 0, policy_version 124960 (0.0004) [2023-03-08 09:39:59,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11788.1). Total num frames: 63979520. Throughput: 0: 11948.2. Samples: 63943748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:39:59,282][367454] Avg episode reward: [(0, '4185.457')] [2023-03-08 09:40:02,332][367737] Updated weights for policy 0, policy_version 125040 (0.0004) [2023-03-08 09:40:04,272][367454] Fps is (10 sec: 13107.1, 60 sec: 12151.4, 300 sec: 11802.0). Total num frames: 64045056. Throughput: 0: 12116.5. Samples: 64020964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:40:04,272][367454] Avg episode reward: [(0, '4092.500')] [2023-03-08 09:40:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000125088_64045056.pth... [2023-03-08 09:40:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000124360_63672320.pth [2023-03-08 09:40:05,524][367737] Updated weights for policy 0, policy_version 125120 (0.0004) [2023-03-08 09:40:08,796][367737] Updated weights for policy 0, policy_version 125200 (0.0004) [2023-03-08 09:40:09,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 11802.0). Total num frames: 64106496. Throughput: 0: 12273.4. Samples: 64097624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:40:09,272][367454] Avg episode reward: [(0, '4408.496')] [2023-03-08 09:40:11,946][367737] Updated weights for policy 0, policy_version 125280 (0.0003) [2023-03-08 09:40:14,271][367454] Fps is (10 sec: 12697.7, 60 sec: 12219.7, 300 sec: 11829.8). Total num frames: 64172032. Throughput: 0: 12367.5. Samples: 64135628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:40:14,272][367454] Avg episode reward: [(0, '4076.066')] [2023-03-08 09:40:15,125][367737] Updated weights for policy 0, policy_version 125360 (0.0004) [2023-03-08 09:40:18,260][367737] Updated weights for policy 0, policy_version 125440 (0.0004) [2023-03-08 09:40:19,272][367454] Fps is (10 sec: 13107.2, 60 sec: 12356.3, 300 sec: 11857.6). Total num frames: 64237568. Throughput: 0: 12541.0. Samples: 64214160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:40:19,272][367454] Avg episode reward: [(0, '4195.738')] [2023-03-08 09:40:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000125464_64237568.pth... [2023-03-08 09:40:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000124712_63852544.pth [2023-03-08 09:40:21,594][367737] Updated weights for policy 0, policy_version 125520 (0.0004) [2023-03-08 09:40:24,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 11871.5). Total num frames: 64299008. Throughput: 0: 12557.0. Samples: 64288628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:40:24,272][367454] Avg episode reward: [(0, '4352.300')] [2023-03-08 09:40:24,886][367737] Updated weights for policy 0, policy_version 125600 (0.0004) [2023-03-08 09:40:28,206][367737] Updated weights for policy 0, policy_version 125680 (0.0004) [2023-03-08 09:40:29,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 11871.5). Total num frames: 64360448. Throughput: 0: 12512.8. Samples: 64325480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:40:29,272][367454] Avg episode reward: [(0, '4155.517')] [2023-03-08 09:40:31,351][367737] Updated weights for policy 0, policy_version 125760 (0.0003) [2023-03-08 09:40:34,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 11885.3). Total num frames: 64421888. Throughput: 0: 12653.6. Samples: 64402092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:40:34,272][367454] Avg episode reward: [(0, '4251.848')] [2023-03-08 09:40:34,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000125824_64421888.pth... [2023-03-08 09:40:34,276][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000125088_64045056.pth [2023-03-08 09:40:34,649][367737] Updated weights for policy 0, policy_version 125840 (0.0004) [2023-03-08 09:40:37,963][367737] Updated weights for policy 0, policy_version 125920 (0.0004) [2023-03-08 09:40:39,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 11913.1). Total num frames: 64487424. Throughput: 0: 12669.2. Samples: 64476232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:40:39,272][367454] Avg episode reward: [(0, '4271.004')] [2023-03-08 09:40:41,280][367737] Updated weights for policy 0, policy_version 126000 (0.0004) [2023-03-08 09:40:44,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12492.8, 300 sec: 11913.1). Total num frames: 64544768. Throughput: 0: 12656.7. Samples: 64513300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:40:44,272][367454] Avg episode reward: [(0, '4280.496')] [2023-03-08 09:40:44,625][367737] Updated weights for policy 0, policy_version 126080 (0.0004) [2023-03-08 09:40:47,826][367737] Updated weights for policy 0, policy_version 126160 (0.0004) [2023-03-08 09:40:49,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12629.3, 300 sec: 11940.9). Total num frames: 64610304. Throughput: 0: 12612.7. Samples: 64588536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:40:49,272][367454] Avg episode reward: [(0, '4290.458')] [2023-03-08 09:40:49,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000126192_64610304.pth... [2023-03-08 09:40:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000125464_64237568.pth [2023-03-08 09:40:51,002][367737] Updated weights for policy 0, policy_version 126240 (0.0004) [2023-03-08 09:40:54,123][367737] Updated weights for policy 0, policy_version 126320 (0.0004) [2023-03-08 09:40:54,272][367454] Fps is (10 sec: 13107.2, 60 sec: 12697.6, 300 sec: 11968.7). Total num frames: 64675840. Throughput: 0: 12635.2. Samples: 64666208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:40:54,272][367454] Avg episode reward: [(0, '4275.236')] [2023-03-08 09:40:57,283][367737] Updated weights for policy 0, policy_version 126400 (0.0004) [2023-03-08 09:40:59,272][367454] Fps is (10 sec: 13107.2, 60 sec: 12697.6, 300 sec: 11996.4). Total num frames: 64741376. Throughput: 0: 12651.6. Samples: 64704948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:40:59,272][367454] Avg episode reward: [(0, '4184.351')] [2023-03-08 09:41:00,412][367737] Updated weights for policy 0, policy_version 126480 (0.0004) [2023-03-08 09:41:03,512][367737] Updated weights for policy 0, policy_version 126560 (0.0003) [2023-03-08 09:41:04,271][367454] Fps is (10 sec: 13107.3, 60 sec: 12697.6, 300 sec: 12024.2). Total num frames: 64806912. Throughput: 0: 12656.2. Samples: 64783688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:41:04,272][367454] Avg episode reward: [(0, '3936.331')] [2023-03-08 09:41:04,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000126576_64806912.pth... [2023-03-08 09:41:04,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000125824_64421888.pth [2023-03-08 09:41:06,600][367737] Updated weights for policy 0, policy_version 126640 (0.0004) [2023-03-08 09:41:09,271][367454] Fps is (10 sec: 13107.3, 60 sec: 12765.9, 300 sec: 12052.0). Total num frames: 64872448. Throughput: 0: 12778.0. Samples: 64863640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:41:09,272][367454] Avg episode reward: [(0, '3825.928')] [2023-03-08 09:41:09,715][367737] Updated weights for policy 0, policy_version 126720 (0.0003) [2023-03-08 09:41:12,887][367737] Updated weights for policy 0, policy_version 126800 (0.0004) [2023-03-08 09:41:14,271][367454] Fps is (10 sec: 13107.2, 60 sec: 12765.9, 300 sec: 12079.7). Total num frames: 64937984. Throughput: 0: 12820.2. Samples: 64902388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:41:14,272][367454] Avg episode reward: [(0, '4340.272')] [2023-03-08 09:41:16,143][367737] Updated weights for policy 0, policy_version 126880 (0.0005) [2023-03-08 09:41:19,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12629.3, 300 sec: 12065.8). Total num frames: 64995328. Throughput: 0: 12799.5. Samples: 64978072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:41:19,272][367454] Avg episode reward: [(0, '4243.647')] [2023-03-08 09:41:19,312][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000126952_64999424.pth... [2023-03-08 09:41:19,314][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000126192_64610304.pth [2023-03-08 09:41:19,629][367737] Updated weights for policy 0, policy_version 126960 (0.0005) [2023-03-08 09:41:22,986][367737] Updated weights for policy 0, policy_version 127040 (0.0005) [2023-03-08 09:41:24,272][367454] Fps is (10 sec: 11878.3, 60 sec: 12629.3, 300 sec: 12079.7). Total num frames: 65056768. Throughput: 0: 12732.4. Samples: 65049192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:41:24,272][367454] Avg episode reward: [(0, '4174.708')] [2023-03-08 09:41:26,517][367737] Updated weights for policy 0, policy_version 127120 (0.0005) [2023-03-08 09:41:29,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12561.1, 300 sec: 12079.7). Total num frames: 65114112. Throughput: 0: 12692.7. Samples: 65084472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:41:29,272][367454] Avg episode reward: [(0, '3967.634')] [2023-03-08 09:41:30,003][367737] Updated weights for policy 0, policy_version 127200 (0.0005) [2023-03-08 09:41:33,392][367737] Updated weights for policy 0, policy_version 127280 (0.0005) [2023-03-08 09:41:34,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12561.1, 300 sec: 12093.6). Total num frames: 65175552. Throughput: 0: 12591.3. Samples: 65155144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:41:34,272][367454] Avg episode reward: [(0, '4375.826')] [2023-03-08 09:41:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000127296_65175552.pth... [2023-03-08 09:41:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000126576_64806912.pth [2023-03-08 09:41:36,894][367737] Updated weights for policy 0, policy_version 127360 (0.0005) [2023-03-08 09:41:39,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 12093.6). Total num frames: 65232896. Throughput: 0: 12412.4. Samples: 65224768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:41:39,272][367454] Avg episode reward: [(0, '4245.133')] [2023-03-08 09:41:40,512][367737] Updated weights for policy 0, policy_version 127440 (0.0005) [2023-03-08 09:41:43,943][367737] Updated weights for policy 0, policy_version 127520 (0.0005) [2023-03-08 09:41:44,271][367454] Fps is (10 sec: 11468.9, 60 sec: 12424.5, 300 sec: 12093.6). Total num frames: 65290240. Throughput: 0: 12339.7. Samples: 65260232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:41:44,272][367454] Avg episode reward: [(0, '4264.758')] [2023-03-08 09:41:47,198][367737] Updated weights for policy 0, policy_version 127600 (0.0005) [2023-03-08 09:41:49,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12121.4). Total num frames: 65355776. Throughput: 0: 12224.7. Samples: 65333800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:41:49,272][367454] Avg episode reward: [(0, '4430.064')] [2023-03-08 09:41:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000127648_65355776.pth... [2023-03-08 09:41:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000126952_64999424.pth [2023-03-08 09:41:50,361][367737] Updated weights for policy 0, policy_version 127680 (0.0005) [2023-03-08 09:41:53,508][367737] Updated weights for policy 0, policy_version 127760 (0.0003) [2023-03-08 09:41:54,271][367454] Fps is (10 sec: 13107.2, 60 sec: 12424.5, 300 sec: 12135.3). Total num frames: 65421312. Throughput: 0: 12172.1. Samples: 65411384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:41:54,272][367454] Avg episode reward: [(0, '4444.357')] [2023-03-08 09:41:54,272][367693] Saving new best policy, reward=4444.357! [2023-03-08 09:41:56,720][367737] Updated weights for policy 0, policy_version 127840 (0.0003) [2023-03-08 09:41:59,271][367454] Fps is (10 sec: 12697.7, 60 sec: 12356.3, 300 sec: 12149.2). Total num frames: 65482752. Throughput: 0: 12167.7. Samples: 65449936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:41:59,272][367454] Avg episode reward: [(0, '4258.030')] [2023-03-08 09:41:59,872][367737] Updated weights for policy 0, policy_version 127920 (0.0004) [2023-03-08 09:42:03,122][367737] Updated weights for policy 0, policy_version 128000 (0.0005) [2023-03-08 09:42:04,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12356.2, 300 sec: 12163.0). Total num frames: 65548288. Throughput: 0: 12204.6. Samples: 65527280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:42:04,272][367454] Avg episode reward: [(0, '4111.612')] [2023-03-08 09:42:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000128024_65548288.pth... [2023-03-08 09:42:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000127296_65175552.pth [2023-03-08 09:42:06,407][367737] Updated weights for policy 0, policy_version 128080 (0.0005) [2023-03-08 09:42:09,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 12176.9). Total num frames: 65609728. Throughput: 0: 12275.7. Samples: 65601600. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:42:09,272][367454] Avg episode reward: [(0, '4015.009')] [2023-03-08 09:42:09,730][367737] Updated weights for policy 0, policy_version 128160 (0.0005) [2023-03-08 09:42:12,980][367737] Updated weights for policy 0, policy_version 128240 (0.0005) [2023-03-08 09:42:14,271][367454] Fps is (10 sec: 12288.2, 60 sec: 12219.7, 300 sec: 12190.8). Total num frames: 65671168. Throughput: 0: 12319.8. Samples: 65638864. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:42:14,272][367454] Avg episode reward: [(0, '4229.204')] [2023-03-08 09:42:16,292][367737] Updated weights for policy 0, policy_version 128320 (0.0005) [2023-03-08 09:42:19,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12356.3, 300 sec: 12204.7). Total num frames: 65736704. Throughput: 0: 12418.5. Samples: 65713976. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:42:19,272][367454] Avg episode reward: [(0, '4351.543')] [2023-03-08 09:42:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000128392_65736704.pth... [2023-03-08 09:42:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000127648_65355776.pth [2023-03-08 09:42:19,386][367737] Updated weights for policy 0, policy_version 128400 (0.0004) [2023-03-08 09:42:22,553][367737] Updated weights for policy 0, policy_version 128480 (0.0004) [2023-03-08 09:42:24,272][367454] Fps is (10 sec: 13107.1, 60 sec: 12424.5, 300 sec: 12232.5). Total num frames: 65802240. Throughput: 0: 12615.4. Samples: 65792460. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:42:24,272][367454] Avg episode reward: [(0, '4385.417')] [2023-03-08 09:42:25,871][367737] Updated weights for policy 0, policy_version 128560 (0.0005) [2023-03-08 09:42:29,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12424.6, 300 sec: 12232.5). Total num frames: 65859584. Throughput: 0: 12642.9. Samples: 65829160. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:42:29,272][367454] Avg episode reward: [(0, '4311.555')] [2023-03-08 09:42:29,378][367737] Updated weights for policy 0, policy_version 128640 (0.0005) [2023-03-08 09:42:32,924][367737] Updated weights for policy 0, policy_version 128720 (0.0005) [2023-03-08 09:42:34,271][367454] Fps is (10 sec: 11468.9, 60 sec: 12356.3, 300 sec: 12232.5). Total num frames: 65916928. Throughput: 0: 12556.9. Samples: 65898860. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:42:34,272][367454] Avg episode reward: [(0, '4482.799')] [2023-03-08 09:42:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000128744_65916928.pth... [2023-03-08 09:42:34,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000128024_65548288.pth [2023-03-08 09:42:34,278][367693] Saving new best policy, reward=4482.799! [2023-03-08 09:42:36,518][367737] Updated weights for policy 0, policy_version 128800 (0.0005) [2023-03-08 09:42:39,271][367454] Fps is (10 sec: 11468.8, 60 sec: 12356.3, 300 sec: 12232.5). Total num frames: 65974272. Throughput: 0: 12361.5. Samples: 65967652. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:42:39,272][367454] Avg episode reward: [(0, '4389.696')] [2023-03-08 09:42:40,102][367737] Updated weights for policy 0, policy_version 128880 (0.0005) [2023-03-08 09:42:43,705][367737] Updated weights for policy 0, policy_version 128960 (0.0005) [2023-03-08 09:42:44,272][367454] Fps is (10 sec: 11468.8, 60 sec: 12356.3, 300 sec: 12232.5). Total num frames: 66031616. Throughput: 0: 12254.4. Samples: 66001384. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:42:44,272][367454] Avg episode reward: [(0, '4440.031')] [2023-03-08 09:42:47,257][367737] Updated weights for policy 0, policy_version 129040 (0.0005) [2023-03-08 09:42:49,271][367454] Fps is (10 sec: 11468.8, 60 sec: 12219.7, 300 sec: 12246.3). Total num frames: 66088960. Throughput: 0: 12064.2. Samples: 66070168. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:42:49,272][367454] Avg episode reward: [(0, '4352.638')] [2023-03-08 09:42:49,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000129080_66088960.pth... [2023-03-08 09:42:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000128392_65736704.pth [2023-03-08 09:42:50,758][367737] Updated weights for policy 0, policy_version 129120 (0.0005) [2023-03-08 09:42:54,008][367737] Updated weights for policy 0, policy_version 129200 (0.0004) [2023-03-08 09:42:54,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12246.3). Total num frames: 66150400. Throughput: 0: 12014.9. Samples: 66142272. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:42:54,272][367454] Avg episode reward: [(0, '4544.806')] [2023-03-08 09:42:54,272][367693] Saving new best policy, reward=4544.806! [2023-03-08 09:42:57,380][367737] Updated weights for policy 0, policy_version 129280 (0.0005) [2023-03-08 09:42:59,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 12260.2). Total num frames: 66211840. Throughput: 0: 12006.0. Samples: 66179136. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:42:59,272][367454] Avg episode reward: [(0, '4414.822')] [2023-03-08 09:43:00,616][367737] Updated weights for policy 0, policy_version 129360 (0.0005) [2023-03-08 09:43:03,857][367737] Updated weights for policy 0, policy_version 129440 (0.0005) [2023-03-08 09:43:04,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12151.5, 300 sec: 12288.0). Total num frames: 66277376. Throughput: 0: 12037.1. Samples: 66255648. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:43:04,272][367454] Avg episode reward: [(0, '4327.872')] [2023-03-08 09:43:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000129448_66277376.pth... [2023-03-08 09:43:04,279][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000128744_65916928.pth [2023-03-08 09:43:07,072][367737] Updated weights for policy 0, policy_version 129520 (0.0005) [2023-03-08 09:43:09,272][367454] Fps is (10 sec: 13107.2, 60 sec: 12219.7, 300 sec: 12315.8). Total num frames: 66342912. Throughput: 0: 11978.0. Samples: 66331472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:43:09,272][367454] Avg episode reward: [(0, '4412.446')] [2023-03-08 09:43:10,205][367737] Updated weights for policy 0, policy_version 129600 (0.0004) [2023-03-08 09:43:13,462][367737] Updated weights for policy 0, policy_version 129680 (0.0005) [2023-03-08 09:43:14,272][367454] Fps is (10 sec: 12697.7, 60 sec: 12219.7, 300 sec: 12315.8). Total num frames: 66404352. Throughput: 0: 12023.0. Samples: 66370196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:43:14,272][367454] Avg episode reward: [(0, '4252.191')] [2023-03-08 09:43:16,608][367737] Updated weights for policy 0, policy_version 129760 (0.0004) [2023-03-08 09:43:19,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 12357.4). Total num frames: 66469888. Throughput: 0: 12190.0. Samples: 66447412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:43:19,272][367454] Avg episode reward: [(0, '4453.923')] [2023-03-08 09:43:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000129824_66469888.pth... [2023-03-08 09:43:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000129080_66088960.pth [2023-03-08 09:43:19,806][367737] Updated weights for policy 0, policy_version 129840 (0.0005) [2023-03-08 09:43:23,003][367737] Updated weights for policy 0, policy_version 129920 (0.0004) [2023-03-08 09:43:24,271][367454] Fps is (10 sec: 12697.7, 60 sec: 12151.5, 300 sec: 12357.4). Total num frames: 66531328. Throughput: 0: 12361.0. Samples: 66523896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:43:24,272][367454] Avg episode reward: [(0, '4467.094')] [2023-03-08 09:43:26,201][367737] Updated weights for policy 0, policy_version 130000 (0.0005) [2023-03-08 09:43:29,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 12371.3). Total num frames: 66596864. Throughput: 0: 12471.5. Samples: 66562600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:43:29,272][367454] Avg episode reward: [(0, '4361.858')] [2023-03-08 09:43:29,476][367737] Updated weights for policy 0, policy_version 130080 (0.0005) [2023-03-08 09:43:32,642][367737] Updated weights for policy 0, policy_version 130160 (0.0004) [2023-03-08 09:43:34,272][367454] Fps is (10 sec: 13107.1, 60 sec: 12424.5, 300 sec: 12385.2). Total num frames: 66662400. Throughput: 0: 12632.3. Samples: 66638624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:43:34,272][367454] Avg episode reward: [(0, '4396.942')] [2023-03-08 09:43:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000130200_66662400.pth... [2023-03-08 09:43:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000129448_66277376.pth [2023-03-08 09:43:35,912][367737] Updated weights for policy 0, policy_version 130240 (0.0005) [2023-03-08 09:43:39,223][367737] Updated weights for policy 0, policy_version 130320 (0.0005) [2023-03-08 09:43:39,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12371.3). Total num frames: 66723840. Throughput: 0: 12697.2. Samples: 66713644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:43:39,272][367454] Avg episode reward: [(0, '4213.521')] [2023-03-08 09:43:42,453][367737] Updated weights for policy 0, policy_version 130400 (0.0005) [2023-03-08 09:43:44,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12371.3). Total num frames: 66785280. Throughput: 0: 12729.7. Samples: 66751972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:43:44,272][367454] Avg episode reward: [(0, '4022.624')] [2023-03-08 09:43:45,681][367737] Updated weights for policy 0, policy_version 130480 (0.0004) [2023-03-08 09:43:48,842][367737] Updated weights for policy 0, policy_version 130560 (0.0004) [2023-03-08 09:43:49,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12697.6, 300 sec: 12385.2). Total num frames: 66850816. Throughput: 0: 12711.6. Samples: 66827668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:43:49,272][367454] Avg episode reward: [(0, '4303.641')] [2023-03-08 09:43:49,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000130568_66850816.pth... [2023-03-08 09:43:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000129824_66469888.pth [2023-03-08 09:43:52,081][367737] Updated weights for policy 0, policy_version 130640 (0.0004) [2023-03-08 09:43:54,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12697.6, 300 sec: 12385.2). Total num frames: 66912256. Throughput: 0: 12725.7. Samples: 66904128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:43:54,272][367454] Avg episode reward: [(0, '4292.334')] [2023-03-08 09:43:55,385][367737] Updated weights for policy 0, policy_version 130720 (0.0005) [2023-03-08 09:43:58,655][367737] Updated weights for policy 0, policy_version 130800 (0.0005) [2023-03-08 09:43:59,272][367454] Fps is (10 sec: 12697.7, 60 sec: 12765.9, 300 sec: 12413.0). Total num frames: 66977792. Throughput: 0: 12684.4. Samples: 66940992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:43:59,272][367454] Avg episode reward: [(0, '4386.916')] [2023-03-08 09:44:01,860][367737] Updated weights for policy 0, policy_version 130880 (0.0005) [2023-03-08 09:44:04,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12697.6, 300 sec: 12413.0). Total num frames: 67039232. Throughput: 0: 12673.9. Samples: 67017736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:44:04,272][367454] Avg episode reward: [(0, '4488.116')] [2023-03-08 09:44:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000130936_67039232.pth... [2023-03-08 09:44:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000130200_66662400.pth [2023-03-08 09:44:05,090][367737] Updated weights for policy 0, policy_version 130960 (0.0005) [2023-03-08 09:44:08,284][367737] Updated weights for policy 0, policy_version 131040 (0.0005) [2023-03-08 09:44:09,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12629.3, 300 sec: 12413.0). Total num frames: 67100672. Throughput: 0: 12662.3. Samples: 67093700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:44:09,272][367454] Avg episode reward: [(0, '4397.408')] [2023-03-08 09:44:11,665][367737] Updated weights for policy 0, policy_version 131120 (0.0005) [2023-03-08 09:44:14,271][367454] Fps is (10 sec: 12697.7, 60 sec: 12697.6, 300 sec: 12440.7). Total num frames: 67166208. Throughput: 0: 12614.1. Samples: 67130232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:44:14,272][367454] Avg episode reward: [(0, '4305.371')] [2023-03-08 09:44:14,848][367737] Updated weights for policy 0, policy_version 131200 (0.0004) [2023-03-08 09:44:18,087][367737] Updated weights for policy 0, policy_version 131280 (0.0004) [2023-03-08 09:44:19,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12454.6). Total num frames: 67227648. Throughput: 0: 12633.0. Samples: 67207108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:44:19,272][367454] Avg episode reward: [(0, '4424.590')] [2023-03-08 09:44:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000131304_67227648.pth... [2023-03-08 09:44:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000130568_66850816.pth [2023-03-08 09:44:21,359][367737] Updated weights for policy 0, policy_version 131360 (0.0004) [2023-03-08 09:44:24,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12629.3, 300 sec: 12468.5). Total num frames: 67289088. Throughput: 0: 12607.9. Samples: 67281000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:44:24,272][367454] Avg episode reward: [(0, '4278.473')] [2023-03-08 09:44:24,672][367737] Updated weights for policy 0, policy_version 131440 (0.0005) [2023-03-08 09:44:28,190][367737] Updated weights for policy 0, policy_version 131520 (0.0005) [2023-03-08 09:44:29,271][367454] Fps is (10 sec: 11878.5, 60 sec: 12492.8, 300 sec: 12468.5). Total num frames: 67346432. Throughput: 0: 12574.5. Samples: 67317824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:44:29,272][367454] Avg episode reward: [(0, '4415.180')] [2023-03-08 09:44:31,767][367737] Updated weights for policy 0, policy_version 131600 (0.0005) [2023-03-08 09:44:34,272][367454] Fps is (10 sec: 11468.6, 60 sec: 12356.3, 300 sec: 12440.7). Total num frames: 67403776. Throughput: 0: 12424.4. Samples: 67386764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:44:34,272][367454] Avg episode reward: [(0, '4309.941')] [2023-03-08 09:44:34,281][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000131656_67407872.pth... [2023-03-08 09:44:34,283][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000130936_67039232.pth [2023-03-08 09:44:35,359][367737] Updated weights for policy 0, policy_version 131680 (0.0005) [2023-03-08 09:44:38,902][367737] Updated weights for policy 0, policy_version 131760 (0.0005) [2023-03-08 09:44:39,272][367454] Fps is (10 sec: 11878.3, 60 sec: 12356.3, 300 sec: 12440.7). Total num frames: 67465216. Throughput: 0: 12256.9. Samples: 67455688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:44:39,272][367454] Avg episode reward: [(0, '4301.632')] [2023-03-08 09:44:42,365][367737] Updated weights for policy 0, policy_version 131840 (0.0005) [2023-03-08 09:44:44,272][367454] Fps is (10 sec: 11878.5, 60 sec: 12288.0, 300 sec: 12440.7). Total num frames: 67522560. Throughput: 0: 12197.2. Samples: 67489864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:44:44,272][367454] Avg episode reward: [(0, '4247.593')] [2023-03-08 09:44:45,728][367737] Updated weights for policy 0, policy_version 131920 (0.0004) [2023-03-08 09:44:49,017][367737] Updated weights for policy 0, policy_version 132000 (0.0005) [2023-03-08 09:44:49,272][367454] Fps is (10 sec: 11878.3, 60 sec: 12219.7, 300 sec: 12440.7). Total num frames: 67584000. Throughput: 0: 12128.8. Samples: 67563532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:44:49,272][367454] Avg episode reward: [(0, '4269.452')] [2023-03-08 09:44:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000132000_67584000.pth... [2023-03-08 09:44:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000131304_67227648.pth [2023-03-08 09:44:52,289][367737] Updated weights for policy 0, policy_version 132080 (0.0004) [2023-03-08 09:44:54,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12219.7, 300 sec: 12426.9). Total num frames: 67645440. Throughput: 0: 12112.6. Samples: 67638764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:44:54,272][367454] Avg episode reward: [(0, '4187.475')] [2023-03-08 09:44:55,678][367737] Updated weights for policy 0, policy_version 132160 (0.0005) [2023-03-08 09:44:59,127][367737] Updated weights for policy 0, policy_version 132240 (0.0005) [2023-03-08 09:44:59,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 12413.0). Total num frames: 67706880. Throughput: 0: 12087.6. Samples: 67674176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:44:59,272][367454] Avg episode reward: [(0, '4019.246')] [2023-03-08 09:45:02,632][367737] Updated weights for policy 0, policy_version 132320 (0.0005) [2023-03-08 09:45:04,272][367454] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 12399.1). Total num frames: 67764224. Throughput: 0: 11948.9. Samples: 67744808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:45:04,272][367454] Avg episode reward: [(0, '3918.542')] [2023-03-08 09:45:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000132352_67764224.pth... [2023-03-08 09:45:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000131656_67407872.pth [2023-03-08 09:45:06,059][367737] Updated weights for policy 0, policy_version 132400 (0.0005) [2023-03-08 09:45:09,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 12385.2). Total num frames: 67825664. Throughput: 0: 11877.2. Samples: 67815476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:45:09,272][367454] Avg episode reward: [(0, '3773.483')] [2023-03-08 09:45:09,594][367737] Updated weights for policy 0, policy_version 132480 (0.0005) [2023-03-08 09:45:12,929][367737] Updated weights for policy 0, policy_version 132560 (0.0005) [2023-03-08 09:45:14,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12014.9, 300 sec: 12371.3). Total num frames: 67887104. Throughput: 0: 11855.2. Samples: 67851308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:45:14,272][367454] Avg episode reward: [(0, '3887.380')] [2023-03-08 09:45:16,055][367737] Updated weights for policy 0, policy_version 132640 (0.0004) [2023-03-08 09:45:19,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 12371.3). Total num frames: 67948544. Throughput: 0: 12028.5. Samples: 67928044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:45:19,272][367454] Avg episode reward: [(0, '3856.133')] [2023-03-08 09:45:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000132712_67948544.pth... [2023-03-08 09:45:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000132000_67584000.pth [2023-03-08 09:45:19,559][367737] Updated weights for policy 0, policy_version 132720 (0.0005) [2023-03-08 09:45:22,974][367737] Updated weights for policy 0, policy_version 132800 (0.0005) [2023-03-08 09:45:24,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11946.6, 300 sec: 12357.4). Total num frames: 68005888. Throughput: 0: 12064.8. Samples: 67998604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:45:24,272][367454] Avg episode reward: [(0, '3957.340')] [2023-03-08 09:45:26,350][367737] Updated weights for policy 0, policy_version 132880 (0.0005) [2023-03-08 09:45:29,271][367454] Fps is (10 sec: 11878.5, 60 sec: 12014.9, 300 sec: 12357.4). Total num frames: 68067328. Throughput: 0: 12108.1. Samples: 68034728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:45:29,272][367454] Avg episode reward: [(0, '4095.845')] [2023-03-08 09:45:29,646][367737] Updated weights for policy 0, policy_version 132960 (0.0003) [2023-03-08 09:45:32,851][367737] Updated weights for policy 0, policy_version 133040 (0.0003) [2023-03-08 09:45:34,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 12357.4). Total num frames: 68132864. Throughput: 0: 12161.0. Samples: 68110776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:45:34,272][367454] Avg episode reward: [(0, '4105.794')] [2023-03-08 09:45:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000133072_68132864.pth... [2023-03-08 09:45:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000132352_67764224.pth [2023-03-08 09:45:36,199][367737] Updated weights for policy 0, policy_version 133120 (0.0003) [2023-03-08 09:45:39,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 12357.4). Total num frames: 68190208. Throughput: 0: 12105.2. Samples: 68183500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:45:39,272][367454] Avg episode reward: [(0, '4272.760')] [2023-03-08 09:45:39,650][367737] Updated weights for policy 0, policy_version 133200 (0.0003) [2023-03-08 09:45:43,128][367737] Updated weights for policy 0, policy_version 133280 (0.0003) [2023-03-08 09:45:44,271][367454] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12343.5). Total num frames: 68251648. Throughput: 0: 12088.2. Samples: 68218144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:45:44,272][367454] Avg episode reward: [(0, '4308.832')] [2023-03-08 09:45:46,551][367737] Updated weights for policy 0, policy_version 133360 (0.0003) [2023-03-08 09:45:49,271][367454] Fps is (10 sec: 12287.9, 60 sec: 12151.5, 300 sec: 12329.7). Total num frames: 68313088. Throughput: 0: 12128.5. Samples: 68290588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:45:49,272][367454] Avg episode reward: [(0, '4201.937')] [2023-03-08 09:45:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000133424_68313088.pth... [2023-03-08 09:45:49,276][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000132712_67948544.pth [2023-03-08 09:45:49,903][367737] Updated weights for policy 0, policy_version 133440 (0.0004) [2023-03-08 09:45:53,320][367737] Updated weights for policy 0, policy_version 133520 (0.0005) [2023-03-08 09:45:54,272][367454] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 12301.9). Total num frames: 68370432. Throughput: 0: 12164.5. Samples: 68362880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:45:54,272][367454] Avg episode reward: [(0, '4253.289')] [2023-03-08 09:45:56,906][367737] Updated weights for policy 0, policy_version 133600 (0.0005) [2023-03-08 09:45:59,271][367454] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 12274.1). Total num frames: 68427776. Throughput: 0: 12150.7. Samples: 68398088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:45:59,272][367454] Avg episode reward: [(0, '4376.084')] [2023-03-08 09:46:00,530][367737] Updated weights for policy 0, policy_version 133680 (0.0005) [2023-03-08 09:46:04,146][367737] Updated weights for policy 0, policy_version 133760 (0.0005) [2023-03-08 09:46:04,272][367454] Fps is (10 sec: 11468.7, 60 sec: 12014.9, 300 sec: 12246.3). Total num frames: 68485120. Throughput: 0: 11925.8. Samples: 68464704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:46:04,272][367454] Avg episode reward: [(0, '4001.617')] [2023-03-08 09:46:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000133760_68485120.pth... [2023-03-08 09:46:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000133072_68132864.pth [2023-03-08 09:46:07,846][367737] Updated weights for policy 0, policy_version 133840 (0.0006) [2023-03-08 09:46:09,271][367454] Fps is (10 sec: 11059.2, 60 sec: 11878.4, 300 sec: 12204.7). Total num frames: 68538368. Throughput: 0: 11857.8. Samples: 68532204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:46:09,272][367454] Avg episode reward: [(0, '4197.676')] [2023-03-08 09:46:11,406][367737] Updated weights for policy 0, policy_version 133920 (0.0005) [2023-03-08 09:46:14,271][367454] Fps is (10 sec: 11059.4, 60 sec: 11810.1, 300 sec: 12204.7). Total num frames: 68595712. Throughput: 0: 11829.4. Samples: 68567052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:46:14,272][367454] Avg episode reward: [(0, '4325.277')] [2023-03-08 09:46:15,061][367737] Updated weights for policy 0, policy_version 134000 (0.0006) [2023-03-08 09:46:18,732][367737] Updated weights for policy 0, policy_version 134080 (0.0005) [2023-03-08 09:46:19,271][367454] Fps is (10 sec: 11468.7, 60 sec: 11741.9, 300 sec: 12190.8). Total num frames: 68653056. Throughput: 0: 11626.7. Samples: 68633976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:46:19,272][367454] Avg episode reward: [(0, '4165.665')] [2023-03-08 09:46:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000134088_68653056.pth... [2023-03-08 09:46:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000133424_68313088.pth [2023-03-08 09:46:22,398][367737] Updated weights for policy 0, policy_version 134160 (0.0005) [2023-03-08 09:46:24,271][367454] Fps is (10 sec: 11468.7, 60 sec: 11741.9, 300 sec: 12190.8). Total num frames: 68710400. Throughput: 0: 11495.4. Samples: 68700792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:46:24,272][367454] Avg episode reward: [(0, '4026.182')] [2023-03-08 09:46:26,035][367737] Updated weights for policy 0, policy_version 134240 (0.0005) [2023-03-08 09:46:29,271][367454] Fps is (10 sec: 11059.3, 60 sec: 11605.3, 300 sec: 12163.0). Total num frames: 68763648. Throughput: 0: 11486.6. Samples: 68735040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:46:29,272][367454] Avg episode reward: [(0, '4268.146')] [2023-03-08 09:46:29,751][367737] Updated weights for policy 0, policy_version 134320 (0.0005) [2023-03-08 09:46:33,310][367737] Updated weights for policy 0, policy_version 134400 (0.0004) [2023-03-08 09:46:34,271][367454] Fps is (10 sec: 11059.2, 60 sec: 11468.8, 300 sec: 12163.0). Total num frames: 68820992. Throughput: 0: 11340.9. Samples: 68800928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:46:34,272][367454] Avg episode reward: [(0, '4091.103')] [2023-03-08 09:46:34,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000134416_68820992.pth... [2023-03-08 09:46:34,276][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000133760_68485120.pth [2023-03-08 09:46:36,670][367737] Updated weights for policy 0, policy_version 134480 (0.0005) [2023-03-08 09:46:39,271][367454] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 12176.9). Total num frames: 68882432. Throughput: 0: 11358.1. Samples: 68873992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:46:39,272][367454] Avg episode reward: [(0, '4171.506')] [2023-03-08 09:46:40,290][367737] Updated weights for policy 0, policy_version 134560 (0.0005) [2023-03-08 09:46:43,857][367737] Updated weights for policy 0, policy_version 134640 (0.0005) [2023-03-08 09:46:44,271][367454] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 12149.2). Total num frames: 68939776. Throughput: 0: 11344.9. Samples: 68908608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:46:44,272][367454] Avg episode reward: [(0, '4170.873')] [2023-03-08 09:46:47,548][367737] Updated weights for policy 0, policy_version 134720 (0.0005) [2023-03-08 09:46:49,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 12121.4). Total num frames: 68997120. Throughput: 0: 11352.4. Samples: 68975560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:46:49,272][367454] Avg episode reward: [(0, '4241.977')] [2023-03-08 09:46:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000134760_68997120.pth... [2023-03-08 09:46:49,279][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000134088_68653056.pth [2023-03-08 09:46:50,946][367737] Updated weights for policy 0, policy_version 134800 (0.0004) [2023-03-08 09:46:54,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 12107.5). Total num frames: 69054464. Throughput: 0: 11430.0. Samples: 69046556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:46:54,272][367454] Avg episode reward: [(0, '4171.218')] [2023-03-08 09:46:54,437][367737] Updated weights for policy 0, policy_version 134880 (0.0004) [2023-03-08 09:46:58,167][367737] Updated weights for policy 0, policy_version 134960 (0.0005) [2023-03-08 09:46:59,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11400.5, 300 sec: 12079.7). Total num frames: 69111808. Throughput: 0: 11398.9. Samples: 69080004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:46:59,272][367454] Avg episode reward: [(0, '4283.546')] [2023-03-08 09:47:01,751][367737] Updated weights for policy 0, policy_version 135040 (0.0004) [2023-03-08 09:47:04,272][367454] Fps is (10 sec: 11059.1, 60 sec: 11332.3, 300 sec: 12052.0). Total num frames: 69165056. Throughput: 0: 11431.0. Samples: 69148372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:47:04,272][367454] Avg episode reward: [(0, '4343.815')] [2023-03-08 09:47:04,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000135096_69169152.pth... [2023-03-08 09:47:04,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000134416_68820992.pth [2023-03-08 09:47:05,347][367737] Updated weights for policy 0, policy_version 135120 (0.0005) [2023-03-08 09:47:08,619][367737] Updated weights for policy 0, policy_version 135200 (0.0003) [2023-03-08 09:47:09,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 12052.0). Total num frames: 69226496. Throughput: 0: 11523.5. Samples: 69219352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:47:09,272][367454] Avg episode reward: [(0, '4271.477')] [2023-03-08 09:47:12,021][367737] Updated weights for policy 0, policy_version 135280 (0.0004) [2023-03-08 09:47:14,271][367454] Fps is (10 sec: 12288.1, 60 sec: 11537.1, 300 sec: 12038.1). Total num frames: 69287936. Throughput: 0: 11559.8. Samples: 69255232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:47:14,272][367454] Avg episode reward: [(0, '4282.863')] [2023-03-08 09:47:15,406][367737] Updated weights for policy 0, policy_version 135360 (0.0004) [2023-03-08 09:47:18,687][367737] Updated weights for policy 0, policy_version 135440 (0.0004) [2023-03-08 09:47:19,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11605.3, 300 sec: 12024.2). Total num frames: 69349376. Throughput: 0: 11739.0. Samples: 69329184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:47:19,272][367454] Avg episode reward: [(0, '4339.631')] [2023-03-08 09:47:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000135448_69349376.pth... [2023-03-08 09:47:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000134760_68997120.pth [2023-03-08 09:47:22,384][367737] Updated weights for policy 0, policy_version 135520 (0.0005) [2023-03-08 09:47:24,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 12024.2). Total num frames: 69406720. Throughput: 0: 11654.3. Samples: 69398436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:47:24,272][367454] Avg episode reward: [(0, '4246.571')] [2023-03-08 09:47:25,917][367737] Updated weights for policy 0, policy_version 135600 (0.0005) [2023-03-08 09:47:29,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12024.2). Total num frames: 69464064. Throughput: 0: 11639.6. Samples: 69432392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:47:29,272][367454] Avg episode reward: [(0, '4275.894')] [2023-03-08 09:47:29,586][367737] Updated weights for policy 0, policy_version 135680 (0.0004) [2023-03-08 09:47:33,074][367737] Updated weights for policy 0, policy_version 135760 (0.0004) [2023-03-08 09:47:34,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12024.2). Total num frames: 69521408. Throughput: 0: 11674.0. Samples: 69500892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:47:34,272][367454] Avg episode reward: [(0, '4389.772')] [2023-03-08 09:47:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000135784_69521408.pth... [2023-03-08 09:47:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000135096_69169152.pth [2023-03-08 09:47:36,506][367737] Updated weights for policy 0, policy_version 135840 (0.0004) [2023-03-08 09:47:39,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12024.2). Total num frames: 69578752. Throughput: 0: 11656.1. Samples: 69571080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:47:39,272][367454] Avg episode reward: [(0, '4518.634')] [2023-03-08 09:47:40,111][367737] Updated weights for policy 0, policy_version 135920 (0.0005) [2023-03-08 09:47:43,702][367737] Updated weights for policy 0, policy_version 136000 (0.0005) [2023-03-08 09:47:44,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12024.2). Total num frames: 69636096. Throughput: 0: 11706.9. Samples: 69606812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:47:44,272][367454] Avg episode reward: [(0, '4314.547')] [2023-03-08 09:47:47,316][367737] Updated weights for policy 0, policy_version 136080 (0.0005) [2023-03-08 09:47:49,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12010.3). Total num frames: 69693440. Throughput: 0: 11672.1. Samples: 69673616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:47:49,272][367454] Avg episode reward: [(0, '4513.511')] [2023-03-08 09:47:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000136120_69693440.pth... [2023-03-08 09:47:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000135448_69349376.pth [2023-03-08 09:47:50,746][367737] Updated weights for policy 0, policy_version 136160 (0.0005) [2023-03-08 09:47:53,940][367737] Updated weights for policy 0, policy_version 136240 (0.0004) [2023-03-08 09:47:54,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 12024.2). Total num frames: 69758976. Throughput: 0: 11738.8. Samples: 69747600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:47:54,272][367454] Avg episode reward: [(0, '4449.094')] [2023-03-08 09:47:57,219][367737] Updated weights for policy 0, policy_version 136320 (0.0005) [2023-03-08 09:47:59,272][367454] Fps is (10 sec: 12697.6, 60 sec: 11810.1, 300 sec: 12010.3). Total num frames: 69820416. Throughput: 0: 11779.3. Samples: 69785300. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:47:59,272][367454] Avg episode reward: [(0, '4354.815')] [2023-03-08 09:48:00,485][367737] Updated weights for policy 0, policy_version 136400 (0.0004) [2023-03-08 09:48:03,757][367737] Updated weights for policy 0, policy_version 136480 (0.0004) [2023-03-08 09:48:04,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11996.4). Total num frames: 69881856. Throughput: 0: 11801.9. Samples: 69860268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:48:04,281][367454] Avg episode reward: [(0, '4415.143')] [2023-03-08 09:48:04,285][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000136488_69881856.pth... [2023-03-08 09:48:04,287][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000135784_69521408.pth [2023-03-08 09:48:06,918][367737] Updated weights for policy 0, policy_version 136560 (0.0003) [2023-03-08 09:48:09,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 12010.3). Total num frames: 69947392. Throughput: 0: 11976.4. Samples: 69937376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:48:09,283][367454] Avg episode reward: [(0, '4516.126')] [2023-03-08 09:48:10,262][367737] Updated weights for policy 0, policy_version 136640 (0.0004) [2023-03-08 09:48:13,503][367737] Updated weights for policy 0, policy_version 136720 (0.0004) [2023-03-08 09:48:14,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11996.4). Total num frames: 70008832. Throughput: 0: 12043.9. Samples: 69974368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:48:14,282][367454] Avg episode reward: [(0, '4562.180')] [2023-03-08 09:48:14,283][367693] Saving new best policy, reward=4562.180! [2023-03-08 09:48:16,836][367737] Updated weights for policy 0, policy_version 136800 (0.0004) [2023-03-08 09:48:19,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11996.4). Total num frames: 70070272. Throughput: 0: 12176.9. Samples: 70048852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:48:19,283][367454] Avg episode reward: [(0, '4513.574')] [2023-03-08 09:48:19,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000136856_70070272.pth... [2023-03-08 09:48:19,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000136120_69693440.pth [2023-03-08 09:48:20,117][367737] Updated weights for policy 0, policy_version 136880 (0.0004) [2023-03-08 09:48:23,343][367737] Updated weights for policy 0, policy_version 136960 (0.0004) [2023-03-08 09:48:24,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12083.2, 300 sec: 11982.5). Total num frames: 70131712. Throughput: 0: 12282.7. Samples: 70123800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:48:24,272][367454] Avg episode reward: [(0, '4619.296')] [2023-03-08 09:48:24,305][367693] Saving new best policy, reward=4619.296! [2023-03-08 09:48:26,646][367737] Updated weights for policy 0, policy_version 137040 (0.0005) [2023-03-08 09:48:29,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11968.7). Total num frames: 70193152. Throughput: 0: 12322.3. Samples: 70161316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:48:29,272][367454] Avg episode reward: [(0, '4481.687')] [2023-03-08 09:48:30,000][367737] Updated weights for policy 0, policy_version 137120 (0.0005) [2023-03-08 09:48:33,583][367737] Updated weights for policy 0, policy_version 137200 (0.0005) [2023-03-08 09:48:34,272][367454] Fps is (10 sec: 11878.3, 60 sec: 12151.5, 300 sec: 11954.8). Total num frames: 70250496. Throughput: 0: 12432.4. Samples: 70233076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:48:34,272][367454] Avg episode reward: [(0, '4492.709')] [2023-03-08 09:48:34,302][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000137216_70254592.pth... [2023-03-08 09:48:34,303][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000136488_69881856.pth [2023-03-08 09:48:37,177][367737] Updated weights for policy 0, policy_version 137280 (0.0004) [2023-03-08 09:48:39,271][367454] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 11954.8). Total num frames: 70311936. Throughput: 0: 12331.0. Samples: 70302496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:48:39,272][367454] Avg episode reward: [(0, '4594.626')] [2023-03-08 09:48:40,712][367737] Updated weights for policy 0, policy_version 137360 (0.0005) [2023-03-08 09:48:44,121][367737] Updated weights for policy 0, policy_version 137440 (0.0004) [2023-03-08 09:48:44,272][367454] Fps is (10 sec: 11878.5, 60 sec: 12219.7, 300 sec: 11927.0). Total num frames: 70369280. Throughput: 0: 12249.2. Samples: 70336512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:48:44,272][367454] Avg episode reward: [(0, '4539.872')] [2023-03-08 09:48:47,633][367737] Updated weights for policy 0, policy_version 137520 (0.0005) [2023-03-08 09:48:49,272][367454] Fps is (10 sec: 11468.7, 60 sec: 12219.7, 300 sec: 11913.1). Total num frames: 70426624. Throughput: 0: 12154.8. Samples: 70407232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:48:49,283][367454] Avg episode reward: [(0, '4511.722')] [2023-03-08 09:48:49,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000137552_70426624.pth... [2023-03-08 09:48:49,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000136856_70070272.pth [2023-03-08 09:48:51,112][367737] Updated weights for policy 0, policy_version 137600 (0.0005) [2023-03-08 09:48:54,271][367454] Fps is (10 sec: 11468.9, 60 sec: 12083.2, 300 sec: 11885.3). Total num frames: 70483968. Throughput: 0: 11988.0. Samples: 70476836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:48:54,283][367454] Avg episode reward: [(0, '4513.679')] [2023-03-08 09:48:54,755][367737] Updated weights for policy 0, policy_version 137680 (0.0005) [2023-03-08 09:48:58,223][367737] Updated weights for policy 0, policy_version 137760 (0.0004) [2023-03-08 09:48:59,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11885.3). Total num frames: 70545408. Throughput: 0: 11932.3. Samples: 70511320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:48:59,282][367454] Avg episode reward: [(0, '4593.078')] [2023-03-08 09:49:01,730][367737] Updated weights for policy 0, policy_version 137840 (0.0005) [2023-03-08 09:49:04,272][367454] Fps is (10 sec: 11878.2, 60 sec: 12014.9, 300 sec: 11871.5). Total num frames: 70602752. Throughput: 0: 11853.8. Samples: 70582272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:49:04,283][367454] Avg episode reward: [(0, '4400.288')] [2023-03-08 09:49:04,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000137896_70602752.pth... [2023-03-08 09:49:04,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000137216_70254592.pth [2023-03-08 09:49:05,186][367737] Updated weights for policy 0, policy_version 137920 (0.0005) [2023-03-08 09:49:08,491][367737] Updated weights for policy 0, policy_version 138000 (0.0005) [2023-03-08 09:49:09,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11857.6). Total num frames: 70664192. Throughput: 0: 11802.5. Samples: 70654912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:49:09,283][367454] Avg episode reward: [(0, '4450.231')] [2023-03-08 09:49:11,664][367737] Updated weights for policy 0, policy_version 138080 (0.0004) [2023-03-08 09:49:14,272][367454] Fps is (10 sec: 12697.7, 60 sec: 12014.9, 300 sec: 11871.5). Total num frames: 70729728. Throughput: 0: 11813.8. Samples: 70692936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:49:14,282][367454] Avg episode reward: [(0, '4522.385')] [2023-03-08 09:49:14,924][367737] Updated weights for policy 0, policy_version 138160 (0.0004) [2023-03-08 09:49:18,240][367737] Updated weights for policy 0, policy_version 138240 (0.0003) [2023-03-08 09:49:19,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11871.5). Total num frames: 70791168. Throughput: 0: 11906.8. Samples: 70768880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:49:19,282][367454] Avg episode reward: [(0, '4537.238')] [2023-03-08 09:49:19,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000138264_70791168.pth... [2023-03-08 09:49:19,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000137552_70426624.pth [2023-03-08 09:49:21,535][367737] Updated weights for policy 0, policy_version 138320 (0.0004) [2023-03-08 09:49:24,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11885.3). Total num frames: 70852608. Throughput: 0: 11993.2. Samples: 70842192. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:49:24,282][367454] Avg episode reward: [(0, '4582.054')] [2023-03-08 09:49:24,950][367737] Updated weights for policy 0, policy_version 138400 (0.0004) [2023-03-08 09:49:28,419][367737] Updated weights for policy 0, policy_version 138480 (0.0005) [2023-03-08 09:49:29,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11885.3). Total num frames: 70909952. Throughput: 0: 12038.5. Samples: 70878244. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:49:29,282][367454] Avg episode reward: [(0, '4529.466')] [2023-03-08 09:49:31,878][367737] Updated weights for policy 0, policy_version 138560 (0.0005) [2023-03-08 09:49:34,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11946.7, 300 sec: 11871.5). Total num frames: 70967296. Throughput: 0: 12041.1. Samples: 70949080. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:49:34,283][367454] Avg episode reward: [(0, '4596.429')] [2023-03-08 09:49:34,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000138616_70971392.pth... [2023-03-08 09:49:34,287][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000137896_70602752.pth [2023-03-08 09:49:35,315][367737] Updated weights for policy 0, policy_version 138640 (0.0005) [2023-03-08 09:49:38,900][367737] Updated weights for policy 0, policy_version 138720 (0.0005) [2023-03-08 09:49:39,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11885.3). Total num frames: 71028736. Throughput: 0: 12060.0. Samples: 71019536. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:49:39,272][367454] Avg episode reward: [(0, '4426.749')] [2023-03-08 09:49:42,418][367737] Updated weights for policy 0, policy_version 138800 (0.0005) [2023-03-08 09:49:44,272][367454] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 11871.5). Total num frames: 71086080. Throughput: 0: 12045.7. Samples: 71053376. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:49:44,272][367454] Avg episode reward: [(0, '4392.216')] [2023-03-08 09:49:45,998][367737] Updated weights for policy 0, policy_version 138880 (0.0005) [2023-03-08 09:49:49,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11857.6). Total num frames: 71143424. Throughput: 0: 12015.2. Samples: 71122956. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:49:49,272][367454] Avg episode reward: [(0, '4489.839')] [2023-03-08 09:49:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000138952_71143424.pth... [2023-03-08 09:49:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000138264_70791168.pth [2023-03-08 09:49:49,600][367737] Updated weights for policy 0, policy_version 138960 (0.0005) [2023-03-08 09:49:53,122][367737] Updated weights for policy 0, policy_version 139040 (0.0005) [2023-03-08 09:49:54,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11843.7). Total num frames: 71200768. Throughput: 0: 11940.3. Samples: 71192224. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:49:54,272][367454] Avg episode reward: [(0, '4530.186')] [2023-03-08 09:49:56,585][367737] Updated weights for policy 0, policy_version 139120 (0.0004) [2023-03-08 09:49:59,272][367454] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 11857.6). Total num frames: 71262208. Throughput: 0: 11871.6. Samples: 71227156. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:49:59,272][367454] Avg episode reward: [(0, '4498.259')] [2023-03-08 09:49:59,808][367737] Updated weights for policy 0, policy_version 139200 (0.0004) [2023-03-08 09:50:03,055][367737] Updated weights for policy 0, policy_version 139280 (0.0004) [2023-03-08 09:50:04,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12014.9, 300 sec: 11857.6). Total num frames: 71323648. Throughput: 0: 11874.5. Samples: 71303232. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:50:04,272][367454] Avg episode reward: [(0, '4479.392')] [2023-03-08 09:50:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000139304_71323648.pth... [2023-03-08 09:50:04,276][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000138616_70971392.pth [2023-03-08 09:50:06,284][367737] Updated weights for policy 0, policy_version 139360 (0.0004) [2023-03-08 09:50:09,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11857.6). Total num frames: 71385088. Throughput: 0: 11896.4. Samples: 71377528. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:50:09,272][367454] Avg episode reward: [(0, '4558.310')] [2023-03-08 09:50:09,671][367737] Updated weights for policy 0, policy_version 139440 (0.0004) [2023-03-08 09:50:13,008][367737] Updated weights for policy 0, policy_version 139520 (0.0004) [2023-03-08 09:50:14,272][367454] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11857.6). Total num frames: 71446528. Throughput: 0: 11931.7. Samples: 71415172. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:50:14,272][367454] Avg episode reward: [(0, '4461.102')] [2023-03-08 09:50:16,624][367737] Updated weights for policy 0, policy_version 139600 (0.0005) [2023-03-08 09:50:19,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11857.6). Total num frames: 71503872. Throughput: 0: 11881.5. Samples: 71483748. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:50:19,272][367454] Avg episode reward: [(0, '4493.906')] [2023-03-08 09:50:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000139656_71503872.pth... [2023-03-08 09:50:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000138952_71143424.pth [2023-03-08 09:50:20,188][367737] Updated weights for policy 0, policy_version 139680 (0.0005) [2023-03-08 09:50:23,638][367737] Updated weights for policy 0, policy_version 139760 (0.0005) [2023-03-08 09:50:24,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11857.6). Total num frames: 71565312. Throughput: 0: 11870.1. Samples: 71553692. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:50:24,272][367454] Avg episode reward: [(0, '4432.861')] [2023-03-08 09:50:26,836][367737] Updated weights for policy 0, policy_version 139840 (0.0003) [2023-03-08 09:50:29,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11843.7). Total num frames: 71626752. Throughput: 0: 11974.5. Samples: 71592228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:50:29,272][367454] Avg episode reward: [(0, '4626.786')] [2023-03-08 09:50:29,273][367693] Saving new best policy, reward=4626.786! [2023-03-08 09:50:30,239][367737] Updated weights for policy 0, policy_version 139920 (0.0004) [2023-03-08 09:50:33,656][367737] Updated weights for policy 0, policy_version 140000 (0.0005) [2023-03-08 09:50:34,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11843.7). Total num frames: 71684096. Throughput: 0: 12016.3. Samples: 71663688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:50:34,272][367454] Avg episode reward: [(0, '4551.945')] [2023-03-08 09:50:34,309][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000140016_71688192.pth... [2023-03-08 09:50:34,311][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000139304_71323648.pth [2023-03-08 09:50:36,976][367737] Updated weights for policy 0, policy_version 140080 (0.0004) [2023-03-08 09:50:39,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11857.6). Total num frames: 71749632. Throughput: 0: 12141.8. Samples: 71738604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:50:39,272][367454] Avg episode reward: [(0, '4409.538')] [2023-03-08 09:50:40,225][367737] Updated weights for policy 0, policy_version 140160 (0.0004) [2023-03-08 09:50:43,579][367737] Updated weights for policy 0, policy_version 140240 (0.0004) [2023-03-08 09:50:44,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12014.9, 300 sec: 11843.7). Total num frames: 71806976. Throughput: 0: 12218.2. Samples: 71776976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:50:44,272][367454] Avg episode reward: [(0, '4446.953')] [2023-03-08 09:50:47,227][367737] Updated weights for policy 0, policy_version 140320 (0.0005) [2023-03-08 09:50:49,272][367454] Fps is (10 sec: 11468.7, 60 sec: 12014.9, 300 sec: 11843.7). Total num frames: 71864320. Throughput: 0: 12060.8. Samples: 71845968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:50:49,272][367454] Avg episode reward: [(0, '4583.733')] [2023-03-08 09:50:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000140360_71864320.pth... [2023-03-08 09:50:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000139656_71503872.pth [2023-03-08 09:50:50,911][367737] Updated weights for policy 0, policy_version 140400 (0.0005) [2023-03-08 09:50:54,271][367454] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11843.7). Total num frames: 71921664. Throughput: 0: 11911.3. Samples: 71913536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:50:54,272][367454] Avg episode reward: [(0, '4506.181')] [2023-03-08 09:50:54,470][367737] Updated weights for policy 0, policy_version 140480 (0.0005) [2023-03-08 09:50:58,042][367737] Updated weights for policy 0, policy_version 140560 (0.0005) [2023-03-08 09:50:59,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11843.7). Total num frames: 71979008. Throughput: 0: 11847.0. Samples: 71948288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:50:59,272][367454] Avg episode reward: [(0, '4548.305')] [2023-03-08 09:51:01,524][367737] Updated weights for policy 0, policy_version 140640 (0.0005) [2023-03-08 09:51:04,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11871.5). Total num frames: 72040448. Throughput: 0: 11887.0. Samples: 72018664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:51:04,272][367454] Avg episode reward: [(0, '4401.500')] [2023-03-08 09:51:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000140704_72040448.pth... [2023-03-08 09:51:04,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000140016_71688192.pth [2023-03-08 09:51:04,811][367737] Updated weights for policy 0, policy_version 140720 (0.0004) [2023-03-08 09:51:08,127][367737] Updated weights for policy 0, policy_version 140800 (0.0004) [2023-03-08 09:51:09,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11885.3). Total num frames: 72101888. Throughput: 0: 11987.0. Samples: 72093108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:51:09,272][367454] Avg episode reward: [(0, '4373.968')] [2023-03-08 09:51:11,507][367737] Updated weights for policy 0, policy_version 140880 (0.0004) [2023-03-08 09:51:14,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11899.2). Total num frames: 72163328. Throughput: 0: 11940.8. Samples: 72129564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:51:14,283][367454] Avg episode reward: [(0, '4476.811')] [2023-03-08 09:51:14,901][367737] Updated weights for policy 0, policy_version 140960 (0.0005) [2023-03-08 09:51:18,178][367737] Updated weights for policy 0, policy_version 141040 (0.0005) [2023-03-08 09:51:19,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11913.1). Total num frames: 72224768. Throughput: 0: 11988.3. Samples: 72203160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:51:19,282][367454] Avg episode reward: [(0, '4565.749')] [2023-03-08 09:51:19,285][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000141064_72224768.pth... [2023-03-08 09:51:19,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000140360_71864320.pth [2023-03-08 09:51:21,559][367737] Updated weights for policy 0, policy_version 141120 (0.0004) [2023-03-08 09:51:24,271][367454] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11927.0). Total num frames: 72282112. Throughput: 0: 11908.1. Samples: 72274468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:51:24,272][367454] Avg episode reward: [(0, '4547.367')] [2023-03-08 09:51:24,967][367737] Updated weights for policy 0, policy_version 141200 (0.0005) [2023-03-08 09:51:28,233][367737] Updated weights for policy 0, policy_version 141280 (0.0004) [2023-03-08 09:51:29,271][367454] Fps is (10 sec: 12288.2, 60 sec: 12015.0, 300 sec: 11954.8). Total num frames: 72347648. Throughput: 0: 11885.8. Samples: 72311836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:51:29,282][367454] Avg episode reward: [(0, '4506.787')] [2023-03-08 09:51:31,599][367737] Updated weights for policy 0, policy_version 141360 (0.0004) [2023-03-08 09:51:34,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11940.9). Total num frames: 72404992. Throughput: 0: 11997.9. Samples: 72385872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:51:34,282][367454] Avg episode reward: [(0, '4495.742')] [2023-03-08 09:51:34,285][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000141416_72404992.pth... [2023-03-08 09:51:34,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000140704_72040448.pth [2023-03-08 09:51:34,978][367737] Updated weights for policy 0, policy_version 141440 (0.0005) [2023-03-08 09:51:38,323][367737] Updated weights for policy 0, policy_version 141520 (0.0005) [2023-03-08 09:51:39,271][367454] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11954.8). Total num frames: 72466432. Throughput: 0: 12117.9. Samples: 72458840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:51:39,282][367454] Avg episode reward: [(0, '4589.474')] [2023-03-08 09:51:41,783][367737] Updated weights for policy 0, policy_version 141600 (0.0004) [2023-03-08 09:51:44,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12014.9, 300 sec: 11968.6). Total num frames: 72527872. Throughput: 0: 12150.1. Samples: 72495044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:51:44,272][367454] Avg episode reward: [(0, '4502.989')] [2023-03-08 09:51:45,260][367737] Updated weights for policy 0, policy_version 141680 (0.0003) [2023-03-08 09:51:48,562][367737] Updated weights for policy 0, policy_version 141760 (0.0003) [2023-03-08 09:51:49,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11982.5). Total num frames: 72589312. Throughput: 0: 12198.1. Samples: 72567580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:51:49,282][367454] Avg episode reward: [(0, '4468.608')] [2023-03-08 09:51:49,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000141776_72589312.pth... [2023-03-08 09:51:49,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000141064_72224768.pth [2023-03-08 09:51:51,875][367737] Updated weights for policy 0, policy_version 141840 (0.0003) [2023-03-08 09:51:54,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12151.5, 300 sec: 11996.4). Total num frames: 72650752. Throughput: 0: 12182.6. Samples: 72641324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:51:54,283][367454] Avg episode reward: [(0, '4543.033')] [2023-03-08 09:51:55,204][367737] Updated weights for policy 0, policy_version 141920 (0.0003) [2023-03-08 09:51:58,613][367737] Updated weights for policy 0, policy_version 142000 (0.0004) [2023-03-08 09:51:59,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12010.3). Total num frames: 72708096. Throughput: 0: 12158.4. Samples: 72676692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:51:59,272][367454] Avg episode reward: [(0, '4442.611')] [2023-03-08 09:52:01,873][367737] Updated weights for policy 0, policy_version 142080 (0.0004) [2023-03-08 09:52:04,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12219.7, 300 sec: 12024.2). Total num frames: 72773632. Throughput: 0: 12189.3. Samples: 72751680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:52:04,283][367454] Avg episode reward: [(0, '4562.014')] [2023-03-08 09:52:04,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000142136_72773632.pth... [2023-03-08 09:52:04,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000141416_72404992.pth [2023-03-08 09:52:05,131][367737] Updated weights for policy 0, policy_version 142160 (0.0004) [2023-03-08 09:52:08,610][367737] Updated weights for policy 0, policy_version 142240 (0.0005) [2023-03-08 09:52:09,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 12010.3). Total num frames: 72830976. Throughput: 0: 12214.4. Samples: 72824116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:52:09,272][367454] Avg episode reward: [(0, '4571.926')] [2023-03-08 09:52:12,149][367737] Updated weights for policy 0, policy_version 142320 (0.0005) [2023-03-08 09:52:14,272][367454] Fps is (10 sec: 11468.9, 60 sec: 12083.2, 300 sec: 11996.4). Total num frames: 72888320. Throughput: 0: 12173.6. Samples: 72859648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:52:14,272][367454] Avg episode reward: [(0, '4492.671')] [2023-03-08 09:52:15,723][367737] Updated weights for policy 0, policy_version 142400 (0.0005) [2023-03-08 09:52:19,272][367454] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11996.4). Total num frames: 72945664. Throughput: 0: 12050.0. Samples: 72928124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:52:19,272][367454] Avg episode reward: [(0, '4575.591')] [2023-03-08 09:52:19,282][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000142480_72949760.pth... [2023-03-08 09:52:19,282][367737] Updated weights for policy 0, policy_version 142480 (0.0005) [2023-03-08 09:52:19,283][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000141776_72589312.pth [2023-03-08 09:52:22,862][367737] Updated weights for policy 0, policy_version 142560 (0.0005) [2023-03-08 09:52:24,272][367454] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11996.4). Total num frames: 73003008. Throughput: 0: 11953.0. Samples: 72996728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:52:24,272][367454] Avg episode reward: [(0, '4568.157')] [2023-03-08 09:52:26,459][367737] Updated weights for policy 0, policy_version 142640 (0.0005) [2023-03-08 09:52:29,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11996.4). Total num frames: 73060352. Throughput: 0: 11920.2. Samples: 73031456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:52:29,272][367454] Avg episode reward: [(0, '4503.219')] [2023-03-08 09:52:30,048][367737] Updated weights for policy 0, policy_version 142720 (0.0005) [2023-03-08 09:52:33,517][367737] Updated weights for policy 0, policy_version 142800 (0.0004) [2023-03-08 09:52:34,271][367454] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12010.3). Total num frames: 73121792. Throughput: 0: 11840.5. Samples: 73100404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:52:34,272][367454] Avg episode reward: [(0, '4505.303')] [2023-03-08 09:52:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000142816_73121792.pth... [2023-03-08 09:52:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000142136_72773632.pth [2023-03-08 09:52:37,100][367737] Updated weights for policy 0, policy_version 142880 (0.0005) [2023-03-08 09:52:39,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11996.4). Total num frames: 73175040. Throughput: 0: 11733.1. Samples: 73169312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:52:39,272][367454] Avg episode reward: [(0, '4539.426')] [2023-03-08 09:52:40,720][367737] Updated weights for policy 0, policy_version 142960 (0.0005) [2023-03-08 09:52:44,271][367454] Fps is (10 sec: 11059.3, 60 sec: 11741.9, 300 sec: 11996.4). Total num frames: 73232384. Throughput: 0: 11709.5. Samples: 73203620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:52:44,272][367454] Avg episode reward: [(0, '4548.231')] [2023-03-08 09:52:44,338][367737] Updated weights for policy 0, policy_version 143040 (0.0005) [2023-03-08 09:52:47,872][367737] Updated weights for policy 0, policy_version 143120 (0.0005) [2023-03-08 09:52:49,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11968.7). Total num frames: 73289728. Throughput: 0: 11561.4. Samples: 73271940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:52:49,272][367454] Avg episode reward: [(0, '4604.536')] [2023-03-08 09:52:49,337][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000143152_73293824.pth... [2023-03-08 09:52:49,340][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000142480_72949760.pth [2023-03-08 09:52:51,406][367737] Updated weights for policy 0, policy_version 143200 (0.0005) [2023-03-08 09:52:54,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11954.8). Total num frames: 73347072. Throughput: 0: 11486.7. Samples: 73341016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:52:54,272][367454] Avg episode reward: [(0, '4535.061')] [2023-03-08 09:52:55,007][367737] Updated weights for policy 0, policy_version 143280 (0.0005) [2023-03-08 09:52:58,654][367737] Updated weights for policy 0, policy_version 143360 (0.0005) [2023-03-08 09:52:59,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11940.9). Total num frames: 73404416. Throughput: 0: 11465.9. Samples: 73375612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:52:59,272][367454] Avg episode reward: [(0, '4597.267')] [2023-03-08 09:53:02,245][367737] Updated weights for policy 0, policy_version 143440 (0.0005) [2023-03-08 09:53:04,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11913.1). Total num frames: 73461760. Throughput: 0: 11443.2. Samples: 73443068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:53:04,272][367454] Avg episode reward: [(0, '4574.178')] [2023-03-08 09:53:04,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000143480_73461760.pth... [2023-03-08 09:53:04,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000142816_73121792.pth [2023-03-08 09:53:05,829][367737] Updated weights for policy 0, policy_version 143520 (0.0005) [2023-03-08 09:53:09,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11899.2). Total num frames: 73519104. Throughput: 0: 11466.5. Samples: 73512720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:53:09,272][367454] Avg episode reward: [(0, '4617.528')] [2023-03-08 09:53:09,311][367737] Updated weights for policy 0, policy_version 143600 (0.0004) [2023-03-08 09:53:13,003][367737] Updated weights for policy 0, policy_version 143680 (0.0004) [2023-03-08 09:53:14,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11885.3). Total num frames: 73576448. Throughput: 0: 11414.5. Samples: 73545108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:53:14,272][367454] Avg episode reward: [(0, '4580.917')] [2023-03-08 09:53:16,602][367737] Updated weights for policy 0, policy_version 143760 (0.0005) [2023-03-08 09:53:19,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11871.5). Total num frames: 73633792. Throughput: 0: 11399.5. Samples: 73613384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:53:19,272][367454] Avg episode reward: [(0, '4565.331')] [2023-03-08 09:53:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000143816_73633792.pth... [2023-03-08 09:53:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000143152_73293824.pth [2023-03-08 09:53:20,133][367737] Updated weights for policy 0, policy_version 143840 (0.0004) [2023-03-08 09:53:23,526][367737] Updated weights for policy 0, policy_version 143920 (0.0005) [2023-03-08 09:53:24,271][367454] Fps is (10 sec: 11878.5, 60 sec: 11537.1, 300 sec: 11871.5). Total num frames: 73695232. Throughput: 0: 11476.1. Samples: 73685736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:53:24,272][367454] Avg episode reward: [(0, '4511.351')] [2023-03-08 09:53:27,127][367737] Updated weights for policy 0, policy_version 144000 (0.0004) [2023-03-08 09:53:29,271][367454] Fps is (10 sec: 11878.5, 60 sec: 11537.1, 300 sec: 11871.5). Total num frames: 73752576. Throughput: 0: 11470.8. Samples: 73719808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:53:29,283][367454] Avg episode reward: [(0, '4465.980')] [2023-03-08 09:53:30,562][367737] Updated weights for policy 0, policy_version 144080 (0.0003) [2023-03-08 09:53:34,136][367737] Updated weights for policy 0, policy_version 144160 (0.0004) [2023-03-08 09:53:34,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11857.6). Total num frames: 73809920. Throughput: 0: 11501.4. Samples: 73789504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:53:34,272][367454] Avg episode reward: [(0, '4521.387')] [2023-03-08 09:53:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000144160_73809920.pth... [2023-03-08 09:53:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000143480_73461760.pth [2023-03-08 09:53:37,616][367737] Updated weights for policy 0, policy_version 144240 (0.0003) [2023-03-08 09:53:39,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11857.6). Total num frames: 73867264. Throughput: 0: 11531.5. Samples: 73859936. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:53:39,272][367454] Avg episode reward: [(0, '4482.736')] [2023-03-08 09:53:40,990][367737] Updated weights for policy 0, policy_version 144320 (0.0003) [2023-03-08 09:53:44,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11871.5). Total num frames: 73928704. Throughput: 0: 11564.4. Samples: 73896008. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:53:44,272][367454] Avg episode reward: [(0, '4489.084')] [2023-03-08 09:53:44,358][367737] Updated weights for policy 0, policy_version 144400 (0.0004) [2023-03-08 09:53:48,169][367737] Updated weights for policy 0, policy_version 144480 (0.0004) [2023-03-08 09:53:49,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11857.6). Total num frames: 73981952. Throughput: 0: 11612.5. Samples: 73965632. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:53:49,272][367454] Avg episode reward: [(0, '4490.163')] [2023-03-08 09:53:49,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000144496_73981952.pth... [2023-03-08 09:53:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000143816_73633792.pth [2023-03-08 09:53:52,198][367737] Updated weights for policy 0, policy_version 144560 (0.0006) [2023-03-08 09:53:54,271][367454] Fps is (10 sec: 10649.6, 60 sec: 11468.8, 300 sec: 11829.8). Total num frames: 74035200. Throughput: 0: 11430.0. Samples: 74027072. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:53:54,272][367454] Avg episode reward: [(0, '4517.654')] [2023-03-08 09:53:56,095][367737] Updated weights for policy 0, policy_version 144640 (0.0005) [2023-03-08 09:53:59,272][367454] Fps is (10 sec: 10649.6, 60 sec: 11400.5, 300 sec: 11815.9). Total num frames: 74088448. Throughput: 0: 11427.6. Samples: 74059348. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:53:59,272][367454] Avg episode reward: [(0, '4505.125')] [2023-03-08 09:53:59,957][367737] Updated weights for policy 0, policy_version 144720 (0.0005) [2023-03-08 09:54:03,351][367737] Updated weights for policy 0, policy_version 144800 (0.0004) [2023-03-08 09:54:04,271][367454] Fps is (10 sec: 11059.2, 60 sec: 11400.5, 300 sec: 11802.0). Total num frames: 74145792. Throughput: 0: 11381.5. Samples: 74125552. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:54:04,272][367454] Avg episode reward: [(0, '4479.073')] [2023-03-08 09:54:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000144816_74145792.pth... [2023-03-08 09:54:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000144160_73809920.pth [2023-03-08 09:54:06,722][367737] Updated weights for policy 0, policy_version 144880 (0.0005) [2023-03-08 09:54:09,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11774.3). Total num frames: 74203136. Throughput: 0: 11339.6. Samples: 74196020. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:54:09,272][367454] Avg episode reward: [(0, '4528.703')] [2023-03-08 09:54:10,637][367737] Updated weights for policy 0, policy_version 144960 (0.0005) [2023-03-08 09:54:14,259][367737] Updated weights for policy 0, policy_version 145040 (0.0005) [2023-03-08 09:54:14,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11760.4). Total num frames: 74260480. Throughput: 0: 11286.7. Samples: 74227712. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:54:14,272][367454] Avg episode reward: [(0, '4481.110')] [2023-03-08 09:54:17,972][367737] Updated weights for policy 0, policy_version 145120 (0.0005) [2023-03-08 09:54:19,272][367454] Fps is (10 sec: 11059.1, 60 sec: 11332.2, 300 sec: 11732.6). Total num frames: 74313728. Throughput: 0: 11237.6. Samples: 74295196. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:54:19,272][367454] Avg episode reward: [(0, '4503.424')] [2023-03-08 09:54:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000145144_74313728.pth... [2023-03-08 09:54:19,279][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000144496_73981952.pth [2023-03-08 09:54:21,753][367737] Updated weights for policy 0, policy_version 145200 (0.0005) [2023-03-08 09:54:24,271][367454] Fps is (10 sec: 11059.3, 60 sec: 11264.0, 300 sec: 11732.6). Total num frames: 74371072. Throughput: 0: 11148.6. Samples: 74361620. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:54:24,272][367454] Avg episode reward: [(0, '4517.696')] [2023-03-08 09:54:25,262][367737] Updated weights for policy 0, policy_version 145280 (0.0005) [2023-03-08 09:54:28,919][367737] Updated weights for policy 0, policy_version 145360 (0.0005) [2023-03-08 09:54:29,272][367454] Fps is (10 sec: 11059.3, 60 sec: 11195.7, 300 sec: 11718.7). Total num frames: 74424320. Throughput: 0: 11109.7. Samples: 74395944. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:54:29,272][367454] Avg episode reward: [(0, '4561.643')] [2023-03-08 09:54:32,592][367737] Updated weights for policy 0, policy_version 145440 (0.0005) [2023-03-08 09:54:34,272][367454] Fps is (10 sec: 11059.0, 60 sec: 11195.7, 300 sec: 11704.8). Total num frames: 74481664. Throughput: 0: 11054.6. Samples: 74463088. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:54:34,272][367454] Avg episode reward: [(0, '4689.797')] [2023-03-08 09:54:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000145472_74481664.pth... [2023-03-08 09:54:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000144816_74145792.pth [2023-03-08 09:54:34,279][367693] Saving new best policy, reward=4689.797! [2023-03-08 09:54:36,161][367737] Updated weights for policy 0, policy_version 145520 (0.0005) [2023-03-08 09:54:39,272][367454] Fps is (10 sec: 11878.5, 60 sec: 11264.0, 300 sec: 11718.7). Total num frames: 74543104. Throughput: 0: 11228.7. Samples: 74532364. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:54:39,272][367454] Avg episode reward: [(0, '4555.837')] [2023-03-08 09:54:39,531][367737] Updated weights for policy 0, policy_version 145600 (0.0004) [2023-03-08 09:54:42,858][367737] Updated weights for policy 0, policy_version 145680 (0.0004) [2023-03-08 09:54:44,272][367454] Fps is (10 sec: 12288.1, 60 sec: 11264.0, 300 sec: 11732.6). Total num frames: 74604544. Throughput: 0: 11361.1. Samples: 74570596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:54:44,272][367454] Avg episode reward: [(0, '4567.061')] [2023-03-08 09:54:46,215][367737] Updated weights for policy 0, policy_version 145760 (0.0004) [2023-03-08 09:54:49,272][367454] Fps is (10 sec: 12287.9, 60 sec: 11400.5, 300 sec: 11746.5). Total num frames: 74665984. Throughput: 0: 11515.4. Samples: 74643744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:54:49,272][367454] Avg episode reward: [(0, '4438.265')] [2023-03-08 09:54:49,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000145832_74665984.pth... [2023-03-08 09:54:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000145144_74313728.pth [2023-03-08 09:54:49,552][367737] Updated weights for policy 0, policy_version 145840 (0.0004) [2023-03-08 09:54:52,852][367737] Updated weights for policy 0, policy_version 145920 (0.0004) [2023-03-08 09:54:54,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11537.1, 300 sec: 11746.5). Total num frames: 74727424. Throughput: 0: 11602.2. Samples: 74718116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:54:54,272][367454] Avg episode reward: [(0, '4553.465')] [2023-03-08 09:54:56,223][367737] Updated weights for policy 0, policy_version 146000 (0.0005) [2023-03-08 09:54:59,271][367454] Fps is (10 sec: 12288.1, 60 sec: 11673.6, 300 sec: 11746.5). Total num frames: 74788864. Throughput: 0: 11699.8. Samples: 74754204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:54:59,272][367454] Avg episode reward: [(0, '4419.966')] [2023-03-08 09:54:59,546][367737] Updated weights for policy 0, policy_version 146080 (0.0004) [2023-03-08 09:55:02,995][367737] Updated weights for policy 0, policy_version 146160 (0.0005) [2023-03-08 09:55:04,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11732.6). Total num frames: 74846208. Throughput: 0: 11794.8. Samples: 74825960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:55:04,272][367454] Avg episode reward: [(0, '4491.714')] [2023-03-08 09:55:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000146184_74846208.pth... [2023-03-08 09:55:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000145472_74481664.pth [2023-03-08 09:55:06,417][367737] Updated weights for policy 0, policy_version 146240 (0.0005) [2023-03-08 09:55:09,271][367454] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11732.6). Total num frames: 74907648. Throughput: 0: 11940.4. Samples: 74898940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:55:09,272][367454] Avg episode reward: [(0, '4558.656')] [2023-03-08 09:55:09,796][367737] Updated weights for policy 0, policy_version 146320 (0.0004) [2023-03-08 09:55:13,349][367737] Updated weights for policy 0, policy_version 146400 (0.0005) [2023-03-08 09:55:14,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11732.6). Total num frames: 74964992. Throughput: 0: 11956.0. Samples: 74933964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:55:14,272][367454] Avg episode reward: [(0, '4591.173')] [2023-03-08 09:55:16,939][367737] Updated weights for policy 0, policy_version 146480 (0.0005) [2023-03-08 09:55:19,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 11718.7). Total num frames: 75022336. Throughput: 0: 12002.9. Samples: 75003220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:55:19,272][367454] Avg episode reward: [(0, '4446.937')] [2023-03-08 09:55:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000146528_75022336.pth... [2023-03-08 09:55:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000145832_74665984.pth [2023-03-08 09:55:20,623][367737] Updated weights for policy 0, policy_version 146560 (0.0005) [2023-03-08 09:55:24,129][367737] Updated weights for policy 0, policy_version 146640 (0.0005) [2023-03-08 09:55:24,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11704.8). Total num frames: 75079680. Throughput: 0: 11980.7. Samples: 75071496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:55:24,272][367454] Avg episode reward: [(0, '4312.502')] [2023-03-08 09:55:27,505][367737] Updated weights for policy 0, policy_version 146720 (0.0004) [2023-03-08 09:55:29,271][367454] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 11718.7). Total num frames: 75141120. Throughput: 0: 11925.1. Samples: 75107224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:55:29,272][367454] Avg episode reward: [(0, '4394.008')] [2023-03-08 09:55:31,112][367737] Updated weights for policy 0, policy_version 146800 (0.0005) [2023-03-08 09:55:34,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11677.1). Total num frames: 75194368. Throughput: 0: 11814.0. Samples: 75175376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:55:34,272][367454] Avg episode reward: [(0, '4252.264')] [2023-03-08 09:55:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000146864_75194368.pth... [2023-03-08 09:55:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000146184_74846208.pth [2023-03-08 09:55:34,768][367737] Updated weights for policy 0, policy_version 146880 (0.0005) [2023-03-08 09:55:38,352][367737] Updated weights for policy 0, policy_version 146960 (0.0005) [2023-03-08 09:55:39,272][367454] Fps is (10 sec: 11059.2, 60 sec: 11810.1, 300 sec: 11677.1). Total num frames: 75251712. Throughput: 0: 11678.8. Samples: 75243664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:55:39,272][367454] Avg episode reward: [(0, '4465.955')] [2023-03-08 09:55:41,989][367737] Updated weights for policy 0, policy_version 147040 (0.0005) [2023-03-08 09:55:44,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 11677.1). Total num frames: 75309056. Throughput: 0: 11641.9. Samples: 75278088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:55:44,272][367454] Avg episode reward: [(0, '4375.878')] [2023-03-08 09:55:45,705][367737] Updated weights for policy 0, policy_version 147120 (0.0005) [2023-03-08 09:55:49,211][367737] Updated weights for policy 0, policy_version 147200 (0.0005) [2023-03-08 09:55:49,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11677.1). Total num frames: 75366400. Throughput: 0: 11548.5. Samples: 75345640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:55:49,272][367454] Avg episode reward: [(0, '4515.712')] [2023-03-08 09:55:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000147200_75366400.pth... [2023-03-08 09:55:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000146528_75022336.pth [2023-03-08 09:55:52,760][367737] Updated weights for policy 0, policy_version 147280 (0.0005) [2023-03-08 09:55:54,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11677.1). Total num frames: 75423744. Throughput: 0: 11475.7. Samples: 75415344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:55:54,272][367454] Avg episode reward: [(0, '4549.200')] [2023-03-08 09:55:56,350][367737] Updated weights for policy 0, policy_version 147360 (0.0005) [2023-03-08 09:55:59,271][367454] Fps is (10 sec: 11059.3, 60 sec: 11468.8, 300 sec: 11649.3). Total num frames: 75476992. Throughput: 0: 11433.9. Samples: 75448488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:55:59,272][367454] Avg episode reward: [(0, '4407.887')] [2023-03-08 09:56:00,086][367737] Updated weights for policy 0, policy_version 147440 (0.0005) [2023-03-08 09:56:03,855][367737] Updated weights for policy 0, policy_version 147520 (0.0005) [2023-03-08 09:56:04,272][367454] Fps is (10 sec: 11059.1, 60 sec: 11468.8, 300 sec: 11635.4). Total num frames: 75534336. Throughput: 0: 11349.1. Samples: 75513928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:56:04,272][367454] Avg episode reward: [(0, '4464.933')] [2023-03-08 09:56:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000147528_75534336.pth... [2023-03-08 09:56:04,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000146864_75194368.pth [2023-03-08 09:56:07,544][367737] Updated weights for policy 0, policy_version 147600 (0.0005) [2023-03-08 09:56:09,272][367454] Fps is (10 sec: 11059.1, 60 sec: 11332.3, 300 sec: 11607.6). Total num frames: 75587584. Throughput: 0: 11317.8. Samples: 75580796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:56:09,272][367454] Avg episode reward: [(0, '4251.863')] [2023-03-08 09:56:11,048][367737] Updated weights for policy 0, policy_version 147680 (0.0004) [2023-03-08 09:56:14,271][367454] Fps is (10 sec: 11059.3, 60 sec: 11332.3, 300 sec: 11593.8). Total num frames: 75644928. Throughput: 0: 11312.0. Samples: 75616264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:56:14,272][367454] Avg episode reward: [(0, '4391.554')] [2023-03-08 09:56:14,727][367737] Updated weights for policy 0, policy_version 147760 (0.0006) [2023-03-08 09:56:18,396][367737] Updated weights for policy 0, policy_version 147840 (0.0005) [2023-03-08 09:56:19,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11593.8). Total num frames: 75702272. Throughput: 0: 11280.5. Samples: 75682996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:56:19,272][367454] Avg episode reward: [(0, '4374.128')] [2023-03-08 09:56:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000147856_75702272.pth... [2023-03-08 09:56:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000147200_75366400.pth [2023-03-08 09:56:22,012][367737] Updated weights for policy 0, policy_version 147920 (0.0005) [2023-03-08 09:56:24,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11566.0). Total num frames: 75759616. Throughput: 0: 11280.4. Samples: 75751280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:56:24,272][367454] Avg episode reward: [(0, '4392.758')] [2023-03-08 09:56:25,626][367737] Updated weights for policy 0, policy_version 148000 (0.0005) [2023-03-08 09:56:29,231][367737] Updated weights for policy 0, policy_version 148080 (0.0005) [2023-03-08 09:56:29,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11264.0, 300 sec: 11566.0). Total num frames: 75816960. Throughput: 0: 11252.3. Samples: 75784440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:56:29,272][367454] Avg episode reward: [(0, '4345.720')] [2023-03-08 09:56:32,861][367737] Updated weights for policy 0, policy_version 148160 (0.0005) [2023-03-08 09:56:34,272][367454] Fps is (10 sec: 11059.0, 60 sec: 11264.0, 300 sec: 11538.2). Total num frames: 75870208. Throughput: 0: 11277.7. Samples: 75853140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:56:34,272][367454] Avg episode reward: [(0, '4427.492')] [2023-03-08 09:56:34,304][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000148192_75874304.pth... [2023-03-08 09:56:34,305][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000147528_75534336.pth [2023-03-08 09:56:36,504][367737] Updated weights for policy 0, policy_version 148240 (0.0005) [2023-03-08 09:56:39,272][367454] Fps is (10 sec: 11059.2, 60 sec: 11264.0, 300 sec: 11524.3). Total num frames: 75927552. Throughput: 0: 11208.6. Samples: 75919732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:56:39,272][367454] Avg episode reward: [(0, '4211.017')] [2023-03-08 09:56:40,358][367737] Updated weights for policy 0, policy_version 148320 (0.0004) [2023-03-08 09:56:44,039][367737] Updated weights for policy 0, policy_version 148400 (0.0005) [2023-03-08 09:56:44,272][367454] Fps is (10 sec: 11059.4, 60 sec: 11195.7, 300 sec: 11496.6). Total num frames: 75980800. Throughput: 0: 11164.9. Samples: 75950908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:56:44,272][367454] Avg episode reward: [(0, '4204.543')] [2023-03-08 09:56:47,450][367737] Updated weights for policy 0, policy_version 148480 (0.0004) [2023-03-08 09:56:49,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11496.6). Total num frames: 76042240. Throughput: 0: 11279.0. Samples: 76021484. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:56:49,272][367454] Avg episode reward: [(0, '4535.209')] [2023-03-08 09:56:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000148520_76042240.pth... [2023-03-08 09:56:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000147856_75702272.pth [2023-03-08 09:56:50,988][367737] Updated weights for policy 0, policy_version 148560 (0.0005) [2023-03-08 09:56:54,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11264.0, 300 sec: 11496.6). Total num frames: 76099584. Throughput: 0: 11348.0. Samples: 76091456. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:56:54,272][367454] Avg episode reward: [(0, '4471.963')] [2023-03-08 09:56:54,455][367737] Updated weights for policy 0, policy_version 148640 (0.0003) [2023-03-08 09:56:57,923][367737] Updated weights for policy 0, policy_version 148720 (0.0003) [2023-03-08 09:56:59,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11332.2, 300 sec: 11468.8). Total num frames: 76156928. Throughput: 0: 11351.7. Samples: 76127092. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:56:59,272][367454] Avg episode reward: [(0, '4514.397')] [2023-03-08 09:57:01,347][367737] Updated weights for policy 0, policy_version 148800 (0.0004) [2023-03-08 09:57:04,271][367454] Fps is (10 sec: 11878.5, 60 sec: 11400.6, 300 sec: 11482.7). Total num frames: 76218368. Throughput: 0: 11448.0. Samples: 76198156. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:57:04,272][367454] Avg episode reward: [(0, '4515.996')] [2023-03-08 09:57:04,292][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000148872_76222464.pth... [2023-03-08 09:57:04,294][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000148192_75874304.pth [2023-03-08 09:57:04,632][367737] Updated weights for policy 0, policy_version 148880 (0.0004) [2023-03-08 09:57:07,999][367737] Updated weights for policy 0, policy_version 148960 (0.0005) [2023-03-08 09:57:09,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11537.1, 300 sec: 11496.6). Total num frames: 76279808. Throughput: 0: 11568.7. Samples: 76271872. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:57:09,272][367454] Avg episode reward: [(0, '4536.055')] [2023-03-08 09:57:11,273][367737] Updated weights for policy 0, policy_version 149040 (0.0005) [2023-03-08 09:57:14,272][367454] Fps is (10 sec: 12697.5, 60 sec: 11673.6, 300 sec: 11524.3). Total num frames: 76345344. Throughput: 0: 11677.9. Samples: 76309944. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:57:14,272][367454] Avg episode reward: [(0, '4578.654')] [2023-03-08 09:57:14,565][367737] Updated weights for policy 0, policy_version 149120 (0.0004) [2023-03-08 09:57:17,862][367737] Updated weights for policy 0, policy_version 149200 (0.0004) [2023-03-08 09:57:19,271][367454] Fps is (10 sec: 12697.6, 60 sec: 11741.9, 300 sec: 11538.2). Total num frames: 76406784. Throughput: 0: 11831.9. Samples: 76385572. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:57:19,272][367454] Avg episode reward: [(0, '4613.801')] [2023-03-08 09:57:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000149232_76406784.pth... [2023-03-08 09:57:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000148520_76042240.pth [2023-03-08 09:57:21,490][367737] Updated weights for policy 0, policy_version 149280 (0.0005) [2023-03-08 09:57:24,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11524.3). Total num frames: 76460032. Throughput: 0: 11837.6. Samples: 76452424. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:57:24,272][367454] Avg episode reward: [(0, '4645.379')] [2023-03-08 09:57:25,219][367737] Updated weights for policy 0, policy_version 149360 (0.0005) [2023-03-08 09:57:28,970][367737] Updated weights for policy 0, policy_version 149440 (0.0005) [2023-03-08 09:57:29,271][367454] Fps is (10 sec: 10649.6, 60 sec: 11605.3, 300 sec: 11496.6). Total num frames: 76513280. Throughput: 0: 11861.6. Samples: 76484680. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:57:29,272][367454] Avg episode reward: [(0, '4558.782')] [2023-03-08 09:57:32,494][367737] Updated weights for policy 0, policy_version 149520 (0.0005) [2023-03-08 09:57:34,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11741.9, 300 sec: 11524.3). Total num frames: 76574720. Throughput: 0: 11821.4. Samples: 76553448. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:57:34,272][367454] Avg episode reward: [(0, '4526.553')] [2023-03-08 09:57:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000149560_76574720.pth... [2023-03-08 09:57:34,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000148872_76222464.pth [2023-03-08 09:57:36,021][367737] Updated weights for policy 0, policy_version 149600 (0.0005) [2023-03-08 09:57:39,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11524.3). Total num frames: 76632064. Throughput: 0: 11830.0. Samples: 76623808. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:57:39,272][367454] Avg episode reward: [(0, '4514.681')] [2023-03-08 09:57:39,531][367737] Updated weights for policy 0, policy_version 149680 (0.0005) [2023-03-08 09:57:43,009][367737] Updated weights for policy 0, policy_version 149760 (0.0005) [2023-03-08 09:57:44,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 11524.3). Total num frames: 76689408. Throughput: 0: 11789.1. Samples: 76657600. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:57:44,272][367454] Avg episode reward: [(0, '4567.826')] [2023-03-08 09:57:46,550][367737] Updated weights for policy 0, policy_version 149840 (0.0005) [2023-03-08 09:57:49,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11524.3). Total num frames: 76746752. Throughput: 0: 11764.5. Samples: 76727560. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 09:57:49,272][367454] Avg episode reward: [(0, '4545.604')] [2023-03-08 09:57:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000149896_76746752.pth... [2023-03-08 09:57:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000149232_76406784.pth [2023-03-08 09:57:50,280][367737] Updated weights for policy 0, policy_version 149920 (0.0005) [2023-03-08 09:57:53,879][367737] Updated weights for policy 0, policy_version 150000 (0.0005) [2023-03-08 09:57:54,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11524.3). Total num frames: 76804096. Throughput: 0: 11627.8. Samples: 76795124. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:57:54,272][367454] Avg episode reward: [(0, '4474.420')] [2023-03-08 09:57:57,442][367737] Updated weights for policy 0, policy_version 150080 (0.0005) [2023-03-08 09:57:59,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11524.3). Total num frames: 76861440. Throughput: 0: 11534.0. Samples: 76828972. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:57:59,272][367454] Avg episode reward: [(0, '4505.111')] [2023-03-08 09:58:00,986][367737] Updated weights for policy 0, policy_version 150160 (0.0005) [2023-03-08 09:58:04,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 11524.3). Total num frames: 76918784. Throughput: 0: 11395.6. Samples: 76898376. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:58:04,272][367454] Avg episode reward: [(0, '4515.784')] [2023-03-08 09:58:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000150232_76918784.pth... [2023-03-08 09:58:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000149560_76574720.pth [2023-03-08 09:58:04,406][367737] Updated weights for policy 0, policy_version 150240 (0.0005) [2023-03-08 09:58:08,132][367737] Updated weights for policy 0, policy_version 150320 (0.0005) [2023-03-08 09:58:09,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11524.3). Total num frames: 76976128. Throughput: 0: 11445.2. Samples: 76967460. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:58:09,272][367454] Avg episode reward: [(0, '4510.451')] [2023-03-08 09:58:11,697][367737] Updated weights for policy 0, policy_version 150400 (0.0005) [2023-03-08 09:58:14,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11524.3). Total num frames: 77033472. Throughput: 0: 11468.6. Samples: 77000768. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:58:14,272][367454] Avg episode reward: [(0, '4463.376')] [2023-03-08 09:58:14,997][367737] Updated weights for policy 0, policy_version 150480 (0.0004) [2023-03-08 09:58:18,758][367737] Updated weights for policy 0, policy_version 150560 (0.0005) [2023-03-08 09:58:19,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11400.5, 300 sec: 11510.4). Total num frames: 77090816. Throughput: 0: 11496.1. Samples: 77070772. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:58:19,272][367454] Avg episode reward: [(0, '4552.487')] [2023-03-08 09:58:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000150568_77090816.pth... [2023-03-08 09:58:19,279][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000149896_76746752.pth [2023-03-08 09:58:22,362][367737] Updated weights for policy 0, policy_version 150640 (0.0005) [2023-03-08 09:58:24,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11510.5). Total num frames: 77148160. Throughput: 0: 11463.9. Samples: 77139684. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:58:24,272][367454] Avg episode reward: [(0, '4469.929')] [2023-03-08 09:58:25,967][367737] Updated weights for policy 0, policy_version 150720 (0.0005) [2023-03-08 09:58:29,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11510.5). Total num frames: 77205504. Throughput: 0: 11453.6. Samples: 77173012. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:58:29,272][367454] Avg episode reward: [(0, '4496.530')] [2023-03-08 09:58:29,527][367737] Updated weights for policy 0, policy_version 150800 (0.0005) [2023-03-08 09:58:32,941][367737] Updated weights for policy 0, policy_version 150880 (0.0004) [2023-03-08 09:58:34,272][367454] Fps is (10 sec: 11878.2, 60 sec: 11537.0, 300 sec: 11524.3). Total num frames: 77266944. Throughput: 0: 11461.5. Samples: 77243328. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:58:34,272][367454] Avg episode reward: [(0, '4366.822')] [2023-03-08 09:58:34,277][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000150912_77266944.pth... [2023-03-08 09:58:34,279][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000150232_76918784.pth [2023-03-08 09:58:36,264][367737] Updated weights for policy 0, policy_version 150960 (0.0004) [2023-03-08 09:58:39,271][367454] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 11510.5). Total num frames: 77324288. Throughput: 0: 11602.4. Samples: 77317232. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:58:39,272][367454] Avg episode reward: [(0, '4427.151')] [2023-03-08 09:58:39,747][367737] Updated weights for policy 0, policy_version 151040 (0.0005) [2023-03-08 09:58:43,367][367737] Updated weights for policy 0, policy_version 151120 (0.0005) [2023-03-08 09:58:44,272][367454] Fps is (10 sec: 11469.0, 60 sec: 11537.1, 300 sec: 11524.3). Total num frames: 77381632. Throughput: 0: 11585.5. Samples: 77350320. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:58:44,272][367454] Avg episode reward: [(0, '4439.502')] [2023-03-08 09:58:46,826][367737] Updated weights for policy 0, policy_version 151200 (0.0004) [2023-03-08 09:58:49,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11538.2). Total num frames: 77438976. Throughput: 0: 11621.2. Samples: 77421328. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 09:58:49,272][367454] Avg episode reward: [(0, '4397.228')] [2023-03-08 09:58:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000151256_77443072.pth... [2023-03-08 09:58:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000150568_77090816.pth [2023-03-08 09:58:50,323][367737] Updated weights for policy 0, policy_version 151280 (0.0005) [2023-03-08 09:58:53,753][367737] Updated weights for policy 0, policy_version 151360 (0.0005) [2023-03-08 09:58:54,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11566.0). Total num frames: 77500416. Throughput: 0: 11661.7. Samples: 77492236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:58:54,272][367454] Avg episode reward: [(0, '4451.968')] [2023-03-08 09:58:57,095][367737] Updated weights for policy 0, policy_version 151440 (0.0005) [2023-03-08 09:58:59,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 11579.9). Total num frames: 77561856. Throughput: 0: 11740.8. Samples: 77529104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:58:59,272][367454] Avg episode reward: [(0, '4480.917')] [2023-03-08 09:59:00,382][367737] Updated weights for policy 0, policy_version 151520 (0.0004) [2023-03-08 09:59:03,728][367737] Updated weights for policy 0, policy_version 151600 (0.0004) [2023-03-08 09:59:04,272][367454] Fps is (10 sec: 12287.9, 60 sec: 11741.9, 300 sec: 11593.8). Total num frames: 77623296. Throughput: 0: 11824.6. Samples: 77602880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:59:04,272][367454] Avg episode reward: [(0, '4408.518')] [2023-03-08 09:59:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000151608_77623296.pth... [2023-03-08 09:59:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000150912_77266944.pth [2023-03-08 09:59:06,967][367737] Updated weights for policy 0, policy_version 151680 (0.0005) [2023-03-08 09:59:09,271][367454] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 11607.6). Total num frames: 77684736. Throughput: 0: 11950.1. Samples: 77677440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:59:09,272][367454] Avg episode reward: [(0, '4415.705')] [2023-03-08 09:59:10,272][367737] Updated weights for policy 0, policy_version 151760 (0.0005) [2023-03-08 09:59:13,490][367737] Updated weights for policy 0, policy_version 151840 (0.0004) [2023-03-08 09:59:14,271][367454] Fps is (10 sec: 12697.7, 60 sec: 11946.7, 300 sec: 11649.3). Total num frames: 77750272. Throughput: 0: 12047.0. Samples: 77715128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:59:14,272][367454] Avg episode reward: [(0, '4387.185')] [2023-03-08 09:59:16,779][367737] Updated weights for policy 0, policy_version 151920 (0.0005) [2023-03-08 09:59:19,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12014.9, 300 sec: 11663.2). Total num frames: 77811712. Throughput: 0: 12173.6. Samples: 77791140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:59:19,272][367454] Avg episode reward: [(0, '4354.460')] [2023-03-08 09:59:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000151976_77811712.pth... [2023-03-08 09:59:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000151256_77443072.pth [2023-03-08 09:59:20,230][367737] Updated weights for policy 0, policy_version 152000 (0.0005) [2023-03-08 09:59:23,704][367737] Updated weights for policy 0, policy_version 152080 (0.0005) [2023-03-08 09:59:24,272][367454] Fps is (10 sec: 11878.3, 60 sec: 12014.9, 300 sec: 11677.1). Total num frames: 77869056. Throughput: 0: 12082.3. Samples: 77860936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:59:24,272][367454] Avg episode reward: [(0, '4220.141')] [2023-03-08 09:59:27,277][367737] Updated weights for policy 0, policy_version 152160 (0.0005) [2023-03-08 09:59:29,271][367454] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 11691.0). Total num frames: 77930496. Throughput: 0: 12140.1. Samples: 77896624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:59:29,272][367454] Avg episode reward: [(0, '4399.780')] [2023-03-08 09:59:30,672][367737] Updated weights for policy 0, policy_version 152240 (0.0004) [2023-03-08 09:59:34,172][367737] Updated weights for policy 0, policy_version 152320 (0.0005) [2023-03-08 09:59:34,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12015.0, 300 sec: 11677.1). Total num frames: 77987840. Throughput: 0: 12134.3. Samples: 77967372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:59:34,272][367454] Avg episode reward: [(0, '4511.227')] [2023-03-08 09:59:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000152320_77987840.pth... [2023-03-08 09:59:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000151608_77623296.pth [2023-03-08 09:59:37,714][367737] Updated weights for policy 0, policy_version 152400 (0.0005) [2023-03-08 09:59:39,272][367454] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11663.2). Total num frames: 78045184. Throughput: 0: 12107.1. Samples: 78037056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:59:39,272][367454] Avg episode reward: [(0, '4361.436')] [2023-03-08 09:59:41,246][367737] Updated weights for policy 0, policy_version 152480 (0.0005) [2023-03-08 09:59:44,272][367454] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 11663.2). Total num frames: 78106624. Throughput: 0: 12055.8. Samples: 78071616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:59:44,272][367454] Avg episode reward: [(0, '4393.134')] [2023-03-08 09:59:44,527][367737] Updated weights for policy 0, policy_version 152560 (0.0005) [2023-03-08 09:59:47,742][367737] Updated weights for policy 0, policy_version 152640 (0.0005) [2023-03-08 09:59:49,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11663.2). Total num frames: 78168064. Throughput: 0: 12104.7. Samples: 78147592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:59:49,282][367454] Avg episode reward: [(0, '4367.300')] [2023-03-08 09:59:49,285][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000152672_78168064.pth... [2023-03-08 09:59:49,287][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000151976_77811712.pth [2023-03-08 09:59:51,061][367737] Updated weights for policy 0, policy_version 152720 (0.0005) [2023-03-08 09:59:54,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11663.2). Total num frames: 78229504. Throughput: 0: 12100.1. Samples: 78221944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 09:59:54,283][367454] Avg episode reward: [(0, '4480.492')] [2023-03-08 09:59:54,321][367737] Updated weights for policy 0, policy_version 152800 (0.0005) [2023-03-08 09:59:57,555][367737] Updated weights for policy 0, policy_version 152880 (0.0005) [2023-03-08 09:59:59,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11677.1). Total num frames: 78290944. Throughput: 0: 12109.3. Samples: 78260048. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 09:59:59,283][367454] Avg episode reward: [(0, '4495.462')] [2023-03-08 10:00:01,115][367737] Updated weights for policy 0, policy_version 152960 (0.0006) [2023-03-08 10:00:04,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11677.1). Total num frames: 78352384. Throughput: 0: 12006.0. Samples: 78331412. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:00:04,283][367454] Avg episode reward: [(0, '4445.785')] [2023-03-08 10:00:04,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000153032_78352384.pth... [2023-03-08 10:00:04,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000152320_77987840.pth [2023-03-08 10:00:04,509][367737] Updated weights for policy 0, policy_version 153040 (0.0005) [2023-03-08 10:00:07,927][367737] Updated weights for policy 0, policy_version 153120 (0.0004) [2023-03-08 10:00:09,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 11691.0). Total num frames: 78413824. Throughput: 0: 12046.4. Samples: 78403024. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:00:09,282][367454] Avg episode reward: [(0, '4393.720')] [2023-03-08 10:00:11,366][367737] Updated weights for policy 0, policy_version 153200 (0.0004) [2023-03-08 10:00:14,271][367454] Fps is (10 sec: 11878.5, 60 sec: 12014.9, 300 sec: 11691.0). Total num frames: 78471168. Throughput: 0: 12041.1. Samples: 78438472. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:00:14,272][367454] Avg episode reward: [(0, '4475.100')] [2023-03-08 10:00:14,922][367737] Updated weights for policy 0, policy_version 153280 (0.0005) [2023-03-08 10:00:18,451][367737] Updated weights for policy 0, policy_version 153360 (0.0005) [2023-03-08 10:00:19,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11691.0). Total num frames: 78528512. Throughput: 0: 12016.3. Samples: 78508104. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:00:19,272][367454] Avg episode reward: [(0, '4556.494')] [2023-03-08 10:00:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000153376_78528512.pth... [2023-03-08 10:00:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000152672_78168064.pth [2023-03-08 10:00:22,016][367737] Updated weights for policy 0, policy_version 153440 (0.0005) [2023-03-08 10:00:24,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11946.7, 300 sec: 11677.1). Total num frames: 78585856. Throughput: 0: 12013.5. Samples: 78577664. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:00:24,272][367454] Avg episode reward: [(0, '4467.345')] [2023-03-08 10:00:25,559][367737] Updated weights for policy 0, policy_version 153520 (0.0005) [2023-03-08 10:00:29,272][367454] Fps is (10 sec: 11059.2, 60 sec: 11810.1, 300 sec: 11677.1). Total num frames: 78639104. Throughput: 0: 12003.2. Samples: 78611760. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:00:29,272][367454] Avg episode reward: [(0, '4529.801')] [2023-03-08 10:00:29,283][367737] Updated weights for policy 0, policy_version 153600 (0.0005) [2023-03-08 10:00:32,760][367737] Updated weights for policy 0, policy_version 153680 (0.0005) [2023-03-08 10:00:34,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11691.0). Total num frames: 78700544. Throughput: 0: 11834.1. Samples: 78680128. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:00:34,272][367454] Avg episode reward: [(0, '4504.876')] [2023-03-08 10:00:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000153712_78700544.pth... [2023-03-08 10:00:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000153032_78352384.pth [2023-03-08 10:00:36,289][367737] Updated weights for policy 0, policy_version 153760 (0.0005) [2023-03-08 10:00:39,271][367454] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 11691.0). Total num frames: 78757888. Throughput: 0: 11729.3. Samples: 78749760. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:00:39,272][367454] Avg episode reward: [(0, '4445.886')] [2023-03-08 10:00:39,814][367737] Updated weights for policy 0, policy_version 153840 (0.0005) [2023-03-08 10:00:43,287][367737] Updated weights for policy 0, policy_version 153920 (0.0005) [2023-03-08 10:00:44,272][367454] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 11691.0). Total num frames: 78815232. Throughput: 0: 11668.4. Samples: 78785128. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:00:44,272][367454] Avg episode reward: [(0, '4513.124')] [2023-03-08 10:00:46,815][367737] Updated weights for policy 0, policy_version 154000 (0.0005) [2023-03-08 10:00:49,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11741.9, 300 sec: 11691.0). Total num frames: 78872576. Throughput: 0: 11643.2. Samples: 78855356. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:00:49,272][367454] Avg episode reward: [(0, '4544.613')] [2023-03-08 10:00:49,300][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000154056_78876672.pth... [2023-03-08 10:00:49,302][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000153376_78528512.pth [2023-03-08 10:00:50,358][367737] Updated weights for policy 0, policy_version 154080 (0.0005) [2023-03-08 10:00:53,894][367737] Updated weights for policy 0, policy_version 154160 (0.0005) [2023-03-08 10:00:54,271][367454] Fps is (10 sec: 11878.5, 60 sec: 11741.9, 300 sec: 11718.7). Total num frames: 78934016. Throughput: 0: 11586.4. Samples: 78924412. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:00:54,272][367454] Avg episode reward: [(0, '4575.562')] [2023-03-08 10:00:57,577][367737] Updated weights for policy 0, policy_version 154240 (0.0005) [2023-03-08 10:00:59,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11704.8). Total num frames: 78987264. Throughput: 0: 11552.4. Samples: 78958332. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:00:59,272][367454] Avg episode reward: [(0, '4498.865')] [2023-03-08 10:01:01,170][367737] Updated weights for policy 0, policy_version 154320 (0.0005) [2023-03-08 10:01:04,271][367454] Fps is (10 sec: 11059.1, 60 sec: 11537.1, 300 sec: 11718.7). Total num frames: 79044608. Throughput: 0: 11508.4. Samples: 79025984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:01:04,272][367454] Avg episode reward: [(0, '4464.132')] [2023-03-08 10:01:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000154384_79044608.pth... [2023-03-08 10:01:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000153712_78700544.pth [2023-03-08 10:01:04,736][367737] Updated weights for policy 0, policy_version 154400 (0.0005) [2023-03-08 10:01:08,218][367737] Updated weights for policy 0, policy_version 154480 (0.0005) [2023-03-08 10:01:09,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11718.7). Total num frames: 79101952. Throughput: 0: 11516.6. Samples: 79095908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:01:09,272][367454] Avg episode reward: [(0, '4559.243')] [2023-03-08 10:01:11,773][367737] Updated weights for policy 0, policy_version 154560 (0.0005) [2023-03-08 10:01:14,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11718.7). Total num frames: 79159296. Throughput: 0: 11530.3. Samples: 79130624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:01:14,272][367454] Avg episode reward: [(0, '4527.480')] [2023-03-08 10:01:15,377][367737] Updated weights for policy 0, policy_version 154640 (0.0005) [2023-03-08 10:01:18,931][367737] Updated weights for policy 0, policy_version 154720 (0.0005) [2023-03-08 10:01:19,271][367454] Fps is (10 sec: 11878.3, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 79220736. Throughput: 0: 11533.0. Samples: 79199112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:01:19,272][367454] Avg episode reward: [(0, '4533.740')] [2023-03-08 10:01:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000154728_79220736.pth... [2023-03-08 10:01:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000154056_78876672.pth [2023-03-08 10:01:22,451][367737] Updated weights for policy 0, policy_version 154800 (0.0005) [2023-03-08 10:01:24,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 79278080. Throughput: 0: 11536.2. Samples: 79268888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:01:24,282][367454] Avg episode reward: [(0, '4540.373')] [2023-03-08 10:01:26,033][367737] Updated weights for policy 0, policy_version 154880 (0.0005) [2023-03-08 10:01:29,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 79335424. Throughput: 0: 11505.7. Samples: 79302884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:01:29,282][367454] Avg episode reward: [(0, '4529.712')] [2023-03-08 10:01:29,519][367737] Updated weights for policy 0, policy_version 154960 (0.0005) [2023-03-08 10:01:33,011][367737] Updated weights for policy 0, policy_version 155040 (0.0005) [2023-03-08 10:01:34,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11746.5). Total num frames: 79392768. Throughput: 0: 11517.3. Samples: 79373636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:01:34,282][367454] Avg episode reward: [(0, '4455.178')] [2023-03-08 10:01:34,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000155064_79392768.pth... [2023-03-08 10:01:34,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000154384_79044608.pth [2023-03-08 10:01:36,592][367737] Updated weights for policy 0, policy_version 155120 (0.0005) [2023-03-08 10:01:39,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11760.4). Total num frames: 79450112. Throughput: 0: 11502.6. Samples: 79442028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:01:39,272][367454] Avg episode reward: [(0, '4550.882')] [2023-03-08 10:01:40,110][367737] Updated weights for policy 0, policy_version 155200 (0.0005) [2023-03-08 10:01:43,683][367737] Updated weights for policy 0, policy_version 155280 (0.0005) [2023-03-08 10:01:44,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11746.5). Total num frames: 79507456. Throughput: 0: 11529.9. Samples: 79477176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:01:44,272][367454] Avg episode reward: [(0, '4521.068')] [2023-03-08 10:01:47,315][367737] Updated weights for policy 0, policy_version 155360 (0.0005) [2023-03-08 10:01:49,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11746.5). Total num frames: 79564800. Throughput: 0: 11535.2. Samples: 79545068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:01:49,272][367454] Avg episode reward: [(0, '4409.793')] [2023-03-08 10:01:49,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000155400_79564800.pth... [2023-03-08 10:01:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000154728_79220736.pth [2023-03-08 10:01:50,710][367737] Updated weights for policy 0, policy_version 155440 (0.0005) [2023-03-08 10:01:54,213][367737] Updated weights for policy 0, policy_version 155520 (0.0004) [2023-03-08 10:01:54,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11537.1, 300 sec: 11760.4). Total num frames: 79626240. Throughput: 0: 11583.2. Samples: 79617152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:01:54,272][367454] Avg episode reward: [(0, '4143.812')] [2023-03-08 10:01:57,573][367737] Updated weights for policy 0, policy_version 155600 (0.0004) [2023-03-08 10:01:59,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 79683584. Throughput: 0: 11574.0. Samples: 79651452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:01:59,272][367454] Avg episode reward: [(0, '4285.721')] [2023-03-08 10:02:01,153][367737] Updated weights for policy 0, policy_version 155680 (0.0005) [2023-03-08 10:02:04,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11732.6). Total num frames: 79740928. Throughput: 0: 11629.3. Samples: 79722432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:02:04,272][367454] Avg episode reward: [(0, '4519.236')] [2023-03-08 10:02:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000155744_79740928.pth... [2023-03-08 10:02:04,279][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000155064_79392768.pth [2023-03-08 10:02:04,712][367737] Updated weights for policy 0, policy_version 155760 (0.0005) [2023-03-08 10:02:08,300][367737] Updated weights for policy 0, policy_version 155840 (0.0005) [2023-03-08 10:02:09,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11704.8). Total num frames: 79798272. Throughput: 0: 11603.6. Samples: 79791052. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:02:09,272][367454] Avg episode reward: [(0, '4451.770')] [2023-03-08 10:02:11,792][367737] Updated weights for policy 0, policy_version 155920 (0.0004) [2023-03-08 10:02:14,272][367454] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11691.0). Total num frames: 79855616. Throughput: 0: 11645.8. Samples: 79826944. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:02:14,272][367454] Avg episode reward: [(0, '4507.116')] [2023-03-08 10:02:15,379][367737] Updated weights for policy 0, policy_version 156000 (0.0005) [2023-03-08 10:02:18,951][367737] Updated weights for policy 0, policy_version 156080 (0.0005) [2023-03-08 10:02:19,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11704.8). Total num frames: 79912960. Throughput: 0: 11591.7. Samples: 79895260. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:02:19,272][367454] Avg episode reward: [(0, '4259.706')] [2023-03-08 10:02:19,309][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000156088_79917056.pth... [2023-03-08 10:02:19,310][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000155400_79564800.pth [2023-03-08 10:02:22,510][367737] Updated weights for policy 0, policy_version 156160 (0.0005) [2023-03-08 10:02:24,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11718.7). Total num frames: 79970304. Throughput: 0: 11589.0. Samples: 79963532. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:02:24,272][367454] Avg episode reward: [(0, '4257.424')] [2023-03-08 10:02:26,282][367737] Updated weights for policy 0, policy_version 156240 (0.0005) [2023-03-08 10:02:29,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11704.8). Total num frames: 80027648. Throughput: 0: 11527.9. Samples: 79995932. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:02:29,272][367454] Avg episode reward: [(0, '4300.605')] [2023-03-08 10:02:29,850][367737] Updated weights for policy 0, policy_version 156320 (0.0005) [2023-03-08 10:02:33,407][367737] Updated weights for policy 0, policy_version 156400 (0.0005) [2023-03-08 10:02:34,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11704.8). Total num frames: 80084992. Throughput: 0: 11544.8. Samples: 80064584. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:02:34,272][367454] Avg episode reward: [(0, '4272.670')] [2023-03-08 10:02:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000156416_80084992.pth... [2023-03-08 10:02:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000155744_79740928.pth [2023-03-08 10:02:36,754][367737] Updated weights for policy 0, policy_version 156480 (0.0004) [2023-03-08 10:02:39,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 11718.7). Total num frames: 80146432. Throughput: 0: 11581.3. Samples: 80138312. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:02:39,272][367454] Avg episode reward: [(0, '4341.210')] [2023-03-08 10:02:39,980][367737] Updated weights for policy 0, policy_version 156560 (0.0003) [2023-03-08 10:02:43,321][367737] Updated weights for policy 0, policy_version 156640 (0.0004) [2023-03-08 10:02:44,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 11732.6). Total num frames: 80207872. Throughput: 0: 11648.8. Samples: 80175648. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:02:44,272][367454] Avg episode reward: [(0, '4358.532')] [2023-03-08 10:02:46,565][367737] Updated weights for policy 0, policy_version 156720 (0.0004) [2023-03-08 10:02:49,272][367454] Fps is (10 sec: 12287.9, 60 sec: 11741.8, 300 sec: 11746.5). Total num frames: 80269312. Throughput: 0: 11746.2. Samples: 80251012. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:02:49,272][367454] Avg episode reward: [(0, '4479.739')] [2023-03-08 10:02:49,302][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000156784_80273408.pth... [2023-03-08 10:02:49,303][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000156088_79917056.pth [2023-03-08 10:02:49,983][367737] Updated weights for policy 0, policy_version 156800 (0.0005) [2023-03-08 10:02:53,315][367737] Updated weights for policy 0, policy_version 156880 (0.0004) [2023-03-08 10:02:54,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11760.4). Total num frames: 80330752. Throughput: 0: 11827.7. Samples: 80323300. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:02:54,272][367454] Avg episode reward: [(0, '4485.231')] [2023-03-08 10:02:56,619][367737] Updated weights for policy 0, policy_version 156960 (0.0004) [2023-03-08 10:02:59,272][367454] Fps is (10 sec: 12697.7, 60 sec: 11878.4, 300 sec: 11788.1). Total num frames: 80396288. Throughput: 0: 11853.4. Samples: 80360348. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:02:59,272][367454] Avg episode reward: [(0, '4192.848')] [2023-03-08 10:02:59,877][367737] Updated weights for policy 0, policy_version 157040 (0.0005) [2023-03-08 10:03:03,235][367737] Updated weights for policy 0, policy_version 157120 (0.0004) [2023-03-08 10:03:04,272][367454] Fps is (10 sec: 12697.5, 60 sec: 11946.7, 300 sec: 11802.0). Total num frames: 80457728. Throughput: 0: 11994.3. Samples: 80435004. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:03:04,272][367454] Avg episode reward: [(0, '4403.273')] [2023-03-08 10:03:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000157144_80457728.pth... [2023-03-08 10:03:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000156416_80084992.pth [2023-03-08 10:03:06,605][367737] Updated weights for policy 0, policy_version 157200 (0.0005) [2023-03-08 10:03:09,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12014.9, 300 sec: 11815.9). Total num frames: 80519168. Throughput: 0: 12113.0. Samples: 80508616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:03:09,272][367454] Avg episode reward: [(0, '4411.711')] [2023-03-08 10:03:09,923][367737] Updated weights for policy 0, policy_version 157280 (0.0004) [2023-03-08 10:03:13,500][367737] Updated weights for policy 0, policy_version 157360 (0.0005) [2023-03-08 10:03:14,271][367454] Fps is (10 sec: 11878.6, 60 sec: 12014.9, 300 sec: 11815.9). Total num frames: 80576512. Throughput: 0: 12193.8. Samples: 80544652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:03:14,272][367454] Avg episode reward: [(0, '4334.825')] [2023-03-08 10:03:16,943][367737] Updated weights for policy 0, policy_version 157440 (0.0004) [2023-03-08 10:03:19,272][367454] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11815.9). Total num frames: 80633856. Throughput: 0: 12214.4. Samples: 80614232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:03:19,272][367454] Avg episode reward: [(0, '4531.397')] [2023-03-08 10:03:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000157488_80633856.pth... [2023-03-08 10:03:19,279][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000156784_80273408.pth [2023-03-08 10:03:20,502][367737] Updated weights for policy 0, policy_version 157520 (0.0005) [2023-03-08 10:03:24,042][367737] Updated weights for policy 0, policy_version 157600 (0.0004) [2023-03-08 10:03:24,271][367454] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11815.9). Total num frames: 80691200. Throughput: 0: 12106.0. Samples: 80683080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:03:24,272][367454] Avg episode reward: [(0, '4390.231')] [2023-03-08 10:03:27,550][367737] Updated weights for policy 0, policy_version 157680 (0.0004) [2023-03-08 10:03:29,272][367454] Fps is (10 sec: 11468.7, 60 sec: 12014.9, 300 sec: 11802.0). Total num frames: 80748544. Throughput: 0: 12081.4. Samples: 80719312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:03:29,272][367454] Avg episode reward: [(0, '4487.968')] [2023-03-08 10:03:31,101][367737] Updated weights for policy 0, policy_version 157760 (0.0005) [2023-03-08 10:03:34,272][367454] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11802.0). Total num frames: 80805888. Throughput: 0: 11927.7. Samples: 80787760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:03:34,272][367454] Avg episode reward: [(0, '4272.684')] [2023-03-08 10:03:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000157824_80805888.pth... [2023-03-08 10:03:34,279][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000157144_80457728.pth [2023-03-08 10:03:34,706][367737] Updated weights for policy 0, policy_version 157840 (0.0005) [2023-03-08 10:03:38,243][367737] Updated weights for policy 0, policy_version 157920 (0.0005) [2023-03-08 10:03:39,272][367454] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11802.0). Total num frames: 80863232. Throughput: 0: 11852.9. Samples: 80856680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:03:39,272][367454] Avg episode reward: [(0, '4308.825')] [2023-03-08 10:03:41,857][367737] Updated weights for policy 0, policy_version 158000 (0.0005) [2023-03-08 10:03:44,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11802.0). Total num frames: 80920576. Throughput: 0: 11805.0. Samples: 80891572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:03:44,283][367454] Avg episode reward: [(0, '4104.833')] [2023-03-08 10:03:45,552][367737] Updated weights for policy 0, policy_version 158080 (0.0005) [2023-03-08 10:03:49,271][367454] Fps is (10 sec: 11469.0, 60 sec: 11810.2, 300 sec: 11788.2). Total num frames: 80977920. Throughput: 0: 11609.9. Samples: 80957448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:03:49,272][367454] Avg episode reward: [(0, '4248.258')] [2023-03-08 10:03:49,272][367737] Updated weights for policy 0, policy_version 158160 (0.0005) [2023-03-08 10:03:49,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000158160_80977920.pth... [2023-03-08 10:03:49,276][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000157488_80633856.pth [2023-03-08 10:03:53,068][367737] Updated weights for policy 0, policy_version 158240 (0.0005) [2023-03-08 10:03:54,271][367454] Fps is (10 sec: 11059.2, 60 sec: 11673.6, 300 sec: 11760.4). Total num frames: 81031168. Throughput: 0: 11429.5. Samples: 81022944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:03:54,272][367454] Avg episode reward: [(0, '4110.830')] [2023-03-08 10:03:56,831][367737] Updated weights for policy 0, policy_version 158320 (0.0005) [2023-03-08 10:03:59,271][367454] Fps is (10 sec: 10649.5, 60 sec: 11468.8, 300 sec: 11732.6). Total num frames: 81084416. Throughput: 0: 11357.6. Samples: 81055744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:03:59,272][367454] Avg episode reward: [(0, '4225.753')] [2023-03-08 10:04:00,550][367737] Updated weights for policy 0, policy_version 158400 (0.0005) [2023-03-08 10:04:04,126][367737] Updated weights for policy 0, policy_version 158480 (0.0004) [2023-03-08 10:04:04,272][367454] Fps is (10 sec: 11059.1, 60 sec: 11400.5, 300 sec: 11718.7). Total num frames: 81141760. Throughput: 0: 11287.8. Samples: 81122184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:04:04,272][367454] Avg episode reward: [(0, '4225.698')] [2023-03-08 10:04:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000158480_81141760.pth... [2023-03-08 10:04:04,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000157824_80805888.pth [2023-03-08 10:04:07,811][367737] Updated weights for policy 0, policy_version 158560 (0.0005) [2023-03-08 10:04:09,272][367454] Fps is (10 sec: 11059.1, 60 sec: 11264.0, 300 sec: 11677.1). Total num frames: 81195008. Throughput: 0: 11247.2. Samples: 81189204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:04:09,272][367454] Avg episode reward: [(0, '4211.603')] [2023-03-08 10:04:11,399][367737] Updated weights for policy 0, policy_version 158640 (0.0005) [2023-03-08 10:04:14,272][367454] Fps is (10 sec: 11059.2, 60 sec: 11264.0, 300 sec: 11663.2). Total num frames: 81252352. Throughput: 0: 11209.6. Samples: 81223744. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:04:14,272][367454] Avg episode reward: [(0, '4343.792')] [2023-03-08 10:04:14,983][367737] Updated weights for policy 0, policy_version 158720 (0.0005) [2023-03-08 10:04:18,357][367737] Updated weights for policy 0, policy_version 158800 (0.0005) [2023-03-08 10:04:19,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11332.3, 300 sec: 11677.1). Total num frames: 81313792. Throughput: 0: 11241.9. Samples: 81293648. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:04:19,272][367454] Avg episode reward: [(0, '4404.300')] [2023-03-08 10:04:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000158816_81313792.pth... [2023-03-08 10:04:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000158160_80977920.pth [2023-03-08 10:04:21,810][367737] Updated weights for policy 0, policy_version 158880 (0.0005) [2023-03-08 10:04:24,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11400.5, 300 sec: 11677.1). Total num frames: 81375232. Throughput: 0: 11315.3. Samples: 81365868. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:04:24,283][367454] Avg episode reward: [(0, '4204.775')] [2023-03-08 10:04:25,238][367737] Updated weights for policy 0, policy_version 158960 (0.0005) [2023-03-08 10:04:28,618][367737] Updated weights for policy 0, policy_version 159040 (0.0005) [2023-03-08 10:04:29,272][367454] Fps is (10 sec: 11878.5, 60 sec: 11400.6, 300 sec: 11677.1). Total num frames: 81432576. Throughput: 0: 11334.2. Samples: 81401612. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:04:29,283][367454] Avg episode reward: [(0, '4162.809')] [2023-03-08 10:04:32,015][367737] Updated weights for policy 0, policy_version 159120 (0.0004) [2023-03-08 10:04:34,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 11691.0). Total num frames: 81494016. Throughput: 0: 11470.2. Samples: 81473608. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:04:34,283][367454] Avg episode reward: [(0, '4271.242')] [2023-03-08 10:04:34,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000159168_81494016.pth... [2023-03-08 10:04:34,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000158480_81141760.pth [2023-03-08 10:04:35,454][367737] Updated weights for policy 0, policy_version 159200 (0.0003) [2023-03-08 10:04:38,819][367737] Updated weights for policy 0, policy_version 159280 (0.0004) [2023-03-08 10:04:39,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11537.1, 300 sec: 11691.0). Total num frames: 81555456. Throughput: 0: 11629.9. Samples: 81546288. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:04:39,282][367454] Avg episode reward: [(0, '4299.408')] [2023-03-08 10:04:42,159][367737] Updated weights for policy 0, policy_version 159360 (0.0004) [2023-03-08 10:04:44,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11605.3, 300 sec: 11691.0). Total num frames: 81616896. Throughput: 0: 11711.2. Samples: 81582748. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:04:44,283][367454] Avg episode reward: [(0, '4389.077')] [2023-03-08 10:04:45,499][367737] Updated weights for policy 0, policy_version 159440 (0.0003) [2023-03-08 10:04:48,959][367737] Updated weights for policy 0, policy_version 159520 (0.0003) [2023-03-08 10:04:49,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11677.1). Total num frames: 81674240. Throughput: 0: 11865.7. Samples: 81656140. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:04:49,283][367454] Avg episode reward: [(0, '4458.520')] [2023-03-08 10:04:49,315][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000159528_81678336.pth... [2023-03-08 10:04:49,319][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000158816_81313792.pth [2023-03-08 10:04:52,323][367737] Updated weights for policy 0, policy_version 159600 (0.0005) [2023-03-08 10:04:54,271][367454] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 11691.0). Total num frames: 81739776. Throughput: 0: 11986.1. Samples: 81728576. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:04:54,282][367454] Avg episode reward: [(0, '4375.837')] [2023-03-08 10:04:55,568][367737] Updated weights for policy 0, policy_version 159680 (0.0004) [2023-03-08 10:04:58,949][367737] Updated weights for policy 0, policy_version 159760 (0.0004) [2023-03-08 10:04:59,271][367454] Fps is (10 sec: 12288.1, 60 sec: 11878.4, 300 sec: 11677.1). Total num frames: 81797120. Throughput: 0: 12065.3. Samples: 81766680. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:04:59,282][367454] Avg episode reward: [(0, '4506.403')] [2023-03-08 10:05:02,229][367737] Updated weights for policy 0, policy_version 159840 (0.0004) [2023-03-08 10:05:04,271][367454] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11677.1). Total num frames: 81858560. Throughput: 0: 12140.6. Samples: 81839972. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:05:04,282][367454] Avg episode reward: [(0, '4413.085')] [2023-03-08 10:05:04,302][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000159888_81862656.pth... [2023-03-08 10:05:04,304][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000159168_81494016.pth [2023-03-08 10:05:05,684][367737] Updated weights for policy 0, policy_version 159920 (0.0005) [2023-03-08 10:05:09,078][367737] Updated weights for policy 0, policy_version 160000 (0.0005) [2023-03-08 10:05:09,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11691.0). Total num frames: 81920000. Throughput: 0: 12132.0. Samples: 81911808. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:05:09,283][367454] Avg episode reward: [(0, '4251.497')] [2023-03-08 10:05:12,474][367737] Updated weights for policy 0, policy_version 160080 (0.0005) [2023-03-08 10:05:14,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12151.5, 300 sec: 11704.8). Total num frames: 81981440. Throughput: 0: 12148.9. Samples: 81948312. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:05:14,272][367454] Avg episode reward: [(0, '4397.122')] [2023-03-08 10:05:15,766][367737] Updated weights for policy 0, policy_version 160160 (0.0004) [2023-03-08 10:05:19,159][367737] Updated weights for policy 0, policy_version 160240 (0.0004) [2023-03-08 10:05:19,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11718.7). Total num frames: 82042880. Throughput: 0: 12195.6. Samples: 82022412. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:05:19,283][367454] Avg episode reward: [(0, '4566.334')] [2023-03-08 10:05:19,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000160240_82042880.pth... [2023-03-08 10:05:19,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000159528_81678336.pth [2023-03-08 10:05:22,806][367737] Updated weights for policy 0, policy_version 160320 (0.0006) [2023-03-08 10:05:24,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11732.6). Total num frames: 82100224. Throughput: 0: 12111.2. Samples: 82091292. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:05:24,283][367454] Avg episode reward: [(0, '4454.120')] [2023-03-08 10:05:26,390][367737] Updated weights for policy 0, policy_version 160400 (0.0005) [2023-03-08 10:05:29,271][367454] Fps is (10 sec: 11468.9, 60 sec: 12083.2, 300 sec: 11718.7). Total num frames: 82157568. Throughput: 0: 12047.0. Samples: 82124864. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:05:29,272][367454] Avg episode reward: [(0, '4556.064')] [2023-03-08 10:05:29,999][367737] Updated weights for policy 0, policy_version 160480 (0.0005) [2023-03-08 10:05:33,691][367737] Updated weights for policy 0, policy_version 160560 (0.0005) [2023-03-08 10:05:34,272][367454] Fps is (10 sec: 11059.2, 60 sec: 11946.7, 300 sec: 11704.8). Total num frames: 82210816. Throughput: 0: 11924.9. Samples: 82192760. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:05:34,272][367454] Avg episode reward: [(0, '4440.118')] [2023-03-08 10:05:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000160568_82210816.pth... [2023-03-08 10:05:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000159888_81862656.pth [2023-03-08 10:05:37,239][367737] Updated weights for policy 0, policy_version 160640 (0.0006) [2023-03-08 10:05:39,272][367454] Fps is (10 sec: 11059.1, 60 sec: 11878.4, 300 sec: 11704.8). Total num frames: 82268160. Throughput: 0: 11835.5. Samples: 82261172. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:05:39,272][367454] Avg episode reward: [(0, '4533.073')] [2023-03-08 10:05:40,860][367737] Updated weights for policy 0, policy_version 160720 (0.0006) [2023-03-08 10:05:44,272][367454] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 11704.8). Total num frames: 82325504. Throughput: 0: 11743.8. Samples: 82295152. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:05:44,276][367454] Avg episode reward: [(0, '4463.999')] [2023-03-08 10:05:44,398][367737] Updated weights for policy 0, policy_version 160800 (0.0005) [2023-03-08 10:05:47,702][367737] Updated weights for policy 0, policy_version 160880 (0.0004) [2023-03-08 10:05:49,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11704.8). Total num frames: 82386944. Throughput: 0: 11710.9. Samples: 82366964. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:05:49,272][367454] Avg episode reward: [(0, '4567.988')] [2023-03-08 10:05:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000160912_82386944.pth... [2023-03-08 10:05:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000160240_82042880.pth [2023-03-08 10:05:51,089][367737] Updated weights for policy 0, policy_version 160960 (0.0005) [2023-03-08 10:05:54,271][367454] Fps is (10 sec: 12288.1, 60 sec: 11810.1, 300 sec: 11732.6). Total num frames: 82448384. Throughput: 0: 11743.3. Samples: 82440256. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:05:54,272][367454] Avg episode reward: [(0, '4544.906')] [2023-03-08 10:05:54,360][367737] Updated weights for policy 0, policy_version 161040 (0.0005) [2023-03-08 10:05:57,699][367737] Updated weights for policy 0, policy_version 161120 (0.0005) [2023-03-08 10:05:59,271][367454] Fps is (10 sec: 12288.1, 60 sec: 11878.4, 300 sec: 11746.5). Total num frames: 82509824. Throughput: 0: 11769.3. Samples: 82477928. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:05:59,272][367454] Avg episode reward: [(0, '4478.909')] [2023-03-08 10:06:01,026][367737] Updated weights for policy 0, policy_version 161200 (0.0004) [2023-03-08 10:06:04,272][367454] Fps is (10 sec: 12287.9, 60 sec: 11878.4, 300 sec: 11760.4). Total num frames: 82571264. Throughput: 0: 11759.8. Samples: 82551604. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:06:04,272][367454] Avg episode reward: [(0, '4463.639')] [2023-03-08 10:06:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000161272_82571264.pth... [2023-03-08 10:06:04,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000160568_82210816.pth [2023-03-08 10:06:04,322][367737] Updated weights for policy 0, policy_version 161280 (0.0004) [2023-03-08 10:06:07,647][367737] Updated weights for policy 0, policy_version 161360 (0.0004) [2023-03-08 10:06:09,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11774.3). Total num frames: 82632704. Throughput: 0: 11871.5. Samples: 82625508. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:06:09,282][367454] Avg episode reward: [(0, '4433.425')] [2023-03-08 10:06:11,179][367737] Updated weights for policy 0, policy_version 161440 (0.0005) [2023-03-08 10:06:14,271][367454] Fps is (10 sec: 11878.5, 60 sec: 11810.1, 300 sec: 11760.4). Total num frames: 82690048. Throughput: 0: 11891.4. Samples: 82659976. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:06:14,272][367454] Avg episode reward: [(0, '4418.246')] [2023-03-08 10:06:14,775][367737] Updated weights for policy 0, policy_version 161520 (0.0005) [2023-03-08 10:06:18,410][367737] Updated weights for policy 0, policy_version 161600 (0.0005) [2023-03-08 10:06:19,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11760.4). Total num frames: 82747392. Throughput: 0: 11897.5. Samples: 82728148. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:06:19,283][367454] Avg episode reward: [(0, '4229.353')] [2023-03-08 10:06:19,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000161616_82747392.pth... [2023-03-08 10:06:19,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000160912_82386944.pth [2023-03-08 10:06:22,035][367737] Updated weights for policy 0, policy_version 161680 (0.0005) [2023-03-08 10:06:24,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 11760.4). Total num frames: 82804736. Throughput: 0: 11882.6. Samples: 82795888. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:06:24,282][367454] Avg episode reward: [(0, '4573.054')] [2023-03-08 10:06:25,604][367737] Updated weights for policy 0, policy_version 161760 (0.0005) [2023-03-08 10:06:29,178][367737] Updated weights for policy 0, policy_version 161840 (0.0005) [2023-03-08 10:06:29,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11760.4). Total num frames: 82862080. Throughput: 0: 11886.4. Samples: 82830040. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:06:29,282][367454] Avg episode reward: [(0, '4443.805')] [2023-03-08 10:06:32,739][367737] Updated weights for policy 0, policy_version 161920 (0.0005) [2023-03-08 10:06:34,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 11760.4). Total num frames: 82919424. Throughput: 0: 11823.2. Samples: 82899008. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:06:34,282][367454] Avg episode reward: [(0, '4461.185')] [2023-03-08 10:06:34,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000161952_82919424.pth... [2023-03-08 10:06:34,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000161272_82571264.pth [2023-03-08 10:06:36,352][367737] Updated weights for policy 0, policy_version 162000 (0.0005) [2023-03-08 10:06:39,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11760.4). Total num frames: 82976768. Throughput: 0: 11727.3. Samples: 82967984. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:06:39,272][367454] Avg episode reward: [(0, '4483.943')] [2023-03-08 10:06:39,952][367737] Updated weights for policy 0, policy_version 162080 (0.0004) [2023-03-08 10:06:43,576][367737] Updated weights for policy 0, policy_version 162160 (0.0005) [2023-03-08 10:06:44,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 11760.4). Total num frames: 83034112. Throughput: 0: 11632.9. Samples: 83001408. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:06:44,272][367454] Avg episode reward: [(0, '4519.572')] [2023-03-08 10:06:47,155][367737] Updated weights for policy 0, policy_version 162240 (0.0005) [2023-03-08 10:06:49,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11746.5). Total num frames: 83091456. Throughput: 0: 11519.2. Samples: 83069968. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:06:49,272][367454] Avg episode reward: [(0, '4435.814')] [2023-03-08 10:06:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000162288_83091456.pth... [2023-03-08 10:06:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000161616_82747392.pth [2023-03-08 10:06:50,567][367737] Updated weights for policy 0, policy_version 162320 (0.0004) [2023-03-08 10:06:53,860][367737] Updated weights for policy 0, policy_version 162400 (0.0004) [2023-03-08 10:06:54,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11760.4). Total num frames: 83152896. Throughput: 0: 11492.0. Samples: 83142648. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:06:54,272][367454] Avg episode reward: [(0, '4414.437')] [2023-03-08 10:06:57,446][367737] Updated weights for policy 0, policy_version 162480 (0.0004) [2023-03-08 10:06:59,271][367454] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11760.4). Total num frames: 83210240. Throughput: 0: 11501.3. Samples: 83177536. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:06:59,272][367454] Avg episode reward: [(0, '4494.939')] [2023-03-08 10:07:00,960][367737] Updated weights for policy 0, policy_version 162560 (0.0004) [2023-03-08 10:07:04,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11760.4). Total num frames: 83267584. Throughput: 0: 11544.3. Samples: 83247644. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:07:04,272][367454] Avg episode reward: [(0, '4565.287')] [2023-03-08 10:07:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000162632_83267584.pth... [2023-03-08 10:07:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000161952_82919424.pth [2023-03-08 10:07:04,396][367737] Updated weights for policy 0, policy_version 162640 (0.0004) [2023-03-08 10:07:07,849][367737] Updated weights for policy 0, policy_version 162720 (0.0003) [2023-03-08 10:07:09,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11774.3). Total num frames: 83329024. Throughput: 0: 11633.8. Samples: 83319412. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:07:09,272][367454] Avg episode reward: [(0, '4491.661')] [2023-03-08 10:07:11,166][367737] Updated weights for policy 0, policy_version 162800 (0.0003) [2023-03-08 10:07:14,272][367454] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11774.3). Total num frames: 83386368. Throughput: 0: 11700.1. Samples: 83356544. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:07:14,272][367454] Avg episode reward: [(0, '4518.592')] [2023-03-08 10:07:14,769][367737] Updated weights for policy 0, policy_version 162880 (0.0005) [2023-03-08 10:07:18,304][367737] Updated weights for policy 0, policy_version 162960 (0.0005) [2023-03-08 10:07:19,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11788.1). Total num frames: 83447808. Throughput: 0: 11682.1. Samples: 83424704. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:07:19,272][367454] Avg episode reward: [(0, '4546.188')] [2023-03-08 10:07:19,277][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000162984_83447808.pth... [2023-03-08 10:07:19,279][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000162288_83091456.pth [2023-03-08 10:07:21,556][367737] Updated weights for policy 0, policy_version 163040 (0.0005) [2023-03-08 10:07:24,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11741.8, 300 sec: 11802.0). Total num frames: 83509248. Throughput: 0: 11826.8. Samples: 83500192. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:07:24,272][367454] Avg episode reward: [(0, '4531.865')] [2023-03-08 10:07:24,764][367737] Updated weights for policy 0, policy_version 163120 (0.0004) [2023-03-08 10:07:28,091][367737] Updated weights for policy 0, policy_version 163200 (0.0005) [2023-03-08 10:07:29,272][367454] Fps is (10 sec: 12288.1, 60 sec: 11810.1, 300 sec: 11815.9). Total num frames: 83570688. Throughput: 0: 11923.9. Samples: 83537984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:07:29,272][367454] Avg episode reward: [(0, '4595.438')] [2023-03-08 10:07:31,342][367737] Updated weights for policy 0, policy_version 163280 (0.0004) [2023-03-08 10:07:34,272][367454] Fps is (10 sec: 12697.6, 60 sec: 11946.7, 300 sec: 11829.8). Total num frames: 83636224. Throughput: 0: 12063.3. Samples: 83612816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:07:34,272][367454] Avg episode reward: [(0, '4608.511')] [2023-03-08 10:07:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000163352_83636224.pth... [2023-03-08 10:07:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000162632_83267584.pth [2023-03-08 10:07:34,570][367737] Updated weights for policy 0, policy_version 163360 (0.0004) [2023-03-08 10:07:37,870][367737] Updated weights for policy 0, policy_version 163440 (0.0005) [2023-03-08 10:07:39,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11829.8). Total num frames: 83697664. Throughput: 0: 12112.1. Samples: 83687692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:07:39,272][367454] Avg episode reward: [(0, '4619.282')] [2023-03-08 10:07:41,242][367737] Updated weights for policy 0, policy_version 163520 (0.0004) [2023-03-08 10:07:44,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12083.2, 300 sec: 11829.8). Total num frames: 83759104. Throughput: 0: 12143.1. Samples: 83723976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:07:44,272][367454] Avg episode reward: [(0, '4525.691')] [2023-03-08 10:07:44,510][367737] Updated weights for policy 0, policy_version 163600 (0.0003) [2023-03-08 10:07:47,888][367737] Updated weights for policy 0, policy_version 163680 (0.0004) [2023-03-08 10:07:49,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12151.5, 300 sec: 11829.8). Total num frames: 83820544. Throughput: 0: 12249.4. Samples: 83798868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:07:49,272][367454] Avg episode reward: [(0, '4460.243')] [2023-03-08 10:07:49,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000163712_83820544.pth... [2023-03-08 10:07:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000162984_83447808.pth [2023-03-08 10:07:51,190][367737] Updated weights for policy 0, policy_version 163760 (0.0004) [2023-03-08 10:07:54,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11815.9). Total num frames: 83881984. Throughput: 0: 12291.6. Samples: 83872536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:07:54,272][367454] Avg episode reward: [(0, '4439.754')] [2023-03-08 10:07:54,502][367737] Updated weights for policy 0, policy_version 163840 (0.0005) [2023-03-08 10:07:57,657][367737] Updated weights for policy 0, policy_version 163920 (0.0004) [2023-03-08 10:07:59,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 11815.9). Total num frames: 83943424. Throughput: 0: 12315.2. Samples: 83910728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:07:59,272][367454] Avg episode reward: [(0, '4379.024')] [2023-03-08 10:08:00,991][367737] Updated weights for policy 0, policy_version 164000 (0.0005) [2023-03-08 10:08:04,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 11815.9). Total num frames: 84004864. Throughput: 0: 12457.5. Samples: 83985292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:08:04,272][367454] Avg episode reward: [(0, '4360.690')] [2023-03-08 10:08:04,289][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000164080_84008960.pth... [2023-03-08 10:08:04,289][367737] Updated weights for policy 0, policy_version 164080 (0.0005) [2023-03-08 10:08:04,291][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000163352_83636224.pth [2023-03-08 10:08:07,574][367737] Updated weights for policy 0, policy_version 164160 (0.0004) [2023-03-08 10:08:09,272][367454] Fps is (10 sec: 12697.7, 60 sec: 12356.3, 300 sec: 11843.7). Total num frames: 84070400. Throughput: 0: 12450.1. Samples: 84060448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:08:09,272][367454] Avg episode reward: [(0, '4376.269')] [2023-03-08 10:08:10,819][367737] Updated weights for policy 0, policy_version 164240 (0.0003) [2023-03-08 10:08:14,038][367737] Updated weights for policy 0, policy_version 164320 (0.0004) [2023-03-08 10:08:14,272][367454] Fps is (10 sec: 12697.7, 60 sec: 12424.5, 300 sec: 11857.6). Total num frames: 84131840. Throughput: 0: 12450.4. Samples: 84098252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:08:14,272][367454] Avg episode reward: [(0, '4457.089')] [2023-03-08 10:08:17,226][367737] Updated weights for policy 0, policy_version 164400 (0.0004) [2023-03-08 10:08:19,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 11885.3). Total num frames: 84197376. Throughput: 0: 12493.6. Samples: 84175028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:08:19,272][367454] Avg episode reward: [(0, '4411.900')] [2023-03-08 10:08:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000164448_84197376.pth... [2023-03-08 10:08:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000163712_83820544.pth [2023-03-08 10:08:20,421][367737] Updated weights for policy 0, policy_version 164480 (0.0004) [2023-03-08 10:08:23,808][367737] Updated weights for policy 0, policy_version 164560 (0.0005) [2023-03-08 10:08:24,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 11899.2). Total num frames: 84258816. Throughput: 0: 12507.9. Samples: 84250548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:08:24,272][367454] Avg episode reward: [(0, '4411.879')] [2023-03-08 10:08:27,304][367737] Updated weights for policy 0, policy_version 164640 (0.0005) [2023-03-08 10:08:29,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 11899.2). Total num frames: 84316160. Throughput: 0: 12471.6. Samples: 84285196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:08:29,272][367454] Avg episode reward: [(0, '4386.810')] [2023-03-08 10:08:30,843][367737] Updated weights for policy 0, policy_version 164720 (0.0004) [2023-03-08 10:08:34,272][367454] Fps is (10 sec: 11468.7, 60 sec: 12288.0, 300 sec: 11899.2). Total num frames: 84373504. Throughput: 0: 12381.4. Samples: 84356032. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:08:34,272][367454] Avg episode reward: [(0, '4364.250')] [2023-03-08 10:08:34,291][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000164800_84377600.pth... [2023-03-08 10:08:34,292][367737] Updated weights for policy 0, policy_version 164800 (0.0004) [2023-03-08 10:08:34,293][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000164080_84008960.pth [2023-03-08 10:08:37,756][367737] Updated weights for policy 0, policy_version 164880 (0.0004) [2023-03-08 10:08:39,271][367454] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 11913.1). Total num frames: 84434944. Throughput: 0: 12306.4. Samples: 84426324. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:08:39,272][367454] Avg episode reward: [(0, '4416.687')] [2023-03-08 10:08:41,193][367737] Updated weights for policy 0, policy_version 164960 (0.0005) [2023-03-08 10:08:44,271][367454] Fps is (10 sec: 11878.5, 60 sec: 12219.7, 300 sec: 11913.1). Total num frames: 84492288. Throughput: 0: 12256.4. Samples: 84462264. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:08:44,272][367454] Avg episode reward: [(0, '4339.386')] [2023-03-08 10:08:44,710][367737] Updated weights for policy 0, policy_version 165040 (0.0005) [2023-03-08 10:08:48,096][367737] Updated weights for policy 0, policy_version 165120 (0.0004) [2023-03-08 10:08:49,271][367454] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 11940.9). Total num frames: 84553728. Throughput: 0: 12176.8. Samples: 84533248. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:08:49,272][367454] Avg episode reward: [(0, '4465.230')] [2023-03-08 10:08:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000165144_84553728.pth... [2023-03-08 10:08:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000164448_84197376.pth [2023-03-08 10:08:51,615][367737] Updated weights for policy 0, policy_version 165200 (0.0005) [2023-03-08 10:08:54,271][367454] Fps is (10 sec: 11878.3, 60 sec: 12151.5, 300 sec: 11954.8). Total num frames: 84611072. Throughput: 0: 12054.2. Samples: 84602888. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:08:54,272][367454] Avg episode reward: [(0, '4504.388')] [2023-03-08 10:08:55,091][367737] Updated weights for policy 0, policy_version 165280 (0.0004) [2023-03-08 10:08:58,426][367737] Updated weights for policy 0, policy_version 165360 (0.0004) [2023-03-08 10:08:59,271][367454] Fps is (10 sec: 11878.5, 60 sec: 12151.5, 300 sec: 11968.7). Total num frames: 84672512. Throughput: 0: 12034.6. Samples: 84639808. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:08:59,272][367454] Avg episode reward: [(0, '4417.953')] [2023-03-08 10:09:01,706][367737] Updated weights for policy 0, policy_version 165440 (0.0003) [2023-03-08 10:09:04,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12219.7, 300 sec: 12010.3). Total num frames: 84738048. Throughput: 0: 11967.0. Samples: 84713544. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:09:04,272][367454] Avg episode reward: [(0, '4272.887')] [2023-03-08 10:09:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000165504_84738048.pth... [2023-03-08 10:09:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000164800_84377600.pth [2023-03-08 10:09:04,944][367737] Updated weights for policy 0, policy_version 165520 (0.0004) [2023-03-08 10:09:08,201][367737] Updated weights for policy 0, policy_version 165600 (0.0004) [2023-03-08 10:09:09,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 12024.2). Total num frames: 84799488. Throughput: 0: 11979.6. Samples: 84789632. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:09:09,272][367454] Avg episode reward: [(0, '4458.633')] [2023-03-08 10:09:11,478][367737] Updated weights for policy 0, policy_version 165680 (0.0004) [2023-03-08 10:09:14,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 12024.2). Total num frames: 84860928. Throughput: 0: 12046.5. Samples: 84827288. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:09:14,272][367454] Avg episode reward: [(0, '4350.031')] [2023-03-08 10:09:14,863][367737] Updated weights for policy 0, policy_version 165760 (0.0004) [2023-03-08 10:09:18,100][367737] Updated weights for policy 0, policy_version 165840 (0.0003) [2023-03-08 10:09:19,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 12024.2). Total num frames: 84922368. Throughput: 0: 12127.5. Samples: 84901768. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:09:19,272][367454] Avg episode reward: [(0, '4524.955')] [2023-03-08 10:09:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000165864_84922368.pth... [2023-03-08 10:09:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000165144_84553728.pth [2023-03-08 10:09:21,493][367737] Updated weights for policy 0, policy_version 165920 (0.0004) [2023-03-08 10:09:24,271][367454] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 12024.2). Total num frames: 84979712. Throughput: 0: 12130.6. Samples: 84972200. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:09:24,272][367454] Avg episode reward: [(0, '4428.014')] [2023-03-08 10:09:25,089][367737] Updated weights for policy 0, policy_version 166000 (0.0005) [2023-03-08 10:09:28,792][367737] Updated weights for policy 0, policy_version 166080 (0.0005) [2023-03-08 10:09:29,271][367454] Fps is (10 sec: 11468.9, 60 sec: 12014.9, 300 sec: 12010.3). Total num frames: 85037056. Throughput: 0: 12092.9. Samples: 85006444. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:09:29,272][367454] Avg episode reward: [(0, '4550.461')] [2023-03-08 10:09:32,486][367737] Updated weights for policy 0, policy_version 166160 (0.0005) [2023-03-08 10:09:34,272][367454] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11996.4). Total num frames: 85094400. Throughput: 0: 12009.6. Samples: 85073680. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:09:34,272][367454] Avg episode reward: [(0, '4613.347')] [2023-03-08 10:09:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000166200_85094400.pth... [2023-03-08 10:09:34,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000165504_84738048.pth [2023-03-08 10:09:35,975][367737] Updated weights for policy 0, policy_version 166240 (0.0005) [2023-03-08 10:09:39,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11982.5). Total num frames: 85151744. Throughput: 0: 12014.1. Samples: 85143520. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:09:39,272][367454] Avg episode reward: [(0, '4501.551')] [2023-03-08 10:09:39,492][367737] Updated weights for policy 0, policy_version 166320 (0.0004) [2023-03-08 10:09:43,072][367737] Updated weights for policy 0, policy_version 166400 (0.0003) [2023-03-08 10:09:44,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11982.5). Total num frames: 85209088. Throughput: 0: 11981.5. Samples: 85178976. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:09:44,272][367454] Avg episode reward: [(0, '4524.340')] [2023-03-08 10:09:46,619][367737] Updated weights for policy 0, policy_version 166480 (0.0005) [2023-03-08 10:09:49,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11878.4, 300 sec: 11954.8). Total num frames: 85266432. Throughput: 0: 11838.0. Samples: 85246252. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:09:49,272][367454] Avg episode reward: [(0, '4579.927')] [2023-03-08 10:09:49,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000166536_85266432.pth... [2023-03-08 10:09:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000165864_84922368.pth [2023-03-08 10:09:50,203][367737] Updated weights for policy 0, policy_version 166560 (0.0005) [2023-03-08 10:09:53,660][367737] Updated weights for policy 0, policy_version 166640 (0.0005) [2023-03-08 10:09:54,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11954.8). Total num frames: 85323776. Throughput: 0: 11710.8. Samples: 85316616. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:09:54,272][367454] Avg episode reward: [(0, '4549.929')] [2023-03-08 10:09:57,167][367737] Updated weights for policy 0, policy_version 166720 (0.0005) [2023-03-08 10:09:59,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11940.9). Total num frames: 85381120. Throughput: 0: 11669.1. Samples: 85352396. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:09:59,272][367454] Avg episode reward: [(0, '4485.973')] [2023-03-08 10:10:00,846][367737] Updated weights for policy 0, policy_version 166800 (0.0005) [2023-03-08 10:10:04,272][367454] Fps is (10 sec: 11468.6, 60 sec: 11673.6, 300 sec: 11927.0). Total num frames: 85438464. Throughput: 0: 11506.5. Samples: 85419560. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:10:04,272][367454] Avg episode reward: [(0, '4582.490')] [2023-03-08 10:10:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000166872_85438464.pth... [2023-03-08 10:10:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000166200_85094400.pth [2023-03-08 10:10:04,441][367737] Updated weights for policy 0, policy_version 166880 (0.0005) [2023-03-08 10:10:08,028][367737] Updated weights for policy 0, policy_version 166960 (0.0005) [2023-03-08 10:10:09,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11913.1). Total num frames: 85495808. Throughput: 0: 11455.1. Samples: 85487680. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:10:09,272][367454] Avg episode reward: [(0, '4573.820')] [2023-03-08 10:10:11,382][367737] Updated weights for policy 0, policy_version 167040 (0.0005) [2023-03-08 10:10:14,272][367454] Fps is (10 sec: 11878.6, 60 sec: 11605.3, 300 sec: 11913.1). Total num frames: 85557248. Throughput: 0: 11513.3. Samples: 85524544. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:10:14,272][367454] Avg episode reward: [(0, '4500.211')] [2023-03-08 10:10:14,662][367737] Updated weights for policy 0, policy_version 167120 (0.0004) [2023-03-08 10:10:18,027][367737] Updated weights for policy 0, policy_version 167200 (0.0005) [2023-03-08 10:10:19,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11605.3, 300 sec: 11927.0). Total num frames: 85618688. Throughput: 0: 11657.6. Samples: 85598272. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:10:19,272][367454] Avg episode reward: [(0, '4559.302')] [2023-03-08 10:10:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000167224_85618688.pth... [2023-03-08 10:10:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000166536_85266432.pth [2023-03-08 10:10:21,452][367737] Updated weights for policy 0, policy_version 167280 (0.0005) [2023-03-08 10:10:24,271][367454] Fps is (10 sec: 12288.1, 60 sec: 11673.6, 300 sec: 11940.9). Total num frames: 85680128. Throughput: 0: 11745.4. Samples: 85672064. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:10:24,272][367454] Avg episode reward: [(0, '4460.780')] [2023-03-08 10:10:24,702][367737] Updated weights for policy 0, policy_version 167360 (0.0004) [2023-03-08 10:10:28,150][367737] Updated weights for policy 0, policy_version 167440 (0.0005) [2023-03-08 10:10:29,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11968.7). Total num frames: 85741568. Throughput: 0: 11773.9. Samples: 85708800. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:10:29,272][367454] Avg episode reward: [(0, '4445.515')] [2023-03-08 10:10:31,664][367737] Updated weights for policy 0, policy_version 167520 (0.0005) [2023-03-08 10:10:34,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11741.9, 300 sec: 11968.6). Total num frames: 85798912. Throughput: 0: 11845.8. Samples: 85779312. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:10:34,272][367454] Avg episode reward: [(0, '4434.783')] [2023-03-08 10:10:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000167576_85798912.pth... [2023-03-08 10:10:34,276][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000166872_85438464.pth [2023-03-08 10:10:34,976][367737] Updated weights for policy 0, policy_version 167600 (0.0005) [2023-03-08 10:10:38,291][367737] Updated weights for policy 0, policy_version 167680 (0.0004) [2023-03-08 10:10:39,272][367454] Fps is (10 sec: 11878.2, 60 sec: 11810.1, 300 sec: 11982.5). Total num frames: 85860352. Throughput: 0: 11925.6. Samples: 85853272. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:10:39,272][367454] Avg episode reward: [(0, '4432.915')] [2023-03-08 10:10:41,676][367737] Updated weights for policy 0, policy_version 167760 (0.0004) [2023-03-08 10:10:44,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11982.5). Total num frames: 85921792. Throughput: 0: 11926.7. Samples: 85889096. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:10:44,272][367454] Avg episode reward: [(0, '4573.788')] [2023-03-08 10:10:45,227][367737] Updated weights for policy 0, policy_version 167840 (0.0005) [2023-03-08 10:10:48,765][367737] Updated weights for policy 0, policy_version 167920 (0.0005) [2023-03-08 10:10:49,272][367454] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 11968.6). Total num frames: 85979136. Throughput: 0: 11986.9. Samples: 85958972. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:10:49,272][367454] Avg episode reward: [(0, '4469.459')] [2023-03-08 10:10:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000167928_85979136.pth... [2023-03-08 10:10:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000167224_85618688.pth [2023-03-08 10:10:52,232][367737] Updated weights for policy 0, policy_version 168000 (0.0005) [2023-03-08 10:10:54,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11954.8). Total num frames: 86036480. Throughput: 0: 12062.5. Samples: 86030492. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:10:54,272][367454] Avg episode reward: [(0, '4506.337')] [2023-03-08 10:10:55,715][367737] Updated weights for policy 0, policy_version 168080 (0.0004) [2023-03-08 10:10:58,976][367737] Updated weights for policy 0, policy_version 168160 (0.0004) [2023-03-08 10:10:59,272][367454] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 11954.8). Total num frames: 86097920. Throughput: 0: 12014.9. Samples: 86065216. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:10:59,272][367454] Avg episode reward: [(0, '4627.116')] [2023-03-08 10:11:02,559][367737] Updated weights for policy 0, policy_version 168240 (0.0005) [2023-03-08 10:11:04,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11940.9). Total num frames: 86155264. Throughput: 0: 11981.4. Samples: 86137436. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:11:04,272][367454] Avg episode reward: [(0, '4594.244')] [2023-03-08 10:11:04,303][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000168280_86159360.pth... [2023-03-08 10:11:04,304][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000167576_85798912.pth [2023-03-08 10:11:05,992][367737] Updated weights for policy 0, policy_version 168320 (0.0004) [2023-03-08 10:11:09,271][367454] Fps is (10 sec: 11878.5, 60 sec: 12014.9, 300 sec: 11954.8). Total num frames: 86216704. Throughput: 0: 11905.7. Samples: 86207820. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:11:09,272][367454] Avg episode reward: [(0, '4458.957')] [2023-03-08 10:11:09,526][367737] Updated weights for policy 0, policy_version 168400 (0.0005) [2023-03-08 10:11:12,904][367737] Updated weights for policy 0, policy_version 168480 (0.0004) [2023-03-08 10:11:14,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11954.8). Total num frames: 86274048. Throughput: 0: 11889.2. Samples: 86243816. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:11:14,272][367454] Avg episode reward: [(0, '4478.183')] [2023-03-08 10:11:16,349][367737] Updated weights for policy 0, policy_version 168560 (0.0005) [2023-03-08 10:11:19,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11968.6). Total num frames: 86335488. Throughput: 0: 11907.7. Samples: 86315156. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:11:19,272][367454] Avg episode reward: [(0, '4502.029')] [2023-03-08 10:11:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000168624_86335488.pth... [2023-03-08 10:11:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000167928_85979136.pth [2023-03-08 10:11:19,880][367737] Updated weights for policy 0, policy_version 168640 (0.0005) [2023-03-08 10:11:23,453][367737] Updated weights for policy 0, policy_version 168720 (0.0005) [2023-03-08 10:11:24,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11968.6). Total num frames: 86392832. Throughput: 0: 11805.9. Samples: 86384536. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:11:24,272][367454] Avg episode reward: [(0, '4647.075')] [2023-03-08 10:11:27,293][367737] Updated weights for policy 0, policy_version 168800 (0.0006) [2023-03-08 10:11:29,272][367454] Fps is (10 sec: 11059.2, 60 sec: 11741.9, 300 sec: 11954.8). Total num frames: 86446080. Throughput: 0: 11714.9. Samples: 86416268. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:11:29,272][367454] Avg episode reward: [(0, '4566.259')] [2023-03-08 10:11:30,712][367737] Updated weights for policy 0, policy_version 168880 (0.0004) [2023-03-08 10:11:34,121][367737] Updated weights for policy 0, policy_version 168960 (0.0005) [2023-03-08 10:11:34,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11968.6). Total num frames: 86507520. Throughput: 0: 11733.6. Samples: 86486984. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:11:34,272][367454] Avg episode reward: [(0, '4625.491')] [2023-03-08 10:11:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000168960_86507520.pth... [2023-03-08 10:11:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000168280_86159360.pth [2023-03-08 10:11:37,609][367737] Updated weights for policy 0, policy_version 169040 (0.0005) [2023-03-08 10:11:39,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11968.6). Total num frames: 86564864. Throughput: 0: 11710.2. Samples: 86557452. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:11:39,272][367454] Avg episode reward: [(0, '4618.827')] [2023-03-08 10:11:41,195][367737] Updated weights for policy 0, policy_version 169120 (0.0005) [2023-03-08 10:11:44,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11968.7). Total num frames: 86622208. Throughput: 0: 11706.7. Samples: 86592016. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:11:44,272][367454] Avg episode reward: [(0, '4617.048')] [2023-03-08 10:11:44,663][367737] Updated weights for policy 0, policy_version 169200 (0.0005) [2023-03-08 10:11:48,239][367737] Updated weights for policy 0, policy_version 169280 (0.0005) [2023-03-08 10:11:49,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 11954.8). Total num frames: 86679552. Throughput: 0: 11653.7. Samples: 86661852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:11:49,272][367454] Avg episode reward: [(0, '4572.970')] [2023-03-08 10:11:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000169296_86679552.pth... [2023-03-08 10:11:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000168624_86335488.pth [2023-03-08 10:11:51,847][367737] Updated weights for policy 0, policy_version 169360 (0.0004) [2023-03-08 10:11:54,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11954.8). Total num frames: 86736896. Throughput: 0: 11583.1. Samples: 86729060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:11:54,272][367454] Avg episode reward: [(0, '4450.272')] [2023-03-08 10:11:55,408][367737] Updated weights for policy 0, policy_version 169440 (0.0004) [2023-03-08 10:11:58,839][367737] Updated weights for policy 0, policy_version 169520 (0.0004) [2023-03-08 10:11:59,271][367454] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 11968.7). Total num frames: 86798336. Throughput: 0: 11584.5. Samples: 86765116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:11:59,272][367454] Avg episode reward: [(0, '4320.775')] [2023-03-08 10:12:02,418][367737] Updated weights for policy 0, policy_version 169600 (0.0005) [2023-03-08 10:12:04,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11954.8). Total num frames: 86855680. Throughput: 0: 11556.7. Samples: 86835208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:12:04,272][367454] Avg episode reward: [(0, '4450.530')] [2023-03-08 10:12:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000169640_86855680.pth... [2023-03-08 10:12:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000168960_86507520.pth [2023-03-08 10:12:05,832][367737] Updated weights for policy 0, policy_version 169680 (0.0003) [2023-03-08 10:12:09,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11954.8). Total num frames: 86913024. Throughput: 0: 11580.3. Samples: 86905648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:12:09,272][367454] Avg episode reward: [(0, '4287.340')] [2023-03-08 10:12:09,369][367737] Updated weights for policy 0, policy_version 169760 (0.0005) [2023-03-08 10:12:12,943][367737] Updated weights for policy 0, policy_version 169840 (0.0005) [2023-03-08 10:12:14,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11940.9). Total num frames: 86970368. Throughput: 0: 11663.6. Samples: 86941132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:12:14,272][367454] Avg episode reward: [(0, '4522.265')] [2023-03-08 10:12:16,301][367737] Updated weights for policy 0, policy_version 169920 (0.0004) [2023-03-08 10:12:19,272][367454] Fps is (10 sec: 12287.9, 60 sec: 11673.6, 300 sec: 11954.8). Total num frames: 87035904. Throughput: 0: 11670.6. Samples: 87012160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:12:19,272][367454] Avg episode reward: [(0, '4430.381')] [2023-03-08 10:12:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000169992_87035904.pth... [2023-03-08 10:12:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000169296_86679552.pth [2023-03-08 10:12:19,526][367737] Updated weights for policy 0, policy_version 170000 (0.0005) [2023-03-08 10:12:22,775][367737] Updated weights for policy 0, policy_version 170080 (0.0005) [2023-03-08 10:12:24,271][367454] Fps is (10 sec: 12697.6, 60 sec: 11741.9, 300 sec: 11954.8). Total num frames: 87097344. Throughput: 0: 11815.3. Samples: 87089140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:12:24,272][367454] Avg episode reward: [(0, '4524.811')] [2023-03-08 10:12:25,996][367737] Updated weights for policy 0, policy_version 170160 (0.0004) [2023-03-08 10:12:29,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11940.9). Total num frames: 87158784. Throughput: 0: 11884.3. Samples: 87126808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:12:29,272][367454] Avg episode reward: [(0, '4452.437')] [2023-03-08 10:12:29,411][367737] Updated weights for policy 0, policy_version 170240 (0.0005) [2023-03-08 10:12:32,943][367737] Updated weights for policy 0, policy_version 170320 (0.0004) [2023-03-08 10:12:34,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11927.0). Total num frames: 87216128. Throughput: 0: 11903.8. Samples: 87197524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:12:34,272][367454] Avg episode reward: [(0, '4532.526')] [2023-03-08 10:12:34,320][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000170352_87220224.pth... [2023-03-08 10:12:34,322][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000169640_86855680.pth [2023-03-08 10:12:36,434][367737] Updated weights for policy 0, policy_version 170400 (0.0005) [2023-03-08 10:12:39,271][367454] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 11927.0). Total num frames: 87277568. Throughput: 0: 11942.1. Samples: 87266456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:12:39,272][367454] Avg episode reward: [(0, '4478.976')] [2023-03-08 10:12:39,914][367737] Updated weights for policy 0, policy_version 170480 (0.0005) [2023-03-08 10:12:43,281][367737] Updated weights for policy 0, policy_version 170560 (0.0003) [2023-03-08 10:12:44,271][367454] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11927.0). Total num frames: 87339008. Throughput: 0: 11971.6. Samples: 87303836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:12:44,272][367454] Avg episode reward: [(0, '4490.307')] [2023-03-08 10:12:46,680][367737] Updated weights for policy 0, policy_version 170640 (0.0004) [2023-03-08 10:12:49,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11913.1). Total num frames: 87396352. Throughput: 0: 12016.3. Samples: 87375944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:12:49,272][367454] Avg episode reward: [(0, '4340.763')] [2023-03-08 10:12:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000170696_87396352.pth... [2023-03-08 10:12:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000169992_87035904.pth [2023-03-08 10:12:50,171][367737] Updated weights for policy 0, policy_version 170720 (0.0005) [2023-03-08 10:12:53,692][367737] Updated weights for policy 0, policy_version 170800 (0.0005) [2023-03-08 10:12:54,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11946.7, 300 sec: 11899.2). Total num frames: 87453696. Throughput: 0: 12008.6. Samples: 87446036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:12:54,272][367454] Avg episode reward: [(0, '4393.677')] [2023-03-08 10:12:57,435][367737] Updated weights for policy 0, policy_version 170880 (0.0005) [2023-03-08 10:12:59,271][367454] Fps is (10 sec: 11469.0, 60 sec: 11878.4, 300 sec: 11885.3). Total num frames: 87511040. Throughput: 0: 11959.1. Samples: 87479292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:12:59,272][367454] Avg episode reward: [(0, '4396.101')] [2023-03-08 10:13:01,068][367737] Updated weights for policy 0, policy_version 170960 (0.0005) [2023-03-08 10:13:04,271][367454] Fps is (10 sec: 11059.2, 60 sec: 11810.1, 300 sec: 11843.7). Total num frames: 87564288. Throughput: 0: 11893.1. Samples: 87547348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:13:04,272][367454] Avg episode reward: [(0, '4400.252')] [2023-03-08 10:13:04,296][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000171032_87568384.pth... [2023-03-08 10:13:04,297][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000170352_87220224.pth [2023-03-08 10:13:04,656][367737] Updated weights for policy 0, policy_version 171040 (0.0005) [2023-03-08 10:13:08,286][367737] Updated weights for policy 0, policy_version 171120 (0.0005) [2023-03-08 10:13:09,271][367454] Fps is (10 sec: 11059.1, 60 sec: 11810.1, 300 sec: 11829.8). Total num frames: 87621632. Throughput: 0: 11677.5. Samples: 87614628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:13:09,272][367454] Avg episode reward: [(0, '4493.949')] [2023-03-08 10:13:11,849][367737] Updated weights for policy 0, policy_version 171200 (0.0004) [2023-03-08 10:13:14,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11802.0). Total num frames: 87678976. Throughput: 0: 11612.5. Samples: 87649372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:13:14,272][367454] Avg episode reward: [(0, '4413.259')] [2023-03-08 10:13:15,502][367737] Updated weights for policy 0, policy_version 171280 (0.0005) [2023-03-08 10:13:19,051][367737] Updated weights for policy 0, policy_version 171360 (0.0005) [2023-03-08 10:13:19,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 11788.1). Total num frames: 87736320. Throughput: 0: 11560.6. Samples: 87717752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:13:19,272][367454] Avg episode reward: [(0, '4548.921')] [2023-03-08 10:13:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000171360_87736320.pth... [2023-03-08 10:13:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000170696_87396352.pth [2023-03-08 10:13:22,543][367737] Updated weights for policy 0, policy_version 171440 (0.0005) [2023-03-08 10:13:24,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11788.2). Total num frames: 87793664. Throughput: 0: 11580.2. Samples: 87787564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:13:24,272][367454] Avg episode reward: [(0, '4541.232')] [2023-03-08 10:13:26,061][367737] Updated weights for policy 0, policy_version 171520 (0.0004) [2023-03-08 10:13:29,271][367454] Fps is (10 sec: 11469.0, 60 sec: 11537.1, 300 sec: 11788.2). Total num frames: 87851008. Throughput: 0: 11522.2. Samples: 87822336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:13:29,272][367454] Avg episode reward: [(0, '4567.217')] [2023-03-08 10:13:29,678][367737] Updated weights for policy 0, policy_version 171600 (0.0005) [2023-03-08 10:13:33,232][367737] Updated weights for policy 0, policy_version 171680 (0.0005) [2023-03-08 10:13:34,271][367454] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11788.1). Total num frames: 87912448. Throughput: 0: 11449.3. Samples: 87891164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:13:34,272][367454] Avg episode reward: [(0, '4525.757')] [2023-03-08 10:13:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000171704_87912448.pth... [2023-03-08 10:13:34,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000171032_87568384.pth [2023-03-08 10:13:36,764][367737] Updated weights for policy 0, policy_version 171760 (0.0005) [2023-03-08 10:13:39,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11774.3). Total num frames: 87965696. Throughput: 0: 11411.7. Samples: 87959564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:13:39,272][367454] Avg episode reward: [(0, '4455.309')] [2023-03-08 10:13:40,380][367737] Updated weights for policy 0, policy_version 171840 (0.0005) [2023-03-08 10:13:43,820][367737] Updated weights for policy 0, policy_version 171920 (0.0005) [2023-03-08 10:13:44,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11774.3). Total num frames: 88027136. Throughput: 0: 11447.5. Samples: 87994432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:13:44,272][367454] Avg episode reward: [(0, '4614.587')] [2023-03-08 10:13:47,439][367737] Updated weights for policy 0, policy_version 172000 (0.0005) [2023-03-08 10:13:49,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11468.8, 300 sec: 11774.3). Total num frames: 88084480. Throughput: 0: 11481.2. Samples: 88064000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:13:49,272][367454] Avg episode reward: [(0, '4452.858')] [2023-03-08 10:13:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000172040_88084480.pth... [2023-03-08 10:13:49,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000171360_87736320.pth [2023-03-08 10:13:51,038][367737] Updated weights for policy 0, policy_version 172080 (0.0004) [2023-03-08 10:13:54,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11760.4). Total num frames: 88141824. Throughput: 0: 11499.6. Samples: 88132108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:13:54,272][367454] Avg episode reward: [(0, '4544.161')] [2023-03-08 10:13:54,577][367737] Updated weights for policy 0, policy_version 172160 (0.0005) [2023-03-08 10:13:57,826][367737] Updated weights for policy 0, policy_version 172240 (0.0004) [2023-03-08 10:13:59,271][367454] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 11746.5). Total num frames: 88203264. Throughput: 0: 11540.9. Samples: 88168712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:13:59,272][367454] Avg episode reward: [(0, '4550.308')] [2023-03-08 10:14:01,094][367737] Updated weights for policy 0, policy_version 172320 (0.0004) [2023-03-08 10:14:04,272][367454] Fps is (10 sec: 12287.9, 60 sec: 11673.6, 300 sec: 11746.5). Total num frames: 88264704. Throughput: 0: 11691.6. Samples: 88243872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:14:04,272][367454] Avg episode reward: [(0, '4543.728')] [2023-03-08 10:14:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000172392_88264704.pth... [2023-03-08 10:14:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000171704_87912448.pth [2023-03-08 10:14:04,448][367737] Updated weights for policy 0, policy_version 172400 (0.0005) [2023-03-08 10:14:07,780][367737] Updated weights for policy 0, policy_version 172480 (0.0005) [2023-03-08 10:14:09,271][367454] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11746.5). Total num frames: 88326144. Throughput: 0: 11784.9. Samples: 88317884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:14:09,272][367454] Avg episode reward: [(0, '4553.001')] [2023-03-08 10:14:11,184][367737] Updated weights for policy 0, policy_version 172560 (0.0005) [2023-03-08 10:14:14,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11732.6). Total num frames: 88383488. Throughput: 0: 11800.5. Samples: 88353360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:14:14,272][367454] Avg episode reward: [(0, '4512.178')] [2023-03-08 10:14:14,734][367737] Updated weights for policy 0, policy_version 172640 (0.0005) [2023-03-08 10:14:18,023][367737] Updated weights for policy 0, policy_version 172720 (0.0004) [2023-03-08 10:14:19,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11746.5). Total num frames: 88444928. Throughput: 0: 11852.2. Samples: 88424512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:14:19,272][367454] Avg episode reward: [(0, '4479.340')] [2023-03-08 10:14:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000172744_88444928.pth... [2023-03-08 10:14:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000172040_88084480.pth [2023-03-08 10:14:21,442][367737] Updated weights for policy 0, policy_version 172800 (0.0005) [2023-03-08 10:14:24,271][367454] Fps is (10 sec: 12288.1, 60 sec: 11878.4, 300 sec: 11760.4). Total num frames: 88506368. Throughput: 0: 11970.6. Samples: 88498240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:14:24,272][367454] Avg episode reward: [(0, '4427.135')] [2023-03-08 10:14:24,657][367737] Updated weights for policy 0, policy_version 172880 (0.0004) [2023-03-08 10:14:27,980][367737] Updated weights for policy 0, policy_version 172960 (0.0004) [2023-03-08 10:14:29,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11774.3). Total num frames: 88567808. Throughput: 0: 12025.1. Samples: 88535564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:14:29,272][367454] Avg episode reward: [(0, '4510.578')] [2023-03-08 10:14:31,422][367737] Updated weights for policy 0, policy_version 173040 (0.0005) [2023-03-08 10:14:34,271][367454] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11774.3). Total num frames: 88625152. Throughput: 0: 12087.1. Samples: 88607920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:14:34,272][367454] Avg episode reward: [(0, '4414.200')] [2023-03-08 10:14:34,315][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000173104_88629248.pth... [2023-03-08 10:14:34,316][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000172392_88264704.pth [2023-03-08 10:14:35,058][367737] Updated weights for policy 0, policy_version 173120 (0.0005) [2023-03-08 10:14:38,442][367737] Updated weights for policy 0, policy_version 173200 (0.0005) [2023-03-08 10:14:39,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11788.1). Total num frames: 88686592. Throughput: 0: 12138.3. Samples: 88678332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:14:39,272][367454] Avg episode reward: [(0, '4298.786')] [2023-03-08 10:14:41,849][367737] Updated weights for policy 0, policy_version 173280 (0.0005) [2023-03-08 10:14:44,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12014.9, 300 sec: 11802.0). Total num frames: 88748032. Throughput: 0: 12131.7. Samples: 88714640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:14:44,272][367454] Avg episode reward: [(0, '4386.509')] [2023-03-08 10:14:45,271][367737] Updated weights for policy 0, policy_version 173360 (0.0005) [2023-03-08 10:14:48,898][367737] Updated weights for policy 0, policy_version 173440 (0.0005) [2023-03-08 10:14:49,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11788.1). Total num frames: 88801280. Throughput: 0: 12022.8. Samples: 88784896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:14:49,272][367454] Avg episode reward: [(0, '4420.246')] [2023-03-08 10:14:49,278][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000173448_88805376.pth... [2023-03-08 10:14:49,279][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000172744_88444928.pth [2023-03-08 10:14:52,537][367737] Updated weights for policy 0, policy_version 173520 (0.0006) [2023-03-08 10:14:54,271][367454] Fps is (10 sec: 11059.3, 60 sec: 11946.7, 300 sec: 11788.2). Total num frames: 88858624. Throughput: 0: 11880.1. Samples: 88852488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:14:54,272][367454] Avg episode reward: [(0, '4416.837')] [2023-03-08 10:14:56,143][367737] Updated weights for policy 0, policy_version 173600 (0.0005) [2023-03-08 10:14:59,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11788.2). Total num frames: 88915968. Throughput: 0: 11846.9. Samples: 88886468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:14:59,272][367454] Avg episode reward: [(0, '4398.155')] [2023-03-08 10:14:59,845][367737] Updated weights for policy 0, policy_version 173680 (0.0005) [2023-03-08 10:15:03,464][367737] Updated weights for policy 0, policy_version 173760 (0.0005) [2023-03-08 10:15:04,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 11788.1). Total num frames: 88973312. Throughput: 0: 11740.7. Samples: 88952844. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:15:04,272][367454] Avg episode reward: [(0, '4470.123')] [2023-03-08 10:15:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000173776_88973312.pth... [2023-03-08 10:15:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000173104_88629248.pth [2023-03-08 10:15:06,942][367737] Updated weights for policy 0, policy_version 173840 (0.0005) [2023-03-08 10:15:09,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11774.3). Total num frames: 89030656. Throughput: 0: 11650.8. Samples: 89022528. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:15:09,272][367454] Avg episode reward: [(0, '4338.593')] [2023-03-08 10:15:10,583][367737] Updated weights for policy 0, policy_version 173920 (0.0005) [2023-03-08 10:15:14,242][367737] Updated weights for policy 0, policy_version 174000 (0.0005) [2023-03-08 10:15:14,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 11760.4). Total num frames: 89088000. Throughput: 0: 11567.9. Samples: 89056120. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:15:14,272][367454] Avg episode reward: [(0, '4475.862')] [2023-03-08 10:15:17,780][367737] Updated weights for policy 0, policy_version 174080 (0.0005) [2023-03-08 10:15:19,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 11746.5). Total num frames: 89145344. Throughput: 0: 11486.2. Samples: 89124800. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:15:19,272][367454] Avg episode reward: [(0, '4537.983')] [2023-03-08 10:15:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000174112_89145344.pth... [2023-03-08 10:15:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000173448_88805376.pth [2023-03-08 10:15:21,215][367737] Updated weights for policy 0, policy_version 174160 (0.0005) [2023-03-08 10:15:24,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11746.5). Total num frames: 89206784. Throughput: 0: 11519.0. Samples: 89196688. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:15:24,272][367454] Avg episode reward: [(0, '4551.770')] [2023-03-08 10:15:24,528][367737] Updated weights for policy 0, policy_version 174240 (0.0003) [2023-03-08 10:15:27,988][367737] Updated weights for policy 0, policy_version 174320 (0.0003) [2023-03-08 10:15:29,272][367454] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 89264128. Throughput: 0: 11521.7. Samples: 89233116. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:15:29,272][367454] Avg episode reward: [(0, '4385.608')] [2023-03-08 10:15:31,417][367737] Updated weights for policy 0, policy_version 174400 (0.0003) [2023-03-08 10:15:34,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11746.5). Total num frames: 89325568. Throughput: 0: 11559.8. Samples: 89305088. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:15:34,272][367454] Avg episode reward: [(0, '4491.334')] [2023-03-08 10:15:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000174464_89325568.pth... [2023-03-08 10:15:34,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000173776_88973312.pth [2023-03-08 10:15:34,938][367737] Updated weights for policy 0, policy_version 174480 (0.0005) [2023-03-08 10:15:38,535][367737] Updated weights for policy 0, policy_version 174560 (0.0006) [2023-03-08 10:15:39,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11732.6). Total num frames: 89382912. Throughput: 0: 11579.0. Samples: 89373544. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:15:39,272][367454] Avg episode reward: [(0, '4527.426')] [2023-03-08 10:15:42,140][367737] Updated weights for policy 0, policy_version 174640 (0.0005) [2023-03-08 10:15:44,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 89440256. Throughput: 0: 11578.2. Samples: 89407488. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:15:44,272][367454] Avg episode reward: [(0, '4467.107')] [2023-03-08 10:15:45,675][367737] Updated weights for policy 0, policy_version 174720 (0.0004) [2023-03-08 10:15:49,262][367737] Updated weights for policy 0, policy_version 174800 (0.0004) [2023-03-08 10:15:49,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11732.6). Total num frames: 89497600. Throughput: 0: 11627.2. Samples: 89476068. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:15:49,272][367454] Avg episode reward: [(0, '4278.653')] [2023-03-08 10:15:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000174800_89497600.pth... [2023-03-08 10:15:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000174112_89145344.pth [2023-03-08 10:15:52,634][367737] Updated weights for policy 0, policy_version 174880 (0.0003) [2023-03-08 10:15:54,271][367454] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11718.7). Total num frames: 89554944. Throughput: 0: 11662.2. Samples: 89547328. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:15:54,272][367454] Avg episode reward: [(0, '4480.129')] [2023-03-08 10:15:55,988][367737] Updated weights for policy 0, policy_version 174960 (0.0003) [2023-03-08 10:15:59,272][367454] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 11732.6). Total num frames: 89616384. Throughput: 0: 11743.3. Samples: 89584568. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:15:59,272][367454] Avg episode reward: [(0, '4487.688')] [2023-03-08 10:15:59,523][367737] Updated weights for policy 0, policy_version 175040 (0.0005) [2023-03-08 10:16:03,068][367737] Updated weights for policy 0, policy_version 175120 (0.0005) [2023-03-08 10:16:04,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11718.7). Total num frames: 89673728. Throughput: 0: 11744.9. Samples: 89653320. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:16:04,283][367454] Avg episode reward: [(0, '4372.619')] [2023-03-08 10:16:04,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000175144_89673728.pth... [2023-03-08 10:16:04,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000174464_89325568.pth [2023-03-08 10:16:06,428][367737] Updated weights for policy 0, policy_version 175200 (0.0003) [2023-03-08 10:16:09,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11732.6). Total num frames: 89735168. Throughput: 0: 11793.4. Samples: 89727392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:16:09,283][367454] Avg episode reward: [(0, '4461.253')] [2023-03-08 10:16:09,751][367737] Updated weights for policy 0, policy_version 175280 (0.0003) [2023-03-08 10:16:13,080][367737] Updated weights for policy 0, policy_version 175360 (0.0003) [2023-03-08 10:16:14,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 11732.6). Total num frames: 89796608. Throughput: 0: 11794.1. Samples: 89763848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:16:14,272][367454] Avg episode reward: [(0, '4411.507')] [2023-03-08 10:16:16,408][367737] Updated weights for policy 0, policy_version 175440 (0.0003) [2023-03-08 10:16:19,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11746.5). Total num frames: 89858048. Throughput: 0: 11834.3. Samples: 89837632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:16:19,272][367454] Avg episode reward: [(0, '4438.090')] [2023-03-08 10:16:19,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000175504_89858048.pth... [2023-03-08 10:16:19,276][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000174800_89497600.pth [2023-03-08 10:16:19,682][367737] Updated weights for policy 0, policy_version 175520 (0.0003) [2023-03-08 10:16:22,948][367737] Updated weights for policy 0, policy_version 175600 (0.0003) [2023-03-08 10:16:24,272][367454] Fps is (10 sec: 12697.6, 60 sec: 11946.7, 300 sec: 11788.1). Total num frames: 89923584. Throughput: 0: 11987.4. Samples: 89912976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:16:24,272][367454] Avg episode reward: [(0, '4513.315')] [2023-03-08 10:16:26,095][367737] Updated weights for policy 0, policy_version 175680 (0.0003) [2023-03-08 10:16:29,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11788.2). Total num frames: 89985024. Throughput: 0: 12105.4. Samples: 89952232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:16:29,272][367454] Avg episode reward: [(0, '4443.770')] [2023-03-08 10:16:29,396][367737] Updated weights for policy 0, policy_version 175760 (0.0003) [2023-03-08 10:16:32,786][367737] Updated weights for policy 0, policy_version 175840 (0.0003) [2023-03-08 10:16:34,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11802.0). Total num frames: 90046464. Throughput: 0: 12220.5. Samples: 90025992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:16:34,272][367454] Avg episode reward: [(0, '4462.988')] [2023-03-08 10:16:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000175872_90046464.pth... [2023-03-08 10:16:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000175144_89673728.pth [2023-03-08 10:16:36,233][367737] Updated weights for policy 0, policy_version 175920 (0.0004) [2023-03-08 10:16:39,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11802.0). Total num frames: 90103808. Throughput: 0: 12184.2. Samples: 90095616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:16:39,272][367454] Avg episode reward: [(0, '4331.462')] [2023-03-08 10:16:39,851][367737] Updated weights for policy 0, policy_version 176000 (0.0005) [2023-03-08 10:16:43,415][367737] Updated weights for policy 0, policy_version 176080 (0.0005) [2023-03-08 10:16:44,271][367454] Fps is (10 sec: 11468.9, 60 sec: 12014.9, 300 sec: 11802.0). Total num frames: 90161152. Throughput: 0: 12105.8. Samples: 90129328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:16:44,272][367454] Avg episode reward: [(0, '4398.773')] [2023-03-08 10:16:46,843][367737] Updated weights for policy 0, policy_version 176160 (0.0004) [2023-03-08 10:16:49,271][367454] Fps is (10 sec: 11468.9, 60 sec: 12015.0, 300 sec: 11802.0). Total num frames: 90218496. Throughput: 0: 12157.4. Samples: 90200400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:16:49,272][367454] Avg episode reward: [(0, '4404.280')] [2023-03-08 10:16:49,335][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000176216_90222592.pth... [2023-03-08 10:16:49,337][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000175504_89858048.pth [2023-03-08 10:16:50,391][367737] Updated weights for policy 0, policy_version 176240 (0.0004) [2023-03-08 10:16:53,864][367737] Updated weights for policy 0, policy_version 176320 (0.0004) [2023-03-08 10:16:54,271][367454] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11802.0). Total num frames: 90279936. Throughput: 0: 12066.1. Samples: 90270364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:16:54,272][367454] Avg episode reward: [(0, '4446.171')] [2023-03-08 10:16:57,236][367737] Updated weights for policy 0, policy_version 176400 (0.0004) [2023-03-08 10:16:59,271][367454] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11802.0). Total num frames: 90337280. Throughput: 0: 12079.2. Samples: 90307412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:16:59,282][367454] Avg episode reward: [(0, '4480.883')] [2023-03-08 10:17:00,844][367737] Updated weights for policy 0, policy_version 176480 (0.0005) [2023-03-08 10:17:04,189][367737] Updated weights for policy 0, policy_version 176560 (0.0004) [2023-03-08 10:17:04,272][367454] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 11815.9). Total num frames: 90398720. Throughput: 0: 11989.3. Samples: 90377152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:17:04,272][367454] Avg episode reward: [(0, '4496.306')] [2023-03-08 10:17:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000176560_90398720.pth... [2023-03-08 10:17:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000175872_90046464.pth [2023-03-08 10:17:07,688][367737] Updated weights for policy 0, policy_version 176640 (0.0005) [2023-03-08 10:17:09,272][367454] Fps is (10 sec: 11878.3, 60 sec: 12014.9, 300 sec: 11815.9). Total num frames: 90456064. Throughput: 0: 11886.8. Samples: 90447880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:17:09,272][367454] Avg episode reward: [(0, '4510.300')] [2023-03-08 10:17:11,291][367737] Updated weights for policy 0, policy_version 176720 (0.0005) [2023-03-08 10:17:14,272][367454] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11788.2). Total num frames: 90513408. Throughput: 0: 11767.0. Samples: 90481748. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:17:14,272][367454] Avg episode reward: [(0, '4523.283')] [2023-03-08 10:17:14,927][367737] Updated weights for policy 0, policy_version 176800 (0.0005) [2023-03-08 10:17:18,467][367737] Updated weights for policy 0, policy_version 176880 (0.0005) [2023-03-08 10:17:19,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11878.4, 300 sec: 11774.3). Total num frames: 90570752. Throughput: 0: 11652.1. Samples: 90550336. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:17:19,272][367454] Avg episode reward: [(0, '4421.379')] [2023-03-08 10:17:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000176896_90570752.pth... [2023-03-08 10:17:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000176216_90222592.pth [2023-03-08 10:17:22,068][367737] Updated weights for policy 0, policy_version 176960 (0.0005) [2023-03-08 10:17:24,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11760.4). Total num frames: 90628096. Throughput: 0: 11644.6. Samples: 90619624. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:17:24,272][367454] Avg episode reward: [(0, '4342.976')] [2023-03-08 10:17:25,553][367737] Updated weights for policy 0, policy_version 177040 (0.0005) [2023-03-08 10:17:29,125][367737] Updated weights for policy 0, policy_version 177120 (0.0005) [2023-03-08 10:17:29,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 11760.4). Total num frames: 90685440. Throughput: 0: 11673.9. Samples: 90654652. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:17:29,272][367454] Avg episode reward: [(0, '4460.516')] [2023-03-08 10:17:32,770][367737] Updated weights for policy 0, policy_version 177200 (0.0005) [2023-03-08 10:17:34,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 90742784. Throughput: 0: 11598.0. Samples: 90722312. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:17:34,272][367454] Avg episode reward: [(0, '4526.374')] [2023-03-08 10:17:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000177232_90742784.pth... [2023-03-08 10:17:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000176560_90398720.pth [2023-03-08 10:17:36,412][367737] Updated weights for policy 0, policy_version 177280 (0.0005) [2023-03-08 10:17:39,272][367454] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11718.7). Total num frames: 90796032. Throughput: 0: 11524.7. Samples: 90788976. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:17:39,272][367454] Avg episode reward: [(0, '4337.398')] [2023-03-08 10:17:40,115][367737] Updated weights for policy 0, policy_version 177360 (0.0005) [2023-03-08 10:17:43,679][367737] Updated weights for policy 0, policy_version 177440 (0.0005) [2023-03-08 10:17:44,272][367454] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11718.7). Total num frames: 90853376. Throughput: 0: 11451.8. Samples: 90822744. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:17:44,272][367454] Avg episode reward: [(0, '4365.823')] [2023-03-08 10:17:47,250][367737] Updated weights for policy 0, policy_version 177520 (0.0005) [2023-03-08 10:17:49,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11718.7). Total num frames: 90910720. Throughput: 0: 11436.2. Samples: 90891780. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:17:49,272][367454] Avg episode reward: [(0, '4480.283')] [2023-03-08 10:17:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000177560_90910720.pth... [2023-03-08 10:17:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000176896_90570752.pth [2023-03-08 10:17:50,826][367737] Updated weights for policy 0, policy_version 177600 (0.0005) [2023-03-08 10:17:54,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11718.7). Total num frames: 90968064. Throughput: 0: 11386.0. Samples: 90960248. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:17:54,283][367454] Avg episode reward: [(0, '4523.059')] [2023-03-08 10:17:54,460][367737] Updated weights for policy 0, policy_version 177680 (0.0005) [2023-03-08 10:17:58,015][367737] Updated weights for policy 0, policy_version 177760 (0.0005) [2023-03-08 10:17:59,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11732.6). Total num frames: 91025408. Throughput: 0: 11383.9. Samples: 90994024. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:17:59,282][367454] Avg episode reward: [(0, '4502.714')] [2023-03-08 10:18:01,297][367737] Updated weights for policy 0, policy_version 177840 (0.0004) [2023-03-08 10:18:04,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11537.1, 300 sec: 11760.4). Total num frames: 91090944. Throughput: 0: 11501.8. Samples: 91067920. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:18:04,283][367454] Avg episode reward: [(0, '4442.210')] [2023-03-08 10:18:04,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000177912_91090944.pth... [2023-03-08 10:18:04,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000177232_90742784.pth [2023-03-08 10:18:04,591][367737] Updated weights for policy 0, policy_version 177920 (0.0004) [2023-03-08 10:18:08,015][367737] Updated weights for policy 0, policy_version 178000 (0.0005) [2023-03-08 10:18:09,272][367454] Fps is (10 sec: 12287.9, 60 sec: 11537.1, 300 sec: 11760.4). Total num frames: 91148288. Throughput: 0: 11567.6. Samples: 91140168. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:18:09,272][367454] Avg episode reward: [(0, '4541.724')] [2023-03-08 10:18:11,665][367737] Updated weights for policy 0, policy_version 178080 (0.0005) [2023-03-08 10:18:14,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11760.4). Total num frames: 91205632. Throughput: 0: 11536.8. Samples: 91173808. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:18:14,272][367454] Avg episode reward: [(0, '4262.831')] [2023-03-08 10:18:15,228][367737] Updated weights for policy 0, policy_version 178160 (0.0005) [2023-03-08 10:18:18,750][367737] Updated weights for policy 0, policy_version 178240 (0.0005) [2023-03-08 10:18:19,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11537.0, 300 sec: 11760.4). Total num frames: 91262976. Throughput: 0: 11564.2. Samples: 91242700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:18:19,272][367454] Avg episode reward: [(0, '4279.225')] [2023-03-08 10:18:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000178248_91262976.pth... [2023-03-08 10:18:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000177560_90910720.pth [2023-03-08 10:18:22,402][367737] Updated weights for policy 0, policy_version 178320 (0.0005) [2023-03-08 10:18:24,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11760.4). Total num frames: 91320320. Throughput: 0: 11614.9. Samples: 91311644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:18:24,272][367454] Avg episode reward: [(0, '4435.895')] [2023-03-08 10:18:26,022][367737] Updated weights for policy 0, policy_version 178400 (0.0004) [2023-03-08 10:18:29,272][367454] Fps is (10 sec: 11059.3, 60 sec: 11468.8, 300 sec: 11732.6). Total num frames: 91373568. Throughput: 0: 11605.0. Samples: 91344968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:18:29,272][367454] Avg episode reward: [(0, '4498.260')] [2023-03-08 10:18:29,699][367737] Updated weights for policy 0, policy_version 178480 (0.0005) [2023-03-08 10:18:33,342][367737] Updated weights for policy 0, policy_version 178560 (0.0004) [2023-03-08 10:18:34,272][367454] Fps is (10 sec: 11059.1, 60 sec: 11468.8, 300 sec: 11746.5). Total num frames: 91430912. Throughput: 0: 11553.1. Samples: 91411668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:18:34,272][367454] Avg episode reward: [(0, '4260.367')] [2023-03-08 10:18:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000178576_91430912.pth... [2023-03-08 10:18:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000177912_91090944.pth [2023-03-08 10:18:36,863][367737] Updated weights for policy 0, policy_version 178640 (0.0005) [2023-03-08 10:18:39,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 91488256. Throughput: 0: 11588.0. Samples: 91481708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:18:39,272][367454] Avg episode reward: [(0, '4326.770')] [2023-03-08 10:18:40,432][367737] Updated weights for policy 0, policy_version 178720 (0.0005) [2023-03-08 10:18:43,907][367737] Updated weights for policy 0, policy_version 178800 (0.0005) [2023-03-08 10:18:44,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 91549696. Throughput: 0: 11603.2. Samples: 91516168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:18:44,272][367454] Avg episode reward: [(0, '4321.115')] [2023-03-08 10:18:47,534][367737] Updated weights for policy 0, policy_version 178880 (0.0005) [2023-03-08 10:18:49,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 91607040. Throughput: 0: 11496.1. Samples: 91585244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:18:49,272][367454] Avg episode reward: [(0, '4491.511')] [2023-03-08 10:18:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000178920_91607040.pth... [2023-03-08 10:18:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000178248_91262976.pth [2023-03-08 10:18:50,917][367737] Updated weights for policy 0, policy_version 178960 (0.0005) [2023-03-08 10:18:54,215][367737] Updated weights for policy 0, policy_version 179040 (0.0005) [2023-03-08 10:18:54,271][367454] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 11746.5). Total num frames: 91668480. Throughput: 0: 11534.9. Samples: 91659240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:18:54,272][367454] Avg episode reward: [(0, '4404.657')] [2023-03-08 10:18:57,598][367737] Updated weights for policy 0, policy_version 179120 (0.0004) [2023-03-08 10:18:59,271][367454] Fps is (10 sec: 11878.6, 60 sec: 11673.6, 300 sec: 11732.6). Total num frames: 91725824. Throughput: 0: 11583.4. Samples: 91695060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:18:59,272][367454] Avg episode reward: [(0, '4283.744')] [2023-03-08 10:19:00,987][367737] Updated weights for policy 0, policy_version 179200 (0.0005) [2023-03-08 10:19:04,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 11732.6). Total num frames: 91787264. Throughput: 0: 11648.2. Samples: 91766868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:19:04,272][367454] Avg episode reward: [(0, '4360.506')] [2023-03-08 10:19:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000179272_91787264.pth... [2023-03-08 10:19:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000178576_91430912.pth [2023-03-08 10:19:04,368][367737] Updated weights for policy 0, policy_version 179280 (0.0004) [2023-03-08 10:19:07,735][367737] Updated weights for policy 0, policy_version 179360 (0.0004) [2023-03-08 10:19:09,272][367454] Fps is (10 sec: 12287.9, 60 sec: 11673.6, 300 sec: 11746.5). Total num frames: 91848704. Throughput: 0: 11751.1. Samples: 91840444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:19:09,272][367454] Avg episode reward: [(0, '4324.826')] [2023-03-08 10:19:11,135][367737] Updated weights for policy 0, policy_version 179440 (0.0004) [2023-03-08 10:19:14,271][367454] Fps is (10 sec: 12288.1, 60 sec: 11741.9, 300 sec: 11746.5). Total num frames: 91910144. Throughput: 0: 11818.3. Samples: 91876792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:19:14,272][367454] Avg episode reward: [(0, '4447.172')] [2023-03-08 10:19:14,588][367737] Updated weights for policy 0, policy_version 179520 (0.0004) [2023-03-08 10:19:17,958][367737] Updated weights for policy 0, policy_version 179600 (0.0004) [2023-03-08 10:19:19,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11741.9, 300 sec: 11732.6). Total num frames: 91967488. Throughput: 0: 11918.6. Samples: 91948004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:19:19,272][367454] Avg episode reward: [(0, '4348.486')] [2023-03-08 10:19:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000179624_91967488.pth... [2023-03-08 10:19:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000178920_91607040.pth [2023-03-08 10:19:21,315][367737] Updated weights for policy 0, policy_version 179680 (0.0004) [2023-03-08 10:19:24,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11732.6). Total num frames: 92028928. Throughput: 0: 11979.8. Samples: 92020800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:19:24,272][367454] Avg episode reward: [(0, '4411.507')] [2023-03-08 10:19:24,757][367737] Updated weights for policy 0, policy_version 179760 (0.0005) [2023-03-08 10:19:28,049][367737] Updated weights for policy 0, policy_version 179840 (0.0004) [2023-03-08 10:19:29,271][367454] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11746.5). Total num frames: 92090368. Throughput: 0: 12030.0. Samples: 92057516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:19:29,272][367454] Avg episode reward: [(0, '4345.243')] [2023-03-08 10:19:31,292][367737] Updated weights for policy 0, policy_version 179920 (0.0004) [2023-03-08 10:19:34,272][367454] Fps is (10 sec: 12697.7, 60 sec: 12083.2, 300 sec: 11760.4). Total num frames: 92155904. Throughput: 0: 12162.5. Samples: 92132556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:19:34,272][367454] Avg episode reward: [(0, '4490.452')] [2023-03-08 10:19:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000179992_92155904.pth... [2023-03-08 10:19:34,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000179272_91787264.pth [2023-03-08 10:19:34,576][367737] Updated weights for policy 0, policy_version 180000 (0.0005) [2023-03-08 10:19:37,953][367737] Updated weights for policy 0, policy_version 180080 (0.0005) [2023-03-08 10:19:39,271][367454] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 11760.4). Total num frames: 92217344. Throughput: 0: 12158.3. Samples: 92206364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:19:39,282][367454] Avg episode reward: [(0, '4452.917')] [2023-03-08 10:19:41,166][367737] Updated weights for policy 0, policy_version 180160 (0.0004) [2023-03-08 10:19:44,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11788.1). Total num frames: 92278784. Throughput: 0: 12218.3. Samples: 92244884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:19:44,283][367454] Avg episode reward: [(0, '4567.286')] [2023-03-08 10:19:44,576][367737] Updated weights for policy 0, policy_version 180240 (0.0005) [2023-03-08 10:19:47,955][367737] Updated weights for policy 0, policy_version 180320 (0.0005) [2023-03-08 10:19:49,271][367454] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11788.1). Total num frames: 92336128. Throughput: 0: 12222.3. Samples: 92316868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:19:49,282][367454] Avg episode reward: [(0, '4381.822')] [2023-03-08 10:19:49,285][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000180352_92340224.pth... [2023-03-08 10:19:49,287][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000179624_91967488.pth [2023-03-08 10:19:51,231][367737] Updated weights for policy 0, policy_version 180400 (0.0004) [2023-03-08 10:19:54,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 11815.9). Total num frames: 92401664. Throughput: 0: 12230.4. Samples: 92390812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:19:54,272][367454] Avg episode reward: [(0, '4430.196')] [2023-03-08 10:19:54,622][367737] Updated weights for policy 0, policy_version 180480 (0.0004) [2023-03-08 10:19:58,059][367737] Updated weights for policy 0, policy_version 180560 (0.0004) [2023-03-08 10:19:59,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12219.7, 300 sec: 11815.9). Total num frames: 92459008. Throughput: 0: 12209.9. Samples: 92426240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:19:59,283][367454] Avg episode reward: [(0, '4429.470')] [2023-03-08 10:20:01,442][367737] Updated weights for policy 0, policy_version 180640 (0.0004) [2023-03-08 10:20:04,272][367454] Fps is (10 sec: 11878.3, 60 sec: 12219.7, 300 sec: 11829.8). Total num frames: 92520448. Throughput: 0: 12253.9. Samples: 92499428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:20:04,272][367454] Avg episode reward: [(0, '4409.818')] [2023-03-08 10:20:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000180704_92520448.pth... [2023-03-08 10:20:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000179992_92155904.pth [2023-03-08 10:20:04,808][367737] Updated weights for policy 0, policy_version 180720 (0.0004) [2023-03-08 10:20:08,082][367737] Updated weights for policy 0, policy_version 180800 (0.0004) [2023-03-08 10:20:09,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 11843.7). Total num frames: 92581888. Throughput: 0: 12286.6. Samples: 92573696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:20:09,272][367454] Avg episode reward: [(0, '4134.753')] [2023-03-08 10:20:11,415][367737] Updated weights for policy 0, policy_version 180880 (0.0003) [2023-03-08 10:20:14,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 11857.6). Total num frames: 92643328. Throughput: 0: 12290.0. Samples: 92610568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:20:14,272][367454] Avg episode reward: [(0, '4409.080')] [2023-03-08 10:20:14,802][367737] Updated weights for policy 0, policy_version 180960 (0.0004) [2023-03-08 10:20:18,139][367737] Updated weights for policy 0, policy_version 181040 (0.0005) [2023-03-08 10:20:19,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 11857.6). Total num frames: 92704768. Throughput: 0: 12249.2. Samples: 92683772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:20:19,272][367454] Avg episode reward: [(0, '4227.207')] [2023-03-08 10:20:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000181064_92704768.pth... [2023-03-08 10:20:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000180352_92340224.pth [2023-03-08 10:20:21,648][367737] Updated weights for policy 0, policy_version 181120 (0.0004) [2023-03-08 10:20:24,271][367454] Fps is (10 sec: 11468.9, 60 sec: 12151.5, 300 sec: 11843.7). Total num frames: 92758016. Throughput: 0: 12147.2. Samples: 92752988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:20:24,272][367454] Avg episode reward: [(0, '4367.691')] [2023-03-08 10:20:25,368][367737] Updated weights for policy 0, policy_version 181200 (0.0005) [2023-03-08 10:20:28,909][367737] Updated weights for policy 0, policy_version 181280 (0.0005) [2023-03-08 10:20:29,272][367454] Fps is (10 sec: 11468.8, 60 sec: 12151.4, 300 sec: 11843.7). Total num frames: 92819456. Throughput: 0: 12041.5. Samples: 92786752. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:20:29,272][367454] Avg episode reward: [(0, '4344.557')] [2023-03-08 10:20:32,467][367737] Updated weights for policy 0, policy_version 181360 (0.0004) [2023-03-08 10:20:34,272][367454] Fps is (10 sec: 11878.3, 60 sec: 12014.9, 300 sec: 11843.7). Total num frames: 92876800. Throughput: 0: 11977.4. Samples: 92855852. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:20:34,283][367454] Avg episode reward: [(0, '4517.350')] [2023-03-08 10:20:34,287][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000181400_92876800.pth... [2023-03-08 10:20:34,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000180704_92520448.pth [2023-03-08 10:20:36,044][367737] Updated weights for policy 0, policy_version 181440 (0.0005) [2023-03-08 10:20:39,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11843.7). Total num frames: 92934144. Throughput: 0: 11875.3. Samples: 92925200. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:20:39,283][367454] Avg episode reward: [(0, '4519.500')] [2023-03-08 10:20:39,568][367737] Updated weights for policy 0, policy_version 181520 (0.0005) [2023-03-08 10:20:43,176][367737] Updated weights for policy 0, policy_version 181600 (0.0005) [2023-03-08 10:20:44,271][367454] Fps is (10 sec: 11059.3, 60 sec: 11810.1, 300 sec: 11829.8). Total num frames: 92987392. Throughput: 0: 11834.7. Samples: 92958800. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:20:44,283][367454] Avg episode reward: [(0, '4512.293')] [2023-03-08 10:20:46,834][367737] Updated weights for policy 0, policy_version 181680 (0.0005) [2023-03-08 10:20:49,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11843.7). Total num frames: 93048832. Throughput: 0: 11735.2. Samples: 93027512. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:20:49,272][367454] Avg episode reward: [(0, '4460.115')] [2023-03-08 10:20:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000181736_93048832.pth... [2023-03-08 10:20:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000181064_92704768.pth [2023-03-08 10:20:50,059][367737] Updated weights for policy 0, policy_version 181760 (0.0003) [2023-03-08 10:20:53,374][367737] Updated weights for policy 0, policy_version 181840 (0.0004) [2023-03-08 10:20:54,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 11843.7). Total num frames: 93110272. Throughput: 0: 11743.3. Samples: 93102144. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:20:54,272][367454] Avg episode reward: [(0, '4470.496')] [2023-03-08 10:20:56,652][367737] Updated weights for policy 0, policy_version 181920 (0.0004) [2023-03-08 10:20:59,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11857.6). Total num frames: 93171712. Throughput: 0: 11759.2. Samples: 93139732. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:20:59,272][367454] Avg episode reward: [(0, '4471.952')] [2023-03-08 10:20:59,991][367737] Updated weights for policy 0, policy_version 182000 (0.0005) [2023-03-08 10:21:03,326][367737] Updated weights for policy 0, policy_version 182080 (0.0004) [2023-03-08 10:21:04,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11857.6). Total num frames: 93233152. Throughput: 0: 11769.1. Samples: 93213380. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:21:04,272][367454] Avg episode reward: [(0, '4484.041')] [2023-03-08 10:21:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000182096_93233152.pth... [2023-03-08 10:21:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000181400_92876800.pth [2023-03-08 10:21:06,626][367737] Updated weights for policy 0, policy_version 182160 (0.0004) [2023-03-08 10:21:09,271][367454] Fps is (10 sec: 12697.7, 60 sec: 11946.7, 300 sec: 11871.5). Total num frames: 93298688. Throughput: 0: 11874.6. Samples: 93287344. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:21:09,272][367454] Avg episode reward: [(0, '4425.815')] [2023-03-08 10:21:09,892][367737] Updated weights for policy 0, policy_version 182240 (0.0004) [2023-03-08 10:21:13,184][367737] Updated weights for policy 0, policy_version 182320 (0.0004) [2023-03-08 10:21:14,271][367454] Fps is (10 sec: 12697.7, 60 sec: 11946.7, 300 sec: 11871.5). Total num frames: 93360128. Throughput: 0: 11979.1. Samples: 93325812. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:21:14,272][367454] Avg episode reward: [(0, '4319.016')] [2023-03-08 10:21:16,450][367737] Updated weights for policy 0, policy_version 182400 (0.0004) [2023-03-08 10:21:19,272][367454] Fps is (10 sec: 12287.8, 60 sec: 11946.7, 300 sec: 11857.6). Total num frames: 93421568. Throughput: 0: 12105.5. Samples: 93400600. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:21:19,272][367454] Avg episode reward: [(0, '4349.169')] [2023-03-08 10:21:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000182464_93421568.pth... [2023-03-08 10:21:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000181736_93048832.pth [2023-03-08 10:21:19,781][367737] Updated weights for policy 0, policy_version 182480 (0.0004) [2023-03-08 10:21:23,043][367737] Updated weights for policy 0, policy_version 182560 (0.0004) [2023-03-08 10:21:24,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11857.6). Total num frames: 93483008. Throughput: 0: 12215.1. Samples: 93474880. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:21:24,272][367454] Avg episode reward: [(0, '4516.663')] [2023-03-08 10:21:26,665][367737] Updated weights for policy 0, policy_version 182640 (0.0005) [2023-03-08 10:21:29,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11843.7). Total num frames: 93540352. Throughput: 0: 12219.8. Samples: 93508692. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:21:29,272][367454] Avg episode reward: [(0, '4564.203')] [2023-03-08 10:21:30,202][367737] Updated weights for policy 0, policy_version 182720 (0.0005) [2023-03-08 10:21:33,811][367737] Updated weights for policy 0, policy_version 182800 (0.0005) [2023-03-08 10:21:34,272][367454] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11843.7). Total num frames: 93597696. Throughput: 0: 12217.1. Samples: 93577280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:21:34,283][367454] Avg episode reward: [(0, '4378.227')] [2023-03-08 10:21:34,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000182808_93597696.pth... [2023-03-08 10:21:34,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000182096_93233152.pth [2023-03-08 10:21:37,407][367737] Updated weights for policy 0, policy_version 182880 (0.0005) [2023-03-08 10:21:39,271][367454] Fps is (10 sec: 11468.9, 60 sec: 12014.9, 300 sec: 11843.7). Total num frames: 93655040. Throughput: 0: 12079.8. Samples: 93645736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:21:39,282][367454] Avg episode reward: [(0, '4438.682')] [2023-03-08 10:21:41,067][367737] Updated weights for policy 0, policy_version 182960 (0.0005) [2023-03-08 10:21:44,271][367454] Fps is (10 sec: 11059.4, 60 sec: 12014.9, 300 sec: 11829.8). Total num frames: 93708288. Throughput: 0: 11997.4. Samples: 93679616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:21:44,282][367454] Avg episode reward: [(0, '4443.372')] [2023-03-08 10:21:44,649][367737] Updated weights for policy 0, policy_version 183040 (0.0005) [2023-03-08 10:21:48,133][367737] Updated weights for policy 0, policy_version 183120 (0.0005) [2023-03-08 10:21:49,272][367454] Fps is (10 sec: 11468.7, 60 sec: 12014.9, 300 sec: 11829.8). Total num frames: 93769728. Throughput: 0: 11880.0. Samples: 93747980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:21:49,282][367454] Avg episode reward: [(0, '4496.436')] [2023-03-08 10:21:49,285][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000183144_93769728.pth... [2023-03-08 10:21:49,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000182464_93421568.pth [2023-03-08 10:21:51,655][367737] Updated weights for policy 0, policy_version 183200 (0.0004) [2023-03-08 10:21:54,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11829.8). Total num frames: 93827072. Throughput: 0: 11813.5. Samples: 93818952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:21:54,272][367454] Avg episode reward: [(0, '4356.220')] [2023-03-08 10:21:55,107][367737] Updated weights for policy 0, policy_version 183280 (0.0004) [2023-03-08 10:21:58,799][367737] Updated weights for policy 0, policy_version 183360 (0.0005) [2023-03-08 10:21:59,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11815.9). Total num frames: 93884416. Throughput: 0: 11749.5. Samples: 93854540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:21:59,272][367454] Avg episode reward: [(0, '4383.055')] [2023-03-08 10:22:02,208][367737] Updated weights for policy 0, policy_version 183440 (0.0005) [2023-03-08 10:22:04,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11829.8). Total num frames: 93945856. Throughput: 0: 11619.4. Samples: 93923472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:22:04,272][367454] Avg episode reward: [(0, '4206.998')] [2023-03-08 10:22:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000183488_93945856.pth... [2023-03-08 10:22:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000182808_93597696.pth [2023-03-08 10:22:05,611][367737] Updated weights for policy 0, policy_version 183520 (0.0004) [2023-03-08 10:22:08,964][367737] Updated weights for policy 0, policy_version 183600 (0.0004) [2023-03-08 10:22:09,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11741.8, 300 sec: 11829.8). Total num frames: 94003200. Throughput: 0: 11577.1. Samples: 93995848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:22:09,272][367454] Avg episode reward: [(0, '4282.847')] [2023-03-08 10:22:12,358][367737] Updated weights for policy 0, policy_version 183680 (0.0005) [2023-03-08 10:22:14,271][367454] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11843.7). Total num frames: 94064640. Throughput: 0: 11627.8. Samples: 94031944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:22:14,272][367454] Avg episode reward: [(0, '4414.728')] [2023-03-08 10:22:15,694][367737] Updated weights for policy 0, policy_version 183760 (0.0004) [2023-03-08 10:22:19,129][367737] Updated weights for policy 0, policy_version 183840 (0.0005) [2023-03-08 10:22:19,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11857.6). Total num frames: 94126080. Throughput: 0: 11740.4. Samples: 94105600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:22:19,272][367454] Avg episode reward: [(0, '4417.091')] [2023-03-08 10:22:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000183840_94126080.pth... [2023-03-08 10:22:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000183144_93769728.pth [2023-03-08 10:22:22,604][367737] Updated weights for policy 0, policy_version 183920 (0.0005) [2023-03-08 10:22:24,271][367454] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11871.5). Total num frames: 94187520. Throughput: 0: 11801.5. Samples: 94176804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:22:24,272][367454] Avg episode reward: [(0, '4318.155')] [2023-03-08 10:22:25,920][367737] Updated weights for policy 0, policy_version 184000 (0.0004) [2023-03-08 10:22:29,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11871.5). Total num frames: 94244864. Throughput: 0: 11858.7. Samples: 94213260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:22:29,283][367454] Avg episode reward: [(0, '4155.834')] [2023-03-08 10:22:29,594][367737] Updated weights for policy 0, policy_version 184080 (0.0005) [2023-03-08 10:22:33,269][367737] Updated weights for policy 0, policy_version 184160 (0.0005) [2023-03-08 10:22:34,272][367454] Fps is (10 sec: 11059.1, 60 sec: 11673.6, 300 sec: 11871.5). Total num frames: 94298112. Throughput: 0: 11825.9. Samples: 94280144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:22:34,282][367454] Avg episode reward: [(0, '4226.645')] [2023-03-08 10:22:34,286][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000184176_94298112.pth... [2023-03-08 10:22:34,289][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000183488_93945856.pth [2023-03-08 10:22:36,790][367737] Updated weights for policy 0, policy_version 184240 (0.0005) [2023-03-08 10:22:39,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11885.3). Total num frames: 94359552. Throughput: 0: 11830.7. Samples: 94351332. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:22:39,272][367454] Avg episode reward: [(0, '4259.213')] [2023-03-08 10:22:40,179][367737] Updated weights for policy 0, policy_version 184320 (0.0004) [2023-03-08 10:22:43,661][367737] Updated weights for policy 0, policy_version 184400 (0.0004) [2023-03-08 10:22:44,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11885.3). Total num frames: 94416896. Throughput: 0: 11805.9. Samples: 94385804. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:22:44,272][367454] Avg episode reward: [(0, '4110.507')] [2023-03-08 10:22:46,976][367737] Updated weights for policy 0, policy_version 184480 (0.0004) [2023-03-08 10:22:49,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11899.2). Total num frames: 94478336. Throughput: 0: 11893.4. Samples: 94458676. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:22:49,272][367454] Avg episode reward: [(0, '4247.472')] [2023-03-08 10:22:49,302][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000184536_94482432.pth... [2023-03-08 10:22:49,303][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000183840_94126080.pth [2023-03-08 10:22:50,260][367737] Updated weights for policy 0, policy_version 184560 (0.0004) [2023-03-08 10:22:53,609][367737] Updated weights for policy 0, policy_version 184640 (0.0004) [2023-03-08 10:22:54,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11913.1). Total num frames: 94539776. Throughput: 0: 11931.7. Samples: 94532776. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:22:54,272][367454] Avg episode reward: [(0, '4404.513')] [2023-03-08 10:22:56,910][367737] Updated weights for policy 0, policy_version 184720 (0.0004) [2023-03-08 10:22:59,272][367454] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11913.1). Total num frames: 94605312. Throughput: 0: 11963.8. Samples: 94570316. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:22:59,272][367454] Avg episode reward: [(0, '4471.703')] [2023-03-08 10:23:00,234][367737] Updated weights for policy 0, policy_version 184800 (0.0004) [2023-03-08 10:23:03,862][367737] Updated weights for policy 0, policy_version 184880 (0.0004) [2023-03-08 10:23:04,272][367454] Fps is (10 sec: 12287.9, 60 sec: 11946.6, 300 sec: 11913.1). Total num frames: 94662656. Throughput: 0: 11926.9. Samples: 94642312. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:23:04,272][367454] Avg episode reward: [(0, '4260.690')] [2023-03-08 10:23:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000184888_94662656.pth... [2023-03-08 10:23:04,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000184176_94298112.pth [2023-03-08 10:23:07,594][367737] Updated weights for policy 0, policy_version 184960 (0.0005) [2023-03-08 10:23:09,271][367454] Fps is (10 sec: 11059.3, 60 sec: 11878.4, 300 sec: 11899.2). Total num frames: 94715904. Throughput: 0: 11817.7. Samples: 94708600. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:23:09,272][367454] Avg episode reward: [(0, '4233.138')] [2023-03-08 10:23:11,136][367737] Updated weights for policy 0, policy_version 185040 (0.0005) [2023-03-08 10:23:14,272][367454] Fps is (10 sec: 11059.3, 60 sec: 11810.1, 300 sec: 11899.2). Total num frames: 94773248. Throughput: 0: 11793.8. Samples: 94743980. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:23:14,272][367454] Avg episode reward: [(0, '4577.150')] [2023-03-08 10:23:14,735][367737] Updated weights for policy 0, policy_version 185120 (0.0005) [2023-03-08 10:23:18,107][367737] Updated weights for policy 0, policy_version 185200 (0.0004) [2023-03-08 10:23:19,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11913.1). Total num frames: 94834688. Throughput: 0: 11852.1. Samples: 94813488. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:23:19,272][367454] Avg episode reward: [(0, '4392.273')] [2023-03-08 10:23:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000185224_94834688.pth... [2023-03-08 10:23:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000184536_94482432.pth [2023-03-08 10:23:21,266][367737] Updated weights for policy 0, policy_version 185280 (0.0004) [2023-03-08 10:23:24,272][367454] Fps is (10 sec: 12697.6, 60 sec: 11878.4, 300 sec: 11954.8). Total num frames: 94900224. Throughput: 0: 11974.5. Samples: 94890184. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:23:24,272][367454] Avg episode reward: [(0, '4566.803')] [2023-03-08 10:23:24,575][367737] Updated weights for policy 0, policy_version 185360 (0.0004) [2023-03-08 10:23:27,895][367737] Updated weights for policy 0, policy_version 185440 (0.0004) [2023-03-08 10:23:29,272][367454] Fps is (10 sec: 12697.7, 60 sec: 11946.7, 300 sec: 11968.7). Total num frames: 94961664. Throughput: 0: 12018.8. Samples: 94926648. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:23:29,272][367454] Avg episode reward: [(0, '4361.644')] [2023-03-08 10:23:31,231][367737] Updated weights for policy 0, policy_version 185520 (0.0004) [2023-03-08 10:23:34,272][367454] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11982.5). Total num frames: 95023104. Throughput: 0: 12047.5. Samples: 95000812. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:23:34,272][367454] Avg episode reward: [(0, '4489.821')] [2023-03-08 10:23:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000185592_95023104.pth... [2023-03-08 10:23:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000184888_94662656.pth [2023-03-08 10:23:34,415][367737] Updated weights for policy 0, policy_version 185600 (0.0003) [2023-03-08 10:23:37,675][367737] Updated weights for policy 0, policy_version 185680 (0.0004) [2023-03-08 10:23:39,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11982.5). Total num frames: 95084544. Throughput: 0: 12092.4. Samples: 95076932. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:23:39,272][367454] Avg episode reward: [(0, '4521.269')] [2023-03-08 10:23:40,976][367737] Updated weights for policy 0, policy_version 185760 (0.0004) [2023-03-08 10:23:44,271][367454] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 11996.4). Total num frames: 95145984. Throughput: 0: 12086.9. Samples: 95114228. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:23:44,272][367454] Avg episode reward: [(0, '4488.695')] [2023-03-08 10:23:44,285][367737] Updated weights for policy 0, policy_version 185840 (0.0004) [2023-03-08 10:23:47,543][367737] Updated weights for policy 0, policy_version 185920 (0.0004) [2023-03-08 10:23:49,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12219.7, 300 sec: 12010.3). Total num frames: 95211520. Throughput: 0: 12146.5. Samples: 95188904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:23:49,272][367454] Avg episode reward: [(0, '4305.882')] [2023-03-08 10:23:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000185960_95211520.pth... [2023-03-08 10:23:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000185224_94834688.pth [2023-03-08 10:23:50,820][367737] Updated weights for policy 0, policy_version 186000 (0.0005) [2023-03-08 10:23:54,113][367737] Updated weights for policy 0, policy_version 186080 (0.0004) [2023-03-08 10:23:54,272][367454] Fps is (10 sec: 12697.5, 60 sec: 12219.7, 300 sec: 12024.2). Total num frames: 95272960. Throughput: 0: 12354.9. Samples: 95264572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:23:54,272][367454] Avg episode reward: [(0, '4522.101')] [2023-03-08 10:23:57,415][367737] Updated weights for policy 0, policy_version 186160 (0.0004) [2023-03-08 10:23:59,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 12024.2). Total num frames: 95334400. Throughput: 0: 12392.0. Samples: 95301620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:23:59,272][367454] Avg episode reward: [(0, '4445.966')] [2023-03-08 10:24:00,737][367737] Updated weights for policy 0, policy_version 186240 (0.0004) [2023-03-08 10:24:04,130][367737] Updated weights for policy 0, policy_version 186320 (0.0004) [2023-03-08 10:24:04,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12219.8, 300 sec: 12024.2). Total num frames: 95395840. Throughput: 0: 12483.9. Samples: 95375264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:24:04,272][367454] Avg episode reward: [(0, '4454.086')] [2023-03-08 10:24:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000186320_95395840.pth... [2023-03-08 10:24:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000185592_95023104.pth [2023-03-08 10:24:07,426][367737] Updated weights for policy 0, policy_version 186400 (0.0004) [2023-03-08 10:24:09,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12024.2). Total num frames: 95457280. Throughput: 0: 12421.5. Samples: 95449152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:24:09,272][367454] Avg episode reward: [(0, '4540.460')] [2023-03-08 10:24:10,723][367737] Updated weights for policy 0, policy_version 186480 (0.0004) [2023-03-08 10:24:14,058][367737] Updated weights for policy 0, policy_version 186560 (0.0004) [2023-03-08 10:24:14,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12038.1). Total num frames: 95518720. Throughput: 0: 12429.0. Samples: 95485952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:24:14,282][367454] Avg episode reward: [(0, '4536.579')] [2023-03-08 10:24:17,479][367737] Updated weights for policy 0, policy_version 186640 (0.0005) [2023-03-08 10:24:19,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12038.1). Total num frames: 95580160. Throughput: 0: 12399.7. Samples: 95558796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:24:19,272][367454] Avg episode reward: [(0, '4597.323')] [2023-03-08 10:24:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000186680_95580160.pth... [2023-03-08 10:24:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000185960_95211520.pth [2023-03-08 10:24:20,711][367737] Updated weights for policy 0, policy_version 186720 (0.0004) [2023-03-08 10:24:24,058][367737] Updated weights for policy 0, policy_version 186800 (0.0004) [2023-03-08 10:24:24,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12038.1). Total num frames: 95641600. Throughput: 0: 12367.5. Samples: 95633472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:24:24,282][367454] Avg episode reward: [(0, '4495.234')] [2023-03-08 10:24:27,474][367737] Updated weights for policy 0, policy_version 186880 (0.0004) [2023-03-08 10:24:29,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12024.2). Total num frames: 95703040. Throughput: 0: 12353.1. Samples: 95670116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:24:29,282][367454] Avg episode reward: [(0, '4483.664')] [2023-03-08 10:24:30,755][367737] Updated weights for policy 0, policy_version 186960 (0.0004) [2023-03-08 10:24:34,154][367737] Updated weights for policy 0, policy_version 187040 (0.0005) [2023-03-08 10:24:34,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12024.2). Total num frames: 95764480. Throughput: 0: 12324.3. Samples: 95743496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:24:34,283][367454] Avg episode reward: [(0, '4466.867')] [2023-03-08 10:24:34,285][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000187040_95764480.pth... [2023-03-08 10:24:34,288][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000186320_95395840.pth [2023-03-08 10:24:37,727][367737] Updated weights for policy 0, policy_version 187120 (0.0005) [2023-03-08 10:24:39,272][367454] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 12010.3). Total num frames: 95821824. Throughput: 0: 12200.6. Samples: 95813600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:24:39,272][367454] Avg episode reward: [(0, '4446.618')] [2023-03-08 10:24:41,298][367737] Updated weights for policy 0, policy_version 187200 (0.0005) [2023-03-08 10:24:44,271][367454] Fps is (10 sec: 11878.5, 60 sec: 12288.0, 300 sec: 12024.2). Total num frames: 95883264. Throughput: 0: 12129.2. Samples: 95847432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:24:44,272][367454] Avg episode reward: [(0, '4570.807')] [2023-03-08 10:24:44,558][367737] Updated weights for policy 0, policy_version 187280 (0.0004) [2023-03-08 10:24:47,802][367737] Updated weights for policy 0, policy_version 187360 (0.0004) [2023-03-08 10:24:49,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12010.3). Total num frames: 95944704. Throughput: 0: 12167.6. Samples: 95922804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:24:49,272][367454] Avg episode reward: [(0, '4583.934')] [2023-03-08 10:24:49,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000187392_95944704.pth... [2023-03-08 10:24:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000186680_95580160.pth [2023-03-08 10:24:51,080][367737] Updated weights for policy 0, policy_version 187440 (0.0005) [2023-03-08 10:24:54,271][367454] Fps is (10 sec: 12288.0, 60 sec: 12219.8, 300 sec: 12024.2). Total num frames: 96006144. Throughput: 0: 12195.1. Samples: 95997932. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:24:54,272][367454] Avg episode reward: [(0, '4372.900')] [2023-03-08 10:24:54,459][367737] Updated weights for policy 0, policy_version 187520 (0.0005) [2023-03-08 10:24:58,031][367737] Updated weights for policy 0, policy_version 187600 (0.0005) [2023-03-08 10:24:59,271][367454] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12010.3). Total num frames: 96063488. Throughput: 0: 12121.3. Samples: 96031408. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:24:59,272][367454] Avg episode reward: [(0, '4566.514')] [2023-03-08 10:25:01,571][367737] Updated weights for policy 0, policy_version 187680 (0.0005) [2023-03-08 10:25:04,271][367454] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 11996.4). Total num frames: 96120832. Throughput: 0: 12065.0. Samples: 96101720. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:25:04,272][367454] Avg episode reward: [(0, '4575.192')] [2023-03-08 10:25:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000187736_96120832.pth... [2023-03-08 10:25:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000187040_95764480.pth [2023-03-08 10:25:05,170][367737] Updated weights for policy 0, policy_version 187760 (0.0005) [2023-03-08 10:25:08,628][367737] Updated weights for policy 0, policy_version 187840 (0.0005) [2023-03-08 10:25:09,271][367454] Fps is (10 sec: 11468.9, 60 sec: 12014.9, 300 sec: 11982.5). Total num frames: 96178176. Throughput: 0: 11949.1. Samples: 96171180. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:25:09,272][367454] Avg episode reward: [(0, '4470.914')] [2023-03-08 10:25:11,960][367737] Updated weights for policy 0, policy_version 187920 (0.0004) [2023-03-08 10:25:14,271][367454] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11982.5). Total num frames: 96239616. Throughput: 0: 11952.3. Samples: 96207968. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:25:14,272][367454] Avg episode reward: [(0, '4336.752')] [2023-03-08 10:25:15,386][367737] Updated weights for policy 0, policy_version 188000 (0.0005) [2023-03-08 10:25:18,745][367737] Updated weights for policy 0, policy_version 188080 (0.0005) [2023-03-08 10:25:19,272][367454] Fps is (10 sec: 12287.8, 60 sec: 12014.9, 300 sec: 12010.3). Total num frames: 96301056. Throughput: 0: 11932.4. Samples: 96280456. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:25:19,272][367454] Avg episode reward: [(0, '4458.323')] [2023-03-08 10:25:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000188088_96301056.pth... [2023-03-08 10:25:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000187392_95944704.pth [2023-03-08 10:25:22,118][367737] Updated weights for policy 0, policy_version 188160 (0.0005) [2023-03-08 10:25:24,272][367454] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 12010.3). Total num frames: 96362496. Throughput: 0: 11999.2. Samples: 96353564. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:25:24,272][367454] Avg episode reward: [(0, '4445.244')] [2023-03-08 10:25:25,492][367737] Updated weights for policy 0, policy_version 188240 (0.0005) [2023-03-08 10:25:29,110][367737] Updated weights for policy 0, policy_version 188320 (0.0005) [2023-03-08 10:25:29,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12010.3). Total num frames: 96419840. Throughput: 0: 12056.4. Samples: 96389972. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:25:29,272][367454] Avg episode reward: [(0, '4386.813')] [2023-03-08 10:25:32,754][367737] Updated weights for policy 0, policy_version 188400 (0.0005) [2023-03-08 10:25:34,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 12010.3). Total num frames: 96477184. Throughput: 0: 11865.9. Samples: 96456768. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:25:34,272][367454] Avg episode reward: [(0, '4301.985')] [2023-03-08 10:25:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000188432_96477184.pth... [2023-03-08 10:25:34,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000187736_96120832.pth [2023-03-08 10:25:36,328][367737] Updated weights for policy 0, policy_version 188480 (0.0005) [2023-03-08 10:25:39,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11878.4, 300 sec: 12024.2). Total num frames: 96534528. Throughput: 0: 11740.4. Samples: 96526252. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:25:39,272][367454] Avg episode reward: [(0, '4271.690')] [2023-03-08 10:25:39,802][367737] Updated weights for policy 0, policy_version 188560 (0.0005) [2023-03-08 10:25:43,056][367737] Updated weights for policy 0, policy_version 188640 (0.0004) [2023-03-08 10:25:44,271][367454] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 12024.2). Total num frames: 96595968. Throughput: 0: 11815.7. Samples: 96563116. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:25:44,272][367454] Avg episode reward: [(0, '4232.039')] [2023-03-08 10:25:46,465][367737] Updated weights for policy 0, policy_version 188720 (0.0005) [2023-03-08 10:25:49,272][367454] Fps is (10 sec: 12287.9, 60 sec: 11878.4, 300 sec: 12024.2). Total num frames: 96657408. Throughput: 0: 11865.4. Samples: 96635664. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:25:49,272][367454] Avg episode reward: [(0, '4297.272')] [2023-03-08 10:25:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000188784_96657408.pth... [2023-03-08 10:25:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000188088_96301056.pth [2023-03-08 10:25:49,901][367737] Updated weights for policy 0, policy_version 188800 (0.0004) [2023-03-08 10:25:53,299][367737] Updated weights for policy 0, policy_version 188880 (0.0004) [2023-03-08 10:25:54,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 12010.3). Total num frames: 96714752. Throughput: 0: 11915.6. Samples: 96707384. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:25:54,272][367454] Avg episode reward: [(0, '4074.735')] [2023-03-08 10:25:56,761][367737] Updated weights for policy 0, policy_version 188960 (0.0005) [2023-03-08 10:25:59,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 12010.3). Total num frames: 96776192. Throughput: 0: 11899.0. Samples: 96743424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:25:59,272][367454] Avg episode reward: [(0, '4144.617')] [2023-03-08 10:26:00,043][367737] Updated weights for policy 0, policy_version 189040 (0.0005) [2023-03-08 10:26:03,754][367737] Updated weights for policy 0, policy_version 189120 (0.0005) [2023-03-08 10:26:04,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11982.5). Total num frames: 96833536. Throughput: 0: 11878.1. Samples: 96814972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:26:04,272][367454] Avg episode reward: [(0, '4188.588')] [2023-03-08 10:26:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000189128_96833536.pth... [2023-03-08 10:26:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000188432_96477184.pth [2023-03-08 10:26:07,311][367737] Updated weights for policy 0, policy_version 189200 (0.0004) [2023-03-08 10:26:09,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11968.6). Total num frames: 96890880. Throughput: 0: 11761.9. Samples: 96882848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:26:09,272][367454] Avg episode reward: [(0, '4095.968')] [2023-03-08 10:26:10,710][367737] Updated weights for policy 0, policy_version 189280 (0.0004) [2023-03-08 10:26:14,023][367737] Updated weights for policy 0, policy_version 189360 (0.0005) [2023-03-08 10:26:14,271][367454] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 11968.7). Total num frames: 96952320. Throughput: 0: 11770.1. Samples: 96919624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:26:14,272][367454] Avg episode reward: [(0, '4382.342')] [2023-03-08 10:26:17,522][367737] Updated weights for policy 0, policy_version 189440 (0.0005) [2023-03-08 10:26:19,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11954.8). Total num frames: 97009664. Throughput: 0: 11894.8. Samples: 96992036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:26:19,272][367454] Avg episode reward: [(0, '4364.885')] [2023-03-08 10:26:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000189472_97009664.pth... [2023-03-08 10:26:19,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000188784_96657408.pth [2023-03-08 10:26:21,162][367737] Updated weights for policy 0, policy_version 189520 (0.0004) [2023-03-08 10:26:24,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11968.7). Total num frames: 97071104. Throughput: 0: 11896.4. Samples: 97061592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:26:24,272][367454] Avg episode reward: [(0, '4222.952')] [2023-03-08 10:26:24,551][367737] Updated weights for policy 0, policy_version 189600 (0.0004) [2023-03-08 10:26:28,160][367737] Updated weights for policy 0, policy_version 189680 (0.0005) [2023-03-08 10:26:29,272][367454] Fps is (10 sec: 11878.5, 60 sec: 11810.1, 300 sec: 11968.7). Total num frames: 97128448. Throughput: 0: 11838.7. Samples: 97095856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:26:29,272][367454] Avg episode reward: [(0, '4341.076')] [2023-03-08 10:26:31,835][367737] Updated weights for policy 0, policy_version 189760 (0.0005) [2023-03-08 10:26:34,271][367454] Fps is (10 sec: 11059.3, 60 sec: 11741.9, 300 sec: 11954.8). Total num frames: 97181696. Throughput: 0: 11732.5. Samples: 97163624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:26:34,272][367454] Avg episode reward: [(0, '4508.934')] [2023-03-08 10:26:34,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000189808_97181696.pth... [2023-03-08 10:26:34,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000189128_96833536.pth [2023-03-08 10:26:35,512][367737] Updated weights for policy 0, policy_version 189840 (0.0005) [2023-03-08 10:26:39,252][367737] Updated weights for policy 0, policy_version 189920 (0.0005) [2023-03-08 10:26:39,272][367454] Fps is (10 sec: 11059.1, 60 sec: 11741.8, 300 sec: 11968.6). Total num frames: 97239040. Throughput: 0: 11616.5. Samples: 97230128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:26:39,272][367454] Avg episode reward: [(0, '4383.995')] [2023-03-08 10:26:42,832][367737] Updated weights for policy 0, policy_version 190000 (0.0005) [2023-03-08 10:26:44,271][367454] Fps is (10 sec: 11059.2, 60 sec: 11605.3, 300 sec: 11940.9). Total num frames: 97292288. Throughput: 0: 11559.8. Samples: 97263616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:26:44,272][367454] Avg episode reward: [(0, '4434.696')] [2023-03-08 10:26:46,430][367737] Updated weights for policy 0, policy_version 190080 (0.0005) [2023-03-08 10:26:49,271][367454] Fps is (10 sec: 11059.4, 60 sec: 11537.1, 300 sec: 11940.9). Total num frames: 97349632. Throughput: 0: 11512.8. Samples: 97333048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:26:49,272][367454] Avg episode reward: [(0, '4434.381')] [2023-03-08 10:26:49,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000190144_97353728.pth... [2023-03-08 10:26:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000189472_97009664.pth [2023-03-08 10:26:50,009][367737] Updated weights for policy 0, policy_version 190160 (0.0005) [2023-03-08 10:26:53,515][367737] Updated weights for policy 0, policy_version 190240 (0.0005) [2023-03-08 10:26:54,272][367454] Fps is (10 sec: 11878.2, 60 sec: 11605.3, 300 sec: 11954.8). Total num frames: 97411072. Throughput: 0: 11527.3. Samples: 97401576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:26:54,272][367454] Avg episode reward: [(0, '4440.947')] [2023-03-08 10:26:57,144][367737] Updated weights for policy 0, policy_version 190320 (0.0005) [2023-03-08 10:26:59,272][367454] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11927.0). Total num frames: 97464320. Throughput: 0: 11468.6. Samples: 97435712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:26:59,272][367454] Avg episode reward: [(0, '4394.835')] [2023-03-08 10:27:00,682][367737] Updated weights for policy 0, policy_version 190400 (0.0005) [2023-03-08 10:27:04,038][367737] Updated weights for policy 0, policy_version 190480 (0.0004) [2023-03-08 10:27:04,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11940.9). Total num frames: 97525760. Throughput: 0: 11407.0. Samples: 97505352. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:27:04,272][367454] Avg episode reward: [(0, '4516.080')] [2023-03-08 10:27:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000190480_97525760.pth... [2023-03-08 10:27:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000189808_97181696.pth [2023-03-08 10:27:07,394][367737] Updated weights for policy 0, policy_version 190560 (0.0004) [2023-03-08 10:27:09,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11605.3, 300 sec: 11940.9). Total num frames: 97587200. Throughput: 0: 11498.5. Samples: 97579024. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:27:09,272][367454] Avg episode reward: [(0, '4323.918')] [2023-03-08 10:27:10,851][367737] Updated weights for policy 0, policy_version 190640 (0.0005) [2023-03-08 10:27:14,271][367454] Fps is (10 sec: 11878.5, 60 sec: 11537.1, 300 sec: 11927.0). Total num frames: 97644544. Throughput: 0: 11523.7. Samples: 97614420. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:27:14,272][367454] Avg episode reward: [(0, '4455.553')] [2023-03-08 10:27:14,485][367737] Updated weights for policy 0, policy_version 190720 (0.0005) [2023-03-08 10:27:18,102][367737] Updated weights for policy 0, policy_version 190800 (0.0005) [2023-03-08 10:27:19,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11913.1). Total num frames: 97701888. Throughput: 0: 11512.1. Samples: 97681668. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:27:19,272][367454] Avg episode reward: [(0, '4298.939')] [2023-03-08 10:27:19,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000190824_97701888.pth... [2023-03-08 10:27:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000190144_97353728.pth [2023-03-08 10:27:21,712][367737] Updated weights for policy 0, policy_version 190880 (0.0005) [2023-03-08 10:27:24,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11913.1). Total num frames: 97759232. Throughput: 0: 11552.1. Samples: 97749972. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:27:24,272][367454] Avg episode reward: [(0, '4488.509')] [2023-03-08 10:27:25,394][367737] Updated weights for policy 0, policy_version 190960 (0.0005) [2023-03-08 10:27:28,887][367737] Updated weights for policy 0, policy_version 191040 (0.0004) [2023-03-08 10:27:29,271][367454] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11927.0). Total num frames: 97816576. Throughput: 0: 11549.4. Samples: 97783340. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:27:29,272][367454] Avg episode reward: [(0, '4366.548')] [2023-03-08 10:27:32,452][367737] Updated weights for policy 0, policy_version 191120 (0.0005) [2023-03-08 10:27:34,272][367454] Fps is (10 sec: 11468.6, 60 sec: 11537.0, 300 sec: 11913.1). Total num frames: 97873920. Throughput: 0: 11560.2. Samples: 97853260. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:27:34,272][367454] Avg episode reward: [(0, '4459.136')] [2023-03-08 10:27:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000191160_97873920.pth... [2023-03-08 10:27:34,280][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000190480_97525760.pth [2023-03-08 10:27:36,063][367737] Updated weights for policy 0, policy_version 191200 (0.0005) [2023-03-08 10:27:39,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11913.1). Total num frames: 97931264. Throughput: 0: 11546.2. Samples: 97921152. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:27:39,272][367454] Avg episode reward: [(0, '4533.396')] [2023-03-08 10:27:39,595][367737] Updated weights for policy 0, policy_version 191280 (0.0005) [2023-03-08 10:27:43,195][367737] Updated weights for policy 0, policy_version 191360 (0.0005) [2023-03-08 10:27:44,272][367454] Fps is (10 sec: 11059.2, 60 sec: 11537.0, 300 sec: 11885.3). Total num frames: 97984512. Throughput: 0: 11561.4. Samples: 97955976. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:27:44,272][367454] Avg episode reward: [(0, '4544.659')] [2023-03-08 10:27:46,845][367737] Updated weights for policy 0, policy_version 191440 (0.0005) [2023-03-08 10:27:49,272][367454] Fps is (10 sec: 11059.1, 60 sec: 11537.0, 300 sec: 11871.5). Total num frames: 98041856. Throughput: 0: 11514.4. Samples: 98023500. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:27:49,272][367454] Avg episode reward: [(0, '4529.723')] [2023-03-08 10:27:49,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000191488_98041856.pth... [2023-03-08 10:27:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000190824_97701888.pth [2023-03-08 10:27:50,434][367737] Updated weights for policy 0, policy_version 191520 (0.0005) [2023-03-08 10:27:54,092][367737] Updated weights for policy 0, policy_version 191600 (0.0005) [2023-03-08 10:27:54,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11843.7). Total num frames: 98099200. Throughput: 0: 11383.9. Samples: 98091300. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:27:54,272][367454] Avg episode reward: [(0, '4631.474')] [2023-03-08 10:27:57,638][367737] Updated weights for policy 0, policy_version 191680 (0.0005) [2023-03-08 10:27:59,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11843.7). Total num frames: 98156544. Throughput: 0: 11374.6. Samples: 98126276. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:27:59,272][367454] Avg episode reward: [(0, '4529.735')] [2023-03-08 10:28:01,266][367737] Updated weights for policy 0, policy_version 191760 (0.0005) [2023-03-08 10:28:04,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11537.1, 300 sec: 11871.5). Total num frames: 98217984. Throughput: 0: 11392.1. Samples: 98194312. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:28:04,272][367454] Avg episode reward: [(0, '4503.469')] [2023-03-08 10:28:04,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000191832_98217984.pth... [2023-03-08 10:28:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000191160_97873920.pth [2023-03-08 10:28:04,584][367737] Updated weights for policy 0, policy_version 191840 (0.0004) [2023-03-08 10:28:07,854][367737] Updated weights for policy 0, policy_version 191920 (0.0004) [2023-03-08 10:28:09,272][367454] Fps is (10 sec: 12288.0, 60 sec: 11537.1, 300 sec: 11885.3). Total num frames: 98279424. Throughput: 0: 11557.1. Samples: 98270044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:28:09,272][367454] Avg episode reward: [(0, '4509.325')] [2023-03-08 10:28:11,134][367737] Updated weights for policy 0, policy_version 192000 (0.0005) [2023-03-08 10:28:14,272][367454] Fps is (10 sec: 12288.1, 60 sec: 11605.3, 300 sec: 11885.3). Total num frames: 98340864. Throughput: 0: 11647.2. Samples: 98307464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:28:14,272][367454] Avg episode reward: [(0, '4605.768')] [2023-03-08 10:28:14,580][367737] Updated weights for policy 0, policy_version 192080 (0.0005) [2023-03-08 10:28:18,114][367737] Updated weights for policy 0, policy_version 192160 (0.0005) [2023-03-08 10:28:19,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11857.6). Total num frames: 98398208. Throughput: 0: 11655.1. Samples: 98377740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:28:19,272][367454] Avg episode reward: [(0, '4506.913')] [2023-03-08 10:28:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000192184_98398208.pth... [2023-03-08 10:28:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000191488_98041856.pth [2023-03-08 10:28:21,806][367737] Updated weights for policy 0, policy_version 192240 (0.0005) [2023-03-08 10:28:24,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11843.7). Total num frames: 98455552. Throughput: 0: 11657.1. Samples: 98445724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:28:24,283][367454] Avg episode reward: [(0, '4546.136')] [2023-03-08 10:28:25,252][367737] Updated weights for policy 0, policy_version 192320 (0.0005) [2023-03-08 10:28:28,588][367737] Updated weights for policy 0, policy_version 192400 (0.0005) [2023-03-08 10:28:29,272][367454] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11829.8). Total num frames: 98512896. Throughput: 0: 11683.7. Samples: 98481744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:28:29,272][367454] Avg episode reward: [(0, '4508.469')] [2023-03-08 10:28:32,068][367737] Updated weights for policy 0, policy_version 192480 (0.0005) [2023-03-08 10:28:34,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11829.8). Total num frames: 98574336. Throughput: 0: 11785.7. Samples: 98553856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:28:34,272][367454] Avg episode reward: [(0, '4574.426')] [2023-03-08 10:28:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000192528_98574336.pth... [2023-03-08 10:28:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000191832_98217984.pth [2023-03-08 10:28:35,496][367737] Updated weights for policy 0, policy_version 192560 (0.0003) [2023-03-08 10:28:38,935][367737] Updated weights for policy 0, policy_version 192640 (0.0004) [2023-03-08 10:28:39,271][367454] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 11815.9). Total num frames: 98631680. Throughput: 0: 11857.1. Samples: 98624868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:28:39,272][367454] Avg episode reward: [(0, '4390.165')] [2023-03-08 10:28:42,395][367737] Updated weights for policy 0, policy_version 192720 (0.0003) [2023-03-08 10:28:44,271][367454] Fps is (10 sec: 11878.5, 60 sec: 11810.1, 300 sec: 11802.0). Total num frames: 98693120. Throughput: 0: 11869.8. Samples: 98660416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:28:44,272][367454] Avg episode reward: [(0, '4523.924')] [2023-03-08 10:28:45,824][367737] Updated weights for policy 0, policy_version 192800 (0.0003) [2023-03-08 10:28:49,271][367454] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11788.2). Total num frames: 98750464. Throughput: 0: 11925.6. Samples: 98730964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:28:49,272][367454] Avg episode reward: [(0, '4634.801')] [2023-03-08 10:28:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000192872_98750464.pth... [2023-03-08 10:28:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000192184_98398208.pth [2023-03-08 10:28:49,424][367737] Updated weights for policy 0, policy_version 192880 (0.0005) [2023-03-08 10:28:53,015][367737] Updated weights for policy 0, policy_version 192960 (0.0005) [2023-03-08 10:28:54,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11774.3). Total num frames: 98807808. Throughput: 0: 11769.7. Samples: 98799680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:28:54,272][367454] Avg episode reward: [(0, '4540.277')] [2023-03-08 10:28:56,707][367737] Updated weights for policy 0, policy_version 193040 (0.0006) [2023-03-08 10:28:59,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11760.4). Total num frames: 98865152. Throughput: 0: 11674.5. Samples: 98832816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:28:59,272][367454] Avg episode reward: [(0, '4618.772')] [2023-03-08 10:29:00,322][367737] Updated weights for policy 0, policy_version 193120 (0.0005) [2023-03-08 10:29:03,810][367737] Updated weights for policy 0, policy_version 193200 (0.0005) [2023-03-08 10:29:04,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11746.5). Total num frames: 98922496. Throughput: 0: 11650.8. Samples: 98902024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:29:04,272][367454] Avg episode reward: [(0, '4633.906')] [2023-03-08 10:29:04,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000193208_98922496.pth... [2023-03-08 10:29:04,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000192528_98574336.pth [2023-03-08 10:29:07,371][367737] Updated weights for policy 0, policy_version 193280 (0.0005) [2023-03-08 10:29:09,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11732.6). Total num frames: 98979840. Throughput: 0: 11687.2. Samples: 98971648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:29:09,272][367454] Avg episode reward: [(0, '4622.705')] [2023-03-08 10:29:10,875][367737] Updated weights for policy 0, policy_version 193360 (0.0005) [2023-03-08 10:29:14,210][367737] Updated weights for policy 0, policy_version 193440 (0.0004) [2023-03-08 10:29:14,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11732.6). Total num frames: 99041280. Throughput: 0: 11679.2. Samples: 99007308. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:29:14,272][367454] Avg episode reward: [(0, '4556.124')] [2023-03-08 10:29:17,824][367737] Updated weights for policy 0, policy_version 193520 (0.0005) [2023-03-08 10:29:19,272][367454] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11718.7). Total num frames: 99098624. Throughput: 0: 11644.8. Samples: 99077872. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:29:19,272][367454] Avg episode reward: [(0, '4612.450')] [2023-03-08 10:29:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000193552_99098624.pth... [2023-03-08 10:29:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000192872_98750464.pth [2023-03-08 10:29:21,354][367737] Updated weights for policy 0, policy_version 193600 (0.0004) [2023-03-08 10:29:24,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11704.8). Total num frames: 99155968. Throughput: 0: 11597.6. Samples: 99146760. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:29:24,272][367454] Avg episode reward: [(0, '4583.620')] [2023-03-08 10:29:24,986][367737] Updated weights for policy 0, policy_version 193680 (0.0005) [2023-03-08 10:29:28,568][367737] Updated weights for policy 0, policy_version 193760 (0.0005) [2023-03-08 10:29:29,272][367454] Fps is (10 sec: 11059.1, 60 sec: 11605.3, 300 sec: 11677.1). Total num frames: 99209216. Throughput: 0: 11559.8. Samples: 99180608. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:29:29,272][367454] Avg episode reward: [(0, '4584.882')] [2023-03-08 10:29:32,197][367737] Updated weights for policy 0, policy_version 193840 (0.0005) [2023-03-08 10:29:34,272][367454] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11677.1). Total num frames: 99266560. Throughput: 0: 11500.4. Samples: 99248484. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:29:34,272][367454] Avg episode reward: [(0, '4630.286')] [2023-03-08 10:29:34,276][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000193880_99266560.pth... [2023-03-08 10:29:34,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000193208_98922496.pth [2023-03-08 10:29:35,788][367737] Updated weights for policy 0, policy_version 193920 (0.0005) [2023-03-08 10:29:39,272][367454] Fps is (10 sec: 11468.9, 60 sec: 11537.0, 300 sec: 11663.2). Total num frames: 99323904. Throughput: 0: 11486.6. Samples: 99316576. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:29:39,272][367454] Avg episode reward: [(0, '4483.918')] [2023-03-08 10:29:39,333][367737] Updated weights for policy 0, policy_version 194000 (0.0005) [2023-03-08 10:29:42,655][367737] Updated weights for policy 0, policy_version 194080 (0.0004) [2023-03-08 10:29:44,271][367454] Fps is (10 sec: 11878.5, 60 sec: 11537.1, 300 sec: 11663.2). Total num frames: 99385344. Throughput: 0: 11573.9. Samples: 99353640. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:29:44,272][367454] Avg episode reward: [(0, '4654.645')] [2023-03-08 10:29:46,204][367737] Updated weights for policy 0, policy_version 194160 (0.0005) [2023-03-08 10:29:49,271][367454] Fps is (10 sec: 11878.5, 60 sec: 11537.1, 300 sec: 11649.3). Total num frames: 99442688. Throughput: 0: 11592.0. Samples: 99423664. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:29:49,272][367454] Avg episode reward: [(0, '4547.323')] [2023-03-08 10:29:49,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000194224_99442688.pth... [2023-03-08 10:29:49,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000193552_99098624.pth [2023-03-08 10:29:49,686][367737] Updated weights for policy 0, policy_version 194240 (0.0005) [2023-03-08 10:29:53,231][367737] Updated weights for policy 0, policy_version 194320 (0.0005) [2023-03-08 10:29:54,271][367454] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11663.2). Total num frames: 99504128. Throughput: 0: 11607.4. Samples: 99493980. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:29:54,272][367454] Avg episode reward: [(0, '4529.995')] [2023-03-08 10:29:56,700][367737] Updated weights for policy 0, policy_version 194400 (0.0005) [2023-03-08 10:29:59,271][367454] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11663.2). Total num frames: 99561472. Throughput: 0: 11600.3. Samples: 99529320. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:29:59,272][367454] Avg episode reward: [(0, '4565.819')] [2023-03-08 10:30:00,366][367737] Updated weights for policy 0, policy_version 194480 (0.0005) [2023-03-08 10:30:03,950][367737] Updated weights for policy 0, policy_version 194560 (0.0005) [2023-03-08 10:30:04,271][367454] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11649.3). Total num frames: 99614720. Throughput: 0: 11562.3. Samples: 99598176. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:30:04,272][367454] Avg episode reward: [(0, '4519.570')] [2023-03-08 10:30:04,274][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000194560_99614720.pth... [2023-03-08 10:30:04,277][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000193880_99266560.pth [2023-03-08 10:30:07,692][367737] Updated weights for policy 0, policy_version 194640 (0.0004) [2023-03-08 10:30:09,272][367454] Fps is (10 sec: 11059.1, 60 sec: 11537.1, 300 sec: 11635.4). Total num frames: 99672064. Throughput: 0: 11491.6. Samples: 99663880. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:30:09,272][367454] Avg episode reward: [(0, '4577.795')] [2023-03-08 10:30:11,336][367737] Updated weights for policy 0, policy_version 194720 (0.0004) [2023-03-08 10:30:14,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11621.5). Total num frames: 99729408. Throughput: 0: 11475.8. Samples: 99697016. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:30:14,272][367454] Avg episode reward: [(0, '4528.268')] [2023-03-08 10:30:14,947][367737] Updated weights for policy 0, policy_version 194800 (0.0005) [2023-03-08 10:30:18,438][367737] Updated weights for policy 0, policy_version 194880 (0.0004) [2023-03-08 10:30:19,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11607.6). Total num frames: 99786752. Throughput: 0: 11507.8. Samples: 99766336. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:30:19,272][367454] Avg episode reward: [(0, '4542.791')] [2023-03-08 10:30:19,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000194896_99786752.pth... [2023-03-08 10:30:19,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000194224_99442688.pth [2023-03-08 10:30:22,043][367737] Updated weights for policy 0, policy_version 194960 (0.0004) [2023-03-08 10:30:24,271][367454] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11607.6). Total num frames: 99844096. Throughput: 0: 11519.6. Samples: 99834956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:30:24,272][367454] Avg episode reward: [(0, '4474.786')] [2023-03-08 10:30:25,640][367737] Updated weights for policy 0, policy_version 195040 (0.0005) [2023-03-08 10:30:28,959][367737] Updated weights for policy 0, policy_version 195120 (0.0004) [2023-03-08 10:30:29,272][367454] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11607.6). Total num frames: 99901440. Throughput: 0: 11469.3. Samples: 99869760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:30:29,272][367454] Avg episode reward: [(0, '4605.366')] [2023-03-08 10:30:32,255][367737] Updated weights for policy 0, policy_version 195200 (0.0004) [2023-03-08 10:30:34,272][367454] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 11621.5). Total num frames: 99962880. Throughput: 0: 11561.0. Samples: 99943912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:30:34,272][367454] Avg episode reward: [(0, '4631.587')] [2023-03-08 10:30:34,275][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000195240_99962880.pth... [2023-03-08 10:30:34,278][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000194560_99614720.pth [2023-03-08 10:30:35,791][367737] Updated weights for policy 0, policy_version 195280 (0.0005) [2023-03-08 10:30:37,503][367693] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000000 [2023-03-08 10:30:37,843][367693] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000000 [2023-03-08 10:30:37,844][367744] Stopping RolloutWorker_w4... [2023-03-08 10:30:37,844][367738] Stopping RolloutWorker_w6... [2023-03-08 10:30:37,844][367740] Stopping RolloutWorker_w3... [2023-03-08 10:30:37,844][367742] Stopping RolloutWorker_w1... [2023-03-08 10:30:37,844][367741] Stopping RolloutWorker_w7... [2023-03-08 10:30:37,844][367743] Stopping RolloutWorker_w0... [2023-03-08 10:30:37,844][367744] Loop rollout_proc4_evt_loop terminating... [2023-03-08 10:30:37,844][367745] Stopping RolloutWorker_w5... [2023-03-08 10:30:37,844][367740] Loop rollout_proc3_evt_loop terminating... [2023-03-08 10:30:37,844][367738] Loop rollout_proc6_evt_loop terminating... [2023-03-08 10:30:37,844][367739] Stopping RolloutWorker_w2... [2023-03-08 10:30:37,844][367742] Loop rollout_proc1_evt_loop terminating... [2023-03-08 10:30:37,844][367741] Loop rollout_proc7_evt_loop terminating... [2023-03-08 10:30:37,844][367743] Loop rollout_proc0_evt_loop terminating... [2023-03-08 10:30:37,844][367745] Loop rollout_proc5_evt_loop terminating... [2023-03-08 10:30:37,844][367739] Loop rollout_proc2_evt_loop terminating... [2023-03-08 10:30:37,844][367454] Component RolloutWorker_w6 stopped! [2023-03-08 10:30:37,844][367693] Stopping Batcher_0... [2023-03-08 10:30:37,845][367454] Component RolloutWorker_w4 stopped! [2023-03-08 10:30:37,845][367693] Loop batcher_evt_loop terminating... [2023-03-08 10:30:37,845][367454] Component RolloutWorker_w3 stopped! [2023-03-08 10:30:37,845][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000195328_100007936.pth... [2023-03-08 10:30:37,845][367454] Component RolloutWorker_w1 stopped! [2023-03-08 10:30:37,846][367454] Component RolloutWorker_w5 stopped! [2023-03-08 10:30:37,846][367454] Component RolloutWorker_w7 stopped! [2023-03-08 10:30:37,846][367454] Component RolloutWorker_w0 stopped! [2023-03-08 10:30:37,847][367454] Component RolloutWorker_w2 stopped! [2023-03-08 10:30:37,847][367454] Component Batcher_0 stopped! [2023-03-08 10:30:37,848][367693] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000194896_99786752.pth [2023-03-08 10:30:37,848][367693] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-close-v2/checkpoint_p0/checkpoint_000195328_100007936.pth... [2023-03-08 10:30:37,850][367693] Stopping LearnerWorker_p0... [2023-03-08 10:30:37,851][367693] Loop learner_proc0_evt_loop terminating... [2023-03-08 10:30:37,850][367454] Component LearnerWorker_p0 stopped! [2023-03-08 10:30:37,903][367737] Weights refcount: 2 0 [2023-03-08 10:30:37,903][367737] Stopping InferenceWorker_p0-w0... [2023-03-08 10:30:37,904][367737] Loop inference_proc0-0_evt_loop terminating... [2023-03-08 10:30:37,904][367454] Component InferenceWorker_p0-w0 stopped! [2023-03-08 10:30:37,904][367454] Waiting for process learner_proc0 to stop... [2023-03-08 10:30:38,321][367454] Waiting for process inference_proc0-0 to join... [2023-03-08 10:30:38,332][367454] Waiting for process rollout_proc0 to join... [2023-03-08 10:30:38,332][367454] Waiting for process rollout_proc1 to join... [2023-03-08 10:30:38,332][367454] Waiting for process rollout_proc2 to join... [2023-03-08 10:30:38,333][367454] Waiting for process rollout_proc3 to join... [2023-03-08 10:30:38,333][367454] Waiting for process rollout_proc4 to join... [2023-03-08 10:30:38,333][367454] Waiting for process rollout_proc5 to join... [2023-03-08 10:30:38,333][367454] Waiting for process rollout_proc6 to join... [2023-03-08 10:30:38,334][367454] Waiting for process rollout_proc7 to join... [2023-03-08 10:30:38,334][367454] Batcher 0 profile tree view: batching: 16.9237, releasing_batches: 14.4771 [2023-03-08 10:30:38,334][367454] InferenceWorker_p0-w0 profile tree view: wait_policy: 0.0051 wait_policy_total: 2599.0244 update_model: 90.3101 weight_update: 0.0005 one_step: 0.0009 handle_policy_step: 4642.6233 deserialize: 197.6455, stack: 48.1491, obs_to_device_normalize: 821.2120, forward: 2290.7108, send_messages: 355.8114 prepare_outputs: 529.4657 to_cpu: 85.9397 [2023-03-08 10:30:38,334][367454] Learner 0 profile tree view: misc: 0.1103, prepare_batch: 87.5253 train: 1126.9990 epoch_init: 0.3916, minibatch_init: 11.4017, losses_postprocess: 11.5101, kl_divergence: 4.1047, after_optimizer: 4.7202 calculate_losses: 462.7748 losses_init: 0.4026, forward_head: 230.1962, bptt_initial: 1.2280, bptt: 1.2653, tail: 108.4594, advantages_returns: 8.4037, losses: 99.3933 update: 616.8801 clip: 53.9757 [2023-03-08 10:30:38,334][367454] RolloutWorker_w0 profile tree view: wait_for_trajectories: 2.7401, enqueue_policy_requests: 124.0172, env_step: 4904.0956, overhead: 306.4031, complete_rollouts: 3.0845 save_policy_outputs: 318.5740 split_output_tensors: 157.5330 [2023-03-08 10:30:38,335][367454] RolloutWorker_w7 profile tree view: wait_for_trajectories: 2.7465, enqueue_policy_requests: 126.2098, env_step: 4954.0352, overhead: 311.9447, complete_rollouts: 3.1591 save_policy_outputs: 322.2292 split_output_tensors: 158.0224 [2023-03-08 10:30:38,335][367454] Loop Runner_EvtLoop terminating... [2023-03-08 10:30:38,335][367454] Runner profile tree view: main_loop: 7891.9387 [2023-03-08 10:30:38,335][367454] Collected {0: 100007936}, FPS: 12672.2