[2023-03-08 10:30:55,178][389401] Saving configuration to /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/config.json... [2023-03-08 10:30:55,194][389401] Rollout worker 0 uses device cpu [2023-03-08 10:30:55,194][389401] Rollout worker 1 uses device cpu [2023-03-08 10:30:55,194][389401] Rollout worker 2 uses device cpu [2023-03-08 10:30:55,194][389401] Rollout worker 3 uses device cpu [2023-03-08 10:30:55,194][389401] Rollout worker 4 uses device cpu [2023-03-08 10:30:55,194][389401] Rollout worker 5 uses device cpu [2023-03-08 10:30:55,195][389401] Rollout worker 6 uses device cpu [2023-03-08 10:30:55,195][389401] Rollout worker 7 uses device cpu [2023-03-08 10:30:55,195][389401] In synchronous mode, we only accumulate one batch. Setting num_batches_to_accumulate to 1 [2023-03-08 10:30:55,206][389401] InferenceWorker_p0-w0: min num requests: 2 [2023-03-08 10:30:55,223][389401] Starting all processes... [2023-03-08 10:30:55,223][389401] Starting process learner_proc0 [2023-03-08 10:30:55,273][389401] Starting all processes... [2023-03-08 10:30:55,316][389401] Starting process inference_proc0-0 [2023-03-08 10:30:55,316][389401] Starting process rollout_proc0 [2023-03-08 10:30:55,316][389401] Starting process rollout_proc1 [2023-03-08 10:30:55,316][389401] Starting process rollout_proc2 [2023-03-08 10:30:55,316][389401] Starting process rollout_proc3 [2023-03-08 10:30:55,316][389401] Starting process rollout_proc4 [2023-03-08 10:30:55,316][389401] Starting process rollout_proc5 [2023-03-08 10:30:55,316][389401] Starting process rollout_proc6 [2023-03-08 10:30:55,318][389401] Starting process rollout_proc7 [2023-03-08 10:30:56,684][389644] Starting seed is not provided [2023-03-08 10:30:56,684][389644] Initializing actor-critic model on device cpu [2023-03-08 10:30:56,684][389644] RunningMeanStd input shape: (39,) [2023-03-08 10:30:56,684][389644] RunningMeanStd input shape: (1,) [2023-03-08 10:30:56,741][389644] Created Actor Critic model with architecture: [2023-03-08 10:30:56,741][389644] ActorCriticSharedWeights( (obs_normalizer): ObservationNormalizer( (running_mean_std): RunningMeanStdDictInPlace( (running_mean_std): ModuleDict( (obs): RunningMeanStdInPlace() ) ) ) (returns_normalizer): RecursiveScriptModule(original_name=RunningMeanStdInPlace) (encoder): MultiInputEncoder( (encoders): ModuleDict( (obs): MlpEncoder( (mlp_head): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Linear) (1): RecursiveScriptModule(original_name=Tanh) (2): RecursiveScriptModule(original_name=Linear) (3): RecursiveScriptModule(original_name=Tanh) ) ) ) ) (core): ModelCoreIdentity() (decoder): MlpDecoder( (mlp): Identity() ) (critic_linear): Linear(in_features=64, out_features=1, bias=True) (action_parameterization): ActionParameterizationContinuousNonAdaptiveStddev( (distribution_linear): Linear(in_features=64, out_features=4, bias=True) ) ) [2023-03-08 10:30:56,912][389689] Worker 3 uses CPU cores [12, 13, 14, 15] [2023-03-08 10:30:56,955][389691] Worker 7 uses CPU cores [28, 29, 30, 31] [2023-03-08 10:30:56,963][389695] Worker 5 uses CPU cores [20, 21, 22, 23] [2023-03-08 10:30:57,068][389644] Using optimizer [2023-03-08 10:30:57,069][389644] No checkpoints found [2023-03-08 10:30:57,069][389644] Did not load from checkpoint, starting from scratch! [2023-03-08 10:30:57,069][389644] Initialized policy 0 weights for model version 0 [2023-03-08 10:30:57,070][389644] LearnerWorker_p0 finished initialization! [2023-03-08 10:30:57,123][389694] Worker 2 uses CPU cores [8, 9, 10, 11] [2023-03-08 10:30:57,223][389690] Worker 1 uses CPU cores [4, 5, 6, 7] [2023-03-08 10:30:57,294][389693] Worker 4 uses CPU cores [16, 17, 18, 19] [2023-03-08 10:30:57,344][389692] Worker 6 uses CPU cores [24, 25, 26, 27] [2023-03-08 10:30:57,447][389727] Worker 0 uses CPU cores [0, 1, 2, 3] [2023-03-08 10:30:57,561][389688] RunningMeanStd input shape: (39,) [2023-03-08 10:30:57,562][389688] RunningMeanStd input shape: (1,) [2023-03-08 10:30:57,616][389401] Inference worker 0-0 is ready! [2023-03-08 10:30:57,617][389401] All inference workers are ready! Signal rollout workers to start! [2023-03-08 10:30:58,079][389401] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 0. Throughput: 0: nan. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-08 10:31:01,209][389689] Decorrelating experience for 0 frames... [2023-03-08 10:31:01,211][389691] Decorrelating experience for 0 frames... [2023-03-08 10:31:01,221][389689] Decorrelating experience for 64 frames... [2023-03-08 10:31:01,223][389691] Decorrelating experience for 64 frames... [2023-03-08 10:31:01,225][389695] Decorrelating experience for 0 frames... [2023-03-08 10:31:01,227][389690] Decorrelating experience for 0 frames... [2023-03-08 10:31:01,237][389695] Decorrelating experience for 64 frames... [2023-03-08 10:31:01,238][389690] Decorrelating experience for 64 frames... [2023-03-08 10:31:01,254][389689] Decorrelating experience for 128 frames... [2023-03-08 10:31:01,256][389691] Decorrelating experience for 128 frames... [2023-03-08 10:31:01,256][389727] Decorrelating experience for 0 frames... [2023-03-08 10:31:01,260][389693] Decorrelating experience for 0 frames... [2023-03-08 10:31:01,268][389727] Decorrelating experience for 64 frames... [2023-03-08 10:31:01,269][389694] Decorrelating experience for 0 frames... [2023-03-08 10:31:01,270][389695] Decorrelating experience for 128 frames... [2023-03-08 10:31:01,270][389692] Decorrelating experience for 0 frames... [2023-03-08 10:31:01,271][389690] Decorrelating experience for 128 frames... [2023-03-08 10:31:01,272][389693] Decorrelating experience for 64 frames... [2023-03-08 10:31:01,281][389694] Decorrelating experience for 64 frames... [2023-03-08 10:31:01,282][389692] Decorrelating experience for 64 frames... [2023-03-08 10:31:01,301][389727] Decorrelating experience for 128 frames... [2023-03-08 10:31:01,305][389693] Decorrelating experience for 128 frames... [2023-03-08 10:31:01,307][389689] Decorrelating experience for 192 frames... [2023-03-08 10:31:01,308][389691] Decorrelating experience for 192 frames... [2023-03-08 10:31:01,315][389692] Decorrelating experience for 128 frames... [2023-03-08 10:31:01,315][389694] Decorrelating experience for 128 frames... [2023-03-08 10:31:01,323][389695] Decorrelating experience for 192 frames... [2023-03-08 10:31:01,324][389690] Decorrelating experience for 192 frames... [2023-03-08 10:31:01,354][389727] Decorrelating experience for 192 frames... [2023-03-08 10:31:01,358][389693] Decorrelating experience for 192 frames... [2023-03-08 10:31:01,367][389694] Decorrelating experience for 192 frames... [2023-03-08 10:31:01,368][389692] Decorrelating experience for 192 frames... [2023-03-08 10:31:03,079][389401] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2023-03-08 10:31:04,877][389689] Decorrelating experience for 256 frames... [2023-03-08 10:31:04,893][389691] Decorrelating experience for 256 frames... [2023-03-08 10:31:04,909][389695] Decorrelating experience for 256 frames... [2023-03-08 10:31:04,913][389690] Decorrelating experience for 256 frames... [2023-03-08 10:31:04,947][389693] Decorrelating experience for 256 frames... [2023-03-08 10:31:04,960][389727] Decorrelating experience for 256 frames... [2023-03-08 10:31:04,966][389692] Decorrelating experience for 256 frames... [2023-03-08 10:31:04,970][389689] Decorrelating experience for 320 frames... [2023-03-08 10:31:04,975][389694] Decorrelating experience for 256 frames... [2023-03-08 10:31:04,990][389691] Decorrelating experience for 320 frames... [2023-03-08 10:31:05,004][389695] Decorrelating experience for 320 frames... [2023-03-08 10:31:05,006][389690] Decorrelating experience for 320 frames... [2023-03-08 10:31:05,041][389693] Decorrelating experience for 320 frames... [2023-03-08 10:31:05,054][389727] Decorrelating experience for 320 frames... [2023-03-08 10:31:05,062][389692] Decorrelating experience for 320 frames... [2023-03-08 10:31:05,069][389694] Decorrelating experience for 320 frames... [2023-03-08 10:31:05,082][389689] Decorrelating experience for 384 frames... [2023-03-08 10:31:05,102][389691] Decorrelating experience for 384 frames... [2023-03-08 10:31:05,117][389695] Decorrelating experience for 384 frames... [2023-03-08 10:31:05,120][389690] Decorrelating experience for 384 frames... [2023-03-08 10:31:05,155][389693] Decorrelating experience for 384 frames... [2023-03-08 10:31:05,169][389727] Decorrelating experience for 384 frames... [2023-03-08 10:31:05,176][389692] Decorrelating experience for 384 frames... [2023-03-08 10:31:05,183][389694] Decorrelating experience for 384 frames... [2023-03-08 10:31:05,215][389689] Decorrelating experience for 448 frames... [2023-03-08 10:31:05,237][389691] Decorrelating experience for 448 frames... [2023-03-08 10:31:05,252][389695] Decorrelating experience for 448 frames... [2023-03-08 10:31:05,254][389690] Decorrelating experience for 448 frames... [2023-03-08 10:31:05,289][389693] Decorrelating experience for 448 frames... [2023-03-08 10:31:05,303][389727] Decorrelating experience for 448 frames... [2023-03-08 10:31:05,311][389692] Decorrelating experience for 448 frames... [2023-03-08 10:31:05,318][389694] Decorrelating experience for 448 frames... [2023-03-08 10:31:08,079][389401] Fps is (10 sec: 2457.6, 60 sec: 2457.6, 300 sec: 2457.6). Total num frames: 24576. Throughput: 0: 828.8. Samples: 8288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:31:08,080][389401] Avg episode reward: [(0, '603.599')] [2023-03-08 10:31:08,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000000048_24576.pth... [2023-03-08 10:31:09,111][389688] Updated weights for policy 0, policy_version 80 (0.0005) [2023-03-08 10:31:12,167][389688] Updated weights for policy 0, policy_version 160 (0.0004) [2023-03-08 10:31:13,079][389401] Fps is (10 sec: 9011.2, 60 sec: 6007.5, 300 sec: 6007.5). Total num frames: 90112. Throughput: 0: 5888.3. Samples: 88324. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:31:13,084][389401] Avg episode reward: [(0, '2165.907')] [2023-03-08 10:31:15,201][389401] Heartbeat connected on Batcher_0 [2023-03-08 10:31:15,209][389401] Heartbeat connected on RolloutWorker_w0 [2023-03-08 10:31:15,210][389401] Heartbeat connected on RolloutWorker_w1 [2023-03-08 10:31:15,212][389401] Heartbeat connected on RolloutWorker_w2 [2023-03-08 10:31:15,214][389401] Heartbeat connected on RolloutWorker_w3 [2023-03-08 10:31:15,216][389401] Heartbeat connected on RolloutWorker_w4 [2023-03-08 10:31:15,218][389401] Heartbeat connected on RolloutWorker_w5 [2023-03-08 10:31:15,220][389401] Heartbeat connected on RolloutWorker_w6 [2023-03-08 10:31:15,222][389401] Heartbeat connected on RolloutWorker_w7 [2023-03-08 10:31:15,229][389401] Heartbeat connected on LearnerWorker_p0 [2023-03-08 10:31:15,231][389688] Updated weights for policy 0, policy_version 240 (0.0005) [2023-03-08 10:31:15,232][389401] Heartbeat connected on InferenceWorker_p0-w0 [2023-03-08 10:31:18,079][389401] Fps is (10 sec: 13517.0, 60 sec: 7987.2, 300 sec: 7987.2). Total num frames: 159744. Throughput: 0: 6381.0. Samples: 127620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:31:18,090][389401] Avg episode reward: [(0, '2017.579')] [2023-03-08 10:31:18,091][389644] Saving new best policy, reward=2017.579! [2023-03-08 10:31:18,417][389688] Updated weights for policy 0, policy_version 320 (0.0005) [2023-03-08 10:31:21,636][389688] Updated weights for policy 0, policy_version 400 (0.0004) [2023-03-08 10:31:23,079][389401] Fps is (10 sec: 13107.3, 60 sec: 8847.4, 300 sec: 8847.4). Total num frames: 221184. Throughput: 0: 8194.6. Samples: 204864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:31:23,080][389401] Avg episode reward: [(0, '1306.951')] [2023-03-08 10:31:23,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000000432_221184.pth... [2023-03-08 10:31:24,751][389688] Updated weights for policy 0, policy_version 480 (0.0004) [2023-03-08 10:31:28,071][389688] Updated weights for policy 0, policy_version 560 (0.0005) [2023-03-08 10:31:28,079][389401] Fps is (10 sec: 12697.6, 60 sec: 9557.4, 300 sec: 9557.4). Total num frames: 286720. Throughput: 0: 9420.7. Samples: 282620. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:31:28,080][389401] Avg episode reward: [(0, '2824.435')] [2023-03-08 10:31:28,080][389644] Saving new best policy, reward=2824.435! [2023-03-08 10:31:31,390][389688] Updated weights for policy 0, policy_version 640 (0.0004) [2023-03-08 10:31:33,079][389401] Fps is (10 sec: 12288.0, 60 sec: 9830.4, 300 sec: 9830.4). Total num frames: 344064. Throughput: 0: 9126.1. Samples: 319412. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:31:33,080][389401] Avg episode reward: [(0, '4182.332')] [2023-03-08 10:31:33,080][389644] Saving new best policy, reward=4182.332! [2023-03-08 10:31:34,947][389688] Updated weights for policy 0, policy_version 720 (0.0005) [2023-03-08 10:31:38,079][389401] Fps is (10 sec: 11468.7, 60 sec: 10035.2, 300 sec: 10035.2). Total num frames: 401408. Throughput: 0: 9729.6. Samples: 389184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:31:38,080][389401] Avg episode reward: [(0, '4485.928')] [2023-03-08 10:31:38,086][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000000792_405504.pth... [2023-03-08 10:31:38,087][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000000048_24576.pth [2023-03-08 10:31:38,088][389644] Saving new best policy, reward=4485.928! [2023-03-08 10:31:38,418][389688] Updated weights for policy 0, policy_version 800 (0.0004) [2023-03-08 10:31:41,760][389688] Updated weights for policy 0, policy_version 880 (0.0004) [2023-03-08 10:31:43,079][389401] Fps is (10 sec: 11878.4, 60 sec: 10285.5, 300 sec: 10285.5). Total num frames: 462848. Throughput: 0: 10237.7. Samples: 460696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:31:43,080][389401] Avg episode reward: [(0, '4636.976')] [2023-03-08 10:31:43,080][389644] Saving new best policy, reward=4636.976! [2023-03-08 10:31:45,354][389688] Updated weights for policy 0, policy_version 960 (0.0005) [2023-03-08 10:31:48,079][389401] Fps is (10 sec: 11878.4, 60 sec: 10403.8, 300 sec: 10403.8). Total num frames: 520192. Throughput: 0: 11013.7. Samples: 495616. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:31:48,080][389401] Avg episode reward: [(0, '4624.705')] [2023-03-08 10:31:48,919][389688] Updated weights for policy 0, policy_version 1040 (0.0005) [2023-03-08 10:31:52,510][389688] Updated weights for policy 0, policy_version 1120 (0.0005) [2023-03-08 10:31:53,079][389401] Fps is (10 sec: 11468.6, 60 sec: 10500.6, 300 sec: 10500.6). Total num frames: 577536. Throughput: 0: 12349.9. Samples: 564032. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:31:53,080][389401] Avg episode reward: [(0, '4588.650')] [2023-03-08 10:31:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000001128_577536.pth... [2023-03-08 10:31:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000000432_221184.pth [2023-03-08 10:31:56,143][389688] Updated weights for policy 0, policy_version 1200 (0.0005) [2023-03-08 10:31:58,079][389401] Fps is (10 sec: 11468.9, 60 sec: 10581.3, 300 sec: 10581.3). Total num frames: 634880. Throughput: 0: 12070.3. Samples: 631488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:31:58,080][389401] Avg episode reward: [(0, '4499.203')] [2023-03-08 10:31:59,743][389688] Updated weights for policy 0, policy_version 1280 (0.0005) [2023-03-08 10:32:03,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 10649.6). Total num frames: 692224. Throughput: 0: 11965.4. Samples: 666064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:32:03,080][389401] Avg episode reward: [(0, '4487.480')] [2023-03-08 10:32:03,265][389688] Updated weights for policy 0, policy_version 1360 (0.0005) [2023-03-08 10:32:06,994][389688] Updated weights for policy 0, policy_version 1440 (0.0005) [2023-03-08 10:32:08,079][389401] Fps is (10 sec: 11059.1, 60 sec: 12014.9, 300 sec: 10649.6). Total num frames: 745472. Throughput: 0: 11742.0. Samples: 733256. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:32:08,080][389401] Avg episode reward: [(0, '4642.037')] [2023-03-08 10:32:08,137][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000001464_749568.pth... [2023-03-08 10:32:08,139][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000000792_405504.pth [2023-03-08 10:32:08,139][389644] Saving new best policy, reward=4642.037! [2023-03-08 10:32:10,903][389688] Updated weights for policy 0, policy_version 1520 (0.0005) [2023-03-08 10:32:13,079][389401] Fps is (10 sec: 10649.7, 60 sec: 11810.1, 300 sec: 10649.6). Total num frames: 798720. Throughput: 0: 11452.4. Samples: 797980. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:32:13,080][389401] Avg episode reward: [(0, '4674.174')] [2023-03-08 10:32:13,092][389644] Saving new best policy, reward=4674.174! [2023-03-08 10:32:14,565][389688] Updated weights for policy 0, policy_version 1600 (0.0004) [2023-03-08 10:32:18,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11605.3, 300 sec: 10700.8). Total num frames: 856064. Throughput: 0: 11380.9. Samples: 831552. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:32:18,080][389401] Avg episode reward: [(0, '4695.164')] [2023-03-08 10:32:18,080][389644] Saving new best policy, reward=4695.164! [2023-03-08 10:32:18,327][389688] Updated weights for policy 0, policy_version 1680 (0.0004) [2023-03-08 10:32:21,745][389688] Updated weights for policy 0, policy_version 1760 (0.0004) [2023-03-08 10:32:23,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 10746.0). Total num frames: 913408. Throughput: 0: 11350.4. Samples: 899952. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:32:23,080][389401] Avg episode reward: [(0, '4707.514')] [2023-03-08 10:32:23,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000001784_913408.pth... [2023-03-08 10:32:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000001128_577536.pth [2023-03-08 10:32:23,085][389644] Saving new best policy, reward=4707.514! [2023-03-08 10:32:25,192][389688] Updated weights for policy 0, policy_version 1840 (0.0004) [2023-03-08 10:32:28,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11468.8, 300 sec: 10831.7). Total num frames: 974848. Throughput: 0: 11377.2. Samples: 972668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:32:28,080][389401] Avg episode reward: [(0, '4595.730')] [2023-03-08 10:32:28,444][389688] Updated weights for policy 0, policy_version 1920 (0.0003) [2023-03-08 10:32:31,610][389688] Updated weights for policy 0, policy_version 2000 (0.0004) [2023-03-08 10:32:33,079][389401] Fps is (10 sec: 12697.7, 60 sec: 11605.3, 300 sec: 10951.4). Total num frames: 1040384. Throughput: 0: 11469.0. Samples: 1011720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:32:33,080][389401] Avg episode reward: [(0, '4635.736')] [2023-03-08 10:32:34,794][389688] Updated weights for policy 0, policy_version 2080 (0.0004) [2023-03-08 10:32:38,079][389401] Fps is (10 sec: 12697.5, 60 sec: 11673.6, 300 sec: 11018.2). Total num frames: 1101824. Throughput: 0: 11664.4. Samples: 1088928. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:32:38,080][389401] Avg episode reward: [(0, '4608.474')] [2023-03-08 10:32:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000002152_1101824.pth... [2023-03-08 10:32:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000001464_749568.pth [2023-03-08 10:32:38,153][389688] Updated weights for policy 0, policy_version 2160 (0.0004) [2023-03-08 10:32:41,623][389688] Updated weights for policy 0, policy_version 2240 (0.0005) [2023-03-08 10:32:43,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 11078.7). Total num frames: 1163264. Throughput: 0: 11726.4. Samples: 1159176. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:32:43,080][389401] Avg episode reward: [(0, '4579.156')] [2023-03-08 10:32:45,182][389688] Updated weights for policy 0, policy_version 2320 (0.0005) [2023-03-08 10:32:48,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11096.4). Total num frames: 1220608. Throughput: 0: 11718.2. Samples: 1193384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:32:48,080][389401] Avg episode reward: [(0, '4607.216')] [2023-03-08 10:32:48,671][389688] Updated weights for policy 0, policy_version 2400 (0.0005) [2023-03-08 10:32:52,147][389688] Updated weights for policy 0, policy_version 2480 (0.0005) [2023-03-08 10:32:53,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 11112.6). Total num frames: 1277952. Throughput: 0: 11787.5. Samples: 1263692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:32:53,080][389401] Avg episode reward: [(0, '4552.695')] [2023-03-08 10:32:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000002496_1277952.pth... [2023-03-08 10:32:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000001784_913408.pth [2023-03-08 10:32:55,843][389688] Updated weights for policy 0, policy_version 2560 (0.0005) [2023-03-08 10:32:58,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11127.5). Total num frames: 1335296. Throughput: 0: 11856.6. Samples: 1331528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:32:58,080][389401] Avg episode reward: [(0, '4488.930')] [2023-03-08 10:32:59,387][389688] Updated weights for policy 0, policy_version 2640 (0.0005) [2023-03-08 10:33:02,847][389688] Updated weights for policy 0, policy_version 2720 (0.0005) [2023-03-08 10:33:03,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11141.1). Total num frames: 1392640. Throughput: 0: 11911.0. Samples: 1367548. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:33:03,080][389401] Avg episode reward: [(0, '4494.934')] [2023-03-08 10:33:06,161][389688] Updated weights for policy 0, policy_version 2800 (0.0004) [2023-03-08 10:33:08,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11185.2). Total num frames: 1454080. Throughput: 0: 12000.7. Samples: 1439984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:33:08,080][389401] Avg episode reward: [(0, '4480.482')] [2023-03-08 10:33:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000002840_1454080.pth... [2023-03-08 10:33:08,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000002152_1101824.pth [2023-03-08 10:33:09,428][389688] Updated weights for policy 0, policy_version 2880 (0.0004) [2023-03-08 10:33:12,870][389688] Updated weights for policy 0, policy_version 2960 (0.0005) [2023-03-08 10:33:13,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11226.1). Total num frames: 1515520. Throughput: 0: 12011.7. Samples: 1513196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:33:13,080][389401] Avg episode reward: [(0, '4374.613')] [2023-03-08 10:33:16,296][389688] Updated weights for policy 0, policy_version 3040 (0.0005) [2023-03-08 10:33:18,079][389401] Fps is (10 sec: 12288.2, 60 sec: 12015.0, 300 sec: 11264.0). Total num frames: 1576960. Throughput: 0: 11925.3. Samples: 1548360. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:33:18,080][389401] Avg episode reward: [(0, '4662.846')] [2023-03-08 10:33:19,847][389688] Updated weights for policy 0, policy_version 3120 (0.0005) [2023-03-08 10:33:23,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11946.6, 300 sec: 11242.8). Total num frames: 1630208. Throughput: 0: 11755.5. Samples: 1617928. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:33:23,080][389401] Avg episode reward: [(0, '4659.831')] [2023-03-08 10:33:23,123][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000003192_1634304.pth... [2023-03-08 10:33:23,125][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000002496_1277952.pth [2023-03-08 10:33:23,473][389688] Updated weights for policy 0, policy_version 3200 (0.0005) [2023-03-08 10:33:26,905][389688] Updated weights for policy 0, policy_version 3280 (0.0005) [2023-03-08 10:33:28,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11946.6, 300 sec: 11277.7). Total num frames: 1691648. Throughput: 0: 11743.7. Samples: 1687644. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:33:28,080][389401] Avg episode reward: [(0, '4617.289')] [2023-03-08 10:33:30,446][389688] Updated weights for policy 0, policy_version 3360 (0.0005) [2023-03-08 10:33:33,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11283.8). Total num frames: 1748992. Throughput: 0: 11772.4. Samples: 1723144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:33:33,080][389401] Avg episode reward: [(0, '4648.775')] [2023-03-08 10:33:34,045][389688] Updated weights for policy 0, policy_version 3440 (0.0005) [2023-03-08 10:33:37,343][389688] Updated weights for policy 0, policy_version 3520 (0.0005) [2023-03-08 10:33:38,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11315.2). Total num frames: 1810432. Throughput: 0: 11785.7. Samples: 1794048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:33:38,080][389401] Avg episode reward: [(0, '4401.916')] [2023-03-08 10:33:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000003536_1810432.pth... [2023-03-08 10:33:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000002840_1454080.pth [2023-03-08 10:33:40,633][389688] Updated weights for policy 0, policy_version 3600 (0.0005) [2023-03-08 10:33:43,079][389401] Fps is (10 sec: 12288.2, 60 sec: 11810.1, 300 sec: 11344.7). Total num frames: 1871872. Throughput: 0: 11959.8. Samples: 1869716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:33:43,080][389401] Avg episode reward: [(0, '4659.363')] [2023-03-08 10:33:43,765][389688] Updated weights for policy 0, policy_version 3680 (0.0004) [2023-03-08 10:33:47,021][389688] Updated weights for policy 0, policy_version 3760 (0.0004) [2023-03-08 10:33:48,079][389401] Fps is (10 sec: 12697.6, 60 sec: 11946.7, 300 sec: 11396.5). Total num frames: 1937408. Throughput: 0: 12023.6. Samples: 1908608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:33:48,080][389401] Avg episode reward: [(0, '4580.183')] [2023-03-08 10:33:50,522][389688] Updated weights for policy 0, policy_version 3840 (0.0004) [2023-03-08 10:33:53,079][389401] Fps is (10 sec: 12287.8, 60 sec: 11946.7, 300 sec: 11398.6). Total num frames: 1994752. Throughput: 0: 11977.5. Samples: 1978972. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:33:53,080][389401] Avg episode reward: [(0, '4564.388')] [2023-03-08 10:33:53,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000003896_1994752.pth... [2023-03-08 10:33:53,087][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000003192_1634304.pth [2023-03-08 10:33:54,147][389688] Updated weights for policy 0, policy_version 3920 (0.0004) [2023-03-08 10:33:57,643][389688] Updated weights for policy 0, policy_version 4000 (0.0005) [2023-03-08 10:33:58,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11400.5). Total num frames: 2052096. Throughput: 0: 11886.0. Samples: 2048064. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:33:58,090][389401] Avg episode reward: [(0, '4527.896')] [2023-03-08 10:34:01,050][389688] Updated weights for policy 0, policy_version 4080 (0.0004) [2023-03-08 10:34:03,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11402.4). Total num frames: 2109440. Throughput: 0: 11910.1. Samples: 2084316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:34:03,090][389401] Avg episode reward: [(0, '4649.095')] [2023-03-08 10:34:04,487][389688] Updated weights for policy 0, policy_version 4160 (0.0005) [2023-03-08 10:34:07,796][389688] Updated weights for policy 0, policy_version 4240 (0.0005) [2023-03-08 10:34:08,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11425.7). Total num frames: 2170880. Throughput: 0: 11978.6. Samples: 2156964. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:34:08,090][389401] Avg episode reward: [(0, '4619.875')] [2023-03-08 10:34:08,138][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000004248_2174976.pth... [2023-03-08 10:34:08,140][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000003536_1810432.pth [2023-03-08 10:34:11,094][389688] Updated weights for policy 0, policy_version 4320 (0.0005) [2023-03-08 10:34:13,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11447.8). Total num frames: 2232320. Throughput: 0: 12087.6. Samples: 2231588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:34:13,090][389401] Avg episode reward: [(0, '4326.124')] [2023-03-08 10:34:14,527][389688] Updated weights for policy 0, policy_version 4400 (0.0005) [2023-03-08 10:34:17,852][389688] Updated weights for policy 0, policy_version 4480 (0.0005) [2023-03-08 10:34:18,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11946.6, 300 sec: 11468.8). Total num frames: 2293760. Throughput: 0: 12101.9. Samples: 2267728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:34:18,080][389401] Avg episode reward: [(0, '4313.969')] [2023-03-08 10:34:21,226][389688] Updated weights for policy 0, policy_version 4560 (0.0005) [2023-03-08 10:34:23,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11488.8). Total num frames: 2355200. Throughput: 0: 12117.7. Samples: 2339344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:34:23,080][389401] Avg episode reward: [(0, '4564.026')] [2023-03-08 10:34:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000004600_2355200.pth... [2023-03-08 10:34:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000003896_1994752.pth [2023-03-08 10:34:24,877][389688] Updated weights for policy 0, policy_version 4640 (0.0005) [2023-03-08 10:34:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11468.8). Total num frames: 2408448. Throughput: 0: 11952.2. Samples: 2407568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:34:28,080][389401] Avg episode reward: [(0, '4615.094')] [2023-03-08 10:34:28,503][389688] Updated weights for policy 0, policy_version 4720 (0.0005) [2023-03-08 10:34:32,076][389688] Updated weights for policy 0, policy_version 4800 (0.0005) [2023-03-08 10:34:33,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11946.7, 300 sec: 11468.8). Total num frames: 2465792. Throughput: 0: 11837.2. Samples: 2441280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:34:33,080][389401] Avg episode reward: [(0, '4564.313')] [2023-03-08 10:34:35,529][389688] Updated weights for policy 0, policy_version 4880 (0.0005) [2023-03-08 10:34:38,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11487.4). Total num frames: 2527232. Throughput: 0: 11828.2. Samples: 2511240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:34:38,080][389401] Avg episode reward: [(0, '4617.133')] [2023-03-08 10:34:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000004936_2527232.pth... [2023-03-08 10:34:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000004248_2174976.pth [2023-03-08 10:34:38,961][389688] Updated weights for policy 0, policy_version 4960 (0.0005) [2023-03-08 10:34:42,134][389688] Updated weights for policy 0, policy_version 5040 (0.0004) [2023-03-08 10:34:43,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11505.2). Total num frames: 2588672. Throughput: 0: 11972.7. Samples: 2586836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:34:43,080][389401] Avg episode reward: [(0, '4626.321')] [2023-03-08 10:34:45,562][389688] Updated weights for policy 0, policy_version 5120 (0.0004) [2023-03-08 10:34:48,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11878.4, 300 sec: 11522.2). Total num frames: 2650112. Throughput: 0: 11955.7. Samples: 2622324. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:34:48,080][389401] Avg episode reward: [(0, '4668.852')] [2023-03-08 10:34:48,966][389688] Updated weights for policy 0, policy_version 5200 (0.0005) [2023-03-08 10:34:52,325][389688] Updated weights for policy 0, policy_version 5280 (0.0005) [2023-03-08 10:34:53,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 11538.5). Total num frames: 2711552. Throughput: 0: 11961.5. Samples: 2695232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:34:53,080][389401] Avg episode reward: [(0, '4699.797')] [2023-03-08 10:34:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000005296_2711552.pth... [2023-03-08 10:34:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000004600_2355200.pth [2023-03-08 10:34:55,763][389688] Updated weights for policy 0, policy_version 5360 (0.0004) [2023-03-08 10:34:58,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11537.1). Total num frames: 2768896. Throughput: 0: 11867.8. Samples: 2765640. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:34:58,080][389401] Avg episode reward: [(0, '4627.295')] [2023-03-08 10:34:59,296][389688] Updated weights for policy 0, policy_version 5440 (0.0005) [2023-03-08 10:35:02,750][389688] Updated weights for policy 0, policy_version 5520 (0.0005) [2023-03-08 10:35:03,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11535.7). Total num frames: 2826240. Throughput: 0: 11875.5. Samples: 2802124. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:35:03,080][389401] Avg episode reward: [(0, '4644.822')] [2023-03-08 10:35:06,431][389688] Updated weights for policy 0, policy_version 5600 (0.0005) [2023-03-08 10:35:08,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11534.3). Total num frames: 2883584. Throughput: 0: 11792.2. Samples: 2869992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:35:08,080][389401] Avg episode reward: [(0, '4654.620')] [2023-03-08 10:35:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000005632_2883584.pth... [2023-03-08 10:35:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000004936_2527232.pth [2023-03-08 10:35:09,809][389688] Updated weights for policy 0, policy_version 5680 (0.0005) [2023-03-08 10:35:13,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11549.1). Total num frames: 2945024. Throughput: 0: 11917.3. Samples: 2943848. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:35:13,080][389401] Avg episode reward: [(0, '4708.352')] [2023-03-08 10:35:13,080][389644] Saving new best policy, reward=4708.352! [2023-03-08 10:35:13,121][389688] Updated weights for policy 0, policy_version 5760 (0.0004) [2023-03-08 10:35:16,418][389688] Updated weights for policy 0, policy_version 5840 (0.0003) [2023-03-08 10:35:18,079][389401] Fps is (10 sec: 12697.6, 60 sec: 11946.7, 300 sec: 11579.1). Total num frames: 3010560. Throughput: 0: 11987.5. Samples: 2980716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:35:18,080][389401] Avg episode reward: [(0, '4727.470')] [2023-03-08 10:35:18,080][389644] Saving new best policy, reward=4727.470! [2023-03-08 10:35:19,704][389688] Updated weights for policy 0, policy_version 5920 (0.0004) [2023-03-08 10:35:22,935][389688] Updated weights for policy 0, policy_version 6000 (0.0005) [2023-03-08 10:35:23,079][389401] Fps is (10 sec: 12697.6, 60 sec: 11946.7, 300 sec: 11592.5). Total num frames: 3072000. Throughput: 0: 12098.7. Samples: 3055680. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:35:23,080][389401] Avg episode reward: [(0, '4700.618')] [2023-03-08 10:35:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000006000_3072000.pth... [2023-03-08 10:35:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000005296_2711552.pth [2023-03-08 10:35:26,181][389688] Updated weights for policy 0, policy_version 6080 (0.0004) [2023-03-08 10:35:28,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11605.3). Total num frames: 3133440. Throughput: 0: 12080.8. Samples: 3130472. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:35:28,080][389401] Avg episode reward: [(0, '4728.612')] [2023-03-08 10:35:28,081][389644] Saving new best policy, reward=4728.612! [2023-03-08 10:35:29,521][389688] Updated weights for policy 0, policy_version 6160 (0.0003) [2023-03-08 10:35:32,893][389688] Updated weights for policy 0, policy_version 6240 (0.0003) [2023-03-08 10:35:33,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11617.7). Total num frames: 3194880. Throughput: 0: 12116.8. Samples: 3167580. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:35:33,080][389401] Avg episode reward: [(0, '4684.102')] [2023-03-08 10:35:36,277][389688] Updated weights for policy 0, policy_version 6320 (0.0003) [2023-03-08 10:35:38,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11629.7). Total num frames: 3256320. Throughput: 0: 12106.8. Samples: 3240040. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:35:38,080][389401] Avg episode reward: [(0, '4690.114')] [2023-03-08 10:35:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000006360_3256320.pth... [2023-03-08 10:35:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000005632_2883584.pth [2023-03-08 10:35:39,788][389688] Updated weights for policy 0, policy_version 6400 (0.0004) [2023-03-08 10:35:43,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11626.9). Total num frames: 3313664. Throughput: 0: 12128.4. Samples: 3311420. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:35:43,080][389401] Avg episode reward: [(0, '4687.781')] [2023-03-08 10:35:43,167][389688] Updated weights for policy 0, policy_version 6480 (0.0004) [2023-03-08 10:35:46,500][389688] Updated weights for policy 0, policy_version 6560 (0.0004) [2023-03-08 10:35:48,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 11638.3). Total num frames: 3375104. Throughput: 0: 12138.5. Samples: 3348356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:35:48,080][389401] Avg episode reward: [(0, '4702.764')] [2023-03-08 10:35:49,797][389688] Updated weights for policy 0, policy_version 6640 (0.0004) [2023-03-08 10:35:53,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11649.3). Total num frames: 3436544. Throughput: 0: 12255.2. Samples: 3421476. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:35:53,080][389401] Avg episode reward: [(0, '4668.854')] [2023-03-08 10:35:53,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000006712_3436544.pth... [2023-03-08 10:35:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000006000_3072000.pth [2023-03-08 10:35:53,156][389688] Updated weights for policy 0, policy_version 6720 (0.0003) [2023-03-08 10:35:56,559][389688] Updated weights for policy 0, policy_version 6800 (0.0003) [2023-03-08 10:35:58,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11857.6). Total num frames: 3497984. Throughput: 0: 12224.5. Samples: 3493952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:35:58,080][389401] Avg episode reward: [(0, '4654.062')] [2023-03-08 10:36:00,084][389688] Updated weights for policy 0, policy_version 6880 (0.0003) [2023-03-08 10:36:03,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11968.7). Total num frames: 3555328. Throughput: 0: 12184.0. Samples: 3528996. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:36:03,080][389401] Avg episode reward: [(0, '4726.155')] [2023-03-08 10:36:03,636][389688] Updated weights for policy 0, policy_version 6960 (0.0004) [2023-03-08 10:36:07,140][389688] Updated weights for policy 0, policy_version 7040 (0.0004) [2023-03-08 10:36:08,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 11940.9). Total num frames: 3612672. Throughput: 0: 12071.5. Samples: 3598896. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:36:08,080][389401] Avg episode reward: [(0, '4726.114')] [2023-03-08 10:36:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000007056_3612672.pth... [2023-03-08 10:36:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000006360_3256320.pth [2023-03-08 10:36:10,759][389688] Updated weights for policy 0, policy_version 7120 (0.0005) [2023-03-08 10:36:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 11899.2). Total num frames: 3670016. Throughput: 0: 11949.0. Samples: 3668176. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:36:13,080][389401] Avg episode reward: [(0, '4711.200')] [2023-03-08 10:36:14,324][389688] Updated weights for policy 0, policy_version 7200 (0.0005) [2023-03-08 10:36:18,030][389688] Updated weights for policy 0, policy_version 7280 (0.0005) [2023-03-08 10:36:18,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11885.3). Total num frames: 3727360. Throughput: 0: 11859.4. Samples: 3701252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:36:18,080][389401] Avg episode reward: [(0, '4729.453')] [2023-03-08 10:36:18,080][389644] Saving new best policy, reward=4729.453! [2023-03-08 10:36:21,598][389688] Updated weights for policy 0, policy_version 7360 (0.0005) [2023-03-08 10:36:23,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11810.1, 300 sec: 11843.7). Total num frames: 3780608. Throughput: 0: 11746.9. Samples: 3768648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:36:23,080][389401] Avg episode reward: [(0, '4728.987')] [2023-03-08 10:36:23,116][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000007392_3784704.pth... [2023-03-08 10:36:23,118][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000006712_3436544.pth [2023-03-08 10:36:25,282][389688] Updated weights for policy 0, policy_version 7440 (0.0005) [2023-03-08 10:36:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11857.6). Total num frames: 3842048. Throughput: 0: 11692.4. Samples: 3837576. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:36:28,080][389401] Avg episode reward: [(0, '4486.814')] [2023-03-08 10:36:28,780][389688] Updated weights for policy 0, policy_version 7520 (0.0004) [2023-03-08 10:36:32,152][389688] Updated weights for policy 0, policy_version 7600 (0.0004) [2023-03-08 10:36:33,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11857.6). Total num frames: 3899392. Throughput: 0: 11653.4. Samples: 3872760. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:36:33,080][389401] Avg episode reward: [(0, '4509.058')] [2023-03-08 10:36:35,577][389688] Updated weights for policy 0, policy_version 7680 (0.0005) [2023-03-08 10:36:38,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11857.6). Total num frames: 3960832. Throughput: 0: 11634.1. Samples: 3945012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:36:38,080][389401] Avg episode reward: [(0, '4728.767')] [2023-03-08 10:36:38,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000007736_3960832.pth... [2023-03-08 10:36:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000007056_3612672.pth [2023-03-08 10:36:38,967][389688] Updated weights for policy 0, policy_version 7760 (0.0004) [2023-03-08 10:36:42,249][389688] Updated weights for policy 0, policy_version 7840 (0.0004) [2023-03-08 10:36:43,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 11871.5). Total num frames: 4022272. Throughput: 0: 11657.3. Samples: 4018528. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:36:43,080][389401] Avg episode reward: [(0, '4724.661')] [2023-03-08 10:36:45,642][389688] Updated weights for policy 0, policy_version 7920 (0.0003) [2023-03-08 10:36:48,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11741.9, 300 sec: 11871.5). Total num frames: 4079616. Throughput: 0: 11691.3. Samples: 4055104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:36:48,080][389401] Avg episode reward: [(0, '4731.890')] [2023-03-08 10:36:48,080][389644] Saving new best policy, reward=4731.890! [2023-03-08 10:36:49,161][389688] Updated weights for policy 0, policy_version 8000 (0.0003) [2023-03-08 10:36:52,636][389688] Updated weights for policy 0, policy_version 8080 (0.0003) [2023-03-08 10:36:53,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11741.9, 300 sec: 11885.3). Total num frames: 4141056. Throughput: 0: 11696.2. Samples: 4125224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:36:53,080][389401] Avg episode reward: [(0, '4723.383')] [2023-03-08 10:36:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000008088_4141056.pth... [2023-03-08 10:36:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000007392_3784704.pth [2023-03-08 10:36:56,006][389688] Updated weights for policy 0, policy_version 8160 (0.0004) [2023-03-08 10:36:58,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11899.2). Total num frames: 4202496. Throughput: 0: 11784.2. Samples: 4198464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:36:58,080][389401] Avg episode reward: [(0, '4729.406')] [2023-03-08 10:36:59,294][389688] Updated weights for policy 0, policy_version 8240 (0.0004) [2023-03-08 10:37:02,604][389688] Updated weights for policy 0, policy_version 8320 (0.0004) [2023-03-08 10:37:03,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11810.1, 300 sec: 11927.0). Total num frames: 4263936. Throughput: 0: 11868.7. Samples: 4235344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:37:03,080][389401] Avg episode reward: [(0, '4731.993')] [2023-03-08 10:37:03,080][389644] Saving new best policy, reward=4731.993! [2023-03-08 10:37:05,869][389688] Updated weights for policy 0, policy_version 8400 (0.0004) [2023-03-08 10:37:08,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11878.4, 300 sec: 11954.8). Total num frames: 4325376. Throughput: 0: 12039.4. Samples: 4310420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:37:08,080][389401] Avg episode reward: [(0, '4732.054')] [2023-03-08 10:37:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000008448_4325376.pth... [2023-03-08 10:37:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000007736_3960832.pth [2023-03-08 10:37:08,086][389644] Saving new best policy, reward=4732.054! [2023-03-08 10:37:09,218][389688] Updated weights for policy 0, policy_version 8480 (0.0005) [2023-03-08 10:37:12,413][389688] Updated weights for policy 0, policy_version 8560 (0.0004) [2023-03-08 10:37:13,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12014.9, 300 sec: 11982.5). Total num frames: 4390912. Throughput: 0: 12183.2. Samples: 4385820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:37:13,080][389401] Avg episode reward: [(0, '4728.930')] [2023-03-08 10:37:15,695][389688] Updated weights for policy 0, policy_version 8640 (0.0005) [2023-03-08 10:37:18,079][389401] Fps is (10 sec: 12697.4, 60 sec: 12083.2, 300 sec: 11996.4). Total num frames: 4452352. Throughput: 0: 12239.9. Samples: 4423556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:37:18,080][389401] Avg episode reward: [(0, '4732.885')] [2023-03-08 10:37:18,081][389644] Saving new best policy, reward=4732.885! [2023-03-08 10:37:19,031][389688] Updated weights for policy 0, policy_version 8720 (0.0005) [2023-03-08 10:37:22,292][389688] Updated weights for policy 0, policy_version 8800 (0.0004) [2023-03-08 10:37:23,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12219.7, 300 sec: 11996.4). Total num frames: 4513792. Throughput: 0: 12275.7. Samples: 4497416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:37:23,080][389401] Avg episode reward: [(0, '4729.199')] [2023-03-08 10:37:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000008816_4513792.pth... [2023-03-08 10:37:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000008088_4141056.pth [2023-03-08 10:37:25,764][389688] Updated weights for policy 0, policy_version 8880 (0.0005) [2023-03-08 10:37:28,079][389401] Fps is (10 sec: 11878.6, 60 sec: 12151.5, 300 sec: 11968.6). Total num frames: 4571136. Throughput: 0: 12190.6. Samples: 4567104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:37:28,080][389401] Avg episode reward: [(0, '4727.627')] [2023-03-08 10:37:29,471][389688] Updated weights for policy 0, policy_version 8960 (0.0005) [2023-03-08 10:37:32,927][389688] Updated weights for policy 0, policy_version 9040 (0.0005) [2023-03-08 10:37:33,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 11954.8). Total num frames: 4628480. Throughput: 0: 12138.0. Samples: 4601316. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:37:33,080][389401] Avg episode reward: [(0, '4672.900')] [2023-03-08 10:37:36,443][389688] Updated weights for policy 0, policy_version 9120 (0.0005) [2023-03-08 10:37:38,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 11940.9). Total num frames: 4685824. Throughput: 0: 12152.1. Samples: 4672068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:37:38,080][389401] Avg episode reward: [(0, '4534.459')] [2023-03-08 10:37:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000009152_4685824.pth... [2023-03-08 10:37:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000008448_4325376.pth [2023-03-08 10:37:39,980][389688] Updated weights for policy 0, policy_version 9200 (0.0005) [2023-03-08 10:37:43,079][389401] Fps is (10 sec: 11468.7, 60 sec: 12014.9, 300 sec: 11940.9). Total num frames: 4743168. Throughput: 0: 12084.9. Samples: 4742284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:37:43,080][389401] Avg episode reward: [(0, '4622.822')] [2023-03-08 10:37:43,492][389688] Updated weights for policy 0, policy_version 9280 (0.0005) [2023-03-08 10:37:46,848][389688] Updated weights for policy 0, policy_version 9360 (0.0005) [2023-03-08 10:37:48,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11954.8). Total num frames: 4804608. Throughput: 0: 12054.8. Samples: 4777808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:37:48,080][389401] Avg episode reward: [(0, '4688.502')] [2023-03-08 10:37:50,139][389688] Updated weights for policy 0, policy_version 9440 (0.0004) [2023-03-08 10:37:53,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11968.6). Total num frames: 4866048. Throughput: 0: 12030.8. Samples: 4851808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:37:53,080][389401] Avg episode reward: [(0, '4722.741')] [2023-03-08 10:37:53,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000009512_4870144.pth... [2023-03-08 10:37:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000008816_4513792.pth [2023-03-08 10:37:53,398][389688] Updated weights for policy 0, policy_version 9520 (0.0004) [2023-03-08 10:37:56,661][389688] Updated weights for policy 0, policy_version 9600 (0.0004) [2023-03-08 10:37:58,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 11996.4). Total num frames: 4931584. Throughput: 0: 12038.5. Samples: 4927552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:37:58,080][389401] Avg episode reward: [(0, '4727.748')] [2023-03-08 10:38:00,063][389688] Updated weights for policy 0, policy_version 9680 (0.0004) [2023-03-08 10:38:03,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12083.2, 300 sec: 11982.5). Total num frames: 4988928. Throughput: 0: 12000.5. Samples: 4963576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:38:03,080][389401] Avg episode reward: [(0, '4696.615')] [2023-03-08 10:38:03,587][389688] Updated weights for policy 0, policy_version 9760 (0.0005) [2023-03-08 10:38:07,027][389688] Updated weights for policy 0, policy_version 9840 (0.0005) [2023-03-08 10:38:08,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 11982.5). Total num frames: 5050368. Throughput: 0: 11923.8. Samples: 5033984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:38:08,080][389401] Avg episode reward: [(0, '4726.336')] [2023-03-08 10:38:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000009864_5050368.pth... [2023-03-08 10:38:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000009152_4685824.pth [2023-03-08 10:38:10,499][389688] Updated weights for policy 0, policy_version 9920 (0.0004) [2023-03-08 10:38:13,079][389401] Fps is (10 sec: 11878.6, 60 sec: 11946.7, 300 sec: 11968.7). Total num frames: 5107712. Throughput: 0: 11921.4. Samples: 5103564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:38:13,080][389401] Avg episode reward: [(0, '4730.934')] [2023-03-08 10:38:14,137][389688] Updated weights for policy 0, policy_version 10000 (0.0005) [2023-03-08 10:38:17,671][389688] Updated weights for policy 0, policy_version 10080 (0.0005) [2023-03-08 10:38:18,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11982.5). Total num frames: 5165056. Throughput: 0: 11911.6. Samples: 5137336. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:38:18,080][389401] Avg episode reward: [(0, '4710.533')] [2023-03-08 10:38:21,108][389688] Updated weights for policy 0, policy_version 10160 (0.0004) [2023-03-08 10:38:23,079][389401] Fps is (10 sec: 11468.6, 60 sec: 11810.1, 300 sec: 11968.6). Total num frames: 5222400. Throughput: 0: 11920.8. Samples: 5208504. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:38:23,080][389401] Avg episode reward: [(0, '4732.077')] [2023-03-08 10:38:23,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000010200_5222400.pth... [2023-03-08 10:38:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000009512_4870144.pth [2023-03-08 10:38:24,598][389688] Updated weights for policy 0, policy_version 10240 (0.0004) [2023-03-08 10:38:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11968.7). Total num frames: 5279744. Throughput: 0: 11912.6. Samples: 5278348. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:38:28,080][389401] Avg episode reward: [(0, '4716.881')] [2023-03-08 10:38:28,185][389688] Updated weights for policy 0, policy_version 10320 (0.0005) [2023-03-08 10:38:31,756][389688] Updated weights for policy 0, policy_version 10400 (0.0005) [2023-03-08 10:38:33,079][389401] Fps is (10 sec: 11469.0, 60 sec: 11810.2, 300 sec: 11954.8). Total num frames: 5337088. Throughput: 0: 11878.5. Samples: 5312340. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:38:33,080][389401] Avg episode reward: [(0, '4693.015')] [2023-03-08 10:38:35,356][389688] Updated weights for policy 0, policy_version 10480 (0.0005) [2023-03-08 10:38:38,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 11940.9). Total num frames: 5394432. Throughput: 0: 11759.2. Samples: 5380972. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:38:38,080][389401] Avg episode reward: [(0, '4529.675')] [2023-03-08 10:38:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000010536_5394432.pth... [2023-03-08 10:38:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000009864_5050368.pth [2023-03-08 10:38:38,929][389688] Updated weights for policy 0, policy_version 10560 (0.0005) [2023-03-08 10:38:42,599][389688] Updated weights for policy 0, policy_version 10640 (0.0004) [2023-03-08 10:38:43,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11810.2, 300 sec: 11913.1). Total num frames: 5451776. Throughput: 0: 11565.4. Samples: 5447996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:38:43,080][389401] Avg episode reward: [(0, '4576.279')] [2023-03-08 10:38:46,177][389688] Updated weights for policy 0, policy_version 10720 (0.0005) [2023-03-08 10:38:48,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11913.1). Total num frames: 5509120. Throughput: 0: 11545.4. Samples: 5483120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:38:48,080][389401] Avg episode reward: [(0, '4713.255')] [2023-03-08 10:38:49,636][389688] Updated weights for policy 0, policy_version 10800 (0.0005) [2023-03-08 10:38:53,050][389688] Updated weights for policy 0, policy_version 10880 (0.0004) [2023-03-08 10:38:53,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11927.0). Total num frames: 5570560. Throughput: 0: 11559.2. Samples: 5554148. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:38:53,080][389401] Avg episode reward: [(0, '4689.092')] [2023-03-08 10:38:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000010880_5570560.pth... [2023-03-08 10:38:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000010200_5222400.pth [2023-03-08 10:38:56,654][389688] Updated weights for policy 0, policy_version 10960 (0.0005) [2023-03-08 10:38:58,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11927.0). Total num frames: 5627904. Throughput: 0: 11559.9. Samples: 5623760. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:38:58,080][389401] Avg episode reward: [(0, '4724.653')] [2023-03-08 10:39:00,080][389688] Updated weights for policy 0, policy_version 11040 (0.0005) [2023-03-08 10:39:03,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11913.1). Total num frames: 5685248. Throughput: 0: 11595.1. Samples: 5659116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:39:03,080][389401] Avg episode reward: [(0, '4727.981')] [2023-03-08 10:39:03,799][389688] Updated weights for policy 0, policy_version 11120 (0.0005) [2023-03-08 10:39:07,429][389688] Updated weights for policy 0, policy_version 11200 (0.0005) [2023-03-08 10:39:08,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11468.8, 300 sec: 11885.3). Total num frames: 5738496. Throughput: 0: 11495.5. Samples: 5725800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:39:08,080][389401] Avg episode reward: [(0, '4722.395')] [2023-03-08 10:39:08,095][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000011216_5742592.pth... [2023-03-08 10:39:08,098][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000010536_5394432.pth [2023-03-08 10:39:10,875][389688] Updated weights for policy 0, policy_version 11280 (0.0005) [2023-03-08 10:39:13,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11537.0, 300 sec: 11885.3). Total num frames: 5799936. Throughput: 0: 11494.8. Samples: 5795616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:39:13,080][389401] Avg episode reward: [(0, '4719.232')] [2023-03-08 10:39:14,387][389688] Updated weights for policy 0, policy_version 11360 (0.0005) [2023-03-08 10:39:18,059][389688] Updated weights for policy 0, policy_version 11440 (0.0005) [2023-03-08 10:39:18,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11537.1, 300 sec: 11871.5). Total num frames: 5857280. Throughput: 0: 11508.8. Samples: 5830236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:39:18,080][389401] Avg episode reward: [(0, '4692.550')] [2023-03-08 10:39:21,692][389688] Updated weights for policy 0, policy_version 11520 (0.0005) [2023-03-08 10:39:23,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11468.8, 300 sec: 11871.5). Total num frames: 5910528. Throughput: 0: 11494.9. Samples: 5898240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:39:23,080][389401] Avg episode reward: [(0, '4718.834')] [2023-03-08 10:39:23,126][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000011552_5914624.pth... [2023-03-08 10:39:23,127][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000010880_5570560.pth [2023-03-08 10:39:25,224][389688] Updated weights for policy 0, policy_version 11600 (0.0005) [2023-03-08 10:39:28,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11468.8, 300 sec: 11871.5). Total num frames: 5967872. Throughput: 0: 11528.0. Samples: 5966756. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:39:28,080][389401] Avg episode reward: [(0, '4698.541')] [2023-03-08 10:39:28,915][389688] Updated weights for policy 0, policy_version 11680 (0.0004) [2023-03-08 10:39:32,583][389688] Updated weights for policy 0, policy_version 11760 (0.0004) [2023-03-08 10:39:33,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11857.6). Total num frames: 6025216. Throughput: 0: 11496.2. Samples: 6000452. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:39:33,080][389401] Avg episode reward: [(0, '4729.818')] [2023-03-08 10:39:36,176][389688] Updated weights for policy 0, policy_version 11840 (0.0005) [2023-03-08 10:39:38,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11843.7). Total num frames: 6082560. Throughput: 0: 11416.1. Samples: 6067872. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:39:38,080][389401] Avg episode reward: [(0, '4689.255')] [2023-03-08 10:39:38,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000011880_6082560.pth... [2023-03-08 10:39:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000011216_5742592.pth [2023-03-08 10:39:39,749][389688] Updated weights for policy 0, policy_version 11920 (0.0004) [2023-03-08 10:39:43,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11829.8). Total num frames: 6139904. Throughput: 0: 11388.3. Samples: 6136232. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:39:43,080][389401] Avg episode reward: [(0, '4711.505')] [2023-03-08 10:39:43,299][389688] Updated weights for policy 0, policy_version 12000 (0.0005) [2023-03-08 10:39:46,949][389688] Updated weights for policy 0, policy_version 12080 (0.0005) [2023-03-08 10:39:48,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11815.9). Total num frames: 6197248. Throughput: 0: 11379.9. Samples: 6171212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:39:48,080][389401] Avg episode reward: [(0, '4681.226')] [2023-03-08 10:39:50,587][389688] Updated weights for policy 0, policy_version 12160 (0.0005) [2023-03-08 10:39:53,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11815.9). Total num frames: 6254592. Throughput: 0: 11388.3. Samples: 6238272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:39:53,080][389401] Avg episode reward: [(0, '4630.978')] [2023-03-08 10:39:53,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000012216_6254592.pth... [2023-03-08 10:39:53,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000011552_5914624.pth [2023-03-08 10:39:54,202][389688] Updated weights for policy 0, policy_version 12240 (0.0005) [2023-03-08 10:39:57,870][389688] Updated weights for policy 0, policy_version 12320 (0.0005) [2023-03-08 10:39:58,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 11802.0). Total num frames: 6307840. Throughput: 0: 11342.3. Samples: 6306020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:39:58,080][389401] Avg episode reward: [(0, '4547.903')] [2023-03-08 10:40:01,204][389688] Updated weights for policy 0, policy_version 12400 (0.0004) [2023-03-08 10:40:03,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11815.9). Total num frames: 6369280. Throughput: 0: 11368.0. Samples: 6341796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:40:03,080][389401] Avg episode reward: [(0, '4639.320')] [2023-03-08 10:40:04,513][389688] Updated weights for policy 0, policy_version 12480 (0.0004) [2023-03-08 10:40:07,974][389688] Updated weights for policy 0, policy_version 12560 (0.0004) [2023-03-08 10:40:08,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11537.1, 300 sec: 11815.9). Total num frames: 6430720. Throughput: 0: 11497.9. Samples: 6415644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:40:08,080][389401] Avg episode reward: [(0, '4459.297')] [2023-03-08 10:40:08,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000012560_6430720.pth... [2023-03-08 10:40:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000011880_6082560.pth [2023-03-08 10:40:11,491][389688] Updated weights for policy 0, policy_version 12640 (0.0004) [2023-03-08 10:40:13,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 11788.2). Total num frames: 6488064. Throughput: 0: 11530.7. Samples: 6485636. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:40:13,080][389401] Avg episode reward: [(0, '4613.474')] [2023-03-08 10:40:14,926][389688] Updated weights for policy 0, policy_version 12720 (0.0003) [2023-03-08 10:40:18,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11774.3). Total num frames: 6545408. Throughput: 0: 11564.2. Samples: 6520840. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:40:18,090][389401] Avg episode reward: [(0, '4696.580')] [2023-03-08 10:40:18,596][389688] Updated weights for policy 0, policy_version 12800 (0.0005) [2023-03-08 10:40:22,456][389688] Updated weights for policy 0, policy_version 12880 (0.0005) [2023-03-08 10:40:23,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11468.8, 300 sec: 11746.5). Total num frames: 6598656. Throughput: 0: 11522.1. Samples: 6586368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:40:23,090][389401] Avg episode reward: [(0, '4511.212')] [2023-03-08 10:40:23,094][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000012888_6598656.pth... [2023-03-08 10:40:23,096][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000012216_6254592.pth [2023-03-08 10:40:26,234][389688] Updated weights for policy 0, policy_version 12960 (0.0005) [2023-03-08 10:40:28,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11468.8, 300 sec: 11732.6). Total num frames: 6656000. Throughput: 0: 11460.8. Samples: 6651968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:40:28,090][389401] Avg episode reward: [(0, '4447.642')] [2023-03-08 10:40:29,663][389688] Updated weights for policy 0, policy_version 13040 (0.0005) [2023-03-08 10:40:33,006][389688] Updated weights for policy 0, policy_version 13120 (0.0003) [2023-03-08 10:40:33,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 6717440. Throughput: 0: 11502.7. Samples: 6688832. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:40:33,090][389401] Avg episode reward: [(0, '4649.900')] [2023-03-08 10:40:36,525][389688] Updated weights for policy 0, policy_version 13200 (0.0003) [2023-03-08 10:40:38,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 6774784. Throughput: 0: 11586.2. Samples: 6759652. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:40:38,090][389401] Avg episode reward: [(0, '4603.027')] [2023-03-08 10:40:38,093][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000013232_6774784.pth... [2023-03-08 10:40:38,096][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000012560_6430720.pth [2023-03-08 10:40:39,867][389688] Updated weights for policy 0, policy_version 13280 (0.0003) [2023-03-08 10:40:43,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11732.6). Total num frames: 6836224. Throughput: 0: 11690.9. Samples: 6832108. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:40:43,080][389401] Avg episode reward: [(0, '4713.704')] [2023-03-08 10:40:43,361][389688] Updated weights for policy 0, policy_version 13360 (0.0003) [2023-03-08 10:40:46,707][389688] Updated weights for policy 0, policy_version 13440 (0.0003) [2023-03-08 10:40:48,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11718.7). Total num frames: 6893568. Throughput: 0: 11699.3. Samples: 6868264. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:40:48,080][389401] Avg episode reward: [(0, '4726.402')] [2023-03-08 10:40:50,085][389688] Updated weights for policy 0, policy_version 13520 (0.0003) [2023-03-08 10:40:53,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11718.7). Total num frames: 6955008. Throughput: 0: 11683.3. Samples: 6941392. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:40:53,080][389401] Avg episode reward: [(0, '4684.529')] [2023-03-08 10:40:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000013584_6955008.pth... [2023-03-08 10:40:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000012888_6598656.pth [2023-03-08 10:40:53,552][389688] Updated weights for policy 0, policy_version 13600 (0.0003) [2023-03-08 10:40:56,991][389688] Updated weights for policy 0, policy_version 13680 (0.0003) [2023-03-08 10:40:58,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11810.1, 300 sec: 11732.6). Total num frames: 7016448. Throughput: 0: 11706.2. Samples: 7012416. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:40:58,080][389401] Avg episode reward: [(0, '4684.410')] [2023-03-08 10:41:00,287][389688] Updated weights for policy 0, policy_version 13760 (0.0003) [2023-03-08 10:41:03,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 11746.5). Total num frames: 7077888. Throughput: 0: 11746.3. Samples: 7049424. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:41:03,080][389401] Avg episode reward: [(0, '4723.812')] [2023-03-08 10:41:03,628][389688] Updated weights for policy 0, policy_version 13840 (0.0003) [2023-03-08 10:41:07,008][389688] Updated weights for policy 0, policy_version 13920 (0.0003) [2023-03-08 10:41:08,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 11760.4). Total num frames: 7139328. Throughput: 0: 11925.3. Samples: 7123008. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:41:08,080][389401] Avg episode reward: [(0, '4726.128')] [2023-03-08 10:41:08,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000013944_7139328.pth... [2023-03-08 10:41:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000013232_6774784.pth [2023-03-08 10:41:10,547][389688] Updated weights for policy 0, policy_version 14000 (0.0004) [2023-03-08 10:41:13,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11760.4). Total num frames: 7196672. Throughput: 0: 12062.4. Samples: 7194776. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:41:13,080][389401] Avg episode reward: [(0, '4730.454')] [2023-03-08 10:41:13,844][389688] Updated weights for policy 0, policy_version 14080 (0.0003) [2023-03-08 10:41:17,149][389688] Updated weights for policy 0, policy_version 14160 (0.0003) [2023-03-08 10:41:18,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 11788.2). Total num frames: 7258112. Throughput: 0: 12048.8. Samples: 7231028. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:41:18,090][389401] Avg episode reward: [(0, '4727.844')] [2023-03-08 10:41:20,484][389688] Updated weights for policy 0, policy_version 14240 (0.0004) [2023-03-08 10:41:23,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12014.9, 300 sec: 11788.1). Total num frames: 7319552. Throughput: 0: 12121.5. Samples: 7305120. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:41:23,090][389401] Avg episode reward: [(0, '4726.789')] [2023-03-08 10:41:23,093][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000014296_7319552.pth... [2023-03-08 10:41:23,096][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000013584_6955008.pth [2023-03-08 10:41:23,911][389688] Updated weights for policy 0, policy_version 14320 (0.0005) [2023-03-08 10:41:27,497][389688] Updated weights for policy 0, policy_version 14400 (0.0005) [2023-03-08 10:41:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11788.2). Total num frames: 7376896. Throughput: 0: 12057.9. Samples: 7374712. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:41:28,090][389401] Avg episode reward: [(0, '4698.534')] [2023-03-08 10:41:31,076][389688] Updated weights for policy 0, policy_version 14480 (0.0005) [2023-03-08 10:41:33,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11774.3). Total num frames: 7434240. Throughput: 0: 12024.3. Samples: 7409360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:41:33,090][389401] Avg episode reward: [(0, '4730.995')] [2023-03-08 10:41:34,715][389688] Updated weights for policy 0, policy_version 14560 (0.0005) [2023-03-08 10:41:38,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11946.7, 300 sec: 11760.4). Total num frames: 7491584. Throughput: 0: 11920.0. Samples: 7477792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:41:38,090][389401] Avg episode reward: [(0, '4727.342')] [2023-03-08 10:41:38,093][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000014632_7491584.pth... [2023-03-08 10:41:38,096][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000013944_7139328.pth [2023-03-08 10:41:38,153][389688] Updated weights for policy 0, policy_version 14640 (0.0005) [2023-03-08 10:41:41,491][389688] Updated weights for policy 0, policy_version 14720 (0.0005) [2023-03-08 10:41:43,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 11774.3). Total num frames: 7553024. Throughput: 0: 11988.1. Samples: 7551880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:41:43,090][389401] Avg episode reward: [(0, '4725.717')] [2023-03-08 10:41:44,716][389688] Updated weights for policy 0, policy_version 14800 (0.0004) [2023-03-08 10:41:47,982][389688] Updated weights for policy 0, policy_version 14880 (0.0004) [2023-03-08 10:41:48,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12083.2, 300 sec: 11788.2). Total num frames: 7618560. Throughput: 0: 12005.9. Samples: 7589692. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:41:48,090][389401] Avg episode reward: [(0, '4696.462')] [2023-03-08 10:41:51,296][389688] Updated weights for policy 0, policy_version 14960 (0.0004) [2023-03-08 10:41:53,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12083.2, 300 sec: 11788.1). Total num frames: 7680000. Throughput: 0: 12015.6. Samples: 7663712. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:41:53,080][389401] Avg episode reward: [(0, '4729.246')] [2023-03-08 10:41:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000015000_7680000.pth... [2023-03-08 10:41:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000014296_7319552.pth [2023-03-08 10:41:54,602][389688] Updated weights for policy 0, policy_version 15040 (0.0005) [2023-03-08 10:41:57,935][389688] Updated weights for policy 0, policy_version 15120 (0.0004) [2023-03-08 10:41:58,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11788.2). Total num frames: 7741440. Throughput: 0: 12059.7. Samples: 7737464. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:41:58,080][389401] Avg episode reward: [(0, '4722.017')] [2023-03-08 10:42:01,207][389688] Updated weights for policy 0, policy_version 15200 (0.0004) [2023-03-08 10:42:03,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11788.2). Total num frames: 7802880. Throughput: 0: 12094.7. Samples: 7775292. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:42:03,080][389401] Avg episode reward: [(0, '4719.024')] [2023-03-08 10:42:04,590][389688] Updated weights for policy 0, policy_version 15280 (0.0005) [2023-03-08 10:42:07,994][389688] Updated weights for policy 0, policy_version 15360 (0.0005) [2023-03-08 10:42:08,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11774.3). Total num frames: 7864320. Throughput: 0: 12064.0. Samples: 7848000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:42:08,080][389401] Avg episode reward: [(0, '4723.062')] [2023-03-08 10:42:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000015360_7864320.pth... [2023-03-08 10:42:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000014632_7491584.pth [2023-03-08 10:42:11,329][389688] Updated weights for policy 0, policy_version 15440 (0.0004) [2023-03-08 10:42:13,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 11760.4). Total num frames: 7921664. Throughput: 0: 12143.4. Samples: 7921164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:42:13,080][389401] Avg episode reward: [(0, '4725.063')] [2023-03-08 10:42:14,774][389688] Updated weights for policy 0, policy_version 15520 (0.0005) [2023-03-08 10:42:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11760.4). Total num frames: 7983104. Throughput: 0: 12152.0. Samples: 7956200. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:42:18,080][389401] Avg episode reward: [(0, '4726.586')] [2023-03-08 10:42:18,215][389688] Updated weights for policy 0, policy_version 15600 (0.0004) [2023-03-08 10:42:21,721][389688] Updated weights for policy 0, policy_version 15680 (0.0005) [2023-03-08 10:42:23,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12014.9, 300 sec: 11760.4). Total num frames: 8040448. Throughput: 0: 12218.5. Samples: 8027624. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:42:23,080][389401] Avg episode reward: [(0, '4709.563')] [2023-03-08 10:42:23,085][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000015712_8044544.pth... [2023-03-08 10:42:23,087][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000015000_7680000.pth [2023-03-08 10:42:25,215][389688] Updated weights for policy 0, policy_version 15760 (0.0004) [2023-03-08 10:42:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11760.4). Total num frames: 8097792. Throughput: 0: 12101.4. Samples: 8096444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:42:28,080][389401] Avg episode reward: [(0, '4565.523')] [2023-03-08 10:42:28,902][389688] Updated weights for policy 0, policy_version 15840 (0.0005) [2023-03-08 10:42:32,678][389688] Updated weights for policy 0, policy_version 15920 (0.0005) [2023-03-08 10:42:33,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11760.4). Total num frames: 8155136. Throughput: 0: 11985.3. Samples: 8129032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:42:33,080][389401] Avg episode reward: [(0, '4312.260')] [2023-03-08 10:42:36,467][389688] Updated weights for policy 0, policy_version 16000 (0.0005) [2023-03-08 10:42:38,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11946.7, 300 sec: 11746.5). Total num frames: 8208384. Throughput: 0: 11791.4. Samples: 8194324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:42:38,080][389401] Avg episode reward: [(0, '4234.355')] [2023-03-08 10:42:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000016032_8208384.pth... [2023-03-08 10:42:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000015360_7864320.pth [2023-03-08 10:42:40,277][389688] Updated weights for policy 0, policy_version 16080 (0.0005) [2023-03-08 10:42:43,079][389401] Fps is (10 sec: 10649.6, 60 sec: 11810.1, 300 sec: 11718.7). Total num frames: 8261632. Throughput: 0: 11597.9. Samples: 8259368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:42:43,080][389401] Avg episode reward: [(0, '4659.654')] [2023-03-08 10:42:43,951][389688] Updated weights for policy 0, policy_version 16160 (0.0005) [2023-03-08 10:42:47,779][389688] Updated weights for policy 0, policy_version 16240 (0.0005) [2023-03-08 10:42:48,079][389401] Fps is (10 sec: 10649.7, 60 sec: 11605.3, 300 sec: 11691.0). Total num frames: 8314880. Throughput: 0: 11507.2. Samples: 8293116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:42:48,080][389401] Avg episode reward: [(0, '4708.726')] [2023-03-08 10:42:51,260][389688] Updated weights for policy 0, policy_version 16320 (0.0004) [2023-03-08 10:42:53,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11677.1). Total num frames: 8376320. Throughput: 0: 11377.9. Samples: 8360008. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:42:53,080][389401] Avg episode reward: [(0, '4577.009')] [2023-03-08 10:42:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000016360_8376320.pth... [2023-03-08 10:42:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000015712_8044544.pth [2023-03-08 10:42:54,733][389688] Updated weights for policy 0, policy_version 16400 (0.0005) [2023-03-08 10:42:58,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11663.2). Total num frames: 8429568. Throughput: 0: 11273.4. Samples: 8428464. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:42:58,080][389401] Avg episode reward: [(0, '4631.120')] [2023-03-08 10:42:58,523][389688] Updated weights for policy 0, policy_version 16480 (0.0005) [2023-03-08 10:43:02,295][389688] Updated weights for policy 0, policy_version 16560 (0.0005) [2023-03-08 10:43:03,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11400.5, 300 sec: 11649.3). Total num frames: 8486912. Throughput: 0: 11232.5. Samples: 8461664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:43:03,080][389401] Avg episode reward: [(0, '4486.584')] [2023-03-08 10:43:06,135][389688] Updated weights for policy 0, policy_version 16640 (0.0005) [2023-03-08 10:43:08,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11264.0, 300 sec: 11635.4). Total num frames: 8540160. Throughput: 0: 11054.8. Samples: 8525092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:43:08,080][389401] Avg episode reward: [(0, '4666.506')] [2023-03-08 10:43:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000016680_8540160.pth... [2023-03-08 10:43:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000016032_8208384.pth [2023-03-08 10:43:09,887][389688] Updated weights for policy 0, policy_version 16720 (0.0005) [2023-03-08 10:43:13,079][389401] Fps is (10 sec: 10649.5, 60 sec: 11195.7, 300 sec: 11621.5). Total num frames: 8593408. Throughput: 0: 10994.2. Samples: 8591184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:43:13,080][389401] Avg episode reward: [(0, '4724.649')] [2023-03-08 10:43:13,622][389688] Updated weights for policy 0, policy_version 16800 (0.0005) [2023-03-08 10:43:17,323][389688] Updated weights for policy 0, policy_version 16880 (0.0005) [2023-03-08 10:43:18,079][389401] Fps is (10 sec: 10649.7, 60 sec: 11059.2, 300 sec: 11607.6). Total num frames: 8646656. Throughput: 0: 11001.8. Samples: 8624112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:43:18,080][389401] Avg episode reward: [(0, '4726.915')] [2023-03-08 10:43:21,103][389688] Updated weights for policy 0, policy_version 16960 (0.0004) [2023-03-08 10:43:23,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11059.2, 300 sec: 11607.6). Total num frames: 8704000. Throughput: 0: 11012.2. Samples: 8689872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:43:23,080][389401] Avg episode reward: [(0, '4724.557')] [2023-03-08 10:43:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000017000_8704000.pth... [2023-03-08 10:43:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000016360_8376320.pth [2023-03-08 10:43:24,763][389688] Updated weights for policy 0, policy_version 17040 (0.0005) [2023-03-08 10:43:28,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 11593.8). Total num frames: 8757248. Throughput: 0: 11043.2. Samples: 8756312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:43:28,090][389401] Avg episode reward: [(0, '4697.785')] [2023-03-08 10:43:28,522][389688] Updated weights for policy 0, policy_version 17120 (0.0005) [2023-03-08 10:43:32,216][389688] Updated weights for policy 0, policy_version 17200 (0.0005) [2023-03-08 10:43:33,079][389401] Fps is (10 sec: 11059.3, 60 sec: 10990.9, 300 sec: 11593.8). Total num frames: 8814592. Throughput: 0: 11031.4. Samples: 8789528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:43:33,090][389401] Avg episode reward: [(0, '4654.796')] [2023-03-08 10:43:35,967][389688] Updated weights for policy 0, policy_version 17280 (0.0005) [2023-03-08 10:43:38,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 11579.9). Total num frames: 8867840. Throughput: 0: 11009.9. Samples: 8855452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:43:38,090][389401] Avg episode reward: [(0, '4713.309')] [2023-03-08 10:43:38,094][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000017320_8867840.pth... [2023-03-08 10:43:38,097][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000016680_8540160.pth [2023-03-08 10:43:39,680][389688] Updated weights for policy 0, policy_version 17360 (0.0005) [2023-03-08 10:43:43,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11059.2, 300 sec: 11579.9). Total num frames: 8925184. Throughput: 0: 10947.3. Samples: 8921096. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:43:43,080][389401] Avg episode reward: [(0, '4714.723')] [2023-03-08 10:43:43,430][389688] Updated weights for policy 0, policy_version 17440 (0.0005) [2023-03-08 10:43:47,102][389688] Updated weights for policy 0, policy_version 17520 (0.0005) [2023-03-08 10:43:48,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11059.2, 300 sec: 11552.1). Total num frames: 8978432. Throughput: 0: 10939.2. Samples: 8953928. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:43:48,080][389401] Avg episode reward: [(0, '4672.604')] [2023-03-08 10:43:50,775][389688] Updated weights for policy 0, policy_version 17600 (0.0005) [2023-03-08 10:43:53,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 11552.1). Total num frames: 9035776. Throughput: 0: 11021.0. Samples: 9021036. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:43:53,080][389401] Avg episode reward: [(0, '4695.196')] [2023-03-08 10:43:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000017648_9035776.pth... [2023-03-08 10:43:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000017000_8704000.pth [2023-03-08 10:43:54,483][389688] Updated weights for policy 0, policy_version 17680 (0.0005) [2023-03-08 10:43:58,079][389401] Fps is (10 sec: 11059.1, 60 sec: 10990.9, 300 sec: 11538.2). Total num frames: 9089024. Throughput: 0: 11040.5. Samples: 9088004. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:43:58,080][389401] Avg episode reward: [(0, '4549.308')] [2023-03-08 10:43:58,183][389688] Updated weights for policy 0, policy_version 17760 (0.0005) [2023-03-08 10:44:01,997][389688] Updated weights for policy 0, policy_version 17840 (0.0005) [2023-03-08 10:44:03,079][389401] Fps is (10 sec: 10649.7, 60 sec: 10922.7, 300 sec: 11538.2). Total num frames: 9142272. Throughput: 0: 11016.2. Samples: 9119840. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:44:03,080][389401] Avg episode reward: [(0, '4475.935')] [2023-03-08 10:44:05,760][389688] Updated weights for policy 0, policy_version 17920 (0.0005) [2023-03-08 10:44:08,079][389401] Fps is (10 sec: 11059.1, 60 sec: 10990.9, 300 sec: 11524.3). Total num frames: 9199616. Throughput: 0: 10990.1. Samples: 9184428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:44:08,080][389401] Avg episode reward: [(0, '4596.823')] [2023-03-08 10:44:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000017968_9199616.pth... [2023-03-08 10:44:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000017320_8867840.pth [2023-03-08 10:44:09,542][389688] Updated weights for policy 0, policy_version 18000 (0.0005) [2023-03-08 10:44:13,079][389401] Fps is (10 sec: 11059.1, 60 sec: 10990.9, 300 sec: 11510.5). Total num frames: 9252864. Throughput: 0: 10943.6. Samples: 9248776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:44:13,090][389401] Avg episode reward: [(0, '4708.238')] [2023-03-08 10:44:13,415][389688] Updated weights for policy 0, policy_version 18080 (0.0005) [2023-03-08 10:44:17,208][389688] Updated weights for policy 0, policy_version 18160 (0.0005) [2023-03-08 10:44:18,079][389401] Fps is (10 sec: 10649.8, 60 sec: 10991.0, 300 sec: 11510.5). Total num frames: 9306112. Throughput: 0: 10933.5. Samples: 9281536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:44:18,080][389401] Avg episode reward: [(0, '4708.509')] [2023-03-08 10:44:20,959][389688] Updated weights for policy 0, policy_version 18240 (0.0005) [2023-03-08 10:44:23,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10922.7, 300 sec: 11496.6). Total num frames: 9359360. Throughput: 0: 10920.4. Samples: 9346872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:44:23,080][389401] Avg episode reward: [(0, '4706.526')] [2023-03-08 10:44:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000018280_9359360.pth... [2023-03-08 10:44:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000017648_9035776.pth [2023-03-08 10:44:24,730][389688] Updated weights for policy 0, policy_version 18320 (0.0005) [2023-03-08 10:44:28,079][389401] Fps is (10 sec: 11059.0, 60 sec: 10990.9, 300 sec: 11496.6). Total num frames: 9416704. Throughput: 0: 10922.5. Samples: 9412608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:44:28,080][389401] Avg episode reward: [(0, '4701.164')] [2023-03-08 10:44:28,412][389688] Updated weights for policy 0, policy_version 18400 (0.0005) [2023-03-08 10:44:32,071][389688] Updated weights for policy 0, policy_version 18480 (0.0005) [2023-03-08 10:44:33,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 11482.7). Total num frames: 9469952. Throughput: 0: 10922.6. Samples: 9445448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:44:33,080][389401] Avg episode reward: [(0, '4664.895')] [2023-03-08 10:44:35,724][389688] Updated weights for policy 0, policy_version 18560 (0.0005) [2023-03-08 10:44:38,079][389401] Fps is (10 sec: 11059.1, 60 sec: 10990.9, 300 sec: 11482.7). Total num frames: 9527296. Throughput: 0: 10929.9. Samples: 9512880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:44:38,080][389401] Avg episode reward: [(0, '4691.818')] [2023-03-08 10:44:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000018608_9527296.pth... [2023-03-08 10:44:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000017968_9199616.pth [2023-03-08 10:44:39,522][389688] Updated weights for policy 0, policy_version 18640 (0.0005) [2023-03-08 10:44:43,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 11468.8). Total num frames: 9580544. Throughput: 0: 10881.8. Samples: 9577684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:44:43,080][389401] Avg episode reward: [(0, '4692.974')] [2023-03-08 10:44:43,288][389688] Updated weights for policy 0, policy_version 18720 (0.0005) [2023-03-08 10:44:47,109][389688] Updated weights for policy 0, policy_version 18800 (0.0005) [2023-03-08 10:44:48,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10922.7, 300 sec: 11454.9). Total num frames: 9633792. Throughput: 0: 10885.7. Samples: 9609696. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:44:48,080][389401] Avg episode reward: [(0, '4696.501')] [2023-03-08 10:44:50,942][389688] Updated weights for policy 0, policy_version 18880 (0.0005) [2023-03-08 10:44:53,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10854.4, 300 sec: 11454.9). Total num frames: 9687040. Throughput: 0: 10896.1. Samples: 9674752. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:44:53,080][389401] Avg episode reward: [(0, '4577.977')] [2023-03-08 10:44:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000018920_9687040.pth... [2023-03-08 10:44:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000018280_9359360.pth [2023-03-08 10:44:54,727][389688] Updated weights for policy 0, policy_version 18960 (0.0005) [2023-03-08 10:44:58,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 11441.0). Total num frames: 9744384. Throughput: 0: 10922.7. Samples: 9740296. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:44:58,080][389401] Avg episode reward: [(0, '4604.578')] [2023-03-08 10:44:58,427][389688] Updated weights for policy 0, policy_version 19040 (0.0005) [2023-03-08 10:45:02,243][389688] Updated weights for policy 0, policy_version 19120 (0.0005) [2023-03-08 10:45:03,079][389401] Fps is (10 sec: 11059.3, 60 sec: 10922.7, 300 sec: 11413.3). Total num frames: 9797632. Throughput: 0: 10922.6. Samples: 9773056. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:45:03,080][389401] Avg episode reward: [(0, '4709.586')] [2023-03-08 10:45:06,033][389688] Updated weights for policy 0, policy_version 19200 (0.0004) [2023-03-08 10:45:08,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10854.4, 300 sec: 11399.4). Total num frames: 9850880. Throughput: 0: 10891.5. Samples: 9836988. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:45:08,080][389401] Avg episode reward: [(0, '4433.969')] [2023-03-08 10:45:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000019240_9850880.pth... [2023-03-08 10:45:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000018608_9527296.pth [2023-03-08 10:45:09,880][389688] Updated weights for policy 0, policy_version 19280 (0.0005) [2023-03-08 10:45:13,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10854.4, 300 sec: 11385.5). Total num frames: 9904128. Throughput: 0: 10836.8. Samples: 9900264. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:45:13,080][389401] Avg episode reward: [(0, '4660.297')] [2023-03-08 10:45:13,778][389688] Updated weights for policy 0, policy_version 19360 (0.0005) [2023-03-08 10:45:17,511][389688] Updated weights for policy 0, policy_version 19440 (0.0005) [2023-03-08 10:45:18,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10854.4, 300 sec: 11385.5). Total num frames: 9957376. Throughput: 0: 10831.7. Samples: 9932872. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:45:18,080][389401] Avg episode reward: [(0, '4626.120')] [2023-03-08 10:45:21,241][389688] Updated weights for policy 0, policy_version 19520 (0.0005) [2023-03-08 10:45:23,079][389401] Fps is (10 sec: 10649.5, 60 sec: 10854.4, 300 sec: 11371.6). Total num frames: 10010624. Throughput: 0: 10796.0. Samples: 9998700. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:45:23,080][389401] Avg episode reward: [(0, '4545.610')] [2023-03-08 10:45:23,100][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000019560_10014720.pth... [2023-03-08 10:45:23,102][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000018920_9687040.pth [2023-03-08 10:45:24,917][389688] Updated weights for policy 0, policy_version 19600 (0.0005) [2023-03-08 10:45:28,079][389401] Fps is (10 sec: 11059.1, 60 sec: 10854.4, 300 sec: 11357.7). Total num frames: 10067968. Throughput: 0: 10862.0. Samples: 10066476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:45:28,080][389401] Avg episode reward: [(0, '4672.136')] [2023-03-08 10:45:28,538][389688] Updated weights for policy 0, policy_version 19680 (0.0005) [2023-03-08 10:45:32,275][389688] Updated weights for policy 0, policy_version 19760 (0.0004) [2023-03-08 10:45:33,079][389401] Fps is (10 sec: 11468.9, 60 sec: 10922.7, 300 sec: 11357.7). Total num frames: 10125312. Throughput: 0: 10898.4. Samples: 10100124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:45:33,080][389401] Avg episode reward: [(0, '4712.034')] [2023-03-08 10:45:35,958][389688] Updated weights for policy 0, policy_version 19840 (0.0005) [2023-03-08 10:45:38,079][389401] Fps is (10 sec: 11059.1, 60 sec: 10854.4, 300 sec: 11329.9). Total num frames: 10178560. Throughput: 0: 10922.5. Samples: 10166264. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:45:38,080][389401] Avg episode reward: [(0, '4717.098')] [2023-03-08 10:45:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000019880_10178560.pth... [2023-03-08 10:45:38,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000019240_9850880.pth [2023-03-08 10:45:39,680][389688] Updated weights for policy 0, policy_version 19920 (0.0005) [2023-03-08 10:45:43,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10854.4, 300 sec: 11316.1). Total num frames: 10231808. Throughput: 0: 10895.3. Samples: 10230584. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:45:43,080][389401] Avg episode reward: [(0, '4717.504')] [2023-03-08 10:45:43,516][389688] Updated weights for policy 0, policy_version 20000 (0.0005) [2023-03-08 10:45:46,999][389688] Updated weights for policy 0, policy_version 20080 (0.0005) [2023-03-08 10:45:48,079][389401] Fps is (10 sec: 11468.9, 60 sec: 10990.9, 300 sec: 11316.1). Total num frames: 10293248. Throughput: 0: 10929.5. Samples: 10264884. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:45:48,080][389401] Avg episode reward: [(0, '4720.672')] [2023-03-08 10:45:50,364][389688] Updated weights for policy 0, policy_version 20160 (0.0004) [2023-03-08 10:45:53,079][389401] Fps is (10 sec: 11878.2, 60 sec: 11059.2, 300 sec: 11302.2). Total num frames: 10350592. Throughput: 0: 11106.3. Samples: 10336772. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:45:53,080][389401] Avg episode reward: [(0, '4722.630')] [2023-03-08 10:45:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000020216_10350592.pth... [2023-03-08 10:45:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000019560_10014720.pth [2023-03-08 10:45:54,068][389688] Updated weights for policy 0, policy_version 20240 (0.0004) [2023-03-08 10:45:58,015][389688] Updated weights for policy 0, policy_version 20320 (0.0005) [2023-03-08 10:45:58,079][389401] Fps is (10 sec: 11059.1, 60 sec: 10990.9, 300 sec: 11274.4). Total num frames: 10403840. Throughput: 0: 11105.7. Samples: 10400020. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:45:58,080][389401] Avg episode reward: [(0, '4716.283')] [2023-03-08 10:46:01,971][389688] Updated weights for policy 0, policy_version 20400 (0.0005) [2023-03-08 10:46:03,079][389401] Fps is (10 sec: 10240.1, 60 sec: 10922.7, 300 sec: 11232.8). Total num frames: 10452992. Throughput: 0: 11077.1. Samples: 10431344. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:46:03,080][389401] Avg episode reward: [(0, '4697.769')] [2023-03-08 10:46:05,876][389688] Updated weights for policy 0, policy_version 20480 (0.0005) [2023-03-08 10:46:08,079][389401] Fps is (10 sec: 10240.0, 60 sec: 10922.7, 300 sec: 11218.9). Total num frames: 10506240. Throughput: 0: 11007.2. Samples: 10494024. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:46:08,080][389401] Avg episode reward: [(0, '3214.204')] [2023-03-08 10:46:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000020520_10506240.pth... [2023-03-08 10:46:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000019880_10178560.pth [2023-03-08 10:46:09,751][389688] Updated weights for policy 0, policy_version 20560 (0.0005) [2023-03-08 10:46:13,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10922.7, 300 sec: 11191.1). Total num frames: 10559488. Throughput: 0: 10911.1. Samples: 10557476. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:46:13,080][389401] Avg episode reward: [(0, '4172.953')] [2023-03-08 10:46:13,620][389688] Updated weights for policy 0, policy_version 20640 (0.0005) [2023-03-08 10:46:17,627][389688] Updated weights for policy 0, policy_version 20720 (0.0005) [2023-03-08 10:46:18,079][389401] Fps is (10 sec: 10649.7, 60 sec: 10922.7, 300 sec: 11163.3). Total num frames: 10612736. Throughput: 0: 10845.4. Samples: 10588168. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:46:18,080][389401] Avg episode reward: [(0, '4671.624')] [2023-03-08 10:46:21,466][389688] Updated weights for policy 0, policy_version 20800 (0.0005) [2023-03-08 10:46:23,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10922.7, 300 sec: 11149.4). Total num frames: 10665984. Throughput: 0: 10788.7. Samples: 10651756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:46:23,080][389401] Avg episode reward: [(0, '4570.926')] [2023-03-08 10:46:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000020832_10665984.pth... [2023-03-08 10:46:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000020216_10350592.pth [2023-03-08 10:46:25,231][389688] Updated weights for policy 0, policy_version 20880 (0.0005) [2023-03-08 10:46:28,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10854.4, 300 sec: 11135.6). Total num frames: 10719232. Throughput: 0: 10778.4. Samples: 10715612. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:46:28,080][389401] Avg episode reward: [(0, '4640.092')] [2023-03-08 10:46:29,072][389688] Updated weights for policy 0, policy_version 20960 (0.0004) [2023-03-08 10:46:32,741][389688] Updated weights for policy 0, policy_version 21040 (0.0003) [2023-03-08 10:46:33,079][389401] Fps is (10 sec: 10649.5, 60 sec: 10786.1, 300 sec: 11121.7). Total num frames: 10772480. Throughput: 0: 10747.7. Samples: 10748532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:46:33,080][389401] Avg episode reward: [(0, '4689.171')] [2023-03-08 10:46:36,743][389688] Updated weights for policy 0, policy_version 21120 (0.0004) [2023-03-08 10:46:38,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10786.2, 300 sec: 11093.9). Total num frames: 10825728. Throughput: 0: 10579.2. Samples: 10812836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:46:38,080][389401] Avg episode reward: [(0, '4655.332')] [2023-03-08 10:46:38,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000021144_10825728.pth... [2023-03-08 10:46:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000020520_10506240.pth [2023-03-08 10:46:40,585][389688] Updated weights for policy 0, policy_version 21200 (0.0004) [2023-03-08 10:46:43,079][389401] Fps is (10 sec: 10649.7, 60 sec: 10786.1, 300 sec: 11052.3). Total num frames: 10878976. Throughput: 0: 10595.2. Samples: 10876804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:46:43,080][389401] Avg episode reward: [(0, '3842.971')] [2023-03-08 10:46:44,356][389688] Updated weights for policy 0, policy_version 21280 (0.0005) [2023-03-08 10:46:48,075][389688] Updated weights for policy 0, policy_version 21360 (0.0005) [2023-03-08 10:46:48,079][389401] Fps is (10 sec: 11059.1, 60 sec: 10717.9, 300 sec: 11038.4). Total num frames: 10936320. Throughput: 0: 10631.8. Samples: 10909776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:46:48,080][389401] Avg episode reward: [(0, '4675.026')] [2023-03-08 10:46:51,883][389688] Updated weights for policy 0, policy_version 21440 (0.0006) [2023-03-08 10:46:53,079][389401] Fps is (10 sec: 11059.1, 60 sec: 10649.6, 300 sec: 11010.6). Total num frames: 10989568. Throughput: 0: 10683.0. Samples: 10974760. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:46:53,080][389401] Avg episode reward: [(0, '4708.797')] [2023-03-08 10:46:53,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000021464_10989568.pth... [2023-03-08 10:46:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000020832_10665984.pth [2023-03-08 10:46:55,500][389688] Updated weights for policy 0, policy_version 21520 (0.0005) [2023-03-08 10:46:58,079][389401] Fps is (10 sec: 10649.5, 60 sec: 10649.6, 300 sec: 10982.8). Total num frames: 11042816. Throughput: 0: 10742.0. Samples: 11040868. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:46:58,080][389401] Avg episode reward: [(0, '4628.104')] [2023-03-08 10:46:59,451][389688] Updated weights for policy 0, policy_version 21600 (0.0005) [2023-03-08 10:47:03,079][389401] Fps is (10 sec: 10649.7, 60 sec: 10717.9, 300 sec: 10955.1). Total num frames: 11096064. Throughput: 0: 10741.9. Samples: 11071552. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:47:03,080][389401] Avg episode reward: [(0, '4711.838')] [2023-03-08 10:47:03,435][389688] Updated weights for policy 0, policy_version 21680 (0.0005) [2023-03-08 10:47:07,387][389688] Updated weights for policy 0, policy_version 21760 (0.0005) [2023-03-08 10:47:08,079][389401] Fps is (10 sec: 10240.0, 60 sec: 10649.6, 300 sec: 10927.3). Total num frames: 11145216. Throughput: 0: 10694.1. Samples: 11132992. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:47:08,080][389401] Avg episode reward: [(0, '4691.248')] [2023-03-08 10:47:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000021768_11145216.pth... [2023-03-08 10:47:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000021144_10825728.pth [2023-03-08 10:47:11,364][389688] Updated weights for policy 0, policy_version 21840 (0.0004) [2023-03-08 10:47:13,079][389401] Fps is (10 sec: 10240.1, 60 sec: 10649.6, 300 sec: 10899.5). Total num frames: 11198464. Throughput: 0: 10651.3. Samples: 11194920. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:47:13,080][389401] Avg episode reward: [(0, '4672.229')] [2023-03-08 10:47:15,307][389688] Updated weights for policy 0, policy_version 21920 (0.0004) [2023-03-08 10:47:18,079][389401] Fps is (10 sec: 10240.1, 60 sec: 10581.3, 300 sec: 10871.8). Total num frames: 11247616. Throughput: 0: 10635.9. Samples: 11227148. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:47:18,080][389401] Avg episode reward: [(0, '4698.860')] [2023-03-08 10:47:19,281][389688] Updated weights for policy 0, policy_version 22000 (0.0006) [2023-03-08 10:47:22,928][389688] Updated weights for policy 0, policy_version 22080 (0.0004) [2023-03-08 10:47:23,079][389401] Fps is (10 sec: 10649.5, 60 sec: 10649.6, 300 sec: 10871.8). Total num frames: 11304960. Throughput: 0: 10619.3. Samples: 11290708. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:47:23,080][389401] Avg episode reward: [(0, '4655.415')] [2023-03-08 10:47:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000022080_11304960.pth... [2023-03-08 10:47:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000021464_10989568.pth [2023-03-08 10:47:26,776][389688] Updated weights for policy 0, policy_version 22160 (0.0005) [2023-03-08 10:47:28,079][389401] Fps is (10 sec: 11059.1, 60 sec: 10649.6, 300 sec: 10857.9). Total num frames: 11358208. Throughput: 0: 10627.7. Samples: 11355052. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:47:28,080][389401] Avg episode reward: [(0, '4708.079')] [2023-03-08 10:47:30,441][389688] Updated weights for policy 0, policy_version 22240 (0.0004) [2023-03-08 10:47:33,079][389401] Fps is (10 sec: 11059.3, 60 sec: 10717.9, 300 sec: 10871.8). Total num frames: 11415552. Throughput: 0: 10656.4. Samples: 11389312. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:47:33,080][389401] Avg episode reward: [(0, '4721.469')] [2023-03-08 10:47:34,099][389688] Updated weights for policy 0, policy_version 22320 (0.0005) [2023-03-08 10:47:37,695][389688] Updated weights for policy 0, policy_version 22400 (0.0005) [2023-03-08 10:47:38,079][389401] Fps is (10 sec: 11468.8, 60 sec: 10786.1, 300 sec: 10885.6). Total num frames: 11472896. Throughput: 0: 10709.7. Samples: 11456696. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:47:38,080][389401] Avg episode reward: [(0, '4690.103')] [2023-03-08 10:47:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000022408_11472896.pth... [2023-03-08 10:47:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000021768_11145216.pth [2023-03-08 10:47:41,270][389688] Updated weights for policy 0, policy_version 22480 (0.0005) [2023-03-08 10:47:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 10854.4, 300 sec: 10899.5). Total num frames: 11530240. Throughput: 0: 10783.9. Samples: 11526144. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:47:43,080][389401] Avg episode reward: [(0, '4722.383')] [2023-03-08 10:47:44,786][389688] Updated weights for policy 0, policy_version 22560 (0.0004) [2023-03-08 10:47:48,079][389401] Fps is (10 sec: 11468.9, 60 sec: 10854.4, 300 sec: 10885.6). Total num frames: 11587584. Throughput: 0: 10863.8. Samples: 11560424. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:47:48,080][389401] Avg episode reward: [(0, '4491.084')] [2023-03-08 10:47:48,443][389688] Updated weights for policy 0, policy_version 22640 (0.0004) [2023-03-08 10:47:52,077][389688] Updated weights for policy 0, policy_version 22720 (0.0005) [2023-03-08 10:47:53,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10854.4, 300 sec: 10885.6). Total num frames: 11640832. Throughput: 0: 11010.8. Samples: 11628476. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:47:53,080][389401] Avg episode reward: [(0, '4663.989')] [2023-03-08 10:47:53,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000022736_11640832.pth... [2023-03-08 10:47:53,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000022080_11304960.pth [2023-03-08 10:47:55,641][389688] Updated weights for policy 0, policy_version 22800 (0.0004) [2023-03-08 10:47:58,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 10885.6). Total num frames: 11698176. Throughput: 0: 11157.5. Samples: 11697008. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:47:58,080][389401] Avg episode reward: [(0, '4712.550')] [2023-03-08 10:47:59,163][389688] Updated weights for policy 0, policy_version 22880 (0.0004) [2023-03-08 10:48:02,565][389688] Updated weights for policy 0, policy_version 22960 (0.0004) [2023-03-08 10:48:03,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11059.2, 300 sec: 10913.4). Total num frames: 11759616. Throughput: 0: 11225.8. Samples: 11732312. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 10:48:03,080][389401] Avg episode reward: [(0, '4715.638')] [2023-03-08 10:48:06,032][389688] Updated weights for policy 0, policy_version 23040 (0.0005) [2023-03-08 10:48:08,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11195.7, 300 sec: 10927.3). Total num frames: 11816960. Throughput: 0: 11406.1. Samples: 11803980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:48:08,080][389401] Avg episode reward: [(0, '4724.183')] [2023-03-08 10:48:08,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000023080_11816960.pth... [2023-03-08 10:48:08,087][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000022408_11472896.pth [2023-03-08 10:48:09,745][389688] Updated weights for policy 0, policy_version 23120 (0.0005) [2023-03-08 10:48:13,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11264.0, 300 sec: 10941.2). Total num frames: 11874304. Throughput: 0: 11458.2. Samples: 11870672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:48:13,080][389401] Avg episode reward: [(0, '4725.712')] [2023-03-08 10:48:13,316][389688] Updated weights for policy 0, policy_version 23200 (0.0004) [2023-03-08 10:48:16,960][389688] Updated weights for policy 0, policy_version 23280 (0.0004) [2023-03-08 10:48:18,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11332.3, 300 sec: 10927.3). Total num frames: 11927552. Throughput: 0: 11461.2. Samples: 11905064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:48:18,080][389401] Avg episode reward: [(0, '4721.001')] [2023-03-08 10:48:20,748][389688] Updated weights for policy 0, policy_version 23360 (0.0005) [2023-03-08 10:48:23,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11332.3, 300 sec: 10941.2). Total num frames: 11984896. Throughput: 0: 11416.3. Samples: 11970428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:48:23,080][389401] Avg episode reward: [(0, '4728.417')] [2023-03-08 10:48:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000023408_11984896.pth... [2023-03-08 10:48:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000022736_11640832.pth [2023-03-08 10:48:24,580][389688] Updated weights for policy 0, policy_version 23440 (0.0005) [2023-03-08 10:48:28,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 10927.3). Total num frames: 12038144. Throughput: 0: 11286.9. Samples: 12034056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:48:28,080][389401] Avg episode reward: [(0, '4723.883')] [2023-03-08 10:48:28,428][389688] Updated weights for policy 0, policy_version 23520 (0.0005) [2023-03-08 10:48:32,312][389688] Updated weights for policy 0, policy_version 23600 (0.0005) [2023-03-08 10:48:33,079][389401] Fps is (10 sec: 10649.7, 60 sec: 11264.0, 300 sec: 10927.3). Total num frames: 12091392. Throughput: 0: 11237.4. Samples: 12066108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:48:33,080][389401] Avg episode reward: [(0, '4724.193')] [2023-03-08 10:48:36,151][389688] Updated weights for policy 0, policy_version 23680 (0.0005) [2023-03-08 10:48:38,079][389401] Fps is (10 sec: 10240.0, 60 sec: 11127.5, 300 sec: 10899.5). Total num frames: 12140544. Throughput: 0: 11125.4. Samples: 12129120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:48:38,080][389401] Avg episode reward: [(0, '4712.131')] [2023-03-08 10:48:38,102][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000023720_12144640.pth... [2023-03-08 10:48:38,103][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000023080_11816960.pth [2023-03-08 10:48:39,941][389688] Updated weights for policy 0, policy_version 23760 (0.0005) [2023-03-08 10:48:43,079][389401] Fps is (10 sec: 10649.5, 60 sec: 11127.5, 300 sec: 10913.4). Total num frames: 12197888. Throughput: 0: 11082.9. Samples: 12195740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:48:43,080][389401] Avg episode reward: [(0, '4722.248')] [2023-03-08 10:48:43,597][389688] Updated weights for policy 0, policy_version 23840 (0.0004) [2023-03-08 10:48:47,198][389688] Updated weights for policy 0, policy_version 23920 (0.0004) [2023-03-08 10:48:48,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11127.5, 300 sec: 10913.4). Total num frames: 12255232. Throughput: 0: 11044.1. Samples: 12229296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:48:48,080][389401] Avg episode reward: [(0, '4723.179')] [2023-03-08 10:48:50,814][389688] Updated weights for policy 0, policy_version 24000 (0.0005) [2023-03-08 10:48:53,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 10927.3). Total num frames: 12312576. Throughput: 0: 10977.2. Samples: 12297952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:48:53,080][389401] Avg episode reward: [(0, '4709.643')] [2023-03-08 10:48:53,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000024048_12312576.pth... [2023-03-08 10:48:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000023408_11984896.pth [2023-03-08 10:48:54,395][389688] Updated weights for policy 0, policy_version 24080 (0.0004) [2023-03-08 10:48:58,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11127.5, 300 sec: 10927.3). Total num frames: 12365824. Throughput: 0: 10983.2. Samples: 12364916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:48:58,080][389401] Avg episode reward: [(0, '4709.772')] [2023-03-08 10:48:58,134][389688] Updated weights for policy 0, policy_version 24160 (0.0005) [2023-03-08 10:49:01,920][389688] Updated weights for policy 0, policy_version 24240 (0.0005) [2023-03-08 10:49:03,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 10927.3). Total num frames: 12423168. Throughput: 0: 10943.7. Samples: 12397532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:49:03,080][389401] Avg episode reward: [(0, '4728.863')] [2023-03-08 10:49:05,716][389688] Updated weights for policy 0, policy_version 24320 (0.0005) [2023-03-08 10:49:08,079][389401] Fps is (10 sec: 11059.0, 60 sec: 10990.9, 300 sec: 10927.3). Total num frames: 12476416. Throughput: 0: 10925.7. Samples: 12462084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:49:08,080][389401] Avg episode reward: [(0, '4730.948')] [2023-03-08 10:49:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000024368_12476416.pth... [2023-03-08 10:49:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000023720_12144640.pth [2023-03-08 10:49:09,576][389688] Updated weights for policy 0, policy_version 24400 (0.0005) [2023-03-08 10:49:13,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10922.7, 300 sec: 10927.3). Total num frames: 12529664. Throughput: 0: 10924.1. Samples: 12525640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:49:13,080][389401] Avg episode reward: [(0, '4731.993')] [2023-03-08 10:49:13,388][389688] Updated weights for policy 0, policy_version 24480 (0.0005) [2023-03-08 10:49:17,123][389688] Updated weights for policy 0, policy_version 24560 (0.0005) [2023-03-08 10:49:18,079][389401] Fps is (10 sec: 10649.7, 60 sec: 10922.7, 300 sec: 10927.3). Total num frames: 12582912. Throughput: 0: 10939.8. Samples: 12558400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:49:18,080][389401] Avg episode reward: [(0, '4729.616')] [2023-03-08 10:49:20,674][389688] Updated weights for policy 0, policy_version 24640 (0.0005) [2023-03-08 10:49:23,079][389401] Fps is (10 sec: 11059.1, 60 sec: 10922.7, 300 sec: 10927.3). Total num frames: 12640256. Throughput: 0: 11083.3. Samples: 12627868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:49:23,080][389401] Avg episode reward: [(0, '4731.087')] [2023-03-08 10:49:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000024688_12640256.pth... [2023-03-08 10:49:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000024048_12312576.pth [2023-03-08 10:49:24,231][389688] Updated weights for policy 0, policy_version 24720 (0.0005) [2023-03-08 10:49:28,043][389688] Updated weights for policy 0, policy_version 24800 (0.0006) [2023-03-08 10:49:28,079][389401] Fps is (10 sec: 11468.7, 60 sec: 10990.9, 300 sec: 10941.2). Total num frames: 12697600. Throughput: 0: 11061.6. Samples: 12693512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:49:28,080][389401] Avg episode reward: [(0, '4730.520')] [2023-03-08 10:49:31,847][389688] Updated weights for policy 0, policy_version 24880 (0.0005) [2023-03-08 10:49:33,079][389401] Fps is (10 sec: 11059.3, 60 sec: 10990.9, 300 sec: 10927.3). Total num frames: 12750848. Throughput: 0: 11043.9. Samples: 12726272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:49:33,080][389401] Avg episode reward: [(0, '4729.277')] [2023-03-08 10:49:35,618][389688] Updated weights for policy 0, policy_version 24960 (0.0005) [2023-03-08 10:49:38,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11127.4, 300 sec: 10941.2). Total num frames: 12808192. Throughput: 0: 10974.8. Samples: 12791820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:49:38,080][389401] Avg episode reward: [(0, '4727.654')] [2023-03-08 10:49:38,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000025016_12808192.pth... [2023-03-08 10:49:38,087][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000024368_12476416.pth [2023-03-08 10:49:39,102][389688] Updated weights for policy 0, policy_version 25040 (0.0005) [2023-03-08 10:49:42,663][389688] Updated weights for policy 0, policy_version 25120 (0.0005) [2023-03-08 10:49:43,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11127.5, 300 sec: 10955.1). Total num frames: 12865536. Throughput: 0: 11034.0. Samples: 12861448. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:49:43,080][389401] Avg episode reward: [(0, '4716.531')] [2023-03-08 10:49:46,324][389688] Updated weights for policy 0, policy_version 25200 (0.0005) [2023-03-08 10:49:48,079][389401] Fps is (10 sec: 11059.4, 60 sec: 11059.2, 300 sec: 10955.1). Total num frames: 12918784. Throughput: 0: 11042.3. Samples: 12894436. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:49:48,080][389401] Avg episode reward: [(0, '4724.295')] [2023-03-08 10:49:49,930][389688] Updated weights for policy 0, policy_version 25280 (0.0005) [2023-03-08 10:49:53,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11127.5, 300 sec: 10968.9). Total num frames: 12980224. Throughput: 0: 11148.4. Samples: 12963760. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:49:53,080][389401] Avg episode reward: [(0, '4612.799')] [2023-03-08 10:49:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000025352_12980224.pth... [2023-03-08 10:49:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000024688_12640256.pth [2023-03-08 10:49:53,402][389688] Updated weights for policy 0, policy_version 25360 (0.0005) [2023-03-08 10:49:56,834][389688] Updated weights for policy 0, policy_version 25440 (0.0005) [2023-03-08 10:49:58,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11195.7, 300 sec: 10982.8). Total num frames: 13037568. Throughput: 0: 11294.7. Samples: 13033904. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 10:49:58,080][389401] Avg episode reward: [(0, '4473.125')] [2023-03-08 10:50:00,634][389688] Updated weights for policy 0, policy_version 25520 (0.0006) [2023-03-08 10:50:03,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11195.7, 300 sec: 10996.7). Total num frames: 13094912. Throughput: 0: 11286.9. Samples: 13066312. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:50:03,080][389401] Avg episode reward: [(0, '4720.097')] [2023-03-08 10:50:04,113][389688] Updated weights for policy 0, policy_version 25600 (0.0004) [2023-03-08 10:50:07,497][389688] Updated weights for policy 0, policy_version 25680 (0.0005) [2023-03-08 10:50:08,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11010.6). Total num frames: 13152256. Throughput: 0: 11322.3. Samples: 13137372. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:50:08,080][389401] Avg episode reward: [(0, '4727.061')] [2023-03-08 10:50:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000025688_13152256.pth... [2023-03-08 10:50:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000025016_12808192.pth [2023-03-08 10:50:10,864][389688] Updated weights for policy 0, policy_version 25760 (0.0004) [2023-03-08 10:50:13,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11400.5, 300 sec: 11038.4). Total num frames: 13213696. Throughput: 0: 11470.8. Samples: 13209696. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:50:13,080][389401] Avg episode reward: [(0, '4730.881')] [2023-03-08 10:50:14,326][389688] Updated weights for policy 0, policy_version 25840 (0.0005) [2023-03-08 10:50:18,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11038.4). Total num frames: 13266944. Throughput: 0: 11541.0. Samples: 13245616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:50:18,080][389401] Avg episode reward: [(0, '4727.893')] [2023-03-08 10:50:18,220][389688] Updated weights for policy 0, policy_version 25920 (0.0005) [2023-03-08 10:50:21,900][389688] Updated weights for policy 0, policy_version 26000 (0.0005) [2023-03-08 10:50:23,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11400.5, 300 sec: 11038.4). Total num frames: 13324288. Throughput: 0: 11498.3. Samples: 13309240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:50:23,080][389401] Avg episode reward: [(0, '4732.085')] [2023-03-08 10:50:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000026024_13324288.pth... [2023-03-08 10:50:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000025352_12980224.pth [2023-03-08 10:50:25,561][389688] Updated weights for policy 0, policy_version 26080 (0.0004) [2023-03-08 10:50:28,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11332.3, 300 sec: 11024.5). Total num frames: 13377536. Throughput: 0: 11434.2. Samples: 13375988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:50:28,080][389401] Avg episode reward: [(0, '4731.837')] [2023-03-08 10:50:29,342][389688] Updated weights for policy 0, policy_version 26160 (0.0005) [2023-03-08 10:50:33,079][389401] Fps is (10 sec: 10649.6, 60 sec: 11332.3, 300 sec: 11024.5). Total num frames: 13430784. Throughput: 0: 11417.9. Samples: 13408244. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:50:33,080][389401] Avg episode reward: [(0, '4719.210')] [2023-03-08 10:50:33,183][389688] Updated weights for policy 0, policy_version 26240 (0.0005) [2023-03-08 10:50:36,975][389688] Updated weights for policy 0, policy_version 26320 (0.0005) [2023-03-08 10:50:38,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11332.3, 300 sec: 11038.4). Total num frames: 13488128. Throughput: 0: 11290.0. Samples: 13471808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:50:38,080][389401] Avg episode reward: [(0, '4719.287')] [2023-03-08 10:50:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000026344_13488128.pth... [2023-03-08 10:50:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000025688_13152256.pth [2023-03-08 10:50:40,406][389688] Updated weights for policy 0, policy_version 26400 (0.0003) [2023-03-08 10:50:43,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11332.3, 300 sec: 11024.5). Total num frames: 13545472. Throughput: 0: 11300.3. Samples: 13542416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:50:43,080][389401] Avg episode reward: [(0, '4726.822')] [2023-03-08 10:50:43,987][389688] Updated weights for policy 0, policy_version 26480 (0.0004) [2023-03-08 10:50:47,672][389688] Updated weights for policy 0, policy_version 26560 (0.0005) [2023-03-08 10:50:48,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11024.5). Total num frames: 13602816. Throughput: 0: 11330.5. Samples: 13576184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:50:48,080][389401] Avg episode reward: [(0, '4730.920')] [2023-03-08 10:50:51,354][389688] Updated weights for policy 0, policy_version 26640 (0.0005) [2023-03-08 10:50:53,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11264.0, 300 sec: 11024.5). Total num frames: 13656064. Throughput: 0: 11245.1. Samples: 13643400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:50:53,080][389401] Avg episode reward: [(0, '4731.792')] [2023-03-08 10:50:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000026672_13656064.pth... [2023-03-08 10:50:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000026024_13324288.pth [2023-03-08 10:50:55,005][389688] Updated weights for policy 0, policy_version 26720 (0.0005) [2023-03-08 10:50:58,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11264.0, 300 sec: 11052.3). Total num frames: 13713408. Throughput: 0: 11104.2. Samples: 13709384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:50:58,080][389401] Avg episode reward: [(0, '4730.081')] [2023-03-08 10:50:58,742][389688] Updated weights for policy 0, policy_version 26800 (0.0005) [2023-03-08 10:51:02,359][389688] Updated weights for policy 0, policy_version 26880 (0.0004) [2023-03-08 10:51:03,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11052.3). Total num frames: 13766656. Throughput: 0: 11054.6. Samples: 13743072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:51:03,080][389401] Avg episode reward: [(0, '4726.076')] [2023-03-08 10:51:06,151][389688] Updated weights for policy 0, policy_version 26960 (0.0004) [2023-03-08 10:51:08,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11195.7, 300 sec: 11066.1). Total num frames: 13824000. Throughput: 0: 11107.9. Samples: 13809096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:51:08,080][389401] Avg episode reward: [(0, '4723.265')] [2023-03-08 10:51:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000027000_13824000.pth... [2023-03-08 10:51:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000026344_13488128.pth [2023-03-08 10:51:09,776][389688] Updated weights for policy 0, policy_version 27040 (0.0005) [2023-03-08 10:51:13,079][389401] Fps is (10 sec: 11469.0, 60 sec: 11127.5, 300 sec: 11080.0). Total num frames: 13881344. Throughput: 0: 11168.9. Samples: 13878588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:51:13,090][389401] Avg episode reward: [(0, '4729.932')] [2023-03-08 10:51:13,237][389688] Updated weights for policy 0, policy_version 27120 (0.0004) [2023-03-08 10:51:17,005][389688] Updated weights for policy 0, policy_version 27200 (0.0003) [2023-03-08 10:51:18,079][389401] Fps is (10 sec: 11059.4, 60 sec: 11127.5, 300 sec: 11080.0). Total num frames: 13934592. Throughput: 0: 11184.6. Samples: 13911552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:51:18,080][389401] Avg episode reward: [(0, '4729.949')] [2023-03-08 10:51:20,730][389688] Updated weights for policy 0, policy_version 27280 (0.0005) [2023-03-08 10:51:23,079][389401] Fps is (10 sec: 11059.0, 60 sec: 11127.5, 300 sec: 11093.9). Total num frames: 13991936. Throughput: 0: 11236.1. Samples: 13977432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:51:23,080][389401] Avg episode reward: [(0, '4718.224')] [2023-03-08 10:51:23,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000027328_13991936.pth... [2023-03-08 10:51:23,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000026672_13656064.pth [2023-03-08 10:51:24,476][389688] Updated weights for policy 0, policy_version 27360 (0.0005) [2023-03-08 10:51:28,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11127.5, 300 sec: 11093.9). Total num frames: 14045184. Throughput: 0: 11095.2. Samples: 14041700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:51:28,080][389401] Avg episode reward: [(0, '4705.647')] [2023-03-08 10:51:28,385][389688] Updated weights for policy 0, policy_version 27440 (0.0005) [2023-03-08 10:51:32,088][389688] Updated weights for policy 0, policy_version 27520 (0.0004) [2023-03-08 10:51:33,079][389401] Fps is (10 sec: 10649.6, 60 sec: 11127.5, 300 sec: 11093.9). Total num frames: 14098432. Throughput: 0: 11061.0. Samples: 14073928. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:51:33,080][389401] Avg episode reward: [(0, '4718.366')] [2023-03-08 10:51:35,818][389688] Updated weights for policy 0, policy_version 27600 (0.0005) [2023-03-08 10:51:38,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11127.5, 300 sec: 11107.8). Total num frames: 14155776. Throughput: 0: 11038.3. Samples: 14140124. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:51:38,080][389401] Avg episode reward: [(0, '4716.390')] [2023-03-08 10:51:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000027648_14155776.pth... [2023-03-08 10:51:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000027000_13824000.pth [2023-03-08 10:51:39,416][389688] Updated weights for policy 0, policy_version 27680 (0.0005) [2023-03-08 10:51:43,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11059.2, 300 sec: 11093.9). Total num frames: 14209024. Throughput: 0: 11068.5. Samples: 14207464. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 10:51:43,080][389401] Avg episode reward: [(0, '4719.722')] [2023-03-08 10:51:43,251][389688] Updated weights for policy 0, policy_version 27760 (0.0005) [2023-03-08 10:51:46,898][389688] Updated weights for policy 0, policy_version 27840 (0.0005) [2023-03-08 10:51:48,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11059.2, 300 sec: 11107.8). Total num frames: 14266368. Throughput: 0: 11040.5. Samples: 14239892. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:51:48,080][389401] Avg episode reward: [(0, '4714.139')] [2023-03-08 10:51:50,556][389688] Updated weights for policy 0, policy_version 27920 (0.0005) [2023-03-08 10:51:53,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 11107.8). Total num frames: 14319616. Throughput: 0: 11073.3. Samples: 14307392. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:51:53,080][389401] Avg episode reward: [(0, '4720.519')] [2023-03-08 10:51:53,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000027968_14319616.pth... [2023-03-08 10:51:53,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000027328_13991936.pth [2023-03-08 10:51:54,219][389688] Updated weights for policy 0, policy_version 28000 (0.0005) [2023-03-08 10:51:57,856][389688] Updated weights for policy 0, policy_version 28080 (0.0004) [2023-03-08 10:51:58,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 11121.7). Total num frames: 14376960. Throughput: 0: 11025.0. Samples: 14374712. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:51:58,080][389401] Avg episode reward: [(0, '4700.732')] [2023-03-08 10:52:01,848][389688] Updated weights for policy 0, policy_version 28160 (0.0005) [2023-03-08 10:52:03,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11059.2, 300 sec: 11135.6). Total num frames: 14430208. Throughput: 0: 10979.7. Samples: 14405640. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:52:03,080][389401] Avg episode reward: [(0, '4672.601')] [2023-03-08 10:52:05,576][389688] Updated weights for policy 0, policy_version 28240 (0.0005) [2023-03-08 10:52:08,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10990.9, 300 sec: 11135.6). Total num frames: 14483456. Throughput: 0: 10971.6. Samples: 14471152. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:52:08,080][389401] Avg episode reward: [(0, '4507.027')] [2023-03-08 10:52:08,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000028288_14483456.pth... [2023-03-08 10:52:08,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000027648_14155776.pth [2023-03-08 10:52:09,374][389688] Updated weights for policy 0, policy_version 28320 (0.0004) [2023-03-08 10:52:13,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10922.7, 300 sec: 11149.4). Total num frames: 14536704. Throughput: 0: 10955.0. Samples: 14534676. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:52:13,080][389401] Avg episode reward: [(0, '4714.997')] [2023-03-08 10:52:13,260][389688] Updated weights for policy 0, policy_version 28400 (0.0005) [2023-03-08 10:52:17,299][389688] Updated weights for policy 0, policy_version 28480 (0.0005) [2023-03-08 10:52:18,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10922.6, 300 sec: 11135.6). Total num frames: 14589952. Throughput: 0: 10921.1. Samples: 14565376. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:52:18,080][389401] Avg episode reward: [(0, '4702.795')] [2023-03-08 10:52:21,043][389688] Updated weights for policy 0, policy_version 28560 (0.0005) [2023-03-08 10:52:23,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10854.4, 300 sec: 11135.6). Total num frames: 14643200. Throughput: 0: 10874.9. Samples: 14629492. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:52:23,090][389401] Avg episode reward: [(0, '4494.167')] [2023-03-08 10:52:23,093][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000028600_14643200.pth... [2023-03-08 10:52:23,095][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000027968_14319616.pth [2023-03-08 10:52:24,899][389688] Updated weights for policy 0, policy_version 28640 (0.0005) [2023-03-08 10:52:28,079][389401] Fps is (10 sec: 10649.7, 60 sec: 10854.4, 300 sec: 11121.7). Total num frames: 14696448. Throughput: 0: 10785.7. Samples: 14692820. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:52:28,080][389401] Avg episode reward: [(0, '4649.359')] [2023-03-08 10:52:28,719][389688] Updated weights for policy 0, policy_version 28720 (0.0005) [2023-03-08 10:52:32,400][389688] Updated weights for policy 0, policy_version 28800 (0.0004) [2023-03-08 10:52:33,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10854.4, 300 sec: 11107.8). Total num frames: 14749696. Throughput: 0: 10798.1. Samples: 14725808. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:52:33,080][389401] Avg episode reward: [(0, '4660.520')] [2023-03-08 10:52:36,334][389688] Updated weights for policy 0, policy_version 28880 (0.0004) [2023-03-08 10:52:38,079][389401] Fps is (10 sec: 10649.5, 60 sec: 10786.1, 300 sec: 11093.9). Total num frames: 14802944. Throughput: 0: 10731.3. Samples: 14790300. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:52:38,080][389401] Avg episode reward: [(0, '4695.797')] [2023-03-08 10:52:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000028912_14802944.pth... [2023-03-08 10:52:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000028288_14483456.pth [2023-03-08 10:52:40,155][389688] Updated weights for policy 0, policy_version 28960 (0.0004) [2023-03-08 10:52:43,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10854.4, 300 sec: 11093.9). Total num frames: 14860288. Throughput: 0: 10693.4. Samples: 14855916. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 10:52:43,080][389401] Avg episode reward: [(0, '4549.147')] [2023-03-08 10:52:43,809][389688] Updated weights for policy 0, policy_version 29040 (0.0005) [2023-03-08 10:52:47,796][389688] Updated weights for policy 0, policy_version 29120 (0.0005) [2023-03-08 10:52:48,079][389401] Fps is (10 sec: 10649.7, 60 sec: 10717.9, 300 sec: 11080.0). Total num frames: 14909440. Throughput: 0: 10720.4. Samples: 14888056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:52:48,080][389401] Avg episode reward: [(0, '4488.963')] [2023-03-08 10:52:51,907][389688] Updated weights for policy 0, policy_version 29200 (0.0005) [2023-03-08 10:52:53,079][389401] Fps is (10 sec: 9830.4, 60 sec: 10649.6, 300 sec: 11052.3). Total num frames: 14958592. Throughput: 0: 10595.3. Samples: 14947940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:52:53,080][389401] Avg episode reward: [(0, '4648.964')] [2023-03-08 10:52:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000029216_14958592.pth... [2023-03-08 10:52:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000028600_14643200.pth [2023-03-08 10:52:56,076][389688] Updated weights for policy 0, policy_version 29280 (0.0005) [2023-03-08 10:52:58,079][389401] Fps is (10 sec: 9830.3, 60 sec: 10513.1, 300 sec: 11010.6). Total num frames: 15007744. Throughput: 0: 10506.0. Samples: 15007448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:52:58,080][389401] Avg episode reward: [(0, '4635.377')] [2023-03-08 10:53:00,036][389688] Updated weights for policy 0, policy_version 29360 (0.0005) [2023-03-08 10:53:03,079][389401] Fps is (10 sec: 10649.7, 60 sec: 10581.3, 300 sec: 11010.6). Total num frames: 15065088. Throughput: 0: 10534.9. Samples: 15039444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:53:03,080][389401] Avg episode reward: [(0, '4677.540')] [2023-03-08 10:53:03,961][389688] Updated weights for policy 0, policy_version 29440 (0.0005) [2023-03-08 10:53:07,947][389688] Updated weights for policy 0, policy_version 29520 (0.0005) [2023-03-08 10:53:08,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10513.1, 300 sec: 10982.8). Total num frames: 15114240. Throughput: 0: 10488.1. Samples: 15101456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:53:08,080][389401] Avg episode reward: [(0, '4655.966')] [2023-03-08 10:53:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000029520_15114240.pth... [2023-03-08 10:53:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000028912_14802944.pth [2023-03-08 10:53:11,935][389688] Updated weights for policy 0, policy_version 29600 (0.0005) [2023-03-08 10:53:13,079][389401] Fps is (10 sec: 9830.4, 60 sec: 10444.8, 300 sec: 10968.9). Total num frames: 15163392. Throughput: 0: 10443.2. Samples: 15162764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:53:13,080][389401] Avg episode reward: [(0, '4629.718')] [2023-03-08 10:53:15,820][389688] Updated weights for policy 0, policy_version 29680 (0.0005) [2023-03-08 10:53:18,079][389401] Fps is (10 sec: 10649.7, 60 sec: 10513.1, 300 sec: 10969.0). Total num frames: 15220736. Throughput: 0: 10411.4. Samples: 15194320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:53:18,080][389401] Avg episode reward: [(0, '4628.688')] [2023-03-08 10:53:19,531][389688] Updated weights for policy 0, policy_version 29760 (0.0004) [2023-03-08 10:53:23,010][389688] Updated weights for policy 0, policy_version 29840 (0.0004) [2023-03-08 10:53:23,079][389401] Fps is (10 sec: 11468.7, 60 sec: 10581.3, 300 sec: 10982.8). Total num frames: 15278080. Throughput: 0: 10475.6. Samples: 15261704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:53:23,080][389401] Avg episode reward: [(0, '4536.824')] [2023-03-08 10:53:23,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000029840_15278080.pth... [2023-03-08 10:53:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000029216_14958592.pth [2023-03-08 10:53:26,197][389688] Updated weights for policy 0, policy_version 29920 (0.0004) [2023-03-08 10:53:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 10717.9, 300 sec: 11010.6). Total num frames: 15339520. Throughput: 0: 10657.2. Samples: 15335488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:53:28,080][389401] Avg episode reward: [(0, '4645.472')] [2023-03-08 10:53:29,695][389688] Updated weights for policy 0, policy_version 30000 (0.0005) [2023-03-08 10:53:33,079][389401] Fps is (10 sec: 11878.5, 60 sec: 10786.1, 300 sec: 11038.4). Total num frames: 15396864. Throughput: 0: 10744.4. Samples: 15371556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:53:33,080][389401] Avg episode reward: [(0, '4674.441')] [2023-03-08 10:53:33,419][389688] Updated weights for policy 0, policy_version 30080 (0.0005) [2023-03-08 10:53:37,015][389688] Updated weights for policy 0, policy_version 30160 (0.0005) [2023-03-08 10:53:38,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10786.1, 300 sec: 11024.5). Total num frames: 15450112. Throughput: 0: 10887.9. Samples: 15437896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:53:38,080][389401] Avg episode reward: [(0, '4494.111')] [2023-03-08 10:53:38,087][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000030184_15454208.pth... [2023-03-08 10:53:38,088][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000029520_15114240.pth [2023-03-08 10:53:40,473][389688] Updated weights for policy 0, policy_version 30240 (0.0005) [2023-03-08 10:53:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 10854.4, 300 sec: 11038.4). Total num frames: 15511552. Throughput: 0: 11162.7. Samples: 15509768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:53:43,080][389401] Avg episode reward: [(0, '4678.586')] [2023-03-08 10:53:43,839][389688] Updated weights for policy 0, policy_version 30320 (0.0005) [2023-03-08 10:53:47,427][389688] Updated weights for policy 0, policy_version 30400 (0.0005) [2023-03-08 10:53:48,079][389401] Fps is (10 sec: 11878.5, 60 sec: 10990.9, 300 sec: 11038.4). Total num frames: 15568896. Throughput: 0: 11221.1. Samples: 15544392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:53:48,080][389401] Avg episode reward: [(0, '4647.180')] [2023-03-08 10:53:51,014][389688] Updated weights for policy 0, policy_version 30480 (0.0005) [2023-03-08 10:53:53,079][389401] Fps is (10 sec: 11468.6, 60 sec: 11127.5, 300 sec: 11052.3). Total num frames: 15626240. Throughput: 0: 11374.6. Samples: 15613312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:53:53,080][389401] Avg episode reward: [(0, '4712.731')] [2023-03-08 10:53:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000030520_15626240.pth... [2023-03-08 10:53:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000029840_15278080.pth [2023-03-08 10:53:54,749][389688] Updated weights for policy 0, policy_version 30560 (0.0005) [2023-03-08 10:53:58,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11052.3). Total num frames: 15683584. Throughput: 0: 11484.2. Samples: 15679552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:53:58,080][389401] Avg episode reward: [(0, '4722.261')] [2023-03-08 10:53:58,462][389688] Updated weights for policy 0, policy_version 30640 (0.0005) [2023-03-08 10:54:02,396][389688] Updated weights for policy 0, policy_version 30720 (0.0005) [2023-03-08 10:54:03,079][389401] Fps is (10 sec: 10649.8, 60 sec: 11127.5, 300 sec: 11038.4). Total num frames: 15732736. Throughput: 0: 11470.4. Samples: 15710488. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:54:03,080][389401] Avg episode reward: [(0, '4722.952')] [2023-03-08 10:54:06,072][389688] Updated weights for policy 0, policy_version 30800 (0.0005) [2023-03-08 10:54:08,079][389401] Fps is (10 sec: 10649.5, 60 sec: 11264.0, 300 sec: 11052.3). Total num frames: 15790080. Throughput: 0: 11440.3. Samples: 15776516. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:54:08,080][389401] Avg episode reward: [(0, '4718.896')] [2023-03-08 10:54:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000030840_15790080.pth... [2023-03-08 10:54:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000030184_15454208.pth [2023-03-08 10:54:09,783][389688] Updated weights for policy 0, policy_version 30880 (0.0004) [2023-03-08 10:54:13,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11332.3, 300 sec: 11052.3). Total num frames: 15843328. Throughput: 0: 11233.5. Samples: 15840996. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:54:13,080][389401] Avg episode reward: [(0, '4695.520')] [2023-03-08 10:54:13,634][389688] Updated weights for policy 0, policy_version 30960 (0.0005) [2023-03-08 10:54:17,599][389688] Updated weights for policy 0, policy_version 31040 (0.0005) [2023-03-08 10:54:18,079][389401] Fps is (10 sec: 10649.7, 60 sec: 11264.0, 300 sec: 11038.4). Total num frames: 15896576. Throughput: 0: 11128.4. Samples: 15872336. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:54:18,080][389401] Avg episode reward: [(0, '4698.134')] [2023-03-08 10:54:21,451][389688] Updated weights for policy 0, policy_version 31120 (0.0005) [2023-03-08 10:54:23,079][389401] Fps is (10 sec: 10649.6, 60 sec: 11195.7, 300 sec: 11024.5). Total num frames: 15949824. Throughput: 0: 11065.0. Samples: 15935820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:54:23,080][389401] Avg episode reward: [(0, '4660.829')] [2023-03-08 10:54:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000031152_15949824.pth... [2023-03-08 10:54:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000030520_15626240.pth [2023-03-08 10:54:25,469][389688] Updated weights for policy 0, policy_version 31200 (0.0005) [2023-03-08 10:54:28,079][389401] Fps is (10 sec: 10240.1, 60 sec: 10990.9, 300 sec: 11010.6). Total num frames: 15998976. Throughput: 0: 10842.8. Samples: 15997696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:54:28,080][389401] Avg episode reward: [(0, '4707.977')] [2023-03-08 10:54:29,371][389688] Updated weights for policy 0, policy_version 31280 (0.0005) [2023-03-08 10:54:33,079][389401] Fps is (10 sec: 10240.0, 60 sec: 10922.7, 300 sec: 10996.7). Total num frames: 16052224. Throughput: 0: 10768.2. Samples: 16028960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:54:33,080][389401] Avg episode reward: [(0, '4646.231')] [2023-03-08 10:54:33,308][389688] Updated weights for policy 0, policy_version 31360 (0.0005) [2023-03-08 10:54:37,282][389688] Updated weights for policy 0, policy_version 31440 (0.0005) [2023-03-08 10:54:38,079][389401] Fps is (10 sec: 10649.5, 60 sec: 10922.7, 300 sec: 10982.8). Total num frames: 16105472. Throughput: 0: 10615.7. Samples: 16091016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:54:38,080][389401] Avg episode reward: [(0, '4676.016')] [2023-03-08 10:54:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000031456_16105472.pth... [2023-03-08 10:54:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000030840_15790080.pth [2023-03-08 10:54:40,991][389688] Updated weights for policy 0, policy_version 31520 (0.0004) [2023-03-08 10:54:43,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10786.1, 300 sec: 10982.8). Total num frames: 16158720. Throughput: 0: 10588.9. Samples: 16156052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:54:43,080][389401] Avg episode reward: [(0, '4720.365')] [2023-03-08 10:54:44,677][389688] Updated weights for policy 0, policy_version 31600 (0.0004) [2023-03-08 10:54:48,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10786.1, 300 sec: 10969.0). Total num frames: 16216064. Throughput: 0: 10662.4. Samples: 16190296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:54:48,080][389401] Avg episode reward: [(0, '4715.356')] [2023-03-08 10:54:48,447][389688] Updated weights for policy 0, policy_version 31680 (0.0005) [2023-03-08 10:54:52,240][389688] Updated weights for policy 0, policy_version 31760 (0.0005) [2023-03-08 10:54:53,079][389401] Fps is (10 sec: 11059.1, 60 sec: 10717.9, 300 sec: 10955.1). Total num frames: 16269312. Throughput: 0: 10628.3. Samples: 16254788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:54:53,080][389401] Avg episode reward: [(0, '4714.756')] [2023-03-08 10:54:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000031776_16269312.pth... [2023-03-08 10:54:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000031152_15949824.pth [2023-03-08 10:54:55,992][389688] Updated weights for policy 0, policy_version 31840 (0.0005) [2023-03-08 10:54:58,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10649.6, 300 sec: 10941.2). Total num frames: 16322560. Throughput: 0: 10633.1. Samples: 16319484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:54:58,080][389401] Avg episode reward: [(0, '4712.219')] [2023-03-08 10:54:59,819][389688] Updated weights for policy 0, policy_version 31920 (0.0005) [2023-03-08 10:55:03,079][389401] Fps is (10 sec: 10649.7, 60 sec: 10717.8, 300 sec: 10927.3). Total num frames: 16375808. Throughput: 0: 10652.5. Samples: 16351700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:55:03,080][389401] Avg episode reward: [(0, '4703.169')] [2023-03-08 10:55:03,638][389688] Updated weights for policy 0, policy_version 32000 (0.0006) [2023-03-08 10:55:07,556][389688] Updated weights for policy 0, policy_version 32080 (0.0006) [2023-03-08 10:55:08,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10649.6, 300 sec: 10899.5). Total num frames: 16429056. Throughput: 0: 10669.8. Samples: 16415960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:55:08,080][389401] Avg episode reward: [(0, '4708.181')] [2023-03-08 10:55:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000032088_16429056.pth... [2023-03-08 10:55:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000031456_16105472.pth [2023-03-08 10:55:11,221][389688] Updated weights for policy 0, policy_version 32160 (0.0005) [2023-03-08 10:55:13,079][389401] Fps is (10 sec: 11059.3, 60 sec: 10717.9, 300 sec: 10913.4). Total num frames: 16486400. Throughput: 0: 10771.4. Samples: 16482408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:55:13,080][389401] Avg episode reward: [(0, '4019.154')] [2023-03-08 10:55:14,721][389688] Updated weights for policy 0, policy_version 32240 (0.0004) [2023-03-08 10:55:18,079][389401] Fps is (10 sec: 11468.8, 60 sec: 10786.1, 300 sec: 10913.4). Total num frames: 16543744. Throughput: 0: 10854.5. Samples: 16517412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:55:18,090][389401] Avg episode reward: [(0, '4484.846')] [2023-03-08 10:55:18,369][389688] Updated weights for policy 0, policy_version 32320 (0.0005) [2023-03-08 10:55:21,991][389688] Updated weights for policy 0, policy_version 32400 (0.0004) [2023-03-08 10:55:23,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10786.2, 300 sec: 10913.4). Total num frames: 16596992. Throughput: 0: 10972.5. Samples: 16584776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:55:23,080][389401] Avg episode reward: [(0, '4694.971')] [2023-03-08 10:55:23,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000032416_16596992.pth... [2023-03-08 10:55:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000031776_16269312.pth [2023-03-08 10:55:25,788][389688] Updated weights for policy 0, policy_version 32480 (0.0004) [2023-03-08 10:55:28,079][389401] Fps is (10 sec: 11059.3, 60 sec: 10922.7, 300 sec: 10927.3). Total num frames: 16654336. Throughput: 0: 10982.0. Samples: 16650240. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:55:28,080][389401] Avg episode reward: [(0, '4693.771')] [2023-03-08 10:55:29,553][389688] Updated weights for policy 0, policy_version 32560 (0.0004) [2023-03-08 10:55:33,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 10913.4). Total num frames: 16707584. Throughput: 0: 10950.8. Samples: 16683080. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:55:33,080][389401] Avg episode reward: [(0, '4665.851')] [2023-03-08 10:55:33,295][389688] Updated weights for policy 0, policy_version 32640 (0.0004) [2023-03-08 10:55:36,943][389688] Updated weights for policy 0, policy_version 32720 (0.0004) [2023-03-08 10:55:38,079][389401] Fps is (10 sec: 11059.1, 60 sec: 10990.9, 300 sec: 10913.4). Total num frames: 16764928. Throughput: 0: 10979.2. Samples: 16748852. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:55:38,080][389401] Avg episode reward: [(0, '4519.837')] [2023-03-08 10:55:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000032744_16764928.pth... [2023-03-08 10:55:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000032088_16429056.pth [2023-03-08 10:55:40,729][389688] Updated weights for policy 0, policy_version 32800 (0.0005) [2023-03-08 10:55:43,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 10899.5). Total num frames: 16818176. Throughput: 0: 11004.3. Samples: 16814676. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 10:55:43,080][389401] Avg episode reward: [(0, '4555.097')] [2023-03-08 10:55:44,338][389688] Updated weights for policy 0, policy_version 32880 (0.0005) [2023-03-08 10:55:48,079][389401] Fps is (10 sec: 10649.7, 60 sec: 10922.7, 300 sec: 10899.5). Total num frames: 16871424. Throughput: 0: 11070.2. Samples: 16849856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:55:48,080][389401] Avg episode reward: [(0, '4609.438')] [2023-03-08 10:55:48,104][389688] Updated weights for policy 0, policy_version 32960 (0.0005) [2023-03-08 10:55:51,877][389688] Updated weights for policy 0, policy_version 33040 (0.0006) [2023-03-08 10:55:53,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10922.7, 300 sec: 10885.6). Total num frames: 16924672. Throughput: 0: 11075.7. Samples: 16914364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:55:53,080][389401] Avg episode reward: [(0, '4710.822')] [2023-03-08 10:55:53,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000033064_16928768.pth... [2023-03-08 10:55:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000032416_16596992.pth [2023-03-08 10:55:55,764][389688] Updated weights for policy 0, policy_version 33120 (0.0004) [2023-03-08 10:55:58,079][389401] Fps is (10 sec: 10649.5, 60 sec: 10922.7, 300 sec: 10885.6). Total num frames: 16977920. Throughput: 0: 11005.2. Samples: 16977644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:55:58,080][389401] Avg episode reward: [(0, '4696.022')] [2023-03-08 10:55:59,599][389688] Updated weights for policy 0, policy_version 33200 (0.0005) [2023-03-08 10:56:03,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 10885.6). Total num frames: 17035264. Throughput: 0: 10958.8. Samples: 17010556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:56:03,080][389401] Avg episode reward: [(0, '4701.690')] [2023-03-08 10:56:03,479][389688] Updated weights for policy 0, policy_version 33280 (0.0005) [2023-03-08 10:56:07,463][389688] Updated weights for policy 0, policy_version 33360 (0.0005) [2023-03-08 10:56:08,079][389401] Fps is (10 sec: 10649.5, 60 sec: 10922.7, 300 sec: 10857.9). Total num frames: 17084416. Throughput: 0: 10830.2. Samples: 17072136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:56:08,080][389401] Avg episode reward: [(0, '4684.053')] [2023-03-08 10:56:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000033368_17084416.pth... [2023-03-08 10:56:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000032744_16764928.pth [2023-03-08 10:56:11,395][389688] Updated weights for policy 0, policy_version 33440 (0.0005) [2023-03-08 10:56:13,079][389401] Fps is (10 sec: 10239.9, 60 sec: 10854.4, 300 sec: 10857.9). Total num frames: 17137664. Throughput: 0: 10759.3. Samples: 17134408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:56:13,080][389401] Avg episode reward: [(0, '4707.651')] [2023-03-08 10:56:15,092][389688] Updated weights for policy 0, policy_version 33520 (0.0005) [2023-03-08 10:56:18,079][389401] Fps is (10 sec: 11059.3, 60 sec: 10854.4, 300 sec: 10857.9). Total num frames: 17195008. Throughput: 0: 10789.8. Samples: 17168620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:56:18,080][389401] Avg episode reward: [(0, '4702.779')] [2023-03-08 10:56:18,740][389688] Updated weights for policy 0, policy_version 33600 (0.0004) [2023-03-08 10:56:22,594][389688] Updated weights for policy 0, policy_version 33680 (0.0005) [2023-03-08 10:56:23,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10854.4, 300 sec: 10857.9). Total num frames: 17248256. Throughput: 0: 10775.8. Samples: 17233764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:56:23,080][389401] Avg episode reward: [(0, '4637.108')] [2023-03-08 10:56:23,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000033688_17248256.pth... [2023-03-08 10:56:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000033064_16928768.pth [2023-03-08 10:56:26,174][389688] Updated weights for policy 0, policy_version 33760 (0.0004) [2023-03-08 10:56:28,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10854.4, 300 sec: 10871.8). Total num frames: 17305600. Throughput: 0: 10818.6. Samples: 17301512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:56:28,080][389401] Avg episode reward: [(0, '4674.367')] [2023-03-08 10:56:29,843][389688] Updated weights for policy 0, policy_version 33840 (0.0004) [2023-03-08 10:56:33,079][389401] Fps is (10 sec: 11468.9, 60 sec: 10922.7, 300 sec: 10871.8). Total num frames: 17362944. Throughput: 0: 10786.3. Samples: 17335240. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:56:33,090][389401] Avg episode reward: [(0, '4677.740')] [2023-03-08 10:56:33,423][389688] Updated weights for policy 0, policy_version 33920 (0.0004) [2023-03-08 10:56:37,255][389688] Updated weights for policy 0, policy_version 34000 (0.0005) [2023-03-08 10:56:38,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10854.4, 300 sec: 10871.8). Total num frames: 17416192. Throughput: 0: 10829.2. Samples: 17401680. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:56:38,080][389401] Avg episode reward: [(0, '4724.061')] [2023-03-08 10:56:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000034016_17416192.pth... [2023-03-08 10:56:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000033368_17084416.pth [2023-03-08 10:56:41,059][389688] Updated weights for policy 0, policy_version 34080 (0.0005) [2023-03-08 10:56:43,079][389401] Fps is (10 sec: 10649.5, 60 sec: 10854.4, 300 sec: 10857.9). Total num frames: 17469440. Throughput: 0: 10848.4. Samples: 17465824. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:56:43,080][389401] Avg episode reward: [(0, '4726.717')] [2023-03-08 10:56:44,891][389688] Updated weights for policy 0, policy_version 34160 (0.0005) [2023-03-08 10:56:48,079][389401] Fps is (10 sec: 10649.7, 60 sec: 10854.4, 300 sec: 10857.9). Total num frames: 17522688. Throughput: 0: 10858.9. Samples: 17499204. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:56:48,080][389401] Avg episode reward: [(0, '4726.749')] [2023-03-08 10:56:48,552][389688] Updated weights for policy 0, policy_version 34240 (0.0005) [2023-03-08 10:56:52,330][389688] Updated weights for policy 0, policy_version 34320 (0.0006) [2023-03-08 10:56:53,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 10857.9). Total num frames: 17580032. Throughput: 0: 10946.5. Samples: 17564728. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:56:53,080][389401] Avg episode reward: [(0, '4730.083')] [2023-03-08 10:56:53,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000034336_17580032.pth... [2023-03-08 10:56:53,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000033688_17248256.pth [2023-03-08 10:56:56,107][389688] Updated weights for policy 0, policy_version 34400 (0.0005) [2023-03-08 10:56:58,079][389401] Fps is (10 sec: 11059.1, 60 sec: 10922.7, 300 sec: 10857.9). Total num frames: 17633280. Throughput: 0: 10997.8. Samples: 17629308. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:56:58,080][389401] Avg episode reward: [(0, '4728.589')] [2023-03-08 10:56:59,986][389688] Updated weights for policy 0, policy_version 34480 (0.0005) [2023-03-08 10:57:03,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10854.4, 300 sec: 10857.9). Total num frames: 17686528. Throughput: 0: 10960.0. Samples: 17661820. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:57:03,080][389401] Avg episode reward: [(0, '4723.680')] [2023-03-08 10:57:03,781][389688] Updated weights for policy 0, policy_version 34560 (0.0005) [2023-03-08 10:57:07,590][389688] Updated weights for policy 0, policy_version 34640 (0.0005) [2023-03-08 10:57:08,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10922.7, 300 sec: 10857.9). Total num frames: 17739776. Throughput: 0: 10936.3. Samples: 17725896. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:57:08,080][389401] Avg episode reward: [(0, '4725.197')] [2023-03-08 10:57:08,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000034648_17739776.pth... [2023-03-08 10:57:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000034016_17416192.pth [2023-03-08 10:57:11,425][389688] Updated weights for policy 0, policy_version 34720 (0.0005) [2023-03-08 10:57:13,079][389401] Fps is (10 sec: 10649.5, 60 sec: 10922.7, 300 sec: 10857.9). Total num frames: 17793024. Throughput: 0: 10861.1. Samples: 17790260. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 10:57:13,080][389401] Avg episode reward: [(0, '4733.117')] [2023-03-08 10:57:13,080][389644] Saving new best policy, reward=4733.117! [2023-03-08 10:57:15,237][389688] Updated weights for policy 0, policy_version 34800 (0.0005) [2023-03-08 10:57:18,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10854.4, 300 sec: 10857.9). Total num frames: 17846272. Throughput: 0: 10811.5. Samples: 17821760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:57:18,080][389401] Avg episode reward: [(0, '4687.535')] [2023-03-08 10:57:19,067][389688] Updated weights for policy 0, policy_version 34880 (0.0005) [2023-03-08 10:57:22,827][389688] Updated weights for policy 0, policy_version 34960 (0.0005) [2023-03-08 10:57:23,079][389401] Fps is (10 sec: 10649.6, 60 sec: 10854.4, 300 sec: 10857.9). Total num frames: 17899520. Throughput: 0: 10781.1. Samples: 17886832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:57:23,080][389401] Avg episode reward: [(0, '4729.516')] [2023-03-08 10:57:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000034960_17899520.pth... [2023-03-08 10:57:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000034336_17580032.pth [2023-03-08 10:57:26,438][389688] Updated weights for policy 0, policy_version 35040 (0.0005) [2023-03-08 10:57:28,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10854.4, 300 sec: 10871.8). Total num frames: 17956864. Throughput: 0: 10863.8. Samples: 17954696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:57:28,090][389401] Avg episode reward: [(0, '4730.178')] [2023-03-08 10:57:30,088][389688] Updated weights for policy 0, policy_version 35120 (0.0005) [2023-03-08 10:57:33,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10786.1, 300 sec: 10871.8). Total num frames: 18010112. Throughput: 0: 10852.9. Samples: 17987584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:57:33,080][389401] Avg episode reward: [(0, '4729.148')] [2023-03-08 10:57:33,922][389688] Updated weights for policy 0, policy_version 35200 (0.0005) [2023-03-08 10:57:37,508][389688] Updated weights for policy 0, policy_version 35280 (0.0004) [2023-03-08 10:57:38,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10854.4, 300 sec: 10871.8). Total num frames: 18067456. Throughput: 0: 10870.0. Samples: 18053880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:57:38,080][389401] Avg episode reward: [(0, '4730.509')] [2023-03-08 10:57:38,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000035288_18067456.pth... [2023-03-08 10:57:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000034648_17739776.pth [2023-03-08 10:57:41,131][389688] Updated weights for policy 0, policy_version 35360 (0.0005) [2023-03-08 10:57:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 10922.7, 300 sec: 10899.5). Total num frames: 18124800. Throughput: 0: 10941.5. Samples: 18121676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:57:43,080][389401] Avg episode reward: [(0, '4697.932')] [2023-03-08 10:57:44,689][389688] Updated weights for policy 0, policy_version 35440 (0.0005) [2023-03-08 10:57:48,079][389401] Fps is (10 sec: 11059.3, 60 sec: 10922.7, 300 sec: 10913.4). Total num frames: 18178048. Throughput: 0: 10987.1. Samples: 18156240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:57:48,080][389401] Avg episode reward: [(0, '4692.542')] [2023-03-08 10:57:48,498][389688] Updated weights for policy 0, policy_version 35520 (0.0005) [2023-03-08 10:57:52,215][389688] Updated weights for policy 0, policy_version 35600 (0.0006) [2023-03-08 10:57:53,079][389401] Fps is (10 sec: 11059.1, 60 sec: 10922.6, 300 sec: 10941.2). Total num frames: 18235392. Throughput: 0: 10988.8. Samples: 18220392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:57:53,080][389401] Avg episode reward: [(0, '4499.578')] [2023-03-08 10:57:53,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000035616_18235392.pth... [2023-03-08 10:57:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000034960_17899520.pth [2023-03-08 10:57:55,871][389688] Updated weights for policy 0, policy_version 35680 (0.0005) [2023-03-08 10:57:58,079][389401] Fps is (10 sec: 11468.8, 60 sec: 10990.9, 300 sec: 10941.2). Total num frames: 18292736. Throughput: 0: 11076.7. Samples: 18288712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:57:58,080][389401] Avg episode reward: [(0, '4618.291')] [2023-03-08 10:57:59,479][389688] Updated weights for policy 0, policy_version 35760 (0.0005) [2023-03-08 10:58:03,079][389401] Fps is (10 sec: 11059.3, 60 sec: 10990.9, 300 sec: 10955.1). Total num frames: 18345984. Throughput: 0: 11104.9. Samples: 18321480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:58:03,080][389401] Avg episode reward: [(0, '4721.730')] [2023-03-08 10:58:03,229][389688] Updated weights for policy 0, policy_version 35840 (0.0005) [2023-03-08 10:58:06,957][389688] Updated weights for policy 0, policy_version 35920 (0.0005) [2023-03-08 10:58:08,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 10982.8). Total num frames: 18403328. Throughput: 0: 11116.5. Samples: 18387072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:58:08,080][389401] Avg episode reward: [(0, '4600.240')] [2023-03-08 10:58:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000035944_18403328.pth... [2023-03-08 10:58:08,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000035288_18067456.pth [2023-03-08 10:58:10,595][389688] Updated weights for policy 0, policy_version 36000 (0.0005) [2023-03-08 10:58:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11127.5, 300 sec: 10982.8). Total num frames: 18460672. Throughput: 0: 11152.8. Samples: 18456572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:58:13,080][389401] Avg episode reward: [(0, '4727.904')] [2023-03-08 10:58:14,238][389688] Updated weights for policy 0, policy_version 36080 (0.0004) [2023-03-08 10:58:18,063][389688] Updated weights for policy 0, policy_version 36160 (0.0005) [2023-03-08 10:58:18,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11127.5, 300 sec: 10969.0). Total num frames: 18513920. Throughput: 0: 11130.2. Samples: 18488444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:58:18,080][389401] Avg episode reward: [(0, '4728.486')] [2023-03-08 10:58:21,922][389688] Updated weights for policy 0, policy_version 36240 (0.0005) [2023-03-08 10:58:23,079][389401] Fps is (10 sec: 10649.4, 60 sec: 11127.5, 300 sec: 10941.2). Total num frames: 18567168. Throughput: 0: 11064.1. Samples: 18551764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:58:23,080][389401] Avg episode reward: [(0, '4726.978')] [2023-03-08 10:58:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000036264_18567168.pth... [2023-03-08 10:58:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000035616_18235392.pth [2023-03-08 10:58:25,791][389688] Updated weights for policy 0, policy_version 36320 (0.0005) [2023-03-08 10:58:28,079][389401] Fps is (10 sec: 10649.5, 60 sec: 11059.2, 300 sec: 10927.3). Total num frames: 18620416. Throughput: 0: 10993.5. Samples: 18616384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:58:28,080][389401] Avg episode reward: [(0, '4727.269')] [2023-03-08 10:58:29,416][389688] Updated weights for policy 0, policy_version 36400 (0.0004) [2023-03-08 10:58:32,973][389688] Updated weights for policy 0, policy_version 36480 (0.0004) [2023-03-08 10:58:33,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11127.5, 300 sec: 10941.2). Total num frames: 18677760. Throughput: 0: 10995.3. Samples: 18651028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:58:33,080][389401] Avg episode reward: [(0, '4729.561')] [2023-03-08 10:58:36,538][389688] Updated weights for policy 0, policy_version 36560 (0.0005) [2023-03-08 10:58:38,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11127.5, 300 sec: 10927.3). Total num frames: 18735104. Throughput: 0: 11101.0. Samples: 18719936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:58:38,080][389401] Avg episode reward: [(0, '4731.437')] [2023-03-08 10:58:38,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000036592_18735104.pth... [2023-03-08 10:58:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000035944_18403328.pth [2023-03-08 10:58:40,188][389688] Updated weights for policy 0, policy_version 36640 (0.0005) [2023-03-08 10:58:43,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11127.5, 300 sec: 10927.3). Total num frames: 18792448. Throughput: 0: 11103.3. Samples: 18788360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:58:43,080][389401] Avg episode reward: [(0, '4728.891')] [2023-03-08 10:58:43,791][389688] Updated weights for policy 0, policy_version 36720 (0.0005) [2023-03-08 10:58:47,413][389688] Updated weights for policy 0, policy_version 36800 (0.0005) [2023-03-08 10:58:48,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11195.7, 300 sec: 10927.3). Total num frames: 18849792. Throughput: 0: 11103.4. Samples: 18821132. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:58:48,080][389401] Avg episode reward: [(0, '4724.855')] [2023-03-08 10:58:50,717][389688] Updated weights for policy 0, policy_version 36880 (0.0004) [2023-03-08 10:58:53,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11264.0, 300 sec: 10941.2). Total num frames: 18911232. Throughput: 0: 11284.2. Samples: 18894860. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:58:53,080][389401] Avg episode reward: [(0, '4342.635')] [2023-03-08 10:58:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000036936_18911232.pth... [2023-03-08 10:58:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000036264_18567168.pth [2023-03-08 10:58:53,904][389688] Updated weights for policy 0, policy_version 36960 (0.0004) [2023-03-08 10:58:57,141][389688] Updated weights for policy 0, policy_version 37040 (0.0005) [2023-03-08 10:58:58,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11332.3, 300 sec: 10982.8). Total num frames: 18972672. Throughput: 0: 11435.7. Samples: 18971180. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:58:58,080][389401] Avg episode reward: [(0, '4474.312')] [2023-03-08 10:59:00,512][389688] Updated weights for policy 0, policy_version 37120 (0.0004) [2023-03-08 10:59:03,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11468.8, 300 sec: 10996.7). Total num frames: 19034112. Throughput: 0: 11524.4. Samples: 19007044. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:59:03,080][389401] Avg episode reward: [(0, '4686.370')] [2023-03-08 10:59:04,227][389688] Updated weights for policy 0, policy_version 37200 (0.0005) [2023-03-08 10:59:07,778][389688] Updated weights for policy 0, policy_version 37280 (0.0004) [2023-03-08 10:59:08,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 10996.7). Total num frames: 19087360. Throughput: 0: 11603.9. Samples: 19073940. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 10:59:08,080][389401] Avg episode reward: [(0, '4391.082')] [2023-03-08 10:59:08,134][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000037288_19091456.pth... [2023-03-08 10:59:08,135][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000036592_18735104.pth [2023-03-08 10:59:11,091][389688] Updated weights for policy 0, policy_version 37360 (0.0005) [2023-03-08 10:59:13,079][389401] Fps is (10 sec: 11469.0, 60 sec: 11468.8, 300 sec: 11024.5). Total num frames: 19148800. Throughput: 0: 11816.2. Samples: 19148112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:59:13,080][389401] Avg episode reward: [(0, '4257.300')] [2023-03-08 10:59:14,616][389688] Updated weights for policy 0, policy_version 37440 (0.0005) [2023-03-08 10:59:18,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11537.1, 300 sec: 11038.4). Total num frames: 19206144. Throughput: 0: 11783.6. Samples: 19181288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:59:18,080][389401] Avg episode reward: [(0, '4721.942')] [2023-03-08 10:59:18,276][389688] Updated weights for policy 0, policy_version 37520 (0.0005) [2023-03-08 10:59:21,992][389688] Updated weights for policy 0, policy_version 37600 (0.0005) [2023-03-08 10:59:23,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11605.4, 300 sec: 11066.1). Total num frames: 19263488. Throughput: 0: 11717.2. Samples: 19247208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:59:23,080][389401] Avg episode reward: [(0, '4725.203')] [2023-03-08 10:59:23,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000037624_19263488.pth... [2023-03-08 10:59:23,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000036936_18911232.pth [2023-03-08 10:59:25,704][389688] Updated weights for policy 0, policy_version 37680 (0.0005) [2023-03-08 10:59:28,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11605.3, 300 sec: 11066.1). Total num frames: 19316736. Throughput: 0: 11666.6. Samples: 19313356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:59:28,080][389401] Avg episode reward: [(0, '4723.985')] [2023-03-08 10:59:29,448][389688] Updated weights for policy 0, policy_version 37760 (0.0005) [2023-03-08 10:59:33,079][389401] Fps is (10 sec: 10649.6, 60 sec: 11537.1, 300 sec: 11066.1). Total num frames: 19369984. Throughput: 0: 11657.1. Samples: 19345704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:59:33,080][389401] Avg episode reward: [(0, '4722.336')] [2023-03-08 10:59:33,275][389688] Updated weights for policy 0, policy_version 37840 (0.0005) [2023-03-08 10:59:36,956][389688] Updated weights for policy 0, policy_version 37920 (0.0005) [2023-03-08 10:59:38,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11080.0). Total num frames: 19427328. Throughput: 0: 11485.5. Samples: 19411708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:59:38,080][389401] Avg episode reward: [(0, '4678.772')] [2023-03-08 10:59:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000037944_19427328.pth... [2023-03-08 10:59:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000037288_19091456.pth [2023-03-08 10:59:40,762][389688] Updated weights for policy 0, policy_version 38000 (0.0005) [2023-03-08 10:59:43,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11468.8, 300 sec: 11066.1). Total num frames: 19480576. Throughput: 0: 11229.1. Samples: 19476488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:59:43,080][389401] Avg episode reward: [(0, '4719.080')] [2023-03-08 10:59:44,569][389688] Updated weights for policy 0, policy_version 38080 (0.0005) [2023-03-08 10:59:48,079][389401] Fps is (10 sec: 10649.6, 60 sec: 11400.5, 300 sec: 11066.1). Total num frames: 19533824. Throughput: 0: 11145.9. Samples: 19508608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:59:48,080][389401] Avg episode reward: [(0, '4719.417')] [2023-03-08 10:59:48,350][389688] Updated weights for policy 0, policy_version 38160 (0.0005) [2023-03-08 10:59:51,836][389688] Updated weights for policy 0, policy_version 38240 (0.0004) [2023-03-08 10:59:53,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11332.3, 300 sec: 11080.0). Total num frames: 19591168. Throughput: 0: 11172.0. Samples: 19576680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:59:53,080][389401] Avg episode reward: [(0, '4731.568')] [2023-03-08 10:59:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000038264_19591168.pth... [2023-03-08 10:59:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000037624_19263488.pth [2023-03-08 10:59:55,601][389688] Updated weights for policy 0, policy_version 38320 (0.0005) [2023-03-08 10:59:58,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11093.9). Total num frames: 19648512. Throughput: 0: 11030.6. Samples: 19644488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 10:59:58,080][389401] Avg episode reward: [(0, '4723.317')] [2023-03-08 10:59:59,071][389688] Updated weights for policy 0, policy_version 38400 (0.0004) [2023-03-08 11:00:02,833][389688] Updated weights for policy 0, policy_version 38480 (0.0005) [2023-03-08 11:00:03,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11127.5, 300 sec: 11093.9). Total num frames: 19701760. Throughput: 0: 11049.9. Samples: 19678536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:00:03,080][389401] Avg episode reward: [(0, '4690.508')] [2023-03-08 11:00:06,479][389688] Updated weights for policy 0, policy_version 38560 (0.0005) [2023-03-08 11:00:08,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11195.7, 300 sec: 11093.9). Total num frames: 19759104. Throughput: 0: 11054.8. Samples: 19744676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:00:08,080][389401] Avg episode reward: [(0, '4728.116')] [2023-03-08 11:00:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000038592_19759104.pth... [2023-03-08 11:00:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000037944_19427328.pth [2023-03-08 11:00:10,152][389688] Updated weights for policy 0, policy_version 38640 (0.0005) [2023-03-08 11:00:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11127.4, 300 sec: 11093.9). Total num frames: 19816448. Throughput: 0: 11090.2. Samples: 19812416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:00:13,080][389401] Avg episode reward: [(0, '4690.867')] [2023-03-08 11:00:13,700][389688] Updated weights for policy 0, policy_version 38720 (0.0005) [2023-03-08 11:00:17,256][389688] Updated weights for policy 0, policy_version 38800 (0.0005) [2023-03-08 11:00:18,079][389401] Fps is (10 sec: 11469.0, 60 sec: 11127.5, 300 sec: 11107.8). Total num frames: 19873792. Throughput: 0: 11128.3. Samples: 19846476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:00:18,080][389401] Avg episode reward: [(0, '4707.973')] [2023-03-08 11:00:20,766][389688] Updated weights for policy 0, policy_version 38880 (0.0005) [2023-03-08 11:00:23,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11127.4, 300 sec: 11107.8). Total num frames: 19931136. Throughput: 0: 11235.2. Samples: 19917292. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:00:23,080][389401] Avg episode reward: [(0, '4685.770')] [2023-03-08 11:00:23,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000038928_19931136.pth... [2023-03-08 11:00:23,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000038264_19591168.pth [2023-03-08 11:00:24,132][389688] Updated weights for policy 0, policy_version 38960 (0.0005) [2023-03-08 11:00:27,421][389688] Updated weights for policy 0, policy_version 39040 (0.0004) [2023-03-08 11:00:28,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11332.3, 300 sec: 11149.5). Total num frames: 19996672. Throughput: 0: 11449.6. Samples: 19991720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:00:28,080][389401] Avg episode reward: [(0, '4681.440')] [2023-03-08 11:00:30,628][389688] Updated weights for policy 0, policy_version 39120 (0.0004) [2023-03-08 11:00:33,079][389401] Fps is (10 sec: 12697.7, 60 sec: 11468.8, 300 sec: 11163.3). Total num frames: 20058112. Throughput: 0: 11575.6. Samples: 20029512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:00:33,080][389401] Avg episode reward: [(0, '4206.221')] [2023-03-08 11:00:33,862][389688] Updated weights for policy 0, policy_version 39200 (0.0004) [2023-03-08 11:00:37,233][389688] Updated weights for policy 0, policy_version 39280 (0.0004) [2023-03-08 11:00:38,079][389401] Fps is (10 sec: 12287.8, 60 sec: 11537.1, 300 sec: 11191.1). Total num frames: 20119552. Throughput: 0: 11746.0. Samples: 20105248. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:00:38,080][389401] Avg episode reward: [(0, '4490.810')] [2023-03-08 11:00:38,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000039296_20119552.pth... [2023-03-08 11:00:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000038592_19759104.pth [2023-03-08 11:00:40,735][389688] Updated weights for policy 0, policy_version 39360 (0.0005) [2023-03-08 11:00:43,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11205.0). Total num frames: 20176896. Throughput: 0: 11800.4. Samples: 20175504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:00:43,080][389401] Avg episode reward: [(0, '4423.338')] [2023-03-08 11:00:44,176][389688] Updated weights for policy 0, policy_version 39440 (0.0005) [2023-03-08 11:00:47,420][389688] Updated weights for policy 0, policy_version 39520 (0.0004) [2023-03-08 11:00:48,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11741.9, 300 sec: 11232.8). Total num frames: 20238336. Throughput: 0: 11846.1. Samples: 20211608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:00:48,080][389401] Avg episode reward: [(0, '4653.643')] [2023-03-08 11:00:50,712][389688] Updated weights for policy 0, policy_version 39600 (0.0004) [2023-03-08 11:00:53,079][389401] Fps is (10 sec: 12697.5, 60 sec: 11878.4, 300 sec: 11274.4). Total num frames: 20303872. Throughput: 0: 12062.5. Samples: 20287488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:00:53,080][389401] Avg episode reward: [(0, '4464.724')] [2023-03-08 11:00:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000039656_20303872.pth... [2023-03-08 11:00:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000038928_19931136.pth [2023-03-08 11:00:54,083][389688] Updated weights for policy 0, policy_version 39680 (0.0005) [2023-03-08 11:00:57,417][389688] Updated weights for policy 0, policy_version 39760 (0.0004) [2023-03-08 11:00:58,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11274.4). Total num frames: 20361216. Throughput: 0: 12171.9. Samples: 20360152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:00:58,080][389401] Avg episode reward: [(0, '4682.971')] [2023-03-08 11:01:00,807][389688] Updated weights for policy 0, policy_version 39840 (0.0005) [2023-03-08 11:01:03,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11330.0). Total num frames: 20426752. Throughput: 0: 12210.4. Samples: 20395944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:01:03,080][389401] Avg episode reward: [(0, '4391.529')] [2023-03-08 11:01:04,053][389688] Updated weights for policy 0, policy_version 39920 (0.0005) [2023-03-08 11:01:07,464][389688] Updated weights for policy 0, policy_version 40000 (0.0005) [2023-03-08 11:01:08,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11343.8). Total num frames: 20484096. Throughput: 0: 12284.4. Samples: 20470088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:01:08,080][389401] Avg episode reward: [(0, '4265.497')] [2023-03-08 11:01:08,102][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000040016_20488192.pth... [2023-03-08 11:01:08,104][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000039296_20119552.pth [2023-03-08 11:01:10,701][389688] Updated weights for policy 0, policy_version 40080 (0.0004) [2023-03-08 11:01:13,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12219.8, 300 sec: 11371.6). Total num frames: 20549632. Throughput: 0: 12308.8. Samples: 20545616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:01:13,080][389401] Avg episode reward: [(0, '4711.416')] [2023-03-08 11:01:13,896][389688] Updated weights for policy 0, policy_version 40160 (0.0004) [2023-03-08 11:01:17,110][389688] Updated weights for policy 0, policy_version 40240 (0.0003) [2023-03-08 11:01:18,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12288.0, 300 sec: 11399.4). Total num frames: 20611072. Throughput: 0: 12329.3. Samples: 20584328. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 11:01:18,080][389401] Avg episode reward: [(0, '4643.177')] [2023-03-08 11:01:20,647][389688] Updated weights for policy 0, policy_version 40320 (0.0005) [2023-03-08 11:01:23,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12356.3, 300 sec: 11413.3). Total num frames: 20672512. Throughput: 0: 12239.9. Samples: 20656044. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 11:01:23,080][389401] Avg episode reward: [(0, '4644.824')] [2023-03-08 11:01:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000040376_20672512.pth... [2023-03-08 11:01:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000039656_20303872.pth [2023-03-08 11:01:24,010][389688] Updated weights for policy 0, policy_version 40400 (0.0005) [2023-03-08 11:01:27,363][389688] Updated weights for policy 0, policy_version 40480 (0.0005) [2023-03-08 11:01:28,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 11427.1). Total num frames: 20733952. Throughput: 0: 12314.1. Samples: 20729640. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 11:01:28,080][389401] Avg episode reward: [(0, '4728.832')] [2023-03-08 11:01:30,711][389688] Updated weights for policy 0, policy_version 40560 (0.0005) [2023-03-08 11:01:33,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 11454.9). Total num frames: 20795392. Throughput: 0: 12327.9. Samples: 20766364. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 11:01:33,080][389401] Avg episode reward: [(0, '4638.202')] [2023-03-08 11:01:33,913][389688] Updated weights for policy 0, policy_version 40640 (0.0004) [2023-03-08 11:01:37,354][389688] Updated weights for policy 0, policy_version 40720 (0.0005) [2023-03-08 11:01:38,079][389401] Fps is (10 sec: 12287.8, 60 sec: 12288.0, 300 sec: 11482.7). Total num frames: 20856832. Throughput: 0: 12289.6. Samples: 20840520. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 11:01:38,080][389401] Avg episode reward: [(0, '4476.616')] [2023-03-08 11:01:38,085][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000040736_20856832.pth... [2023-03-08 11:01:38,087][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000040016_20488192.pth [2023-03-08 11:01:41,010][389688] Updated weights for policy 0, policy_version 40800 (0.0005) [2023-03-08 11:01:43,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 11496.6). Total num frames: 20914176. Throughput: 0: 12212.4. Samples: 20909708. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:01:43,080][389401] Avg episode reward: [(0, '4229.887')] [2023-03-08 11:01:44,553][389688] Updated weights for policy 0, policy_version 40880 (0.0005) [2023-03-08 11:01:48,079][389401] Fps is (10 sec: 11059.5, 60 sec: 12151.5, 300 sec: 11482.7). Total num frames: 20967424. Throughput: 0: 12153.7. Samples: 20942860. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:01:48,080][389401] Avg episode reward: [(0, '4412.105')] [2023-03-08 11:01:48,140][389688] Updated weights for policy 0, policy_version 40960 (0.0004) [2023-03-08 11:01:51,549][389688] Updated weights for policy 0, policy_version 41040 (0.0005) [2023-03-08 11:01:53,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 11510.5). Total num frames: 21028864. Throughput: 0: 12077.4. Samples: 21013572. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:01:53,080][389401] Avg episode reward: [(0, '4725.298')] [2023-03-08 11:01:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000041072_21028864.pth... [2023-03-08 11:01:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000040376_20672512.pth [2023-03-08 11:01:54,923][389688] Updated weights for policy 0, policy_version 41120 (0.0004) [2023-03-08 11:01:58,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12151.5, 300 sec: 11538.2). Total num frames: 21090304. Throughput: 0: 12008.6. Samples: 21086004. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:01:58,080][389401] Avg episode reward: [(0, '4613.858')] [2023-03-08 11:01:58,384][389688] Updated weights for policy 0, policy_version 41200 (0.0004) [2023-03-08 11:02:01,895][389688] Updated weights for policy 0, policy_version 41280 (0.0005) [2023-03-08 11:02:03,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11552.1). Total num frames: 21147648. Throughput: 0: 11909.0. Samples: 21120232. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:02:03,080][389401] Avg episode reward: [(0, '4512.412')] [2023-03-08 11:02:05,419][389688] Updated weights for policy 0, policy_version 41360 (0.0004) [2023-03-08 11:02:08,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11566.0). Total num frames: 21204992. Throughput: 0: 11905.3. Samples: 21191784. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:02:08,080][389401] Avg episode reward: [(0, '4681.127')] [2023-03-08 11:02:08,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000041416_21204992.pth... [2023-03-08 11:02:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000040736_20856832.pth [2023-03-08 11:02:08,838][389688] Updated weights for policy 0, policy_version 41440 (0.0005) [2023-03-08 11:02:12,169][389688] Updated weights for policy 0, policy_version 41520 (0.0004) [2023-03-08 11:02:13,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11593.8). Total num frames: 21266432. Throughput: 0: 11876.4. Samples: 21264076. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:02:13,080][389401] Avg episode reward: [(0, '4684.570')] [2023-03-08 11:02:15,539][389688] Updated weights for policy 0, policy_version 41600 (0.0004) [2023-03-08 11:02:18,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11621.5). Total num frames: 21327872. Throughput: 0: 11865.0. Samples: 21300288. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:02:18,080][389401] Avg episode reward: [(0, '4677.719')] [2023-03-08 11:02:18,907][389688] Updated weights for policy 0, policy_version 41680 (0.0005) [2023-03-08 11:02:22,264][389688] Updated weights for policy 0, policy_version 41760 (0.0004) [2023-03-08 11:02:23,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 11635.4). Total num frames: 21389312. Throughput: 0: 11832.9. Samples: 21373000. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:02:23,080][389401] Avg episode reward: [(0, '4645.049')] [2023-03-08 11:02:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000041776_21389312.pth... [2023-03-08 11:02:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000041072_21028864.pth [2023-03-08 11:02:25,779][389688] Updated weights for policy 0, policy_version 41840 (0.0004) [2023-03-08 11:02:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11649.3). Total num frames: 21446656. Throughput: 0: 11871.3. Samples: 21443916. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:02:28,080][389401] Avg episode reward: [(0, '4726.089')] [2023-03-08 11:02:29,223][389688] Updated weights for policy 0, policy_version 41920 (0.0005) [2023-03-08 11:02:32,573][389688] Updated weights for policy 0, policy_version 42000 (0.0005) [2023-03-08 11:02:33,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11663.2). Total num frames: 21508096. Throughput: 0: 11942.2. Samples: 21480260. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:02:33,080][389401] Avg episode reward: [(0, '4720.688')] [2023-03-08 11:02:35,934][389688] Updated weights for policy 0, policy_version 42080 (0.0005) [2023-03-08 11:02:38,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11878.4, 300 sec: 11677.1). Total num frames: 21569536. Throughput: 0: 12006.5. Samples: 21553864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:02:38,080][389401] Avg episode reward: [(0, '4727.404')] [2023-03-08 11:02:38,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000042128_21569536.pth... [2023-03-08 11:02:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000041416_21204992.pth [2023-03-08 11:02:39,377][389688] Updated weights for policy 0, policy_version 42160 (0.0005) [2023-03-08 11:02:42,933][389688] Updated weights for policy 0, policy_version 42240 (0.0004) [2023-03-08 11:02:43,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 11691.0). Total num frames: 21626880. Throughput: 0: 11946.5. Samples: 21623596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:02:43,080][389401] Avg episode reward: [(0, '4724.944')] [2023-03-08 11:02:46,536][389688] Updated weights for policy 0, policy_version 42320 (0.0005) [2023-03-08 11:02:48,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11946.6, 300 sec: 11691.0). Total num frames: 21684224. Throughput: 0: 11935.5. Samples: 21657328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:02:48,080][389401] Avg episode reward: [(0, '4728.009')] [2023-03-08 11:02:49,945][389688] Updated weights for policy 0, policy_version 42400 (0.0004) [2023-03-08 11:02:53,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11691.0). Total num frames: 21741568. Throughput: 0: 11933.9. Samples: 21728812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:02:53,080][389401] Avg episode reward: [(0, '4727.584')] [2023-03-08 11:02:53,085][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000042472_21745664.pth... [2023-03-08 11:02:53,087][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000041776_21389312.pth [2023-03-08 11:02:53,451][389688] Updated weights for policy 0, policy_version 42480 (0.0004) [2023-03-08 11:02:57,110][389688] Updated weights for policy 0, policy_version 42560 (0.0005) [2023-03-08 11:02:58,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11704.8). Total num frames: 21798912. Throughput: 0: 11842.7. Samples: 21797000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:02:58,080][389401] Avg episode reward: [(0, '4727.833')] [2023-03-08 11:03:00,891][389688] Updated weights for policy 0, policy_version 42640 (0.0005) [2023-03-08 11:03:03,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11741.9, 300 sec: 11691.0). Total num frames: 21852160. Throughput: 0: 11760.8. Samples: 21829524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:03:03,080][389401] Avg episode reward: [(0, '4727.411')] [2023-03-08 11:03:04,732][389688] Updated weights for policy 0, policy_version 42720 (0.0005) [2023-03-08 11:03:08,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11741.9, 300 sec: 11691.0). Total num frames: 21909504. Throughput: 0: 11598.0. Samples: 21894912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:03:08,080][389401] Avg episode reward: [(0, '4728.182')] [2023-03-08 11:03:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000042792_21909504.pth... [2023-03-08 11:03:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000042128_21569536.pth [2023-03-08 11:03:08,338][389688] Updated weights for policy 0, policy_version 42800 (0.0005) [2023-03-08 11:03:11,820][389688] Updated weights for policy 0, policy_version 42880 (0.0004) [2023-03-08 11:03:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11704.8). Total num frames: 21966848. Throughput: 0: 11571.6. Samples: 21964640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:03:13,080][389401] Avg episode reward: [(0, '4726.686')] [2023-03-08 11:03:15,386][389688] Updated weights for policy 0, policy_version 42960 (0.0005) [2023-03-08 11:03:18,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11718.7). Total num frames: 22024192. Throughput: 0: 11529.8. Samples: 21999100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:03:18,080][389401] Avg episode reward: [(0, '4727.238')] [2023-03-08 11:03:18,988][389688] Updated weights for policy 0, policy_version 43040 (0.0005) [2023-03-08 11:03:22,461][389688] Updated weights for policy 0, policy_version 43120 (0.0004) [2023-03-08 11:03:23,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 22081536. Throughput: 0: 11427.6. Samples: 22068104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:03:23,080][389401] Avg episode reward: [(0, '4727.996')] [2023-03-08 11:03:23,100][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000043136_22085632.pth... [2023-03-08 11:03:23,102][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000042472_21745664.pth [2023-03-08 11:03:25,962][389688] Updated weights for policy 0, policy_version 43200 (0.0004) [2023-03-08 11:03:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11732.6). Total num frames: 22138880. Throughput: 0: 11413.2. Samples: 22137188. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 11:03:28,080][389401] Avg episode reward: [(0, '4727.803')] [2023-03-08 11:03:29,667][389688] Updated weights for policy 0, policy_version 43280 (0.0005) [2023-03-08 11:03:33,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11732.6). Total num frames: 22196224. Throughput: 0: 11406.7. Samples: 22170628. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 11:03:33,080][389401] Avg episode reward: [(0, '4724.103')] [2023-03-08 11:03:33,270][389688] Updated weights for policy 0, policy_version 43360 (0.0005) [2023-03-08 11:03:36,868][389688] Updated weights for policy 0, policy_version 43440 (0.0005) [2023-03-08 11:03:38,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11732.6). Total num frames: 22253568. Throughput: 0: 11322.6. Samples: 22238328. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 11:03:38,080][389401] Avg episode reward: [(0, '4728.751')] [2023-03-08 11:03:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000043464_22253568.pth... [2023-03-08 11:03:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000042792_21909504.pth [2023-03-08 11:03:40,565][389688] Updated weights for policy 0, policy_version 43520 (0.0005) [2023-03-08 11:03:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11732.6). Total num frames: 22310912. Throughput: 0: 11329.2. Samples: 22306816. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 11:03:43,080][389401] Avg episode reward: [(0, '4725.332')] [2023-03-08 11:03:44,109][389688] Updated weights for policy 0, policy_version 43600 (0.0005) [2023-03-08 11:03:47,761][389688] Updated weights for policy 0, policy_version 43680 (0.0005) [2023-03-08 11:03:48,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 11704.8). Total num frames: 22364160. Throughput: 0: 11344.0. Samples: 22340004. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 11:03:48,080][389401] Avg episode reward: [(0, '4725.974')] [2023-03-08 11:03:51,339][389688] Updated weights for policy 0, policy_version 43760 (0.0004) [2023-03-08 11:03:53,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 11691.0). Total num frames: 22421504. Throughput: 0: 11429.0. Samples: 22409216. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 11:03:53,080][389401] Avg episode reward: [(0, '4727.799')] [2023-03-08 11:03:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000043800_22425600.pth... [2023-03-08 11:03:53,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000043136_22085632.pth [2023-03-08 11:03:54,831][389688] Updated weights for policy 0, policy_version 43840 (0.0005) [2023-03-08 11:03:58,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11400.5, 300 sec: 11691.0). Total num frames: 22482944. Throughput: 0: 11457.7. Samples: 22480236. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 11:03:58,080][389401] Avg episode reward: [(0, '4703.881')] [2023-03-08 11:03:58,209][389688] Updated weights for policy 0, policy_version 43920 (0.0004) [2023-03-08 11:04:01,617][389688] Updated weights for policy 0, policy_version 44000 (0.0004) [2023-03-08 11:04:03,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11537.1, 300 sec: 11718.7). Total num frames: 22544384. Throughput: 0: 11493.5. Samples: 22516308. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 11:04:03,080][389401] Avg episode reward: [(0, '4675.766')] [2023-03-08 11:04:05,068][389688] Updated weights for policy 0, policy_version 44080 (0.0004) [2023-03-08 11:04:08,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 11704.8). Total num frames: 22601728. Throughput: 0: 11548.1. Samples: 22587772. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 11:04:08,080][389401] Avg episode reward: [(0, '4559.730')] [2023-03-08 11:04:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000044144_22601728.pth... [2023-03-08 11:04:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000043464_22253568.pth [2023-03-08 11:04:08,495][389688] Updated weights for policy 0, policy_version 44160 (0.0004) [2023-03-08 11:04:12,002][389688] Updated weights for policy 0, policy_version 44240 (0.0004) [2023-03-08 11:04:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11704.8). Total num frames: 22659072. Throughput: 0: 11587.7. Samples: 22658636. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 11:04:13,080][389401] Avg episode reward: [(0, '4463.176')] [2023-03-08 11:04:15,618][389688] Updated weights for policy 0, policy_version 44320 (0.0003) [2023-03-08 11:04:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11718.7). Total num frames: 22720512. Throughput: 0: 11584.1. Samples: 22691912. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 11:04:18,080][389401] Avg episode reward: [(0, '4452.942')] [2023-03-08 11:04:19,087][389688] Updated weights for policy 0, policy_version 44400 (0.0004) [2023-03-08 11:04:22,586][389688] Updated weights for policy 0, policy_version 44480 (0.0004) [2023-03-08 11:04:23,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11732.6). Total num frames: 22777856. Throughput: 0: 11650.3. Samples: 22762592. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 11:04:23,080][389401] Avg episode reward: [(0, '4253.439')] [2023-03-08 11:04:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000044488_22777856.pth... [2023-03-08 11:04:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000043800_22425600.pth [2023-03-08 11:04:26,198][389688] Updated weights for policy 0, policy_version 44560 (0.0005) [2023-03-08 11:04:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 22835200. Throughput: 0: 11652.5. Samples: 22831176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:04:28,080][389401] Avg episode reward: [(0, '4230.146')] [2023-03-08 11:04:29,707][389688] Updated weights for policy 0, policy_version 44640 (0.0004) [2023-03-08 11:04:33,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 22892544. Throughput: 0: 11724.4. Samples: 22867604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:04:33,080][389401] Avg episode reward: [(0, '4726.546')] [2023-03-08 11:04:33,167][389688] Updated weights for policy 0, policy_version 44720 (0.0004) [2023-03-08 11:04:36,883][389688] Updated weights for policy 0, policy_version 44800 (0.0004) [2023-03-08 11:04:38,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11760.4). Total num frames: 22949888. Throughput: 0: 11686.9. Samples: 22935128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:04:38,080][389401] Avg episode reward: [(0, '4726.151')] [2023-03-08 11:04:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000044824_22949888.pth... [2023-03-08 11:04:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000044144_22601728.pth [2023-03-08 11:04:40,426][389688] Updated weights for policy 0, policy_version 44880 (0.0005) [2023-03-08 11:04:43,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11774.3). Total num frames: 23007232. Throughput: 0: 11654.2. Samples: 23004676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:04:43,080][389401] Avg episode reward: [(0, '4725.977')] [2023-03-08 11:04:43,960][389688] Updated weights for policy 0, policy_version 44960 (0.0006) [2023-03-08 11:04:47,599][389688] Updated weights for policy 0, policy_version 45040 (0.0005) [2023-03-08 11:04:48,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11774.3). Total num frames: 23064576. Throughput: 0: 11636.6. Samples: 23039956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:04:48,080][389401] Avg episode reward: [(0, '4731.997')] [2023-03-08 11:04:51,246][389688] Updated weights for policy 0, policy_version 45120 (0.0005) [2023-03-08 11:04:53,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11774.3). Total num frames: 23121920. Throughput: 0: 11518.4. Samples: 23106100. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:04:53,080][389401] Avg episode reward: [(0, '4727.924')] [2023-03-08 11:04:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000045160_23121920.pth... [2023-03-08 11:04:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000044488_22777856.pth [2023-03-08 11:04:54,925][389688] Updated weights for policy 0, policy_version 45200 (0.0005) [2023-03-08 11:04:58,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11537.1, 300 sec: 11774.3). Total num frames: 23175168. Throughput: 0: 11425.4. Samples: 23172780. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:04:58,080][389401] Avg episode reward: [(0, '4727.409')] [2023-03-08 11:04:58,606][389688] Updated weights for policy 0, policy_version 45280 (0.0005) [2023-03-08 11:05:02,044][389688] Updated weights for policy 0, policy_version 45360 (0.0005) [2023-03-08 11:05:03,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11788.2). Total num frames: 23236608. Throughput: 0: 11467.2. Samples: 23207936. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:05:03,080][389401] Avg episode reward: [(0, '4643.228')] [2023-03-08 11:05:05,251][389688] Updated weights for policy 0, policy_version 45440 (0.0004) [2023-03-08 11:05:08,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11605.3, 300 sec: 11802.0). Total num frames: 23298048. Throughput: 0: 11580.8. Samples: 23283728. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:05:08,080][389401] Avg episode reward: [(0, '4460.398')] [2023-03-08 11:05:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000045504_23298048.pth... [2023-03-08 11:05:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000044824_22949888.pth [2023-03-08 11:05:08,454][389688] Updated weights for policy 0, policy_version 45520 (0.0003) [2023-03-08 11:05:11,789][389688] Updated weights for policy 0, policy_version 45600 (0.0003) [2023-03-08 11:05:13,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 11815.9). Total num frames: 23359488. Throughput: 0: 11672.6. Samples: 23356444. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:05:13,080][389401] Avg episode reward: [(0, '4451.609')] [2023-03-08 11:05:15,591][389688] Updated weights for policy 0, policy_version 45680 (0.0005) [2023-03-08 11:05:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11815.9). Total num frames: 23416832. Throughput: 0: 11577.8. Samples: 23388604. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:05:18,080][389401] Avg episode reward: [(0, '4365.041')] [2023-03-08 11:05:18,999][389688] Updated weights for policy 0, policy_version 45760 (0.0005) [2023-03-08 11:05:22,351][389688] Updated weights for policy 0, policy_version 45840 (0.0005) [2023-03-08 11:05:23,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 11802.0). Total num frames: 23478272. Throughput: 0: 11707.2. Samples: 23461952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:05:23,080][389401] Avg episode reward: [(0, '3869.589')] [2023-03-08 11:05:23,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000045856_23478272.pth... [2023-03-08 11:05:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000045160_23121920.pth [2023-03-08 11:05:25,694][389688] Updated weights for policy 0, policy_version 45920 (0.0005) [2023-03-08 11:05:28,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 11788.2). Total num frames: 23535616. Throughput: 0: 11763.3. Samples: 23534024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:05:28,080][389401] Avg episode reward: [(0, '4411.013')] [2023-03-08 11:05:29,213][389688] Updated weights for policy 0, policy_version 46000 (0.0005) [2023-03-08 11:05:32,535][389688] Updated weights for policy 0, policy_version 46080 (0.0004) [2023-03-08 11:05:33,079][389401] Fps is (10 sec: 11878.2, 60 sec: 11741.8, 300 sec: 11788.1). Total num frames: 23597056. Throughput: 0: 11799.9. Samples: 23570952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:05:33,080][389401] Avg episode reward: [(0, '4724.373')] [2023-03-08 11:05:35,863][389688] Updated weights for policy 0, policy_version 46160 (0.0005) [2023-03-08 11:05:38,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11810.1, 300 sec: 11802.0). Total num frames: 23658496. Throughput: 0: 11928.9. Samples: 23642900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:05:38,080][389401] Avg episode reward: [(0, '4683.607')] [2023-03-08 11:05:38,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000046208_23658496.pth... [2023-03-08 11:05:38,087][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000045504_23298048.pth [2023-03-08 11:05:39,300][389688] Updated weights for policy 0, policy_version 46240 (0.0005) [2023-03-08 11:05:42,794][389688] Updated weights for policy 0, policy_version 46320 (0.0005) [2023-03-08 11:05:43,079][389401] Fps is (10 sec: 11878.7, 60 sec: 11810.1, 300 sec: 11788.2). Total num frames: 23715840. Throughput: 0: 12047.3. Samples: 23714908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:05:43,080][389401] Avg episode reward: [(0, '4429.415')] [2023-03-08 11:05:46,465][389688] Updated weights for policy 0, policy_version 46400 (0.0005) [2023-03-08 11:05:48,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 11760.4). Total num frames: 23773184. Throughput: 0: 12011.5. Samples: 23748452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:05:48,080][389401] Avg episode reward: [(0, '4644.973')] [2023-03-08 11:05:50,051][389688] Updated weights for policy 0, policy_version 46480 (0.0005) [2023-03-08 11:05:53,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 11760.4). Total num frames: 23830528. Throughput: 0: 11828.4. Samples: 23816004. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 11:05:53,080][389401] Avg episode reward: [(0, '4693.267')] [2023-03-08 11:05:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000046544_23830528.pth... [2023-03-08 11:05:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000045856_23478272.pth [2023-03-08 11:05:53,618][389688] Updated weights for policy 0, policy_version 46560 (0.0005) [2023-03-08 11:05:57,166][389688] Updated weights for policy 0, policy_version 46640 (0.0005) [2023-03-08 11:05:58,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11878.4, 300 sec: 11732.6). Total num frames: 23887872. Throughput: 0: 11763.3. Samples: 23885792. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 11:05:58,080][389401] Avg episode reward: [(0, '4726.328')] [2023-03-08 11:06:00,545][389688] Updated weights for policy 0, policy_version 46720 (0.0005) [2023-03-08 11:06:03,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11746.5). Total num frames: 23949312. Throughput: 0: 11849.8. Samples: 23921844. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 11:06:03,080][389401] Avg episode reward: [(0, '4725.127')] [2023-03-08 11:06:03,914][389688] Updated weights for policy 0, policy_version 46800 (0.0004) [2023-03-08 11:06:07,290][389688] Updated weights for policy 0, policy_version 46880 (0.0005) [2023-03-08 11:06:08,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11732.6). Total num frames: 24010752. Throughput: 0: 11840.4. Samples: 23994772. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 11:06:08,080][389401] Avg episode reward: [(0, '4724.593')] [2023-03-08 11:06:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000046896_24010752.pth... [2023-03-08 11:06:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000046208_23658496.pth [2023-03-08 11:06:10,593][389688] Updated weights for policy 0, policy_version 46960 (0.0004) [2023-03-08 11:06:13,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11878.4, 300 sec: 11732.6). Total num frames: 24072192. Throughput: 0: 11911.3. Samples: 24070032. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 11:06:13,080][389401] Avg episode reward: [(0, '4710.267')] [2023-03-08 11:06:13,809][389688] Updated weights for policy 0, policy_version 47040 (0.0004) [2023-03-08 11:06:17,099][389688] Updated weights for policy 0, policy_version 47120 (0.0004) [2023-03-08 11:06:18,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11732.6). Total num frames: 24133632. Throughput: 0: 11934.7. Samples: 24108012. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 11:06:18,080][389401] Avg episode reward: [(0, '4582.447')] [2023-03-08 11:06:20,475][389688] Updated weights for policy 0, policy_version 47200 (0.0005) [2023-03-08 11:06:23,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11946.6, 300 sec: 11732.6). Total num frames: 24195072. Throughput: 0: 11962.9. Samples: 24181232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:06:23,080][389401] Avg episode reward: [(0, '4651.207')] [2023-03-08 11:06:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000047256_24195072.pth... [2023-03-08 11:06:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000046544_23830528.pth [2023-03-08 11:06:23,898][389688] Updated weights for policy 0, policy_version 47280 (0.0005) [2023-03-08 11:06:27,451][389688] Updated weights for policy 0, policy_version 47360 (0.0005) [2023-03-08 11:06:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11718.7). Total num frames: 24252416. Throughput: 0: 11916.2. Samples: 24251140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:06:28,080][389401] Avg episode reward: [(0, '4598.465')] [2023-03-08 11:06:30,886][389688] Updated weights for policy 0, policy_version 47440 (0.0005) [2023-03-08 11:06:33,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 11718.7). Total num frames: 24313856. Throughput: 0: 11953.0. Samples: 24286336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:06:33,080][389401] Avg episode reward: [(0, '4678.571')] [2023-03-08 11:06:34,402][389688] Updated weights for policy 0, policy_version 47520 (0.0005) [2023-03-08 11:06:37,877][389688] Updated weights for policy 0, policy_version 47600 (0.0005) [2023-03-08 11:06:38,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11718.7). Total num frames: 24371200. Throughput: 0: 11986.0. Samples: 24355376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:06:38,080][389401] Avg episode reward: [(0, '4693.893')] [2023-03-08 11:06:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000047600_24371200.pth... [2023-03-08 11:06:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000046896_24010752.pth [2023-03-08 11:06:41,199][389688] Updated weights for policy 0, policy_version 47680 (0.0004) [2023-03-08 11:06:43,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11946.6, 300 sec: 11746.5). Total num frames: 24432640. Throughput: 0: 12066.0. Samples: 24428764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:06:43,080][389401] Avg episode reward: [(0, '4619.149')] [2023-03-08 11:06:44,602][389688] Updated weights for policy 0, policy_version 47760 (0.0005) [2023-03-08 11:06:47,745][389688] Updated weights for policy 0, policy_version 47840 (0.0004) [2023-03-08 11:06:48,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12083.2, 300 sec: 11760.4). Total num frames: 24498176. Throughput: 0: 12113.4. Samples: 24466948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:06:48,080][389401] Avg episode reward: [(0, '4627.895')] [2023-03-08 11:06:51,244][389688] Updated weights for policy 0, policy_version 47920 (0.0005) [2023-03-08 11:06:53,079][389401] Fps is (10 sec: 12288.2, 60 sec: 12083.2, 300 sec: 11746.5). Total num frames: 24555520. Throughput: 0: 12098.8. Samples: 24539216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:06:53,080][389401] Avg episode reward: [(0, '4640.970')] [2023-03-08 11:06:53,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000047960_24555520.pth... [2023-03-08 11:06:53,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000047256_24195072.pth [2023-03-08 11:06:54,698][389688] Updated weights for policy 0, policy_version 48000 (0.0005) [2023-03-08 11:06:58,079][389401] Fps is (10 sec: 11468.9, 60 sec: 12083.2, 300 sec: 11746.5). Total num frames: 24612864. Throughput: 0: 12011.8. Samples: 24610564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:06:58,080][389401] Avg episode reward: [(0, '4575.459')] [2023-03-08 11:06:58,209][389688] Updated weights for policy 0, policy_version 48080 (0.0005) [2023-03-08 11:07:01,567][389688] Updated weights for policy 0, policy_version 48160 (0.0004) [2023-03-08 11:07:03,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11760.4). Total num frames: 24674304. Throughput: 0: 11951.7. Samples: 24645836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:07:03,080][389401] Avg episode reward: [(0, '4725.757')] [2023-03-08 11:07:04,825][389688] Updated weights for policy 0, policy_version 48240 (0.0005) [2023-03-08 11:07:08,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11760.4). Total num frames: 24735744. Throughput: 0: 11992.5. Samples: 24720896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:07:08,080][389401] Avg episode reward: [(0, '4670.667')] [2023-03-08 11:07:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000048312_24735744.pth... [2023-03-08 11:07:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000047600_24371200.pth [2023-03-08 11:07:08,233][389688] Updated weights for policy 0, policy_version 48320 (0.0005) [2023-03-08 11:07:11,644][389688] Updated weights for policy 0, policy_version 48400 (0.0005) [2023-03-08 11:07:13,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12015.0, 300 sec: 11746.5). Total num frames: 24793088. Throughput: 0: 12043.3. Samples: 24793088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:07:13,080][389401] Avg episode reward: [(0, '4596.187')] [2023-03-08 11:07:15,207][389688] Updated weights for policy 0, policy_version 48480 (0.0005) [2023-03-08 11:07:18,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12014.9, 300 sec: 11746.5). Total num frames: 24854528. Throughput: 0: 12027.7. Samples: 24827580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:07:18,080][389401] Avg episode reward: [(0, '4526.565')] [2023-03-08 11:07:18,568][389688] Updated weights for policy 0, policy_version 48560 (0.0005) [2023-03-08 11:07:22,071][389688] Updated weights for policy 0, policy_version 48640 (0.0005) [2023-03-08 11:07:23,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11746.5). Total num frames: 24911872. Throughput: 0: 12082.2. Samples: 24899072. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 11:07:23,080][389401] Avg episode reward: [(0, '4482.572')] [2023-03-08 11:07:23,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000048664_24915968.pth... [2023-03-08 11:07:23,083][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000047960_24555520.pth [2023-03-08 11:07:25,517][389688] Updated weights for policy 0, policy_version 48720 (0.0005) [2023-03-08 11:07:28,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12014.9, 300 sec: 11746.5). Total num frames: 24973312. Throughput: 0: 12026.2. Samples: 24969944. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 11:07:28,080][389401] Avg episode reward: [(0, '4648.819')] [2023-03-08 11:07:28,807][389688] Updated weights for policy 0, policy_version 48800 (0.0005) [2023-03-08 11:07:32,090][389688] Updated weights for policy 0, policy_version 48880 (0.0005) [2023-03-08 11:07:33,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12083.2, 300 sec: 11760.4). Total num frames: 25038848. Throughput: 0: 12043.4. Samples: 25008900. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 11:07:33,080][389401] Avg episode reward: [(0, '3815.589')] [2023-03-08 11:07:35,443][389688] Updated weights for policy 0, policy_version 48960 (0.0005) [2023-03-08 11:07:38,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12083.2, 300 sec: 11760.4). Total num frames: 25096192. Throughput: 0: 12073.0. Samples: 25082500. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 11:07:38,080][389401] Avg episode reward: [(0, '4647.740')] [2023-03-08 11:07:38,104][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000049024_25100288.pth... [2023-03-08 11:07:38,105][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000048312_24735744.pth [2023-03-08 11:07:38,755][389688] Updated weights for policy 0, policy_version 49040 (0.0005) [2023-03-08 11:07:42,011][389688] Updated weights for policy 0, policy_version 49120 (0.0005) [2023-03-08 11:07:43,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11788.2). Total num frames: 25161728. Throughput: 0: 12157.3. Samples: 25157644. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 11:07:43,080][389401] Avg episode reward: [(0, '4724.695')] [2023-03-08 11:07:45,361][389688] Updated weights for policy 0, policy_version 49200 (0.0005) [2023-03-08 11:07:48,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12083.2, 300 sec: 11802.0). Total num frames: 25223168. Throughput: 0: 12192.6. Samples: 25194504. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 11:07:48,080][389401] Avg episode reward: [(0, '4625.556')] [2023-03-08 11:07:48,631][389688] Updated weights for policy 0, policy_version 49280 (0.0005) [2023-03-08 11:07:51,876][389688] Updated weights for policy 0, policy_version 49360 (0.0005) [2023-03-08 11:07:53,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12151.4, 300 sec: 11815.9). Total num frames: 25284608. Throughput: 0: 12186.7. Samples: 25269296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:07:53,080][389401] Avg episode reward: [(0, '4711.270')] [2023-03-08 11:07:53,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000049384_25284608.pth... [2023-03-08 11:07:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000048664_24915968.pth [2023-03-08 11:07:55,029][389688] Updated weights for policy 0, policy_version 49440 (0.0004) [2023-03-08 11:07:58,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12288.0, 300 sec: 11857.6). Total num frames: 25350144. Throughput: 0: 12289.4. Samples: 25346112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:07:58,080][389401] Avg episode reward: [(0, '4369.096')] [2023-03-08 11:07:58,312][389688] Updated weights for policy 0, policy_version 49520 (0.0005) [2023-03-08 11:08:01,659][389688] Updated weights for policy 0, policy_version 49600 (0.0005) [2023-03-08 11:08:03,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12219.7, 300 sec: 11857.6). Total num frames: 25407488. Throughput: 0: 12342.1. Samples: 25382976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:08:03,080][389401] Avg episode reward: [(0, '4647.652')] [2023-03-08 11:08:05,220][389688] Updated weights for policy 0, policy_version 49680 (0.0005) [2023-03-08 11:08:08,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12219.7, 300 sec: 11871.5). Total num frames: 25468928. Throughput: 0: 12336.5. Samples: 25454216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:08:08,080][389401] Avg episode reward: [(0, '4679.899')] [2023-03-08 11:08:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000049744_25468928.pth... [2023-03-08 11:08:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000049024_25100288.pth [2023-03-08 11:08:08,590][389688] Updated weights for policy 0, policy_version 49760 (0.0005) [2023-03-08 11:08:12,017][389688] Updated weights for policy 0, policy_version 49840 (0.0005) [2023-03-08 11:08:13,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 11885.3). Total num frames: 25530368. Throughput: 0: 12362.7. Samples: 25526264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:08:13,080][389401] Avg episode reward: [(0, '4726.316')] [2023-03-08 11:08:15,343][389688] Updated weights for policy 0, policy_version 49920 (0.0005) [2023-03-08 11:08:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 11885.3). Total num frames: 25587712. Throughput: 0: 12317.8. Samples: 25563200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:08:18,080][389401] Avg episode reward: [(0, '4721.573')] [2023-03-08 11:08:18,804][389688] Updated weights for policy 0, policy_version 50000 (0.0005) [2023-03-08 11:08:22,074][389688] Updated weights for policy 0, policy_version 50080 (0.0004) [2023-03-08 11:08:23,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12356.2, 300 sec: 11913.1). Total num frames: 25653248. Throughput: 0: 12297.5. Samples: 25635888. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:08:23,080][389401] Avg episode reward: [(0, '4720.696')] [2023-03-08 11:08:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000050104_25653248.pth... [2023-03-08 11:08:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000049384_25284608.pth [2023-03-08 11:08:25,266][389688] Updated weights for policy 0, policy_version 50160 (0.0005) [2023-03-08 11:08:28,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12356.3, 300 sec: 11927.0). Total num frames: 25714688. Throughput: 0: 12299.7. Samples: 25711132. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:08:28,080][389401] Avg episode reward: [(0, '4721.202')] [2023-03-08 11:08:28,614][389688] Updated weights for policy 0, policy_version 50240 (0.0005) [2023-03-08 11:08:32,116][389688] Updated weights for policy 0, policy_version 50320 (0.0005) [2023-03-08 11:08:33,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12219.7, 300 sec: 11927.0). Total num frames: 25772032. Throughput: 0: 12284.6. Samples: 25747312. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:08:33,080][389401] Avg episode reward: [(0, '4664.305')] [2023-03-08 11:08:35,625][389688] Updated weights for policy 0, policy_version 50400 (0.0005) [2023-03-08 11:08:38,079][389401] Fps is (10 sec: 11468.9, 60 sec: 12219.7, 300 sec: 11927.0). Total num frames: 25829376. Throughput: 0: 12173.2. Samples: 25817088. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:08:38,080][389401] Avg episode reward: [(0, '4281.415')] [2023-03-08 11:08:38,126][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000050456_25833472.pth... [2023-03-08 11:08:38,128][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000049744_25468928.pth [2023-03-08 11:08:39,129][389688] Updated weights for policy 0, policy_version 50480 (0.0005) [2023-03-08 11:08:42,503][389688] Updated weights for policy 0, policy_version 50560 (0.0005) [2023-03-08 11:08:43,079][389401] Fps is (10 sec: 11878.2, 60 sec: 12151.4, 300 sec: 11954.8). Total num frames: 25890816. Throughput: 0: 12050.9. Samples: 25888404. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:08:43,080][389401] Avg episode reward: [(0, '4370.106')] [2023-03-08 11:08:45,999][389688] Updated weights for policy 0, policy_version 50640 (0.0006) [2023-03-08 11:08:48,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11968.7). Total num frames: 25952256. Throughput: 0: 12013.7. Samples: 25923592. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:08:48,080][389401] Avg episode reward: [(0, '4510.265')] [2023-03-08 11:08:49,474][389688] Updated weights for policy 0, policy_version 50720 (0.0005) [2023-03-08 11:08:53,079][389401] Fps is (10 sec: 11468.9, 60 sec: 12014.9, 300 sec: 11940.9). Total num frames: 26005504. Throughput: 0: 11974.4. Samples: 25993064. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:08:53,080][389401] Avg episode reward: [(0, '4721.141')] [2023-03-08 11:08:53,144][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000050800_26009600.pth... [2023-03-08 11:08:53,145][389688] Updated weights for policy 0, policy_version 50800 (0.0005) [2023-03-08 11:08:53,146][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000050104_25653248.pth [2023-03-08 11:08:56,537][389688] Updated weights for policy 0, policy_version 50880 (0.0005) [2023-03-08 11:08:58,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11946.6, 300 sec: 11940.9). Total num frames: 26066944. Throughput: 0: 11934.2. Samples: 26063304. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:08:58,080][389401] Avg episode reward: [(0, '3986.741')] [2023-03-08 11:09:00,083][389688] Updated weights for policy 0, policy_version 50960 (0.0005) [2023-03-08 11:09:03,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11940.9). Total num frames: 26124288. Throughput: 0: 11879.5. Samples: 26097776. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:09:03,080][389401] Avg episode reward: [(0, '4247.740')] [2023-03-08 11:09:03,786][389688] Updated weights for policy 0, policy_version 51040 (0.0006) [2023-03-08 11:09:07,500][389688] Updated weights for policy 0, policy_version 51120 (0.0005) [2023-03-08 11:09:08,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11810.1, 300 sec: 11927.0). Total num frames: 26177536. Throughput: 0: 11738.6. Samples: 26164124. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:09:08,080][389401] Avg episode reward: [(0, '4701.176')] [2023-03-08 11:09:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000051128_26177536.pth... [2023-03-08 11:09:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000050456_25833472.pth [2023-03-08 11:09:11,110][389688] Updated weights for policy 0, policy_version 51200 (0.0006) [2023-03-08 11:09:13,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11741.9, 300 sec: 11913.1). Total num frames: 26234880. Throughput: 0: 11588.8. Samples: 26232628. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:09:13,090][389401] Avg episode reward: [(0, '4475.599')] [2023-03-08 11:09:14,629][389688] Updated weights for policy 0, policy_version 51280 (0.0005) [2023-03-08 11:09:18,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 11913.1). Total num frames: 26292224. Throughput: 0: 11558.1. Samples: 26267428. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:09:18,090][389401] Avg episode reward: [(0, '4723.649')] [2023-03-08 11:09:18,150][389688] Updated weights for policy 0, policy_version 51360 (0.0005) [2023-03-08 11:09:21,871][389688] Updated weights for policy 0, policy_version 51440 (0.0006) [2023-03-08 11:09:23,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11913.1). Total num frames: 26349568. Throughput: 0: 11511.1. Samples: 26335088. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:09:23,080][389401] Avg episode reward: [(0, '4623.241')] [2023-03-08 11:09:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000051464_26349568.pth... [2023-03-08 11:09:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000050800_26009600.pth [2023-03-08 11:09:25,401][389688] Updated weights for policy 0, policy_version 51520 (0.0005) [2023-03-08 11:09:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11913.1). Total num frames: 26406912. Throughput: 0: 11483.2. Samples: 26405148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:09:28,080][389401] Avg episode reward: [(0, '4091.585')] [2023-03-08 11:09:28,885][389688] Updated weights for policy 0, policy_version 51600 (0.0005) [2023-03-08 11:09:32,261][389688] Updated weights for policy 0, policy_version 51680 (0.0005) [2023-03-08 11:09:33,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11927.0). Total num frames: 26468352. Throughput: 0: 11468.9. Samples: 26439692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:09:33,080][389401] Avg episode reward: [(0, '4628.401')] [2023-03-08 11:09:35,740][389688] Updated weights for policy 0, policy_version 51760 (0.0005) [2023-03-08 11:09:38,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11927.0). Total num frames: 26525696. Throughput: 0: 11541.3. Samples: 26512424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:09:38,080][389401] Avg episode reward: [(0, '4725.433')] [2023-03-08 11:09:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000051808_26525696.pth... [2023-03-08 11:09:38,088][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000051128_26177536.pth [2023-03-08 11:09:39,300][389688] Updated weights for policy 0, policy_version 51840 (0.0004) [2023-03-08 11:09:42,906][389688] Updated weights for policy 0, policy_version 51920 (0.0004) [2023-03-08 11:09:43,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11927.0). Total num frames: 26583040. Throughput: 0: 11477.4. Samples: 26579788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:09:43,080][389401] Avg episode reward: [(0, '4680.947')] [2023-03-08 11:09:46,394][389688] Updated weights for policy 0, policy_version 52000 (0.0005) [2023-03-08 11:09:48,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11537.1, 300 sec: 11940.9). Total num frames: 26644480. Throughput: 0: 11507.7. Samples: 26615624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:09:48,080][389401] Avg episode reward: [(0, '4571.936')] [2023-03-08 11:09:49,676][389688] Updated weights for policy 0, policy_version 52080 (0.0004) [2023-03-08 11:09:53,002][389688] Updated weights for policy 0, policy_version 52160 (0.0004) [2023-03-08 11:09:53,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11673.6, 300 sec: 11968.6). Total num frames: 26705920. Throughput: 0: 11676.0. Samples: 26689544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:09:53,080][389401] Avg episode reward: [(0, '4567.200')] [2023-03-08 11:09:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000052160_26705920.pth... [2023-03-08 11:09:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000051464_26349568.pth [2023-03-08 11:09:56,247][389688] Updated weights for policy 0, policy_version 52240 (0.0004) [2023-03-08 11:09:58,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 11968.7). Total num frames: 26767360. Throughput: 0: 11791.3. Samples: 26763236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:09:58,080][389401] Avg episode reward: [(0, '4621.348')] [2023-03-08 11:09:59,717][389688] Updated weights for policy 0, policy_version 52320 (0.0004) [2023-03-08 11:10:03,017][389688] Updated weights for policy 0, policy_version 52400 (0.0004) [2023-03-08 11:10:03,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11741.9, 300 sec: 11968.7). Total num frames: 26828800. Throughput: 0: 11821.5. Samples: 26799396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:10:03,080][389401] Avg episode reward: [(0, '4538.132')] [2023-03-08 11:10:06,336][389688] Updated weights for policy 0, policy_version 52480 (0.0004) [2023-03-08 11:10:08,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11968.7). Total num frames: 26890240. Throughput: 0: 11974.1. Samples: 26873920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:10:08,080][389401] Avg episode reward: [(0, '4724.302')] [2023-03-08 11:10:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000052520_26890240.pth... [2023-03-08 11:10:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000051808_26525696.pth [2023-03-08 11:10:09,619][389688] Updated weights for policy 0, policy_version 52560 (0.0004) [2023-03-08 11:10:12,957][389688] Updated weights for policy 0, policy_version 52640 (0.0004) [2023-03-08 11:10:13,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11982.5). Total num frames: 26951680. Throughput: 0: 12055.8. Samples: 26947656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:10:13,090][389401] Avg episode reward: [(0, '4723.779')] [2023-03-08 11:10:16,385][389688] Updated weights for policy 0, policy_version 52720 (0.0004) [2023-03-08 11:10:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11968.6). Total num frames: 27009024. Throughput: 0: 12104.7. Samples: 26984404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:10:18,080][389401] Avg episode reward: [(0, '4613.312')] [2023-03-08 11:10:20,023][389688] Updated weights for policy 0, policy_version 52800 (0.0005) [2023-03-08 11:10:23,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11968.6). Total num frames: 27066368. Throughput: 0: 12002.1. Samples: 27052516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:10:23,080][389401] Avg episode reward: [(0, '4541.620')] [2023-03-08 11:10:23,116][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000052872_27070464.pth... [2023-03-08 11:10:23,117][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000052160_26705920.pth [2023-03-08 11:10:23,438][389688] Updated weights for policy 0, policy_version 52880 (0.0004) [2023-03-08 11:10:26,775][389688] Updated weights for policy 0, policy_version 52960 (0.0005) [2023-03-08 11:10:28,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11982.5). Total num frames: 27131904. Throughput: 0: 12155.8. Samples: 27126800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:10:28,090][389401] Avg episode reward: [(0, '4691.468')] [2023-03-08 11:10:30,056][389688] Updated weights for policy 0, policy_version 53040 (0.0005) [2023-03-08 11:10:33,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11968.7). Total num frames: 27189248. Throughput: 0: 12182.0. Samples: 27163816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:10:33,080][389401] Avg episode reward: [(0, '4727.874')] [2023-03-08 11:10:33,419][389688] Updated weights for policy 0, policy_version 53120 (0.0005) [2023-03-08 11:10:36,948][389688] Updated weights for policy 0, policy_version 53200 (0.0005) [2023-03-08 11:10:38,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11982.5). Total num frames: 27250688. Throughput: 0: 12120.7. Samples: 27234976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:10:38,080][389401] Avg episode reward: [(0, '3959.260')] [2023-03-08 11:10:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000053224_27250688.pth... [2023-03-08 11:10:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000052520_26890240.pth [2023-03-08 11:10:40,520][389688] Updated weights for policy 0, policy_version 53280 (0.0006) [2023-03-08 11:10:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11968.6). Total num frames: 27303936. Throughput: 0: 12006.8. Samples: 27303544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:10:43,080][389401] Avg episode reward: [(0, '4482.699')] [2023-03-08 11:10:44,164][389688] Updated weights for policy 0, policy_version 53360 (0.0005) [2023-03-08 11:10:47,682][389688] Updated weights for policy 0, policy_version 53440 (0.0005) [2023-03-08 11:10:48,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11982.5). Total num frames: 27365376. Throughput: 0: 11943.0. Samples: 27336832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:10:48,080][389401] Avg episode reward: [(0, '4615.949')] [2023-03-08 11:10:51,185][389688] Updated weights for policy 0, policy_version 53520 (0.0005) [2023-03-08 11:10:53,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11982.5). Total num frames: 27422720. Throughput: 0: 11864.5. Samples: 27407824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:10:53,080][389401] Avg episode reward: [(0, '4651.782')] [2023-03-08 11:10:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000053560_27422720.pth... [2023-03-08 11:10:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000052872_27070464.pth [2023-03-08 11:10:54,544][389688] Updated weights for policy 0, policy_version 53600 (0.0004) [2023-03-08 11:10:58,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11878.4, 300 sec: 11968.7). Total num frames: 27480064. Throughput: 0: 11825.6. Samples: 27479808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:10:58,080][389401] Avg episode reward: [(0, '4578.943')] [2023-03-08 11:10:58,091][389688] Updated weights for policy 0, policy_version 53680 (0.0005) [2023-03-08 11:11:01,561][389688] Updated weights for policy 0, policy_version 53760 (0.0004) [2023-03-08 11:11:03,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11968.7). Total num frames: 27541504. Throughput: 0: 11783.6. Samples: 27514668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:11:03,080][389401] Avg episode reward: [(0, '4729.935')] [2023-03-08 11:11:04,990][389688] Updated weights for policy 0, policy_version 53840 (0.0005) [2023-03-08 11:11:08,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11954.8). Total num frames: 27598848. Throughput: 0: 11861.3. Samples: 27586276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:11:08,080][389401] Avg episode reward: [(0, '4646.246')] [2023-03-08 11:11:08,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000053904_27598848.pth... [2023-03-08 11:11:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000053224_27250688.pth [2023-03-08 11:11:08,500][389688] Updated weights for policy 0, policy_version 53920 (0.0004) [2023-03-08 11:11:11,834][389688] Updated weights for policy 0, policy_version 54000 (0.0005) [2023-03-08 11:11:13,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11954.8). Total num frames: 27660288. Throughput: 0: 11788.8. Samples: 27657296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:11:13,080][389401] Avg episode reward: [(0, '4680.499')] [2023-03-08 11:11:15,323][389688] Updated weights for policy 0, policy_version 54080 (0.0004) [2023-03-08 11:11:18,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11810.1, 300 sec: 11940.9). Total num frames: 27717632. Throughput: 0: 11760.9. Samples: 27693056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:11:18,080][389401] Avg episode reward: [(0, '4730.634')] [2023-03-08 11:11:18,900][389688] Updated weights for policy 0, policy_version 54160 (0.0005) [2023-03-08 11:11:22,449][389688] Updated weights for policy 0, policy_version 54240 (0.0005) [2023-03-08 11:11:23,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11940.9). Total num frames: 27774976. Throughput: 0: 11696.7. Samples: 27761328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:11:23,080][389401] Avg episode reward: [(0, '4652.481')] [2023-03-08 11:11:23,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000054248_27774976.pth... [2023-03-08 11:11:23,087][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000053560_27422720.pth [2023-03-08 11:11:26,044][389688] Updated weights for policy 0, policy_version 54320 (0.0005) [2023-03-08 11:11:28,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 11927.0). Total num frames: 27832320. Throughput: 0: 11706.8. Samples: 27830352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:11:28,080][389401] Avg episode reward: [(0, '4658.218')] [2023-03-08 11:11:29,624][389688] Updated weights for policy 0, policy_version 54400 (0.0005) [2023-03-08 11:11:33,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 11927.0). Total num frames: 27889664. Throughput: 0: 11739.4. Samples: 27865104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:11:33,080][389401] Avg episode reward: [(0, '4729.192')] [2023-03-08 11:11:33,200][389688] Updated weights for policy 0, policy_version 54480 (0.0005) [2023-03-08 11:11:36,750][389688] Updated weights for policy 0, policy_version 54560 (0.0005) [2023-03-08 11:11:38,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11913.1). Total num frames: 27947008. Throughput: 0: 11695.8. Samples: 27934136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:11:38,080][389401] Avg episode reward: [(0, '4695.233')] [2023-03-08 11:11:38,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000054584_27947008.pth... [2023-03-08 11:11:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000053904_27598848.pth [2023-03-08 11:11:40,290][389688] Updated weights for policy 0, policy_version 54640 (0.0005) [2023-03-08 11:11:43,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11899.2). Total num frames: 28008448. Throughput: 0: 11683.3. Samples: 28005556. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:11:43,080][389401] Avg episode reward: [(0, '4686.975')] [2023-03-08 11:11:43,493][389688] Updated weights for policy 0, policy_version 54720 (0.0004) [2023-03-08 11:11:47,018][389688] Updated weights for policy 0, policy_version 54800 (0.0004) [2023-03-08 11:11:48,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11741.9, 300 sec: 11913.1). Total num frames: 28069888. Throughput: 0: 11715.3. Samples: 28041856. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:11:48,080][389401] Avg episode reward: [(0, '4729.850')] [2023-03-08 11:11:50,591][389688] Updated weights for policy 0, policy_version 54880 (0.0004) [2023-03-08 11:11:53,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11913.1). Total num frames: 28127232. Throughput: 0: 11670.0. Samples: 28111424. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:11:53,080][389401] Avg episode reward: [(0, '4704.331')] [2023-03-08 11:11:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000054936_28127232.pth... [2023-03-08 11:11:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000054248_27774976.pth [2023-03-08 11:11:54,150][389688] Updated weights for policy 0, policy_version 54960 (0.0004) [2023-03-08 11:11:57,616][389688] Updated weights for policy 0, policy_version 55040 (0.0005) [2023-03-08 11:11:58,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11899.2). Total num frames: 28184576. Throughput: 0: 11627.9. Samples: 28180552. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:11:58,080][389401] Avg episode reward: [(0, '4727.574')] [2023-03-08 11:12:01,295][389688] Updated weights for policy 0, policy_version 55120 (0.0005) [2023-03-08 11:12:03,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11605.4, 300 sec: 11871.5). Total num frames: 28237824. Throughput: 0: 11580.5. Samples: 28214180. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:12:03,080][389401] Avg episode reward: [(0, '4685.199')] [2023-03-08 11:12:05,001][389688] Updated weights for policy 0, policy_version 55200 (0.0005) [2023-03-08 11:12:08,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11605.3, 300 sec: 11871.5). Total num frames: 28295168. Throughput: 0: 11573.1. Samples: 28282116. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:12:08,080][389401] Avg episode reward: [(0, '4565.141')] [2023-03-08 11:12:08,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000055264_28295168.pth... [2023-03-08 11:12:08,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000054584_27947008.pth [2023-03-08 11:12:08,511][389688] Updated weights for policy 0, policy_version 55280 (0.0004) [2023-03-08 11:12:12,053][389688] Updated weights for policy 0, policy_version 55360 (0.0005) [2023-03-08 11:12:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11857.6). Total num frames: 28352512. Throughput: 0: 11590.9. Samples: 28351940. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 11:12:13,080][389401] Avg episode reward: [(0, '4724.160')] [2023-03-08 11:12:15,562][389688] Updated weights for policy 0, policy_version 55440 (0.0005) [2023-03-08 11:12:18,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 11871.5). Total num frames: 28413952. Throughput: 0: 11579.1. Samples: 28386164. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 11:12:18,080][389401] Avg episode reward: [(0, '4725.509')] [2023-03-08 11:12:19,029][389688] Updated weights for policy 0, policy_version 55520 (0.0005) [2023-03-08 11:12:22,386][389688] Updated weights for policy 0, policy_version 55600 (0.0004) [2023-03-08 11:12:23,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11673.6, 300 sec: 11871.5). Total num frames: 28475392. Throughput: 0: 11639.9. Samples: 28457932. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 11:12:23,080][389401] Avg episode reward: [(0, '4723.739')] [2023-03-08 11:12:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000055616_28475392.pth... [2023-03-08 11:12:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000054936_28127232.pth [2023-03-08 11:12:25,763][389688] Updated weights for policy 0, policy_version 55680 (0.0005) [2023-03-08 11:12:28,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 11843.7). Total num frames: 28532736. Throughput: 0: 11693.4. Samples: 28531760. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 11:12:28,080][389401] Avg episode reward: [(0, '4477.095')] [2023-03-08 11:12:29,153][389688] Updated weights for policy 0, policy_version 55760 (0.0004) [2023-03-08 11:12:32,651][389688] Updated weights for policy 0, policy_version 55840 (0.0005) [2023-03-08 11:12:33,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11741.9, 300 sec: 11857.6). Total num frames: 28594176. Throughput: 0: 11666.7. Samples: 28566856. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 11:12:33,080][389401] Avg episode reward: [(0, '3443.951')] [2023-03-08 11:12:36,041][389688] Updated weights for policy 0, policy_version 55920 (0.0005) [2023-03-08 11:12:38,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11810.1, 300 sec: 11843.7). Total num frames: 28655616. Throughput: 0: 11729.2. Samples: 28639240. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 11:12:38,080][389401] Avg episode reward: [(0, '4418.071')] [2023-03-08 11:12:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000055968_28655616.pth... [2023-03-08 11:12:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000055264_28295168.pth [2023-03-08 11:12:39,146][389688] Updated weights for policy 0, policy_version 56000 (0.0004) [2023-03-08 11:12:42,630][389688] Updated weights for policy 0, policy_version 56080 (0.0005) [2023-03-08 11:12:43,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 11843.7). Total num frames: 28717056. Throughput: 0: 11832.9. Samples: 28713032. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 11:12:43,080][389401] Avg episode reward: [(0, '4595.941')] [2023-03-08 11:12:46,134][389688] Updated weights for policy 0, policy_version 56160 (0.0005) [2023-03-08 11:12:48,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11829.8). Total num frames: 28774400. Throughput: 0: 11875.5. Samples: 28748580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:12:48,080][389401] Avg episode reward: [(0, '4683.892')] [2023-03-08 11:12:49,632][389688] Updated weights for policy 0, policy_version 56240 (0.0005) [2023-03-08 11:12:52,988][389688] Updated weights for policy 0, policy_version 56320 (0.0004) [2023-03-08 11:12:53,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11815.9). Total num frames: 28835840. Throughput: 0: 11942.5. Samples: 28819528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:12:53,080][389401] Avg episode reward: [(0, '4616.599')] [2023-03-08 11:12:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000056320_28835840.pth... [2023-03-08 11:12:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000055616_28475392.pth [2023-03-08 11:12:56,300][389688] Updated weights for policy 0, policy_version 56400 (0.0004) [2023-03-08 11:12:58,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11878.4, 300 sec: 11829.8). Total num frames: 28897280. Throughput: 0: 12034.6. Samples: 28893496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:12:58,090][389401] Avg episode reward: [(0, '4727.611')] [2023-03-08 11:12:59,720][389688] Updated weights for policy 0, policy_version 56480 (0.0005) [2023-03-08 11:13:03,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 11815.9). Total num frames: 28954624. Throughput: 0: 12064.0. Samples: 28929044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:13:03,080][389401] Avg episode reward: [(0, '4724.598')] [2023-03-08 11:13:03,248][389688] Updated weights for policy 0, policy_version 56560 (0.0005) [2023-03-08 11:13:06,818][389688] Updated weights for policy 0, policy_version 56640 (0.0005) [2023-03-08 11:13:08,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11815.9). Total num frames: 29016064. Throughput: 0: 12003.1. Samples: 28998072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:13:08,080][389401] Avg episode reward: [(0, '4724.432')] [2023-03-08 11:13:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000056672_29016064.pth... [2023-03-08 11:13:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000055968_28655616.pth [2023-03-08 11:13:10,022][389688] Updated weights for policy 0, policy_version 56720 (0.0004) [2023-03-08 11:13:13,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11829.8). Total num frames: 29077504. Throughput: 0: 12051.1. Samples: 29074060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:13:13,080][389401] Avg episode reward: [(0, '4340.924')] [2023-03-08 11:13:13,289][389688] Updated weights for policy 0, policy_version 56800 (0.0004) [2023-03-08 11:13:16,679][389688] Updated weights for policy 0, policy_version 56880 (0.0005) [2023-03-08 11:13:18,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12015.0, 300 sec: 11802.0). Total num frames: 29134848. Throughput: 0: 12077.5. Samples: 29110344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:13:18,080][389401] Avg episode reward: [(0, '4690.016')] [2023-03-08 11:13:20,143][389688] Updated weights for policy 0, policy_version 56960 (0.0005) [2023-03-08 11:13:23,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11815.9). Total num frames: 29200384. Throughput: 0: 12097.2. Samples: 29183616. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:13:23,080][389401] Avg episode reward: [(0, '4726.406')] [2023-03-08 11:13:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000057032_29200384.pth... [2023-03-08 11:13:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000056320_28835840.pth [2023-03-08 11:13:23,355][389688] Updated weights for policy 0, policy_version 57040 (0.0004) [2023-03-08 11:13:26,765][389688] Updated weights for policy 0, policy_version 57120 (0.0005) [2023-03-08 11:13:28,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12151.5, 300 sec: 11829.8). Total num frames: 29261824. Throughput: 0: 12077.8. Samples: 29256532. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:13:28,080][389401] Avg episode reward: [(0, '4684.211')] [2023-03-08 11:13:30,000][389688] Updated weights for policy 0, policy_version 57200 (0.0004) [2023-03-08 11:13:33,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 11829.8). Total num frames: 29319168. Throughput: 0: 12134.1. Samples: 29294612. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:13:33,080][389401] Avg episode reward: [(0, '4645.063')] [2023-03-08 11:13:33,435][389688] Updated weights for policy 0, policy_version 57280 (0.0005) [2023-03-08 11:13:36,796][389688] Updated weights for policy 0, policy_version 57360 (0.0004) [2023-03-08 11:13:38,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 11829.8). Total num frames: 29380608. Throughput: 0: 12164.7. Samples: 29366940. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:13:38,080][389401] Avg episode reward: [(0, '4728.251')] [2023-03-08 11:13:38,143][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000057392_29384704.pth... [2023-03-08 11:13:38,145][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000056672_29016064.pth [2023-03-08 11:13:40,279][389688] Updated weights for policy 0, policy_version 57440 (0.0005) [2023-03-08 11:13:43,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11829.8). Total num frames: 29442048. Throughput: 0: 12086.4. Samples: 29437384. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:13:43,080][389401] Avg episode reward: [(0, '4718.309')] [2023-03-08 11:13:43,746][389688] Updated weights for policy 0, policy_version 57520 (0.0005) [2023-03-08 11:13:47,210][389688] Updated weights for policy 0, policy_version 57600 (0.0005) [2023-03-08 11:13:48,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 11843.7). Total num frames: 29499392. Throughput: 0: 12084.1. Samples: 29472828. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:13:48,080][389401] Avg episode reward: [(0, '4623.923')] [2023-03-08 11:13:50,825][389688] Updated weights for policy 0, policy_version 57680 (0.0006) [2023-03-08 11:13:53,079][389401] Fps is (10 sec: 11468.7, 60 sec: 12014.9, 300 sec: 11829.8). Total num frames: 29556736. Throughput: 0: 12083.5. Samples: 29541832. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:13:53,080][389401] Avg episode reward: [(0, '4681.864')] [2023-03-08 11:13:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000057728_29556736.pth... [2023-03-08 11:13:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000057032_29200384.pth [2023-03-08 11:13:54,345][389688] Updated weights for policy 0, policy_version 57760 (0.0005) [2023-03-08 11:13:57,934][389688] Updated weights for policy 0, policy_version 57840 (0.0005) [2023-03-08 11:13:58,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11829.8). Total num frames: 29614080. Throughput: 0: 11930.5. Samples: 29610932. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:13:58,080][389401] Avg episode reward: [(0, '4722.874')] [2023-03-08 11:14:01,580][389688] Updated weights for policy 0, policy_version 57920 (0.0005) [2023-03-08 11:14:03,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11946.6, 300 sec: 11843.7). Total num frames: 29671424. Throughput: 0: 11868.8. Samples: 29644440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:14:03,080][389401] Avg episode reward: [(0, '4407.799')] [2023-03-08 11:14:05,227][389688] Updated weights for policy 0, policy_version 58000 (0.0005) [2023-03-08 11:14:08,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11810.1, 300 sec: 11829.8). Total num frames: 29724672. Throughput: 0: 11750.6. Samples: 29712392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:14:08,080][389401] Avg episode reward: [(0, '4368.403')] [2023-03-08 11:14:08,093][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000058064_29728768.pth... [2023-03-08 11:14:08,095][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000057392_29384704.pth [2023-03-08 11:14:08,734][389688] Updated weights for policy 0, policy_version 58080 (0.0005) [2023-03-08 11:14:12,008][389688] Updated weights for policy 0, policy_version 58160 (0.0005) [2023-03-08 11:14:13,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 11857.6). Total num frames: 29790208. Throughput: 0: 11770.1. Samples: 29786184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:14:13,080][389401] Avg episode reward: [(0, '4239.669')] [2023-03-08 11:14:15,137][389688] Updated weights for policy 0, policy_version 58240 (0.0003) [2023-03-08 11:14:18,079][389401] Fps is (10 sec: 12697.5, 60 sec: 11946.7, 300 sec: 11871.5). Total num frames: 29851648. Throughput: 0: 11773.5. Samples: 29824420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:14:18,080][389401] Avg episode reward: [(0, '4661.459')] [2023-03-08 11:14:18,728][389688] Updated weights for policy 0, policy_version 58320 (0.0005) [2023-03-08 11:14:22,284][389688] Updated weights for policy 0, policy_version 58400 (0.0005) [2023-03-08 11:14:23,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11871.5). Total num frames: 29908992. Throughput: 0: 11699.3. Samples: 29893412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:14:23,080][389401] Avg episode reward: [(0, '4459.070')] [2023-03-08 11:14:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000058416_29908992.pth... [2023-03-08 11:14:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000057728_29556736.pth [2023-03-08 11:14:25,531][389688] Updated weights for policy 0, policy_version 58480 (0.0005) [2023-03-08 11:14:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11871.5). Total num frames: 29970432. Throughput: 0: 11808.0. Samples: 29968744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:14:28,080][389401] Avg episode reward: [(0, '2730.370')] [2023-03-08 11:14:28,824][389688] Updated weights for policy 0, policy_version 58560 (0.0005) [2023-03-08 11:14:32,204][389688] Updated weights for policy 0, policy_version 58640 (0.0004) [2023-03-08 11:14:33,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11878.4, 300 sec: 11885.3). Total num frames: 30031872. Throughput: 0: 11813.1. Samples: 30004416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:14:33,080][389401] Avg episode reward: [(0, '4586.575')] [2023-03-08 11:14:35,793][389688] Updated weights for policy 0, policy_version 58720 (0.0005) [2023-03-08 11:14:38,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11885.3). Total num frames: 30089216. Throughput: 0: 11822.3. Samples: 30073836. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:14:38,080][389401] Avg episode reward: [(0, '4718.786')] [2023-03-08 11:14:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000058768_30089216.pth... [2023-03-08 11:14:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000058064_29728768.pth [2023-03-08 11:14:39,304][389688] Updated weights for policy 0, policy_version 58800 (0.0004) [2023-03-08 11:14:42,476][389688] Updated weights for policy 0, policy_version 58880 (0.0003) [2023-03-08 11:14:43,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11885.3). Total num frames: 30150656. Throughput: 0: 11951.1. Samples: 30148732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:14:43,080][389401] Avg episode reward: [(0, '4694.557')] [2023-03-08 11:14:45,907][389688] Updated weights for policy 0, policy_version 58960 (0.0005) [2023-03-08 11:14:48,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11885.3). Total num frames: 30212096. Throughput: 0: 11998.3. Samples: 30184364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:14:48,080][389401] Avg episode reward: [(0, '4513.730')] [2023-03-08 11:14:49,366][389688] Updated weights for policy 0, policy_version 59040 (0.0005) [2023-03-08 11:14:52,643][389688] Updated weights for policy 0, policy_version 59120 (0.0004) [2023-03-08 11:14:53,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 11885.3). Total num frames: 30273536. Throughput: 0: 12107.2. Samples: 30257216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:14:53,080][389401] Avg episode reward: [(0, '4689.623')] [2023-03-08 11:14:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000059128_30273536.pth... [2023-03-08 11:14:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000058416_29908992.pth [2023-03-08 11:14:55,932][389688] Updated weights for policy 0, policy_version 59200 (0.0005) [2023-03-08 11:14:58,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11885.3). Total num frames: 30334976. Throughput: 0: 12105.9. Samples: 30330952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:14:58,080][389401] Avg episode reward: [(0, '4716.325')] [2023-03-08 11:14:59,360][389688] Updated weights for policy 0, policy_version 59280 (0.0005) [2023-03-08 11:15:02,775][389688] Updated weights for policy 0, policy_version 59360 (0.0005) [2023-03-08 11:15:03,079][389401] Fps is (10 sec: 11878.6, 60 sec: 12015.0, 300 sec: 11871.5). Total num frames: 30392320. Throughput: 0: 12071.9. Samples: 30367656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:15:03,080][389401] Avg episode reward: [(0, '4588.129')] [2023-03-08 11:15:06,246][389688] Updated weights for policy 0, policy_version 59440 (0.0005) [2023-03-08 11:15:08,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11871.5). Total num frames: 30453760. Throughput: 0: 12092.8. Samples: 30437588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:15:08,080][389401] Avg episode reward: [(0, '4650.495')] [2023-03-08 11:15:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000059480_30453760.pth... [2023-03-08 11:15:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000058768_30089216.pth [2023-03-08 11:15:09,702][389688] Updated weights for policy 0, policy_version 59520 (0.0005) [2023-03-08 11:15:13,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11871.5). Total num frames: 30511104. Throughput: 0: 12027.6. Samples: 30509988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:15:13,080][389401] Avg episode reward: [(0, '4655.504')] [2023-03-08 11:15:13,148][389688] Updated weights for policy 0, policy_version 59600 (0.0005) [2023-03-08 11:15:16,292][389688] Updated weights for policy 0, policy_version 59680 (0.0003) [2023-03-08 11:15:18,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12083.2, 300 sec: 11899.2). Total num frames: 30576640. Throughput: 0: 12080.4. Samples: 30548032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:15:18,080][389401] Avg episode reward: [(0, '4671.469')] [2023-03-08 11:15:19,522][389688] Updated weights for policy 0, policy_version 59760 (0.0004) [2023-03-08 11:15:22,878][389688] Updated weights for policy 0, policy_version 59840 (0.0004) [2023-03-08 11:15:23,079][389401] Fps is (10 sec: 12697.4, 60 sec: 12151.5, 300 sec: 11885.3). Total num frames: 30638080. Throughput: 0: 12219.2. Samples: 30623700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:15:23,080][389401] Avg episode reward: [(0, '4724.969')] [2023-03-08 11:15:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000059840_30638080.pth... [2023-03-08 11:15:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000059128_30273536.pth [2023-03-08 11:15:26,220][389688] Updated weights for policy 0, policy_version 59920 (0.0004) [2023-03-08 11:15:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11885.3). Total num frames: 30695424. Throughput: 0: 12140.1. Samples: 30695036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:15:28,080][389401] Avg episode reward: [(0, '4606.667')] [2023-03-08 11:15:29,881][389688] Updated weights for policy 0, policy_version 60000 (0.0006) [2023-03-08 11:15:33,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 11885.3). Total num frames: 30756864. Throughput: 0: 12114.3. Samples: 30729508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:15:33,080][389401] Avg episode reward: [(0, '4707.402')] [2023-03-08 11:15:33,396][389688] Updated weights for policy 0, policy_version 60080 (0.0004) [2023-03-08 11:15:37,128][389688] Updated weights for policy 0, policy_version 60160 (0.0006) [2023-03-08 11:15:38,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11885.3). Total num frames: 30810112. Throughput: 0: 12000.1. Samples: 30797220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:15:38,080][389401] Avg episode reward: [(0, '4639.423')] [2023-03-08 11:15:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000060176_30810112.pth... [2023-03-08 11:15:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000059480_30453760.pth [2023-03-08 11:15:40,786][389688] Updated weights for policy 0, policy_version 60240 (0.0005) [2023-03-08 11:15:43,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11946.7, 300 sec: 11871.5). Total num frames: 30867456. Throughput: 0: 11883.4. Samples: 30865704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:15:43,080][389401] Avg episode reward: [(0, '4602.639')] [2023-03-08 11:15:44,194][389688] Updated weights for policy 0, policy_version 60320 (0.0005) [2023-03-08 11:15:47,567][389688] Updated weights for policy 0, policy_version 60400 (0.0005) [2023-03-08 11:15:48,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 11885.3). Total num frames: 30928896. Throughput: 0: 11873.5. Samples: 30901964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:15:48,080][389401] Avg episode reward: [(0, '4551.850')] [2023-03-08 11:15:50,991][389688] Updated weights for policy 0, policy_version 60480 (0.0005) [2023-03-08 11:15:53,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 11885.3). Total num frames: 30986240. Throughput: 0: 11909.9. Samples: 30973536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:15:53,080][389401] Avg episode reward: [(0, '4366.364')] [2023-03-08 11:15:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000060520_30986240.pth... [2023-03-08 11:15:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000059840_30638080.pth [2023-03-08 11:15:54,656][389688] Updated weights for policy 0, policy_version 60560 (0.0005) [2023-03-08 11:15:58,002][389688] Updated weights for policy 0, policy_version 60640 (0.0005) [2023-03-08 11:15:58,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11885.3). Total num frames: 31047680. Throughput: 0: 11857.9. Samples: 31043592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:15:58,080][389401] Avg episode reward: [(0, '4640.775')] [2023-03-08 11:16:01,575][389688] Updated weights for policy 0, policy_version 60720 (0.0005) [2023-03-08 11:16:03,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 11885.3). Total num frames: 31105024. Throughput: 0: 11785.7. Samples: 31078392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:16:03,080][389401] Avg episode reward: [(0, '4667.901')] [2023-03-08 11:16:05,023][389688] Updated weights for policy 0, policy_version 60800 (0.0005) [2023-03-08 11:16:08,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11885.3). Total num frames: 31166464. Throughput: 0: 11697.5. Samples: 31150088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:16:08,080][389401] Avg episode reward: [(0, '4651.784')] [2023-03-08 11:16:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000060872_31166464.pth... [2023-03-08 11:16:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000060176_30810112.pth [2023-03-08 11:16:08,381][389688] Updated weights for policy 0, policy_version 60880 (0.0004) [2023-03-08 11:16:11,704][389688] Updated weights for policy 0, policy_version 60960 (0.0005) [2023-03-08 11:16:13,079][389401] Fps is (10 sec: 12288.2, 60 sec: 11946.7, 300 sec: 11899.2). Total num frames: 31227904. Throughput: 0: 11750.7. Samples: 31223816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:16:13,080][389401] Avg episode reward: [(0, '4723.620')] [2023-03-08 11:16:15,015][389688] Updated weights for policy 0, policy_version 61040 (0.0005) [2023-03-08 11:16:18,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11913.1). Total num frames: 31289344. Throughput: 0: 11803.8. Samples: 31260680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:16:18,080][389401] Avg episode reward: [(0, '4728.277')] [2023-03-08 11:16:18,373][389688] Updated weights for policy 0, policy_version 61120 (0.0005) [2023-03-08 11:16:21,740][389688] Updated weights for policy 0, policy_version 61200 (0.0004) [2023-03-08 11:16:23,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.2, 300 sec: 11913.1). Total num frames: 31346688. Throughput: 0: 11931.6. Samples: 31334140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:16:23,080][389401] Avg episode reward: [(0, '4600.337')] [2023-03-08 11:16:23,130][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000061232_31350784.pth... [2023-03-08 11:16:23,131][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000060520_30986240.pth [2023-03-08 11:16:25,225][389688] Updated weights for policy 0, policy_version 61280 (0.0006) [2023-03-08 11:16:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11927.0). Total num frames: 31408128. Throughput: 0: 11962.7. Samples: 31404024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:16:28,080][389401] Avg episode reward: [(0, '4662.605')] [2023-03-08 11:16:28,733][389688] Updated weights for policy 0, policy_version 61360 (0.0005) [2023-03-08 11:16:32,161][389688] Updated weights for policy 0, policy_version 61440 (0.0005) [2023-03-08 11:16:33,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11927.0). Total num frames: 31465472. Throughput: 0: 11938.2. Samples: 31439184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:16:33,080][389401] Avg episode reward: [(0, '4609.488')] [2023-03-08 11:16:35,566][389688] Updated weights for policy 0, policy_version 61520 (0.0006) [2023-03-08 11:16:38,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11927.0). Total num frames: 31526912. Throughput: 0: 11938.1. Samples: 31510748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:16:38,080][389401] Avg episode reward: [(0, '4686.746')] [2023-03-08 11:16:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000061576_31526912.pth... [2023-03-08 11:16:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000060872_31166464.pth [2023-03-08 11:16:39,124][389688] Updated weights for policy 0, policy_version 61600 (0.0006) [2023-03-08 11:16:42,566][389688] Updated weights for policy 0, policy_version 61680 (0.0005) [2023-03-08 11:16:43,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 11913.1). Total num frames: 31584256. Throughput: 0: 11943.5. Samples: 31581048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:16:43,080][389401] Avg episode reward: [(0, '4685.380')] [2023-03-08 11:16:46,053][389688] Updated weights for policy 0, policy_version 61760 (0.0005) [2023-03-08 11:16:48,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11913.1). Total num frames: 31641600. Throughput: 0: 11969.6. Samples: 31617020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:16:48,080][389401] Avg episode reward: [(0, '4724.689')] [2023-03-08 11:16:49,591][389688] Updated weights for policy 0, policy_version 61840 (0.0005) [2023-03-08 11:16:52,763][389688] Updated weights for policy 0, policy_version 61920 (0.0004) [2023-03-08 11:16:53,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12014.9, 300 sec: 11940.9). Total num frames: 31707136. Throughput: 0: 11984.4. Samples: 31689388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:16:53,080][389401] Avg episode reward: [(0, '4602.875')] [2023-03-08 11:16:53,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000061928_31707136.pth... [2023-03-08 11:16:53,087][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000061232_31350784.pth [2023-03-08 11:16:55,949][389688] Updated weights for policy 0, policy_version 62000 (0.0003) [2023-03-08 11:16:58,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11968.6). Total num frames: 31768576. Throughput: 0: 12016.2. Samples: 31764544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:16:58,080][389401] Avg episode reward: [(0, '4566.755')] [2023-03-08 11:16:59,287][389688] Updated weights for policy 0, policy_version 62080 (0.0005) [2023-03-08 11:17:02,776][389688] Updated weights for policy 0, policy_version 62160 (0.0005) [2023-03-08 11:17:03,079][389401] Fps is (10 sec: 11878.6, 60 sec: 12015.0, 300 sec: 11968.7). Total num frames: 31825920. Throughput: 0: 12016.2. Samples: 31801408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:17:03,080][389401] Avg episode reward: [(0, '4685.029')] [2023-03-08 11:17:06,210][389688] Updated weights for policy 0, policy_version 62240 (0.0004) [2023-03-08 11:17:08,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11982.5). Total num frames: 31887360. Throughput: 0: 11956.2. Samples: 31872172. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:17:08,080][389401] Avg episode reward: [(0, '4726.307')] [2023-03-08 11:17:08,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000062280_31887360.pth... [2023-03-08 11:17:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000061576_31526912.pth [2023-03-08 11:17:09,611][389688] Updated weights for policy 0, policy_version 62320 (0.0004) [2023-03-08 11:17:13,079][389401] Fps is (10 sec: 11878.2, 60 sec: 11946.6, 300 sec: 11968.6). Total num frames: 31944704. Throughput: 0: 11991.1. Samples: 31943624. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:17:13,080][389401] Avg episode reward: [(0, '4477.840')] [2023-03-08 11:17:13,143][389688] Updated weights for policy 0, policy_version 62400 (0.0006) [2023-03-08 11:17:16,671][389688] Updated weights for policy 0, policy_version 62480 (0.0005) [2023-03-08 11:17:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11968.7). Total num frames: 32006144. Throughput: 0: 11965.7. Samples: 31977640. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:17:18,080][389401] Avg episode reward: [(0, '4641.690')] [2023-03-08 11:17:20,127][389688] Updated weights for policy 0, policy_version 62560 (0.0004) [2023-03-08 11:17:23,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 11968.6). Total num frames: 32063488. Throughput: 0: 11968.2. Samples: 32049316. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:17:23,080][389401] Avg episode reward: [(0, '4729.922')] [2023-03-08 11:17:23,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000062624_32063488.pth... [2023-03-08 11:17:23,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000061928_31707136.pth [2023-03-08 11:17:23,439][389688] Updated weights for policy 0, policy_version 62640 (0.0004) [2023-03-08 11:17:26,702][389688] Updated weights for policy 0, policy_version 62720 (0.0005) [2023-03-08 11:17:28,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11982.5). Total num frames: 32129024. Throughput: 0: 12086.4. Samples: 32124936. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:17:28,080][389401] Avg episode reward: [(0, '4728.893')] [2023-03-08 11:17:29,929][389688] Updated weights for policy 0, policy_version 62800 (0.0004) [2023-03-08 11:17:33,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12083.2, 300 sec: 11982.5). Total num frames: 32190464. Throughput: 0: 12124.3. Samples: 32162612. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:17:33,080][389401] Avg episode reward: [(0, '4579.075')] [2023-03-08 11:17:33,132][389688] Updated weights for policy 0, policy_version 62880 (0.0005) [2023-03-08 11:17:36,328][389688] Updated weights for policy 0, policy_version 62960 (0.0005) [2023-03-08 11:17:38,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 11996.4). Total num frames: 32256000. Throughput: 0: 12227.5. Samples: 32239624. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:17:38,080][389401] Avg episode reward: [(0, '4683.857')] [2023-03-08 11:17:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000063000_32256000.pth... [2023-03-08 11:17:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000062280_31887360.pth [2023-03-08 11:17:39,643][389688] Updated weights for policy 0, policy_version 63040 (0.0005) [2023-03-08 11:17:43,067][389688] Updated weights for policy 0, policy_version 63120 (0.0005) [2023-03-08 11:17:43,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 12010.3). Total num frames: 32317440. Throughput: 0: 12195.6. Samples: 32313344. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:17:43,080][389401] Avg episode reward: [(0, '4640.260')] [2023-03-08 11:17:46,558][389688] Updated weights for policy 0, policy_version 63200 (0.0006) [2023-03-08 11:17:48,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12219.7, 300 sec: 11996.4). Total num frames: 32374784. Throughput: 0: 12131.2. Samples: 32347312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:17:48,090][389401] Avg episode reward: [(0, '4726.761')] [2023-03-08 11:17:50,021][389688] Updated weights for policy 0, policy_version 63280 (0.0005) [2023-03-08 11:17:53,079][389401] Fps is (10 sec: 11468.7, 60 sec: 12083.2, 300 sec: 11982.5). Total num frames: 32432128. Throughput: 0: 12150.2. Samples: 32418932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:17:53,080][389401] Avg episode reward: [(0, '4684.339')] [2023-03-08 11:17:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000063344_32432128.pth... [2023-03-08 11:17:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000062624_32063488.pth [2023-03-08 11:17:53,490][389688] Updated weights for policy 0, policy_version 63360 (0.0005) [2023-03-08 11:17:56,846][389688] Updated weights for policy 0, policy_version 63440 (0.0005) [2023-03-08 11:17:58,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11996.4). Total num frames: 32493568. Throughput: 0: 12154.2. Samples: 32490564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:17:58,080][389401] Avg episode reward: [(0, '4686.854')] [2023-03-08 11:18:00,326][389688] Updated weights for policy 0, policy_version 63520 (0.0005) [2023-03-08 11:18:03,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11982.5). Total num frames: 32550912. Throughput: 0: 12193.5. Samples: 32526348. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:18:03,080][389401] Avg episode reward: [(0, '4639.929')] [2023-03-08 11:18:03,844][389688] Updated weights for policy 0, policy_version 63600 (0.0005) [2023-03-08 11:18:07,342][389688] Updated weights for policy 0, policy_version 63680 (0.0006) [2023-03-08 11:18:08,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11982.5). Total num frames: 32612352. Throughput: 0: 12149.2. Samples: 32596032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:18:08,080][389401] Avg episode reward: [(0, '4724.651')] [2023-03-08 11:18:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000063696_32612352.pth... [2023-03-08 11:18:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000063000_32256000.pth [2023-03-08 11:18:10,738][389688] Updated weights for policy 0, policy_version 63760 (0.0005) [2023-03-08 11:18:13,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11982.5). Total num frames: 32669696. Throughput: 0: 12059.3. Samples: 32667604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:18:13,080][389401] Avg episode reward: [(0, '4726.839')] [2023-03-08 11:18:14,213][389688] Updated weights for policy 0, policy_version 63840 (0.0006) [2023-03-08 11:18:17,634][389688] Updated weights for policy 0, policy_version 63920 (0.0005) [2023-03-08 11:18:18,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 11968.7). Total num frames: 32731136. Throughput: 0: 12006.8. Samples: 32702916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:18:18,080][389401] Avg episode reward: [(0, '4717.067')] [2023-03-08 11:18:20,901][389688] Updated weights for policy 0, policy_version 64000 (0.0005) [2023-03-08 11:18:23,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11968.6). Total num frames: 32792576. Throughput: 0: 11934.2. Samples: 32776664. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:18:23,090][389401] Avg episode reward: [(0, '4709.992')] [2023-03-08 11:18:23,093][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000064048_32792576.pth... [2023-03-08 11:18:23,095][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000063344_32432128.pth [2023-03-08 11:18:24,148][389688] Updated weights for policy 0, policy_version 64080 (0.0005) [2023-03-08 11:18:27,526][389688] Updated weights for policy 0, policy_version 64160 (0.0005) [2023-03-08 11:18:28,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11982.5). Total num frames: 32854016. Throughput: 0: 11957.5. Samples: 32851432. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:18:28,090][389401] Avg episode reward: [(0, '4727.382')] [2023-03-08 11:18:30,805][389688] Updated weights for policy 0, policy_version 64240 (0.0005) [2023-03-08 11:18:33,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11982.5). Total num frames: 32915456. Throughput: 0: 12036.5. Samples: 32888956. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:18:33,090][389401] Avg episode reward: [(0, '4677.270')] [2023-03-08 11:18:34,244][389688] Updated weights for policy 0, policy_version 64320 (0.0005) [2023-03-08 11:18:37,737][389688] Updated weights for policy 0, policy_version 64400 (0.0005) [2023-03-08 11:18:38,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11982.5). Total num frames: 32976896. Throughput: 0: 12035.1. Samples: 32960512. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:18:38,090][389401] Avg episode reward: [(0, '4685.845')] [2023-03-08 11:18:38,094][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000064408_32976896.pth... [2023-03-08 11:18:38,096][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000063696_32612352.pth [2023-03-08 11:18:40,931][389688] Updated weights for policy 0, policy_version 64480 (0.0004) [2023-03-08 11:18:43,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11996.4). Total num frames: 33038336. Throughput: 0: 12121.6. Samples: 33036036. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:18:43,090][389401] Avg episode reward: [(0, '4727.121')] [2023-03-08 11:18:44,098][389688] Updated weights for policy 0, policy_version 64560 (0.0004) [2023-03-08 11:18:47,495][389688] Updated weights for policy 0, policy_version 64640 (0.0005) [2023-03-08 11:18:48,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12083.2, 300 sec: 12010.3). Total num frames: 33099776. Throughput: 0: 12170.2. Samples: 33074008. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:18:48,080][389401] Avg episode reward: [(0, '4681.046')] [2023-03-08 11:18:50,890][389688] Updated weights for policy 0, policy_version 64720 (0.0005) [2023-03-08 11:18:53,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12151.5, 300 sec: 12024.2). Total num frames: 33161216. Throughput: 0: 12206.3. Samples: 33145316. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:18:53,080][389401] Avg episode reward: [(0, '4546.704')] [2023-03-08 11:18:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000064768_33161216.pth... [2023-03-08 11:18:53,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000064048_32792576.pth [2023-03-08 11:18:54,265][389688] Updated weights for policy 0, policy_version 64800 (0.0005) [2023-03-08 11:18:57,360][389688] Updated weights for policy 0, policy_version 64880 (0.0004) [2023-03-08 11:18:58,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 12052.0). Total num frames: 33226752. Throughput: 0: 12334.7. Samples: 33222664. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:18:58,080][389401] Avg episode reward: [(0, '4714.250')] [2023-03-08 11:19:00,494][389688] Updated weights for policy 0, policy_version 64960 (0.0004) [2023-03-08 11:19:03,079][389401] Fps is (10 sec: 12697.8, 60 sec: 12288.0, 300 sec: 12079.7). Total num frames: 33288192. Throughput: 0: 12416.9. Samples: 33261676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:19:03,080][389401] Avg episode reward: [(0, '4705.476')] [2023-03-08 11:19:03,896][389688] Updated weights for policy 0, policy_version 65040 (0.0005) [2023-03-08 11:19:07,253][389688] Updated weights for policy 0, policy_version 65120 (0.0005) [2023-03-08 11:19:08,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12065.8). Total num frames: 33349632. Throughput: 0: 12385.9. Samples: 33334028. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:19:08,080][389401] Avg episode reward: [(0, '4717.880')] [2023-03-08 11:19:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000065136_33349632.pth... [2023-03-08 11:19:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000064408_32976896.pth [2023-03-08 11:19:10,636][389688] Updated weights for policy 0, policy_version 65200 (0.0005) [2023-03-08 11:19:13,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 12065.8). Total num frames: 33411072. Throughput: 0: 12345.6. Samples: 33406984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:19:13,080][389401] Avg episode reward: [(0, '4436.266')] [2023-03-08 11:19:14,047][389688] Updated weights for policy 0, policy_version 65280 (0.0005) [2023-03-08 11:19:17,514][389688] Updated weights for policy 0, policy_version 65360 (0.0005) [2023-03-08 11:19:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 12065.8). Total num frames: 33468416. Throughput: 0: 12316.4. Samples: 33443196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:19:18,080][389401] Avg episode reward: [(0, '4669.082')] [2023-03-08 11:19:20,967][389688] Updated weights for policy 0, policy_version 65440 (0.0005) [2023-03-08 11:19:23,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12288.0, 300 sec: 12065.8). Total num frames: 33529856. Throughput: 0: 12289.4. Samples: 33513536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:19:23,080][389401] Avg episode reward: [(0, '4674.670')] [2023-03-08 11:19:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000065488_33529856.pth... [2023-03-08 11:19:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000064768_33161216.pth [2023-03-08 11:19:24,324][389688] Updated weights for policy 0, policy_version 65520 (0.0004) [2023-03-08 11:19:27,497][389688] Updated weights for policy 0, policy_version 65600 (0.0004) [2023-03-08 11:19:28,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 12065.8). Total num frames: 33591296. Throughput: 0: 12288.8. Samples: 33589032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:19:28,080][389401] Avg episode reward: [(0, '4692.554')] [2023-03-08 11:19:30,812][389688] Updated weights for policy 0, policy_version 65680 (0.0005) [2023-03-08 11:19:33,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12079.7). Total num frames: 33652736. Throughput: 0: 12285.8. Samples: 33626872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:19:33,080][389401] Avg episode reward: [(0, '4681.823')] [2023-03-08 11:19:34,236][389688] Updated weights for policy 0, policy_version 65760 (0.0005) [2023-03-08 11:19:37,709][389688] Updated weights for policy 0, policy_version 65840 (0.0005) [2023-03-08 11:19:38,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 12079.7). Total num frames: 33714176. Throughput: 0: 12277.5. Samples: 33697804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:19:38,080][389401] Avg episode reward: [(0, '4408.228')] [2023-03-08 11:19:38,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000065848_33714176.pth... [2023-03-08 11:19:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000065136_33349632.pth [2023-03-08 11:19:41,235][389688] Updated weights for policy 0, policy_version 65920 (0.0005) [2023-03-08 11:19:43,079][389401] Fps is (10 sec: 11878.6, 60 sec: 12219.8, 300 sec: 12065.8). Total num frames: 33771520. Throughput: 0: 12105.8. Samples: 33767424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:19:43,080][389401] Avg episode reward: [(0, '4671.402')] [2023-03-08 11:19:44,763][389688] Updated weights for policy 0, policy_version 66000 (0.0005) [2023-03-08 11:19:48,079][389401] Fps is (10 sec: 11468.9, 60 sec: 12151.5, 300 sec: 12052.0). Total num frames: 33828864. Throughput: 0: 12040.9. Samples: 33803516. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:19:48,080][389401] Avg episode reward: [(0, '4726.599')] [2023-03-08 11:19:48,168][389688] Updated weights for policy 0, policy_version 66080 (0.0005) [2023-03-08 11:19:51,392][389688] Updated weights for policy 0, policy_version 66160 (0.0004) [2023-03-08 11:19:53,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12219.7, 300 sec: 12065.8). Total num frames: 33894400. Throughput: 0: 12078.9. Samples: 33877580. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:19:53,080][389401] Avg episode reward: [(0, '4727.699')] [2023-03-08 11:19:53,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000066200_33894400.pth... [2023-03-08 11:19:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000065488_33529856.pth [2023-03-08 11:19:54,750][389688] Updated weights for policy 0, policy_version 66240 (0.0005) [2023-03-08 11:19:58,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 12065.8). Total num frames: 33951744. Throughput: 0: 12043.8. Samples: 33948956. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:19:58,080][389401] Avg episode reward: [(0, '4653.730')] [2023-03-08 11:19:58,231][389688] Updated weights for policy 0, policy_version 66320 (0.0006) [2023-03-08 11:20:01,635][389688] Updated weights for policy 0, policy_version 66400 (0.0005) [2023-03-08 11:20:03,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 12065.8). Total num frames: 34013184. Throughput: 0: 12037.4. Samples: 33984880. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:20:03,080][389401] Avg episode reward: [(0, '4681.972')] [2023-03-08 11:20:04,860][389688] Updated weights for policy 0, policy_version 66480 (0.0005) [2023-03-08 11:20:08,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 12079.7). Total num frames: 34074624. Throughput: 0: 12120.2. Samples: 34058944. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:20:08,080][389401] Avg episode reward: [(0, '4678.136')] [2023-03-08 11:20:08,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000066552_34074624.pth... [2023-03-08 11:20:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000065848_33714176.pth [2023-03-08 11:20:08,185][389688] Updated weights for policy 0, policy_version 66560 (0.0005) [2023-03-08 11:20:11,320][389688] Updated weights for policy 0, policy_version 66640 (0.0004) [2023-03-08 11:20:13,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12151.5, 300 sec: 12079.7). Total num frames: 34140160. Throughput: 0: 12156.4. Samples: 34136072. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:20:13,080][389401] Avg episode reward: [(0, '4723.272')] [2023-03-08 11:20:14,687][389688] Updated weights for policy 0, policy_version 66720 (0.0005) [2023-03-08 11:20:18,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 12065.8). Total num frames: 34197504. Throughput: 0: 12132.9. Samples: 34172852. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:20:18,080][389401] Avg episode reward: [(0, '4714.548')] [2023-03-08 11:20:18,144][389688] Updated weights for policy 0, policy_version 66800 (0.0005) [2023-03-08 11:20:21,531][389688] Updated weights for policy 0, policy_version 66880 (0.0005) [2023-03-08 11:20:23,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12079.7). Total num frames: 34258944. Throughput: 0: 12132.7. Samples: 34243776. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 11:20:23,080][389401] Avg episode reward: [(0, '4371.688')] [2023-03-08 11:20:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000066912_34258944.pth... [2023-03-08 11:20:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000066200_33894400.pth [2023-03-08 11:20:24,982][389688] Updated weights for policy 0, policy_version 66960 (0.0006) [2023-03-08 11:20:28,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 12065.8). Total num frames: 34316288. Throughput: 0: 12173.0. Samples: 34315208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:20:28,080][389401] Avg episode reward: [(0, '4689.874')] [2023-03-08 11:20:28,527][389688] Updated weights for policy 0, policy_version 67040 (0.0005) [2023-03-08 11:20:31,921][389688] Updated weights for policy 0, policy_version 67120 (0.0004) [2023-03-08 11:20:33,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 12093.6). Total num frames: 34377728. Throughput: 0: 12124.7. Samples: 34349128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:20:33,080][389401] Avg episode reward: [(0, '4729.098')] [2023-03-08 11:20:35,119][389688] Updated weights for policy 0, policy_version 67200 (0.0004) [2023-03-08 11:20:38,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 12107.5). Total num frames: 34439168. Throughput: 0: 12199.1. Samples: 34426540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:20:38,080][389401] Avg episode reward: [(0, '4725.842')] [2023-03-08 11:20:38,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000067272_34443264.pth... [2023-03-08 11:20:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000066552_34074624.pth [2023-03-08 11:20:38,439][389688] Updated weights for policy 0, policy_version 67280 (0.0004) [2023-03-08 11:20:41,747][389688] Updated weights for policy 0, policy_version 67360 (0.0005) [2023-03-08 11:20:43,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 12107.5). Total num frames: 34500608. Throughput: 0: 12229.1. Samples: 34499264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:20:43,080][389401] Avg episode reward: [(0, '4643.285')] [2023-03-08 11:20:45,107][389688] Updated weights for policy 0, policy_version 67440 (0.0005) [2023-03-08 11:20:48,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12219.7, 300 sec: 12121.4). Total num frames: 34562048. Throughput: 0: 12258.7. Samples: 34536520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:20:48,080][389401] Avg episode reward: [(0, '4484.141')] [2023-03-08 11:20:48,399][389688] Updated weights for policy 0, policy_version 67520 (0.0005) [2023-03-08 11:20:51,601][389688] Updated weights for policy 0, policy_version 67600 (0.0004) [2023-03-08 11:20:53,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 12135.3). Total num frames: 34627584. Throughput: 0: 12279.1. Samples: 34611504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:20:53,080][389401] Avg episode reward: [(0, '4648.880')] [2023-03-08 11:20:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000067632_34627584.pth... [2023-03-08 11:20:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000066912_34258944.pth [2023-03-08 11:20:54,936][389688] Updated weights for policy 0, policy_version 67680 (0.0006) [2023-03-08 11:20:58,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 12149.2). Total num frames: 34689024. Throughput: 0: 12218.8. Samples: 34685916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:20:58,080][389401] Avg episode reward: [(0, '4728.707')] [2023-03-08 11:20:58,263][389688] Updated weights for policy 0, policy_version 67760 (0.0005) [2023-03-08 11:21:01,768][389688] Updated weights for policy 0, policy_version 67840 (0.0005) [2023-03-08 11:21:03,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 12149.2). Total num frames: 34750464. Throughput: 0: 12196.6. Samples: 34721696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:21:03,080][389401] Avg episode reward: [(0, '4559.564')] [2023-03-08 11:21:05,157][389688] Updated weights for policy 0, policy_version 67920 (0.0005) [2023-03-08 11:21:08,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12219.7, 300 sec: 12135.3). Total num frames: 34807808. Throughput: 0: 12200.6. Samples: 34792804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:21:08,080][389401] Avg episode reward: [(0, '4615.631')] [2023-03-08 11:21:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000067984_34807808.pth... [2023-03-08 11:21:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000067272_34443264.pth [2023-03-08 11:21:08,563][389688] Updated weights for policy 0, policy_version 68000 (0.0006) [2023-03-08 11:21:11,749][389688] Updated weights for policy 0, policy_version 68080 (0.0005) [2023-03-08 11:21:13,079][389401] Fps is (10 sec: 12287.7, 60 sec: 12219.7, 300 sec: 12149.1). Total num frames: 34873344. Throughput: 0: 12312.1. Samples: 34869256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:21:13,080][389401] Avg episode reward: [(0, '4660.844')] [2023-03-08 11:21:14,988][389688] Updated weights for policy 0, policy_version 68160 (0.0004) [2023-03-08 11:21:18,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12288.0, 300 sec: 12163.0). Total num frames: 34934784. Throughput: 0: 12383.3. Samples: 34906376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:21:18,080][389401] Avg episode reward: [(0, '4731.912')] [2023-03-08 11:21:18,197][389688] Updated weights for policy 0, policy_version 68240 (0.0005) [2023-03-08 11:21:21,552][389688] Updated weights for policy 0, policy_version 68320 (0.0005) [2023-03-08 11:21:23,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 12163.0). Total num frames: 34996224. Throughput: 0: 12319.6. Samples: 34980924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:21:23,080][389401] Avg episode reward: [(0, '4662.663')] [2023-03-08 11:21:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000068352_34996224.pth... [2023-03-08 11:21:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000067632_34627584.pth [2023-03-08 11:21:24,825][389688] Updated weights for policy 0, policy_version 68400 (0.0005) [2023-03-08 11:21:27,884][389688] Updated weights for policy 0, policy_version 68480 (0.0004) [2023-03-08 11:21:28,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12424.5, 300 sec: 12190.8). Total num frames: 35061760. Throughput: 0: 12427.5. Samples: 35058504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:21:28,090][389401] Avg episode reward: [(0, '4693.693')] [2023-03-08 11:21:31,097][389688] Updated weights for policy 0, policy_version 68560 (0.0004) [2023-03-08 11:21:33,079][389401] Fps is (10 sec: 13107.3, 60 sec: 12492.8, 300 sec: 12204.7). Total num frames: 35127296. Throughput: 0: 12459.4. Samples: 35097196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:21:33,080][389401] Avg episode reward: [(0, '4681.999')] [2023-03-08 11:21:34,274][389688] Updated weights for policy 0, policy_version 68640 (0.0004) [2023-03-08 11:21:37,551][389688] Updated weights for policy 0, policy_version 68720 (0.0004) [2023-03-08 11:21:38,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12218.6). Total num frames: 35188736. Throughput: 0: 12473.9. Samples: 35172832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:21:38,080][389401] Avg episode reward: [(0, '4622.651')] [2023-03-08 11:21:38,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000068728_35188736.pth... [2023-03-08 11:21:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000067984_34807808.pth [2023-03-08 11:21:40,969][389688] Updated weights for policy 0, policy_version 68800 (0.0004) [2023-03-08 11:21:43,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12492.8, 300 sec: 12232.5). Total num frames: 35250176. Throughput: 0: 12448.2. Samples: 35246088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:21:43,080][389401] Avg episode reward: [(0, '4667.838')] [2023-03-08 11:21:44,320][389688] Updated weights for policy 0, policy_version 68880 (0.0005) [2023-03-08 11:21:47,790][389688] Updated weights for policy 0, policy_version 68960 (0.0006) [2023-03-08 11:21:48,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12424.5, 300 sec: 12204.7). Total num frames: 35307520. Throughput: 0: 12448.5. Samples: 35281880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:21:48,080][389401] Avg episode reward: [(0, '4678.347')] [2023-03-08 11:21:50,989][389688] Updated weights for policy 0, policy_version 69040 (0.0005) [2023-03-08 11:21:53,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12218.6). Total num frames: 35373056. Throughput: 0: 12531.8. Samples: 35356736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:21:53,080][389401] Avg episode reward: [(0, '4673.560')] [2023-03-08 11:21:53,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000069088_35373056.pth... [2023-03-08 11:21:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000068352_34996224.pth [2023-03-08 11:21:54,276][389688] Updated weights for policy 0, policy_version 69120 (0.0005) [2023-03-08 11:21:57,594][389688] Updated weights for policy 0, policy_version 69200 (0.0004) [2023-03-08 11:21:58,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12424.5, 300 sec: 12232.5). Total num frames: 35434496. Throughput: 0: 12478.7. Samples: 35430796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:21:58,080][389401] Avg episode reward: [(0, '4552.588')] [2023-03-08 11:22:00,808][389688] Updated weights for policy 0, policy_version 69280 (0.0004) [2023-03-08 11:22:03,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12424.5, 300 sec: 12232.5). Total num frames: 35495936. Throughput: 0: 12500.9. Samples: 35468916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:22:03,080][389401] Avg episode reward: [(0, '4565.714')] [2023-03-08 11:22:04,320][389688] Updated weights for policy 0, policy_version 69360 (0.0004) [2023-03-08 11:22:07,834][389688] Updated weights for policy 0, policy_version 69440 (0.0005) [2023-03-08 11:22:08,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 12232.5). Total num frames: 35553280. Throughput: 0: 12422.6. Samples: 35539940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:22:08,080][389401] Avg episode reward: [(0, '4686.055')] [2023-03-08 11:22:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000069440_35553280.pth... [2023-03-08 11:22:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000068728_35188736.pth [2023-03-08 11:22:11,406][389688] Updated weights for policy 0, policy_version 69520 (0.0005) [2023-03-08 11:22:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12288.0, 300 sec: 12218.6). Total num frames: 35610624. Throughput: 0: 12251.6. Samples: 35609828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:22:13,080][389401] Avg episode reward: [(0, '4433.022')] [2023-03-08 11:22:14,856][389688] Updated weights for policy 0, policy_version 69600 (0.0005) [2023-03-08 11:22:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 12232.5). Total num frames: 35672064. Throughput: 0: 12164.1. Samples: 35644580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:22:18,080][389401] Avg episode reward: [(0, '4682.089')] [2023-03-08 11:22:18,346][389688] Updated weights for policy 0, policy_version 69680 (0.0005) [2023-03-08 11:22:21,774][389688] Updated weights for policy 0, policy_version 69760 (0.0005) [2023-03-08 11:22:23,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12219.7, 300 sec: 12204.7). Total num frames: 35729408. Throughput: 0: 12074.8. Samples: 35716196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:22:23,080][389401] Avg episode reward: [(0, '4728.049')] [2023-03-08 11:22:23,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000069784_35729408.pth... [2023-03-08 11:22:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000069088_35373056.pth [2023-03-08 11:22:25,327][389688] Updated weights for policy 0, policy_version 69840 (0.0005) [2023-03-08 11:22:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 12190.8). Total num frames: 35786752. Throughput: 0: 11990.3. Samples: 35785652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:22:28,080][389401] Avg episode reward: [(0, '4730.625')] [2023-03-08 11:22:28,869][389688] Updated weights for policy 0, policy_version 69920 (0.0005) [2023-03-08 11:22:32,389][389688] Updated weights for policy 0, policy_version 70000 (0.0005) [2023-03-08 11:22:33,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 12176.9). Total num frames: 35848192. Throughput: 0: 11947.5. Samples: 35819520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:22:33,080][389401] Avg episode reward: [(0, '4726.609')] [2023-03-08 11:22:35,807][389688] Updated weights for policy 0, policy_version 70080 (0.0005) [2023-03-08 11:22:38,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12163.0). Total num frames: 35905536. Throughput: 0: 11870.8. Samples: 35890920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:22:38,080][389401] Avg episode reward: [(0, '4728.175')] [2023-03-08 11:22:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000070128_35905536.pth... [2023-03-08 11:22:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000069440_35553280.pth [2023-03-08 11:22:39,106][389688] Updated weights for policy 0, policy_version 70160 (0.0005) [2023-03-08 11:22:42,326][389688] Updated weights for policy 0, policy_version 70240 (0.0004) [2023-03-08 11:22:43,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 12176.9). Total num frames: 35966976. Throughput: 0: 11913.6. Samples: 35966908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:22:43,080][389401] Avg episode reward: [(0, '4727.856')] [2023-03-08 11:22:45,725][389688] Updated weights for policy 0, policy_version 70320 (0.0004) [2023-03-08 11:22:48,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12083.2, 300 sec: 12204.7). Total num frames: 36032512. Throughput: 0: 11876.7. Samples: 36003368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:22:48,080][389401] Avg episode reward: [(0, '4727.763')] [2023-03-08 11:22:48,981][389688] Updated weights for policy 0, policy_version 70400 (0.0004) [2023-03-08 11:22:52,122][389688] Updated weights for policy 0, policy_version 70480 (0.0004) [2023-03-08 11:22:53,079][389401] Fps is (10 sec: 13107.2, 60 sec: 12083.2, 300 sec: 12218.6). Total num frames: 36098048. Throughput: 0: 11993.3. Samples: 36079640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:22:53,080][389401] Avg episode reward: [(0, '4687.749')] [2023-03-08 11:22:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000070504_36098048.pth... [2023-03-08 11:22:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000069784_35729408.pth [2023-03-08 11:22:55,240][389688] Updated weights for policy 0, policy_version 70560 (0.0003) [2023-03-08 11:22:58,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12083.2, 300 sec: 12232.5). Total num frames: 36159488. Throughput: 0: 12170.4. Samples: 36157496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:22:58,080][389401] Avg episode reward: [(0, '4646.744')] [2023-03-08 11:22:58,487][389688] Updated weights for policy 0, policy_version 70640 (0.0004) [2023-03-08 11:23:01,569][389688] Updated weights for policy 0, policy_version 70720 (0.0004) [2023-03-08 11:23:03,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 12246.3). Total num frames: 36225024. Throughput: 0: 12263.0. Samples: 36196416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:23:03,080][389401] Avg episode reward: [(0, '4725.199')] [2023-03-08 11:23:04,745][389688] Updated weights for policy 0, policy_version 70800 (0.0004) [2023-03-08 11:23:08,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12219.8, 300 sec: 12260.2). Total num frames: 36286464. Throughput: 0: 12369.3. Samples: 36272812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:23:08,080][389401] Avg episode reward: [(0, '4421.570')] [2023-03-08 11:23:08,093][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000070880_36290560.pth... [2023-03-08 11:23:08,094][389688] Updated weights for policy 0, policy_version 70880 (0.0005) [2023-03-08 11:23:08,095][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000070128_35905536.pth [2023-03-08 11:23:11,621][389688] Updated weights for policy 0, policy_version 70960 (0.0004) [2023-03-08 11:23:13,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12260.2). Total num frames: 36347904. Throughput: 0: 12404.9. Samples: 36343872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:23:13,080][389401] Avg episode reward: [(0, '4580.362')] [2023-03-08 11:23:14,894][389688] Updated weights for policy 0, policy_version 71040 (0.0004) [2023-03-08 11:23:18,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12260.2). Total num frames: 36409344. Throughput: 0: 12491.3. Samples: 36381628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:23:18,080][389401] Avg episode reward: [(0, '4685.789')] [2023-03-08 11:23:18,231][389688] Updated weights for policy 0, policy_version 71120 (0.0004) [2023-03-08 11:23:21,710][389688] Updated weights for policy 0, policy_version 71200 (0.0004) [2023-03-08 11:23:23,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12288.0, 300 sec: 12246.3). Total num frames: 36466688. Throughput: 0: 12516.7. Samples: 36454172. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:23:23,080][389401] Avg episode reward: [(0, '4684.740')] [2023-03-08 11:23:23,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000071224_36466688.pth... [2023-03-08 11:23:23,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000070504_36098048.pth [2023-03-08 11:23:25,208][389688] Updated weights for policy 0, policy_version 71280 (0.0005) [2023-03-08 11:23:28,079][389401] Fps is (10 sec: 11468.9, 60 sec: 12288.0, 300 sec: 12232.5). Total num frames: 36524032. Throughput: 0: 12368.8. Samples: 36523504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:23:28,080][389401] Avg episode reward: [(0, '4726.214')] [2023-03-08 11:23:28,821][389688] Updated weights for policy 0, policy_version 71360 (0.0005) [2023-03-08 11:23:32,304][389688] Updated weights for policy 0, policy_version 71440 (0.0005) [2023-03-08 11:23:33,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 12232.5). Total num frames: 36585472. Throughput: 0: 12300.1. Samples: 36556872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:23:33,080][389401] Avg episode reward: [(0, '4715.901')] [2023-03-08 11:23:35,893][389688] Updated weights for policy 0, policy_version 71520 (0.0004) [2023-03-08 11:23:38,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12288.0, 300 sec: 12218.6). Total num frames: 36642816. Throughput: 0: 12152.5. Samples: 36626504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:23:38,080][389401] Avg episode reward: [(0, '4716.453')] [2023-03-08 11:23:38,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000071568_36642816.pth... [2023-03-08 11:23:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000070880_36290560.pth [2023-03-08 11:23:39,479][389688] Updated weights for policy 0, policy_version 71600 (0.0005) [2023-03-08 11:23:42,828][389688] Updated weights for policy 0, policy_version 71680 (0.0005) [2023-03-08 11:23:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12219.7, 300 sec: 12204.7). Total num frames: 36700160. Throughput: 0: 12013.8. Samples: 36698116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:23:43,080][389401] Avg episode reward: [(0, '4725.016')] [2023-03-08 11:23:46,076][389688] Updated weights for policy 0, policy_version 71760 (0.0004) [2023-03-08 11:23:48,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12204.7). Total num frames: 36761600. Throughput: 0: 11994.8. Samples: 36736184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:23:48,080][389401] Avg episode reward: [(0, '4705.907')] [2023-03-08 11:23:49,469][389688] Updated weights for policy 0, policy_version 71840 (0.0004) [2023-03-08 11:23:52,864][389688] Updated weights for policy 0, policy_version 71920 (0.0004) [2023-03-08 11:23:53,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 12190.8). Total num frames: 36823040. Throughput: 0: 11921.0. Samples: 36809256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:23:53,080][389401] Avg episode reward: [(0, '4724.948')] [2023-03-08 11:23:53,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000071920_36823040.pth... [2023-03-08 11:23:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000071224_36466688.pth [2023-03-08 11:23:56,267][389688] Updated weights for policy 0, policy_version 72000 (0.0005) [2023-03-08 11:23:58,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12083.2, 300 sec: 12190.8). Total num frames: 36884480. Throughput: 0: 11916.2. Samples: 36880100. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:23:58,080][389401] Avg episode reward: [(0, '4725.165')] [2023-03-08 11:23:59,849][389688] Updated weights for policy 0, policy_version 72080 (0.0005) [2023-03-08 11:24:03,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 12163.0). Total num frames: 36937728. Throughput: 0: 11813.1. Samples: 36913216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:24:03,080][389401] Avg episode reward: [(0, '4679.878')] [2023-03-08 11:24:03,500][389688] Updated weights for policy 0, policy_version 72160 (0.0005) [2023-03-08 11:24:07,177][389688] Updated weights for policy 0, policy_version 72240 (0.0006) [2023-03-08 11:24:08,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11810.1, 300 sec: 12149.1). Total num frames: 36995072. Throughput: 0: 11705.0. Samples: 36980900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:24:08,080][389401] Avg episode reward: [(0, '4684.488')] [2023-03-08 11:24:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000072256_36995072.pth... [2023-03-08 11:24:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000071568_36642816.pth [2023-03-08 11:24:10,635][389688] Updated weights for policy 0, policy_version 72320 (0.0004) [2023-03-08 11:24:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 12149.2). Total num frames: 37052416. Throughput: 0: 11731.9. Samples: 37051440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:24:13,080][389401] Avg episode reward: [(0, '4659.858')] [2023-03-08 11:24:14,118][389688] Updated weights for policy 0, policy_version 72400 (0.0005) [2023-03-08 11:24:17,608][389688] Updated weights for policy 0, policy_version 72480 (0.0005) [2023-03-08 11:24:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 12149.2). Total num frames: 37113856. Throughput: 0: 11770.4. Samples: 37086540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:24:18,080][389401] Avg episode reward: [(0, '4645.562')] [2023-03-08 11:24:21,021][389688] Updated weights for policy 0, policy_version 72560 (0.0005) [2023-03-08 11:24:23,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11810.1, 300 sec: 12149.1). Total num frames: 37175296. Throughput: 0: 11810.0. Samples: 37157956. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:24:23,080][389401] Avg episode reward: [(0, '4721.280')] [2023-03-08 11:24:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000072608_37175296.pth... [2023-03-08 11:24:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000071920_36823040.pth [2023-03-08 11:24:24,405][389688] Updated weights for policy 0, policy_version 72640 (0.0005) [2023-03-08 11:24:28,028][389688] Updated weights for policy 0, policy_version 72720 (0.0006) [2023-03-08 11:24:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 12135.3). Total num frames: 37232640. Throughput: 0: 11788.7. Samples: 37228608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:24:28,080][389401] Avg episode reward: [(0, '4684.412')] [2023-03-08 11:24:31,294][389688] Updated weights for policy 0, policy_version 72800 (0.0005) [2023-03-08 11:24:33,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11810.1, 300 sec: 12135.3). Total num frames: 37294080. Throughput: 0: 11762.0. Samples: 37265472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:24:33,080][389401] Avg episode reward: [(0, '4729.711')] [2023-03-08 11:24:34,743][389688] Updated weights for policy 0, policy_version 72880 (0.0005) [2023-03-08 11:24:38,079][389401] Fps is (10 sec: 11878.6, 60 sec: 11810.1, 300 sec: 12135.3). Total num frames: 37351424. Throughput: 0: 11762.9. Samples: 37338584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:24:38,080][389401] Avg episode reward: [(0, '4726.701')] [2023-03-08 11:24:38,140][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000072960_37355520.pth... [2023-03-08 11:24:38,141][389688] Updated weights for policy 0, policy_version 72960 (0.0005) [2023-03-08 11:24:38,143][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000072256_36995072.pth [2023-03-08 11:24:41,632][389688] Updated weights for policy 0, policy_version 73040 (0.0005) [2023-03-08 11:24:43,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 12149.2). Total num frames: 37412864. Throughput: 0: 11747.8. Samples: 37408752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:24:43,080][389401] Avg episode reward: [(0, '4723.599')] [2023-03-08 11:24:45,090][389688] Updated weights for policy 0, policy_version 73120 (0.0005) [2023-03-08 11:24:48,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 12121.4). Total num frames: 37470208. Throughput: 0: 11802.8. Samples: 37444344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:24:48,080][389401] Avg episode reward: [(0, '4726.111')] [2023-03-08 11:24:48,606][389688] Updated weights for policy 0, policy_version 73200 (0.0004) [2023-03-08 11:24:51,999][389688] Updated weights for policy 0, policy_version 73280 (0.0005) [2023-03-08 11:24:53,079][389401] Fps is (10 sec: 11878.2, 60 sec: 11810.1, 300 sec: 12135.3). Total num frames: 37531648. Throughput: 0: 11876.3. Samples: 37515336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:24:53,080][389401] Avg episode reward: [(0, '4688.838')] [2023-03-08 11:24:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000073304_37531648.pth... [2023-03-08 11:24:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000072608_37175296.pth [2023-03-08 11:24:55,407][389688] Updated weights for policy 0, policy_version 73360 (0.0005) [2023-03-08 11:24:58,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11741.8, 300 sec: 12121.4). Total num frames: 37588992. Throughput: 0: 11889.2. Samples: 37586456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:24:58,080][389401] Avg episode reward: [(0, '4726.202')] [2023-03-08 11:24:58,763][389688] Updated weights for policy 0, policy_version 73440 (0.0004) [2023-03-08 11:25:02,123][389688] Updated weights for policy 0, policy_version 73520 (0.0005) [2023-03-08 11:25:03,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 12121.4). Total num frames: 37650432. Throughput: 0: 11966.1. Samples: 37625016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:25:03,080][389401] Avg episode reward: [(0, '4711.969')] [2023-03-08 11:25:05,617][389688] Updated weights for policy 0, policy_version 73600 (0.0005) [2023-03-08 11:25:08,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 12107.5). Total num frames: 37711872. Throughput: 0: 11946.8. Samples: 37695560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:25:08,080][389401] Avg episode reward: [(0, '4721.466')] [2023-03-08 11:25:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000073656_37711872.pth... [2023-03-08 11:25:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000072960_37355520.pth [2023-03-08 11:25:08,963][389688] Updated weights for policy 0, policy_version 73680 (0.0005) [2023-03-08 11:25:12,350][389688] Updated weights for policy 0, policy_version 73760 (0.0005) [2023-03-08 11:25:13,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12014.9, 300 sec: 12121.4). Total num frames: 37773312. Throughput: 0: 12013.5. Samples: 37769216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:25:13,080][389401] Avg episode reward: [(0, '4724.139')] [2023-03-08 11:25:15,819][389688] Updated weights for policy 0, policy_version 73840 (0.0005) [2023-03-08 11:25:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12107.5). Total num frames: 37830656. Throughput: 0: 11969.2. Samples: 37804088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:25:18,080][389401] Avg episode reward: [(0, '4610.753')] [2023-03-08 11:25:19,222][389688] Updated weights for policy 0, policy_version 73920 (0.0005) [2023-03-08 11:25:22,682][389688] Updated weights for policy 0, policy_version 74000 (0.0005) [2023-03-08 11:25:23,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 12121.4). Total num frames: 37892096. Throughput: 0: 11936.3. Samples: 37875720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:25:23,080][389401] Avg episode reward: [(0, '4711.871')] [2023-03-08 11:25:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000074008_37892096.pth... [2023-03-08 11:25:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000073304_37531648.pth [2023-03-08 11:25:26,191][389688] Updated weights for policy 0, policy_version 74080 (0.0005) [2023-03-08 11:25:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12107.5). Total num frames: 37949440. Throughput: 0: 11937.0. Samples: 37945916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:25:28,080][389401] Avg episode reward: [(0, '4703.984')] [2023-03-08 11:25:29,625][389688] Updated weights for policy 0, policy_version 74160 (0.0005) [2023-03-08 11:25:33,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11878.4, 300 sec: 12093.6). Total num frames: 38006784. Throughput: 0: 11954.0. Samples: 37982272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:25:33,080][389401] Avg episode reward: [(0, '4684.324')] [2023-03-08 11:25:33,127][389688] Updated weights for policy 0, policy_version 74240 (0.0005) [2023-03-08 11:25:36,582][389688] Updated weights for policy 0, policy_version 74320 (0.0004) [2023-03-08 11:25:36,911][389644] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000004 [2023-03-08 11:25:38,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12093.6). Total num frames: 38068224. Throughput: 0: 11935.8. Samples: 38052444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:25:38,080][389401] Avg episode reward: [(0, '4721.953')] [2023-03-08 11:25:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000074352_38068224.pth... [2023-03-08 11:25:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000073656_37711872.pth [2023-03-08 11:25:39,912][389688] Updated weights for policy 0, policy_version 74400 (0.0005) [2023-03-08 11:25:43,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 12093.6). Total num frames: 38129664. Throughput: 0: 12004.7. Samples: 38126668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:25:43,080][389401] Avg episode reward: [(0, '4724.461')] [2023-03-08 11:25:43,161][389688] Updated weights for policy 0, policy_version 74480 (0.0004) [2023-03-08 11:25:46,312][389688] Updated weights for policy 0, policy_version 74560 (0.0004) [2023-03-08 11:25:48,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12083.2, 300 sec: 12093.6). Total num frames: 38195200. Throughput: 0: 12035.0. Samples: 38166592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:25:48,080][389401] Avg episode reward: [(0, '4473.423')] [2023-03-08 11:25:49,679][389688] Updated weights for policy 0, policy_version 74640 (0.0005) [2023-03-08 11:25:53,032][389688] Updated weights for policy 0, policy_version 74720 (0.0005) [2023-03-08 11:25:53,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12083.2, 300 sec: 12093.6). Total num frames: 38256640. Throughput: 0: 12085.4. Samples: 38239404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:25:53,080][389401] Avg episode reward: [(0, '4524.269')] [2023-03-08 11:25:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000074720_38256640.pth... [2023-03-08 11:25:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000074008_37892096.pth [2023-03-08 11:25:56,238][389688] Updated weights for policy 0, policy_version 74800 (0.0004) [2023-03-08 11:25:58,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 12093.6). Total num frames: 38318080. Throughput: 0: 12127.0. Samples: 38314932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:25:58,080][389401] Avg episode reward: [(0, '4721.639')] [2023-03-08 11:25:59,541][389688] Updated weights for policy 0, policy_version 74880 (0.0005) [2023-03-08 11:26:03,035][389688] Updated weights for policy 0, policy_version 74960 (0.0005) [2023-03-08 11:26:03,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 12107.5). Total num frames: 38379520. Throughput: 0: 12186.8. Samples: 38352496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:26:03,090][389401] Avg episode reward: [(0, '4711.352')] [2023-03-08 11:26:06,474][389688] Updated weights for policy 0, policy_version 75040 (0.0005) [2023-03-08 11:26:08,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 12079.7). Total num frames: 38436864. Throughput: 0: 12157.7. Samples: 38422816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:26:08,080][389401] Avg episode reward: [(0, '4725.628')] [2023-03-08 11:26:08,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000075072_38436864.pth... [2023-03-08 11:26:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000074352_38068224.pth [2023-03-08 11:26:10,049][389688] Updated weights for policy 0, policy_version 75120 (0.0004) [2023-03-08 11:26:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 12065.8). Total num frames: 38494208. Throughput: 0: 12097.8. Samples: 38490316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:26:13,080][389401] Avg episode reward: [(0, '4727.619')] [2023-03-08 11:26:13,682][389688] Updated weights for policy 0, policy_version 75200 (0.0006) [2023-03-08 11:26:17,360][389688] Updated weights for policy 0, policy_version 75280 (0.0005) [2023-03-08 11:26:18,079][389401] Fps is (10 sec: 11468.9, 60 sec: 12014.9, 300 sec: 12052.0). Total num frames: 38551552. Throughput: 0: 12034.8. Samples: 38523840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:26:18,080][389401] Avg episode reward: [(0, '4728.356')] [2023-03-08 11:26:21,075][389688] Updated weights for policy 0, policy_version 75360 (0.0005) [2023-03-08 11:26:23,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11946.7, 300 sec: 12024.2). Total num frames: 38608896. Throughput: 0: 11989.7. Samples: 38591980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:26:23,080][389401] Avg episode reward: [(0, '4728.785')] [2023-03-08 11:26:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000075408_38608896.pth... [2023-03-08 11:26:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000074720_38256640.pth [2023-03-08 11:26:24,378][389688] Updated weights for policy 0, policy_version 75440 (0.0004) [2023-03-08 11:26:27,746][389688] Updated weights for policy 0, policy_version 75520 (0.0005) [2023-03-08 11:26:28,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11996.4). Total num frames: 38666240. Throughput: 0: 11961.6. Samples: 38664940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:26:28,080][389401] Avg episode reward: [(0, '4732.299')] [2023-03-08 11:26:31,149][389688] Updated weights for policy 0, policy_version 75600 (0.0004) [2023-03-08 11:26:33,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12014.9, 300 sec: 11996.4). Total num frames: 38727680. Throughput: 0: 11885.1. Samples: 38701420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:26:33,080][389401] Avg episode reward: [(0, '4729.080')] [2023-03-08 11:26:34,543][389688] Updated weights for policy 0, policy_version 75680 (0.0004) [2023-03-08 11:26:37,824][389688] Updated weights for policy 0, policy_version 75760 (0.0004) [2023-03-08 11:26:38,079][389401] Fps is (10 sec: 12287.8, 60 sec: 12014.9, 300 sec: 11996.4). Total num frames: 38789120. Throughput: 0: 11882.5. Samples: 38774116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:26:38,080][389401] Avg episode reward: [(0, '4691.828')] [2023-03-08 11:26:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000075760_38789120.pth... [2023-03-08 11:26:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000075072_38436864.pth [2023-03-08 11:26:41,092][389688] Updated weights for policy 0, policy_version 75840 (0.0004) [2023-03-08 11:26:43,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12083.2, 300 sec: 12024.2). Total num frames: 38854656. Throughput: 0: 11881.0. Samples: 38849576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:26:43,080][389401] Avg episode reward: [(0, '4685.592')] [2023-03-08 11:26:44,423][389688] Updated weights for policy 0, policy_version 75920 (0.0005) [2023-03-08 11:26:47,860][389688] Updated weights for policy 0, policy_version 76000 (0.0005) [2023-03-08 11:26:48,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11996.4). Total num frames: 38912000. Throughput: 0: 11856.1. Samples: 38886020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:26:48,080][389401] Avg episode reward: [(0, '4686.634')] [2023-03-08 11:26:51,166][389688] Updated weights for policy 0, policy_version 76080 (0.0004) [2023-03-08 11:26:53,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11996.4). Total num frames: 38973440. Throughput: 0: 11908.4. Samples: 38958692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:26:53,080][389401] Avg episode reward: [(0, '4728.457')] [2023-03-08 11:26:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000076120_38973440.pth... [2023-03-08 11:26:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000075408_38608896.pth [2023-03-08 11:26:54,677][389688] Updated weights for policy 0, policy_version 76160 (0.0005) [2023-03-08 11:26:58,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 11982.5). Total num frames: 39030784. Throughput: 0: 11999.0. Samples: 39030272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:26:58,080][389401] Avg episode reward: [(0, '4709.172')] [2023-03-08 11:26:58,128][389688] Updated weights for policy 0, policy_version 76240 (0.0005) [2023-03-08 11:27:01,644][389688] Updated weights for policy 0, policy_version 76320 (0.0005) [2023-03-08 11:27:03,079][389401] Fps is (10 sec: 11469.0, 60 sec: 11810.1, 300 sec: 11982.5). Total num frames: 39088128. Throughput: 0: 11995.8. Samples: 39063652. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:27:03,080][389401] Avg episode reward: [(0, '4681.889')] [2023-03-08 11:27:05,173][389688] Updated weights for policy 0, policy_version 76400 (0.0005) [2023-03-08 11:27:08,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11996.4). Total num frames: 39149568. Throughput: 0: 12036.1. Samples: 39133604. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:27:08,080][389401] Avg episode reward: [(0, '4684.114')] [2023-03-08 11:27:08,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000076464_39149568.pth... [2023-03-08 11:27:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000075760_38789120.pth [2023-03-08 11:27:08,708][389688] Updated weights for policy 0, policy_version 76480 (0.0004) [2023-03-08 11:27:12,118][389688] Updated weights for policy 0, policy_version 76560 (0.0005) [2023-03-08 11:27:13,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11982.5). Total num frames: 39206912. Throughput: 0: 12014.6. Samples: 39205596. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:27:13,080][389401] Avg episode reward: [(0, '4726.932')] [2023-03-08 11:27:15,608][389688] Updated weights for policy 0, policy_version 76640 (0.0005) [2023-03-08 11:27:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11996.4). Total num frames: 39268352. Throughput: 0: 11964.7. Samples: 39239832. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:27:18,080][389401] Avg episode reward: [(0, '4706.284')] [2023-03-08 11:27:18,951][389688] Updated weights for policy 0, policy_version 76720 (0.0005) [2023-03-08 11:27:22,420][389688] Updated weights for policy 0, policy_version 76800 (0.0004) [2023-03-08 11:27:23,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12014.9, 300 sec: 12010.3). Total num frames: 39329792. Throughput: 0: 11978.9. Samples: 39313164. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:27:23,080][389401] Avg episode reward: [(0, '4730.357')] [2023-03-08 11:27:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000076816_39329792.pth... [2023-03-08 11:27:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000076120_38973440.pth [2023-03-08 11:27:25,819][389688] Updated weights for policy 0, policy_version 76880 (0.0005) [2023-03-08 11:27:28,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12014.9, 300 sec: 11996.4). Total num frames: 39387136. Throughput: 0: 11867.8. Samples: 39383628. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:27:28,080][389401] Avg episode reward: [(0, '4709.858')] [2023-03-08 11:27:29,363][389688] Updated weights for policy 0, policy_version 76960 (0.0005) [2023-03-08 11:27:32,925][389688] Updated weights for policy 0, policy_version 77040 (0.0005) [2023-03-08 11:27:33,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11996.4). Total num frames: 39444480. Throughput: 0: 11844.3. Samples: 39419016. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:27:33,080][389401] Avg episode reward: [(0, '4727.057')] [2023-03-08 11:27:36,434][389688] Updated weights for policy 0, policy_version 77120 (0.0005) [2023-03-08 11:27:38,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11982.5). Total num frames: 39501824. Throughput: 0: 11764.5. Samples: 39488092. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:27:38,080][389401] Avg episode reward: [(0, '4598.145')] [2023-03-08 11:27:38,111][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000077160_39505920.pth... [2023-03-08 11:27:38,113][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000076464_39149568.pth [2023-03-08 11:27:39,827][389688] Updated weights for policy 0, policy_version 77200 (0.0005) [2023-03-08 11:27:43,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11968.6). Total num frames: 39563264. Throughput: 0: 11807.6. Samples: 39561616. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:27:43,080][389401] Avg episode reward: [(0, '4627.496')] [2023-03-08 11:27:43,117][389688] Updated weights for policy 0, policy_version 77280 (0.0004) [2023-03-08 11:27:46,553][389688] Updated weights for policy 0, policy_version 77360 (0.0005) [2023-03-08 11:27:48,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11954.8). Total num frames: 39624704. Throughput: 0: 11892.9. Samples: 39598832. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:27:48,080][389401] Avg episode reward: [(0, '4727.806')] [2023-03-08 11:27:49,848][389688] Updated weights for policy 0, policy_version 77440 (0.0004) [2023-03-08 11:27:53,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11954.8). Total num frames: 39686144. Throughput: 0: 11929.4. Samples: 39670428. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:27:53,080][389401] Avg episode reward: [(0, '4727.090')] [2023-03-08 11:27:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000077512_39686144.pth... [2023-03-08 11:27:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000076816_39329792.pth [2023-03-08 11:27:53,243][389688] Updated weights for policy 0, policy_version 77520 (0.0005) [2023-03-08 11:27:56,880][389688] Updated weights for policy 0, policy_version 77600 (0.0005) [2023-03-08 11:27:58,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11927.0). Total num frames: 39743488. Throughput: 0: 11871.9. Samples: 39739832. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:27:58,080][389401] Avg episode reward: [(0, '4655.893')] [2023-03-08 11:28:00,409][389688] Updated weights for policy 0, policy_version 77680 (0.0005) [2023-03-08 11:28:03,079][389401] Fps is (10 sec: 11469.0, 60 sec: 11878.4, 300 sec: 11913.1). Total num frames: 39800832. Throughput: 0: 11905.2. Samples: 39775564. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:28:03,080][389401] Avg episode reward: [(0, '4557.467')] [2023-03-08 11:28:03,861][389688] Updated weights for policy 0, policy_version 77760 (0.0005) [2023-03-08 11:28:07,182][389688] Updated weights for policy 0, policy_version 77840 (0.0004) [2023-03-08 11:28:08,079][389401] Fps is (10 sec: 11878.2, 60 sec: 11878.4, 300 sec: 11913.1). Total num frames: 39862272. Throughput: 0: 11852.9. Samples: 39846544. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:28:08,080][389401] Avg episode reward: [(0, '4567.830')] [2023-03-08 11:28:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000077856_39862272.pth... [2023-03-08 11:28:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000077160_39505920.pth [2023-03-08 11:28:10,547][389688] Updated weights for policy 0, policy_version 77920 (0.0005) [2023-03-08 11:28:13,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11946.6, 300 sec: 11913.1). Total num frames: 39923712. Throughput: 0: 11915.9. Samples: 39919844. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:28:13,080][389401] Avg episode reward: [(0, '4209.114')] [2023-03-08 11:28:13,953][389688] Updated weights for policy 0, policy_version 78000 (0.0005) [2023-03-08 11:28:17,359][389688] Updated weights for policy 0, policy_version 78080 (0.0004) [2023-03-08 11:28:18,079][389401] Fps is (10 sec: 12288.2, 60 sec: 11946.7, 300 sec: 11927.0). Total num frames: 39985152. Throughput: 0: 11945.1. Samples: 39956544. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:28:18,080][389401] Avg episode reward: [(0, '4455.486')] [2023-03-08 11:28:20,882][389688] Updated weights for policy 0, policy_version 78160 (0.0005) [2023-03-08 11:28:23,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11927.0). Total num frames: 40042496. Throughput: 0: 11959.0. Samples: 40026248. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:28:23,080][389401] Avg episode reward: [(0, '4681.890')] [2023-03-08 11:28:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000078208_40042496.pth... [2023-03-08 11:28:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000077512_39686144.pth [2023-03-08 11:28:24,411][389688] Updated weights for policy 0, policy_version 78240 (0.0005) [2023-03-08 11:28:27,734][389688] Updated weights for policy 0, policy_version 78320 (0.0004) [2023-03-08 11:28:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11927.0). Total num frames: 40103936. Throughput: 0: 11943.4. Samples: 40099068. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:28:28,080][389401] Avg episode reward: [(0, '4724.840')] [2023-03-08 11:28:31,276][389688] Updated weights for policy 0, policy_version 78400 (0.0005) [2023-03-08 11:28:33,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11927.0). Total num frames: 40161280. Throughput: 0: 11888.6. Samples: 40133820. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:28:33,090][389401] Avg episode reward: [(0, '4685.388')] [2023-03-08 11:28:34,722][389688] Updated weights for policy 0, policy_version 78480 (0.0004) [2023-03-08 11:28:38,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11927.0). Total num frames: 40218624. Throughput: 0: 11847.7. Samples: 40203572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:28:38,080][389401] Avg episode reward: [(0, '4729.414')] [2023-03-08 11:28:38,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000078552_40218624.pth... [2023-03-08 11:28:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000077856_39862272.pth [2023-03-08 11:28:38,316][389688] Updated weights for policy 0, policy_version 78560 (0.0004) [2023-03-08 11:28:41,835][389688] Updated weights for policy 0, policy_version 78640 (0.0005) [2023-03-08 11:28:43,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11878.4, 300 sec: 11913.1). Total num frames: 40275968. Throughput: 0: 11847.4. Samples: 40272968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:28:43,080][389401] Avg episode reward: [(0, '4726.231')] [2023-03-08 11:28:45,278][389688] Updated weights for policy 0, policy_version 78720 (0.0005) [2023-03-08 11:28:48,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 11913.1). Total num frames: 40337408. Throughput: 0: 11860.5. Samples: 40309288. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:28:48,080][389401] Avg episode reward: [(0, '4729.992')] [2023-03-08 11:28:48,530][389688] Updated weights for policy 0, policy_version 78800 (0.0004) [2023-03-08 11:28:52,075][389688] Updated weights for policy 0, policy_version 78880 (0.0005) [2023-03-08 11:28:53,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11810.1, 300 sec: 11899.2). Total num frames: 40394752. Throughput: 0: 11909.3. Samples: 40382464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:28:53,080][389401] Avg episode reward: [(0, '4671.447')] [2023-03-08 11:28:53,130][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000078904_40398848.pth... [2023-03-08 11:28:53,132][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000078208_40042496.pth [2023-03-08 11:28:55,595][389688] Updated weights for policy 0, policy_version 78960 (0.0005) [2023-03-08 11:28:58,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11913.1). Total num frames: 40452096. Throughput: 0: 11827.0. Samples: 40452060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:28:58,080][389401] Avg episode reward: [(0, '4678.947')] [2023-03-08 11:28:59,154][389688] Updated weights for policy 0, policy_version 79040 (0.0005) [2023-03-08 11:29:02,654][389688] Updated weights for policy 0, policy_version 79120 (0.0006) [2023-03-08 11:29:03,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11927.0). Total num frames: 40513536. Throughput: 0: 11761.8. Samples: 40485828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:29:03,080][389401] Avg episode reward: [(0, '4690.772')] [2023-03-08 11:29:06,201][389688] Updated weights for policy 0, policy_version 79200 (0.0005) [2023-03-08 11:29:08,079][389401] Fps is (10 sec: 11878.2, 60 sec: 11810.1, 300 sec: 11927.0). Total num frames: 40570880. Throughput: 0: 11756.1. Samples: 40555272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:29:08,080][389401] Avg episode reward: [(0, '4662.298')] [2023-03-08 11:29:08,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000079240_40570880.pth... [2023-03-08 11:29:08,087][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000078552_40218624.pth [2023-03-08 11:29:09,761][389688] Updated weights for policy 0, policy_version 79280 (0.0005) [2023-03-08 11:29:13,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 11913.1). Total num frames: 40628224. Throughput: 0: 11729.9. Samples: 40626916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:29:13,090][389401] Avg episode reward: [(0, '4730.672')] [2023-03-08 11:29:13,124][389688] Updated weights for policy 0, policy_version 79360 (0.0005) [2023-03-08 11:29:16,730][389688] Updated weights for policy 0, policy_version 79440 (0.0005) [2023-03-08 11:29:18,079][389401] Fps is (10 sec: 11469.0, 60 sec: 11673.6, 300 sec: 11899.2). Total num frames: 40685568. Throughput: 0: 11716.4. Samples: 40661056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:29:18,080][389401] Avg episode reward: [(0, '4731.927')] [2023-03-08 11:29:20,321][389688] Updated weights for policy 0, policy_version 79520 (0.0005) [2023-03-08 11:29:23,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 11899.2). Total num frames: 40742912. Throughput: 0: 11697.1. Samples: 40729944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:29:23,080][389401] Avg episode reward: [(0, '4727.962')] [2023-03-08 11:29:23,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000079576_40742912.pth... [2023-03-08 11:29:23,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000078904_40398848.pth [2023-03-08 11:29:23,917][389688] Updated weights for policy 0, policy_version 79600 (0.0005) [2023-03-08 11:29:27,299][389688] Updated weights for policy 0, policy_version 79680 (0.0004) [2023-03-08 11:29:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11899.2). Total num frames: 40804352. Throughput: 0: 11719.1. Samples: 40800328. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:29:28,080][389401] Avg episode reward: [(0, '4727.456')] [2023-03-08 11:29:30,671][389688] Updated weights for policy 0, policy_version 79760 (0.0004) [2023-03-08 11:29:33,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11913.1). Total num frames: 40865792. Throughput: 0: 11729.4. Samples: 40837112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:29:33,080][389401] Avg episode reward: [(0, '4727.975')] [2023-03-08 11:29:33,936][389688] Updated weights for policy 0, policy_version 79840 (0.0004) [2023-03-08 11:29:37,435][389688] Updated weights for policy 0, policy_version 79920 (0.0005) [2023-03-08 11:29:38,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11899.2). Total num frames: 40923136. Throughput: 0: 11727.2. Samples: 40910188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:29:38,080][389401] Avg episode reward: [(0, '4730.668')] [2023-03-08 11:29:38,143][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000079936_40927232.pth... [2023-03-08 11:29:38,144][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000079240_40570880.pth [2023-03-08 11:29:41,039][389688] Updated weights for policy 0, policy_version 80000 (0.0005) [2023-03-08 11:29:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11899.2). Total num frames: 40980480. Throughput: 0: 11705.8. Samples: 40978820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:29:43,080][389401] Avg episode reward: [(0, '4729.428')] [2023-03-08 11:29:44,568][389688] Updated weights for policy 0, policy_version 80080 (0.0005) [2023-03-08 11:29:48,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11885.3). Total num frames: 41037824. Throughput: 0: 11720.7. Samples: 41013260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:29:48,080][389401] Avg episode reward: [(0, '4622.291')] [2023-03-08 11:29:48,177][389688] Updated weights for policy 0, policy_version 80160 (0.0005) [2023-03-08 11:29:51,728][389688] Updated weights for policy 0, policy_version 80240 (0.0005) [2023-03-08 11:29:53,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 11885.3). Total num frames: 41095168. Throughput: 0: 11721.1. Samples: 41082720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:29:53,080][389401] Avg episode reward: [(0, '4536.620')] [2023-03-08 11:29:53,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000080264_41095168.pth... [2023-03-08 11:29:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000079576_40742912.pth [2023-03-08 11:29:55,392][389688] Updated weights for policy 0, policy_version 80320 (0.0005) [2023-03-08 11:29:58,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11871.5). Total num frames: 41152512. Throughput: 0: 11621.4. Samples: 41149876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:29:58,080][389401] Avg episode reward: [(0, '4670.960')] [2023-03-08 11:29:58,947][389688] Updated weights for policy 0, policy_version 80400 (0.0005) [2023-03-08 11:30:02,520][389688] Updated weights for policy 0, policy_version 80480 (0.0005) [2023-03-08 11:30:03,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11857.6). Total num frames: 41209856. Throughput: 0: 11649.4. Samples: 41185280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:30:03,080][389401] Avg episode reward: [(0, '4655.400')] [2023-03-08 11:30:06,054][389688] Updated weights for policy 0, policy_version 80560 (0.0005) [2023-03-08 11:30:08,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11605.4, 300 sec: 11843.7). Total num frames: 41267200. Throughput: 0: 11638.8. Samples: 41253692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:30:08,080][389401] Avg episode reward: [(0, '4632.572')] [2023-03-08 11:30:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000080600_41267200.pth... [2023-03-08 11:30:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000079936_40927232.pth [2023-03-08 11:30:09,525][389688] Updated weights for policy 0, policy_version 80640 (0.0005) [2023-03-08 11:30:12,681][389688] Updated weights for policy 0, policy_version 80720 (0.0004) [2023-03-08 11:30:13,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11741.9, 300 sec: 11871.5). Total num frames: 41332736. Throughput: 0: 11740.4. Samples: 41328648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:30:13,080][389401] Avg episode reward: [(0, '4684.510')] [2023-03-08 11:30:16,106][389688] Updated weights for policy 0, policy_version 80800 (0.0005) [2023-03-08 11:30:18,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11741.9, 300 sec: 11857.6). Total num frames: 41390080. Throughput: 0: 11721.5. Samples: 41364580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:30:18,080][389401] Avg episode reward: [(0, '4435.415')] [2023-03-08 11:30:19,407][389688] Updated weights for policy 0, policy_version 80880 (0.0005) [2023-03-08 11:30:22,786][389688] Updated weights for policy 0, policy_version 80960 (0.0004) [2023-03-08 11:30:23,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11871.5). Total num frames: 41451520. Throughput: 0: 11724.8. Samples: 41437804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:30:23,080][389401] Avg episode reward: [(0, '4599.814')] [2023-03-08 11:30:23,110][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000080968_41455616.pth... [2023-03-08 11:30:23,113][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000080264_41095168.pth [2023-03-08 11:30:26,239][389688] Updated weights for policy 0, policy_version 81040 (0.0004) [2023-03-08 11:30:28,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 11885.3). Total num frames: 41512960. Throughput: 0: 11778.9. Samples: 41508872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:30:28,080][389401] Avg episode reward: [(0, '4674.751')] [2023-03-08 11:30:29,916][389688] Updated weights for policy 0, policy_version 81120 (0.0005) [2023-03-08 11:30:33,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11857.6). Total num frames: 41566208. Throughput: 0: 11743.0. Samples: 41541696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:30:33,080][389401] Avg episode reward: [(0, '4667.704')] [2023-03-08 11:30:33,482][389688] Updated weights for policy 0, policy_version 81200 (0.0005) [2023-03-08 11:30:36,896][389688] Updated weights for policy 0, policy_version 81280 (0.0005) [2023-03-08 11:30:38,079][389401] Fps is (10 sec: 11468.6, 60 sec: 11741.8, 300 sec: 11857.6). Total num frames: 41627648. Throughput: 0: 11771.4. Samples: 41612432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:30:38,080][389401] Avg episode reward: [(0, '4725.645')] [2023-03-08 11:30:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000081304_41627648.pth... [2023-03-08 11:30:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000080600_41267200.pth [2023-03-08 11:30:40,519][389688] Updated weights for policy 0, policy_version 81360 (0.0005) [2023-03-08 11:30:43,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11741.9, 300 sec: 11829.8). Total num frames: 41684992. Throughput: 0: 11801.9. Samples: 41680960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:30:43,080][389401] Avg episode reward: [(0, '4668.719')] [2023-03-08 11:30:44,027][389688] Updated weights for policy 0, policy_version 81440 (0.0005) [2023-03-08 11:30:47,543][389688] Updated weights for policy 0, policy_version 81520 (0.0005) [2023-03-08 11:30:48,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 11815.9). Total num frames: 41742336. Throughput: 0: 11807.1. Samples: 41716600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:30:48,080][389401] Avg episode reward: [(0, '4573.730')] [2023-03-08 11:30:51,228][389688] Updated weights for policy 0, policy_version 81600 (0.0005) [2023-03-08 11:30:53,079][389401] Fps is (10 sec: 11468.6, 60 sec: 11741.9, 300 sec: 11802.0). Total num frames: 41799680. Throughput: 0: 11781.1. Samples: 41783840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:30:53,080][389401] Avg episode reward: [(0, '4729.067')] [2023-03-08 11:30:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000081640_41799680.pth... [2023-03-08 11:30:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000080968_41455616.pth [2023-03-08 11:30:54,719][389688] Updated weights for policy 0, policy_version 81680 (0.0005) [2023-03-08 11:30:58,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 11788.2). Total num frames: 41857024. Throughput: 0: 11670.6. Samples: 41853824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:30:58,080][389401] Avg episode reward: [(0, '4535.464')] [2023-03-08 11:30:58,282][389688] Updated weights for policy 0, policy_version 81760 (0.0005) [2023-03-08 11:31:01,881][389688] Updated weights for policy 0, policy_version 81840 (0.0005) [2023-03-08 11:31:03,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11788.2). Total num frames: 41914368. Throughput: 0: 11640.9. Samples: 41888420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:31:03,080][389401] Avg episode reward: [(0, '4466.579')] [2023-03-08 11:31:05,372][389688] Updated weights for policy 0, policy_version 81920 (0.0005) [2023-03-08 11:31:08,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11802.0). Total num frames: 41975808. Throughput: 0: 11585.2. Samples: 41959136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:31:08,080][389401] Avg episode reward: [(0, '4728.357')] [2023-03-08 11:31:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000081984_41975808.pth... [2023-03-08 11:31:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000081304_41627648.pth [2023-03-08 11:31:08,715][389688] Updated weights for policy 0, policy_version 82000 (0.0004) [2023-03-08 11:31:12,299][389688] Updated weights for policy 0, policy_version 82080 (0.0005) [2023-03-08 11:31:13,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11802.0). Total num frames: 42033152. Throughput: 0: 11561.0. Samples: 42029120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:31:13,080][389401] Avg episode reward: [(0, '4702.316')] [2023-03-08 11:31:15,673][389688] Updated weights for policy 0, policy_version 82160 (0.0004) [2023-03-08 11:31:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11815.9). Total num frames: 42094592. Throughput: 0: 11647.4. Samples: 42065828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:31:18,080][389401] Avg episode reward: [(0, '4676.680')] [2023-03-08 11:31:18,980][389688] Updated weights for policy 0, policy_version 82240 (0.0004) [2023-03-08 11:31:22,179][389688] Updated weights for policy 0, policy_version 82320 (0.0003) [2023-03-08 11:31:23,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11829.8). Total num frames: 42156032. Throughput: 0: 11740.0. Samples: 42140732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:31:23,080][389401] Avg episode reward: [(0, '4665.446')] [2023-03-08 11:31:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000082336_42156032.pth... [2023-03-08 11:31:23,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000081640_41799680.pth [2023-03-08 11:31:25,364][389688] Updated weights for policy 0, policy_version 82400 (0.0003) [2023-03-08 11:31:28,079][389401] Fps is (10 sec: 12697.5, 60 sec: 11810.1, 300 sec: 11843.7). Total num frames: 42221568. Throughput: 0: 11903.5. Samples: 42216620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:31:28,080][389401] Avg episode reward: [(0, '4681.996')] [2023-03-08 11:31:28,717][389688] Updated weights for policy 0, policy_version 82480 (0.0005) [2023-03-08 11:31:31,966][389688] Updated weights for policy 0, policy_version 82560 (0.0004) [2023-03-08 11:31:33,079][389401] Fps is (10 sec: 12697.7, 60 sec: 11946.7, 300 sec: 11843.7). Total num frames: 42283008. Throughput: 0: 11951.3. Samples: 42254408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:31:33,080][389401] Avg episode reward: [(0, '4689.051')] [2023-03-08 11:31:35,347][389688] Updated weights for policy 0, policy_version 82640 (0.0004) [2023-03-08 11:31:38,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11829.8). Total num frames: 42344448. Throughput: 0: 12105.3. Samples: 42328580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:31:38,080][389401] Avg episode reward: [(0, '4688.046')] [2023-03-08 11:31:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000082704_42344448.pth... [2023-03-08 11:31:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000081984_41975808.pth [2023-03-08 11:31:38,570][389688] Updated weights for policy 0, policy_version 82720 (0.0004) [2023-03-08 11:31:42,060][389688] Updated weights for policy 0, policy_version 82800 (0.0005) [2023-03-08 11:31:43,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11829.8). Total num frames: 42401792. Throughput: 0: 12154.7. Samples: 42400788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:31:43,080][389401] Avg episode reward: [(0, '4660.629')] [2023-03-08 11:31:45,529][389688] Updated weights for policy 0, policy_version 82880 (0.0005) [2023-03-08 11:31:48,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11829.8). Total num frames: 42463232. Throughput: 0: 12165.8. Samples: 42435880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:31:48,080][389401] Avg episode reward: [(0, '4689.701')] [2023-03-08 11:31:48,967][389688] Updated weights for policy 0, policy_version 82960 (0.0005) [2023-03-08 11:31:52,370][389688] Updated weights for policy 0, policy_version 83040 (0.0005) [2023-03-08 11:31:53,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11843.7). Total num frames: 42524672. Throughput: 0: 12203.8. Samples: 42508308. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:31:53,080][389401] Avg episode reward: [(0, '4714.693')] [2023-03-08 11:31:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000083056_42524672.pth... [2023-03-08 11:31:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000082336_42156032.pth [2023-03-08 11:31:55,649][389688] Updated weights for policy 0, policy_version 83120 (0.0004) [2023-03-08 11:31:58,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11857.6). Total num frames: 42586112. Throughput: 0: 12300.8. Samples: 42582656. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:31:58,080][389401] Avg episode reward: [(0, '4705.121')] [2023-03-08 11:31:58,943][389688] Updated weights for policy 0, policy_version 83200 (0.0004) [2023-03-08 11:32:02,528][389688] Updated weights for policy 0, policy_version 83280 (0.0005) [2023-03-08 11:32:03,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11843.7). Total num frames: 42643456. Throughput: 0: 12273.5. Samples: 42618136. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:32:03,080][389401] Avg episode reward: [(0, '4728.511')] [2023-03-08 11:32:06,072][389688] Updated weights for policy 0, policy_version 83360 (0.0005) [2023-03-08 11:32:08,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 11843.7). Total num frames: 42700800. Throughput: 0: 12145.3. Samples: 42687272. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:32:08,080][389401] Avg episode reward: [(0, '4646.783')] [2023-03-08 11:32:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000083400_42700800.pth... [2023-03-08 11:32:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000082704_42344448.pth [2023-03-08 11:32:09,596][389688] Updated weights for policy 0, policy_version 83440 (0.0005) [2023-03-08 11:32:13,035][389688] Updated weights for policy 0, policy_version 83520 (0.0005) [2023-03-08 11:32:13,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11843.7). Total num frames: 42762240. Throughput: 0: 12033.2. Samples: 42758112. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:32:13,080][389401] Avg episode reward: [(0, '4335.756')] [2023-03-08 11:32:16,577][389688] Updated weights for policy 0, policy_version 83600 (0.0005) [2023-03-08 11:32:18,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 11829.8). Total num frames: 42819584. Throughput: 0: 11968.9. Samples: 42793008. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:32:18,080][389401] Avg episode reward: [(0, '4681.400')] [2023-03-08 11:32:20,071][389688] Updated weights for policy 0, policy_version 83680 (0.0005) [2023-03-08 11:32:23,079][389401] Fps is (10 sec: 11468.7, 60 sec: 12014.9, 300 sec: 11829.8). Total num frames: 42876928. Throughput: 0: 11869.3. Samples: 42862700. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:32:23,080][389401] Avg episode reward: [(0, '4726.554')] [2023-03-08 11:32:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000083744_42876928.pth... [2023-03-08 11:32:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000083056_42524672.pth [2023-03-08 11:32:23,599][389688] Updated weights for policy 0, policy_version 83760 (0.0005) [2023-03-08 11:32:27,034][389688] Updated weights for policy 0, policy_version 83840 (0.0005) [2023-03-08 11:32:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11843.7). Total num frames: 42938368. Throughput: 0: 11838.6. Samples: 42933524. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:32:28,080][389401] Avg episode reward: [(0, '4664.422')] [2023-03-08 11:32:30,582][389688] Updated weights for policy 0, policy_version 83920 (0.0005) [2023-03-08 11:32:33,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 11843.7). Total num frames: 42995712. Throughput: 0: 11815.8. Samples: 42967592. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:32:33,080][389401] Avg episode reward: [(0, '4663.352')] [2023-03-08 11:32:33,893][389688] Updated weights for policy 0, policy_version 84000 (0.0005) [2023-03-08 11:32:37,354][389688] Updated weights for policy 0, policy_version 84080 (0.0005) [2023-03-08 11:32:38,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 11843.7). Total num frames: 43057152. Throughput: 0: 11832.4. Samples: 43040768. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:32:38,080][389401] Avg episode reward: [(0, '4675.661')] [2023-03-08 11:32:38,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000084096_43057152.pth... [2023-03-08 11:32:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000083400_42700800.pth [2023-03-08 11:32:40,641][389688] Updated weights for policy 0, policy_version 84160 (0.0005) [2023-03-08 11:32:43,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11843.7). Total num frames: 43118592. Throughput: 0: 11842.7. Samples: 43115576. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:32:43,080][389401] Avg episode reward: [(0, '4684.641')] [2023-03-08 11:32:43,844][389688] Updated weights for policy 0, policy_version 84240 (0.0004) [2023-03-08 11:32:47,077][389688] Updated weights for policy 0, policy_version 84320 (0.0004) [2023-03-08 11:32:48,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11857.6). Total num frames: 43184128. Throughput: 0: 11891.9. Samples: 43153272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:32:48,080][389401] Avg episode reward: [(0, '4730.820')] [2023-03-08 11:32:50,250][389688] Updated weights for policy 0, policy_version 84400 (0.0004) [2023-03-08 11:32:53,079][389401] Fps is (10 sec: 13107.1, 60 sec: 12083.2, 300 sec: 11885.3). Total num frames: 43249664. Throughput: 0: 12097.4. Samples: 43231656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:32:53,080][389401] Avg episode reward: [(0, '4728.780')] [2023-03-08 11:32:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000084472_43249664.pth... [2023-03-08 11:32:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000083744_42876928.pth [2023-03-08 11:32:53,322][389688] Updated weights for policy 0, policy_version 84480 (0.0004) [2023-03-08 11:32:56,453][389688] Updated weights for policy 0, policy_version 84560 (0.0004) [2023-03-08 11:32:58,079][389401] Fps is (10 sec: 13107.2, 60 sec: 12151.5, 300 sec: 11913.1). Total num frames: 43315200. Throughput: 0: 12281.5. Samples: 43310780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:32:58,080][389401] Avg episode reward: [(0, '4713.372')] [2023-03-08 11:32:59,666][389688] Updated weights for policy 0, policy_version 84640 (0.0004) [2023-03-08 11:33:02,856][389688] Updated weights for policy 0, policy_version 84720 (0.0004) [2023-03-08 11:33:03,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12219.7, 300 sec: 11913.1). Total num frames: 43376640. Throughput: 0: 12333.0. Samples: 43347992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:33:03,080][389401] Avg episode reward: [(0, '4727.343')] [2023-03-08 11:33:06,094][389688] Updated weights for policy 0, policy_version 84800 (0.0004) [2023-03-08 11:33:08,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12356.3, 300 sec: 11927.0). Total num frames: 43442176. Throughput: 0: 12489.9. Samples: 43424744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:33:08,080][389401] Avg episode reward: [(0, '4697.581')] [2023-03-08 11:33:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000084848_43442176.pth... [2023-03-08 11:33:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000084096_43057152.pth [2023-03-08 11:33:09,377][389688] Updated weights for policy 0, policy_version 84880 (0.0004) [2023-03-08 11:33:12,548][389688] Updated weights for policy 0, policy_version 84960 (0.0004) [2023-03-08 11:33:13,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12356.3, 300 sec: 11927.0). Total num frames: 43503616. Throughput: 0: 12603.5. Samples: 43500684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:33:13,080][389401] Avg episode reward: [(0, '4703.227')] [2023-03-08 11:33:15,729][389688] Updated weights for policy 0, policy_version 85040 (0.0004) [2023-03-08 11:33:18,079][389401] Fps is (10 sec: 12288.2, 60 sec: 12424.5, 300 sec: 11940.9). Total num frames: 43565056. Throughput: 0: 12717.0. Samples: 43539856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:33:18,080][389401] Avg episode reward: [(0, '4647.955')] [2023-03-08 11:33:19,101][389688] Updated weights for policy 0, policy_version 85120 (0.0004) [2023-03-08 11:33:22,400][389688] Updated weights for policy 0, policy_version 85200 (0.0004) [2023-03-08 11:33:23,079][389401] Fps is (10 sec: 12287.8, 60 sec: 12492.8, 300 sec: 11940.9). Total num frames: 43626496. Throughput: 0: 12722.0. Samples: 43613260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:33:23,080][389401] Avg episode reward: [(0, '4559.067')] [2023-03-08 11:33:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000085208_43626496.pth... [2023-03-08 11:33:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000084472_43249664.pth [2023-03-08 11:33:25,928][389688] Updated weights for policy 0, policy_version 85280 (0.0005) [2023-03-08 11:33:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12424.5, 300 sec: 11940.9). Total num frames: 43683840. Throughput: 0: 12621.4. Samples: 43683540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:33:28,080][389401] Avg episode reward: [(0, '4640.158')] [2023-03-08 11:33:29,498][389688] Updated weights for policy 0, policy_version 85360 (0.0004) [2023-03-08 11:33:32,993][389688] Updated weights for policy 0, policy_version 85440 (0.0005) [2023-03-08 11:33:33,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12492.8, 300 sec: 11954.8). Total num frames: 43745280. Throughput: 0: 12549.7. Samples: 43718008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:33:33,080][389401] Avg episode reward: [(0, '4681.196')] [2023-03-08 11:33:36,518][389688] Updated weights for policy 0, policy_version 85520 (0.0006) [2023-03-08 11:33:38,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12424.5, 300 sec: 11954.8). Total num frames: 43802624. Throughput: 0: 12354.3. Samples: 43787600. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:33:38,080][389401] Avg episode reward: [(0, '4499.452')] [2023-03-08 11:33:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000085552_43802624.pth... [2023-03-08 11:33:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000084848_43442176.pth [2023-03-08 11:33:40,024][389688] Updated weights for policy 0, policy_version 85600 (0.0005) [2023-03-08 11:33:43,079][389401] Fps is (10 sec: 11468.9, 60 sec: 12356.3, 300 sec: 11940.9). Total num frames: 43859968. Throughput: 0: 12164.4. Samples: 43858176. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:33:43,080][389401] Avg episode reward: [(0, '4708.169')] [2023-03-08 11:33:43,531][389688] Updated weights for policy 0, policy_version 85680 (0.0005) [2023-03-08 11:33:46,957][389688] Updated weights for policy 0, policy_version 85760 (0.0005) [2023-03-08 11:33:48,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 11954.8). Total num frames: 43921408. Throughput: 0: 12107.0. Samples: 43892808. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:33:48,080][389401] Avg episode reward: [(0, '4661.366')] [2023-03-08 11:33:50,395][389688] Updated weights for policy 0, policy_version 85840 (0.0004) [2023-03-08 11:33:53,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12151.5, 300 sec: 11954.8). Total num frames: 43978752. Throughput: 0: 12015.8. Samples: 43965456. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:33:53,080][389401] Avg episode reward: [(0, '4696.175')] [2023-03-08 11:33:53,100][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000085904_43982848.pth... [2023-03-08 11:33:53,101][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000085208_43626496.pth [2023-03-08 11:33:53,760][389688] Updated weights for policy 0, policy_version 85920 (0.0003) [2023-03-08 11:33:57,027][389688] Updated weights for policy 0, policy_version 86000 (0.0003) [2023-03-08 11:33:58,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11968.7). Total num frames: 44044288. Throughput: 0: 11979.6. Samples: 44039768. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:33:58,080][389401] Avg episode reward: [(0, '4721.751')] [2023-03-08 11:34:00,359][389688] Updated weights for policy 0, policy_version 86080 (0.0003) [2023-03-08 11:34:03,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12151.5, 300 sec: 11982.5). Total num frames: 44105728. Throughput: 0: 11932.9. Samples: 44076836. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:34:03,080][389401] Avg episode reward: [(0, '4720.979')] [2023-03-08 11:34:03,676][389688] Updated weights for policy 0, policy_version 86160 (0.0003) [2023-03-08 11:34:07,252][389688] Updated weights for policy 0, policy_version 86240 (0.0005) [2023-03-08 11:34:08,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11982.5). Total num frames: 44163072. Throughput: 0: 11890.3. Samples: 44148324. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:34:08,080][389401] Avg episode reward: [(0, '4444.497')] [2023-03-08 11:34:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000086256_44163072.pth... [2023-03-08 11:34:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000085552_43802624.pth [2023-03-08 11:34:10,703][389688] Updated weights for policy 0, policy_version 86320 (0.0005) [2023-03-08 11:34:13,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11996.4). Total num frames: 44224512. Throughput: 0: 11921.3. Samples: 44220000. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:34:13,080][389401] Avg episode reward: [(0, '4625.853')] [2023-03-08 11:34:14,014][389688] Updated weights for policy 0, policy_version 86400 (0.0004) [2023-03-08 11:34:17,474][389688] Updated weights for policy 0, policy_version 86480 (0.0005) [2023-03-08 11:34:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11996.4). Total num frames: 44281856. Throughput: 0: 11982.2. Samples: 44257208. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:34:18,080][389401] Avg episode reward: [(0, '4671.854')] [2023-03-08 11:34:20,942][389688] Updated weights for policy 0, policy_version 86560 (0.0004) [2023-03-08 11:34:23,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11996.4). Total num frames: 44343296. Throughput: 0: 11984.9. Samples: 44326920. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:34:23,080][389401] Avg episode reward: [(0, '4723.468')] [2023-03-08 11:34:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000086608_44343296.pth... [2023-03-08 11:34:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000085904_43982848.pth [2023-03-08 11:34:24,563][389688] Updated weights for policy 0, policy_version 86640 (0.0005) [2023-03-08 11:34:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11968.6). Total num frames: 44396544. Throughput: 0: 11917.7. Samples: 44394472. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:34:28,080][389401] Avg episode reward: [(0, '4730.675')] [2023-03-08 11:34:28,212][389688] Updated weights for policy 0, policy_version 86720 (0.0005) [2023-03-08 11:34:31,794][389688] Updated weights for policy 0, policy_version 86800 (0.0005) [2023-03-08 11:34:33,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11810.2, 300 sec: 11968.6). Total num frames: 44453888. Throughput: 0: 11906.9. Samples: 44428616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:34:33,080][389401] Avg episode reward: [(0, '4731.190')] [2023-03-08 11:34:35,358][389688] Updated weights for policy 0, policy_version 86880 (0.0005) [2023-03-08 11:34:38,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11968.6). Total num frames: 44511232. Throughput: 0: 11830.3. Samples: 44497820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:34:38,080][389401] Avg episode reward: [(0, '4683.508')] [2023-03-08 11:34:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000086936_44511232.pth... [2023-03-08 11:34:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000086256_44163072.pth [2023-03-08 11:34:38,892][389688] Updated weights for policy 0, policy_version 86960 (0.0005) [2023-03-08 11:34:42,268][389688] Updated weights for policy 0, policy_version 87040 (0.0005) [2023-03-08 11:34:43,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11982.5). Total num frames: 44572672. Throughput: 0: 11753.5. Samples: 44568676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:34:43,080][389401] Avg episode reward: [(0, '4714.116')] [2023-03-08 11:34:45,647][389688] Updated weights for policy 0, policy_version 87120 (0.0004) [2023-03-08 11:34:48,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11982.5). Total num frames: 44630016. Throughput: 0: 11746.9. Samples: 44605448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:34:48,080][389401] Avg episode reward: [(0, '4731.219')] [2023-03-08 11:34:49,253][389688] Updated weights for policy 0, policy_version 87200 (0.0005) [2023-03-08 11:34:52,999][389688] Updated weights for policy 0, policy_version 87280 (0.0005) [2023-03-08 11:34:53,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 11982.5). Total num frames: 44687360. Throughput: 0: 11646.6. Samples: 44672420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:34:53,080][389401] Avg episode reward: [(0, '4696.781')] [2023-03-08 11:34:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000087280_44687360.pth... [2023-03-08 11:34:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000086608_44343296.pth [2023-03-08 11:34:56,596][389688] Updated weights for policy 0, policy_version 87360 (0.0005) [2023-03-08 11:34:58,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 11982.5). Total num frames: 44744704. Throughput: 0: 11569.2. Samples: 44740616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:34:58,080][389401] Avg episode reward: [(0, '4678.480')] [2023-03-08 11:35:00,227][389688] Updated weights for policy 0, policy_version 87440 (0.0005) [2023-03-08 11:35:03,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11982.5). Total num frames: 44802048. Throughput: 0: 11472.0. Samples: 44773448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:35:03,080][389401] Avg episode reward: [(0, '4677.449')] [2023-03-08 11:35:03,655][389688] Updated weights for policy 0, policy_version 87520 (0.0004) [2023-03-08 11:35:06,926][389688] Updated weights for policy 0, policy_version 87600 (0.0003) [2023-03-08 11:35:08,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 11968.7). Total num frames: 44863488. Throughput: 0: 11572.3. Samples: 44847672. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:35:08,080][389401] Avg episode reward: [(0, '4691.599')] [2023-03-08 11:35:08,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000087624_44863488.pth... [2023-03-08 11:35:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000086936_44511232.pth [2023-03-08 11:35:10,325][389688] Updated weights for policy 0, policy_version 87680 (0.0004) [2023-03-08 11:35:13,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 11982.5). Total num frames: 44924928. Throughput: 0: 11692.7. Samples: 44920644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:35:13,080][389401] Avg episode reward: [(0, '4737.968')] [2023-03-08 11:35:13,080][389644] Saving new best policy, reward=4737.968! [2023-03-08 11:35:13,739][389688] Updated weights for policy 0, policy_version 87760 (0.0004) [2023-03-08 11:35:17,068][389688] Updated weights for policy 0, policy_version 87840 (0.0004) [2023-03-08 11:35:18,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11982.5). Total num frames: 44986368. Throughput: 0: 11729.3. Samples: 44956432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:35:18,080][389401] Avg episode reward: [(0, '4733.786')] [2023-03-08 11:35:20,297][389688] Updated weights for policy 0, policy_version 87920 (0.0004) [2023-03-08 11:35:23,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11741.9, 300 sec: 11982.5). Total num frames: 45047808. Throughput: 0: 11858.1. Samples: 45031436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:35:23,080][389401] Avg episode reward: [(0, '4735.289')] [2023-03-08 11:35:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000087984_45047808.pth... [2023-03-08 11:35:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000087280_44687360.pth [2023-03-08 11:35:23,589][389688] Updated weights for policy 0, policy_version 88000 (0.0004) [2023-03-08 11:35:26,883][389688] Updated weights for policy 0, policy_version 88080 (0.0004) [2023-03-08 11:35:28,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 12010.3). Total num frames: 45109248. Throughput: 0: 11939.4. Samples: 45105948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:35:28,080][389401] Avg episode reward: [(0, '4731.156')] [2023-03-08 11:35:30,247][389688] Updated weights for policy 0, policy_version 88160 (0.0004) [2023-03-08 11:35:33,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 12010.3). Total num frames: 45170688. Throughput: 0: 11940.0. Samples: 45142748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:35:33,080][389401] Avg episode reward: [(0, '4729.567')] [2023-03-08 11:35:33,633][389688] Updated weights for policy 0, policy_version 88240 (0.0005) [2023-03-08 11:35:37,316][389688] Updated weights for policy 0, policy_version 88320 (0.0005) [2023-03-08 11:35:38,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 12010.3). Total num frames: 45228032. Throughput: 0: 12001.7. Samples: 45212496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:35:38,080][389401] Avg episode reward: [(0, '4570.566')] [2023-03-08 11:35:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000088336_45228032.pth... [2023-03-08 11:35:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000087624_44863488.pth [2023-03-08 11:35:40,778][389688] Updated weights for policy 0, policy_version 88400 (0.0004) [2023-03-08 11:35:43,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11878.4, 300 sec: 12010.3). Total num frames: 45285376. Throughput: 0: 12029.4. Samples: 45281940. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:35:43,080][389401] Avg episode reward: [(0, '4688.259')] [2023-03-08 11:35:44,432][389688] Updated weights for policy 0, policy_version 88480 (0.0005) [2023-03-08 11:35:48,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11810.2, 300 sec: 11996.4). Total num frames: 45338624. Throughput: 0: 12029.3. Samples: 45314768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:35:48,080][389401] Avg episode reward: [(0, '4721.417')] [2023-03-08 11:35:48,118][389688] Updated weights for policy 0, policy_version 88560 (0.0005) [2023-03-08 11:35:51,924][389688] Updated weights for policy 0, policy_version 88640 (0.0006) [2023-03-08 11:35:53,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11810.1, 300 sec: 11996.4). Total num frames: 45395968. Throughput: 0: 11852.9. Samples: 45381052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:35:53,080][389401] Avg episode reward: [(0, '4728.706')] [2023-03-08 11:35:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000088664_45395968.pth... [2023-03-08 11:35:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000087984_45047808.pth [2023-03-08 11:35:55,587][389688] Updated weights for policy 0, policy_version 88720 (0.0005) [2023-03-08 11:35:58,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 11996.4). Total num frames: 45453312. Throughput: 0: 11747.5. Samples: 45449280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:35:58,080][389401] Avg episode reward: [(0, '4734.345')] [2023-03-08 11:35:59,090][389688] Updated weights for policy 0, policy_version 88800 (0.0005) [2023-03-08 11:36:02,474][389688] Updated weights for policy 0, policy_version 88880 (0.0005) [2023-03-08 11:36:03,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 11982.5). Total num frames: 45510656. Throughput: 0: 11734.7. Samples: 45484496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:36:03,080][389401] Avg episode reward: [(0, '4733.912')] [2023-03-08 11:36:06,018][389688] Updated weights for policy 0, policy_version 88960 (0.0005) [2023-03-08 11:36:08,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11982.5). Total num frames: 45568000. Throughput: 0: 11636.0. Samples: 45555056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:36:08,080][389401] Avg episode reward: [(0, '4735.508')] [2023-03-08 11:36:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000089000_45568000.pth... [2023-03-08 11:36:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000088336_45228032.pth [2023-03-08 11:36:09,639][389688] Updated weights for policy 0, policy_version 89040 (0.0006) [2023-03-08 11:36:13,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 11968.6). Total num frames: 45625344. Throughput: 0: 11486.8. Samples: 45622856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:36:13,080][389401] Avg episode reward: [(0, '4701.608')] [2023-03-08 11:36:13,235][389688] Updated weights for policy 0, policy_version 89120 (0.0004) [2023-03-08 11:36:16,774][389688] Updated weights for policy 0, policy_version 89200 (0.0005) [2023-03-08 11:36:18,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11954.8). Total num frames: 45682688. Throughput: 0: 11453.0. Samples: 45658132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:36:18,080][389401] Avg episode reward: [(0, '4697.515')] [2023-03-08 11:36:20,335][389688] Updated weights for policy 0, policy_version 89280 (0.0005) [2023-03-08 11:36:23,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11927.0). Total num frames: 45740032. Throughput: 0: 11423.3. Samples: 45726544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:36:23,080][389401] Avg episode reward: [(0, '4735.199')] [2023-03-08 11:36:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000089336_45740032.pth... [2023-03-08 11:36:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000088664_45395968.pth [2023-03-08 11:36:23,867][389688] Updated weights for policy 0, policy_version 89360 (0.0005) [2023-03-08 11:36:27,524][389688] Updated weights for policy 0, policy_version 89440 (0.0005) [2023-03-08 11:36:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11913.1). Total num frames: 45797376. Throughput: 0: 11395.9. Samples: 45794756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:36:28,080][389401] Avg episode reward: [(0, '4735.269')] [2023-03-08 11:36:31,062][389688] Updated weights for policy 0, policy_version 89520 (0.0005) [2023-03-08 11:36:33,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11400.6, 300 sec: 11899.2). Total num frames: 45854720. Throughput: 0: 11452.8. Samples: 45830144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:36:33,080][389401] Avg episode reward: [(0, '4738.233')] [2023-03-08 11:36:33,111][389644] Saving new best policy, reward=4738.233! [2023-03-08 11:36:34,559][389688] Updated weights for policy 0, policy_version 89600 (0.0005) [2023-03-08 11:36:38,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11899.2). Total num frames: 45912064. Throughput: 0: 11519.9. Samples: 45899448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:36:38,080][389401] Avg episode reward: [(0, '4674.288')] [2023-03-08 11:36:38,108][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000089680_45916160.pth... [2023-03-08 11:36:38,109][389688] Updated weights for policy 0, policy_version 89680 (0.0005) [2023-03-08 11:36:38,109][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000089000_45568000.pth [2023-03-08 11:36:41,746][389688] Updated weights for policy 0, policy_version 89760 (0.0005) [2023-03-08 11:36:43,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11400.5, 300 sec: 11885.3). Total num frames: 45969408. Throughput: 0: 11525.4. Samples: 45967924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:36:43,080][389401] Avg episode reward: [(0, '4546.470')] [2023-03-08 11:36:45,301][389688] Updated weights for policy 0, policy_version 89840 (0.0006) [2023-03-08 11:36:48,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11871.5). Total num frames: 46026752. Throughput: 0: 11504.0. Samples: 46002176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:36:48,080][389401] Avg episode reward: [(0, '4671.729')] [2023-03-08 11:36:48,904][389688] Updated weights for policy 0, policy_version 89920 (0.0005) [2023-03-08 11:36:52,546][389688] Updated weights for policy 0, policy_version 90000 (0.0005) [2023-03-08 11:36:53,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11857.6). Total num frames: 46084096. Throughput: 0: 11448.8. Samples: 46070252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:36:53,080][389401] Avg episode reward: [(0, '4617.250')] [2023-03-08 11:36:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000090008_46084096.pth... [2023-03-08 11:36:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000089336_45740032.pth [2023-03-08 11:36:56,183][389688] Updated weights for policy 0, policy_version 90080 (0.0005) [2023-03-08 11:36:58,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11857.6). Total num frames: 46141440. Throughput: 0: 11438.5. Samples: 46137588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:36:58,080][389401] Avg episode reward: [(0, '4734.572')] [2023-03-08 11:36:59,782][389688] Updated weights for policy 0, policy_version 90160 (0.0005) [2023-03-08 11:37:03,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11857.6). Total num frames: 46198784. Throughput: 0: 11425.1. Samples: 46172260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:37:03,080][389401] Avg episode reward: [(0, '4737.720')] [2023-03-08 11:37:03,188][389688] Updated weights for policy 0, policy_version 90240 (0.0004) [2023-03-08 11:37:06,551][389688] Updated weights for policy 0, policy_version 90320 (0.0004) [2023-03-08 11:37:08,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 11857.6). Total num frames: 46260224. Throughput: 0: 11519.3. Samples: 46244912. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:37:08,080][389401] Avg episode reward: [(0, '4727.842')] [2023-03-08 11:37:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000090352_46260224.pth... [2023-03-08 11:37:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000089680_45916160.pth [2023-03-08 11:37:09,758][389688] Updated weights for policy 0, policy_version 90400 (0.0004) [2023-03-08 11:37:13,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11605.3, 300 sec: 11871.5). Total num frames: 46321664. Throughput: 0: 11650.9. Samples: 46319048. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:37:13,080][389401] Avg episode reward: [(0, '4734.580')] [2023-03-08 11:37:13,176][389688] Updated weights for policy 0, policy_version 90480 (0.0005) [2023-03-08 11:37:16,462][389688] Updated weights for policy 0, policy_version 90560 (0.0004) [2023-03-08 11:37:18,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 11885.3). Total num frames: 46383104. Throughput: 0: 11700.6. Samples: 46356672. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:37:18,080][389401] Avg episode reward: [(0, '4736.446')] [2023-03-08 11:37:19,898][389688] Updated weights for policy 0, policy_version 90640 (0.0005) [2023-03-08 11:37:23,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11741.9, 300 sec: 11885.3). Total num frames: 46444544. Throughput: 0: 11758.9. Samples: 46428600. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:37:23,080][389401] Avg episode reward: [(0, '4738.383')] [2023-03-08 11:37:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000090712_46444544.pth... [2023-03-08 11:37:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000090008_46084096.pth [2023-03-08 11:37:23,086][389644] Saving new best policy, reward=4738.383! [2023-03-08 11:37:23,303][389688] Updated weights for policy 0, policy_version 90720 (0.0004) [2023-03-08 11:37:26,823][389688] Updated weights for policy 0, policy_version 90800 (0.0004) [2023-03-08 11:37:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11885.3). Total num frames: 46501888. Throughput: 0: 11810.2. Samples: 46499384. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:37:28,080][389401] Avg episode reward: [(0, '4734.266')] [2023-03-08 11:37:30,243][389688] Updated weights for policy 0, policy_version 90880 (0.0004) [2023-03-08 11:37:33,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11810.1, 300 sec: 11885.3). Total num frames: 46563328. Throughput: 0: 11843.0. Samples: 46535112. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:37:33,080][389401] Avg episode reward: [(0, '4732.567')] [2023-03-08 11:37:33,665][389688] Updated weights for policy 0, policy_version 90960 (0.0004) [2023-03-08 11:37:37,180][389688] Updated weights for policy 0, policy_version 91040 (0.0005) [2023-03-08 11:37:38,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11871.5). Total num frames: 46620672. Throughput: 0: 11916.7. Samples: 46606504. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:37:38,080][389401] Avg episode reward: [(0, '4708.397')] [2023-03-08 11:37:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000091056_46620672.pth... [2023-03-08 11:37:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000090352_46260224.pth [2023-03-08 11:37:40,533][389688] Updated weights for policy 0, policy_version 91120 (0.0004) [2023-03-08 11:37:43,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 11857.6). Total num frames: 46682112. Throughput: 0: 12015.7. Samples: 46678292. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:37:43,080][389401] Avg episode reward: [(0, '4735.128')] [2023-03-08 11:37:43,975][389688] Updated weights for policy 0, policy_version 91200 (0.0005) [2023-03-08 11:37:47,223][389688] Updated weights for policy 0, policy_version 91280 (0.0004) [2023-03-08 11:37:48,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11843.7). Total num frames: 46743552. Throughput: 0: 12075.2. Samples: 46715644. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:37:48,080][389401] Avg episode reward: [(0, '4676.214')] [2023-03-08 11:37:50,584][389688] Updated weights for policy 0, policy_version 91360 (0.0005) [2023-03-08 11:37:53,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12014.9, 300 sec: 11829.8). Total num frames: 46804992. Throughput: 0: 12083.7. Samples: 46788680. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:37:53,080][389401] Avg episode reward: [(0, '4653.712')] [2023-03-08 11:37:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000091416_46804992.pth... [2023-03-08 11:37:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000090712_46444544.pth [2023-03-08 11:37:53,897][389688] Updated weights for policy 0, policy_version 91440 (0.0004) [2023-03-08 11:37:57,162][389688] Updated weights for policy 0, policy_version 91520 (0.0004) [2023-03-08 11:37:58,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12083.2, 300 sec: 11829.8). Total num frames: 46866432. Throughput: 0: 12118.2. Samples: 46864368. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:37:58,080][389401] Avg episode reward: [(0, '4701.413')] [2023-03-08 11:38:00,403][389688] Updated weights for policy 0, policy_version 91600 (0.0004) [2023-03-08 11:38:03,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12219.7, 300 sec: 11829.8). Total num frames: 46931968. Throughput: 0: 12131.6. Samples: 46902592. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:38:03,080][389401] Avg episode reward: [(0, '4694.879')] [2023-03-08 11:38:03,652][389688] Updated weights for policy 0, policy_version 91680 (0.0004) [2023-03-08 11:38:07,182][389688] Updated weights for policy 0, policy_version 91760 (0.0005) [2023-03-08 11:38:08,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12151.5, 300 sec: 11815.9). Total num frames: 46989312. Throughput: 0: 12154.8. Samples: 46975564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:38:08,080][389401] Avg episode reward: [(0, '4731.411')] [2023-03-08 11:38:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000091776_46989312.pth... [2023-03-08 11:38:08,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000091056_46620672.pth [2023-03-08 11:38:10,733][389688] Updated weights for policy 0, policy_version 91840 (0.0005) [2023-03-08 11:38:13,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12151.5, 300 sec: 11815.9). Total num frames: 47050752. Throughput: 0: 12148.2. Samples: 47046052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:38:13,080][389401] Avg episode reward: [(0, '4731.409')] [2023-03-08 11:38:14,104][389688] Updated weights for policy 0, policy_version 91920 (0.0005) [2023-03-08 11:38:17,551][389688] Updated weights for policy 0, policy_version 92000 (0.0005) [2023-03-08 11:38:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11802.0). Total num frames: 47108096. Throughput: 0: 12151.0. Samples: 47081908. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:38:18,080][389401] Avg episode reward: [(0, '4730.722')] [2023-03-08 11:38:21,003][389688] Updated weights for policy 0, policy_version 92080 (0.0005) [2023-03-08 11:38:23,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 11815.9). Total num frames: 47169536. Throughput: 0: 12147.9. Samples: 47153160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:38:23,080][389401] Avg episode reward: [(0, '4729.145')] [2023-03-08 11:38:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000092128_47169536.pth... [2023-03-08 11:38:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000091416_46804992.pth [2023-03-08 11:38:24,339][389688] Updated weights for policy 0, policy_version 92160 (0.0005) [2023-03-08 11:38:27,824][389688] Updated weights for policy 0, policy_version 92240 (0.0005) [2023-03-08 11:38:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11802.0). Total num frames: 47226880. Throughput: 0: 12151.2. Samples: 47225096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:38:28,080][389401] Avg episode reward: [(0, '4582.138')] [2023-03-08 11:38:31,034][389688] Updated weights for policy 0, policy_version 92320 (0.0005) [2023-03-08 11:38:33,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 11829.8). Total num frames: 47292416. Throughput: 0: 12171.4. Samples: 47263356. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:38:33,080][389401] Avg episode reward: [(0, '4729.318')] [2023-03-08 11:38:34,231][389688] Updated weights for policy 0, policy_version 92400 (0.0004) [2023-03-08 11:38:37,720][389688] Updated weights for policy 0, policy_version 92480 (0.0005) [2023-03-08 11:38:38,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 11843.7). Total num frames: 47353856. Throughput: 0: 12195.7. Samples: 47337488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:38:38,080][389401] Avg episode reward: [(0, '4732.449')] [2023-03-08 11:38:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000092488_47353856.pth... [2023-03-08 11:38:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000091776_46989312.pth [2023-03-08 11:38:41,007][389688] Updated weights for policy 0, policy_version 92560 (0.0005) [2023-03-08 11:38:43,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12219.7, 300 sec: 11843.7). Total num frames: 47415296. Throughput: 0: 12152.1. Samples: 47411212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:38:43,080][389401] Avg episode reward: [(0, '4702.398')] [2023-03-08 11:38:44,328][389688] Updated weights for policy 0, policy_version 92640 (0.0005) [2023-03-08 11:38:47,596][389688] Updated weights for policy 0, policy_version 92720 (0.0004) [2023-03-08 11:38:48,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 11857.6). Total num frames: 47476736. Throughput: 0: 12123.0. Samples: 47448128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:38:48,080][389401] Avg episode reward: [(0, '4684.862')] [2023-03-08 11:38:51,017][389688] Updated weights for policy 0, policy_version 92800 (0.0004) [2023-03-08 11:38:53,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 11843.7). Total num frames: 47538176. Throughput: 0: 12138.3. Samples: 47521788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:38:53,080][389401] Avg episode reward: [(0, '4736.170')] [2023-03-08 11:38:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000092848_47538176.pth... [2023-03-08 11:38:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000092128_47169536.pth [2023-03-08 11:38:54,338][389688] Updated weights for policy 0, policy_version 92880 (0.0004) [2023-03-08 11:38:57,824][389688] Updated weights for policy 0, policy_version 92960 (0.0005) [2023-03-08 11:38:58,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12151.4, 300 sec: 11829.8). Total num frames: 47595520. Throughput: 0: 12167.6. Samples: 47593596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:38:58,080][389401] Avg episode reward: [(0, '4735.747')] [2023-03-08 11:39:01,304][389688] Updated weights for policy 0, policy_version 93040 (0.0005) [2023-03-08 11:39:03,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11843.7). Total num frames: 47656960. Throughput: 0: 12143.2. Samples: 47628352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:39:03,080][389401] Avg episode reward: [(0, '4736.996')] [2023-03-08 11:39:04,598][389688] Updated weights for policy 0, policy_version 93120 (0.0004) [2023-03-08 11:39:08,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 11829.8). Total num frames: 47714304. Throughput: 0: 12186.8. Samples: 47701564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:39:08,080][389401] Avg episode reward: [(0, '4739.020')] [2023-03-08 11:39:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000093192_47714304.pth... [2023-03-08 11:39:08,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000092488_47353856.pth [2023-03-08 11:39:08,084][389644] Saving new best policy, reward=4739.020! [2023-03-08 11:39:08,134][389688] Updated weights for policy 0, policy_version 93200 (0.0005) [2023-03-08 11:39:11,673][389688] Updated weights for policy 0, policy_version 93280 (0.0005) [2023-03-08 11:39:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11829.8). Total num frames: 47771648. Throughput: 0: 12123.8. Samples: 47770668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:39:13,080][389401] Avg episode reward: [(0, '4736.732')] [2023-03-08 11:39:15,102][389688] Updated weights for policy 0, policy_version 93360 (0.0005) [2023-03-08 11:39:18,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 11829.8). Total num frames: 47833088. Throughput: 0: 12100.7. Samples: 47807888. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:39:18,080][389401] Avg episode reward: [(0, '4738.552')] [2023-03-08 11:39:18,459][389688] Updated weights for policy 0, policy_version 93440 (0.0005) [2023-03-08 11:39:21,825][389688] Updated weights for policy 0, policy_version 93520 (0.0005) [2023-03-08 11:39:23,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11857.6). Total num frames: 47894528. Throughput: 0: 12053.6. Samples: 47879900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:39:23,090][389401] Avg episode reward: [(0, '4735.136')] [2023-03-08 11:39:23,122][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000093552_47898624.pth... [2023-03-08 11:39:23,124][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000092848_47538176.pth [2023-03-08 11:39:25,063][389688] Updated weights for policy 0, policy_version 93600 (0.0005) [2023-03-08 11:39:28,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12151.5, 300 sec: 11871.5). Total num frames: 47955968. Throughput: 0: 12056.4. Samples: 47953752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:39:28,080][389401] Avg episode reward: [(0, '4734.240')] [2023-03-08 11:39:28,571][389688] Updated weights for policy 0, policy_version 93680 (0.0005) [2023-03-08 11:39:32,037][389688] Updated weights for policy 0, policy_version 93760 (0.0005) [2023-03-08 11:39:33,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11885.3). Total num frames: 48017408. Throughput: 0: 12013.5. Samples: 47988736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:39:33,080][389401] Avg episode reward: [(0, '4735.405')] [2023-03-08 11:39:35,486][389688] Updated weights for policy 0, policy_version 93840 (0.0004) [2023-03-08 11:39:38,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11871.5). Total num frames: 48074752. Throughput: 0: 11937.9. Samples: 48058992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:39:38,080][389401] Avg episode reward: [(0, '4737.949')] [2023-03-08 11:39:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000093896_48074752.pth... [2023-03-08 11:39:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000093192_47714304.pth [2023-03-08 11:39:39,024][389688] Updated weights for policy 0, policy_version 93920 (0.0005) [2023-03-08 11:39:42,470][389688] Updated weights for policy 0, policy_version 94000 (0.0005) [2023-03-08 11:39:43,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11871.5). Total num frames: 48132096. Throughput: 0: 11929.8. Samples: 48130436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:39:43,080][389401] Avg episode reward: [(0, '4738.506')] [2023-03-08 11:39:45,743][389688] Updated weights for policy 0, policy_version 94080 (0.0004) [2023-03-08 11:39:48,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11899.2). Total num frames: 48197632. Throughput: 0: 11984.5. Samples: 48167656. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:39:48,080][389401] Avg episode reward: [(0, '4737.771')] [2023-03-08 11:39:48,978][389688] Updated weights for policy 0, policy_version 94160 (0.0004) [2023-03-08 11:39:52,307][389688] Updated weights for policy 0, policy_version 94240 (0.0004) [2023-03-08 11:39:53,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12014.9, 300 sec: 11913.1). Total num frames: 48259072. Throughput: 0: 12026.6. Samples: 48242760. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:39:53,080][389401] Avg episode reward: [(0, '4734.639')] [2023-03-08 11:39:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000094256_48259072.pth... [2023-03-08 11:39:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000093552_47898624.pth [2023-03-08 11:39:55,667][389688] Updated weights for policy 0, policy_version 94320 (0.0005) [2023-03-08 11:39:58,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11927.0). Total num frames: 48320512. Throughput: 0: 12133.6. Samples: 48316680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:39:58,080][389401] Avg episode reward: [(0, '4739.046')] [2023-03-08 11:39:58,080][389644] Saving new best policy, reward=4739.046! [2023-03-08 11:39:58,868][389688] Updated weights for policy 0, policy_version 94400 (0.0004) [2023-03-08 11:40:02,125][389688] Updated weights for policy 0, policy_version 94480 (0.0003) [2023-03-08 11:40:03,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11927.0). Total num frames: 48381952. Throughput: 0: 12170.0. Samples: 48355540. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:40:03,080][389401] Avg episode reward: [(0, '4739.963')] [2023-03-08 11:40:03,120][389644] Saving new best policy, reward=4739.963! [2023-03-08 11:40:05,465][389688] Updated weights for policy 0, policy_version 94560 (0.0004) [2023-03-08 11:40:08,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11927.0). Total num frames: 48443392. Throughput: 0: 12179.6. Samples: 48427980. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:40:08,080][389401] Avg episode reward: [(0, '4739.806')] [2023-03-08 11:40:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000094616_48443392.pth... [2023-03-08 11:40:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000093896_48074752.pth [2023-03-08 11:40:08,895][389688] Updated weights for policy 0, policy_version 94640 (0.0004) [2023-03-08 11:40:12,389][389688] Updated weights for policy 0, policy_version 94720 (0.0005) [2023-03-08 11:40:13,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12151.5, 300 sec: 11913.1). Total num frames: 48500736. Throughput: 0: 12142.7. Samples: 48500172. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:40:13,080][389401] Avg episode reward: [(0, '4612.259')] [2023-03-08 11:40:15,926][389688] Updated weights for policy 0, policy_version 94800 (0.0005) [2023-03-08 11:40:18,079][389401] Fps is (10 sec: 11468.9, 60 sec: 12083.2, 300 sec: 11899.2). Total num frames: 48558080. Throughput: 0: 12117.2. Samples: 48534008. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:40:18,080][389401] Avg episode reward: [(0, '4464.075')] [2023-03-08 11:40:19,516][389688] Updated weights for policy 0, policy_version 94880 (0.0005) [2023-03-08 11:40:22,852][389688] Updated weights for policy 0, policy_version 94960 (0.0004) [2023-03-08 11:40:23,079][389401] Fps is (10 sec: 11878.2, 60 sec: 12083.2, 300 sec: 11899.2). Total num frames: 48619520. Throughput: 0: 12144.2. Samples: 48605480. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:40:23,080][389401] Avg episode reward: [(0, '4701.964')] [2023-03-08 11:40:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000094960_48619520.pth... [2023-03-08 11:40:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000094256_48259072.pth [2023-03-08 11:40:26,382][389688] Updated weights for policy 0, policy_version 95040 (0.0005) [2023-03-08 11:40:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11885.3). Total num frames: 48676864. Throughput: 0: 12082.8. Samples: 48674164. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:40:28,080][389401] Avg episode reward: [(0, '4701.762')] [2023-03-08 11:40:29,970][389688] Updated weights for policy 0, policy_version 95120 (0.0005) [2023-03-08 11:40:33,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12014.9, 300 sec: 11899.2). Total num frames: 48738304. Throughput: 0: 12044.1. Samples: 48709640. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:40:33,080][389401] Avg episode reward: [(0, '4740.501')] [2023-03-08 11:40:33,080][389644] Saving new best policy, reward=4740.501! [2023-03-08 11:40:33,296][389688] Updated weights for policy 0, policy_version 95200 (0.0004) [2023-03-08 11:40:36,541][389688] Updated weights for policy 0, policy_version 95280 (0.0004) [2023-03-08 11:40:38,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12083.2, 300 sec: 11913.1). Total num frames: 48799744. Throughput: 0: 12036.8. Samples: 48784416. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:40:38,080][389401] Avg episode reward: [(0, '4656.414')] [2023-03-08 11:40:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000095312_48799744.pth... [2023-03-08 11:40:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000094616_48443392.pth [2023-03-08 11:40:39,739][389688] Updated weights for policy 0, policy_version 95360 (0.0004) [2023-03-08 11:40:43,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 11940.9). Total num frames: 48861184. Throughput: 0: 12068.1. Samples: 48859744. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:40:43,080][389401] Avg episode reward: [(0, '4709.101')] [2023-03-08 11:40:43,129][389688] Updated weights for policy 0, policy_version 95440 (0.0005) [2023-03-08 11:40:46,460][389688] Updated weights for policy 0, policy_version 95520 (0.0005) [2023-03-08 11:40:48,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11954.8). Total num frames: 48922624. Throughput: 0: 12011.3. Samples: 48896048. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:40:48,080][389401] Avg episode reward: [(0, '4649.423')] [2023-03-08 11:40:49,765][389688] Updated weights for policy 0, policy_version 95600 (0.0004) [2023-03-08 11:40:53,079][389401] Fps is (10 sec: 12287.8, 60 sec: 12083.2, 300 sec: 11968.7). Total num frames: 48984064. Throughput: 0: 12049.7. Samples: 48970216. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:40:53,090][389401] Avg episode reward: [(0, '4738.607')] [2023-03-08 11:40:53,095][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000095672_48984064.pth... [2023-03-08 11:40:53,099][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000094960_48619520.pth [2023-03-08 11:40:53,281][389688] Updated weights for policy 0, policy_version 95680 (0.0005) [2023-03-08 11:40:56,854][389688] Updated weights for policy 0, policy_version 95760 (0.0004) [2023-03-08 11:40:58,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11968.7). Total num frames: 49041408. Throughput: 0: 11947.2. Samples: 49037796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:40:58,080][389401] Avg episode reward: [(0, '4701.280')] [2023-03-08 11:41:00,295][389688] Updated weights for policy 0, policy_version 95840 (0.0005) [2023-03-08 11:41:03,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11982.5). Total num frames: 49102848. Throughput: 0: 12006.6. Samples: 49074304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:41:03,080][389401] Avg episode reward: [(0, '4651.241')] [2023-03-08 11:41:03,611][389688] Updated weights for policy 0, policy_version 95920 (0.0005) [2023-03-08 11:41:06,908][389688] Updated weights for policy 0, policy_version 96000 (0.0005) [2023-03-08 11:41:08,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12014.9, 300 sec: 11996.4). Total num frames: 49164288. Throughput: 0: 12064.2. Samples: 49148368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:41:08,080][389401] Avg episode reward: [(0, '4668.074')] [2023-03-08 11:41:08,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000096024_49164288.pth... [2023-03-08 11:41:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000095312_48799744.pth [2023-03-08 11:41:10,271][389688] Updated weights for policy 0, policy_version 96080 (0.0005) [2023-03-08 11:41:13,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 12010.3). Total num frames: 49225728. Throughput: 0: 12198.8. Samples: 49223112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:41:13,080][389401] Avg episode reward: [(0, '4736.712')] [2023-03-08 11:41:13,501][389688] Updated weights for policy 0, policy_version 96160 (0.0004) [2023-03-08 11:41:16,747][389688] Updated weights for policy 0, policy_version 96240 (0.0004) [2023-03-08 11:41:18,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 12024.2). Total num frames: 49287168. Throughput: 0: 12253.5. Samples: 49261048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:41:18,080][389401] Avg episode reward: [(0, '4695.113')] [2023-03-08 11:41:20,046][389688] Updated weights for policy 0, policy_version 96320 (0.0004) [2023-03-08 11:41:23,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 12052.0). Total num frames: 49352704. Throughput: 0: 12261.9. Samples: 49336204. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:41:23,080][389401] Avg episode reward: [(0, '4738.629')] [2023-03-08 11:41:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000096392_49352704.pth... [2023-03-08 11:41:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000095672_48984064.pth [2023-03-08 11:41:23,431][389688] Updated weights for policy 0, policy_version 96400 (0.0005) [2023-03-08 11:41:26,983][389688] Updated weights for policy 0, policy_version 96480 (0.0005) [2023-03-08 11:41:28,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12219.7, 300 sec: 12052.0). Total num frames: 49410048. Throughput: 0: 12137.9. Samples: 49405952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:41:28,080][389401] Avg episode reward: [(0, '4703.591')] [2023-03-08 11:41:30,388][389688] Updated weights for policy 0, policy_version 96560 (0.0004) [2023-03-08 11:41:33,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 12052.0). Total num frames: 49467392. Throughput: 0: 12141.0. Samples: 49442392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:41:33,080][389401] Avg episode reward: [(0, '4495.803')] [2023-03-08 11:41:33,856][389688] Updated weights for policy 0, policy_version 96640 (0.0005) [2023-03-08 11:41:37,123][389688] Updated weights for policy 0, policy_version 96720 (0.0005) [2023-03-08 11:41:38,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12151.4, 300 sec: 12065.8). Total num frames: 49528832. Throughput: 0: 12095.5. Samples: 49514512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:41:38,080][389401] Avg episode reward: [(0, '4698.892')] [2023-03-08 11:41:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000096736_49528832.pth... [2023-03-08 11:41:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000096024_49164288.pth [2023-03-08 11:41:40,469][389688] Updated weights for policy 0, policy_version 96800 (0.0004) [2023-03-08 11:41:43,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12151.4, 300 sec: 12079.7). Total num frames: 49590272. Throughput: 0: 12217.1. Samples: 49587568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:41:43,080][389401] Avg episode reward: [(0, '4665.894')] [2023-03-08 11:41:43,980][389688] Updated weights for policy 0, policy_version 96880 (0.0005) [2023-03-08 11:41:47,478][389688] Updated weights for policy 0, policy_version 96960 (0.0004) [2023-03-08 11:41:48,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12083.2, 300 sec: 12079.7). Total num frames: 49647616. Throughput: 0: 12190.6. Samples: 49622880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:41:48,080][389401] Avg episode reward: [(0, '4736.936')] [2023-03-08 11:41:50,971][389688] Updated weights for policy 0, policy_version 97040 (0.0006) [2023-03-08 11:41:53,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 12093.6). Total num frames: 49709056. Throughput: 0: 12095.9. Samples: 49692684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:41:53,080][389401] Avg episode reward: [(0, '4700.293')] [2023-03-08 11:41:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000097088_49709056.pth... [2023-03-08 11:41:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000096392_49352704.pth [2023-03-08 11:41:54,335][389688] Updated weights for policy 0, policy_version 97120 (0.0004) [2023-03-08 11:41:57,809][389688] Updated weights for policy 0, policy_version 97200 (0.0005) [2023-03-08 11:41:58,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 12093.6). Total num frames: 49766400. Throughput: 0: 12030.5. Samples: 49764484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:41:58,080][389401] Avg episode reward: [(0, '4295.154')] [2023-03-08 11:42:01,251][389688] Updated weights for policy 0, policy_version 97280 (0.0005) [2023-03-08 11:42:03,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 12093.6). Total num frames: 49827840. Throughput: 0: 11978.6. Samples: 49800088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:42:03,080][389401] Avg episode reward: [(0, '3973.640')] [2023-03-08 11:42:04,715][389688] Updated weights for policy 0, policy_version 97360 (0.0005) [2023-03-08 11:42:08,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12015.0, 300 sec: 12079.7). Total num frames: 49885184. Throughput: 0: 11885.6. Samples: 49871056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:42:08,080][389401] Avg episode reward: [(0, '4421.103')] [2023-03-08 11:42:08,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000097432_49885184.pth... [2023-03-08 11:42:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000096736_49528832.pth [2023-03-08 11:42:08,274][389688] Updated weights for policy 0, policy_version 97440 (0.0005) [2023-03-08 11:42:11,634][389688] Updated weights for policy 0, policy_version 97520 (0.0004) [2023-03-08 11:42:13,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12014.9, 300 sec: 12079.7). Total num frames: 49946624. Throughput: 0: 11939.1. Samples: 49943212. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:42:13,080][389401] Avg episode reward: [(0, '4736.078')] [2023-03-08 11:42:14,949][389688] Updated weights for policy 0, policy_version 97600 (0.0004) [2023-03-08 11:42:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 12065.8). Total num frames: 50003968. Throughput: 0: 11935.0. Samples: 49979464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:42:18,080][389401] Avg episode reward: [(0, '4665.718')] [2023-03-08 11:42:18,515][389688] Updated weights for policy 0, policy_version 97680 (0.0005) [2023-03-08 11:42:22,064][389688] Updated weights for policy 0, policy_version 97760 (0.0005) [2023-03-08 11:42:23,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 12065.8). Total num frames: 50061312. Throughput: 0: 11875.6. Samples: 50048916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:42:23,080][389401] Avg episode reward: [(0, '4588.711')] [2023-03-08 11:42:23,111][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000097784_50065408.pth... [2023-03-08 11:42:23,113][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000097088_49709056.pth [2023-03-08 11:42:25,589][389688] Updated weights for policy 0, policy_version 97840 (0.0005) [2023-03-08 11:42:28,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 12065.8). Total num frames: 50122752. Throughput: 0: 11803.4. Samples: 50118720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:42:28,080][389401] Avg episode reward: [(0, '4658.177')] [2023-03-08 11:42:29,088][389688] Updated weights for policy 0, policy_version 97920 (0.0005) [2023-03-08 11:42:32,673][389688] Updated weights for policy 0, policy_version 98000 (0.0005) [2023-03-08 11:42:33,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 12065.8). Total num frames: 50180096. Throughput: 0: 11777.4. Samples: 50152864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:42:33,080][389401] Avg episode reward: [(0, '4732.227')] [2023-03-08 11:42:36,162][389688] Updated weights for policy 0, policy_version 98080 (0.0005) [2023-03-08 11:42:38,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 12052.0). Total num frames: 50237440. Throughput: 0: 11788.3. Samples: 50223160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:42:38,080][389401] Avg episode reward: [(0, '4619.871')] [2023-03-08 11:42:38,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000098120_50237440.pth... [2023-03-08 11:42:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000097432_49885184.pth [2023-03-08 11:42:38,306][389644] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000005 [2023-03-08 11:42:39,715][389688] Updated weights for policy 0, policy_version 98160 (0.0005) [2023-03-08 11:42:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 12038.1). Total num frames: 50294784. Throughput: 0: 11746.4. Samples: 50293072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:42:43,080][389401] Avg episode reward: [(0, '4629.585')] [2023-03-08 11:42:43,111][389688] Updated weights for policy 0, policy_version 98240 (0.0005) [2023-03-08 11:42:46,411][389688] Updated weights for policy 0, policy_version 98320 (0.0005) [2023-03-08 11:42:48,079][389401] Fps is (10 sec: 11878.6, 60 sec: 11810.1, 300 sec: 12038.1). Total num frames: 50356224. Throughput: 0: 11809.4. Samples: 50331508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:42:48,080][389401] Avg episode reward: [(0, '4738.515')] [2023-03-08 11:42:49,694][389688] Updated weights for policy 0, policy_version 98400 (0.0004) [2023-03-08 11:42:52,976][389688] Updated weights for policy 0, policy_version 98480 (0.0005) [2023-03-08 11:42:53,079][389401] Fps is (10 sec: 12697.5, 60 sec: 11878.4, 300 sec: 12052.0). Total num frames: 50421760. Throughput: 0: 11875.3. Samples: 50405448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:42:53,080][389401] Avg episode reward: [(0, '4726.840')] [2023-03-08 11:42:53,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000098480_50421760.pth... [2023-03-08 11:42:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000097784_50065408.pth [2023-03-08 11:42:56,344][389688] Updated weights for policy 0, policy_version 98560 (0.0005) [2023-03-08 11:42:58,079][389401] Fps is (10 sec: 12697.6, 60 sec: 11946.7, 300 sec: 12038.1). Total num frames: 50483200. Throughput: 0: 11908.7. Samples: 50479104. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 11:42:58,080][389401] Avg episode reward: [(0, '4728.785')] [2023-03-08 11:42:59,676][389688] Updated weights for policy 0, policy_version 98640 (0.0005) [2023-03-08 11:43:02,869][389688] Updated weights for policy 0, policy_version 98720 (0.0005) [2023-03-08 11:43:03,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 12052.0). Total num frames: 50544640. Throughput: 0: 11923.7. Samples: 50516032. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 11:43:03,080][389401] Avg episode reward: [(0, '4735.331')] [2023-03-08 11:43:06,083][389688] Updated weights for policy 0, policy_version 98800 (0.0004) [2023-03-08 11:43:08,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12083.2, 300 sec: 12065.8). Total num frames: 50610176. Throughput: 0: 12108.6. Samples: 50593804. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 11:43:08,080][389401] Avg episode reward: [(0, '4657.955')] [2023-03-08 11:43:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000098848_50610176.pth... [2023-03-08 11:43:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000098120_50237440.pth [2023-03-08 11:43:09,191][389688] Updated weights for policy 0, policy_version 98880 (0.0004) [2023-03-08 11:43:12,518][389688] Updated weights for policy 0, policy_version 98960 (0.0005) [2023-03-08 11:43:13,079][389401] Fps is (10 sec: 12697.4, 60 sec: 12083.2, 300 sec: 12079.7). Total num frames: 50671616. Throughput: 0: 12234.5. Samples: 50669276. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 11:43:13,080][389401] Avg episode reward: [(0, '4737.356')] [2023-03-08 11:43:15,850][389688] Updated weights for policy 0, policy_version 99040 (0.0005) [2023-03-08 11:43:18,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 12079.7). Total num frames: 50733056. Throughput: 0: 12291.5. Samples: 50705980. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 11:43:18,080][389401] Avg episode reward: [(0, '4695.992')] [2023-03-08 11:43:19,310][389688] Updated weights for policy 0, policy_version 99120 (0.0005) [2023-03-08 11:43:22,624][389688] Updated weights for policy 0, policy_version 99200 (0.0005) [2023-03-08 11:43:23,079][389401] Fps is (10 sec: 12288.2, 60 sec: 12219.7, 300 sec: 12093.6). Total num frames: 50794496. Throughput: 0: 12333.7. Samples: 50778176. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 11:43:23,080][389401] Avg episode reward: [(0, '4739.559')] [2023-03-08 11:43:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000099208_50794496.pth... [2023-03-08 11:43:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000098480_50421760.pth [2023-03-08 11:43:25,906][389688] Updated weights for policy 0, policy_version 99280 (0.0004) [2023-03-08 11:43:28,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 12093.6). Total num frames: 50860032. Throughput: 0: 12479.5. Samples: 50854648. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 11:43:28,080][389401] Avg episode reward: [(0, '4738.910')] [2023-03-08 11:43:28,976][389688] Updated weights for policy 0, policy_version 99360 (0.0004) [2023-03-08 11:43:32,050][389688] Updated weights for policy 0, policy_version 99440 (0.0004) [2023-03-08 11:43:33,079][389401] Fps is (10 sec: 13107.2, 60 sec: 12424.5, 300 sec: 12107.5). Total num frames: 50925568. Throughput: 0: 12528.4. Samples: 50895288. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 11:43:33,080][389401] Avg episode reward: [(0, '4738.760')] [2023-03-08 11:43:35,317][389688] Updated weights for policy 0, policy_version 99520 (0.0005) [2023-03-08 11:43:38,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12492.8, 300 sec: 12107.5). Total num frames: 50987008. Throughput: 0: 12557.5. Samples: 50970536. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 11:43:38,080][389401] Avg episode reward: [(0, '4739.124')] [2023-03-08 11:43:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000099584_50987008.pth... [2023-03-08 11:43:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000098848_50610176.pth [2023-03-08 11:43:38,663][389688] Updated weights for policy 0, policy_version 99600 (0.0005) [2023-03-08 11:43:41,765][389688] Updated weights for policy 0, policy_version 99680 (0.0004) [2023-03-08 11:43:43,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12629.3, 300 sec: 12121.4). Total num frames: 51052544. Throughput: 0: 12647.2. Samples: 51048228. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 11:43:43,080][389401] Avg episode reward: [(0, '4738.135')] [2023-03-08 11:43:45,215][389688] Updated weights for policy 0, policy_version 99760 (0.0005) [2023-03-08 11:43:48,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12561.0, 300 sec: 12107.5). Total num frames: 51109888. Throughput: 0: 12568.1. Samples: 51081596. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 11:43:48,080][389401] Avg episode reward: [(0, '4737.672')] [2023-03-08 11:43:48,757][389688] Updated weights for policy 0, policy_version 99840 (0.0007) [2023-03-08 11:43:52,180][389688] Updated weights for policy 0, policy_version 99920 (0.0005) [2023-03-08 11:43:53,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12424.6, 300 sec: 12107.5). Total num frames: 51167232. Throughput: 0: 12435.2. Samples: 51153388. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 11:43:53,080][389401] Avg episode reward: [(0, '4737.898')] [2023-03-08 11:43:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000099936_51167232.pth... [2023-03-08 11:43:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000099208_50794496.pth [2023-03-08 11:43:55,444][389688] Updated weights for policy 0, policy_version 100000 (0.0004) [2023-03-08 11:43:58,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12424.5, 300 sec: 12107.5). Total num frames: 51228672. Throughput: 0: 12402.0. Samples: 51227364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:43:58,080][389401] Avg episode reward: [(0, '4736.382')] [2023-03-08 11:43:58,803][389688] Updated weights for policy 0, policy_version 100080 (0.0005) [2023-03-08 11:44:01,970][389688] Updated weights for policy 0, policy_version 100160 (0.0005) [2023-03-08 11:44:03,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12135.3). Total num frames: 51294208. Throughput: 0: 12415.9. Samples: 51264696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:44:03,080][389401] Avg episode reward: [(0, '4734.784')] [2023-03-08 11:44:05,056][389688] Updated weights for policy 0, policy_version 100240 (0.0005) [2023-03-08 11:44:08,035][389688] Updated weights for policy 0, policy_version 100320 (0.0005) [2023-03-08 11:44:08,079][389401] Fps is (10 sec: 13516.7, 60 sec: 12561.1, 300 sec: 12176.9). Total num frames: 51363840. Throughput: 0: 12601.2. Samples: 51345228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:44:08,080][389401] Avg episode reward: [(0, '4688.416')] [2023-03-08 11:44:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000100320_51363840.pth... [2023-03-08 11:44:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000099584_50987008.pth [2023-03-08 11:44:11,213][389688] Updated weights for policy 0, policy_version 100400 (0.0005) [2023-03-08 11:44:13,079][389401] Fps is (10 sec: 13516.9, 60 sec: 12629.4, 300 sec: 12190.8). Total num frames: 51429376. Throughput: 0: 12680.4. Samples: 51425264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:44:13,080][389401] Avg episode reward: [(0, '4729.645')] [2023-03-08 11:44:14,153][389688] Updated weights for policy 0, policy_version 100480 (0.0004) [2023-03-08 11:44:17,118][389688] Updated weights for policy 0, policy_version 100560 (0.0004) [2023-03-08 11:44:18,079][389401] Fps is (10 sec: 13516.8, 60 sec: 12765.9, 300 sec: 12218.6). Total num frames: 51499008. Throughput: 0: 12694.2. Samples: 51466524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:44:18,080][389401] Avg episode reward: [(0, '4704.428')] [2023-03-08 11:44:20,076][389688] Updated weights for policy 0, policy_version 100640 (0.0004) [2023-03-08 11:44:22,980][389688] Updated weights for policy 0, policy_version 100720 (0.0004) [2023-03-08 11:44:23,079][389401] Fps is (10 sec: 13926.2, 60 sec: 12902.4, 300 sec: 12246.3). Total num frames: 51568640. Throughput: 0: 12885.7. Samples: 51550392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:44:23,080][389401] Avg episode reward: [(0, '4733.622')] [2023-03-08 11:44:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000100720_51568640.pth... [2023-03-08 11:44:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000099936_51167232.pth [2023-03-08 11:44:25,844][389688] Updated weights for policy 0, policy_version 100800 (0.0004) [2023-03-08 11:44:28,079][389401] Fps is (10 sec: 13926.5, 60 sec: 12970.7, 300 sec: 12274.1). Total num frames: 51638272. Throughput: 0: 13050.2. Samples: 51635484. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:44:28,080][389401] Avg episode reward: [(0, '4564.671')] [2023-03-08 11:44:28,743][389688] Updated weights for policy 0, policy_version 100880 (0.0004) [2023-03-08 11:44:32,116][389688] Updated weights for policy 0, policy_version 100960 (0.0006) [2023-03-08 11:44:33,079][389401] Fps is (10 sec: 13516.9, 60 sec: 12970.7, 300 sec: 12301.9). Total num frames: 51703808. Throughput: 0: 13184.0. Samples: 51674876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:44:33,080][389401] Avg episode reward: [(0, '4698.430')] [2023-03-08 11:44:35,047][389688] Updated weights for policy 0, policy_version 101040 (0.0004) [2023-03-08 11:44:38,079][389401] Fps is (10 sec: 13107.2, 60 sec: 13039.0, 300 sec: 12329.7). Total num frames: 51769344. Throughput: 0: 13334.4. Samples: 51753436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:44:38,080][389401] Avg episode reward: [(0, '4699.446')] [2023-03-08 11:44:38,114][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000101120_51773440.pth... [2023-03-08 11:44:38,115][389688] Updated weights for policy 0, policy_version 101120 (0.0005) [2023-03-08 11:44:38,117][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000100320_51363840.pth [2023-03-08 11:44:41,120][389688] Updated weights for policy 0, policy_version 101200 (0.0004) [2023-03-08 11:44:43,079][389401] Fps is (10 sec: 13516.8, 60 sec: 13107.2, 300 sec: 12343.5). Total num frames: 51838976. Throughput: 0: 13511.4. Samples: 51835380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:44:43,080][389401] Avg episode reward: [(0, '4483.872')] [2023-03-08 11:44:44,073][389688] Updated weights for policy 0, policy_version 101280 (0.0004) [2023-03-08 11:44:47,117][389688] Updated weights for policy 0, policy_version 101360 (0.0005) [2023-03-08 11:44:48,079][389401] Fps is (10 sec: 13926.3, 60 sec: 13312.0, 300 sec: 12371.3). Total num frames: 51908608. Throughput: 0: 13583.1. Samples: 51875936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:44:48,080][389401] Avg episode reward: [(0, '4546.344')] [2023-03-08 11:44:49,953][389688] Updated weights for policy 0, policy_version 101440 (0.0004) [2023-03-08 11:44:52,930][389688] Updated weights for policy 0, policy_version 101520 (0.0004) [2023-03-08 11:44:53,079][389401] Fps is (10 sec: 13926.4, 60 sec: 13516.8, 300 sec: 12399.1). Total num frames: 51978240. Throughput: 0: 13650.0. Samples: 51959480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:44:53,080][389401] Avg episode reward: [(0, '4492.157')] [2023-03-08 11:44:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000101520_51978240.pth... [2023-03-08 11:44:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000100720_51568640.pth [2023-03-08 11:44:55,824][389688] Updated weights for policy 0, policy_version 101600 (0.0003) [2023-03-08 11:44:58,079][389401] Fps is (10 sec: 13926.4, 60 sec: 13653.3, 300 sec: 12426.8). Total num frames: 52047872. Throughput: 0: 13742.8. Samples: 52043692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:44:58,080][389401] Avg episode reward: [(0, '4635.520')] [2023-03-08 11:44:58,945][389688] Updated weights for policy 0, policy_version 101680 (0.0005) [2023-03-08 11:45:02,288][389688] Updated weights for policy 0, policy_version 101760 (0.0005) [2023-03-08 11:45:03,079][389401] Fps is (10 sec: 13107.3, 60 sec: 13585.1, 300 sec: 12426.9). Total num frames: 52109312. Throughput: 0: 13648.6. Samples: 52080712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:45:03,080][389401] Avg episode reward: [(0, '4738.463')] [2023-03-08 11:45:05,489][389688] Updated weights for policy 0, policy_version 101840 (0.0005) [2023-03-08 11:45:08,079][389401] Fps is (10 sec: 12697.6, 60 sec: 13516.8, 300 sec: 12454.6). Total num frames: 52174848. Throughput: 0: 13492.2. Samples: 52157540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:45:08,080][389401] Avg episode reward: [(0, '4738.578')] [2023-03-08 11:45:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000101904_52174848.pth... [2023-03-08 11:45:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000101120_51773440.pth [2023-03-08 11:45:08,538][389688] Updated weights for policy 0, policy_version 101920 (0.0004) [2023-03-08 11:45:11,528][389688] Updated weights for policy 0, policy_version 102000 (0.0004) [2023-03-08 11:45:13,079][389401] Fps is (10 sec: 13107.0, 60 sec: 13516.8, 300 sec: 12482.4). Total num frames: 52240384. Throughput: 0: 13403.1. Samples: 52238624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:45:13,080][389401] Avg episode reward: [(0, '4737.547')] [2023-03-08 11:45:14,629][389688] Updated weights for policy 0, policy_version 102080 (0.0005) [2023-03-08 11:45:17,871][389688] Updated weights for policy 0, policy_version 102160 (0.0005) [2023-03-08 11:45:18,079][389401] Fps is (10 sec: 13107.2, 60 sec: 13448.5, 300 sec: 12496.3). Total num frames: 52305920. Throughput: 0: 13397.3. Samples: 52277756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:45:18,080][389401] Avg episode reward: [(0, '4741.069')] [2023-03-08 11:45:18,080][389644] Saving new best policy, reward=4741.069! [2023-03-08 11:45:21,079][389688] Updated weights for policy 0, policy_version 102240 (0.0005) [2023-03-08 11:45:23,079][389401] Fps is (10 sec: 13107.2, 60 sec: 13380.3, 300 sec: 12524.0). Total num frames: 52371456. Throughput: 0: 13361.6. Samples: 52354708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:45:23,080][389401] Avg episode reward: [(0, '4738.295')] [2023-03-08 11:45:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000102288_52371456.pth... [2023-03-08 11:45:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000101520_51978240.pth [2023-03-08 11:45:24,145][389688] Updated weights for policy 0, policy_version 102320 (0.0005) [2023-03-08 11:45:27,226][389688] Updated weights for policy 0, policy_version 102400 (0.0004) [2023-03-08 11:45:28,079][389401] Fps is (10 sec: 13107.2, 60 sec: 13312.0, 300 sec: 12537.9). Total num frames: 52436992. Throughput: 0: 13309.0. Samples: 52434284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:45:28,080][389401] Avg episode reward: [(0, '4732.422')] [2023-03-08 11:45:30,575][389688] Updated weights for policy 0, policy_version 102480 (0.0005) [2023-03-08 11:45:33,079][389401] Fps is (10 sec: 12697.7, 60 sec: 13243.7, 300 sec: 12537.9). Total num frames: 52498432. Throughput: 0: 13212.3. Samples: 52470488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:45:33,080][389401] Avg episode reward: [(0, '4734.593')] [2023-03-08 11:45:33,997][389688] Updated weights for policy 0, policy_version 102560 (0.0005) [2023-03-08 11:45:37,187][389688] Updated weights for policy 0, policy_version 102640 (0.0004) [2023-03-08 11:45:38,079][389401] Fps is (10 sec: 12288.0, 60 sec: 13175.4, 300 sec: 12537.9). Total num frames: 52559872. Throughput: 0: 13011.3. Samples: 52544988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:45:38,080][389401] Avg episode reward: [(0, '4730.975')] [2023-03-08 11:45:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000102656_52559872.pth... [2023-03-08 11:45:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000101904_52174848.pth [2023-03-08 11:45:40,633][389688] Updated weights for policy 0, policy_version 102720 (0.0005) [2023-03-08 11:45:43,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12970.7, 300 sec: 12524.0). Total num frames: 52617216. Throughput: 0: 12730.2. Samples: 52616552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:45:43,080][389401] Avg episode reward: [(0, '4580.441')] [2023-03-08 11:45:44,131][389688] Updated weights for policy 0, policy_version 102800 (0.0005) [2023-03-08 11:45:47,272][389688] Updated weights for policy 0, policy_version 102880 (0.0004) [2023-03-08 11:45:48,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12902.4, 300 sec: 12537.9). Total num frames: 52682752. Throughput: 0: 12725.7. Samples: 52653368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:45:48,080][389401] Avg episode reward: [(0, '4711.269')] [2023-03-08 11:45:50,333][389688] Updated weights for policy 0, policy_version 102960 (0.0004) [2023-03-08 11:45:53,079][389401] Fps is (10 sec: 13107.0, 60 sec: 12834.1, 300 sec: 12565.7). Total num frames: 52748288. Throughput: 0: 12763.9. Samples: 52731916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:45:53,080][389401] Avg episode reward: [(0, '4717.443')] [2023-03-08 11:45:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000103024_52748288.pth... [2023-03-08 11:45:53,087][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000102288_52371456.pth [2023-03-08 11:45:53,707][389688] Updated weights for policy 0, policy_version 103040 (0.0005) [2023-03-08 11:45:56,960][389688] Updated weights for policy 0, policy_version 103120 (0.0005) [2023-03-08 11:45:58,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12697.6, 300 sec: 12565.7). Total num frames: 52809728. Throughput: 0: 12601.8. Samples: 52805704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:45:58,080][389401] Avg episode reward: [(0, '4728.992')] [2023-03-08 11:46:00,205][389688] Updated weights for policy 0, policy_version 103200 (0.0005) [2023-03-08 11:46:03,079][389401] Fps is (10 sec: 12288.2, 60 sec: 12697.6, 300 sec: 12565.7). Total num frames: 52871168. Throughput: 0: 12577.5. Samples: 52843744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:46:03,080][389401] Avg episode reward: [(0, '4728.179')] [2023-03-08 11:46:03,416][389688] Updated weights for policy 0, policy_version 103280 (0.0004) [2023-03-08 11:46:06,452][389688] Updated weights for policy 0, policy_version 103360 (0.0004) [2023-03-08 11:46:08,079][389401] Fps is (10 sec: 13107.2, 60 sec: 12765.9, 300 sec: 12593.5). Total num frames: 52940800. Throughput: 0: 12634.3. Samples: 52923252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:46:08,080][389401] Avg episode reward: [(0, '4732.720')] [2023-03-08 11:46:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000103400_52940800.pth... [2023-03-08 11:46:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000102656_52559872.pth [2023-03-08 11:46:09,489][389688] Updated weights for policy 0, policy_version 103440 (0.0004) [2023-03-08 11:46:12,871][389688] Updated weights for policy 0, policy_version 103520 (0.0005) [2023-03-08 11:46:13,079][389401] Fps is (10 sec: 13107.1, 60 sec: 12697.6, 300 sec: 12593.5). Total num frames: 53002240. Throughput: 0: 12559.6. Samples: 52999468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:46:13,080][389401] Avg episode reward: [(0, '4712.072')] [2023-03-08 11:46:16,365][389688] Updated weights for policy 0, policy_version 103600 (0.0005) [2023-03-08 11:46:18,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12561.1, 300 sec: 12565.7). Total num frames: 53059584. Throughput: 0: 12546.3. Samples: 53035072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:46:18,080][389401] Avg episode reward: [(0, '4730.742')] [2023-03-08 11:46:19,711][389688] Updated weights for policy 0, policy_version 103680 (0.0005) [2023-03-08 11:46:23,060][389688] Updated weights for policy 0, policy_version 103760 (0.0005) [2023-03-08 11:46:23,079][389401] Fps is (10 sec: 12287.8, 60 sec: 12561.0, 300 sec: 12593.5). Total num frames: 53125120. Throughput: 0: 12508.0. Samples: 53107852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:46:23,080][389401] Avg episode reward: [(0, '4737.002')] [2023-03-08 11:46:23,085][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000103760_53125120.pth... [2023-03-08 11:46:23,087][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000103024_52748288.pth [2023-03-08 11:46:26,515][389688] Updated weights for policy 0, policy_version 103840 (0.0005) [2023-03-08 11:46:28,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 12593.5). Total num frames: 53182464. Throughput: 0: 12512.9. Samples: 53179636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:46:28,080][389401] Avg episode reward: [(0, '4734.803')] [2023-03-08 11:46:29,927][389688] Updated weights for policy 0, policy_version 103920 (0.0004) [2023-03-08 11:46:33,079][389401] Fps is (10 sec: 11878.7, 60 sec: 12424.5, 300 sec: 12593.5). Total num frames: 53243904. Throughput: 0: 12502.8. Samples: 53215996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:46:33,080][389401] Avg episode reward: [(0, '4733.654')] [2023-03-08 11:46:33,352][389688] Updated weights for policy 0, policy_version 104000 (0.0005) [2023-03-08 11:46:36,743][389688] Updated weights for policy 0, policy_version 104080 (0.0005) [2023-03-08 11:46:38,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12593.5). Total num frames: 53305344. Throughput: 0: 12361.4. Samples: 53288180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:46:38,080][389401] Avg episode reward: [(0, '4738.316')] [2023-03-08 11:46:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000104112_53305344.pth... [2023-03-08 11:46:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000103400_52940800.pth [2023-03-08 11:46:39,977][389688] Updated weights for policy 0, policy_version 104160 (0.0004) [2023-03-08 11:46:43,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12607.3). Total num frames: 53366784. Throughput: 0: 12368.0. Samples: 53362264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:46:43,080][389401] Avg episode reward: [(0, '4685.228')] [2023-03-08 11:46:43,438][389688] Updated weights for policy 0, policy_version 104240 (0.0005) [2023-03-08 11:46:46,812][389688] Updated weights for policy 0, policy_version 104320 (0.0004) [2023-03-08 11:46:48,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12356.3, 300 sec: 12593.5). Total num frames: 53424128. Throughput: 0: 12318.6. Samples: 53398080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:46:48,080][389401] Avg episode reward: [(0, '4737.567')] [2023-03-08 11:46:50,086][389688] Updated weights for policy 0, policy_version 104400 (0.0004) [2023-03-08 11:46:53,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 12607.3). Total num frames: 53485568. Throughput: 0: 12163.0. Samples: 53470588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:46:53,080][389401] Avg episode reward: [(0, '4705.489')] [2023-03-08 11:46:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000104464_53485568.pth... [2023-03-08 11:46:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000103760_53125120.pth [2023-03-08 11:46:53,517][389688] Updated weights for policy 0, policy_version 104480 (0.0004) [2023-03-08 11:46:56,837][389688] Updated weights for policy 0, policy_version 104560 (0.0005) [2023-03-08 11:46:58,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12607.4). Total num frames: 53547008. Throughput: 0: 12093.2. Samples: 53543664. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:46:58,080][389401] Avg episode reward: [(0, '4737.618')] [2023-03-08 11:47:00,339][389688] Updated weights for policy 0, policy_version 104640 (0.0005) [2023-03-08 11:47:03,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12607.3). Total num frames: 53604352. Throughput: 0: 12104.5. Samples: 53579776. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:47:03,080][389401] Avg episode reward: [(0, '4734.024')] [2023-03-08 11:47:03,986][389688] Updated weights for policy 0, policy_version 104720 (0.0005) [2023-03-08 11:47:07,244][389688] Updated weights for policy 0, policy_version 104800 (0.0004) [2023-03-08 11:47:08,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 12607.3). Total num frames: 53665792. Throughput: 0: 12036.1. Samples: 53649472. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:47:08,080][389401] Avg episode reward: [(0, '4678.936')] [2023-03-08 11:47:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000104816_53665792.pth... [2023-03-08 11:47:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000104112_53305344.pth [2023-03-08 11:47:10,412][389688] Updated weights for policy 0, policy_version 104880 (0.0004) [2023-03-08 11:47:13,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12151.5, 300 sec: 12635.1). Total num frames: 53731328. Throughput: 0: 12165.9. Samples: 53727100. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:47:13,080][389401] Avg episode reward: [(0, '4700.927')] [2023-03-08 11:47:13,781][389688] Updated weights for policy 0, policy_version 104960 (0.0005) [2023-03-08 11:47:17,121][389688] Updated weights for policy 0, policy_version 105040 (0.0005) [2023-03-08 11:47:18,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 12649.0). Total num frames: 53792768. Throughput: 0: 12148.0. Samples: 53762656. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:47:18,080][389401] Avg episode reward: [(0, '4738.799')] [2023-03-08 11:47:20,371][389688] Updated weights for policy 0, policy_version 105120 (0.0004) [2023-03-08 11:47:23,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12151.5, 300 sec: 12649.0). Total num frames: 53854208. Throughput: 0: 12215.9. Samples: 53837896. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:47:23,080][389401] Avg episode reward: [(0, '4708.415')] [2023-03-08 11:47:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000105184_53854208.pth... [2023-03-08 11:47:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000104464_53485568.pth [2023-03-08 11:47:23,570][389688] Updated weights for policy 0, policy_version 105200 (0.0004) [2023-03-08 11:47:26,676][389688] Updated weights for policy 0, policy_version 105280 (0.0004) [2023-03-08 11:47:28,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 12676.8). Total num frames: 53919744. Throughput: 0: 12298.8. Samples: 53915712. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:47:28,080][389401] Avg episode reward: [(0, '4693.655')] [2023-03-08 11:47:29,885][389688] Updated weights for policy 0, policy_version 105360 (0.0004) [2023-03-08 11:47:33,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 12690.7). Total num frames: 53981184. Throughput: 0: 12353.2. Samples: 53953972. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:47:33,080][389401] Avg episode reward: [(0, '4738.902')] [2023-03-08 11:47:33,258][389688] Updated weights for policy 0, policy_version 105440 (0.0005) [2023-03-08 11:47:36,788][389688] Updated weights for policy 0, policy_version 105520 (0.0005) [2023-03-08 11:47:38,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12704.5). Total num frames: 54042624. Throughput: 0: 12314.3. Samples: 54024732. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:47:38,080][389401] Avg episode reward: [(0, '4703.078')] [2023-03-08 11:47:38,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000105552_54042624.pth... [2023-03-08 11:47:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000104816_53665792.pth [2023-03-08 11:47:39,918][389688] Updated weights for policy 0, policy_version 105600 (0.0004) [2023-03-08 11:47:43,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12288.0, 300 sec: 12704.5). Total num frames: 54104064. Throughput: 0: 12415.5. Samples: 54102360. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:47:43,080][389401] Avg episode reward: [(0, '4720.743')] [2023-03-08 11:47:43,100][389688] Updated weights for policy 0, policy_version 105680 (0.0004) [2023-03-08 11:47:46,211][389688] Updated weights for policy 0, policy_version 105760 (0.0004) [2023-03-08 11:47:48,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12424.5, 300 sec: 12704.5). Total num frames: 54169600. Throughput: 0: 12505.2. Samples: 54142508. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:47:48,080][389401] Avg episode reward: [(0, '4685.389')] [2023-03-08 11:47:49,637][389688] Updated weights for policy 0, policy_version 105840 (0.0005) [2023-03-08 11:47:52,919][389688] Updated weights for policy 0, policy_version 105920 (0.0005) [2023-03-08 11:47:53,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12424.5, 300 sec: 12704.5). Total num frames: 54231040. Throughput: 0: 12561.1. Samples: 54214720. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:47:53,080][389401] Avg episode reward: [(0, '4738.262')] [2023-03-08 11:47:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000105920_54231040.pth... [2023-03-08 11:47:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000105184_53854208.pth [2023-03-08 11:47:56,366][389688] Updated weights for policy 0, policy_version 106000 (0.0005) [2023-03-08 11:47:58,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12356.3, 300 sec: 12690.7). Total num frames: 54288384. Throughput: 0: 12462.9. Samples: 54287932. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:47:58,080][389401] Avg episode reward: [(0, '4738.283')] [2023-03-08 11:47:59,805][389688] Updated weights for policy 0, policy_version 106080 (0.0005) [2023-03-08 11:48:03,064][389688] Updated weights for policy 0, policy_version 106160 (0.0005) [2023-03-08 11:48:03,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12492.8, 300 sec: 12690.7). Total num frames: 54353920. Throughput: 0: 12478.1. Samples: 54324168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:48:03,080][389401] Avg episode reward: [(0, '4738.536')] [2023-03-08 11:48:06,372][389688] Updated weights for policy 0, policy_version 106240 (0.0005) [2023-03-08 11:48:08,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 12676.8). Total num frames: 54411264. Throughput: 0: 12462.4. Samples: 54398704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:48:08,080][389401] Avg episode reward: [(0, '4736.932')] [2023-03-08 11:48:08,127][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000106280_54415360.pth... [2023-03-08 11:48:08,129][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000105552_54042624.pth [2023-03-08 11:48:09,859][389688] Updated weights for policy 0, policy_version 106320 (0.0005) [2023-03-08 11:48:13,011][389688] Updated weights for policy 0, policy_version 106400 (0.0004) [2023-03-08 11:48:13,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12690.7). Total num frames: 54476800. Throughput: 0: 12377.6. Samples: 54472704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:48:13,080][389401] Avg episode reward: [(0, '4740.899')] [2023-03-08 11:48:16,165][389688] Updated weights for policy 0, policy_version 106480 (0.0005) [2023-03-08 11:48:18,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12424.5, 300 sec: 12690.7). Total num frames: 54538240. Throughput: 0: 12386.8. Samples: 54511376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:48:18,080][389401] Avg episode reward: [(0, '4738.945')] [2023-03-08 11:48:19,359][389688] Updated weights for policy 0, policy_version 106560 (0.0005) [2023-03-08 11:48:22,541][389688] Updated weights for policy 0, policy_version 106640 (0.0005) [2023-03-08 11:48:23,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12690.7). Total num frames: 54603776. Throughput: 0: 12511.6. Samples: 54587756. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:48:23,080][389401] Avg episode reward: [(0, '4737.879')] [2023-03-08 11:48:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000106648_54603776.pth... [2023-03-08 11:48:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000105920_54231040.pth [2023-03-08 11:48:25,765][389688] Updated weights for policy 0, policy_version 106720 (0.0005) [2023-03-08 11:48:28,079][389401] Fps is (10 sec: 13107.3, 60 sec: 12492.8, 300 sec: 12690.7). Total num frames: 54669312. Throughput: 0: 12500.4. Samples: 54664880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:48:28,080][389401] Avg episode reward: [(0, '4738.760')] [2023-03-08 11:48:29,083][389688] Updated weights for policy 0, policy_version 106800 (0.0005) [2023-03-08 11:48:32,263][389688] Updated weights for policy 0, policy_version 106880 (0.0004) [2023-03-08 11:48:33,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12492.8, 300 sec: 12690.7). Total num frames: 54730752. Throughput: 0: 12434.0. Samples: 54702036. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:48:33,080][389401] Avg episode reward: [(0, '4739.829')] [2023-03-08 11:48:35,468][389688] Updated weights for policy 0, policy_version 106960 (0.0005) [2023-03-08 11:48:38,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12492.8, 300 sec: 12676.8). Total num frames: 54792192. Throughput: 0: 12540.5. Samples: 54779044. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:48:38,080][389401] Avg episode reward: [(0, '4743.214')] [2023-03-08 11:48:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000107024_54796288.pth... [2023-03-08 11:48:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000106280_54415360.pth [2023-03-08 11:48:38,085][389644] Saving new best policy, reward=4743.214! [2023-03-08 11:48:38,724][389688] Updated weights for policy 0, policy_version 107040 (0.0005) [2023-03-08 11:48:41,872][389688] Updated weights for policy 0, policy_version 107120 (0.0005) [2023-03-08 11:48:43,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12561.0, 300 sec: 12704.5). Total num frames: 54857728. Throughput: 0: 12600.9. Samples: 54854972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:48:43,080][389401] Avg episode reward: [(0, '4739.193')] [2023-03-08 11:48:45,304][389688] Updated weights for policy 0, policy_version 107200 (0.0005) [2023-03-08 11:48:48,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12492.8, 300 sec: 12718.4). Total num frames: 54919168. Throughput: 0: 12586.5. Samples: 54890560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:48:48,080][389401] Avg episode reward: [(0, '4738.952')] [2023-03-08 11:48:48,580][389688] Updated weights for policy 0, policy_version 107280 (0.0005) [2023-03-08 11:48:52,038][389688] Updated weights for policy 0, policy_version 107360 (0.0005) [2023-03-08 11:48:53,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12718.4). Total num frames: 54980608. Throughput: 0: 12567.1. Samples: 54964224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:48:53,080][389401] Avg episode reward: [(0, '4737.963')] [2023-03-08 11:48:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000107384_54980608.pth... [2023-03-08 11:48:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000106648_54603776.pth [2023-03-08 11:48:55,446][389688] Updated weights for policy 0, policy_version 107440 (0.0005) [2023-03-08 11:48:58,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12492.8, 300 sec: 12690.7). Total num frames: 55037952. Throughput: 0: 12529.5. Samples: 55036532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:48:58,080][389401] Avg episode reward: [(0, '4739.138')] [2023-03-08 11:48:58,765][389688] Updated weights for policy 0, policy_version 107520 (0.0005) [2023-03-08 11:49:02,038][389688] Updated weights for policy 0, policy_version 107600 (0.0004) [2023-03-08 11:49:03,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12492.8, 300 sec: 12676.8). Total num frames: 55103488. Throughput: 0: 12498.5. Samples: 55073808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:49:03,080][389401] Avg episode reward: [(0, '4738.712')] [2023-03-08 11:49:05,491][389688] Updated weights for policy 0, policy_version 107680 (0.0004) [2023-03-08 11:49:08,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12492.8, 300 sec: 12649.0). Total num frames: 55160832. Throughput: 0: 12395.3. Samples: 55145544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:49:08,080][389401] Avg episode reward: [(0, '4738.821')] [2023-03-08 11:49:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000107736_55160832.pth... [2023-03-08 11:49:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000107024_54796288.pth [2023-03-08 11:49:08,891][389688] Updated weights for policy 0, policy_version 107760 (0.0005) [2023-03-08 11:49:12,159][389688] Updated weights for policy 0, policy_version 107840 (0.0004) [2023-03-08 11:49:13,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12424.6, 300 sec: 12621.2). Total num frames: 55222272. Throughput: 0: 12350.7. Samples: 55220660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:49:13,080][389401] Avg episode reward: [(0, '4738.983')] [2023-03-08 11:49:15,348][389688] Updated weights for policy 0, policy_version 107920 (0.0004) [2023-03-08 11:49:18,079][389401] Fps is (10 sec: 12697.8, 60 sec: 12492.8, 300 sec: 12607.4). Total num frames: 55287808. Throughput: 0: 12381.4. Samples: 55259200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:49:18,080][389401] Avg episode reward: [(0, '4740.033')] [2023-03-08 11:49:18,412][389688] Updated weights for policy 0, policy_version 108000 (0.0005) [2023-03-08 11:49:21,701][389688] Updated weights for policy 0, policy_version 108080 (0.0005) [2023-03-08 11:49:23,079][389401] Fps is (10 sec: 13107.1, 60 sec: 12492.8, 300 sec: 12593.5). Total num frames: 55353344. Throughput: 0: 12391.8. Samples: 55336676. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:49:23,080][389401] Avg episode reward: [(0, '4738.889')] [2023-03-08 11:49:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000108112_55353344.pth... [2023-03-08 11:49:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000107384_54980608.pth [2023-03-08 11:49:25,034][389688] Updated weights for policy 0, policy_version 108160 (0.0005) [2023-03-08 11:49:28,079][389401] Fps is (10 sec: 12697.4, 60 sec: 12424.5, 300 sec: 12579.6). Total num frames: 55414784. Throughput: 0: 12344.3. Samples: 55410468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:49:28,080][389401] Avg episode reward: [(0, '4740.557')] [2023-03-08 11:49:28,392][389688] Updated weights for policy 0, policy_version 108240 (0.0005) [2023-03-08 11:49:31,919][389688] Updated weights for policy 0, policy_version 108320 (0.0005) [2023-03-08 11:49:33,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12356.3, 300 sec: 12551.8). Total num frames: 55472128. Throughput: 0: 12298.4. Samples: 55443988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:49:33,080][389401] Avg episode reward: [(0, '4738.524')] [2023-03-08 11:49:35,319][389688] Updated weights for policy 0, policy_version 108400 (0.0005) [2023-03-08 11:49:38,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12356.3, 300 sec: 12524.0). Total num frames: 55533568. Throughput: 0: 12289.6. Samples: 55517256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:49:38,080][389401] Avg episode reward: [(0, '4737.973')] [2023-03-08 11:49:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000108464_55533568.pth... [2023-03-08 11:49:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000107736_55160832.pth [2023-03-08 11:49:38,590][389688] Updated weights for policy 0, policy_version 108480 (0.0005) [2023-03-08 11:49:42,058][389688] Updated weights for policy 0, policy_version 108560 (0.0004) [2023-03-08 11:49:43,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12482.4). Total num frames: 55590912. Throughput: 0: 12290.5. Samples: 55589604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:49:43,080][389401] Avg episode reward: [(0, '4737.610')] [2023-03-08 11:49:45,373][389688] Updated weights for policy 0, policy_version 108640 (0.0004) [2023-03-08 11:49:48,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12468.5). Total num frames: 55656448. Throughput: 0: 12306.4. Samples: 55627596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:49:48,080][389401] Avg episode reward: [(0, '4737.311')] [2023-03-08 11:49:48,674][389688] Updated weights for policy 0, policy_version 108720 (0.0004) [2023-03-08 11:49:52,398][389688] Updated weights for policy 0, policy_version 108800 (0.0005) [2023-03-08 11:49:53,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12413.0). Total num frames: 55709696. Throughput: 0: 12265.3. Samples: 55697480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:49:53,080][389401] Avg episode reward: [(0, '4739.107')] [2023-03-08 11:49:53,097][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000108816_55713792.pth... [2023-03-08 11:49:53,099][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000108112_55353344.pth [2023-03-08 11:49:55,728][389688] Updated weights for policy 0, policy_version 108880 (0.0005) [2023-03-08 11:49:58,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12219.7, 300 sec: 12413.0). Total num frames: 55771136. Throughput: 0: 12203.4. Samples: 55769812. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:49:58,080][389401] Avg episode reward: [(0, '4738.536')] [2023-03-08 11:49:59,066][389688] Updated weights for policy 0, policy_version 108960 (0.0005) [2023-03-08 11:50:02,256][389688] Updated weights for policy 0, policy_version 109040 (0.0005) [2023-03-08 11:50:03,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 12413.0). Total num frames: 55836672. Throughput: 0: 12195.5. Samples: 55808000. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:50:03,080][389401] Avg episode reward: [(0, '4737.475')] [2023-03-08 11:50:05,510][389688] Updated weights for policy 0, policy_version 109120 (0.0005) [2023-03-08 11:50:08,079][389401] Fps is (10 sec: 13107.2, 60 sec: 12356.3, 300 sec: 12413.0). Total num frames: 55902208. Throughput: 0: 12166.0. Samples: 55884144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:50:08,080][389401] Avg episode reward: [(0, '4740.062')] [2023-03-08 11:50:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000109184_55902208.pth... [2023-03-08 11:50:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000108464_55533568.pth [2023-03-08 11:50:08,686][389688] Updated weights for policy 0, policy_version 109200 (0.0004) [2023-03-08 11:50:11,906][389688] Updated weights for policy 0, policy_version 109280 (0.0005) [2023-03-08 11:50:13,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12356.2, 300 sec: 12399.1). Total num frames: 55963648. Throughput: 0: 12238.1. Samples: 55961184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:50:13,090][389401] Avg episode reward: [(0, '4738.474')] [2023-03-08 11:50:15,138][389688] Updated weights for policy 0, policy_version 109360 (0.0004) [2023-03-08 11:50:18,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12385.2). Total num frames: 56025088. Throughput: 0: 12326.7. Samples: 55998688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:50:18,090][389401] Avg episode reward: [(0, '4739.667')] [2023-03-08 11:50:18,411][389688] Updated weights for policy 0, policy_version 109440 (0.0005) [2023-03-08 11:50:21,788][389688] Updated weights for policy 0, policy_version 109520 (0.0005) [2023-03-08 11:50:23,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12219.7, 300 sec: 12371.3). Total num frames: 56086528. Throughput: 0: 12351.1. Samples: 56073056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:50:23,080][389401] Avg episode reward: [(0, '4738.882')] [2023-03-08 11:50:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000109544_56086528.pth... [2023-03-08 11:50:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000108816_55713792.pth [2023-03-08 11:50:25,280][389688] Updated weights for policy 0, policy_version 109600 (0.0005) [2023-03-08 11:50:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12357.4). Total num frames: 56143872. Throughput: 0: 12270.4. Samples: 56141772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:50:28,080][389401] Avg episode reward: [(0, '4739.950')] [2023-03-08 11:50:28,991][389688] Updated weights for policy 0, policy_version 109680 (0.0006) [2023-03-08 11:50:32,508][389688] Updated weights for policy 0, policy_version 109760 (0.0005) [2023-03-08 11:50:33,079][389401] Fps is (10 sec: 11468.9, 60 sec: 12151.5, 300 sec: 12343.5). Total num frames: 56201216. Throughput: 0: 12157.2. Samples: 56174668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:50:33,080][389401] Avg episode reward: [(0, '4737.800')] [2023-03-08 11:50:35,747][389688] Updated weights for policy 0, policy_version 109840 (0.0004) [2023-03-08 11:50:38,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12219.7, 300 sec: 12371.3). Total num frames: 56266752. Throughput: 0: 12272.2. Samples: 56249728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:50:38,080][389401] Avg episode reward: [(0, '4737.695')] [2023-03-08 11:50:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000109896_56266752.pth... [2023-03-08 11:50:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000109184_55902208.pth [2023-03-08 11:50:38,960][389688] Updated weights for policy 0, policy_version 109920 (0.0004) [2023-03-08 11:50:42,213][389688] Updated weights for policy 0, policy_version 110000 (0.0005) [2023-03-08 11:50:43,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12288.0, 300 sec: 12357.4). Total num frames: 56328192. Throughput: 0: 12348.4. Samples: 56325488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:50:43,080][389401] Avg episode reward: [(0, '4742.800')] [2023-03-08 11:50:45,406][389688] Updated weights for policy 0, policy_version 110080 (0.0004) [2023-03-08 11:50:48,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12288.0, 300 sec: 12357.4). Total num frames: 56393728. Throughput: 0: 12360.5. Samples: 56364224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:50:48,080][389401] Avg episode reward: [(0, '4682.438')] [2023-03-08 11:50:48,634][389688] Updated weights for policy 0, policy_version 110160 (0.0004) [2023-03-08 11:50:51,950][389688] Updated weights for policy 0, policy_version 110240 (0.0005) [2023-03-08 11:50:53,079][389401] Fps is (10 sec: 12697.4, 60 sec: 12424.5, 300 sec: 12357.4). Total num frames: 56455168. Throughput: 0: 12329.9. Samples: 56438992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:50:53,080][389401] Avg episode reward: [(0, '4738.898')] [2023-03-08 11:50:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000110264_56455168.pth... [2023-03-08 11:50:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000109544_56086528.pth [2023-03-08 11:50:55,240][389688] Updated weights for policy 0, policy_version 110320 (0.0003) [2023-03-08 11:50:58,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12357.4). Total num frames: 56516608. Throughput: 0: 12241.7. Samples: 56512060. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:50:58,080][389401] Avg episode reward: [(0, '4738.854')] [2023-03-08 11:50:58,761][389688] Updated weights for policy 0, policy_version 110400 (0.0004) [2023-03-08 11:51:02,491][389688] Updated weights for policy 0, policy_version 110480 (0.0005) [2023-03-08 11:51:03,079][389401] Fps is (10 sec: 11468.9, 60 sec: 12219.7, 300 sec: 12301.9). Total num frames: 56569856. Throughput: 0: 12148.1. Samples: 56545352. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:51:03,080][389401] Avg episode reward: [(0, '4738.410')] [2023-03-08 11:51:06,255][389688] Updated weights for policy 0, policy_version 110560 (0.0005) [2023-03-08 11:51:08,079][389401] Fps is (10 sec: 11059.2, 60 sec: 12083.2, 300 sec: 12288.0). Total num frames: 56627200. Throughput: 0: 11951.8. Samples: 56610888. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:51:08,080][389401] Avg episode reward: [(0, '4740.013')] [2023-03-08 11:51:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000110600_56627200.pth... [2023-03-08 11:51:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000109896_56266752.pth [2023-03-08 11:51:09,900][389688] Updated weights for policy 0, policy_version 110640 (0.0005) [2023-03-08 11:51:13,079][389401] Fps is (10 sec: 11468.6, 60 sec: 12014.9, 300 sec: 12288.0). Total num frames: 56684544. Throughput: 0: 11975.9. Samples: 56680688. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:51:13,080][389401] Avg episode reward: [(0, '4739.566')] [2023-03-08 11:51:13,316][389688] Updated weights for policy 0, policy_version 110720 (0.0004) [2023-03-08 11:51:16,804][389688] Updated weights for policy 0, policy_version 110800 (0.0004) [2023-03-08 11:51:18,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 12260.2). Total num frames: 56741888. Throughput: 0: 12030.1. Samples: 56716020. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:51:18,080][389401] Avg episode reward: [(0, '4741.054')] [2023-03-08 11:51:20,602][389688] Updated weights for policy 0, policy_version 110880 (0.0005) [2023-03-08 11:51:23,079][389401] Fps is (10 sec: 11059.4, 60 sec: 11810.2, 300 sec: 12246.3). Total num frames: 56795136. Throughput: 0: 11844.5. Samples: 56782728. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:51:23,080][389401] Avg episode reward: [(0, '4742.003')] [2023-03-08 11:51:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000110928_56795136.pth... [2023-03-08 11:51:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000110264_56455168.pth [2023-03-08 11:51:24,357][389688] Updated weights for policy 0, policy_version 110960 (0.0005) [2023-03-08 11:51:27,994][389688] Updated weights for policy 0, policy_version 111040 (0.0005) [2023-03-08 11:51:28,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11810.1, 300 sec: 12232.5). Total num frames: 56852480. Throughput: 0: 11621.5. Samples: 56848456. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:51:28,080][389401] Avg episode reward: [(0, '4739.056')] [2023-03-08 11:51:31,572][389688] Updated weights for policy 0, policy_version 111120 (0.0005) [2023-03-08 11:51:33,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 12218.6). Total num frames: 56909824. Throughput: 0: 11533.8. Samples: 56883244. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:51:33,080][389401] Avg episode reward: [(0, '4708.583')] [2023-03-08 11:51:34,902][389688] Updated weights for policy 0, policy_version 111200 (0.0004) [2023-03-08 11:51:38,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11741.9, 300 sec: 12218.6). Total num frames: 56971264. Throughput: 0: 11478.2. Samples: 56955512. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:51:38,080][389401] Avg episode reward: [(0, '4739.779')] [2023-03-08 11:51:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000111272_56971264.pth... [2023-03-08 11:51:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000110600_56627200.pth [2023-03-08 11:51:38,339][389688] Updated weights for policy 0, policy_version 111280 (0.0004) [2023-03-08 11:51:41,886][389688] Updated weights for policy 0, policy_version 111360 (0.0004) [2023-03-08 11:51:43,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 12218.6). Total num frames: 57028608. Throughput: 0: 11410.8. Samples: 57025544. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:51:43,080][389401] Avg episode reward: [(0, '4741.411')] [2023-03-08 11:51:45,177][389688] Updated weights for policy 0, policy_version 111440 (0.0004) [2023-03-08 11:51:48,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 12218.6). Total num frames: 57090048. Throughput: 0: 11503.9. Samples: 57063028. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:51:48,080][389401] Avg episode reward: [(0, '4739.784')] [2023-03-08 11:51:48,731][389688] Updated weights for policy 0, policy_version 111520 (0.0005) [2023-03-08 11:51:52,318][389688] Updated weights for policy 0, policy_version 111600 (0.0005) [2023-03-08 11:51:53,079][389401] Fps is (10 sec: 11878.2, 60 sec: 11537.1, 300 sec: 12204.7). Total num frames: 57147392. Throughput: 0: 11559.8. Samples: 57131080. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:51:53,080][389401] Avg episode reward: [(0, '4741.117')] [2023-03-08 11:51:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000111616_57147392.pth... [2023-03-08 11:51:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000110928_56795136.pth [2023-03-08 11:51:55,844][389688] Updated weights for policy 0, policy_version 111680 (0.0005) [2023-03-08 11:51:58,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 12204.7). Total num frames: 57204736. Throughput: 0: 11582.0. Samples: 57201876. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 11:51:58,080][389401] Avg episode reward: [(0, '4739.926')] [2023-03-08 11:51:59,206][389688] Updated weights for policy 0, policy_version 111760 (0.0004) [2023-03-08 11:52:02,770][389688] Updated weights for policy 0, policy_version 111840 (0.0005) [2023-03-08 11:52:03,079][389401] Fps is (10 sec: 11469.0, 60 sec: 11537.1, 300 sec: 12190.8). Total num frames: 57262080. Throughput: 0: 11590.0. Samples: 57237568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:52:03,080][389401] Avg episode reward: [(0, '4740.929')] [2023-03-08 11:52:06,391][389688] Updated weights for policy 0, policy_version 111920 (0.0005) [2023-03-08 11:52:08,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 12163.0). Total num frames: 57319424. Throughput: 0: 11638.0. Samples: 57306436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:52:08,079][389401] Avg episode reward: [(0, '4743.350')] [2023-03-08 11:52:08,133][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000111960_57323520.pth... [2023-03-08 11:52:08,134][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000111272_56971264.pth [2023-03-08 11:52:08,135][389644] Saving new best policy, reward=4743.350! [2023-03-08 11:52:10,033][389688] Updated weights for policy 0, policy_version 112000 (0.0005) [2023-03-08 11:52:13,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 12149.2). Total num frames: 57376768. Throughput: 0: 11649.5. Samples: 57372684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:52:13,080][389401] Avg episode reward: [(0, '4741.106')] [2023-03-08 11:52:13,734][389688] Updated weights for policy 0, policy_version 112080 (0.0005) [2023-03-08 11:52:17,641][389688] Updated weights for policy 0, policy_version 112160 (0.0005) [2023-03-08 11:52:18,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11468.8, 300 sec: 12121.4). Total num frames: 57430016. Throughput: 0: 11604.4. Samples: 57405440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:52:18,080][389401] Avg episode reward: [(0, '4741.450')] [2023-03-08 11:52:21,037][389688] Updated weights for policy 0, policy_version 112240 (0.0004) [2023-03-08 11:52:23,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 12107.5). Total num frames: 57491456. Throughput: 0: 11535.4. Samples: 57474608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:52:23,080][389401] Avg episode reward: [(0, '4641.980')] [2023-03-08 11:52:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000112288_57491456.pth... [2023-03-08 11:52:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000111616_57147392.pth [2023-03-08 11:52:24,345][389688] Updated weights for policy 0, policy_version 112320 (0.0004) [2023-03-08 11:52:27,656][389688] Updated weights for policy 0, policy_version 112400 (0.0005) [2023-03-08 11:52:28,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 12107.5). Total num frames: 57552896. Throughput: 0: 11629.3. Samples: 57548864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:52:28,080][389401] Avg episode reward: [(0, '4742.538')] [2023-03-08 11:52:30,984][389688] Updated weights for policy 0, policy_version 112480 (0.0005) [2023-03-08 11:52:33,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 12107.5). Total num frames: 57614336. Throughput: 0: 11612.4. Samples: 57585588. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:52:33,080][389401] Avg episode reward: [(0, '4741.758')] [2023-03-08 11:52:34,368][389688] Updated weights for policy 0, policy_version 112560 (0.0005) [2023-03-08 11:52:37,921][389688] Updated weights for policy 0, policy_version 112640 (0.0005) [2023-03-08 11:52:38,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 12093.6). Total num frames: 57671680. Throughput: 0: 11703.0. Samples: 57657716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:52:38,080][389401] Avg episode reward: [(0, '4742.692')] [2023-03-08 11:52:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000112640_57671680.pth... [2023-03-08 11:52:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000111960_57323520.pth [2023-03-08 11:52:41,396][389688] Updated weights for policy 0, policy_version 112720 (0.0005) [2023-03-08 11:52:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 12065.8). Total num frames: 57729024. Throughput: 0: 11658.9. Samples: 57726528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:52:43,080][389401] Avg episode reward: [(0, '4742.982')] [2023-03-08 11:52:44,855][389688] Updated weights for policy 0, policy_version 112800 (0.0004) [2023-03-08 11:52:48,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11673.6, 300 sec: 12065.8). Total num frames: 57790464. Throughput: 0: 11663.9. Samples: 57762444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:52:48,080][389401] Avg episode reward: [(0, '4741.561')] [2023-03-08 11:52:48,273][389688] Updated weights for policy 0, policy_version 112880 (0.0004) [2023-03-08 11:52:51,769][389688] Updated weights for policy 0, policy_version 112960 (0.0005) [2023-03-08 11:52:53,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 12079.7). Total num frames: 57851904. Throughput: 0: 11725.0. Samples: 57834060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:52:53,080][389401] Avg episode reward: [(0, '4741.323')] [2023-03-08 11:52:53,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000112992_57851904.pth... [2023-03-08 11:52:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000112288_57491456.pth [2023-03-08 11:52:55,045][389688] Updated weights for policy 0, policy_version 113040 (0.0005) [2023-03-08 11:52:58,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 12065.8). Total num frames: 57913344. Throughput: 0: 11924.0. Samples: 57909264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:52:58,080][389401] Avg episode reward: [(0, '4743.472')] [2023-03-08 11:52:58,080][389644] Saving new best policy, reward=4743.472! [2023-03-08 11:52:58,330][389688] Updated weights for policy 0, policy_version 113120 (0.0005) [2023-03-08 11:53:01,601][389688] Updated weights for policy 0, policy_version 113200 (0.0005) [2023-03-08 11:53:03,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11878.4, 300 sec: 12079.7). Total num frames: 57974784. Throughput: 0: 12016.4. Samples: 57946176. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:53:03,080][389401] Avg episode reward: [(0, '4743.615')] [2023-03-08 11:53:03,080][389644] Saving new best policy, reward=4743.615! [2023-03-08 11:53:04,919][389688] Updated weights for policy 0, policy_version 113280 (0.0005) [2023-03-08 11:53:08,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 12065.8). Total num frames: 58036224. Throughput: 0: 12117.7. Samples: 58019904. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:53:08,080][389401] Avg episode reward: [(0, '4742.557')] [2023-03-08 11:53:08,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000113352_58036224.pth... [2023-03-08 11:53:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000112640_57671680.pth [2023-03-08 11:53:08,265][389688] Updated weights for policy 0, policy_version 113360 (0.0005) [2023-03-08 11:53:11,569][389688] Updated weights for policy 0, policy_version 113440 (0.0004) [2023-03-08 11:53:13,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12014.9, 300 sec: 12065.8). Total num frames: 58097664. Throughput: 0: 12134.7. Samples: 58094928. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:53:13,080][389401] Avg episode reward: [(0, '4743.584')] [2023-03-08 11:53:15,088][389688] Updated weights for policy 0, policy_version 113520 (0.0004) [2023-03-08 11:53:18,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 12038.1). Total num frames: 58155008. Throughput: 0: 12072.1. Samples: 58128832. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:53:18,080][389401] Avg episode reward: [(0, '4742.142')] [2023-03-08 11:53:18,585][389688] Updated weights for policy 0, policy_version 113600 (0.0004) [2023-03-08 11:53:22,272][389688] Updated weights for policy 0, policy_version 113680 (0.0005) [2023-03-08 11:53:23,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 12010.3). Total num frames: 58212352. Throughput: 0: 11980.7. Samples: 58196848. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:53:23,080][389401] Avg episode reward: [(0, '4744.013')] [2023-03-08 11:53:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000113696_58212352.pth... [2023-03-08 11:53:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000112992_57851904.pth [2023-03-08 11:53:23,086][389644] Saving new best policy, reward=4744.013! [2023-03-08 11:53:25,794][389688] Updated weights for policy 0, policy_version 113760 (0.0005) [2023-03-08 11:53:28,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11996.4). Total num frames: 58269696. Throughput: 0: 11981.5. Samples: 58265696. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:53:28,080][389401] Avg episode reward: [(0, '4744.770')] [2023-03-08 11:53:28,080][389644] Saving new best policy, reward=4744.770! [2023-03-08 11:53:29,387][389688] Updated weights for policy 0, policy_version 113840 (0.0005) [2023-03-08 11:53:32,879][389688] Updated weights for policy 0, policy_version 113920 (0.0005) [2023-03-08 11:53:33,079][389401] Fps is (10 sec: 11469.0, 60 sec: 11878.4, 300 sec: 11982.5). Total num frames: 58327040. Throughput: 0: 11959.5. Samples: 58300620. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:53:33,080][389401] Avg episode reward: [(0, '4739.311')] [2023-03-08 11:53:36,310][389688] Updated weights for policy 0, policy_version 114000 (0.0005) [2023-03-08 11:53:38,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11968.6). Total num frames: 58388480. Throughput: 0: 11956.6. Samples: 58372108. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:53:38,080][389401] Avg episode reward: [(0, '4740.872')] [2023-03-08 11:53:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000114040_58388480.pth... [2023-03-08 11:53:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000113352_58036224.pth [2023-03-08 11:53:39,556][389688] Updated weights for policy 0, policy_version 114080 (0.0004) [2023-03-08 11:53:42,881][389688] Updated weights for policy 0, policy_version 114160 (0.0005) [2023-03-08 11:53:43,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12015.0, 300 sec: 11968.7). Total num frames: 58449920. Throughput: 0: 11952.9. Samples: 58447144. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:53:43,080][389401] Avg episode reward: [(0, '4744.493')] [2023-03-08 11:53:46,285][389688] Updated weights for policy 0, policy_version 114240 (0.0005) [2023-03-08 11:53:48,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12014.9, 300 sec: 11968.7). Total num frames: 58511360. Throughput: 0: 11924.7. Samples: 58482788. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:53:48,080][389401] Avg episode reward: [(0, '4745.976')] [2023-03-08 11:53:48,080][389644] Saving new best policy, reward=4745.976! [2023-03-08 11:53:49,769][389688] Updated weights for policy 0, policy_version 114320 (0.0005) [2023-03-08 11:53:53,079][389401] Fps is (10 sec: 11878.2, 60 sec: 11946.7, 300 sec: 11968.6). Total num frames: 58568704. Throughput: 0: 11896.5. Samples: 58555248. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:53:53,080][389401] Avg episode reward: [(0, '4745.029')] [2023-03-08 11:53:53,104][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000114400_58572800.pth... [2023-03-08 11:53:53,104][389688] Updated weights for policy 0, policy_version 114400 (0.0004) [2023-03-08 11:53:53,105][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000113696_58212352.pth [2023-03-08 11:53:56,408][389688] Updated weights for policy 0, policy_version 114480 (0.0004) [2023-03-08 11:53:58,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12014.9, 300 sec: 11968.7). Total num frames: 58634240. Throughput: 0: 11882.6. Samples: 58629644. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:53:58,080][389401] Avg episode reward: [(0, '4743.004')] [2023-03-08 11:53:59,674][389688] Updated weights for policy 0, policy_version 114560 (0.0004) [2023-03-08 11:54:03,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11968.7). Total num frames: 58691584. Throughput: 0: 11929.8. Samples: 58665672. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:54:03,080][389401] Avg episode reward: [(0, '4729.906')] [2023-03-08 11:54:03,289][389688] Updated weights for policy 0, policy_version 114640 (0.0006) [2023-03-08 11:54:06,876][389688] Updated weights for policy 0, policy_version 114720 (0.0005) [2023-03-08 11:54:08,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11878.4, 300 sec: 11954.8). Total num frames: 58748928. Throughput: 0: 11947.3. Samples: 58734476. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:54:08,080][389401] Avg episode reward: [(0, '4740.882')] [2023-03-08 11:54:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000114744_58748928.pth... [2023-03-08 11:54:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000114040_58388480.pth [2023-03-08 11:54:10,546][389688] Updated weights for policy 0, policy_version 114800 (0.0006) [2023-03-08 11:54:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11810.2, 300 sec: 11927.0). Total num frames: 58806272. Throughput: 0: 11923.2. Samples: 58802240. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:54:13,080][389401] Avg episode reward: [(0, '4741.954')] [2023-03-08 11:54:14,006][389688] Updated weights for policy 0, policy_version 114880 (0.0005) [2023-03-08 11:54:17,306][389688] Updated weights for policy 0, policy_version 114960 (0.0004) [2023-03-08 11:54:18,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 11913.1). Total num frames: 58867712. Throughput: 0: 11965.1. Samples: 58839048. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:54:18,080][389401] Avg episode reward: [(0, '4739.779')] [2023-03-08 11:54:20,636][389688] Updated weights for policy 0, policy_version 115040 (0.0005) [2023-03-08 11:54:23,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11946.7, 300 sec: 11913.1). Total num frames: 58929152. Throughput: 0: 12016.3. Samples: 58912840. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:54:23,080][389401] Avg episode reward: [(0, '4732.045')] [2023-03-08 11:54:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000115096_58929152.pth... [2023-03-08 11:54:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000114400_58572800.pth [2023-03-08 11:54:23,854][389688] Updated weights for policy 0, policy_version 115120 (0.0004) [2023-03-08 11:54:27,319][389688] Updated weights for policy 0, policy_version 115200 (0.0005) [2023-03-08 11:54:28,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11927.0). Total num frames: 58990592. Throughput: 0: 11987.0. Samples: 58986560. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:54:28,080][389401] Avg episode reward: [(0, '4710.927')] [2023-03-08 11:54:30,665][389688] Updated weights for policy 0, policy_version 115280 (0.0005) [2023-03-08 11:54:33,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11927.0). Total num frames: 59052032. Throughput: 0: 12013.0. Samples: 59023372. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:54:33,080][389401] Avg episode reward: [(0, '4741.941')] [2023-03-08 11:54:33,985][389688] Updated weights for policy 0, policy_version 115360 (0.0004) [2023-03-08 11:54:37,218][389688] Updated weights for policy 0, policy_version 115440 (0.0004) [2023-03-08 11:54:38,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11940.9). Total num frames: 59113472. Throughput: 0: 12059.3. Samples: 59097916. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:54:38,080][389401] Avg episode reward: [(0, '4716.980')] [2023-03-08 11:54:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000115456_59113472.pth... [2023-03-08 11:54:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000114744_58748928.pth [2023-03-08 11:54:40,560][389688] Updated weights for policy 0, policy_version 115520 (0.0004) [2023-03-08 11:54:43,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11927.0). Total num frames: 59174912. Throughput: 0: 12026.0. Samples: 59170816. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:54:43,080][389401] Avg episode reward: [(0, '4743.777')] [2023-03-08 11:54:44,053][389688] Updated weights for policy 0, policy_version 115600 (0.0004) [2023-03-08 11:54:47,791][389688] Updated weights for policy 0, policy_version 115680 (0.0005) [2023-03-08 11:54:48,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11927.0). Total num frames: 59228160. Throughput: 0: 11973.9. Samples: 59204496. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:54:48,080][389401] Avg episode reward: [(0, '4674.205')] [2023-03-08 11:54:51,087][389688] Updated weights for policy 0, policy_version 115760 (0.0005) [2023-03-08 11:54:53,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11940.9). Total num frames: 59293696. Throughput: 0: 12043.9. Samples: 59276452. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:54:53,080][389401] Avg episode reward: [(0, '4682.042')] [2023-03-08 11:54:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000115808_59293696.pth... [2023-03-08 11:54:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000115096_58929152.pth [2023-03-08 11:54:54,420][389688] Updated weights for policy 0, policy_version 115840 (0.0005) [2023-03-08 11:54:57,728][389688] Updated weights for policy 0, policy_version 115920 (0.0004) [2023-03-08 11:54:58,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11927.0). Total num frames: 59355136. Throughput: 0: 12185.8. Samples: 59350604. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 11:54:58,080][389401] Avg episode reward: [(0, '4738.117')] [2023-03-08 11:55:01,124][389688] Updated weights for policy 0, policy_version 116000 (0.0005) [2023-03-08 11:55:03,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12014.9, 300 sec: 11899.2). Total num frames: 59412480. Throughput: 0: 12161.1. Samples: 59386296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:55:03,080][389401] Avg episode reward: [(0, '4743.973')] [2023-03-08 11:55:04,516][389688] Updated weights for policy 0, policy_version 116080 (0.0005) [2023-03-08 11:55:08,035][389688] Updated weights for policy 0, policy_version 116160 (0.0005) [2023-03-08 11:55:08,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11899.2). Total num frames: 59473920. Throughput: 0: 12105.8. Samples: 59457600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:55:08,080][389401] Avg episode reward: [(0, '4743.574')] [2023-03-08 11:55:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000116160_59473920.pth... [2023-03-08 11:55:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000115456_59113472.pth [2023-03-08 11:55:11,486][389688] Updated weights for policy 0, policy_version 116240 (0.0005) [2023-03-08 11:55:13,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11885.3). Total num frames: 59531264. Throughput: 0: 12020.3. Samples: 59527476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:55:13,080][389401] Avg episode reward: [(0, '4743.931')] [2023-03-08 11:55:14,994][389688] Updated weights for policy 0, policy_version 116320 (0.0005) [2023-03-08 11:55:18,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11871.5). Total num frames: 59588608. Throughput: 0: 12014.8. Samples: 59564040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:55:18,080][389401] Avg episode reward: [(0, '4743.687')] [2023-03-08 11:55:18,518][389688] Updated weights for policy 0, policy_version 116400 (0.0005) [2023-03-08 11:55:22,050][389688] Updated weights for policy 0, policy_version 116480 (0.0005) [2023-03-08 11:55:23,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11946.7, 300 sec: 11871.5). Total num frames: 59645952. Throughput: 0: 11905.5. Samples: 59633664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:55:23,080][389401] Avg episode reward: [(0, '4742.261')] [2023-03-08 11:55:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000116496_59645952.pth... [2023-03-08 11:55:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000115808_59293696.pth [2023-03-08 11:55:25,481][389688] Updated weights for policy 0, policy_version 116560 (0.0004) [2023-03-08 11:55:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.6, 300 sec: 11885.3). Total num frames: 59707392. Throughput: 0: 11866.8. Samples: 59704820. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:55:28,080][389401] Avg episode reward: [(0, '4739.419')] [2023-03-08 11:55:28,919][389688] Updated weights for policy 0, policy_version 116640 (0.0005) [2023-03-08 11:55:32,290][389688] Updated weights for policy 0, policy_version 116720 (0.0005) [2023-03-08 11:55:33,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11871.5). Total num frames: 59768832. Throughput: 0: 11905.1. Samples: 59740224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:55:33,080][389401] Avg episode reward: [(0, '4740.117')] [2023-03-08 11:55:35,519][389688] Updated weights for policy 0, policy_version 116800 (0.0005) [2023-03-08 11:55:38,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11871.5). Total num frames: 59830272. Throughput: 0: 11955.6. Samples: 59814452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:55:38,080][389401] Avg episode reward: [(0, '4735.597')] [2023-03-08 11:55:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000116856_59830272.pth... [2023-03-08 11:55:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000116160_59473920.pth [2023-03-08 11:55:38,878][389688] Updated weights for policy 0, policy_version 116880 (0.0005) [2023-03-08 11:55:42,034][389688] Updated weights for policy 0, policy_version 116960 (0.0003) [2023-03-08 11:55:43,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12015.0, 300 sec: 11871.5). Total num frames: 59895808. Throughput: 0: 12023.5. Samples: 59891660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:55:43,080][389401] Avg episode reward: [(0, '4737.356')] [2023-03-08 11:55:45,451][389688] Updated weights for policy 0, policy_version 117040 (0.0005) [2023-03-08 11:55:48,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11857.6). Total num frames: 59953152. Throughput: 0: 12021.7. Samples: 59927272. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:55:48,080][389401] Avg episode reward: [(0, '4740.739')] [2023-03-08 11:55:49,052][389688] Updated weights for policy 0, policy_version 117120 (0.0005) [2023-03-08 11:55:52,260][389688] Updated weights for policy 0, policy_version 117200 (0.0005) [2023-03-08 11:55:53,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12014.9, 300 sec: 11857.6). Total num frames: 60014592. Throughput: 0: 12023.7. Samples: 59998668. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:55:53,080][389401] Avg episode reward: [(0, '4439.274')] [2023-03-08 11:55:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000117216_60014592.pth... [2023-03-08 11:55:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000116496_59645952.pth [2023-03-08 11:55:55,602][389688] Updated weights for policy 0, policy_version 117280 (0.0005) [2023-03-08 11:55:58,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12015.0, 300 sec: 11885.3). Total num frames: 60076032. Throughput: 0: 12088.3. Samples: 60071448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:55:58,080][389401] Avg episode reward: [(0, '4736.987')] [2023-03-08 11:55:59,009][389688] Updated weights for policy 0, policy_version 117360 (0.0004) [2023-03-08 11:56:02,447][389688] Updated weights for policy 0, policy_version 117440 (0.0004) [2023-03-08 11:56:03,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12014.9, 300 sec: 11885.3). Total num frames: 60133376. Throughput: 0: 12106.0. Samples: 60108808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:56:03,080][389401] Avg episode reward: [(0, '4742.119')] [2023-03-08 11:56:05,833][389688] Updated weights for policy 0, policy_version 117520 (0.0004) [2023-03-08 11:56:08,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12014.9, 300 sec: 11899.2). Total num frames: 60194816. Throughput: 0: 12133.8. Samples: 60179684. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:56:08,080][389401] Avg episode reward: [(0, '4740.248')] [2023-03-08 11:56:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000117568_60194816.pth... [2023-03-08 11:56:08,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000116856_59830272.pth [2023-03-08 11:56:09,348][389688] Updated weights for policy 0, policy_version 117600 (0.0005) [2023-03-08 11:56:12,968][389688] Updated weights for policy 0, policy_version 117680 (0.0005) [2023-03-08 11:56:13,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11899.2). Total num frames: 60252160. Throughput: 0: 12077.6. Samples: 60248312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:56:13,080][389401] Avg episode reward: [(0, '4742.507')] [2023-03-08 11:56:16,545][389688] Updated weights for policy 0, policy_version 117760 (0.0005) [2023-03-08 11:56:18,079][389401] Fps is (10 sec: 11468.9, 60 sec: 12014.9, 300 sec: 11913.1). Total num frames: 60309504. Throughput: 0: 12049.5. Samples: 60282452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:56:18,080][389401] Avg episode reward: [(0, '4744.789')] [2023-03-08 11:56:20,049][389688] Updated weights for policy 0, policy_version 117840 (0.0005) [2023-03-08 11:56:23,079][389401] Fps is (10 sec: 11468.7, 60 sec: 12014.9, 300 sec: 11913.1). Total num frames: 60366848. Throughput: 0: 11957.4. Samples: 60352536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:56:23,080][389401] Avg episode reward: [(0, '4741.834')] [2023-03-08 11:56:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000117904_60366848.pth... [2023-03-08 11:56:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000117216_60014592.pth [2023-03-08 11:56:23,466][389688] Updated weights for policy 0, policy_version 117920 (0.0005) [2023-03-08 11:56:26,975][389688] Updated weights for policy 0, policy_version 118000 (0.0005) [2023-03-08 11:56:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11927.0). Total num frames: 60428288. Throughput: 0: 11818.2. Samples: 60423480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:56:28,080][389401] Avg episode reward: [(0, '4740.664')] [2023-03-08 11:56:30,518][389688] Updated weights for policy 0, policy_version 118080 (0.0005) [2023-03-08 11:56:33,079][389401] Fps is (10 sec: 11878.6, 60 sec: 11946.7, 300 sec: 11913.1). Total num frames: 60485632. Throughput: 0: 11807.7. Samples: 60458620. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:56:33,080][389401] Avg episode reward: [(0, '4742.743')] [2023-03-08 11:56:33,797][389688] Updated weights for policy 0, policy_version 118160 (0.0004) [2023-03-08 11:56:37,088][389688] Updated weights for policy 0, policy_version 118240 (0.0004) [2023-03-08 11:56:38,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11946.6, 300 sec: 11927.0). Total num frames: 60547072. Throughput: 0: 11889.9. Samples: 60533716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:56:38,080][389401] Avg episode reward: [(0, '4741.375')] [2023-03-08 11:56:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000118256_60547072.pth... [2023-03-08 11:56:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000117568_60194816.pth [2023-03-08 11:56:40,694][389688] Updated weights for policy 0, policy_version 118320 (0.0005) [2023-03-08 11:56:43,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11913.1). Total num frames: 60604416. Throughput: 0: 11826.6. Samples: 60603644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:56:43,080][389401] Avg episode reward: [(0, '4741.765')] [2023-03-08 11:56:44,185][389688] Updated weights for policy 0, policy_version 118400 (0.0004) [2023-03-08 11:56:47,525][389688] Updated weights for policy 0, policy_version 118480 (0.0005) [2023-03-08 11:56:48,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 11927.0). Total num frames: 60665856. Throughput: 0: 11772.5. Samples: 60638572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:56:48,080][389401] Avg episode reward: [(0, '4742.419')] [2023-03-08 11:56:50,784][389688] Updated weights for policy 0, policy_version 118560 (0.0004) [2023-03-08 11:56:53,079][389401] Fps is (10 sec: 12697.4, 60 sec: 11946.7, 300 sec: 11954.8). Total num frames: 60731392. Throughput: 0: 11864.0. Samples: 60713564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:56:53,080][389401] Avg episode reward: [(0, '4705.895')] [2023-03-08 11:56:53,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000118616_60731392.pth... [2023-03-08 11:56:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000117904_60366848.pth [2023-03-08 11:56:54,044][389688] Updated weights for policy 0, policy_version 118640 (0.0005) [2023-03-08 11:56:57,299][389688] Updated weights for policy 0, policy_version 118720 (0.0004) [2023-03-08 11:56:58,079][389401] Fps is (10 sec: 12697.6, 60 sec: 11946.7, 300 sec: 11968.6). Total num frames: 60792832. Throughput: 0: 12010.8. Samples: 60788800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:56:58,080][389401] Avg episode reward: [(0, '4742.720')] [2023-03-08 11:57:00,596][389688] Updated weights for policy 0, policy_version 118800 (0.0004) [2023-03-08 11:57:03,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11982.5). Total num frames: 60854272. Throughput: 0: 12078.5. Samples: 60825984. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:57:03,080][389401] Avg episode reward: [(0, '4738.410')] [2023-03-08 11:57:03,960][389688] Updated weights for policy 0, policy_version 118880 (0.0005) [2023-03-08 11:57:07,262][389688] Updated weights for policy 0, policy_version 118960 (0.0005) [2023-03-08 11:57:08,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12014.9, 300 sec: 11996.4). Total num frames: 60915712. Throughput: 0: 12152.4. Samples: 60899392. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:57:08,080][389401] Avg episode reward: [(0, '4743.986')] [2023-03-08 11:57:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000118976_60915712.pth... [2023-03-08 11:57:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000118256_60547072.pth [2023-03-08 11:57:10,660][389688] Updated weights for policy 0, policy_version 119040 (0.0005) [2023-03-08 11:57:13,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 12024.2). Total num frames: 60977152. Throughput: 0: 12212.2. Samples: 60973028. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:57:13,080][389401] Avg episode reward: [(0, '4740.815')] [2023-03-08 11:57:14,059][389688] Updated weights for policy 0, policy_version 119120 (0.0005) [2023-03-08 11:57:17,364][389688] Updated weights for policy 0, policy_version 119200 (0.0004) [2023-03-08 11:57:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 12010.3). Total num frames: 61034496. Throughput: 0: 12249.7. Samples: 61009856. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:57:18,080][389401] Avg episode reward: [(0, '4741.684')] [2023-03-08 11:57:20,890][389688] Updated weights for policy 0, policy_version 119280 (0.0005) [2023-03-08 11:57:23,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12010.3). Total num frames: 61095936. Throughput: 0: 12164.2. Samples: 61081104. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:57:23,090][389401] Avg episode reward: [(0, '4743.412')] [2023-03-08 11:57:23,093][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000119328_61095936.pth... [2023-03-08 11:57:23,095][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000118616_60731392.pth [2023-03-08 11:57:24,135][389688] Updated weights for policy 0, policy_version 119360 (0.0004) [2023-03-08 11:57:27,333][389688] Updated weights for policy 0, policy_version 119440 (0.0004) [2023-03-08 11:57:28,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 12024.2). Total num frames: 61161472. Throughput: 0: 12305.3. Samples: 61157384. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:57:28,080][389401] Avg episode reward: [(0, '4742.613')] [2023-03-08 11:57:30,724][389688] Updated weights for policy 0, policy_version 119520 (0.0005) [2023-03-08 11:57:33,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12288.0, 300 sec: 12038.1). Total num frames: 61222912. Throughput: 0: 12326.6. Samples: 61193268. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:57:33,080][389401] Avg episode reward: [(0, '4740.722')] [2023-03-08 11:57:34,083][389688] Updated weights for policy 0, policy_version 119600 (0.0005) [2023-03-08 11:57:37,767][389688] Updated weights for policy 0, policy_version 119680 (0.0005) [2023-03-08 11:57:38,079][389401] Fps is (10 sec: 11468.9, 60 sec: 12151.5, 300 sec: 12024.2). Total num frames: 61276160. Throughput: 0: 12229.3. Samples: 61263880. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:57:38,080][389401] Avg episode reward: [(0, '4744.197')] [2023-03-08 11:57:38,132][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000119688_61280256.pth... [2023-03-08 11:57:38,133][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000118976_60915712.pth [2023-03-08 11:57:41,298][389688] Updated weights for policy 0, policy_version 119760 (0.0005) [2023-03-08 11:57:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12219.7, 300 sec: 12024.2). Total num frames: 61337600. Throughput: 0: 12104.7. Samples: 61333512. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:57:43,080][389401] Avg episode reward: [(0, '4741.015')] [2023-03-08 11:57:44,746][389688] Updated weights for policy 0, policy_version 119840 (0.0005) [2023-03-08 11:57:48,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12151.5, 300 sec: 12010.3). Total num frames: 61394944. Throughput: 0: 12058.9. Samples: 61368636. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:57:48,080][389401] Avg episode reward: [(0, '4738.527')] [2023-03-08 11:57:48,254][389688] Updated weights for policy 0, policy_version 119920 (0.0005) [2023-03-08 11:57:51,760][389688] Updated weights for policy 0, policy_version 120000 (0.0005) [2023-03-08 11:57:53,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11996.4). Total num frames: 61452288. Throughput: 0: 11998.5. Samples: 61439324. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:57:53,080][389401] Avg episode reward: [(0, '4735.155')] [2023-03-08 11:57:53,139][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000120032_61456384.pth... [2023-03-08 11:57:53,140][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000119328_61095936.pth [2023-03-08 11:57:55,184][389688] Updated weights for policy 0, policy_version 120080 (0.0005) [2023-03-08 11:57:58,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11982.5). Total num frames: 61509632. Throughput: 0: 11924.6. Samples: 61509632. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:57:58,080][389401] Avg episode reward: [(0, '4737.167')] [2023-03-08 11:57:58,790][389688] Updated weights for policy 0, policy_version 120160 (0.0005) [2023-03-08 11:58:02,338][389688] Updated weights for policy 0, policy_version 120240 (0.0005) [2023-03-08 11:58:03,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11982.5). Total num frames: 61571072. Throughput: 0: 11856.3. Samples: 61543388. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:58:03,080][389401] Avg episode reward: [(0, '4733.941')] [2023-03-08 11:58:05,903][389688] Updated weights for policy 0, policy_version 120320 (0.0006) [2023-03-08 11:58:08,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 11968.7). Total num frames: 61628416. Throughput: 0: 11802.7. Samples: 61612224. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:58:08,080][389401] Avg episode reward: [(0, '4734.895')] [2023-03-08 11:58:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000120368_61628416.pth... [2023-03-08 11:58:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000119688_61280256.pth [2023-03-08 11:58:09,422][389688] Updated weights for policy 0, policy_version 120400 (0.0005) [2023-03-08 11:58:12,903][389688] Updated weights for policy 0, policy_version 120480 (0.0005) [2023-03-08 11:58:13,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 11968.7). Total num frames: 61685760. Throughput: 0: 11669.7. Samples: 61682520. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:58:13,080][389401] Avg episode reward: [(0, '4739.121')] [2023-03-08 11:58:16,372][389688] Updated weights for policy 0, policy_version 120560 (0.0005) [2023-03-08 11:58:18,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11810.2, 300 sec: 11968.7). Total num frames: 61743104. Throughput: 0: 11672.5. Samples: 61718528. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:58:18,080][389401] Avg episode reward: [(0, '4737.340')] [2023-03-08 11:58:19,870][389688] Updated weights for policy 0, policy_version 120640 (0.0005) [2023-03-08 11:58:23,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11982.5). Total num frames: 61804544. Throughput: 0: 11652.2. Samples: 61788232. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:58:23,080][389401] Avg episode reward: [(0, '4740.456')] [2023-03-08 11:58:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000120712_61804544.pth... [2023-03-08 11:58:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000120032_61456384.pth [2023-03-08 11:58:23,371][389688] Updated weights for policy 0, policy_version 120720 (0.0005) [2023-03-08 11:58:26,906][389688] Updated weights for policy 0, policy_version 120800 (0.0005) [2023-03-08 11:58:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11982.5). Total num frames: 61861888. Throughput: 0: 11657.3. Samples: 61858088. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:58:28,080][389401] Avg episode reward: [(0, '4741.078')] [2023-03-08 11:58:30,358][389688] Updated weights for policy 0, policy_version 120880 (0.0005) [2023-03-08 11:58:33,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11968.7). Total num frames: 61919232. Throughput: 0: 11689.3. Samples: 61894656. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:58:33,080][389401] Avg episode reward: [(0, '4727.180')] [2023-03-08 11:58:33,783][389688] Updated weights for policy 0, policy_version 120960 (0.0005) [2023-03-08 11:58:37,268][389688] Updated weights for policy 0, policy_version 121040 (0.0005) [2023-03-08 11:58:38,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11741.9, 300 sec: 11968.6). Total num frames: 61980672. Throughput: 0: 11669.4. Samples: 61964448. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:58:38,080][389401] Avg episode reward: [(0, '4728.099')] [2023-03-08 11:58:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000121056_61980672.pth... [2023-03-08 11:58:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000120368_61628416.pth [2023-03-08 11:58:40,783][389688] Updated weights for policy 0, policy_version 121120 (0.0005) [2023-03-08 11:58:43,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11954.8). Total num frames: 62038016. Throughput: 0: 11683.5. Samples: 62035392. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:58:43,080][389401] Avg episode reward: [(0, '4740.340')] [2023-03-08 11:58:44,291][389688] Updated weights for policy 0, policy_version 121200 (0.0005) [2023-03-08 11:58:47,872][389688] Updated weights for policy 0, policy_version 121280 (0.0005) [2023-03-08 11:58:48,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11954.8). Total num frames: 62095360. Throughput: 0: 11714.2. Samples: 62070528. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:58:48,080][389401] Avg episode reward: [(0, '4742.362')] [2023-03-08 11:58:51,461][389688] Updated weights for policy 0, policy_version 121360 (0.0005) [2023-03-08 11:58:53,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 11927.0). Total num frames: 62152704. Throughput: 0: 11703.5. Samples: 62138880. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:58:53,080][389401] Avg episode reward: [(0, '4739.961')] [2023-03-08 11:58:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000121392_62152704.pth... [2023-03-08 11:58:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000120712_61804544.pth [2023-03-08 11:58:54,951][389688] Updated weights for policy 0, policy_version 121440 (0.0005) [2023-03-08 11:58:58,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 11927.0). Total num frames: 62210048. Throughput: 0: 11678.6. Samples: 62208056. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:58:58,080][389401] Avg episode reward: [(0, '4739.057')] [2023-03-08 11:58:58,508][389688] Updated weights for policy 0, policy_version 121520 (0.0005) [2023-03-08 11:59:02,127][389688] Updated weights for policy 0, policy_version 121600 (0.0005) [2023-03-08 11:59:03,079][389401] Fps is (10 sec: 11469.0, 60 sec: 11605.4, 300 sec: 11927.0). Total num frames: 62267392. Throughput: 0: 11650.8. Samples: 62242816. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:59:03,080][389401] Avg episode reward: [(0, '4740.494')] [2023-03-08 11:59:05,588][389688] Updated weights for policy 0, policy_version 121680 (0.0005) [2023-03-08 11:59:08,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11940.9). Total num frames: 62328832. Throughput: 0: 11650.9. Samples: 62312524. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 11:59:08,080][389401] Avg episode reward: [(0, '4737.449')] [2023-03-08 11:59:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000121736_62328832.pth... [2023-03-08 11:59:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000121056_61980672.pth [2023-03-08 11:59:09,010][389688] Updated weights for policy 0, policy_version 121760 (0.0005) [2023-03-08 11:59:12,461][389688] Updated weights for policy 0, policy_version 121840 (0.0005) [2023-03-08 11:59:13,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11927.0). Total num frames: 62386176. Throughput: 0: 11698.0. Samples: 62384500. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:59:13,090][389401] Avg episode reward: [(0, '4440.223')] [2023-03-08 11:59:15,890][389688] Updated weights for policy 0, policy_version 121920 (0.0005) [2023-03-08 11:59:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11741.8, 300 sec: 11927.0). Total num frames: 62447616. Throughput: 0: 11678.6. Samples: 62420192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:59:18,090][389401] Avg episode reward: [(0, '4665.810')] [2023-03-08 11:59:19,411][389688] Updated weights for policy 0, policy_version 122000 (0.0005) [2023-03-08 11:59:22,707][389688] Updated weights for policy 0, policy_version 122080 (0.0005) [2023-03-08 11:59:23,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11927.0). Total num frames: 62509056. Throughput: 0: 11709.9. Samples: 62491392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:59:23,080][389401] Avg episode reward: [(0, '4741.094')] [2023-03-08 11:59:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000122088_62509056.pth... [2023-03-08 11:59:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000121392_62152704.pth [2023-03-08 11:59:25,818][389688] Updated weights for policy 0, policy_version 122160 (0.0004) [2023-03-08 11:59:28,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11810.1, 300 sec: 11927.0). Total num frames: 62570496. Throughput: 0: 11840.5. Samples: 62568216. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:59:28,080][389401] Avg episode reward: [(0, '4741.052')] [2023-03-08 11:59:29,173][389688] Updated weights for policy 0, policy_version 122240 (0.0005) [2023-03-08 11:59:32,749][389688] Updated weights for policy 0, policy_version 122320 (0.0005) [2023-03-08 11:59:33,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11913.1). Total num frames: 62627840. Throughput: 0: 11845.0. Samples: 62603552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:59:33,080][389401] Avg episode reward: [(0, '4740.351')] [2023-03-08 11:59:36,392][389688] Updated weights for policy 0, policy_version 122400 (0.0005) [2023-03-08 11:59:38,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11741.9, 300 sec: 11899.2). Total num frames: 62685184. Throughput: 0: 11848.0. Samples: 62672040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:59:38,080][389401] Avg episode reward: [(0, '4738.926')] [2023-03-08 11:59:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000122432_62685184.pth... [2023-03-08 11:59:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000121736_62328832.pth [2023-03-08 11:59:39,948][389688] Updated weights for policy 0, policy_version 122480 (0.0005) [2023-03-08 11:59:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11913.1). Total num frames: 62742528. Throughput: 0: 11820.7. Samples: 62739988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:59:43,080][389401] Avg episode reward: [(0, '4654.639')] [2023-03-08 11:59:43,609][389688] Updated weights for policy 0, policy_version 122560 (0.0005) [2023-03-08 11:59:47,020][389688] Updated weights for policy 0, policy_version 122640 (0.0004) [2023-03-08 11:59:48,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11810.1, 300 sec: 11899.2). Total num frames: 62803968. Throughput: 0: 11834.5. Samples: 62775368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:59:48,080][389401] Avg episode reward: [(0, '4725.041')] [2023-03-08 11:59:50,322][389688] Updated weights for policy 0, policy_version 122720 (0.0005) [2023-03-08 11:59:53,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11899.2). Total num frames: 62865408. Throughput: 0: 11923.6. Samples: 62849088. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:59:53,080][389401] Avg episode reward: [(0, '4711.945')] [2023-03-08 11:59:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000122784_62865408.pth... [2023-03-08 11:59:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000122088_62509056.pth [2023-03-08 11:59:53,768][389688] Updated weights for policy 0, policy_version 122800 (0.0005) [2023-03-08 11:59:57,088][389688] Updated weights for policy 0, policy_version 122880 (0.0004) [2023-03-08 11:59:58,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11913.1). Total num frames: 62926848. Throughput: 0: 11937.8. Samples: 62921700. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 11:59:58,080][389401] Avg episode reward: [(0, '4718.158')] [2023-03-08 12:00:00,376][389688] Updated weights for policy 0, policy_version 122960 (0.0004) [2023-03-08 12:00:03,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11913.1). Total num frames: 62988288. Throughput: 0: 11985.9. Samples: 62959560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:00:03,080][389401] Avg episode reward: [(0, '4711.396')] [2023-03-08 12:00:03,641][389688] Updated weights for policy 0, policy_version 123040 (0.0005) [2023-03-08 12:00:07,148][389688] Updated weights for policy 0, policy_version 123120 (0.0005) [2023-03-08 12:00:08,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11913.1). Total num frames: 63045632. Throughput: 0: 12004.7. Samples: 63031604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:00:08,080][389401] Avg episode reward: [(0, '4738.564')] [2023-03-08 12:00:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000123136_63045632.pth... [2023-03-08 12:00:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000122432_62685184.pth [2023-03-08 12:00:10,675][389688] Updated weights for policy 0, policy_version 123200 (0.0005) [2023-03-08 12:00:13,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11913.1). Total num frames: 63102976. Throughput: 0: 11853.8. Samples: 63101636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:00:13,080][389401] Avg episode reward: [(0, '4739.957')] [2023-03-08 12:00:14,144][389688] Updated weights for policy 0, policy_version 123280 (0.0005) [2023-03-08 12:00:17,773][389688] Updated weights for policy 0, policy_version 123360 (0.0005) [2023-03-08 12:00:18,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11913.1). Total num frames: 63160320. Throughput: 0: 11834.2. Samples: 63136092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:00:18,080][389401] Avg episode reward: [(0, '4738.314')] [2023-03-08 12:00:21,128][389688] Updated weights for policy 0, policy_version 123440 (0.0004) [2023-03-08 12:00:23,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 11913.1). Total num frames: 63221760. Throughput: 0: 11912.8. Samples: 63208116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:00:23,080][389401] Avg episode reward: [(0, '4736.549')] [2023-03-08 12:00:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000123480_63221760.pth... [2023-03-08 12:00:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000122784_62865408.pth [2023-03-08 12:00:24,675][389688] Updated weights for policy 0, policy_version 123520 (0.0005) [2023-03-08 12:00:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11899.2). Total num frames: 63279104. Throughput: 0: 11897.2. Samples: 63275360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:00:28,080][389401] Avg episode reward: [(0, '4736.728')] [2023-03-08 12:00:28,323][389688] Updated weights for policy 0, policy_version 123600 (0.0005) [2023-03-08 12:00:31,930][389688] Updated weights for policy 0, policy_version 123680 (0.0005) [2023-03-08 12:00:33,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11885.3). Total num frames: 63336448. Throughput: 0: 11893.2. Samples: 63310564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:00:33,080][389401] Avg episode reward: [(0, '4737.446')] [2023-03-08 12:00:35,187][389688] Updated weights for policy 0, policy_version 123760 (0.0004) [2023-03-08 12:00:38,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11878.4, 300 sec: 11871.5). Total num frames: 63397888. Throughput: 0: 11832.9. Samples: 63381568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:00:38,080][389401] Avg episode reward: [(0, '4727.203')] [2023-03-08 12:00:38,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000123824_63397888.pth... [2023-03-08 12:00:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000123136_63045632.pth [2023-03-08 12:00:38,629][389688] Updated weights for policy 0, policy_version 123840 (0.0004) [2023-03-08 12:00:41,904][389688] Updated weights for policy 0, policy_version 123920 (0.0004) [2023-03-08 12:00:43,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11885.3). Total num frames: 63459328. Throughput: 0: 11883.4. Samples: 63456452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:00:43,080][389401] Avg episode reward: [(0, '4720.851')] [2023-03-08 12:00:45,155][389688] Updated weights for policy 0, policy_version 124000 (0.0004) [2023-03-08 12:00:48,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11899.2). Total num frames: 63524864. Throughput: 0: 11878.8. Samples: 63494104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:00:48,080][389401] Avg episode reward: [(0, '4719.691')] [2023-03-08 12:00:48,424][389688] Updated weights for policy 0, policy_version 124080 (0.0004) [2023-03-08 12:00:51,744][389688] Updated weights for policy 0, policy_version 124160 (0.0004) [2023-03-08 12:00:53,079][389401] Fps is (10 sec: 12287.8, 60 sec: 11946.7, 300 sec: 11885.3). Total num frames: 63582208. Throughput: 0: 11949.7. Samples: 63569340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:00:53,080][389401] Avg episode reward: [(0, '4642.965')] [2023-03-08 12:00:53,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000124184_63582208.pth... [2023-03-08 12:00:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000123480_63221760.pth [2023-03-08 12:00:55,401][389688] Updated weights for policy 0, policy_version 124240 (0.0006) [2023-03-08 12:00:58,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11878.4, 300 sec: 11885.3). Total num frames: 63639552. Throughput: 0: 11902.9. Samples: 63637268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:00:58,080][389401] Avg episode reward: [(0, '4649.194')] [2023-03-08 12:00:58,977][389688] Updated weights for policy 0, policy_version 124320 (0.0005) [2023-03-08 12:01:02,462][389688] Updated weights for policy 0, policy_version 124400 (0.0005) [2023-03-08 12:01:03,079][389401] Fps is (10 sec: 11469.0, 60 sec: 11810.2, 300 sec: 11871.5). Total num frames: 63696896. Throughput: 0: 11895.8. Samples: 63671404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:01:03,080][389401] Avg episode reward: [(0, '4684.441')] [2023-03-08 12:01:06,093][389688] Updated weights for policy 0, policy_version 124480 (0.0006) [2023-03-08 12:01:08,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 11871.5). Total num frames: 63754240. Throughput: 0: 11836.1. Samples: 63740740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:01:08,080][389401] Avg episode reward: [(0, '4532.362')] [2023-03-08 12:01:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000124520_63754240.pth... [2023-03-08 12:01:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000123824_63397888.pth [2023-03-08 12:01:09,645][389688] Updated weights for policy 0, policy_version 124560 (0.0005) [2023-03-08 12:01:13,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 11871.5). Total num frames: 63811584. Throughput: 0: 11854.8. Samples: 63808828. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:01:13,080][389401] Avg episode reward: [(0, '4712.954')] [2023-03-08 12:01:13,287][389688] Updated weights for policy 0, policy_version 124640 (0.0005) [2023-03-08 12:01:16,824][389688] Updated weights for policy 0, policy_version 124720 (0.0005) [2023-03-08 12:01:18,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 11871.5). Total num frames: 63868928. Throughput: 0: 11851.2. Samples: 63843868. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:01:18,080][389401] Avg episode reward: [(0, '4641.173')] [2023-03-08 12:01:20,374][389688] Updated weights for policy 0, policy_version 124800 (0.0006) [2023-03-08 12:01:23,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 11857.6). Total num frames: 63926272. Throughput: 0: 11788.1. Samples: 63912032. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:01:23,080][389401] Avg episode reward: [(0, '4737.216')] [2023-03-08 12:01:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000124856_63926272.pth... [2023-03-08 12:01:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000124184_63582208.pth [2023-03-08 12:01:24,023][389688] Updated weights for policy 0, policy_version 124880 (0.0005) [2023-03-08 12:01:27,601][389688] Updated weights for policy 0, policy_version 124960 (0.0005) [2023-03-08 12:01:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11857.6). Total num frames: 63983616. Throughput: 0: 11629.7. Samples: 63979788. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:01:28,080][389401] Avg episode reward: [(0, '4735.964')] [2023-03-08 12:01:31,064][389688] Updated weights for policy 0, policy_version 125040 (0.0005) [2023-03-08 12:01:33,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 11843.7). Total num frames: 64040960. Throughput: 0: 11606.4. Samples: 64016392. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:01:33,080][389401] Avg episode reward: [(0, '4725.722')] [2023-03-08 12:01:34,548][389688] Updated weights for policy 0, policy_version 125120 (0.0005) [2023-03-08 12:01:38,056][389688] Updated weights for policy 0, policy_version 125200 (0.0005) [2023-03-08 12:01:38,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11857.6). Total num frames: 64102400. Throughput: 0: 11480.0. Samples: 64085940. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:01:38,080][389401] Avg episode reward: [(0, '4661.525')] [2023-03-08 12:01:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000125200_64102400.pth... [2023-03-08 12:01:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000124520_63754240.pth [2023-03-08 12:01:41,719][389688] Updated weights for policy 0, policy_version 125280 (0.0006) [2023-03-08 12:01:43,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11829.8). Total num frames: 64155648. Throughput: 0: 11487.2. Samples: 64154192. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:01:43,080][389401] Avg episode reward: [(0, '4656.902')] [2023-03-08 12:01:45,142][389688] Updated weights for policy 0, policy_version 125360 (0.0005) [2023-03-08 12:01:48,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11815.9). Total num frames: 64217088. Throughput: 0: 11546.1. Samples: 64190980. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:01:48,080][389401] Avg episode reward: [(0, '4735.181')] [2023-03-08 12:01:48,416][389688] Updated weights for policy 0, policy_version 125440 (0.0004) [2023-03-08 12:01:51,921][389688] Updated weights for policy 0, policy_version 125520 (0.0005) [2023-03-08 12:01:53,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11605.3, 300 sec: 11815.9). Total num frames: 64278528. Throughput: 0: 11599.8. Samples: 64262732. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:01:53,080][389401] Avg episode reward: [(0, '4681.146')] [2023-03-08 12:01:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000125544_64278528.pth... [2023-03-08 12:01:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000124856_63926272.pth [2023-03-08 12:01:55,382][389688] Updated weights for policy 0, policy_version 125600 (0.0005) [2023-03-08 12:01:58,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11802.0). Total num frames: 64335872. Throughput: 0: 11667.6. Samples: 64333868. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:01:58,080][389401] Avg episode reward: [(0, '4736.911')] [2023-03-08 12:01:58,836][389688] Updated weights for policy 0, policy_version 125680 (0.0005) [2023-03-08 12:02:02,260][389688] Updated weights for policy 0, policy_version 125760 (0.0004) [2023-03-08 12:02:03,079][389401] Fps is (10 sec: 11878.6, 60 sec: 11673.6, 300 sec: 11802.0). Total num frames: 64397312. Throughput: 0: 11700.5. Samples: 64370388. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:02:03,080][389401] Avg episode reward: [(0, '4730.789')] [2023-03-08 12:02:05,660][389688] Updated weights for policy 0, policy_version 125840 (0.0005) [2023-03-08 12:02:08,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11802.0). Total num frames: 64458752. Throughput: 0: 11782.7. Samples: 64442256. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:02:08,080][389401] Avg episode reward: [(0, '4738.659')] [2023-03-08 12:02:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000125896_64458752.pth... [2023-03-08 12:02:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000125200_64102400.pth [2023-03-08 12:02:09,044][389688] Updated weights for policy 0, policy_version 125920 (0.0005) [2023-03-08 12:02:12,580][389688] Updated weights for policy 0, policy_version 126000 (0.0005) [2023-03-08 12:02:13,079][389401] Fps is (10 sec: 11878.2, 60 sec: 11741.9, 300 sec: 11802.0). Total num frames: 64516096. Throughput: 0: 11840.4. Samples: 64512608. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:02:13,080][389401] Avg episode reward: [(0, '4740.013')] [2023-03-08 12:02:16,186][389688] Updated weights for policy 0, policy_version 126080 (0.0005) [2023-03-08 12:02:18,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11788.1). Total num frames: 64573440. Throughput: 0: 11794.0. Samples: 64547124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:02:18,080][389401] Avg episode reward: [(0, '4701.956')] [2023-03-08 12:02:19,901][389688] Updated weights for policy 0, policy_version 126160 (0.0005) [2023-03-08 12:02:23,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11673.6, 300 sec: 11746.5). Total num frames: 64626688. Throughput: 0: 11726.6. Samples: 64613636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:02:23,080][389401] Avg episode reward: [(0, '4626.684')] [2023-03-08 12:02:23,129][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000126232_64630784.pth... [2023-03-08 12:02:23,131][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000125544_64278528.pth [2023-03-08 12:02:23,473][389688] Updated weights for policy 0, policy_version 126240 (0.0004) [2023-03-08 12:02:27,070][389688] Updated weights for policy 0, policy_version 126320 (0.0005) [2023-03-08 12:02:28,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11673.6, 300 sec: 11732.6). Total num frames: 64684032. Throughput: 0: 11752.0. Samples: 64683032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:02:28,080][389401] Avg episode reward: [(0, '4738.717')] [2023-03-08 12:02:30,673][389688] Updated weights for policy 0, policy_version 126400 (0.0005) [2023-03-08 12:02:33,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11741.9, 300 sec: 11760.4). Total num frames: 64745472. Throughput: 0: 11685.1. Samples: 64716808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:02:33,080][389401] Avg episode reward: [(0, '4740.966')] [2023-03-08 12:02:34,135][389688] Updated weights for policy 0, policy_version 126480 (0.0004) [2023-03-08 12:02:37,561][389688] Updated weights for policy 0, policy_version 126560 (0.0004) [2023-03-08 12:02:38,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11746.5). Total num frames: 64802816. Throughput: 0: 11644.0. Samples: 64786712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:02:38,080][389401] Avg episode reward: [(0, '4740.358')] [2023-03-08 12:02:38,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000126568_64802816.pth... [2023-03-08 12:02:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000125896_64458752.pth [2023-03-08 12:02:40,976][389688] Updated weights for policy 0, policy_version 126640 (0.0004) [2023-03-08 12:02:43,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11741.9, 300 sec: 11746.5). Total num frames: 64860160. Throughput: 0: 11652.4. Samples: 64858224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:02:43,080][389401] Avg episode reward: [(0, '4741.062')] [2023-03-08 12:02:44,795][389688] Updated weights for policy 0, policy_version 126720 (0.0005) [2023-03-08 12:02:48,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11605.3, 300 sec: 11732.6). Total num frames: 64913408. Throughput: 0: 11548.1. Samples: 64890052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:02:48,080][389401] Avg episode reward: [(0, '4702.766')] [2023-03-08 12:02:48,455][389688] Updated weights for policy 0, policy_version 126800 (0.0005) [2023-03-08 12:02:51,949][389688] Updated weights for policy 0, policy_version 126880 (0.0004) [2023-03-08 12:02:53,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11746.5). Total num frames: 64974848. Throughput: 0: 11485.6. Samples: 64959108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:02:53,090][389401] Avg episode reward: [(0, '4716.172')] [2023-03-08 12:02:53,093][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000126904_64974848.pth... [2023-03-08 12:02:53,096][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000126232_64630784.pth [2023-03-08 12:02:55,545][389688] Updated weights for policy 0, policy_version 126960 (0.0004) [2023-03-08 12:02:58,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11718.7). Total num frames: 65028096. Throughput: 0: 11409.8. Samples: 65026048. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:02:58,080][389401] Avg episode reward: [(0, '4644.498')] [2023-03-08 12:02:59,383][389688] Updated weights for policy 0, policy_version 127040 (0.0005) [2023-03-08 12:03:03,079][389401] Fps is (10 sec: 10649.6, 60 sec: 11400.5, 300 sec: 11704.8). Total num frames: 65081344. Throughput: 0: 11361.4. Samples: 65058388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:03:03,080][389401] Avg episode reward: [(0, '4490.090')] [2023-03-08 12:03:03,140][389688] Updated weights for policy 0, policy_version 127120 (0.0005) [2023-03-08 12:03:06,956][389688] Updated weights for policy 0, policy_version 127200 (0.0005) [2023-03-08 12:03:08,079][389401] Fps is (10 sec: 10649.6, 60 sec: 11264.0, 300 sec: 11691.0). Total num frames: 65134592. Throughput: 0: 11318.0. Samples: 65122948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:03:08,080][389401] Avg episode reward: [(0, '4520.152')] [2023-03-08 12:03:08,124][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000127224_65138688.pth... [2023-03-08 12:03:08,126][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000126568_64802816.pth [2023-03-08 12:03:10,687][389688] Updated weights for policy 0, policy_version 127280 (0.0005) [2023-03-08 12:03:13,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11264.0, 300 sec: 11691.0). Total num frames: 65191936. Throughput: 0: 11227.7. Samples: 65188280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:03:13,080][389401] Avg episode reward: [(0, '4508.016')] [2023-03-08 12:03:14,418][389688] Updated weights for policy 0, policy_version 127360 (0.0005) [2023-03-08 12:03:18,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11663.2). Total num frames: 65245184. Throughput: 0: 11244.0. Samples: 65222788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:03:18,080][389401] Avg episode reward: [(0, '4482.582')] [2023-03-08 12:03:18,164][389688] Updated weights for policy 0, policy_version 127440 (0.0005) [2023-03-08 12:03:21,720][389688] Updated weights for policy 0, policy_version 127520 (0.0004) [2023-03-08 12:03:23,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11264.0, 300 sec: 11663.2). Total num frames: 65302528. Throughput: 0: 11170.9. Samples: 65289404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:03:23,080][389401] Avg episode reward: [(0, '4600.291')] [2023-03-08 12:03:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000127544_65302528.pth... [2023-03-08 12:03:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000126904_64974848.pth [2023-03-08 12:03:25,392][389688] Updated weights for policy 0, policy_version 127600 (0.0005) [2023-03-08 12:03:28,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11264.0, 300 sec: 11663.2). Total num frames: 65359872. Throughput: 0: 11061.8. Samples: 65356004. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:03:28,080][389401] Avg episode reward: [(0, '4586.775')] [2023-03-08 12:03:29,020][389688] Updated weights for policy 0, policy_version 127680 (0.0004) [2023-03-08 12:03:32,571][389688] Updated weights for policy 0, policy_version 127760 (0.0004) [2023-03-08 12:03:33,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11195.7, 300 sec: 11649.3). Total num frames: 65417216. Throughput: 0: 11121.8. Samples: 65390532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:03:33,080][389401] Avg episode reward: [(0, '4728.157')] [2023-03-08 12:03:36,115][389688] Updated weights for policy 0, policy_version 127840 (0.0004) [2023-03-08 12:03:38,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11195.7, 300 sec: 11649.3). Total num frames: 65474560. Throughput: 0: 11128.1. Samples: 65459872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:03:38,080][389401] Avg episode reward: [(0, '4599.607')] [2023-03-08 12:03:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000127880_65474560.pth... [2023-03-08 12:03:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000127224_65138688.pth [2023-03-08 12:03:39,621][389688] Updated weights for policy 0, policy_version 127920 (0.0004) [2023-03-08 12:03:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 11649.3). Total num frames: 65531904. Throughput: 0: 11223.7. Samples: 65531116. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:03:43,080][389401] Avg episode reward: [(0, '4707.315')] [2023-03-08 12:03:43,122][389688] Updated weights for policy 0, policy_version 128000 (0.0005) [2023-03-08 12:03:46,675][389688] Updated weights for policy 0, policy_version 128080 (0.0005) [2023-03-08 12:03:48,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11264.0, 300 sec: 11649.3). Total num frames: 65589248. Throughput: 0: 11264.4. Samples: 65565284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:03:48,080][389401] Avg episode reward: [(0, '4726.392')] [2023-03-08 12:03:50,209][389688] Updated weights for policy 0, policy_version 128160 (0.0005) [2023-03-08 12:03:53,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11195.7, 300 sec: 11649.3). Total num frames: 65646592. Throughput: 0: 11363.6. Samples: 65634312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:03:53,080][389401] Avg episode reward: [(0, '4740.869')] [2023-03-08 12:03:53,115][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000128224_65650688.pth... [2023-03-08 12:03:53,116][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000127544_65302528.pth [2023-03-08 12:03:53,857][389688] Updated weights for policy 0, policy_version 128240 (0.0005) [2023-03-08 12:03:57,515][389688] Updated weights for policy 0, policy_version 128320 (0.0004) [2023-03-08 12:03:58,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11264.0, 300 sec: 11649.3). Total num frames: 65703936. Throughput: 0: 11405.3. Samples: 65701516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:03:58,080][389401] Avg episode reward: [(0, '4739.665')] [2023-03-08 12:04:00,972][389688] Updated weights for policy 0, policy_version 128400 (0.0004) [2023-03-08 12:04:03,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11400.5, 300 sec: 11649.3). Total num frames: 65765376. Throughput: 0: 11425.5. Samples: 65736936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:04:03,080][389401] Avg episode reward: [(0, '4740.689')] [2023-03-08 12:04:04,444][389688] Updated weights for policy 0, policy_version 128480 (0.0005) [2023-03-08 12:04:07,965][389688] Updated weights for policy 0, policy_version 128560 (0.0004) [2023-03-08 12:04:08,079][389401] Fps is (10 sec: 11878.2, 60 sec: 11468.8, 300 sec: 11649.3). Total num frames: 65822720. Throughput: 0: 11500.4. Samples: 65806924. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:04:08,080][389401] Avg episode reward: [(0, '4738.903')] [2023-03-08 12:04:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000128560_65822720.pth... [2023-03-08 12:04:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000127880_65474560.pth [2023-03-08 12:04:11,561][389688] Updated weights for policy 0, policy_version 128640 (0.0005) [2023-03-08 12:04:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11635.4). Total num frames: 65880064. Throughput: 0: 11556.4. Samples: 65876040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:04:13,080][389401] Avg episode reward: [(0, '4739.639')] [2023-03-08 12:04:15,145][389688] Updated weights for policy 0, policy_version 128720 (0.0005) [2023-03-08 12:04:18,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11621.5). Total num frames: 65937408. Throughput: 0: 11569.9. Samples: 65911176. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:04:18,080][389401] Avg episode reward: [(0, '4736.948')] [2023-03-08 12:04:18,606][389688] Updated weights for policy 0, policy_version 128800 (0.0004) [2023-03-08 12:04:22,309][389688] Updated weights for policy 0, policy_version 128880 (0.0004) [2023-03-08 12:04:23,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11607.6). Total num frames: 65994752. Throughput: 0: 11545.9. Samples: 65979436. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:04:23,080][389401] Avg episode reward: [(0, '4694.837')] [2023-03-08 12:04:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000128896_65994752.pth... [2023-03-08 12:04:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000128224_65650688.pth [2023-03-08 12:04:26,041][389688] Updated weights for policy 0, policy_version 128960 (0.0004) [2023-03-08 12:04:28,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11468.8, 300 sec: 11593.8). Total num frames: 66048000. Throughput: 0: 11453.7. Samples: 66046532. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:04:28,080][389401] Avg episode reward: [(0, '4559.201')] [2023-03-08 12:04:29,641][389688] Updated weights for policy 0, policy_version 129040 (0.0005) [2023-03-08 12:04:33,079][389401] Fps is (10 sec: 10649.7, 60 sec: 11400.5, 300 sec: 11579.9). Total num frames: 66101248. Throughput: 0: 11432.5. Samples: 66079744. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:04:33,080][389401] Avg episode reward: [(0, '4397.678')] [2023-03-08 12:04:34,041][389688] Updated weights for policy 0, policy_version 129120 (0.0004) [2023-03-08 12:04:38,079][389401] Fps is (10 sec: 9420.7, 60 sec: 11127.5, 300 sec: 11524.3). Total num frames: 66142208. Throughput: 0: 11015.1. Samples: 66129992. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:04:38,080][389401] Avg episode reward: [(0, '4389.328')] [2023-03-08 12:04:38,086][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000129192_66146304.pth... [2023-03-08 12:04:38,088][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000128560_65822720.pth [2023-03-08 12:04:38,464][389688] Updated weights for policy 0, policy_version 129200 (0.0005) [2023-03-08 12:04:42,089][389688] Updated weights for policy 0, policy_version 129280 (0.0004) [2023-03-08 12:04:43,079][389401] Fps is (10 sec: 9830.4, 60 sec: 11127.5, 300 sec: 11510.5). Total num frames: 66199552. Throughput: 0: 11033.0. Samples: 66198000. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:04:43,080][389401] Avg episode reward: [(0, '4467.777')] [2023-03-08 12:04:45,595][389688] Updated weights for policy 0, policy_version 129360 (0.0005) [2023-03-08 12:04:48,079][389401] Fps is (10 sec: 11469.0, 60 sec: 11127.5, 300 sec: 11496.6). Total num frames: 66256896. Throughput: 0: 11016.6. Samples: 66232684. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:04:48,080][389401] Avg episode reward: [(0, '4663.933')] [2023-03-08 12:04:49,165][389688] Updated weights for policy 0, policy_version 129440 (0.0004) [2023-03-08 12:04:52,811][389688] Updated weights for policy 0, policy_version 129520 (0.0005) [2023-03-08 12:04:53,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11127.5, 300 sec: 11482.7). Total num frames: 66314240. Throughput: 0: 11002.1. Samples: 66302016. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:04:53,080][389401] Avg episode reward: [(0, '4673.465')] [2023-03-08 12:04:53,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000129520_66314240.pth... [2023-03-08 12:04:53,087][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000128896_65994752.pth [2023-03-08 12:04:56,664][389688] Updated weights for policy 0, policy_version 129600 (0.0004) [2023-03-08 12:04:58,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11059.2, 300 sec: 11454.9). Total num frames: 66367488. Throughput: 0: 10904.2. Samples: 66366728. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:04:58,090][389401] Avg episode reward: [(0, '4637.448')] [2023-03-08 12:05:00,326][389688] Updated weights for policy 0, policy_version 129680 (0.0004) [2023-03-08 12:05:03,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10990.9, 300 sec: 11454.9). Total num frames: 66424832. Throughput: 0: 10867.5. Samples: 66400212. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:05:03,090][389401] Avg episode reward: [(0, '4649.864')] [2023-03-08 12:05:04,059][389688] Updated weights for policy 0, policy_version 129760 (0.0005) [2023-03-08 12:05:07,795][389688] Updated weights for policy 0, policy_version 129840 (0.0006) [2023-03-08 12:05:08,079][389401] Fps is (10 sec: 11059.1, 60 sec: 10922.7, 300 sec: 11441.0). Total num frames: 66478080. Throughput: 0: 10807.4. Samples: 66465768. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:05:08,090][389401] Avg episode reward: [(0, '4577.480')] [2023-03-08 12:05:08,094][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000129840_66478080.pth... [2023-03-08 12:05:08,097][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000129192_66146304.pth [2023-03-08 12:05:11,476][389688] Updated weights for policy 0, policy_version 129920 (0.0004) [2023-03-08 12:05:13,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10922.7, 300 sec: 11441.0). Total num frames: 66535424. Throughput: 0: 10779.1. Samples: 66531592. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:05:13,090][389401] Avg episode reward: [(0, '4598.224')] [2023-03-08 12:05:15,084][389688] Updated weights for policy 0, policy_version 130000 (0.0005) [2023-03-08 12:05:18,079][389401] Fps is (10 sec: 11468.8, 60 sec: 10922.7, 300 sec: 11427.1). Total num frames: 66592768. Throughput: 0: 10836.0. Samples: 66567364. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:05:18,090][389401] Avg episode reward: [(0, '4560.071')] [2023-03-08 12:05:18,793][389688] Updated weights for policy 0, policy_version 130080 (0.0005) [2023-03-08 12:05:22,413][389688] Updated weights for policy 0, policy_version 130160 (0.0004) [2023-03-08 12:05:23,079][389401] Fps is (10 sec: 11059.2, 60 sec: 10854.4, 300 sec: 11413.3). Total num frames: 66646016. Throughput: 0: 11187.3. Samples: 66633420. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:05:23,080][389401] Avg episode reward: [(0, '4461.832')] [2023-03-08 12:05:23,144][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000130176_66650112.pth... [2023-03-08 12:05:23,146][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000129520_66314240.pth [2023-03-08 12:05:26,155][389688] Updated weights for policy 0, policy_version 130240 (0.0005) [2023-03-08 12:05:28,079][389401] Fps is (10 sec: 11059.3, 60 sec: 10922.7, 300 sec: 11413.3). Total num frames: 66703360. Throughput: 0: 11139.2. Samples: 66699264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:05:28,080][389401] Avg episode reward: [(0, '4410.061')] [2023-03-08 12:05:29,832][389688] Updated weights for policy 0, policy_version 130320 (0.0005) [2023-03-08 12:05:33,079][389401] Fps is (10 sec: 11468.8, 60 sec: 10990.9, 300 sec: 11399.4). Total num frames: 66760704. Throughput: 0: 11132.2. Samples: 66733632. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:05:33,080][389401] Avg episode reward: [(0, '4613.318')] [2023-03-08 12:05:33,347][389688] Updated weights for policy 0, policy_version 130400 (0.0005) [2023-03-08 12:05:36,951][389688] Updated weights for policy 0, policy_version 130480 (0.0005) [2023-03-08 12:05:38,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11385.5). Total num frames: 66818048. Throughput: 0: 11118.4. Samples: 66802344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:05:38,080][389401] Avg episode reward: [(0, '4715.794')] [2023-03-08 12:05:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000130504_66818048.pth... [2023-03-08 12:05:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000129840_66478080.pth [2023-03-08 12:05:40,467][389688] Updated weights for policy 0, policy_version 130560 (0.0005) [2023-03-08 12:05:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11357.7). Total num frames: 66875392. Throughput: 0: 11254.6. Samples: 66873188. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:05:43,080][389401] Avg episode reward: [(0, '4627.626')] [2023-03-08 12:05:43,833][389688] Updated weights for policy 0, policy_version 130640 (0.0003) [2023-03-08 12:05:47,286][389688] Updated weights for policy 0, policy_version 130720 (0.0004) [2023-03-08 12:05:48,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11332.3, 300 sec: 11371.6). Total num frames: 66936832. Throughput: 0: 11289.2. Samples: 66908224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:05:48,080][389401] Avg episode reward: [(0, '4565.722')] [2023-03-08 12:05:50,591][389688] Updated weights for policy 0, policy_version 130800 (0.0004) [2023-03-08 12:05:53,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11400.5, 300 sec: 11385.5). Total num frames: 66998272. Throughput: 0: 11470.8. Samples: 66981952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:05:53,080][389401] Avg episode reward: [(0, '4714.484')] [2023-03-08 12:05:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000130856_66998272.pth... [2023-03-08 12:05:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000130176_66650112.pth [2023-03-08 12:05:53,983][389688] Updated weights for policy 0, policy_version 130880 (0.0004) [2023-03-08 12:05:57,377][389688] Updated weights for policy 0, policy_version 130960 (0.0004) [2023-03-08 12:05:58,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11537.1, 300 sec: 11399.4). Total num frames: 67059712. Throughput: 0: 11637.5. Samples: 67055280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:05:58,080][389401] Avg episode reward: [(0, '4711.737')] [2023-03-08 12:06:00,818][389688] Updated weights for policy 0, policy_version 131040 (0.0005) [2023-03-08 12:06:03,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11537.1, 300 sec: 11399.4). Total num frames: 67117056. Throughput: 0: 11625.4. Samples: 67090508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:06:03,080][389401] Avg episode reward: [(0, '4725.296')] [2023-03-08 12:06:04,225][389688] Updated weights for policy 0, policy_version 131120 (0.0004) [2023-03-08 12:06:07,545][389688] Updated weights for policy 0, policy_version 131200 (0.0004) [2023-03-08 12:06:08,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11413.3). Total num frames: 67178496. Throughput: 0: 11787.7. Samples: 67163868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:06:08,080][389401] Avg episode reward: [(0, '4729.344')] [2023-03-08 12:06:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000131208_67178496.pth... [2023-03-08 12:06:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000130504_66818048.pth [2023-03-08 12:06:10,917][389688] Updated weights for policy 0, policy_version 131280 (0.0003) [2023-03-08 12:06:13,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11427.1). Total num frames: 67239936. Throughput: 0: 11944.1. Samples: 67236748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:06:13,080][389401] Avg episode reward: [(0, '4719.874')] [2023-03-08 12:06:14,283][389688] Updated weights for policy 0, policy_version 131360 (0.0004) [2023-03-08 12:06:17,791][389688] Updated weights for policy 0, policy_version 131440 (0.0005) [2023-03-08 12:06:18,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11741.9, 300 sec: 11427.1). Total num frames: 67297280. Throughput: 0: 11979.7. Samples: 67272716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:06:18,080][389401] Avg episode reward: [(0, '4728.758')] [2023-03-08 12:06:21,271][389688] Updated weights for policy 0, policy_version 131520 (0.0005) [2023-03-08 12:06:23,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 11441.0). Total num frames: 67358720. Throughput: 0: 12001.4. Samples: 67342408. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:06:23,080][389401] Avg episode reward: [(0, '4642.299')] [2023-03-08 12:06:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000131560_67358720.pth... [2023-03-08 12:06:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000130856_66998272.pth [2023-03-08 12:06:24,781][389688] Updated weights for policy 0, policy_version 131600 (0.0005) [2023-03-08 12:06:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11810.2, 300 sec: 11427.1). Total num frames: 67411968. Throughput: 0: 11940.7. Samples: 67410520. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:06:28,080][389401] Avg episode reward: [(0, '4676.396')] [2023-03-08 12:06:28,522][389688] Updated weights for policy 0, policy_version 131680 (0.0005) [2023-03-08 12:06:31,944][389688] Updated weights for policy 0, policy_version 131760 (0.0004) [2023-03-08 12:06:33,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11878.4, 300 sec: 11427.1). Total num frames: 67473408. Throughput: 0: 11926.4. Samples: 67444912. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:06:33,080][389401] Avg episode reward: [(0, '4713.072')] [2023-03-08 12:06:35,483][389688] Updated weights for policy 0, policy_version 131840 (0.0004) [2023-03-08 12:06:38,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11441.0). Total num frames: 67530752. Throughput: 0: 11851.0. Samples: 67515244. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:06:38,080][389401] Avg episode reward: [(0, '4685.591')] [2023-03-08 12:06:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000131896_67530752.pth... [2023-03-08 12:06:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000131208_67178496.pth [2023-03-08 12:06:38,938][389688] Updated weights for policy 0, policy_version 131920 (0.0004) [2023-03-08 12:06:42,397][389688] Updated weights for policy 0, policy_version 132000 (0.0005) [2023-03-08 12:06:43,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11878.4, 300 sec: 11427.1). Total num frames: 67588096. Throughput: 0: 11824.4. Samples: 67587376. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:06:43,080][389401] Avg episode reward: [(0, '4665.945')] [2023-03-08 12:06:45,965][389688] Updated weights for policy 0, policy_version 132080 (0.0005) [2023-03-08 12:06:48,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11427.2). Total num frames: 67649536. Throughput: 0: 11787.4. Samples: 67620940. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:06:48,080][389401] Avg episode reward: [(0, '4638.008')] [2023-03-08 12:06:49,586][389688] Updated weights for policy 0, policy_version 132160 (0.0005) [2023-03-08 12:06:53,079][389401] Fps is (10 sec: 11468.6, 60 sec: 11741.9, 300 sec: 11413.3). Total num frames: 67702784. Throughput: 0: 11689.7. Samples: 67689904. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:06:53,080][389401] Avg episode reward: [(0, '4461.204')] [2023-03-08 12:06:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000132232_67702784.pth... [2023-03-08 12:06:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000131560_67358720.pth [2023-03-08 12:06:53,160][389688] Updated weights for policy 0, policy_version 132240 (0.0005) [2023-03-08 12:06:56,977][389688] Updated weights for policy 0, policy_version 132320 (0.0004) [2023-03-08 12:06:58,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11673.6, 300 sec: 11399.4). Total num frames: 67760128. Throughput: 0: 11539.5. Samples: 67756024. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:06:58,080][389401] Avg episode reward: [(0, '4446.892')] [2023-03-08 12:07:00,542][389688] Updated weights for policy 0, policy_version 132400 (0.0005) [2023-03-08 12:07:03,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11605.3, 300 sec: 11371.6). Total num frames: 67813376. Throughput: 0: 11495.4. Samples: 67790012. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:07:03,080][389401] Avg episode reward: [(0, '4150.199')] [2023-03-08 12:07:04,196][389688] Updated weights for policy 0, policy_version 132480 (0.0005) [2023-03-08 12:07:08,031][389688] Updated weights for policy 0, policy_version 132560 (0.0005) [2023-03-08 12:07:08,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11371.6). Total num frames: 67870720. Throughput: 0: 11405.1. Samples: 67855636. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:07:08,080][389401] Avg episode reward: [(0, '4006.028')] [2023-03-08 12:07:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000132560_67870720.pth... [2023-03-08 12:07:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000131896_67530752.pth [2023-03-08 12:07:11,672][389688] Updated weights for policy 0, policy_version 132640 (0.0005) [2023-03-08 12:07:13,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11400.5, 300 sec: 11357.7). Total num frames: 67923968. Throughput: 0: 11393.7. Samples: 67923236. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:07:13,080][389401] Avg episode reward: [(0, '4384.293')] [2023-03-08 12:07:15,414][389688] Updated weights for policy 0, policy_version 132720 (0.0005) [2023-03-08 12:07:18,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11400.5, 300 sec: 11371.6). Total num frames: 67981312. Throughput: 0: 11351.4. Samples: 67955724. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:07:18,080][389401] Avg episode reward: [(0, '4668.705')] [2023-03-08 12:07:18,979][389688] Updated weights for policy 0, policy_version 132800 (0.0005) [2023-03-08 12:07:22,443][389688] Updated weights for policy 0, policy_version 132880 (0.0005) [2023-03-08 12:07:23,079][389401] Fps is (10 sec: 11468.6, 60 sec: 11332.3, 300 sec: 11371.6). Total num frames: 68038656. Throughput: 0: 11337.0. Samples: 68025412. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:07:23,080][389401] Avg episode reward: [(0, '4720.685')] [2023-03-08 12:07:23,146][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000132896_68042752.pth... [2023-03-08 12:07:23,148][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000132232_67702784.pth [2023-03-08 12:07:26,002][389688] Updated weights for policy 0, policy_version 132960 (0.0005) [2023-03-08 12:07:28,079][389401] Fps is (10 sec: 11878.2, 60 sec: 11468.8, 300 sec: 11371.6). Total num frames: 68100096. Throughput: 0: 11291.0. Samples: 68095472. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:07:28,080][389401] Avg episode reward: [(0, '4536.242')] [2023-03-08 12:07:29,561][389688] Updated weights for policy 0, policy_version 133040 (0.0005) [2023-03-08 12:07:33,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11332.3, 300 sec: 11357.7). Total num frames: 68153344. Throughput: 0: 11285.1. Samples: 68128768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:07:33,080][389401] Avg episode reward: [(0, '4682.048')] [2023-03-08 12:07:33,327][389688] Updated weights for policy 0, policy_version 133120 (0.0005) [2023-03-08 12:07:36,826][389688] Updated weights for policy 0, policy_version 133200 (0.0004) [2023-03-08 12:07:38,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11332.3, 300 sec: 11357.7). Total num frames: 68210688. Throughput: 0: 11258.4. Samples: 68196532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:07:38,080][389401] Avg episode reward: [(0, '4708.441')] [2023-03-08 12:07:38,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000133224_68210688.pth... [2023-03-08 12:07:38,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000132560_67870720.pth [2023-03-08 12:07:40,603][389688] Updated weights for policy 0, policy_version 133280 (0.0004) [2023-03-08 12:07:43,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11264.0, 300 sec: 11357.7). Total num frames: 68263936. Throughput: 0: 11247.2. Samples: 68262148. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:07:43,080][389401] Avg episode reward: [(0, '4694.016')] [2023-03-08 12:07:44,330][389688] Updated weights for policy 0, policy_version 133360 (0.0005) [2023-03-08 12:07:47,962][389688] Updated weights for policy 0, policy_version 133440 (0.0005) [2023-03-08 12:07:48,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11343.8). Total num frames: 68321280. Throughput: 0: 11234.0. Samples: 68295544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:07:48,080][389401] Avg episode reward: [(0, '4721.206')] [2023-03-08 12:07:51,770][389688] Updated weights for policy 0, policy_version 133520 (0.0005) [2023-03-08 12:07:53,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11195.7, 300 sec: 11343.8). Total num frames: 68374528. Throughput: 0: 11230.8. Samples: 68361024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:07:53,080][389401] Avg episode reward: [(0, '4726.691')] [2023-03-08 12:07:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000133544_68374528.pth... [2023-03-08 12:07:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000132896_68042752.pth [2023-03-08 12:07:55,383][389688] Updated weights for policy 0, policy_version 133600 (0.0005) [2023-03-08 12:07:58,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11357.7). Total num frames: 68431872. Throughput: 0: 11268.0. Samples: 68430296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:07:58,080][389401] Avg episode reward: [(0, '4726.205')] [2023-03-08 12:07:58,820][389688] Updated weights for policy 0, policy_version 133680 (0.0005) [2023-03-08 12:08:02,259][389688] Updated weights for policy 0, policy_version 133760 (0.0004) [2023-03-08 12:08:03,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11332.3, 300 sec: 11385.5). Total num frames: 68493312. Throughput: 0: 11328.4. Samples: 68465504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:08:03,080][389401] Avg episode reward: [(0, '4724.755')] [2023-03-08 12:08:05,705][389688] Updated weights for policy 0, policy_version 133840 (0.0004) [2023-03-08 12:08:08,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11332.3, 300 sec: 11385.5). Total num frames: 68550656. Throughput: 0: 11390.7. Samples: 68537992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:08:08,080][389401] Avg episode reward: [(0, '4587.611')] [2023-03-08 12:08:08,113][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000133896_68554752.pth... [2023-03-08 12:08:08,116][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000133224_68210688.pth [2023-03-08 12:08:09,228][389688] Updated weights for policy 0, policy_version 133920 (0.0004) [2023-03-08 12:08:12,942][389688] Updated weights for policy 0, policy_version 134000 (0.0006) [2023-03-08 12:08:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11399.4). Total num frames: 68608000. Throughput: 0: 11308.9. Samples: 68604372. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:08:13,080][389401] Avg episode reward: [(0, '4723.194')] [2023-03-08 12:08:16,525][389688] Updated weights for policy 0, policy_version 134080 (0.0005) [2023-03-08 12:08:18,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11399.4). Total num frames: 68665344. Throughput: 0: 11345.1. Samples: 68639296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:08:18,080][389401] Avg episode reward: [(0, '4594.077')] [2023-03-08 12:08:20,066][389688] Updated weights for policy 0, policy_version 134160 (0.0005) [2023-03-08 12:08:23,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11399.4). Total num frames: 68722688. Throughput: 0: 11381.2. Samples: 68708688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:08:23,080][389401] Avg episode reward: [(0, '4581.853')] [2023-03-08 12:08:23,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000134224_68722688.pth... [2023-03-08 12:08:23,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000133544_68374528.pth [2023-03-08 12:08:23,457][389688] Updated weights for policy 0, policy_version 134240 (0.0005) [2023-03-08 12:08:26,840][389688] Updated weights for policy 0, policy_version 134320 (0.0004) [2023-03-08 12:08:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11400.5, 300 sec: 11413.3). Total num frames: 68784128. Throughput: 0: 11545.8. Samples: 68781708. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:08:28,080][389401] Avg episode reward: [(0, '4685.860')] [2023-03-08 12:08:30,241][389688] Updated weights for policy 0, policy_version 134400 (0.0004) [2023-03-08 12:08:33,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11468.8, 300 sec: 11413.3). Total num frames: 68841472. Throughput: 0: 11587.2. Samples: 68816968. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:08:33,080][389401] Avg episode reward: [(0, '4725.050')] [2023-03-08 12:08:33,910][389688] Updated weights for policy 0, policy_version 134480 (0.0005) [2023-03-08 12:08:37,625][389688] Updated weights for policy 0, policy_version 134560 (0.0005) [2023-03-08 12:08:38,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11413.3). Total num frames: 68898816. Throughput: 0: 11630.1. Samples: 68884380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:08:38,080][389401] Avg episode reward: [(0, '4726.726')] [2023-03-08 12:08:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000134568_68898816.pth... [2023-03-08 12:08:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000133896_68554752.pth [2023-03-08 12:08:41,137][389688] Updated weights for policy 0, policy_version 134640 (0.0005) [2023-03-08 12:08:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11413.3). Total num frames: 68956160. Throughput: 0: 11614.8. Samples: 68952964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:08:43,080][389401] Avg episode reward: [(0, '4692.900')] [2023-03-08 12:08:44,560][389688] Updated weights for policy 0, policy_version 134720 (0.0005) [2023-03-08 12:08:48,072][389688] Updated weights for policy 0, policy_version 134800 (0.0005) [2023-03-08 12:08:48,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11427.1). Total num frames: 69017600. Throughput: 0: 11656.8. Samples: 68990060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:08:48,080][389401] Avg episode reward: [(0, '4454.742')] [2023-03-08 12:08:51,672][389688] Updated weights for policy 0, policy_version 134880 (0.0005) [2023-03-08 12:08:53,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11413.3). Total num frames: 69070848. Throughput: 0: 11568.4. Samples: 69058568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:08:53,080][389401] Avg episode reward: [(0, '4594.902')] [2023-03-08 12:08:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000134904_69070848.pth... [2023-03-08 12:08:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000134224_68722688.pth [2023-03-08 12:08:55,419][389688] Updated weights for policy 0, policy_version 134960 (0.0005) [2023-03-08 12:08:58,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11605.3, 300 sec: 11399.4). Total num frames: 69128192. Throughput: 0: 11614.7. Samples: 69127032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:08:58,080][389401] Avg episode reward: [(0, '4699.358')] [2023-03-08 12:08:58,891][389688] Updated weights for policy 0, policy_version 135040 (0.0006) [2023-03-08 12:09:02,594][389688] Updated weights for policy 0, policy_version 135120 (0.0005) [2023-03-08 12:09:03,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11399.4). Total num frames: 69185536. Throughput: 0: 11583.4. Samples: 69160548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:09:03,080][389401] Avg episode reward: [(0, '4737.738')] [2023-03-08 12:09:06,480][389688] Updated weights for policy 0, policy_version 135200 (0.0005) [2023-03-08 12:09:08,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11468.8, 300 sec: 11385.5). Total num frames: 69238784. Throughput: 0: 11459.5. Samples: 69224364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:09:08,080][389401] Avg episode reward: [(0, '4696.736')] [2023-03-08 12:09:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000135232_69238784.pth... [2023-03-08 12:09:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000134568_68898816.pth [2023-03-08 12:09:10,175][389688] Updated weights for policy 0, policy_version 135280 (0.0005) [2023-03-08 12:09:13,079][389401] Fps is (10 sec: 10649.7, 60 sec: 11400.6, 300 sec: 11371.6). Total num frames: 69292032. Throughput: 0: 11333.1. Samples: 69291696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:09:13,080][389401] Avg episode reward: [(0, '4660.225')] [2023-03-08 12:09:13,861][389688] Updated weights for policy 0, policy_version 135360 (0.0005) [2023-03-08 12:09:17,626][389688] Updated weights for policy 0, policy_version 135440 (0.0005) [2023-03-08 12:09:18,079][389401] Fps is (10 sec: 11059.4, 60 sec: 11400.5, 300 sec: 11371.6). Total num frames: 69349376. Throughput: 0: 11285.4. Samples: 69324808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:09:18,080][389401] Avg episode reward: [(0, '4662.919')] [2023-03-08 12:09:21,224][389688] Updated weights for policy 0, policy_version 135520 (0.0005) [2023-03-08 12:09:23,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11332.3, 300 sec: 11371.6). Total num frames: 69402624. Throughput: 0: 11258.9. Samples: 69391032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:09:23,080][389401] Avg episode reward: [(0, '4737.105')] [2023-03-08 12:09:23,107][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000135560_69406720.pth... [2023-03-08 12:09:23,109][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000134904_69070848.pth [2023-03-08 12:09:24,849][389688] Updated weights for policy 0, policy_version 135600 (0.0005) [2023-03-08 12:09:28,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11264.0, 300 sec: 11385.5). Total num frames: 69459968. Throughput: 0: 11250.4. Samples: 69459232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:09:28,080][389401] Avg episode reward: [(0, '4666.006')] [2023-03-08 12:09:28,523][389688] Updated weights for policy 0, policy_version 135680 (0.0005) [2023-03-08 12:09:32,103][389688] Updated weights for policy 0, policy_version 135760 (0.0004) [2023-03-08 12:09:33,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11264.0, 300 sec: 11441.0). Total num frames: 69517312. Throughput: 0: 11170.8. Samples: 69492744. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:09:33,080][389401] Avg episode reward: [(0, '4675.495')] [2023-03-08 12:09:35,536][389688] Updated weights for policy 0, policy_version 135840 (0.0004) [2023-03-08 12:09:38,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11332.3, 300 sec: 11454.9). Total num frames: 69578752. Throughput: 0: 11210.8. Samples: 69563056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:09:38,080][389401] Avg episode reward: [(0, '4662.097')] [2023-03-08 12:09:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000135896_69578752.pth... [2023-03-08 12:09:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000135232_69238784.pth [2023-03-08 12:09:39,110][389688] Updated weights for policy 0, policy_version 135920 (0.0004) [2023-03-08 12:09:42,783][389688] Updated weights for policy 0, policy_version 136000 (0.0005) [2023-03-08 12:09:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11441.0). Total num frames: 69632000. Throughput: 0: 11205.4. Samples: 69631276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:09:43,080][389401] Avg episode reward: [(0, '4699.928')] [2023-03-08 12:09:46,414][389688] Updated weights for policy 0, policy_version 136080 (0.0005) [2023-03-08 12:09:48,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11195.7, 300 sec: 11441.0). Total num frames: 69689344. Throughput: 0: 11206.3. Samples: 69664832. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:09:48,080][389401] Avg episode reward: [(0, '4734.773')] [2023-03-08 12:09:49,882][389688] Updated weights for policy 0, policy_version 136160 (0.0004) [2023-03-08 12:09:53,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11332.3, 300 sec: 11468.8). Total num frames: 69750784. Throughput: 0: 11335.6. Samples: 69734464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:09:53,080][389401] Avg episode reward: [(0, '4737.832')] [2023-03-08 12:09:53,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000136232_69750784.pth... [2023-03-08 12:09:53,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000135560_69406720.pth [2023-03-08 12:09:53,392][389688] Updated weights for policy 0, policy_version 136240 (0.0004) [2023-03-08 12:09:57,058][389688] Updated weights for policy 0, policy_version 136320 (0.0005) [2023-03-08 12:09:58,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11454.9). Total num frames: 69804032. Throughput: 0: 11342.7. Samples: 69802120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:09:58,080][389401] Avg episode reward: [(0, '4739.868')] [2023-03-08 12:10:00,692][389688] Updated weights for policy 0, policy_version 136400 (0.0005) [2023-03-08 12:10:03,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11264.0, 300 sec: 11468.8). Total num frames: 69861376. Throughput: 0: 11377.6. Samples: 69836800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:10:03,080][389401] Avg episode reward: [(0, '4738.407')] [2023-03-08 12:10:04,193][389688] Updated weights for policy 0, policy_version 136480 (0.0005) [2023-03-08 12:10:07,567][389688] Updated weights for policy 0, policy_version 136560 (0.0004) [2023-03-08 12:10:08,079][389401] Fps is (10 sec: 11878.2, 60 sec: 11400.5, 300 sec: 11482.7). Total num frames: 69922816. Throughput: 0: 11482.2. Samples: 69907732. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:10:08,080][389401] Avg episode reward: [(0, '4740.148')] [2023-03-08 12:10:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000136568_69922816.pth... [2023-03-08 12:10:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000135896_69578752.pth [2023-03-08 12:10:10,956][389688] Updated weights for policy 0, policy_version 136640 (0.0004) [2023-03-08 12:10:13,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11468.8, 300 sec: 11482.7). Total num frames: 69980160. Throughput: 0: 11576.2. Samples: 69980160. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:10:13,080][389401] Avg episode reward: [(0, '4742.525')] [2023-03-08 12:10:14,649][389688] Updated weights for policy 0, policy_version 136720 (0.0005) [2023-03-08 12:10:18,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11496.6). Total num frames: 70037504. Throughput: 0: 11520.9. Samples: 70011184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:10:18,080][389401] Avg episode reward: [(0, '4739.598')] [2023-03-08 12:10:18,305][389688] Updated weights for policy 0, policy_version 136800 (0.0005) [2023-03-08 12:10:22,026][389688] Updated weights for policy 0, policy_version 136880 (0.0005) [2023-03-08 12:10:23,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11468.8, 300 sec: 11482.7). Total num frames: 70090752. Throughput: 0: 11454.9. Samples: 70078528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:10:23,080][389401] Avg episode reward: [(0, '4737.975')] [2023-03-08 12:10:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000136896_70090752.pth... [2023-03-08 12:10:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000136232_69750784.pth [2023-03-08 12:10:25,720][389688] Updated weights for policy 0, policy_version 136960 (0.0004) [2023-03-08 12:10:28,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11468.8, 300 sec: 11482.7). Total num frames: 70148096. Throughput: 0: 11439.9. Samples: 70146072. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:10:28,080][389401] Avg episode reward: [(0, '4740.231')] [2023-03-08 12:10:29,247][389688] Updated weights for policy 0, policy_version 137040 (0.0005) [2023-03-08 12:10:33,012][389688] Updated weights for policy 0, policy_version 137120 (0.0005) [2023-03-08 12:10:33,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11482.7). Total num frames: 70205440. Throughput: 0: 11467.3. Samples: 70180864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:10:33,080][389401] Avg episode reward: [(0, '4740.195')] [2023-03-08 12:10:36,803][389688] Updated weights for policy 0, policy_version 137200 (0.0005) [2023-03-08 12:10:38,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 11468.8). Total num frames: 70258688. Throughput: 0: 11354.2. Samples: 70245404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:10:38,080][389401] Avg episode reward: [(0, '4740.556')] [2023-03-08 12:10:38,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000137224_70258688.pth... [2023-03-08 12:10:38,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000136568_69922816.pth [2023-03-08 12:10:40,388][389688] Updated weights for policy 0, policy_version 137280 (0.0005) [2023-03-08 12:10:43,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11400.5, 300 sec: 11454.9). Total num frames: 70316032. Throughput: 0: 11330.8. Samples: 70312008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:10:43,080][389401] Avg episode reward: [(0, '4699.431')] [2023-03-08 12:10:43,995][389688] Updated weights for policy 0, policy_version 137360 (0.0005) [2023-03-08 12:10:47,453][389688] Updated weights for policy 0, policy_version 137440 (0.0005) [2023-03-08 12:10:48,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11400.5, 300 sec: 11441.0). Total num frames: 70373376. Throughput: 0: 11379.2. Samples: 70348864. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:10:48,080][389401] Avg episode reward: [(0, '4741.339')] [2023-03-08 12:10:51,243][389688] Updated weights for policy 0, policy_version 137520 (0.0006) [2023-03-08 12:10:53,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11427.1). Total num frames: 70430720. Throughput: 0: 11261.4. Samples: 70414496. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:10:53,080][389401] Avg episode reward: [(0, '4740.209')] [2023-03-08 12:10:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000137560_70430720.pth... [2023-03-08 12:10:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000136896_70090752.pth [2023-03-08 12:10:54,881][389688] Updated weights for policy 0, policy_version 137600 (0.0005) [2023-03-08 12:10:58,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11332.2, 300 sec: 11413.3). Total num frames: 70483968. Throughput: 0: 11170.1. Samples: 70482816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:10:58,080][389401] Avg episode reward: [(0, '4740.214')] [2023-03-08 12:10:58,478][389688] Updated weights for policy 0, policy_version 137680 (0.0005) [2023-03-08 12:11:01,912][389688] Updated weights for policy 0, policy_version 137760 (0.0005) [2023-03-08 12:11:03,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11413.3). Total num frames: 70545408. Throughput: 0: 11274.6. Samples: 70518540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:11:03,080][389401] Avg episode reward: [(0, '4740.364')] [2023-03-08 12:11:05,382][389688] Updated weights for policy 0, policy_version 137840 (0.0005) [2023-03-08 12:11:08,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11332.3, 300 sec: 11399.4). Total num frames: 70602752. Throughput: 0: 11364.9. Samples: 70589948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:11:08,080][389401] Avg episode reward: [(0, '4734.815')] [2023-03-08 12:11:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000137896_70602752.pth... [2023-03-08 12:11:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000137224_70258688.pth [2023-03-08 12:11:08,894][389688] Updated weights for policy 0, policy_version 137920 (0.0005) [2023-03-08 12:11:12,395][389688] Updated weights for policy 0, policy_version 138000 (0.0005) [2023-03-08 12:11:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11332.2, 300 sec: 11399.4). Total num frames: 70660096. Throughput: 0: 11408.7. Samples: 70659464. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:11:13,080][389401] Avg episode reward: [(0, '4697.266')] [2023-03-08 12:11:15,887][389688] Updated weights for policy 0, policy_version 138080 (0.0005) [2023-03-08 12:11:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11400.5, 300 sec: 11399.4). Total num frames: 70721536. Throughput: 0: 11403.7. Samples: 70694032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:11:18,080][389401] Avg episode reward: [(0, '4663.859')] [2023-03-08 12:11:19,478][389688] Updated weights for policy 0, policy_version 138160 (0.0005) [2023-03-08 12:11:23,007][389688] Updated weights for policy 0, policy_version 138240 (0.0005) [2023-03-08 12:11:23,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 11413.3). Total num frames: 70778880. Throughput: 0: 11510.3. Samples: 70763368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:11:23,080][389401] Avg episode reward: [(0, '4581.119')] [2023-03-08 12:11:23,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000138240_70778880.pth... [2023-03-08 12:11:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000137560_70430720.pth [2023-03-08 12:11:26,548][389688] Updated weights for policy 0, policy_version 138320 (0.0005) [2023-03-08 12:11:28,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11399.4). Total num frames: 70836224. Throughput: 0: 11559.8. Samples: 70832200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:11:28,090][389401] Avg episode reward: [(0, '4665.748')] [2023-03-08 12:11:30,124][389688] Updated weights for policy 0, policy_version 138400 (0.0005) [2023-03-08 12:11:33,079][389401] Fps is (10 sec: 11469.0, 60 sec: 11468.8, 300 sec: 11399.4). Total num frames: 70893568. Throughput: 0: 11519.2. Samples: 70867228. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:11:33,090][389401] Avg episode reward: [(0, '4700.994')] [2023-03-08 12:11:33,624][389688] Updated weights for policy 0, policy_version 138480 (0.0005) [2023-03-08 12:11:37,147][389688] Updated weights for policy 0, policy_version 138560 (0.0005) [2023-03-08 12:11:38,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11537.0, 300 sec: 11399.4). Total num frames: 70950912. Throughput: 0: 11614.7. Samples: 70937156. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:11:38,090][389401] Avg episode reward: [(0, '4660.950')] [2023-03-08 12:11:38,094][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000138576_70950912.pth... [2023-03-08 12:11:38,097][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000137896_70602752.pth [2023-03-08 12:11:40,703][389688] Updated weights for policy 0, policy_version 138640 (0.0005) [2023-03-08 12:11:43,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11385.5). Total num frames: 71008256. Throughput: 0: 11628.2. Samples: 71006084. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:11:43,090][389401] Avg episode reward: [(0, '4738.503')] [2023-03-08 12:11:44,279][389688] Updated weights for policy 0, policy_version 138720 (0.0005) [2023-03-08 12:11:47,879][389688] Updated weights for policy 0, policy_version 138800 (0.0005) [2023-03-08 12:11:48,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11399.4). Total num frames: 71065600. Throughput: 0: 11610.8. Samples: 71041024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:11:48,090][389401] Avg episode reward: [(0, '4739.667')] [2023-03-08 12:11:51,307][389688] Updated weights for policy 0, policy_version 138880 (0.0005) [2023-03-08 12:11:53,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 11413.3). Total num frames: 71127040. Throughput: 0: 11572.7. Samples: 71110720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:11:53,090][389401] Avg episode reward: [(0, '4736.955')] [2023-03-08 12:11:53,093][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000138920_71127040.pth... [2023-03-08 12:11:53,096][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000138240_70778880.pth [2023-03-08 12:11:54,822][389688] Updated weights for policy 0, policy_version 138960 (0.0005) [2023-03-08 12:11:58,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11427.1). Total num frames: 71184384. Throughput: 0: 11577.0. Samples: 71180428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:11:58,080][389401] Avg episode reward: [(0, '4693.755')] [2023-03-08 12:11:58,351][389688] Updated weights for policy 0, policy_version 139040 (0.0005) [2023-03-08 12:12:01,970][389688] Updated weights for policy 0, policy_version 139120 (0.0005) [2023-03-08 12:12:03,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11427.1). Total num frames: 71241728. Throughput: 0: 11563.3. Samples: 71214380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:12:03,080][389401] Avg episode reward: [(0, '4738.313')] [2023-03-08 12:12:05,431][389688] Updated weights for policy 0, policy_version 139200 (0.0005) [2023-03-08 12:12:08,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11441.0). Total num frames: 71299072. Throughput: 0: 11581.4. Samples: 71284532. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:12:08,080][389401] Avg episode reward: [(0, '4720.569')] [2023-03-08 12:12:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000139256_71299072.pth... [2023-03-08 12:12:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000138576_70950912.pth [2023-03-08 12:12:08,976][389688] Updated weights for policy 0, policy_version 139280 (0.0005) [2023-03-08 12:12:12,579][389688] Updated weights for policy 0, policy_version 139360 (0.0005) [2023-03-08 12:12:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11441.0). Total num frames: 71356416. Throughput: 0: 11572.2. Samples: 71352948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:12:13,080][389401] Avg episode reward: [(0, '4728.856')] [2023-03-08 12:12:16,114][389688] Updated weights for policy 0, policy_version 139440 (0.0005) [2023-03-08 12:12:18,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11441.0). Total num frames: 71413760. Throughput: 0: 11582.6. Samples: 71388444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:12:18,080][389401] Avg episode reward: [(0, '4701.732')] [2023-03-08 12:12:19,691][389688] Updated weights for policy 0, policy_version 139520 (0.0005) [2023-03-08 12:12:23,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11427.1). Total num frames: 71471104. Throughput: 0: 11521.8. Samples: 71455636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:12:23,080][389401] Avg episode reward: [(0, '4735.109')] [2023-03-08 12:12:23,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000139592_71471104.pth... [2023-03-08 12:12:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000138920_71127040.pth [2023-03-08 12:12:23,322][389688] Updated weights for policy 0, policy_version 139600 (0.0005) [2023-03-08 12:12:26,832][389688] Updated weights for policy 0, policy_version 139680 (0.0005) [2023-03-08 12:12:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11441.0). Total num frames: 71528448. Throughput: 0: 11533.9. Samples: 71525108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:12:28,080][389401] Avg episode reward: [(0, '4594.046')] [2023-03-08 12:12:30,497][389688] Updated weights for policy 0, policy_version 139760 (0.0005) [2023-03-08 12:12:33,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11468.8, 300 sec: 11427.1). Total num frames: 71581696. Throughput: 0: 11510.3. Samples: 71558988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:12:33,080][389401] Avg episode reward: [(0, '4733.689')] [2023-03-08 12:12:34,230][389688] Updated weights for policy 0, policy_version 139840 (0.0005) [2023-03-08 12:12:37,771][389688] Updated weights for policy 0, policy_version 139920 (0.0005) [2023-03-08 12:12:38,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11468.8, 300 sec: 11441.0). Total num frames: 71639040. Throughput: 0: 11457.6. Samples: 71626312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:12:38,080][389401] Avg episode reward: [(0, '4733.654')] [2023-03-08 12:12:38,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000139920_71639040.pth... [2023-03-08 12:12:38,087][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000139256_71299072.pth [2023-03-08 12:12:41,451][389688] Updated weights for policy 0, policy_version 140000 (0.0005) [2023-03-08 12:12:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11441.0). Total num frames: 71696384. Throughput: 0: 11422.7. Samples: 71694452. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:12:43,080][389401] Avg episode reward: [(0, '4696.364')] [2023-03-08 12:12:44,967][389688] Updated weights for policy 0, policy_version 140080 (0.0005) [2023-03-08 12:12:48,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11454.9). Total num frames: 71753728. Throughput: 0: 11439.7. Samples: 71729168. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:12:48,080][389401] Avg episode reward: [(0, '4731.590')] [2023-03-08 12:12:48,547][389688] Updated weights for policy 0, policy_version 140160 (0.0005) [2023-03-08 12:12:52,134][389688] Updated weights for policy 0, policy_version 140240 (0.0005) [2023-03-08 12:12:53,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11400.5, 300 sec: 11454.9). Total num frames: 71811072. Throughput: 0: 11395.1. Samples: 71797312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:12:53,080][389401] Avg episode reward: [(0, '4732.931')] [2023-03-08 12:12:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000140256_71811072.pth... [2023-03-08 12:12:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000139592_71471104.pth [2023-03-08 12:12:55,774][389688] Updated weights for policy 0, policy_version 140320 (0.0005) [2023-03-08 12:12:58,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11441.0). Total num frames: 71868416. Throughput: 0: 11384.5. Samples: 71865252. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:12:58,080][389401] Avg episode reward: [(0, '4701.484')] [2023-03-08 12:12:59,291][389688] Updated weights for policy 0, policy_version 140400 (0.0005) [2023-03-08 12:13:02,791][389688] Updated weights for policy 0, policy_version 140480 (0.0005) [2023-03-08 12:13:03,079][389401] Fps is (10 sec: 11469.0, 60 sec: 11400.6, 300 sec: 11441.0). Total num frames: 71925760. Throughput: 0: 11394.2. Samples: 71901184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:13:03,080][389401] Avg episode reward: [(0, '4734.304')] [2023-03-08 12:13:06,320][389688] Updated weights for policy 0, policy_version 140560 (0.0005) [2023-03-08 12:13:08,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11400.5, 300 sec: 11441.0). Total num frames: 71983104. Throughput: 0: 11448.7. Samples: 71970828. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:13:08,080][389401] Avg episode reward: [(0, '4665.786')] [2023-03-08 12:13:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000140600_71987200.pth... [2023-03-08 12:13:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000139920_71639040.pth [2023-03-08 12:13:09,889][389688] Updated weights for policy 0, policy_version 140640 (0.0005) [2023-03-08 12:13:13,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11468.8, 300 sec: 11454.9). Total num frames: 72044544. Throughput: 0: 11452.3. Samples: 72040460. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:13:13,080][389401] Avg episode reward: [(0, '4674.479')] [2023-03-08 12:13:13,347][389688] Updated weights for policy 0, policy_version 140720 (0.0005) [2023-03-08 12:13:16,990][389688] Updated weights for policy 0, policy_version 140800 (0.0005) [2023-03-08 12:13:18,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11468.8, 300 sec: 11454.9). Total num frames: 72101888. Throughput: 0: 11445.0. Samples: 72074012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:13:18,080][389401] Avg episode reward: [(0, '4738.596')] [2023-03-08 12:13:20,517][389688] Updated weights for policy 0, policy_version 140880 (0.0005) [2023-03-08 12:13:23,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11441.0). Total num frames: 72159232. Throughput: 0: 11492.6. Samples: 72143476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:13:23,080][389401] Avg episode reward: [(0, '4737.524')] [2023-03-08 12:13:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000140936_72159232.pth... [2023-03-08 12:13:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000140256_71811072.pth [2023-03-08 12:13:24,094][389688] Updated weights for policy 0, policy_version 140960 (0.0005) [2023-03-08 12:13:27,644][389688] Updated weights for policy 0, policy_version 141040 (0.0005) [2023-03-08 12:13:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11441.0). Total num frames: 72216576. Throughput: 0: 11513.2. Samples: 72212544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:13:28,080][389401] Avg episode reward: [(0, '4737.117')] [2023-03-08 12:13:31,232][389688] Updated weights for policy 0, policy_version 141120 (0.0005) [2023-03-08 12:13:33,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11441.0). Total num frames: 72273920. Throughput: 0: 11505.1. Samples: 72246896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:13:33,080][389401] Avg episode reward: [(0, '4737.304')] [2023-03-08 12:13:34,723][389688] Updated weights for policy 0, policy_version 141200 (0.0005) [2023-03-08 12:13:38,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11441.0). Total num frames: 72331264. Throughput: 0: 11528.2. Samples: 72316080. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:13:38,080][389401] Avg episode reward: [(0, '4734.685')] [2023-03-08 12:13:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000141272_72331264.pth... [2023-03-08 12:13:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000140600_71987200.pth [2023-03-08 12:13:38,307][389688] Updated weights for policy 0, policy_version 141280 (0.0005) [2023-03-08 12:13:41,878][389688] Updated weights for policy 0, policy_version 141360 (0.0005) [2023-03-08 12:13:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11427.1). Total num frames: 72388608. Throughput: 0: 11547.0. Samples: 72384868. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:13:43,090][389401] Avg episode reward: [(0, '4735.030')] [2023-03-08 12:13:45,521][389688] Updated weights for policy 0, policy_version 141440 (0.0004) [2023-03-08 12:13:48,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11441.0). Total num frames: 72445952. Throughput: 0: 11502.3. Samples: 72418788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:13:48,080][389401] Avg episode reward: [(0, '4738.714')] [2023-03-08 12:13:49,047][389688] Updated weights for policy 0, policy_version 141520 (0.0005) [2023-03-08 12:13:52,668][389688] Updated weights for policy 0, policy_version 141600 (0.0005) [2023-03-08 12:13:53,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11441.0). Total num frames: 72503296. Throughput: 0: 11483.7. Samples: 72487596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:13:53,080][389401] Avg episode reward: [(0, '4735.653')] [2023-03-08 12:13:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000141608_72503296.pth... [2023-03-08 12:13:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000140936_72159232.pth [2023-03-08 12:13:56,228][389688] Updated weights for policy 0, policy_version 141680 (0.0004) [2023-03-08 12:13:58,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11441.0). Total num frames: 72560640. Throughput: 0: 11468.7. Samples: 72556552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:13:58,080][389401] Avg episode reward: [(0, '4740.283')] [2023-03-08 12:13:59,843][389688] Updated weights for policy 0, policy_version 141760 (0.0005) [2023-03-08 12:14:03,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11454.9). Total num frames: 72617984. Throughput: 0: 11480.5. Samples: 72590636. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:14:03,080][389401] Avg episode reward: [(0, '4742.458')] [2023-03-08 12:14:03,347][389688] Updated weights for policy 0, policy_version 141840 (0.0005) [2023-03-08 12:14:06,900][389688] Updated weights for policy 0, policy_version 141920 (0.0005) [2023-03-08 12:14:08,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11468.8). Total num frames: 72675328. Throughput: 0: 11473.7. Samples: 72659792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:14:08,080][389401] Avg episode reward: [(0, '4735.677')] [2023-03-08 12:14:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000141944_72675328.pth... [2023-03-08 12:14:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000141272_72331264.pth [2023-03-08 12:14:10,432][389688] Updated weights for policy 0, policy_version 142000 (0.0005) [2023-03-08 12:14:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11468.8). Total num frames: 72732672. Throughput: 0: 11469.0. Samples: 72728648. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:14:13,080][389401] Avg episode reward: [(0, '4736.170')] [2023-03-08 12:14:14,079][389688] Updated weights for policy 0, policy_version 142080 (0.0005) [2023-03-08 12:14:17,627][389688] Updated weights for policy 0, policy_version 142160 (0.0004) [2023-03-08 12:14:18,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11482.7). Total num frames: 72790016. Throughput: 0: 11477.8. Samples: 72763396. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:14:18,080][389401] Avg episode reward: [(0, '4736.764')] [2023-03-08 12:14:21,134][389688] Updated weights for policy 0, policy_version 142240 (0.0005) [2023-03-08 12:14:23,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11482.7). Total num frames: 72847360. Throughput: 0: 11495.2. Samples: 72833364. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:14:23,080][389401] Avg episode reward: [(0, '4658.530')] [2023-03-08 12:14:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000142280_72847360.pth... [2023-03-08 12:14:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000141608_72503296.pth [2023-03-08 12:14:24,452][389688] Updated weights for policy 0, policy_version 142320 (0.0005) [2023-03-08 12:14:27,819][389688] Updated weights for policy 0, policy_version 142400 (0.0005) [2023-03-08 12:14:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 11496.6). Total num frames: 72908800. Throughput: 0: 11609.2. Samples: 72907280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:14:28,080][389401] Avg episode reward: [(0, '4739.325')] [2023-03-08 12:14:31,244][389688] Updated weights for policy 0, policy_version 142480 (0.0004) [2023-03-08 12:14:33,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11605.3, 300 sec: 11496.6). Total num frames: 72970240. Throughput: 0: 11638.6. Samples: 72942524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:14:33,080][389401] Avg episode reward: [(0, '4722.977')] [2023-03-08 12:14:34,752][389688] Updated weights for policy 0, policy_version 142560 (0.0005) [2023-03-08 12:14:38,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 11510.4). Total num frames: 73027584. Throughput: 0: 11653.8. Samples: 73012016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:14:38,080][389401] Avg episode reward: [(0, '4698.417')] [2023-03-08 12:14:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000142632_73027584.pth... [2023-03-08 12:14:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000141944_72675328.pth [2023-03-08 12:14:38,283][389688] Updated weights for policy 0, policy_version 142640 (0.0005) [2023-03-08 12:14:41,752][389688] Updated weights for policy 0, policy_version 142720 (0.0005) [2023-03-08 12:14:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 11510.5). Total num frames: 73084928. Throughput: 0: 11720.9. Samples: 73083992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:14:43,080][389401] Avg episode reward: [(0, '4660.027')] [2023-03-08 12:14:45,022][389688] Updated weights for policy 0, policy_version 142800 (0.0004) [2023-03-08 12:14:48,079][389401] Fps is (10 sec: 12288.2, 60 sec: 11741.9, 300 sec: 11524.3). Total num frames: 73150464. Throughput: 0: 11803.7. Samples: 73121800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:14:48,080][389401] Avg episode reward: [(0, '4700.106')] [2023-03-08 12:14:48,298][389688] Updated weights for policy 0, policy_version 142880 (0.0004) [2023-03-08 12:14:51,643][389688] Updated weights for policy 0, policy_version 142960 (0.0004) [2023-03-08 12:14:53,079][389401] Fps is (10 sec: 12697.6, 60 sec: 11810.1, 300 sec: 11552.1). Total num frames: 73211904. Throughput: 0: 11906.5. Samples: 73195584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:14:53,080][389401] Avg episode reward: [(0, '4691.609')] [2023-03-08 12:14:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000142992_73211904.pth... [2023-03-08 12:14:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000142280_72847360.pth [2023-03-08 12:14:54,901][389688] Updated weights for policy 0, policy_version 143040 (0.0005) [2023-03-08 12:14:58,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11566.0). Total num frames: 73273344. Throughput: 0: 12020.3. Samples: 73269560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:14:58,080][389401] Avg episode reward: [(0, '4700.093')] [2023-03-08 12:14:58,286][389688] Updated weights for policy 0, policy_version 143120 (0.0005) [2023-03-08 12:15:01,619][389688] Updated weights for policy 0, policy_version 143200 (0.0004) [2023-03-08 12:15:03,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11566.0). Total num frames: 73334784. Throughput: 0: 12061.8. Samples: 73306176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:15:03,080][389401] Avg episode reward: [(0, '4733.700')] [2023-03-08 12:15:04,885][389688] Updated weights for policy 0, policy_version 143280 (0.0004) [2023-03-08 12:15:08,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11579.9). Total num frames: 73396224. Throughput: 0: 12183.0. Samples: 73381600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:15:08,080][389401] Avg episode reward: [(0, '4711.358')] [2023-03-08 12:15:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000143360_73400320.pth... [2023-03-08 12:15:08,084][389688] Updated weights for policy 0, policy_version 143360 (0.0004) [2023-03-08 12:15:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000142632_73027584.pth [2023-03-08 12:15:11,686][389688] Updated weights for policy 0, policy_version 143440 (0.0005) [2023-03-08 12:15:13,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12083.2, 300 sec: 11593.8). Total num frames: 73457664. Throughput: 0: 12134.2. Samples: 73453316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:15:13,080][389401] Avg episode reward: [(0, '4728.343')] [2023-03-08 12:15:15,171][389688] Updated weights for policy 0, policy_version 143520 (0.0004) [2023-03-08 12:15:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11607.7). Total num frames: 73515008. Throughput: 0: 12113.4. Samples: 73487628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:15:18,079][389401] Avg episode reward: [(0, '4541.445')] [2023-03-08 12:15:18,781][389688] Updated weights for policy 0, policy_version 143600 (0.0005) [2023-03-08 12:15:22,290][389688] Updated weights for policy 0, policy_version 143680 (0.0005) [2023-03-08 12:15:23,079][389401] Fps is (10 sec: 11468.7, 60 sec: 12083.2, 300 sec: 11607.6). Total num frames: 73572352. Throughput: 0: 12096.4. Samples: 73556352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:15:23,080][389401] Avg episode reward: [(0, '4617.315')] [2023-03-08 12:15:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000143696_73572352.pth... [2023-03-08 12:15:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000142992_73211904.pth [2023-03-08 12:15:25,608][389688] Updated weights for policy 0, policy_version 143760 (0.0004) [2023-03-08 12:15:28,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12083.2, 300 sec: 11621.5). Total num frames: 73633792. Throughput: 0: 12177.3. Samples: 73631972. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:15:28,080][389401] Avg episode reward: [(0, '4731.068')] [2023-03-08 12:15:28,812][389688] Updated weights for policy 0, policy_version 143840 (0.0004) [2023-03-08 12:15:32,148][389688] Updated weights for policy 0, policy_version 143920 (0.0004) [2023-03-08 12:15:33,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11649.3). Total num frames: 73695232. Throughput: 0: 12146.3. Samples: 73668384. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:15:33,080][389401] Avg episode reward: [(0, '4661.884')] [2023-03-08 12:15:35,365][389688] Updated weights for policy 0, policy_version 144000 (0.0004) [2023-03-08 12:15:38,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12219.7, 300 sec: 11677.1). Total num frames: 73760768. Throughput: 0: 12197.0. Samples: 73744448. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:15:38,080][389401] Avg episode reward: [(0, '4635.239')] [2023-03-08 12:15:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000144064_73760768.pth... [2023-03-08 12:15:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000143360_73400320.pth [2023-03-08 12:15:38,635][389688] Updated weights for policy 0, policy_version 144080 (0.0004) [2023-03-08 12:15:42,068][389688] Updated weights for policy 0, policy_version 144160 (0.0004) [2023-03-08 12:15:43,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12219.7, 300 sec: 11677.1). Total num frames: 73818112. Throughput: 0: 12177.2. Samples: 73817536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:15:43,080][389401] Avg episode reward: [(0, '4483.723')] [2023-03-08 12:15:45,421][389688] Updated weights for policy 0, policy_version 144240 (0.0005) [2023-03-08 12:15:48,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12219.7, 300 sec: 11704.8). Total num frames: 73883648. Throughput: 0: 12174.0. Samples: 73854008. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:15:48,080][389401] Avg episode reward: [(0, '4664.696')] [2023-03-08 12:15:48,654][389688] Updated weights for policy 0, policy_version 144320 (0.0004) [2023-03-08 12:15:51,806][389688] Updated weights for policy 0, policy_version 144400 (0.0004) [2023-03-08 12:15:53,079][389401] Fps is (10 sec: 12697.4, 60 sec: 12219.7, 300 sec: 11732.6). Total num frames: 73945088. Throughput: 0: 12202.7. Samples: 73930724. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:15:53,090][389401] Avg episode reward: [(0, '4663.946')] [2023-03-08 12:15:53,094][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000144432_73949184.pth... [2023-03-08 12:15:53,096][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000143696_73572352.pth [2023-03-08 12:15:54,993][389688] Updated weights for policy 0, policy_version 144480 (0.0004) [2023-03-08 12:15:58,079][389401] Fps is (10 sec: 12287.8, 60 sec: 12219.7, 300 sec: 11732.6). Total num frames: 74006528. Throughput: 0: 12275.1. Samples: 74005696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:15:58,090][389401] Avg episode reward: [(0, '4687.622')] [2023-03-08 12:15:58,468][389688] Updated weights for policy 0, policy_version 144560 (0.0004) [2023-03-08 12:16:01,897][389688] Updated weights for policy 0, policy_version 144640 (0.0005) [2023-03-08 12:16:03,079][389401] Fps is (10 sec: 12288.2, 60 sec: 12219.7, 300 sec: 11746.5). Total num frames: 74067968. Throughput: 0: 12290.9. Samples: 74040720. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:16:03,080][389401] Avg episode reward: [(0, '4701.891')] [2023-03-08 12:16:05,425][389688] Updated weights for policy 0, policy_version 144720 (0.0005) [2023-03-08 12:16:08,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12151.4, 300 sec: 11746.5). Total num frames: 74125312. Throughput: 0: 12319.5. Samples: 74110728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:16:08,080][389401] Avg episode reward: [(0, '4699.923')] [2023-03-08 12:16:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000144776_74125312.pth... [2023-03-08 12:16:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000144064_73760768.pth [2023-03-08 12:16:08,963][389688] Updated weights for policy 0, policy_version 144800 (0.0005) [2023-03-08 12:16:12,502][389688] Updated weights for policy 0, policy_version 144880 (0.0005) [2023-03-08 12:16:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 11732.6). Total num frames: 74182656. Throughput: 0: 12184.2. Samples: 74180260. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:16:13,080][389401] Avg episode reward: [(0, '4705.453')] [2023-03-08 12:16:16,086][389688] Updated weights for policy 0, policy_version 144960 (0.0005) [2023-03-08 12:16:18,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12151.5, 300 sec: 11746.5). Total num frames: 74244096. Throughput: 0: 12144.7. Samples: 74214896. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:16:18,080][389401] Avg episode reward: [(0, '4682.894')] [2023-03-08 12:16:19,379][389688] Updated weights for policy 0, policy_version 145040 (0.0004) [2023-03-08 12:16:22,921][389688] Updated weights for policy 0, policy_version 145120 (0.0005) [2023-03-08 12:16:23,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12151.5, 300 sec: 11746.5). Total num frames: 74301440. Throughput: 0: 12048.8. Samples: 74286644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:16:23,080][389401] Avg episode reward: [(0, '4703.793')] [2023-03-08 12:16:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000145120_74301440.pth... [2023-03-08 12:16:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000144432_73949184.pth [2023-03-08 12:16:26,400][389688] Updated weights for policy 0, policy_version 145200 (0.0005) [2023-03-08 12:16:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 11746.5). Total num frames: 74358784. Throughput: 0: 11974.6. Samples: 74356392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:16:28,080][389401] Avg episode reward: [(0, '4709.692')] [2023-03-08 12:16:30,010][389688] Updated weights for policy 0, policy_version 145280 (0.0005) [2023-03-08 12:16:33,079][389401] Fps is (10 sec: 11468.7, 60 sec: 12014.9, 300 sec: 11746.5). Total num frames: 74416128. Throughput: 0: 11945.4. Samples: 74391552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:16:33,080][389401] Avg episode reward: [(0, '4681.820')] [2023-03-08 12:16:33,491][389688] Updated weights for policy 0, policy_version 145360 (0.0005) [2023-03-08 12:16:36,847][389688] Updated weights for policy 0, policy_version 145440 (0.0004) [2023-03-08 12:16:38,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11760.4). Total num frames: 74477568. Throughput: 0: 11818.1. Samples: 74462536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:16:38,080][389401] Avg episode reward: [(0, '4709.404')] [2023-03-08 12:16:38,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000145464_74477568.pth... [2023-03-08 12:16:38,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000144776_74125312.pth [2023-03-08 12:16:40,183][389688] Updated weights for policy 0, policy_version 145520 (0.0004) [2023-03-08 12:16:43,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11774.3). Total num frames: 74539008. Throughput: 0: 11761.8. Samples: 74534976. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:16:43,080][389401] Avg episode reward: [(0, '4632.727')] [2023-03-08 12:16:43,660][389688] Updated weights for policy 0, policy_version 145600 (0.0004) [2023-03-08 12:16:46,980][389688] Updated weights for policy 0, policy_version 145680 (0.0005) [2023-03-08 12:16:48,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11774.3). Total num frames: 74600448. Throughput: 0: 11802.8. Samples: 74571848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:16:48,080][389401] Avg episode reward: [(0, '4692.036')] [2023-03-08 12:16:50,314][389688] Updated weights for policy 0, policy_version 145760 (0.0005) [2023-03-08 12:16:53,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11788.1). Total num frames: 74661888. Throughput: 0: 11870.3. Samples: 74644892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:16:53,080][389401] Avg episode reward: [(0, '4628.393')] [2023-03-08 12:16:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000145824_74661888.pth... [2023-03-08 12:16:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000145120_74301440.pth [2023-03-08 12:16:53,685][389688] Updated weights for policy 0, policy_version 145840 (0.0004) [2023-03-08 12:16:56,989][389688] Updated weights for policy 0, policy_version 145920 (0.0005) [2023-03-08 12:16:58,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 11802.0). Total num frames: 74723328. Throughput: 0: 11978.6. Samples: 74719296. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:16:58,080][389401] Avg episode reward: [(0, '4666.902')] [2023-03-08 12:17:00,220][389688] Updated weights for policy 0, policy_version 146000 (0.0005) [2023-03-08 12:17:03,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11815.9). Total num frames: 74784768. Throughput: 0: 12048.4. Samples: 74757076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:17:03,080][389401] Avg episode reward: [(0, '4643.799')] [2023-03-08 12:17:03,565][389688] Updated weights for policy 0, policy_version 146080 (0.0005) [2023-03-08 12:17:06,856][389688] Updated weights for policy 0, policy_version 146160 (0.0005) [2023-03-08 12:17:08,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11829.8). Total num frames: 74846208. Throughput: 0: 12106.2. Samples: 74831424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:17:08,080][389401] Avg episode reward: [(0, '4713.564')] [2023-03-08 12:17:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000146184_74846208.pth... [2023-03-08 12:17:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000145464_74477568.pth [2023-03-08 12:17:10,111][389688] Updated weights for policy 0, policy_version 146240 (0.0004) [2023-03-08 12:17:13,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11843.7). Total num frames: 74907648. Throughput: 0: 12208.3. Samples: 74905768. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:17:13,080][389401] Avg episode reward: [(0, '4725.044')] [2023-03-08 12:17:13,544][389688] Updated weights for policy 0, policy_version 146320 (0.0005) [2023-03-08 12:17:16,999][389688] Updated weights for policy 0, policy_version 146400 (0.0005) [2023-03-08 12:17:18,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11857.6). Total num frames: 74969088. Throughput: 0: 12197.3. Samples: 74940428. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:17:18,080][389401] Avg episode reward: [(0, '4729.105')] [2023-03-08 12:17:20,237][389688] Updated weights for policy 0, policy_version 146480 (0.0004) [2023-03-08 12:17:23,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 11871.5). Total num frames: 75030528. Throughput: 0: 12279.3. Samples: 75015104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:17:23,080][389401] Avg episode reward: [(0, '4731.209')] [2023-03-08 12:17:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000146544_75030528.pth... [2023-03-08 12:17:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000145824_74661888.pth [2023-03-08 12:17:23,651][389688] Updated weights for policy 0, policy_version 146560 (0.0005) [2023-03-08 12:17:27,191][389688] Updated weights for policy 0, policy_version 146640 (0.0005) [2023-03-08 12:17:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 11885.3). Total num frames: 75087872. Throughput: 0: 12225.6. Samples: 75085128. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:17:28,080][389401] Avg episode reward: [(0, '4667.222')] [2023-03-08 12:17:30,772][389688] Updated weights for policy 0, policy_version 146720 (0.0005) [2023-03-08 12:17:33,079][389401] Fps is (10 sec: 11468.9, 60 sec: 12151.5, 300 sec: 11885.3). Total num frames: 75145216. Throughput: 0: 12173.2. Samples: 75119640. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:17:33,080][389401] Avg episode reward: [(0, '4729.582')] [2023-03-08 12:17:34,330][389688] Updated weights for policy 0, policy_version 146800 (0.0005) [2023-03-08 12:17:37,938][389688] Updated weights for policy 0, policy_version 146880 (0.0005) [2023-03-08 12:17:38,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12083.2, 300 sec: 11885.3). Total num frames: 75202560. Throughput: 0: 12080.3. Samples: 75188504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:17:38,080][389401] Avg episode reward: [(0, '4733.864')] [2023-03-08 12:17:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000146880_75202560.pth... [2023-03-08 12:17:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000146184_74846208.pth [2023-03-08 12:17:41,281][389688] Updated weights for policy 0, policy_version 146960 (0.0005) [2023-03-08 12:17:43,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11899.2). Total num frames: 75264000. Throughput: 0: 12030.9. Samples: 75260688. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:17:43,080][389401] Avg episode reward: [(0, '4728.075')] [2023-03-08 12:17:44,599][389688] Updated weights for policy 0, policy_version 147040 (0.0004) [2023-03-08 12:17:48,007][389688] Updated weights for policy 0, policy_version 147120 (0.0005) [2023-03-08 12:17:48,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11913.1). Total num frames: 75325440. Throughput: 0: 11995.5. Samples: 75296872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:17:48,080][389401] Avg episode reward: [(0, '4560.927')] [2023-03-08 12:17:51,259][389688] Updated weights for policy 0, policy_version 147200 (0.0004) [2023-03-08 12:17:53,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11927.0). Total num frames: 75386880. Throughput: 0: 11993.6. Samples: 75371136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:17:53,080][389401] Avg episode reward: [(0, '4729.960')] [2023-03-08 12:17:53,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000147240_75386880.pth... [2023-03-08 12:17:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000146544_75030528.pth [2023-03-08 12:17:54,532][389688] Updated weights for policy 0, policy_version 147280 (0.0004) [2023-03-08 12:17:57,894][389688] Updated weights for policy 0, policy_version 147360 (0.0005) [2023-03-08 12:17:58,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 11940.9). Total num frames: 75448320. Throughput: 0: 11997.4. Samples: 75445652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:17:58,080][389401] Avg episode reward: [(0, '4736.154')] [2023-03-08 12:18:01,370][389688] Updated weights for policy 0, policy_version 147440 (0.0005) [2023-03-08 12:18:03,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11940.9). Total num frames: 75505664. Throughput: 0: 12014.8. Samples: 75481096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:18:03,080][389401] Avg episode reward: [(0, '4663.713')] [2023-03-08 12:18:04,978][389688] Updated weights for policy 0, policy_version 147520 (0.0005) [2023-03-08 12:18:08,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11927.0). Total num frames: 75563008. Throughput: 0: 11878.3. Samples: 75549628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:18:08,080][389401] Avg episode reward: [(0, '4696.909')] [2023-03-08 12:18:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000147584_75563008.pth... [2023-03-08 12:18:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000146880_75202560.pth [2023-03-08 12:18:08,579][389688] Updated weights for policy 0, policy_version 147600 (0.0005) [2023-03-08 12:18:12,226][389688] Updated weights for policy 0, policy_version 147680 (0.0005) [2023-03-08 12:18:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 11927.0). Total num frames: 75620352. Throughput: 0: 11819.1. Samples: 75616988. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:18:13,080][389401] Avg episode reward: [(0, '4699.594')] [2023-03-08 12:18:15,810][389688] Updated weights for policy 0, policy_version 147760 (0.0005) [2023-03-08 12:18:18,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11927.0). Total num frames: 75677696. Throughput: 0: 11821.4. Samples: 75651604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:18:18,080][389401] Avg episode reward: [(0, '4734.172')] [2023-03-08 12:18:19,343][389688] Updated weights for policy 0, policy_version 147840 (0.0005) [2023-03-08 12:18:22,859][389688] Updated weights for policy 0, policy_version 147920 (0.0004) [2023-03-08 12:18:23,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11927.0). Total num frames: 75735040. Throughput: 0: 11830.1. Samples: 75720856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:18:23,080][389401] Avg episode reward: [(0, '4736.143')] [2023-03-08 12:18:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000147920_75735040.pth... [2023-03-08 12:18:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000147240_75386880.pth [2023-03-08 12:18:26,436][389688] Updated weights for policy 0, policy_version 148000 (0.0005) [2023-03-08 12:18:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11927.0). Total num frames: 75792384. Throughput: 0: 11767.7. Samples: 75790236. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:18:28,080][389401] Avg episode reward: [(0, '4652.672')] [2023-03-08 12:18:29,829][389688] Updated weights for policy 0, policy_version 148080 (0.0005) [2023-03-08 12:18:33,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11940.9). Total num frames: 75853824. Throughput: 0: 11780.9. Samples: 75827012. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:18:33,080][389401] Avg episode reward: [(0, '4736.393')] [2023-03-08 12:18:33,382][389688] Updated weights for policy 0, policy_version 148160 (0.0004) [2023-03-08 12:18:36,791][389688] Updated weights for policy 0, policy_version 148240 (0.0004) [2023-03-08 12:18:38,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11940.9). Total num frames: 75911168. Throughput: 0: 11683.3. Samples: 75896884. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:18:38,090][389401] Avg episode reward: [(0, '4695.637')] [2023-03-08 12:18:38,110][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000148272_75915264.pth... [2023-03-08 12:18:38,112][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000147584_75563008.pth [2023-03-08 12:18:40,054][389688] Updated weights for policy 0, policy_version 148320 (0.0004) [2023-03-08 12:18:43,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11878.4, 300 sec: 11968.7). Total num frames: 75976704. Throughput: 0: 11710.1. Samples: 75972608. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:18:43,090][389401] Avg episode reward: [(0, '4736.609')] [2023-03-08 12:18:43,328][389688] Updated weights for policy 0, policy_version 148400 (0.0004) [2023-03-08 12:18:46,530][389688] Updated weights for policy 0, policy_version 148480 (0.0004) [2023-03-08 12:18:48,079][389401] Fps is (10 sec: 12697.7, 60 sec: 11878.4, 300 sec: 11982.5). Total num frames: 76038144. Throughput: 0: 11760.3. Samples: 76010312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:18:48,080][389401] Avg episode reward: [(0, '4739.743')] [2023-03-08 12:18:49,872][389688] Updated weights for policy 0, policy_version 148560 (0.0005) [2023-03-08 12:18:53,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11878.4, 300 sec: 11996.4). Total num frames: 76099584. Throughput: 0: 11858.6. Samples: 76083264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:18:53,080][389401] Avg episode reward: [(0, '4736.462')] [2023-03-08 12:18:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000148632_76099584.pth... [2023-03-08 12:18:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000147920_75735040.pth [2023-03-08 12:18:53,443][389688] Updated weights for policy 0, policy_version 148640 (0.0005) [2023-03-08 12:18:56,931][389688] Updated weights for policy 0, policy_version 148720 (0.0005) [2023-03-08 12:18:58,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11996.4). Total num frames: 76156928. Throughput: 0: 11908.1. Samples: 76152852. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 12:18:58,080][389401] Avg episode reward: [(0, '4740.844')] [2023-03-08 12:19:00,494][389688] Updated weights for policy 0, policy_version 148800 (0.0005) [2023-03-08 12:19:03,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 11996.4). Total num frames: 76214272. Throughput: 0: 11912.7. Samples: 76187676. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 12:19:03,080][389401] Avg episode reward: [(0, '4696.737')] [2023-03-08 12:19:03,936][389688] Updated weights for policy 0, policy_version 148880 (0.0005) [2023-03-08 12:19:07,428][389688] Updated weights for policy 0, policy_version 148960 (0.0004) [2023-03-08 12:19:08,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11996.4). Total num frames: 76271616. Throughput: 0: 11957.6. Samples: 76258948. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 12:19:08,080][389401] Avg episode reward: [(0, '4719.653')] [2023-03-08 12:19:08,126][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000148976_76275712.pth... [2023-03-08 12:19:08,128][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000148272_75915264.pth [2023-03-08 12:19:11,063][389688] Updated weights for policy 0, policy_version 149040 (0.0005) [2023-03-08 12:19:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11996.4). Total num frames: 76328960. Throughput: 0: 11906.0. Samples: 76326008. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 12:19:13,080][389401] Avg episode reward: [(0, '4741.096')] [2023-03-08 12:19:14,724][389688] Updated weights for policy 0, policy_version 149120 (0.0005) [2023-03-08 12:19:18,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 11996.4). Total num frames: 76386304. Throughput: 0: 11855.1. Samples: 76360492. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 12:19:18,080][389401] Avg episode reward: [(0, '4739.209')] [2023-03-08 12:19:18,292][389688] Updated weights for policy 0, policy_version 149200 (0.0005) [2023-03-08 12:19:21,799][389688] Updated weights for policy 0, policy_version 149280 (0.0005) [2023-03-08 12:19:23,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11982.5). Total num frames: 76443648. Throughput: 0: 11831.7. Samples: 76429312. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 12:19:23,080][389401] Avg episode reward: [(0, '4738.581')] [2023-03-08 12:19:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000149304_76443648.pth... [2023-03-08 12:19:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000148632_76099584.pth [2023-03-08 12:19:25,303][389688] Updated weights for policy 0, policy_version 149360 (0.0005) [2023-03-08 12:19:28,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11810.1, 300 sec: 11968.6). Total num frames: 76500992. Throughput: 0: 11704.5. Samples: 76499312. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 12:19:28,080][389401] Avg episode reward: [(0, '4739.170')] [2023-03-08 12:19:28,906][389688] Updated weights for policy 0, policy_version 149440 (0.0005) [2023-03-08 12:19:32,429][389688] Updated weights for policy 0, policy_version 149520 (0.0005) [2023-03-08 12:19:33,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11968.7). Total num frames: 76558336. Throughput: 0: 11632.4. Samples: 76533768. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 12:19:33,080][389401] Avg episode reward: [(0, '4736.392')] [2023-03-08 12:19:35,971][389688] Updated weights for policy 0, policy_version 149600 (0.0004) [2023-03-08 12:19:38,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11968.7). Total num frames: 76615680. Throughput: 0: 11558.4. Samples: 76603392. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 12:19:38,080][389401] Avg episode reward: [(0, '4739.815')] [2023-03-08 12:19:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000149648_76619776.pth... [2023-03-08 12:19:38,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000148976_76275712.pth [2023-03-08 12:19:39,390][389688] Updated weights for policy 0, policy_version 149680 (0.0004) [2023-03-08 12:19:42,616][389688] Updated weights for policy 0, policy_version 149760 (0.0004) [2023-03-08 12:19:43,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 11968.6). Total num frames: 76681216. Throughput: 0: 11652.0. Samples: 76677192. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 12:19:43,080][389401] Avg episode reward: [(0, '4692.961')] [2023-03-08 12:19:46,127][389688] Updated weights for policy 0, policy_version 149840 (0.0004) [2023-03-08 12:19:48,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 11954.8). Total num frames: 76738560. Throughput: 0: 11674.2. Samples: 76713016. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 12:19:48,080][389401] Avg episode reward: [(0, '4710.372')] [2023-03-08 12:19:49,616][389688] Updated weights for policy 0, policy_version 149920 (0.0005) [2023-03-08 12:19:53,041][389688] Updated weights for policy 0, policy_version 150000 (0.0005) [2023-03-08 12:19:53,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11954.8). Total num frames: 76800000. Throughput: 0: 11659.3. Samples: 76783616. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 12:19:53,080][389401] Avg episode reward: [(0, '4665.709')] [2023-03-08 12:19:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000150000_76800000.pth... [2023-03-08 12:19:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000149304_76443648.pth [2023-03-08 12:19:56,597][389688] Updated weights for policy 0, policy_version 150080 (0.0004) [2023-03-08 12:19:58,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11940.9). Total num frames: 76857344. Throughput: 0: 11716.6. Samples: 76853256. Policy #0 lag: (min: 6.0, avg: 6.0, max: 6.0) [2023-03-08 12:19:58,080][389401] Avg episode reward: [(0, '4733.156')] [2023-03-08 12:20:00,181][389688] Updated weights for policy 0, policy_version 150160 (0.0005) [2023-03-08 12:20:03,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11605.4, 300 sec: 11913.1). Total num frames: 76910592. Throughput: 0: 11699.5. Samples: 76886968. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:20:03,080][389401] Avg episode reward: [(0, '4699.966')] [2023-03-08 12:20:03,809][389688] Updated weights for policy 0, policy_version 150240 (0.0005) [2023-03-08 12:20:07,383][389688] Updated weights for policy 0, policy_version 150320 (0.0005) [2023-03-08 12:20:08,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11605.3, 300 sec: 11899.2). Total num frames: 76967936. Throughput: 0: 11695.6. Samples: 76955612. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:20:08,080][389401] Avg episode reward: [(0, '4733.325')] [2023-03-08 12:20:08,086][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000150336_76972032.pth... [2023-03-08 12:20:08,088][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000149648_76619776.pth [2023-03-08 12:20:10,917][389688] Updated weights for policy 0, policy_version 150400 (0.0005) [2023-03-08 12:20:13,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11913.1). Total num frames: 77029376. Throughput: 0: 11687.8. Samples: 77025264. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:20:13,080][389401] Avg episode reward: [(0, '4698.129')] [2023-03-08 12:20:14,409][389688] Updated weights for policy 0, policy_version 150480 (0.0005) [2023-03-08 12:20:17,954][389688] Updated weights for policy 0, policy_version 150560 (0.0005) [2023-03-08 12:20:18,079][389401] Fps is (10 sec: 11878.6, 60 sec: 11673.6, 300 sec: 11913.1). Total num frames: 77086720. Throughput: 0: 11717.6. Samples: 77061060. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:20:18,080][389401] Avg episode reward: [(0, '4370.172')] [2023-03-08 12:20:21,571][389688] Updated weights for policy 0, policy_version 150640 (0.0005) [2023-03-08 12:20:23,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11899.2). Total num frames: 77144064. Throughput: 0: 11667.3. Samples: 77128420. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:20:23,080][389401] Avg episode reward: [(0, '4735.852')] [2023-03-08 12:20:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000150672_77144064.pth... [2023-03-08 12:20:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000150000_76800000.pth [2023-03-08 12:20:25,078][389688] Updated weights for policy 0, policy_version 150720 (0.0005) [2023-03-08 12:20:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11885.3). Total num frames: 77201408. Throughput: 0: 11571.5. Samples: 77197908. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:20:28,080][389401] Avg episode reward: [(0, '4635.089')] [2023-03-08 12:20:28,635][389688] Updated weights for policy 0, policy_version 150800 (0.0005) [2023-03-08 12:20:32,172][389688] Updated weights for policy 0, policy_version 150880 (0.0005) [2023-03-08 12:20:33,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11857.6). Total num frames: 77258752. Throughput: 0: 11538.2. Samples: 77232236. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:20:33,080][389401] Avg episode reward: [(0, '4734.762')] [2023-03-08 12:20:35,759][389688] Updated weights for policy 0, policy_version 150960 (0.0005) [2023-03-08 12:20:38,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11857.6). Total num frames: 77316096. Throughput: 0: 11533.6. Samples: 77302628. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:20:38,080][389401] Avg episode reward: [(0, '4735.801')] [2023-03-08 12:20:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000151008_77316096.pth... [2023-03-08 12:20:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000150336_76972032.pth [2023-03-08 12:20:39,267][389688] Updated weights for policy 0, policy_version 151040 (0.0005) [2023-03-08 12:20:42,887][389688] Updated weights for policy 0, policy_version 151120 (0.0005) [2023-03-08 12:20:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11829.8). Total num frames: 77373440. Throughput: 0: 11504.6. Samples: 77370964. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:20:43,080][389401] Avg episode reward: [(0, '4734.631')] [2023-03-08 12:20:46,439][389688] Updated weights for policy 0, policy_version 151200 (0.0004) [2023-03-08 12:20:48,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11815.9). Total num frames: 77430784. Throughput: 0: 11538.7. Samples: 77406208. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:20:48,080][389401] Avg episode reward: [(0, '4720.106')] [2023-03-08 12:20:50,063][389688] Updated weights for policy 0, policy_version 151280 (0.0004) [2023-03-08 12:20:53,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11802.0). Total num frames: 77488128. Throughput: 0: 11505.2. Samples: 77473344. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:20:53,090][389401] Avg episode reward: [(0, '4728.362')] [2023-03-08 12:20:53,094][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000151344_77488128.pth... [2023-03-08 12:20:53,096][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000150672_77144064.pth [2023-03-08 12:20:53,639][389688] Updated weights for policy 0, policy_version 151360 (0.0005) [2023-03-08 12:20:57,367][389688] Updated weights for policy 0, policy_version 151440 (0.0005) [2023-03-08 12:20:58,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11400.5, 300 sec: 11774.3). Total num frames: 77541376. Throughput: 0: 11464.0. Samples: 77541144. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:20:58,080][389401] Avg episode reward: [(0, '4720.879')] [2023-03-08 12:21:00,915][389688] Updated weights for policy 0, policy_version 151520 (0.0004) [2023-03-08 12:21:03,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11788.1). Total num frames: 77602816. Throughput: 0: 11430.4. Samples: 77575428. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:21:03,080][389401] Avg episode reward: [(0, '4452.026')] [2023-03-08 12:21:04,471][389688] Updated weights for policy 0, policy_version 151600 (0.0004) [2023-03-08 12:21:07,946][389688] Updated weights for policy 0, policy_version 151680 (0.0005) [2023-03-08 12:21:08,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11537.1, 300 sec: 11788.1). Total num frames: 77660160. Throughput: 0: 11469.2. Samples: 77644536. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:21:08,080][389401] Avg episode reward: [(0, '4708.551')] [2023-03-08 12:21:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000151680_77660160.pth... [2023-03-08 12:21:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000151008_77316096.pth [2023-03-08 12:21:11,508][389688] Updated weights for policy 0, policy_version 151760 (0.0005) [2023-03-08 12:21:13,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11774.3). Total num frames: 77717504. Throughput: 0: 11474.3. Samples: 77714252. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:21:13,080][389401] Avg episode reward: [(0, '4665.313')] [2023-03-08 12:21:15,094][389688] Updated weights for policy 0, policy_version 151840 (0.0005) [2023-03-08 12:21:18,079][389401] Fps is (10 sec: 11469.0, 60 sec: 11468.8, 300 sec: 11774.3). Total num frames: 77774848. Throughput: 0: 11482.1. Samples: 77748932. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:21:18,080][389401] Avg episode reward: [(0, '4735.619')] [2023-03-08 12:21:18,599][389688] Updated weights for policy 0, policy_version 151920 (0.0005) [2023-03-08 12:21:22,157][389688] Updated weights for policy 0, policy_version 152000 (0.0005) [2023-03-08 12:21:23,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11468.8, 300 sec: 11774.3). Total num frames: 77832192. Throughput: 0: 11471.0. Samples: 77818824. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:21:23,080][389401] Avg episode reward: [(0, '4733.363')] [2023-03-08 12:21:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000152016_77832192.pth... [2023-03-08 12:21:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000151344_77488128.pth [2023-03-08 12:21:25,828][389688] Updated weights for policy 0, policy_version 152080 (0.0005) [2023-03-08 12:21:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11774.3). Total num frames: 77889536. Throughput: 0: 11448.4. Samples: 77886140. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:21:28,080][389401] Avg episode reward: [(0, '4735.706')] [2023-03-08 12:21:29,440][389688] Updated weights for policy 0, policy_version 152160 (0.0005) [2023-03-08 12:21:33,008][389688] Updated weights for policy 0, policy_version 152240 (0.0005) [2023-03-08 12:21:33,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11760.4). Total num frames: 77946880. Throughput: 0: 11422.9. Samples: 77920240. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:21:33,080][389401] Avg episode reward: [(0, '4735.358')] [2023-03-08 12:21:36,544][389688] Updated weights for policy 0, policy_version 152320 (0.0005) [2023-03-08 12:21:38,079][389401] Fps is (10 sec: 11468.6, 60 sec: 11468.8, 300 sec: 11746.5). Total num frames: 78004224. Throughput: 0: 11459.2. Samples: 77989008. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:21:38,080][389401] Avg episode reward: [(0, '4734.349')] [2023-03-08 12:21:38,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000152352_78004224.pth... [2023-03-08 12:21:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000151680_77660160.pth [2023-03-08 12:21:39,895][389688] Updated weights for policy 0, policy_version 152400 (0.0004) [2023-03-08 12:21:43,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 11746.5). Total num frames: 78065664. Throughput: 0: 11593.2. Samples: 78062840. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:21:43,080][389401] Avg episode reward: [(0, '4663.713')] [2023-03-08 12:21:43,186][389688] Updated weights for policy 0, policy_version 152480 (0.0004) [2023-03-08 12:21:46,409][389688] Updated weights for policy 0, policy_version 152560 (0.0004) [2023-03-08 12:21:48,079][389401] Fps is (10 sec: 12697.8, 60 sec: 11673.6, 300 sec: 11760.4). Total num frames: 78131200. Throughput: 0: 11683.5. Samples: 78101184. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:21:48,080][389401] Avg episode reward: [(0, '4733.467')] [2023-03-08 12:21:49,656][389688] Updated weights for policy 0, policy_version 152640 (0.0004) [2023-03-08 12:21:53,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11673.6, 300 sec: 11746.5). Total num frames: 78188544. Throughput: 0: 11812.0. Samples: 78176076. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:21:53,080][389401] Avg episode reward: [(0, '4737.157')] [2023-03-08 12:21:53,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000152712_78188544.pth... [2023-03-08 12:21:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000152016_77832192.pth [2023-03-08 12:21:53,160][389688] Updated weights for policy 0, policy_version 152720 (0.0005) [2023-03-08 12:21:56,777][389688] Updated weights for policy 0, policy_version 152800 (0.0005) [2023-03-08 12:21:58,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11741.9, 300 sec: 11732.6). Total num frames: 78245888. Throughput: 0: 11767.4. Samples: 78243788. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:21:58,080][389401] Avg episode reward: [(0, '4734.211')] [2023-03-08 12:22:00,267][389688] Updated weights for policy 0, policy_version 152880 (0.0005) [2023-03-08 12:22:03,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 11718.7). Total num frames: 78303232. Throughput: 0: 11773.0. Samples: 78278720. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:22:03,080][389401] Avg episode reward: [(0, '4735.937')] [2023-03-08 12:22:03,824][389688] Updated weights for policy 0, policy_version 152960 (0.0005) [2023-03-08 12:22:07,457][389688] Updated weights for policy 0, policy_version 153040 (0.0005) [2023-03-08 12:22:08,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11704.8). Total num frames: 78360576. Throughput: 0: 11760.8. Samples: 78348060. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:22:08,080][389401] Avg episode reward: [(0, '4736.599')] [2023-03-08 12:22:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000153048_78360576.pth... [2023-03-08 12:22:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000152352_78004224.pth [2023-03-08 12:22:11,112][389688] Updated weights for policy 0, policy_version 153120 (0.0005) [2023-03-08 12:22:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11691.0). Total num frames: 78417920. Throughput: 0: 11739.9. Samples: 78414436. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:22:13,080][389401] Avg episode reward: [(0, '4734.521')] [2023-03-08 12:22:14,716][389688] Updated weights for policy 0, policy_version 153200 (0.0005) [2023-03-08 12:22:18,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11677.1). Total num frames: 78475264. Throughput: 0: 11748.8. Samples: 78448936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:22:18,080][389401] Avg episode reward: [(0, '4735.460')] [2023-03-08 12:22:18,309][389688] Updated weights for policy 0, policy_version 153280 (0.0005) [2023-03-08 12:22:21,967][389688] Updated weights for policy 0, policy_version 153360 (0.0004) [2023-03-08 12:22:23,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11677.1). Total num frames: 78532608. Throughput: 0: 11725.6. Samples: 78516660. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:22:23,080][389401] Avg episode reward: [(0, '4708.478')] [2023-03-08 12:22:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000153384_78532608.pth... [2023-03-08 12:22:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000152712_78188544.pth [2023-03-08 12:22:25,552][389688] Updated weights for policy 0, policy_version 153440 (0.0005) [2023-03-08 12:22:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11677.1). Total num frames: 78589952. Throughput: 0: 11622.6. Samples: 78585856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:22:28,080][389401] Avg episode reward: [(0, '4738.869')] [2023-03-08 12:22:29,167][389688] Updated weights for policy 0, policy_version 153520 (0.0005) [2023-03-08 12:22:32,712][389688] Updated weights for policy 0, policy_version 153600 (0.0005) [2023-03-08 12:22:33,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11677.1). Total num frames: 78647296. Throughput: 0: 11500.2. Samples: 78618696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:22:33,080][389401] Avg episode reward: [(0, '4712.416')] [2023-03-08 12:22:36,272][389688] Updated weights for policy 0, policy_version 153680 (0.0005) [2023-03-08 12:22:38,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 11663.2). Total num frames: 78704640. Throughput: 0: 11383.2. Samples: 78688320. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:22:38,080][389401] Avg episode reward: [(0, '4734.909')] [2023-03-08 12:22:38,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000153720_78704640.pth... [2023-03-08 12:22:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000153048_78360576.pth [2023-03-08 12:22:39,786][389688] Updated weights for policy 0, policy_version 153760 (0.0004) [2023-03-08 12:22:43,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11649.3). Total num frames: 78761984. Throughput: 0: 11426.0. Samples: 78757960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:22:43,080][389401] Avg episode reward: [(0, '4736.670')] [2023-03-08 12:22:43,348][389688] Updated weights for policy 0, policy_version 153840 (0.0004) [2023-03-08 12:22:46,755][389688] Updated weights for policy 0, policy_version 153920 (0.0003) [2023-03-08 12:22:48,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11468.8, 300 sec: 11635.4). Total num frames: 78819328. Throughput: 0: 11449.5. Samples: 78793948. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:22:48,080][389401] Avg episode reward: [(0, '4736.543')] [2023-03-08 12:22:50,066][389688] Updated weights for policy 0, policy_version 154000 (0.0005) [2023-03-08 12:22:53,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11605.3, 300 sec: 11649.3). Total num frames: 78884864. Throughput: 0: 11563.4. Samples: 78868412. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:22:53,080][389401] Avg episode reward: [(0, '4736.128')] [2023-03-08 12:22:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000154072_78884864.pth... [2023-03-08 12:22:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000153384_78532608.pth [2023-03-08 12:22:53,365][389688] Updated weights for policy 0, policy_version 154080 (0.0004) [2023-03-08 12:22:56,778][389688] Updated weights for policy 0, policy_version 154160 (0.0005) [2023-03-08 12:22:58,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11605.3, 300 sec: 11649.3). Total num frames: 78942208. Throughput: 0: 11677.3. Samples: 78939916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:22:58,080][389401] Avg episode reward: [(0, '4736.280')] [2023-03-08 12:23:00,421][389688] Updated weights for policy 0, policy_version 154240 (0.0005) [2023-03-08 12:23:03,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11649.3). Total num frames: 78999552. Throughput: 0: 11665.2. Samples: 78973872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:23:03,080][389401] Avg episode reward: [(0, '4738.819')] [2023-03-08 12:23:04,074][389688] Updated weights for policy 0, policy_version 154320 (0.0004) [2023-03-08 12:23:07,484][389688] Updated weights for policy 0, policy_version 154400 (0.0005) [2023-03-08 12:23:08,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11649.3). Total num frames: 79056896. Throughput: 0: 11687.1. Samples: 79042580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:23:08,080][389401] Avg episode reward: [(0, '4737.205')] [2023-03-08 12:23:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000154408_79056896.pth... [2023-03-08 12:23:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000153720_78704640.pth [2023-03-08 12:23:11,021][389688] Updated weights for policy 0, policy_version 154480 (0.0005) [2023-03-08 12:23:13,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11663.2). Total num frames: 79118336. Throughput: 0: 11722.7. Samples: 79113380. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:23:13,080][389401] Avg episode reward: [(0, '4722.420')] [2023-03-08 12:23:14,380][389688] Updated weights for policy 0, policy_version 154560 (0.0004) [2023-03-08 12:23:17,896][389688] Updated weights for policy 0, policy_version 154640 (0.0005) [2023-03-08 12:23:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11663.2). Total num frames: 79175680. Throughput: 0: 11796.5. Samples: 79149540. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:23:18,080][389401] Avg episode reward: [(0, '4731.511')] [2023-03-08 12:23:21,508][389688] Updated weights for policy 0, policy_version 154720 (0.0005) [2023-03-08 12:23:23,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11663.2). Total num frames: 79233024. Throughput: 0: 11780.5. Samples: 79218440. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:23:23,080][389401] Avg episode reward: [(0, '4735.093')] [2023-03-08 12:23:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000154752_79233024.pth... [2023-03-08 12:23:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000154072_78884864.pth [2023-03-08 12:23:25,102][389688] Updated weights for policy 0, policy_version 154800 (0.0005) [2023-03-08 12:23:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11649.3). Total num frames: 79290368. Throughput: 0: 11741.7. Samples: 79286336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:23:28,080][389401] Avg episode reward: [(0, '4727.409')] [2023-03-08 12:23:28,744][389688] Updated weights for policy 0, policy_version 154880 (0.0005) [2023-03-08 12:23:32,324][389688] Updated weights for policy 0, policy_version 154960 (0.0005) [2023-03-08 12:23:33,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 11649.3). Total num frames: 79347712. Throughput: 0: 11703.0. Samples: 79320584. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:23:33,080][389401] Avg episode reward: [(0, '4733.436')] [2023-03-08 12:23:35,887][389688] Updated weights for policy 0, policy_version 155040 (0.0005) [2023-03-08 12:23:38,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11621.5). Total num frames: 79405056. Throughput: 0: 11562.7. Samples: 79388736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:23:38,080][389401] Avg episode reward: [(0, '4739.383')] [2023-03-08 12:23:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000155088_79405056.pth... [2023-03-08 12:23:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000154408_79056896.pth [2023-03-08 12:23:39,431][389688] Updated weights for policy 0, policy_version 155120 (0.0005) [2023-03-08 12:23:42,975][389688] Updated weights for policy 0, policy_version 155200 (0.0005) [2023-03-08 12:23:43,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 11607.6). Total num frames: 79462400. Throughput: 0: 11523.6. Samples: 79458476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:23:43,080][389401] Avg episode reward: [(0, '4738.345')] [2023-03-08 12:23:46,504][389688] Updated weights for policy 0, policy_version 155280 (0.0005) [2023-03-08 12:23:48,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11593.8). Total num frames: 79519744. Throughput: 0: 11537.5. Samples: 79493060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:23:48,080][389401] Avg episode reward: [(0, '4734.560')] [2023-03-08 12:23:49,856][389688] Updated weights for policy 0, policy_version 155360 (0.0004) [2023-03-08 12:23:53,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 11607.6). Total num frames: 79581184. Throughput: 0: 11607.2. Samples: 79564904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:23:53,086][389401] Avg episode reward: [(0, '4730.640')] [2023-03-08 12:23:53,089][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000155432_79581184.pth... [2023-03-08 12:23:53,092][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000154752_79233024.pth [2023-03-08 12:23:53,351][389688] Updated weights for policy 0, policy_version 155440 (0.0005) [2023-03-08 12:23:56,896][389688] Updated weights for policy 0, policy_version 155520 (0.0005) [2023-03-08 12:23:58,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11607.7). Total num frames: 79638528. Throughput: 0: 11581.6. Samples: 79634552. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:23:58,090][389401] Avg episode reward: [(0, '4730.371')] [2023-03-08 12:24:00,415][389688] Updated weights for policy 0, policy_version 155600 (0.0005) [2023-03-08 12:24:03,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11607.6). Total num frames: 79695872. Throughput: 0: 11572.8. Samples: 79670316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:24:03,090][389401] Avg episode reward: [(0, '4734.136')] [2023-03-08 12:24:03,997][389688] Updated weights for policy 0, policy_version 155680 (0.0005) [2023-03-08 12:24:07,562][389688] Updated weights for policy 0, policy_version 155760 (0.0005) [2023-03-08 12:24:08,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11607.6). Total num frames: 79753216. Throughput: 0: 11583.9. Samples: 79739716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:24:08,080][389401] Avg episode reward: [(0, '4726.588')] [2023-03-08 12:24:08,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000155768_79753216.pth... [2023-03-08 12:24:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000155088_79405056.pth [2023-03-08 12:24:10,885][389688] Updated weights for policy 0, policy_version 155840 (0.0004) [2023-03-08 12:24:13,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11621.5). Total num frames: 79814656. Throughput: 0: 11668.3. Samples: 79811408. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:24:13,080][389401] Avg episode reward: [(0, '4728.492')] [2023-03-08 12:24:14,196][389688] Updated weights for policy 0, policy_version 155920 (0.0005) [2023-03-08 12:24:17,495][389688] Updated weights for policy 0, policy_version 156000 (0.0005) [2023-03-08 12:24:18,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11673.6, 300 sec: 11635.4). Total num frames: 79876096. Throughput: 0: 11740.0. Samples: 79848884. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:24:18,080][389401] Avg episode reward: [(0, '4730.433')] [2023-03-08 12:24:20,750][389688] Updated weights for policy 0, policy_version 156080 (0.0004) [2023-03-08 12:24:23,079][389401] Fps is (10 sec: 12697.5, 60 sec: 11810.1, 300 sec: 11663.2). Total num frames: 79941632. Throughput: 0: 11912.5. Samples: 79924800. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:24:23,080][389401] Avg episode reward: [(0, '4729.681')] [2023-03-08 12:24:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000156136_79941632.pth... [2023-03-08 12:24:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000155432_79581184.pth [2023-03-08 12:24:23,980][389688] Updated weights for policy 0, policy_version 156160 (0.0004) [2023-03-08 12:24:27,199][389688] Updated weights for policy 0, policy_version 156240 (0.0004) [2023-03-08 12:24:28,079][389401] Fps is (10 sec: 12697.6, 60 sec: 11878.4, 300 sec: 11677.1). Total num frames: 80003072. Throughput: 0: 12043.6. Samples: 80000436. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:24:28,080][389401] Avg episode reward: [(0, '4723.678')] [2023-03-08 12:24:30,498][389688] Updated weights for policy 0, policy_version 156320 (0.0005) [2023-03-08 12:24:33,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11946.7, 300 sec: 11691.0). Total num frames: 80064512. Throughput: 0: 12104.5. Samples: 80037760. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:24:33,080][389401] Avg episode reward: [(0, '4727.640')] [2023-03-08 12:24:34,060][389688] Updated weights for policy 0, policy_version 156400 (0.0005) [2023-03-08 12:24:37,643][389688] Updated weights for policy 0, policy_version 156480 (0.0005) [2023-03-08 12:24:38,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11946.7, 300 sec: 11663.2). Total num frames: 80121856. Throughput: 0: 12027.5. Samples: 80106140. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:24:38,080][389401] Avg episode reward: [(0, '4723.935')] [2023-03-08 12:24:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000156488_80121856.pth... [2023-03-08 12:24:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000155768_79753216.pth [2023-03-08 12:24:41,164][389688] Updated weights for policy 0, policy_version 156560 (0.0005) [2023-03-08 12:24:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11663.2). Total num frames: 80179200. Throughput: 0: 12033.9. Samples: 80176076. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:24:43,080][389401] Avg episode reward: [(0, '4726.476')] [2023-03-08 12:24:44,611][389688] Updated weights for policy 0, policy_version 156640 (0.0005) [2023-03-08 12:24:48,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11649.3). Total num frames: 80236544. Throughput: 0: 12038.2. Samples: 80212032. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:24:48,080][389401] Avg episode reward: [(0, '4728.413')] [2023-03-08 12:24:48,175][389688] Updated weights for policy 0, policy_version 156720 (0.0005) [2023-03-08 12:24:51,779][389688] Updated weights for policy 0, policy_version 156800 (0.0005) [2023-03-08 12:24:53,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11878.4, 300 sec: 11649.3). Total num frames: 80293888. Throughput: 0: 12010.1. Samples: 80280168. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:24:53,080][389401] Avg episode reward: [(0, '4729.929')] [2023-03-08 12:24:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000156824_80293888.pth... [2023-03-08 12:24:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000156136_79941632.pth [2023-03-08 12:24:55,204][389688] Updated weights for policy 0, policy_version 156880 (0.0004) [2023-03-08 12:24:58,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11677.1). Total num frames: 80355328. Throughput: 0: 11997.5. Samples: 80351296. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:24:58,090][389401] Avg episode reward: [(0, '4732.142')] [2023-03-08 12:24:58,728][389688] Updated weights for policy 0, policy_version 156960 (0.0005) [2023-03-08 12:25:02,195][389688] Updated weights for policy 0, policy_version 157040 (0.0004) [2023-03-08 12:25:03,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 11677.1). Total num frames: 80412672. Throughput: 0: 11943.6. Samples: 80386348. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:25:03,090][389401] Avg episode reward: [(0, '4735.527')] [2023-03-08 12:25:05,645][389688] Updated weights for policy 0, policy_version 157120 (0.0004) [2023-03-08 12:25:08,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12014.9, 300 sec: 11677.1). Total num frames: 80474112. Throughput: 0: 11844.3. Samples: 80457792. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:25:08,090][389401] Avg episode reward: [(0, '4736.944')] [2023-03-08 12:25:08,093][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000157176_80474112.pth... [2023-03-08 12:25:08,096][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000156488_80121856.pth [2023-03-08 12:25:08,936][389688] Updated weights for policy 0, policy_version 157200 (0.0003) [2023-03-08 12:25:12,243][389688] Updated weights for policy 0, policy_version 157280 (0.0004) [2023-03-08 12:25:13,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12014.9, 300 sec: 11691.0). Total num frames: 80535552. Throughput: 0: 11802.2. Samples: 80531536. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:25:13,090][389401] Avg episode reward: [(0, '4737.066')] [2023-03-08 12:25:15,942][389688] Updated weights for policy 0, policy_version 157360 (0.0005) [2023-03-08 12:25:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11691.0). Total num frames: 80592896. Throughput: 0: 11717.1. Samples: 80565032. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:25:18,090][389401] Avg episode reward: [(0, '4737.439')] [2023-03-08 12:25:19,436][389688] Updated weights for policy 0, policy_version 157440 (0.0005) [2023-03-08 12:25:22,683][389688] Updated weights for policy 0, policy_version 157520 (0.0004) [2023-03-08 12:25:23,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11878.4, 300 sec: 11704.8). Total num frames: 80654336. Throughput: 0: 11808.5. Samples: 80637524. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:25:23,080][389401] Avg episode reward: [(0, '4736.827')] [2023-03-08 12:25:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000157528_80654336.pth... [2023-03-08 12:25:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000156824_80293888.pth [2023-03-08 12:25:25,927][389688] Updated weights for policy 0, policy_version 157600 (0.0004) [2023-03-08 12:25:28,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11718.7). Total num frames: 80715776. Throughput: 0: 11929.8. Samples: 80712916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:25:28,080][389401] Avg episode reward: [(0, '4735.396')] [2023-03-08 12:25:29,144][389688] Updated weights for policy 0, policy_version 157680 (0.0004) [2023-03-08 12:25:32,392][389688] Updated weights for policy 0, policy_version 157760 (0.0004) [2023-03-08 12:25:33,079][389401] Fps is (10 sec: 12697.7, 60 sec: 11946.7, 300 sec: 11746.5). Total num frames: 80781312. Throughput: 0: 11979.5. Samples: 80751108. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:25:33,080][389401] Avg episode reward: [(0, '4664.539')] [2023-03-08 12:25:35,640][389688] Updated weights for policy 0, policy_version 157840 (0.0004) [2023-03-08 12:25:38,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11760.4). Total num frames: 80842752. Throughput: 0: 12145.8. Samples: 80826728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:25:38,080][389401] Avg episode reward: [(0, '4732.503')] [2023-03-08 12:25:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000157896_80842752.pth... [2023-03-08 12:25:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000157176_80474112.pth [2023-03-08 12:25:38,880][389688] Updated weights for policy 0, policy_version 157920 (0.0004) [2023-03-08 12:25:42,393][389688] Updated weights for policy 0, policy_version 158000 (0.0005) [2023-03-08 12:25:43,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12014.9, 300 sec: 11760.4). Total num frames: 80900096. Throughput: 0: 12181.0. Samples: 80899444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:25:43,080][389401] Avg episode reward: [(0, '4736.294')] [2023-03-08 12:25:45,812][389688] Updated weights for policy 0, policy_version 158080 (0.0005) [2023-03-08 12:25:48,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11774.3). Total num frames: 80961536. Throughput: 0: 12196.7. Samples: 80935200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:25:48,080][389401] Avg episode reward: [(0, '4736.517')] [2023-03-08 12:25:49,371][389688] Updated weights for policy 0, policy_version 158160 (0.0005) [2023-03-08 12:25:52,936][389688] Updated weights for policy 0, policy_version 158240 (0.0005) [2023-03-08 12:25:53,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11788.1). Total num frames: 81018880. Throughput: 0: 12128.5. Samples: 81003576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:25:53,080][389401] Avg episode reward: [(0, '4695.449')] [2023-03-08 12:25:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000158240_81018880.pth... [2023-03-08 12:25:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000157528_80654336.pth [2023-03-08 12:25:56,497][389688] Updated weights for policy 0, policy_version 158320 (0.0005) [2023-03-08 12:25:58,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11774.3). Total num frames: 81076224. Throughput: 0: 12076.9. Samples: 81074996. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:25:58,080][389401] Avg episode reward: [(0, '4668.002')] [2023-03-08 12:25:59,762][389688] Updated weights for policy 0, policy_version 158400 (0.0004) [2023-03-08 12:26:03,042][389688] Updated weights for policy 0, policy_version 158480 (0.0004) [2023-03-08 12:26:03,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12151.5, 300 sec: 11802.0). Total num frames: 81141760. Throughput: 0: 12155.4. Samples: 81112024. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:26:03,090][389401] Avg episode reward: [(0, '4735.771')] [2023-03-08 12:26:06,547][389688] Updated weights for policy 0, policy_version 158560 (0.0005) [2023-03-08 12:26:08,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11802.0). Total num frames: 81199104. Throughput: 0: 12140.5. Samples: 81183848. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:26:08,080][389401] Avg episode reward: [(0, '4734.506')] [2023-03-08 12:26:08,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000158592_81199104.pth... [2023-03-08 12:26:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000157896_80842752.pth [2023-03-08 12:26:10,147][389688] Updated weights for policy 0, policy_version 158640 (0.0005) [2023-03-08 12:26:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11802.0). Total num frames: 81256448. Throughput: 0: 11997.5. Samples: 81252804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:26:13,080][389401] Avg episode reward: [(0, '4738.016')] [2023-03-08 12:26:13,602][389688] Updated weights for policy 0, policy_version 158720 (0.0005) [2023-03-08 12:26:17,198][389688] Updated weights for policy 0, policy_version 158800 (0.0005) [2023-03-08 12:26:18,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11802.0). Total num frames: 81313792. Throughput: 0: 11944.4. Samples: 81288604. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:26:18,080][389401] Avg episode reward: [(0, '4737.831')] [2023-03-08 12:26:20,691][389688] Updated weights for policy 0, policy_version 158880 (0.0005) [2023-03-08 12:26:23,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 11802.0). Total num frames: 81371136. Throughput: 0: 11808.1. Samples: 81358092. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:26:23,080][389401] Avg episode reward: [(0, '4737.740')] [2023-03-08 12:26:23,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000158928_81371136.pth... [2023-03-08 12:26:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000158240_81018880.pth [2023-03-08 12:26:24,219][389688] Updated weights for policy 0, policy_version 158960 (0.0005) [2023-03-08 12:26:27,747][389688] Updated weights for policy 0, policy_version 159040 (0.0005) [2023-03-08 12:26:28,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11878.4, 300 sec: 11802.0). Total num frames: 81428480. Throughput: 0: 11747.9. Samples: 81428100. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 12:26:28,090][389401] Avg episode reward: [(0, '4736.883')] [2023-03-08 12:26:31,246][389688] Updated weights for policy 0, policy_version 159120 (0.0005) [2023-03-08 12:26:33,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11815.9). Total num frames: 81489920. Throughput: 0: 11709.1. Samples: 81462108. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 12:26:33,080][389401] Avg episode reward: [(0, '4738.032')] [2023-03-08 12:26:34,797][389688] Updated weights for policy 0, policy_version 159200 (0.0005) [2023-03-08 12:26:38,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11741.9, 300 sec: 11802.0). Total num frames: 81547264. Throughput: 0: 11722.0. Samples: 81531068. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 12:26:38,080][389401] Avg episode reward: [(0, '4737.679')] [2023-03-08 12:26:38,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000159272_81547264.pth... [2023-03-08 12:26:38,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000158592_81199104.pth [2023-03-08 12:26:38,346][389688] Updated weights for policy 0, policy_version 159280 (0.0005) [2023-03-08 12:26:41,923][389688] Updated weights for policy 0, policy_version 159360 (0.0005) [2023-03-08 12:26:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11774.3). Total num frames: 81604608. Throughput: 0: 11684.7. Samples: 81600808. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 12:26:43,080][389401] Avg episode reward: [(0, '4731.987')] [2023-03-08 12:26:45,474][389688] Updated weights for policy 0, policy_version 159440 (0.0005) [2023-03-08 12:26:48,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 11774.3). Total num frames: 81661952. Throughput: 0: 11631.6. Samples: 81635444. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 12:26:48,080][389401] Avg episode reward: [(0, '4736.864')] [2023-03-08 12:26:49,028][389688] Updated weights for policy 0, policy_version 159520 (0.0005) [2023-03-08 12:26:52,524][389688] Updated weights for policy 0, policy_version 159600 (0.0005) [2023-03-08 12:26:53,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11774.3). Total num frames: 81719296. Throughput: 0: 11592.4. Samples: 81705504. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 12:26:53,080][389401] Avg episode reward: [(0, '4738.258')] [2023-03-08 12:26:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000159608_81719296.pth... [2023-03-08 12:26:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000158928_81371136.pth [2023-03-08 12:26:55,962][389688] Updated weights for policy 0, policy_version 159680 (0.0005) [2023-03-08 12:26:58,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11788.2). Total num frames: 81780736. Throughput: 0: 11652.7. Samples: 81777176. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 12:26:58,080][389401] Avg episode reward: [(0, '4728.679')] [2023-03-08 12:26:59,241][389688] Updated weights for policy 0, policy_version 159760 (0.0005) [2023-03-08 12:27:02,437][389688] Updated weights for policy 0, policy_version 159840 (0.0004) [2023-03-08 12:27:03,079][389401] Fps is (10 sec: 12288.1, 60 sec: 11673.6, 300 sec: 11802.0). Total num frames: 81842176. Throughput: 0: 11712.7. Samples: 81815676. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 12:27:03,080][389401] Avg episode reward: [(0, '4691.937')] [2023-03-08 12:27:05,719][389688] Updated weights for policy 0, policy_version 159920 (0.0004) [2023-03-08 12:27:08,079][389401] Fps is (10 sec: 12697.6, 60 sec: 11810.1, 300 sec: 11829.8). Total num frames: 81907712. Throughput: 0: 11833.9. Samples: 81890620. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 12:27:08,080][389401] Avg episode reward: [(0, '4695.944')] [2023-03-08 12:27:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000159976_81907712.pth... [2023-03-08 12:27:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000159272_81547264.pth [2023-03-08 12:27:08,989][389688] Updated weights for policy 0, policy_version 160000 (0.0005) [2023-03-08 12:27:12,289][389688] Updated weights for policy 0, policy_version 160080 (0.0005) [2023-03-08 12:27:13,079][389401] Fps is (10 sec: 12697.5, 60 sec: 11878.4, 300 sec: 11843.7). Total num frames: 81969152. Throughput: 0: 11939.4. Samples: 81965376. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 12:27:13,080][389401] Avg episode reward: [(0, '4697.117')] [2023-03-08 12:27:15,455][389688] Updated weights for policy 0, policy_version 160160 (0.0004) [2023-03-08 12:27:18,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11871.5). Total num frames: 82034688. Throughput: 0: 12049.8. Samples: 82004348. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 12:27:18,080][389401] Avg episode reward: [(0, '4738.015')] [2023-03-08 12:27:18,678][389688] Updated weights for policy 0, policy_version 160240 (0.0004) [2023-03-08 12:27:21,910][389688] Updated weights for policy 0, policy_version 160320 (0.0004) [2023-03-08 12:27:23,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12083.2, 300 sec: 11885.3). Total num frames: 82096128. Throughput: 0: 12207.5. Samples: 82080404. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 12:27:23,080][389401] Avg episode reward: [(0, '4720.681')] [2023-03-08 12:27:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000160344_82096128.pth... [2023-03-08 12:27:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000159608_81719296.pth [2023-03-08 12:27:25,114][389688] Updated weights for policy 0, policy_version 160400 (0.0004) [2023-03-08 12:27:28,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12219.7, 300 sec: 11913.1). Total num frames: 82161664. Throughput: 0: 12366.6. Samples: 82157304. Policy #0 lag: (min: 2.0, avg: 2.0, max: 2.0) [2023-03-08 12:27:28,080][389401] Avg episode reward: [(0, '4740.409')] [2023-03-08 12:27:28,342][389688] Updated weights for policy 0, policy_version 160480 (0.0004) [2023-03-08 12:27:31,590][389688] Updated weights for policy 0, policy_version 160560 (0.0004) [2023-03-08 12:27:33,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 11927.0). Total num frames: 82223104. Throughput: 0: 12423.5. Samples: 82194504. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:27:33,080][389401] Avg episode reward: [(0, '4638.671')] [2023-03-08 12:27:34,880][389688] Updated weights for policy 0, policy_version 160640 (0.0005) [2023-03-08 12:27:38,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 11940.9). Total num frames: 82284544. Throughput: 0: 12544.2. Samples: 82269992. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:27:38,080][389401] Avg episode reward: [(0, '4735.516')] [2023-03-08 12:27:38,109][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000160720_82288640.pth... [2023-03-08 12:27:38,109][389688] Updated weights for policy 0, policy_version 160720 (0.0005) [2023-03-08 12:27:38,111][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000159976_81907712.pth [2023-03-08 12:27:41,358][389688] Updated weights for policy 0, policy_version 160800 (0.0005) [2023-03-08 12:27:43,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12424.5, 300 sec: 11968.7). Total num frames: 82350080. Throughput: 0: 12641.8. Samples: 82346056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:27:43,080][389401] Avg episode reward: [(0, '4734.110')] [2023-03-08 12:27:44,619][389688] Updated weights for policy 0, policy_version 160880 (0.0004) [2023-03-08 12:27:47,872][389688] Updated weights for policy 0, policy_version 160960 (0.0004) [2023-03-08 12:27:48,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12492.8, 300 sec: 11954.8). Total num frames: 82411520. Throughput: 0: 12620.9. Samples: 82383616. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:27:48,080][389401] Avg episode reward: [(0, '4686.420')] [2023-03-08 12:27:51,208][389688] Updated weights for policy 0, policy_version 161040 (0.0005) [2023-03-08 12:27:53,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12561.1, 300 sec: 11968.6). Total num frames: 82472960. Throughput: 0: 12599.5. Samples: 82457596. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:27:53,080][389401] Avg episode reward: [(0, '4678.994')] [2023-03-08 12:27:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000161080_82472960.pth... [2023-03-08 12:27:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000160344_82096128.pth [2023-03-08 12:27:54,507][389688] Updated weights for policy 0, policy_version 161120 (0.0004) [2023-03-08 12:27:57,783][389688] Updated weights for policy 0, policy_version 161200 (0.0005) [2023-03-08 12:27:58,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 11982.5). Total num frames: 82534400. Throughput: 0: 12610.8. Samples: 82532860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:27:58,080][389401] Avg episode reward: [(0, '4566.156')] [2023-03-08 12:28:01,063][389688] Updated weights for policy 0, policy_version 161280 (0.0005) [2023-03-08 12:28:03,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12629.3, 300 sec: 12010.3). Total num frames: 82599936. Throughput: 0: 12577.4. Samples: 82570332. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:28:03,080][389401] Avg episode reward: [(0, '4735.393')] [2023-03-08 12:28:04,397][389688] Updated weights for policy 0, policy_version 161360 (0.0005) [2023-03-08 12:28:07,641][389688] Updated weights for policy 0, policy_version 161440 (0.0004) [2023-03-08 12:28:08,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12561.1, 300 sec: 12010.3). Total num frames: 82661376. Throughput: 0: 12547.8. Samples: 82645056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:28:08,080][389401] Avg episode reward: [(0, '4740.971')] [2023-03-08 12:28:08,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000161448_82661376.pth... [2023-03-08 12:28:08,087][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000160720_82288640.pth [2023-03-08 12:28:10,858][389688] Updated weights for policy 0, policy_version 161520 (0.0004) [2023-03-08 12:28:13,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12629.3, 300 sec: 12038.1). Total num frames: 82726912. Throughput: 0: 12545.5. Samples: 82721852. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:28:13,080][389401] Avg episode reward: [(0, '4740.806')] [2023-03-08 12:28:13,983][389688] Updated weights for policy 0, policy_version 161600 (0.0003) [2023-03-08 12:28:17,331][389688] Updated weights for policy 0, policy_version 161680 (0.0005) [2023-03-08 12:28:18,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12561.1, 300 sec: 12052.0). Total num frames: 82788352. Throughput: 0: 12559.7. Samples: 82759692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:28:18,080][389401] Avg episode reward: [(0, '4740.684')] [2023-03-08 12:28:20,619][389688] Updated weights for policy 0, policy_version 161760 (0.0004) [2023-03-08 12:28:23,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12561.1, 300 sec: 12065.8). Total num frames: 82849792. Throughput: 0: 12521.9. Samples: 82833480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:28:23,080][389401] Avg episode reward: [(0, '4698.742')] [2023-03-08 12:28:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000161816_82849792.pth... [2023-03-08 12:28:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000161080_82472960.pth [2023-03-08 12:28:24,005][389688] Updated weights for policy 0, policy_version 161840 (0.0004) [2023-03-08 12:28:27,626][389688] Updated weights for policy 0, policy_version 161920 (0.0005) [2023-03-08 12:28:28,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12424.5, 300 sec: 12065.8). Total num frames: 82907136. Throughput: 0: 12379.0. Samples: 82903112. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:28:28,080][389401] Avg episode reward: [(0, '4609.983')] [2023-03-08 12:28:31,166][389688] Updated weights for policy 0, policy_version 162000 (0.0005) [2023-03-08 12:28:33,079][389401] Fps is (10 sec: 11468.9, 60 sec: 12356.3, 300 sec: 12065.8). Total num frames: 82964480. Throughput: 0: 12330.7. Samples: 82938496. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:28:33,090][389401] Avg episode reward: [(0, '4697.924')] [2023-03-08 12:28:34,786][389688] Updated weights for policy 0, policy_version 162080 (0.0005) [2023-03-08 12:28:38,079][389401] Fps is (10 sec: 11468.7, 60 sec: 12288.0, 300 sec: 12065.8). Total num frames: 83021824. Throughput: 0: 12187.6. Samples: 83006036. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:28:38,090][389401] Avg episode reward: [(0, '4694.629')] [2023-03-08 12:28:38,093][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000162152_83021824.pth... [2023-03-08 12:28:38,096][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000161448_82661376.pth [2023-03-08 12:28:38,407][389688] Updated weights for policy 0, policy_version 162160 (0.0005) [2023-03-08 12:28:41,982][389688] Updated weights for policy 0, policy_version 162240 (0.0005) [2023-03-08 12:28:43,079][389401] Fps is (10 sec: 11059.2, 60 sec: 12083.2, 300 sec: 12052.0). Total num frames: 83075072. Throughput: 0: 12049.2. Samples: 83075072. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:28:43,090][389401] Avg episode reward: [(0, '4535.200')] [2023-03-08 12:28:45,535][389688] Updated weights for policy 0, policy_version 162320 (0.0005) [2023-03-08 12:28:48,079][389401] Fps is (10 sec: 11468.9, 60 sec: 12083.2, 300 sec: 12052.0). Total num frames: 83136512. Throughput: 0: 11974.2. Samples: 83109172. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:28:48,079][389401] Avg episode reward: [(0, '4708.554')] [2023-03-08 12:28:49,160][389688] Updated weights for policy 0, policy_version 162400 (0.0005) [2023-03-08 12:28:52,638][389688] Updated weights for policy 0, policy_version 162480 (0.0005) [2023-03-08 12:28:53,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 12052.0). Total num frames: 83193856. Throughput: 0: 11841.3. Samples: 83177912. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:28:53,080][389401] Avg episode reward: [(0, '4721.066')] [2023-03-08 12:28:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000162488_83193856.pth... [2023-03-08 12:28:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000161816_82849792.pth [2023-03-08 12:28:56,229][389688] Updated weights for policy 0, policy_version 162560 (0.0005) [2023-03-08 12:28:58,079][389401] Fps is (10 sec: 11468.6, 60 sec: 11946.7, 300 sec: 12052.0). Total num frames: 83251200. Throughput: 0: 11673.7. Samples: 83247168. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:28:58,080][389401] Avg episode reward: [(0, '4716.184')] [2023-03-08 12:28:59,783][389688] Updated weights for policy 0, policy_version 162640 (0.0005) [2023-03-08 12:29:03,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 12052.0). Total num frames: 83308544. Throughput: 0: 11610.6. Samples: 83282168. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:29:03,080][389401] Avg episode reward: [(0, '4730.070')] [2023-03-08 12:29:03,324][389688] Updated weights for policy 0, policy_version 162720 (0.0005) [2023-03-08 12:29:06,939][389688] Updated weights for policy 0, policy_version 162800 (0.0005) [2023-03-08 12:29:08,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11741.9, 300 sec: 12038.1). Total num frames: 83365888. Throughput: 0: 11485.1. Samples: 83350308. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:29:08,080][389401] Avg episode reward: [(0, '4730.676')] [2023-03-08 12:29:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000162824_83365888.pth... [2023-03-08 12:29:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000162152_83021824.pth [2023-03-08 12:29:10,503][389688] Updated weights for policy 0, policy_version 162880 (0.0005) [2023-03-08 12:29:13,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 12024.2). Total num frames: 83423232. Throughput: 0: 11536.2. Samples: 83422240. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:29:13,080][389401] Avg episode reward: [(0, '4714.854')] [2023-03-08 12:29:13,843][389688] Updated weights for policy 0, policy_version 162960 (0.0004) [2023-03-08 12:29:17,470][389688] Updated weights for policy 0, policy_version 163040 (0.0005) [2023-03-08 12:29:18,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11996.4). Total num frames: 83480576. Throughput: 0: 11500.1. Samples: 83456000. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:29:18,080][389401] Avg episode reward: [(0, '4727.482')] [2023-03-08 12:29:21,102][389688] Updated weights for policy 0, policy_version 163120 (0.0005) [2023-03-08 12:29:23,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11982.5). Total num frames: 83537920. Throughput: 0: 11517.1. Samples: 83524308. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:29:23,080][389401] Avg episode reward: [(0, '4712.240')] [2023-03-08 12:29:23,107][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000163168_83542016.pth... [2023-03-08 12:29:23,108][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000162488_83193856.pth [2023-03-08 12:29:24,492][389688] Updated weights for policy 0, policy_version 163200 (0.0004) [2023-03-08 12:29:28,029][389688] Updated weights for policy 0, policy_version 163280 (0.0005) [2023-03-08 12:29:28,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11537.1, 300 sec: 11982.5). Total num frames: 83599360. Throughput: 0: 11561.2. Samples: 83595328. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:29:28,080][389401] Avg episode reward: [(0, '4703.165')] [2023-03-08 12:29:31,676][389688] Updated weights for policy 0, policy_version 163360 (0.0005) [2023-03-08 12:29:33,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11537.1, 300 sec: 11982.5). Total num frames: 83656704. Throughput: 0: 11546.1. Samples: 83628748. Policy #0 lag: (min: 3.0, avg: 3.0, max: 3.0) [2023-03-08 12:29:33,080][389401] Avg episode reward: [(0, '4710.702')] [2023-03-08 12:29:35,140][389688] Updated weights for policy 0, policy_version 163440 (0.0004) [2023-03-08 12:29:38,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 11982.5). Total num frames: 83714048. Throughput: 0: 11602.8. Samples: 83700040. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:29:38,080][389401] Avg episode reward: [(0, '4720.252')] [2023-03-08 12:29:38,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000163504_83714048.pth... [2023-03-08 12:29:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000162824_83365888.pth [2023-03-08 12:29:38,496][389688] Updated weights for policy 0, policy_version 163520 (0.0005) [2023-03-08 12:29:41,951][389688] Updated weights for policy 0, policy_version 163600 (0.0005) [2023-03-08 12:29:43,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11996.4). Total num frames: 83775488. Throughput: 0: 11649.8. Samples: 83771408. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:29:43,080][389401] Avg episode reward: [(0, '4741.565')] [2023-03-08 12:29:45,600][389688] Updated weights for policy 0, policy_version 163680 (0.0005) [2023-03-08 12:29:48,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11996.4). Total num frames: 83832832. Throughput: 0: 11606.4. Samples: 83804456. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:29:48,080][389401] Avg episode reward: [(0, '4734.895')] [2023-03-08 12:29:49,103][389688] Updated weights for policy 0, policy_version 163760 (0.0005) [2023-03-08 12:29:52,681][389688] Updated weights for policy 0, policy_version 163840 (0.0005) [2023-03-08 12:29:53,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11982.5). Total num frames: 83890176. Throughput: 0: 11639.0. Samples: 83874064. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:29:53,080][389401] Avg episode reward: [(0, '4735.033')] [2023-03-08 12:29:53,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000163848_83890176.pth... [2023-03-08 12:29:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000163168_83542016.pth [2023-03-08 12:29:56,370][389688] Updated weights for policy 0, policy_version 163920 (0.0005) [2023-03-08 12:29:58,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11968.7). Total num frames: 83943424. Throughput: 0: 11545.4. Samples: 83941784. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:29:58,080][389401] Avg episode reward: [(0, '4736.595')] [2023-03-08 12:29:59,990][389688] Updated weights for policy 0, policy_version 164000 (0.0005) [2023-03-08 12:30:03,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11537.1, 300 sec: 11954.8). Total num frames: 84000768. Throughput: 0: 11559.8. Samples: 83976192. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:30:03,080][389401] Avg episode reward: [(0, '4704.336')] [2023-03-08 12:30:03,590][389688] Updated weights for policy 0, policy_version 164080 (0.0004) [2023-03-08 12:30:06,866][389688] Updated weights for policy 0, policy_version 164160 (0.0003) [2023-03-08 12:30:08,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11605.3, 300 sec: 11954.8). Total num frames: 84062208. Throughput: 0: 11624.1. Samples: 84047392. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:30:08,080][389401] Avg episode reward: [(0, '4700.182')] [2023-03-08 12:30:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000164184_84062208.pth... [2023-03-08 12:30:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000163504_83714048.pth [2023-03-08 12:30:10,432][389688] Updated weights for policy 0, policy_version 164240 (0.0005) [2023-03-08 12:30:13,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11954.8). Total num frames: 84119552. Throughput: 0: 11564.0. Samples: 84115708. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:30:13,080][389401] Avg episode reward: [(0, '4710.184')] [2023-03-08 12:30:14,013][389688] Updated weights for policy 0, policy_version 164320 (0.0004) [2023-03-08 12:30:17,468][389688] Updated weights for policy 0, policy_version 164400 (0.0005) [2023-03-08 12:30:18,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11940.9). Total num frames: 84176896. Throughput: 0: 11601.9. Samples: 84150836. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:30:18,080][389401] Avg episode reward: [(0, '4689.966')] [2023-03-08 12:30:20,847][389688] Updated weights for policy 0, policy_version 164480 (0.0004) [2023-03-08 12:30:23,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11673.6, 300 sec: 11940.9). Total num frames: 84238336. Throughput: 0: 11622.8. Samples: 84223068. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:30:23,080][389401] Avg episode reward: [(0, '4698.239')] [2023-03-08 12:30:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000164528_84238336.pth... [2023-03-08 12:30:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000163848_83890176.pth [2023-03-08 12:30:24,321][389688] Updated weights for policy 0, policy_version 164560 (0.0004) [2023-03-08 12:30:27,873][389688] Updated weights for policy 0, policy_version 164640 (0.0005) [2023-03-08 12:30:28,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11913.1). Total num frames: 84295680. Throughput: 0: 11599.5. Samples: 84293384. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:30:28,080][389401] Avg episode reward: [(0, '4676.990')] [2023-03-08 12:30:31,536][389688] Updated weights for policy 0, policy_version 164720 (0.0005) [2023-03-08 12:30:33,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 11899.2). Total num frames: 84353024. Throughput: 0: 11620.2. Samples: 84327364. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:30:33,080][389401] Avg episode reward: [(0, '4722.409')] [2023-03-08 12:30:35,187][389688] Updated weights for policy 0, policy_version 164800 (0.0005) [2023-03-08 12:30:38,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11537.1, 300 sec: 11885.3). Total num frames: 84406272. Throughput: 0: 11555.2. Samples: 84394048. Policy #0 lag: (min: 1.0, avg: 1.0, max: 1.0) [2023-03-08 12:30:38,080][389401] Avg episode reward: [(0, '4701.776')] [2023-03-08 12:30:38,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000164856_84406272.pth... [2023-03-08 12:30:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000164184_84062208.pth [2023-03-08 12:30:38,871][389688] Updated weights for policy 0, policy_version 164880 (0.0004) [2023-03-08 12:30:42,423][389688] Updated weights for policy 0, policy_version 164960 (0.0005) [2023-03-08 12:30:43,079][389401] Fps is (10 sec: 11059.3, 60 sec: 11468.8, 300 sec: 11871.5). Total num frames: 84463616. Throughput: 0: 11573.7. Samples: 84462600. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:30:43,090][389401] Avg episode reward: [(0, '4694.748')] [2023-03-08 12:30:46,107][389688] Updated weights for policy 0, policy_version 165040 (0.0005) [2023-03-08 12:30:48,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11871.5). Total num frames: 84520960. Throughput: 0: 11557.2. Samples: 84496264. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:30:48,080][389401] Avg episode reward: [(0, '4690.845')] [2023-03-08 12:30:49,754][389688] Updated weights for policy 0, policy_version 165120 (0.0005) [2023-03-08 12:30:53,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 11871.5). Total num frames: 84578304. Throughput: 0: 11437.3. Samples: 84562068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:30:53,080][389401] Avg episode reward: [(0, '4697.727')] [2023-03-08 12:30:53,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000165192_84578304.pth... [2023-03-08 12:30:53,083][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000164528_84238336.pth [2023-03-08 12:30:53,471][389688] Updated weights for policy 0, policy_version 165200 (0.0005) [2023-03-08 12:30:57,167][389688] Updated weights for policy 0, policy_version 165280 (0.0005) [2023-03-08 12:30:58,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11468.8, 300 sec: 11829.8). Total num frames: 84631552. Throughput: 0: 11396.2. Samples: 84628536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:30:58,080][389401] Avg episode reward: [(0, '4717.722')] [2023-03-08 12:31:00,791][389688] Updated weights for policy 0, policy_version 165360 (0.0005) [2023-03-08 12:31:03,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11468.8, 300 sec: 11829.8). Total num frames: 84688896. Throughput: 0: 11392.0. Samples: 84663476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:31:03,080][389401] Avg episode reward: [(0, '4699.733')] [2023-03-08 12:31:04,386][389688] Updated weights for policy 0, policy_version 165440 (0.0005) [2023-03-08 12:31:08,008][389688] Updated weights for policy 0, policy_version 165520 (0.0005) [2023-03-08 12:31:08,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11400.5, 300 sec: 11829.8). Total num frames: 84746240. Throughput: 0: 11277.1. Samples: 84730536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:31:08,080][389401] Avg episode reward: [(0, '4720.589')] [2023-03-08 12:31:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000165520_84746240.pth... [2023-03-08 12:31:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000164856_84406272.pth [2023-03-08 12:31:11,676][389688] Updated weights for policy 0, policy_version 165600 (0.0005) [2023-03-08 12:31:13,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 11815.9). Total num frames: 84799488. Throughput: 0: 11224.3. Samples: 84798476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:31:13,080][389401] Avg episode reward: [(0, '4732.855')] [2023-03-08 12:31:15,330][389688] Updated weights for policy 0, policy_version 165680 (0.0005) [2023-03-08 12:31:18,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11332.3, 300 sec: 11815.9). Total num frames: 84856832. Throughput: 0: 11220.3. Samples: 84832276. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:31:18,080][389401] Avg episode reward: [(0, '4697.204')] [2023-03-08 12:31:18,997][389688] Updated weights for policy 0, policy_version 165760 (0.0005) [2023-03-08 12:31:22,600][389688] Updated weights for policy 0, policy_version 165840 (0.0005) [2023-03-08 12:31:23,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11815.9). Total num frames: 84914176. Throughput: 0: 11231.5. Samples: 84899468. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:31:23,080][389401] Avg episode reward: [(0, '4683.770')] [2023-03-08 12:31:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000165848_84914176.pth... [2023-03-08 12:31:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000165192_84578304.pth [2023-03-08 12:31:26,220][389688] Updated weights for policy 0, policy_version 165920 (0.0005) [2023-03-08 12:31:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11802.0). Total num frames: 84971520. Throughput: 0: 11218.3. Samples: 84967424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:31:28,080][389401] Avg episode reward: [(0, '4695.160')] [2023-03-08 12:31:29,838][389688] Updated weights for policy 0, policy_version 166000 (0.0005) [2023-03-08 12:31:33,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11788.1). Total num frames: 85024768. Throughput: 0: 11208.9. Samples: 85000664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:31:33,080][389401] Avg episode reward: [(0, '4670.000')] [2023-03-08 12:31:33,496][389688] Updated weights for policy 0, policy_version 166080 (0.0005) [2023-03-08 12:31:37,127][389688] Updated weights for policy 0, policy_version 166160 (0.0005) [2023-03-08 12:31:38,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11264.0, 300 sec: 11788.1). Total num frames: 85082112. Throughput: 0: 11254.4. Samples: 85068516. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:31:38,080][389401] Avg episode reward: [(0, '4658.749')] [2023-03-08 12:31:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000166176_85082112.pth... [2023-03-08 12:31:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000165520_84746240.pth [2023-03-08 12:31:40,796][389688] Updated weights for policy 0, policy_version 166240 (0.0004) [2023-03-08 12:31:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11788.1). Total num frames: 85139456. Throughput: 0: 11267.2. Samples: 85135560. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:31:43,080][389401] Avg episode reward: [(0, '4661.791')] [2023-03-08 12:31:44,456][389688] Updated weights for policy 0, policy_version 166320 (0.0005) [2023-03-08 12:31:48,075][389688] Updated weights for policy 0, policy_version 166400 (0.0005) [2023-03-08 12:31:48,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11264.0, 300 sec: 11788.2). Total num frames: 85196800. Throughput: 0: 11243.2. Samples: 85169420. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:31:48,080][389401] Avg episode reward: [(0, '4682.834')] [2023-03-08 12:31:51,693][389688] Updated weights for policy 0, policy_version 166480 (0.0005) [2023-03-08 12:31:53,079][389401] Fps is (10 sec: 11059.2, 60 sec: 11195.7, 300 sec: 11760.4). Total num frames: 85250048. Throughput: 0: 11271.6. Samples: 85237760. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:31:53,080][389401] Avg episode reward: [(0, '4681.049')] [2023-03-08 12:31:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000166504_85250048.pth... [2023-03-08 12:31:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000165848_84914176.pth [2023-03-08 12:31:55,293][389688] Updated weights for policy 0, policy_version 166560 (0.0005) [2023-03-08 12:31:58,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11264.0, 300 sec: 11746.5). Total num frames: 85307392. Throughput: 0: 11281.9. Samples: 85306160. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:31:58,080][389401] Avg episode reward: [(0, '4652.963')] [2023-03-08 12:31:58,851][389688] Updated weights for policy 0, policy_version 166640 (0.0005) [2023-03-08 12:32:02,497][389688] Updated weights for policy 0, policy_version 166720 (0.0005) [2023-03-08 12:32:03,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11264.0, 300 sec: 11718.7). Total num frames: 85364736. Throughput: 0: 11286.6. Samples: 85340172. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:32:03,080][389401] Avg episode reward: [(0, '4656.023')] [2023-03-08 12:32:06,128][389688] Updated weights for policy 0, policy_version 166800 (0.0005) [2023-03-08 12:32:08,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11264.0, 300 sec: 11704.8). Total num frames: 85422080. Throughput: 0: 11293.2. Samples: 85407660. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:32:08,080][389401] Avg episode reward: [(0, '4700.059')] [2023-03-08 12:32:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000166840_85422080.pth... [2023-03-08 12:32:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000166176_85082112.pth [2023-03-08 12:32:09,742][389688] Updated weights for policy 0, policy_version 166880 (0.0005) [2023-03-08 12:32:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11677.1). Total num frames: 85479424. Throughput: 0: 11288.4. Samples: 85475400. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:32:13,080][389401] Avg episode reward: [(0, '4678.774')] [2023-03-08 12:32:13,359][389688] Updated weights for policy 0, policy_version 166960 (0.0005) [2023-03-08 12:32:16,880][389688] Updated weights for policy 0, policy_version 167040 (0.0005) [2023-03-08 12:32:18,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11663.2). Total num frames: 85536768. Throughput: 0: 11331.2. Samples: 85510568. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:32:18,080][389401] Avg episode reward: [(0, '4679.593')] [2023-03-08 12:32:20,540][389688] Updated weights for policy 0, policy_version 167120 (0.0005) [2023-03-08 12:32:23,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11635.4). Total num frames: 85594112. Throughput: 0: 11331.1. Samples: 85578416. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:32:23,080][389401] Avg episode reward: [(0, '4613.933')] [2023-03-08 12:32:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000167176_85594112.pth... [2023-03-08 12:32:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000166504_85250048.pth [2023-03-08 12:32:24,090][389688] Updated weights for policy 0, policy_version 167200 (0.0005) [2023-03-08 12:32:27,609][389688] Updated weights for policy 0, policy_version 167280 (0.0005) [2023-03-08 12:32:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11332.3, 300 sec: 11621.5). Total num frames: 85651456. Throughput: 0: 11376.6. Samples: 85647508. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:32:28,080][389401] Avg episode reward: [(0, '4604.789')] [2023-03-08 12:32:31,242][389688] Updated weights for policy 0, policy_version 167360 (0.0005) [2023-03-08 12:32:33,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11400.5, 300 sec: 11607.7). Total num frames: 85708800. Throughput: 0: 11382.5. Samples: 85681632. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:32:33,080][389401] Avg episode reward: [(0, '4668.067')] [2023-03-08 12:32:34,677][389688] Updated weights for policy 0, policy_version 167440 (0.0004) [2023-03-08 12:32:38,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11579.9). Total num frames: 85766144. Throughput: 0: 11435.5. Samples: 85752356. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:32:38,080][389401] Avg episode reward: [(0, '4701.068')] [2023-03-08 12:32:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000167512_85766144.pth... [2023-03-08 12:32:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000166840_85422080.pth [2023-03-08 12:32:38,263][389688] Updated weights for policy 0, policy_version 167520 (0.0004) [2023-03-08 12:32:41,817][389688] Updated weights for policy 0, policy_version 167600 (0.0005) [2023-03-08 12:32:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11400.5, 300 sec: 11566.0). Total num frames: 85823488. Throughput: 0: 11427.7. Samples: 85820408. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:32:43,080][389401] Avg episode reward: [(0, '4694.589')] [2023-03-08 12:32:45,379][389688] Updated weights for policy 0, policy_version 167680 (0.0005) [2023-03-08 12:32:48,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11400.5, 300 sec: 11552.1). Total num frames: 85880832. Throughput: 0: 11464.0. Samples: 85856052. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:32:48,080][389401] Avg episode reward: [(0, '4712.273')] [2023-03-08 12:32:48,833][389688] Updated weights for policy 0, policy_version 167760 (0.0005) [2023-03-08 12:32:52,324][389688] Updated weights for policy 0, policy_version 167840 (0.0004) [2023-03-08 12:32:53,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11537.1, 300 sec: 11552.1). Total num frames: 85942272. Throughput: 0: 11517.8. Samples: 85925960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:32:53,080][389401] Avg episode reward: [(0, '4719.242')] [2023-03-08 12:32:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000167856_85942272.pth... [2023-03-08 12:32:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000167176_85594112.pth [2023-03-08 12:32:55,851][389688] Updated weights for policy 0, policy_version 167920 (0.0005) [2023-03-08 12:32:58,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 11524.3). Total num frames: 85999616. Throughput: 0: 11561.8. Samples: 85995680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:32:58,080][389401] Avg episode reward: [(0, '4682.668')] [2023-03-08 12:32:59,363][389688] Updated weights for policy 0, policy_version 168000 (0.0005) [2023-03-08 12:33:03,006][389688] Updated weights for policy 0, policy_version 168080 (0.0005) [2023-03-08 12:33:03,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11510.5). Total num frames: 86056960. Throughput: 0: 11564.4. Samples: 86030964. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:33:03,080][389401] Avg episode reward: [(0, '4718.637')] [2023-03-08 12:33:06,488][389688] Updated weights for policy 0, policy_version 168160 (0.0005) [2023-03-08 12:33:08,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11482.7). Total num frames: 86114304. Throughput: 0: 11587.7. Samples: 86099860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:33:08,080][389401] Avg episode reward: [(0, '4668.244')] [2023-03-08 12:33:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000168192_86114304.pth... [2023-03-08 12:33:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000167512_85766144.pth [2023-03-08 12:33:09,982][389688] Updated weights for policy 0, policy_version 168240 (0.0005) [2023-03-08 12:33:13,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11605.3, 300 sec: 11482.7). Total num frames: 86175744. Throughput: 0: 11649.0. Samples: 86171712. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:33:13,080][389401] Avg episode reward: [(0, '4741.289')] [2023-03-08 12:33:13,311][389688] Updated weights for policy 0, policy_version 168320 (0.0005) [2023-03-08 12:33:16,684][389688] Updated weights for policy 0, policy_version 168400 (0.0004) [2023-03-08 12:33:18,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 11482.7). Total num frames: 86237184. Throughput: 0: 11708.8. Samples: 86208528. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:33:18,080][389401] Avg episode reward: [(0, '4724.765')] [2023-03-08 12:33:19,972][389688] Updated weights for policy 0, policy_version 168480 (0.0004) [2023-03-08 12:33:23,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 11482.7). Total num frames: 86294528. Throughput: 0: 11762.1. Samples: 86281652. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:33:23,080][389401] Avg episode reward: [(0, '4741.668')] [2023-03-08 12:33:23,117][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000168552_86298624.pth... [2023-03-08 12:33:23,119][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000167856_85942272.pth [2023-03-08 12:33:23,462][389688] Updated weights for policy 0, policy_version 168560 (0.0005) [2023-03-08 12:33:27,079][389688] Updated weights for policy 0, policy_version 168640 (0.0005) [2023-03-08 12:33:28,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 11482.7). Total num frames: 86351872. Throughput: 0: 11792.6. Samples: 86351076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:33:28,080][389401] Avg episode reward: [(0, '4739.000')] [2023-03-08 12:33:30,636][389688] Updated weights for policy 0, policy_version 168720 (0.0005) [2023-03-08 12:33:33,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11741.9, 300 sec: 11496.6). Total num frames: 86413312. Throughput: 0: 11747.8. Samples: 86384704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:33:33,080][389401] Avg episode reward: [(0, '4740.810')] [2023-03-08 12:33:34,106][389688] Updated weights for policy 0, policy_version 168800 (0.0005) [2023-03-08 12:33:37,643][389688] Updated weights for policy 0, policy_version 168880 (0.0005) [2023-03-08 12:33:38,079][389401] Fps is (10 sec: 11878.2, 60 sec: 11741.9, 300 sec: 11510.5). Total num frames: 86470656. Throughput: 0: 11763.5. Samples: 86455316. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:33:38,080][389401] Avg episode reward: [(0, '4715.002')] [2023-03-08 12:33:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000168888_86470656.pth... [2023-03-08 12:33:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000168192_86114304.pth [2023-03-08 12:33:41,192][389688] Updated weights for policy 0, policy_version 168960 (0.0005) [2023-03-08 12:33:43,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11741.9, 300 sec: 11496.6). Total num frames: 86528000. Throughput: 0: 11758.2. Samples: 86524800. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:33:43,080][389401] Avg episode reward: [(0, '4740.470')] [2023-03-08 12:33:44,674][389688] Updated weights for policy 0, policy_version 169040 (0.0005) [2023-03-08 12:33:48,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11496.6). Total num frames: 86585344. Throughput: 0: 11759.7. Samples: 86560152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:33:48,080][389401] Avg episode reward: [(0, '4732.446')] [2023-03-08 12:33:48,287][389688] Updated weights for policy 0, policy_version 169120 (0.0005) [2023-03-08 12:33:51,772][389688] Updated weights for policy 0, policy_version 169200 (0.0005) [2023-03-08 12:33:53,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 11496.6). Total num frames: 86642688. Throughput: 0: 11763.6. Samples: 86629224. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:33:53,080][389401] Avg episode reward: [(0, '4740.668')] [2023-03-08 12:33:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000169224_86642688.pth... [2023-03-08 12:33:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000168552_86298624.pth [2023-03-08 12:33:55,279][389688] Updated weights for policy 0, policy_version 169280 (0.0005) [2023-03-08 12:33:58,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11673.6, 300 sec: 11496.6). Total num frames: 86700032. Throughput: 0: 11722.1. Samples: 86699208. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:33:58,080][389401] Avg episode reward: [(0, '4737.223')] [2023-03-08 12:33:58,808][389688] Updated weights for policy 0, policy_version 169360 (0.0005) [2023-03-08 12:34:02,115][389688] Updated weights for policy 0, policy_version 169440 (0.0004) [2023-03-08 12:34:03,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11741.9, 300 sec: 11510.5). Total num frames: 86761472. Throughput: 0: 11702.4. Samples: 86735136. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:34:03,080][389401] Avg episode reward: [(0, '4733.420')] [2023-03-08 12:34:05,556][389688] Updated weights for policy 0, policy_version 169520 (0.0005) [2023-03-08 12:34:08,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11810.1, 300 sec: 11524.3). Total num frames: 86822912. Throughput: 0: 11693.1. Samples: 86807840. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:34:08,080][389401] Avg episode reward: [(0, '4718.003')] [2023-03-08 12:34:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000169576_86822912.pth... [2023-03-08 12:34:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000168888_86470656.pth [2023-03-08 12:34:08,858][389688] Updated weights for policy 0, policy_version 169600 (0.0004) [2023-03-08 12:34:12,062][389688] Updated weights for policy 0, policy_version 169680 (0.0004) [2023-03-08 12:34:13,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 11538.2). Total num frames: 86884352. Throughput: 0: 11823.9. Samples: 86883152. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:34:13,080][389401] Avg episode reward: [(0, '4736.840')] [2023-03-08 12:34:15,608][389688] Updated weights for policy 0, policy_version 169760 (0.0005) [2023-03-08 12:34:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11538.2). Total num frames: 86941696. Throughput: 0: 11835.3. Samples: 86917296. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:34:18,080][389401] Avg episode reward: [(0, '4740.125')] [2023-03-08 12:34:19,158][389688] Updated weights for policy 0, policy_version 169840 (0.0005) [2023-03-08 12:34:22,588][389688] Updated weights for policy 0, policy_version 169920 (0.0005) [2023-03-08 12:34:23,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11538.2). Total num frames: 87003136. Throughput: 0: 11827.4. Samples: 86987548. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:34:23,080][389401] Avg episode reward: [(0, '4740.185')] [2023-03-08 12:34:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000169928_87003136.pth... [2023-03-08 12:34:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000169224_86642688.pth [2023-03-08 12:34:26,092][389688] Updated weights for policy 0, policy_version 170000 (0.0005) [2023-03-08 12:34:28,079][389401] Fps is (10 sec: 11878.6, 60 sec: 11810.1, 300 sec: 11538.2). Total num frames: 87060480. Throughput: 0: 11846.4. Samples: 87057888. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:34:28,080][389401] Avg episode reward: [(0, '4740.337')] [2023-03-08 12:34:29,612][389688] Updated weights for policy 0, policy_version 170080 (0.0005) [2023-03-08 12:34:33,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 11538.2). Total num frames: 87117824. Throughput: 0: 11846.8. Samples: 87093256. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:34:33,080][389401] Avg episode reward: [(0, '4737.492')] [2023-03-08 12:34:33,152][389688] Updated weights for policy 0, policy_version 170160 (0.0005) [2023-03-08 12:34:36,661][389688] Updated weights for policy 0, policy_version 170240 (0.0005) [2023-03-08 12:34:38,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11538.2). Total num frames: 87179264. Throughput: 0: 11859.4. Samples: 87162896. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:34:38,080][389401] Avg episode reward: [(0, '4729.286')] [2023-03-08 12:34:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000170272_87179264.pth... [2023-03-08 12:34:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000169576_86822912.pth [2023-03-08 12:34:40,143][389688] Updated weights for policy 0, policy_version 170320 (0.0005) [2023-03-08 12:34:43,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.2, 300 sec: 11538.2). Total num frames: 87236608. Throughput: 0: 11852.6. Samples: 87232576. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:34:43,080][389401] Avg episode reward: [(0, '4719.922')] [2023-03-08 12:34:43,679][389688] Updated weights for policy 0, policy_version 170400 (0.0005) [2023-03-08 12:34:47,194][389688] Updated weights for policy 0, policy_version 170480 (0.0005) [2023-03-08 12:34:48,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 11538.2). Total num frames: 87293952. Throughput: 0: 11840.5. Samples: 87267960. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:34:48,080][389401] Avg episode reward: [(0, '4734.139')] [2023-03-08 12:34:50,646][389688] Updated weights for policy 0, policy_version 170560 (0.0005) [2023-03-08 12:34:53,079][389401] Fps is (10 sec: 11878.2, 60 sec: 11878.4, 300 sec: 11566.0). Total num frames: 87355392. Throughput: 0: 11803.5. Samples: 87338996. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:34:53,080][389401] Avg episode reward: [(0, '4737.767')] [2023-03-08 12:34:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000170616_87355392.pth... [2023-03-08 12:34:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000169928_87003136.pth [2023-03-08 12:34:54,111][389688] Updated weights for policy 0, policy_version 170640 (0.0005) [2023-03-08 12:34:57,538][389688] Updated weights for policy 0, policy_version 170720 (0.0005) [2023-03-08 12:34:58,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11566.0). Total num frames: 87412736. Throughput: 0: 11708.0. Samples: 87410012. Policy #0 lag: (min: 5.0, avg: 5.0, max: 5.0) [2023-03-08 12:34:58,080][389401] Avg episode reward: [(0, '4737.140')] [2023-03-08 12:35:00,990][389688] Updated weights for policy 0, policy_version 170800 (0.0005) [2023-03-08 12:35:03,079][389401] Fps is (10 sec: 11469.0, 60 sec: 11810.1, 300 sec: 11552.1). Total num frames: 87470080. Throughput: 0: 11738.2. Samples: 87445512. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:35:03,080][389401] Avg episode reward: [(0, '4736.901')] [2023-03-08 12:35:04,566][389688] Updated weights for policy 0, policy_version 170880 (0.0005) [2023-03-08 12:35:08,059][389688] Updated weights for policy 0, policy_version 170960 (0.0005) [2023-03-08 12:35:08,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11566.0). Total num frames: 87531520. Throughput: 0: 11725.6. Samples: 87515200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:35:08,080][389401] Avg episode reward: [(0, '4739.992')] [2023-03-08 12:35:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000170960_87531520.pth... [2023-03-08 12:35:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000170272_87179264.pth [2023-03-08 12:35:11,403][389688] Updated weights for policy 0, policy_version 171040 (0.0005) [2023-03-08 12:35:13,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 11566.0). Total num frames: 87588864. Throughput: 0: 11766.7. Samples: 87587388. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:35:13,080][389401] Avg episode reward: [(0, '4696.968')] [2023-03-08 12:35:14,909][389688] Updated weights for policy 0, policy_version 171120 (0.0005) [2023-03-08 12:35:18,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11810.2, 300 sec: 11566.0). Total num frames: 87650304. Throughput: 0: 11745.6. Samples: 87621808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:35:18,080][389401] Avg episode reward: [(0, '4737.924')] [2023-03-08 12:35:18,335][389688] Updated weights for policy 0, policy_version 171200 (0.0005) [2023-03-08 12:35:21,795][389688] Updated weights for policy 0, policy_version 171280 (0.0005) [2023-03-08 12:35:23,079][389401] Fps is (10 sec: 11878.2, 60 sec: 11741.9, 300 sec: 11566.0). Total num frames: 87707648. Throughput: 0: 11810.3. Samples: 87694360. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:35:23,080][389401] Avg episode reward: [(0, '4737.652')] [2023-03-08 12:35:23,130][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000171312_87711744.pth... [2023-03-08 12:35:23,131][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000170616_87355392.pth [2023-03-08 12:35:25,155][389688] Updated weights for policy 0, policy_version 171360 (0.0005) [2023-03-08 12:35:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11579.9). Total num frames: 87769088. Throughput: 0: 11870.6. Samples: 87766752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:35:28,080][389401] Avg episode reward: [(0, '4697.314')] [2023-03-08 12:35:28,539][389688] Updated weights for policy 0, policy_version 171440 (0.0005) [2023-03-08 12:35:31,959][389688] Updated weights for policy 0, policy_version 171520 (0.0005) [2023-03-08 12:35:33,079][389401] Fps is (10 sec: 12288.2, 60 sec: 11878.4, 300 sec: 11607.6). Total num frames: 87830528. Throughput: 0: 11879.8. Samples: 87802548. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:35:33,080][389401] Avg episode reward: [(0, '4728.192')] [2023-03-08 12:35:35,359][389688] Updated weights for policy 0, policy_version 171600 (0.0005) [2023-03-08 12:35:38,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11878.4, 300 sec: 11621.5). Total num frames: 87891968. Throughput: 0: 11938.6. Samples: 87876232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:35:38,080][389401] Avg episode reward: [(0, '4740.101')] [2023-03-08 12:35:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000171664_87891968.pth... [2023-03-08 12:35:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000170960_87531520.pth [2023-03-08 12:35:38,544][389688] Updated weights for policy 0, policy_version 171680 (0.0004) [2023-03-08 12:35:41,767][389688] Updated weights for policy 0, policy_version 171760 (0.0005) [2023-03-08 12:35:43,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11649.3). Total num frames: 87957504. Throughput: 0: 12060.6. Samples: 87952740. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:35:43,080][389401] Avg episode reward: [(0, '4739.463')] [2023-03-08 12:35:45,000][389688] Updated weights for policy 0, policy_version 171840 (0.0004) [2023-03-08 12:35:48,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12083.2, 300 sec: 11663.2). Total num frames: 88018944. Throughput: 0: 12107.2. Samples: 87990336. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:35:48,080][389401] Avg episode reward: [(0, '4710.361')] [2023-03-08 12:35:48,113][389688] Updated weights for policy 0, policy_version 171920 (0.0003) [2023-03-08 12:35:51,276][389688] Updated weights for policy 0, policy_version 172000 (0.0005) [2023-03-08 12:35:53,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12151.5, 300 sec: 11704.8). Total num frames: 88084480. Throughput: 0: 12301.4. Samples: 88068764. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:35:53,080][389401] Avg episode reward: [(0, '4740.910')] [2023-03-08 12:35:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000172040_88084480.pth... [2023-03-08 12:35:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000171312_87711744.pth [2023-03-08 12:35:54,466][389688] Updated weights for policy 0, policy_version 172080 (0.0004) [2023-03-08 12:35:57,678][389688] Updated weights for policy 0, policy_version 172160 (0.0004) [2023-03-08 12:35:58,079][389401] Fps is (10 sec: 13107.2, 60 sec: 12288.0, 300 sec: 11732.6). Total num frames: 88150016. Throughput: 0: 12408.6. Samples: 88145776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:35:58,080][389401] Avg episode reward: [(0, '4741.414')] [2023-03-08 12:36:01,000][389688] Updated weights for policy 0, policy_version 172240 (0.0004) [2023-03-08 12:36:03,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 11732.6). Total num frames: 88207360. Throughput: 0: 12466.3. Samples: 88182792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:36:03,080][389401] Avg episode reward: [(0, '4741.904')] [2023-03-08 12:36:04,507][389688] Updated weights for policy 0, policy_version 172320 (0.0005) [2023-03-08 12:36:07,772][389688] Updated weights for policy 0, policy_version 172400 (0.0004) [2023-03-08 12:36:08,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12288.0, 300 sec: 11760.4). Total num frames: 88268800. Throughput: 0: 12437.2. Samples: 88254032. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:36:08,080][389401] Avg episode reward: [(0, '4740.553')] [2023-03-08 12:36:08,097][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000172408_88272896.pth... [2023-03-08 12:36:08,099][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000171664_87891968.pth [2023-03-08 12:36:11,077][389688] Updated weights for policy 0, policy_version 172480 (0.0004) [2023-03-08 12:36:13,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12356.2, 300 sec: 11774.3). Total num frames: 88330240. Throughput: 0: 12478.1. Samples: 88328268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:36:13,080][389401] Avg episode reward: [(0, '4740.130')] [2023-03-08 12:36:14,535][389688] Updated weights for policy 0, policy_version 172560 (0.0005) [2023-03-08 12:36:17,729][389688] Updated weights for policy 0, policy_version 172640 (0.0004) [2023-03-08 12:36:18,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12356.3, 300 sec: 11788.1). Total num frames: 88391680. Throughput: 0: 12512.8. Samples: 88365624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:36:18,080][389401] Avg episode reward: [(0, '4742.508')] [2023-03-08 12:36:20,916][389688] Updated weights for policy 0, policy_version 172720 (0.0004) [2023-03-08 12:36:23,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12492.8, 300 sec: 11815.9). Total num frames: 88457216. Throughput: 0: 12580.2. Samples: 88442344. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:36:23,090][389401] Avg episode reward: [(0, '4742.592')] [2023-03-08 12:36:23,124][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000172776_88461312.pth... [2023-03-08 12:36:23,126][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000172040_88084480.pth [2023-03-08 12:36:24,072][389688] Updated weights for policy 0, policy_version 172800 (0.0004) [2023-03-08 12:36:27,289][389688] Updated weights for policy 0, policy_version 172880 (0.0004) [2023-03-08 12:36:28,079][389401] Fps is (10 sec: 13107.1, 60 sec: 12561.0, 300 sec: 11857.6). Total num frames: 88522752. Throughput: 0: 12577.5. Samples: 88518728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:36:28,090][389401] Avg episode reward: [(0, '4742.657')] [2023-03-08 12:36:30,410][389688] Updated weights for policy 0, policy_version 172960 (0.0004) [2023-03-08 12:36:33,079][389401] Fps is (10 sec: 13107.3, 60 sec: 12629.3, 300 sec: 11885.3). Total num frames: 88588288. Throughput: 0: 12640.1. Samples: 88559140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:36:33,090][389401] Avg episode reward: [(0, '4743.766')] [2023-03-08 12:36:33,563][389688] Updated weights for policy 0, policy_version 173040 (0.0004) [2023-03-08 12:36:36,689][389688] Updated weights for policy 0, policy_version 173120 (0.0004) [2023-03-08 12:36:38,079][389401] Fps is (10 sec: 13107.2, 60 sec: 12697.6, 300 sec: 11913.1). Total num frames: 88653824. Throughput: 0: 12630.7. Samples: 88637144. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:36:38,090][389401] Avg episode reward: [(0, '4741.099')] [2023-03-08 12:36:38,094][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000173152_88653824.pth... [2023-03-08 12:36:38,096][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000172408_88272896.pth [2023-03-08 12:36:39,903][389688] Updated weights for policy 0, policy_version 173200 (0.0004) [2023-03-08 12:36:43,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 11927.0). Total num frames: 88715264. Throughput: 0: 12627.6. Samples: 88714020. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:36:43,090][389401] Avg episode reward: [(0, '4741.245')] [2023-03-08 12:36:43,115][389688] Updated weights for policy 0, policy_version 173280 (0.0004) [2023-03-08 12:36:46,282][389688] Updated weights for policy 0, policy_version 173360 (0.0004) [2023-03-08 12:36:48,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12697.6, 300 sec: 11968.7). Total num frames: 88780800. Throughput: 0: 12653.5. Samples: 88752200. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:36:48,090][389401] Avg episode reward: [(0, '4741.688')] [2023-03-08 12:36:49,492][389688] Updated weights for policy 0, policy_version 173440 (0.0004) [2023-03-08 12:36:52,693][389688] Updated weights for policy 0, policy_version 173520 (0.0004) [2023-03-08 12:36:53,079][389401] Fps is (10 sec: 13107.1, 60 sec: 12697.6, 300 sec: 11996.4). Total num frames: 88846336. Throughput: 0: 12773.0. Samples: 88828816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:36:53,090][389401] Avg episode reward: [(0, '4736.826')] [2023-03-08 12:36:53,094][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000173528_88846336.pth... [2023-03-08 12:36:53,097][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000172776_88461312.pth [2023-03-08 12:36:55,919][389688] Updated weights for policy 0, policy_version 173600 (0.0004) [2023-03-08 12:36:58,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12010.3). Total num frames: 88907776. Throughput: 0: 12822.6. Samples: 88905284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:36:58,090][389401] Avg episode reward: [(0, '4710.549')] [2023-03-08 12:36:59,206][389688] Updated weights for policy 0, policy_version 173680 (0.0004) [2023-03-08 12:37:02,444][389688] Updated weights for policy 0, policy_version 173760 (0.0004) [2023-03-08 12:37:03,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12765.9, 300 sec: 12038.1). Total num frames: 88973312. Throughput: 0: 12809.7. Samples: 88942060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:37:03,090][389401] Avg episode reward: [(0, '4736.961')] [2023-03-08 12:37:05,692][389688] Updated weights for policy 0, policy_version 173840 (0.0004) [2023-03-08 12:37:08,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12765.9, 300 sec: 12052.0). Total num frames: 89034752. Throughput: 0: 12795.7. Samples: 89018152. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:37:08,090][389401] Avg episode reward: [(0, '4740.235')] [2023-03-08 12:37:08,094][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000173896_89034752.pth... [2023-03-08 12:37:08,096][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000173152_88653824.pth [2023-03-08 12:37:08,993][389688] Updated weights for policy 0, policy_version 173920 (0.0005) [2023-03-08 12:37:12,241][389688] Updated weights for policy 0, policy_version 174000 (0.0005) [2023-03-08 12:37:13,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12765.9, 300 sec: 12065.8). Total num frames: 89096192. Throughput: 0: 12758.8. Samples: 89092872. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:37:13,090][389401] Avg episode reward: [(0, '4740.672')] [2023-03-08 12:37:15,489][389688] Updated weights for policy 0, policy_version 174080 (0.0004) [2023-03-08 12:37:18,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12834.1, 300 sec: 12093.6). Total num frames: 89161728. Throughput: 0: 12709.3. Samples: 89131060. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:37:18,090][389401] Avg episode reward: [(0, '4744.283')] [2023-03-08 12:37:18,715][389688] Updated weights for policy 0, policy_version 174160 (0.0004) [2023-03-08 12:37:22,030][389688] Updated weights for policy 0, policy_version 174240 (0.0004) [2023-03-08 12:37:23,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12697.6, 300 sec: 12093.6). Total num frames: 89219072. Throughput: 0: 12659.1. Samples: 89206804. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:37:23,090][389401] Avg episode reward: [(0, '4742.404')] [2023-03-08 12:37:23,139][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000174264_89223168.pth... [2023-03-08 12:37:23,141][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000173528_88846336.pth [2023-03-08 12:37:25,610][389688] Updated weights for policy 0, policy_version 174320 (0.0005) [2023-03-08 12:37:28,079][389401] Fps is (10 sec: 11468.9, 60 sec: 12561.1, 300 sec: 12093.6). Total num frames: 89276416. Throughput: 0: 12471.1. Samples: 89275220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:37:28,090][389401] Avg episode reward: [(0, '4739.264')] [2023-03-08 12:37:29,230][389688] Updated weights for policy 0, policy_version 174400 (0.0005) [2023-03-08 12:37:32,762][389688] Updated weights for policy 0, policy_version 174480 (0.0005) [2023-03-08 12:37:33,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12424.5, 300 sec: 12093.6). Total num frames: 89333760. Throughput: 0: 12379.0. Samples: 89309256. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:37:33,080][389401] Avg episode reward: [(0, '4740.011')] [2023-03-08 12:37:36,339][389688] Updated weights for policy 0, policy_version 174560 (0.0005) [2023-03-08 12:37:38,079][389401] Fps is (10 sec: 11468.7, 60 sec: 12288.0, 300 sec: 12093.6). Total num frames: 89391104. Throughput: 0: 12222.2. Samples: 89378816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:37:38,080][389401] Avg episode reward: [(0, '4738.964')] [2023-03-08 12:37:38,086][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000174600_89395200.pth... [2023-03-08 12:37:38,089][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000173896_89034752.pth [2023-03-08 12:37:39,728][389688] Updated weights for policy 0, policy_version 174640 (0.0005) [2023-03-08 12:37:43,079][389401] Fps is (10 sec: 11878.6, 60 sec: 12288.0, 300 sec: 12107.5). Total num frames: 89452544. Throughput: 0: 12071.9. Samples: 89448520. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:37:43,080][389401] Avg episode reward: [(0, '4740.640')] [2023-03-08 12:37:43,307][389688] Updated weights for policy 0, policy_version 174720 (0.0005) [2023-03-08 12:37:46,842][389688] Updated weights for policy 0, policy_version 174800 (0.0004) [2023-03-08 12:37:48,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12093.6). Total num frames: 89509888. Throughput: 0: 12036.4. Samples: 89483696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:37:48,080][389401] Avg episode reward: [(0, '4740.754')] [2023-03-08 12:37:50,195][389688] Updated weights for policy 0, policy_version 174880 (0.0003) [2023-03-08 12:37:53,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 12107.5). Total num frames: 89571328. Throughput: 0: 11975.6. Samples: 89557052. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:37:53,080][389401] Avg episode reward: [(0, '4741.195')] [2023-03-08 12:37:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000174944_89571328.pth... [2023-03-08 12:37:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000174264_89223168.pth [2023-03-08 12:37:53,492][389688] Updated weights for policy 0, policy_version 174960 (0.0003) [2023-03-08 12:37:56,712][389688] Updated weights for policy 0, policy_version 175040 (0.0003) [2023-03-08 12:37:58,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12151.5, 300 sec: 12135.3). Total num frames: 89636864. Throughput: 0: 11991.3. Samples: 89632480. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:37:58,080][389401] Avg episode reward: [(0, '4741.755')] [2023-03-08 12:37:59,987][389688] Updated weights for policy 0, policy_version 175120 (0.0003) [2023-03-08 12:38:03,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12083.2, 300 sec: 12149.2). Total num frames: 89698304. Throughput: 0: 11969.7. Samples: 89669696. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:38:03,080][389401] Avg episode reward: [(0, '4740.472')] [2023-03-08 12:38:03,345][389688] Updated weights for policy 0, policy_version 175200 (0.0004) [2023-03-08 12:38:06,660][389688] Updated weights for policy 0, policy_version 175280 (0.0003) [2023-03-08 12:38:08,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 12149.2). Total num frames: 89759744. Throughput: 0: 11923.7. Samples: 89743368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:38:08,080][389401] Avg episode reward: [(0, '4740.441')] [2023-03-08 12:38:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000175312_89759744.pth... [2023-03-08 12:38:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000174600_89395200.pth [2023-03-08 12:38:09,975][389688] Updated weights for policy 0, policy_version 175360 (0.0003) [2023-03-08 12:38:13,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 12149.2). Total num frames: 89821184. Throughput: 0: 12041.7. Samples: 89817096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:38:13,080][389401] Avg episode reward: [(0, '4741.200')] [2023-03-08 12:38:13,365][389688] Updated weights for policy 0, policy_version 175440 (0.0005) [2023-03-08 12:38:16,702][389688] Updated weights for policy 0, policy_version 175520 (0.0004) [2023-03-08 12:38:18,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12015.0, 300 sec: 12163.0). Total num frames: 89882624. Throughput: 0: 12074.9. Samples: 89852624. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:38:18,080][389401] Avg episode reward: [(0, '4741.420')] [2023-03-08 12:38:20,003][389688] Updated weights for policy 0, policy_version 175600 (0.0005) [2023-03-08 12:38:23,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 12176.9). Total num frames: 89944064. Throughput: 0: 12193.8. Samples: 89927536. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:38:23,080][389401] Avg episode reward: [(0, '4738.705')] [2023-03-08 12:38:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000175672_89944064.pth... [2023-03-08 12:38:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000174944_89571328.pth [2023-03-08 12:38:23,382][389688] Updated weights for policy 0, policy_version 175680 (0.0005) [2023-03-08 12:38:26,654][389688] Updated weights for policy 0, policy_version 175760 (0.0005) [2023-03-08 12:38:28,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12151.5, 300 sec: 12176.9). Total num frames: 90005504. Throughput: 0: 12290.1. Samples: 90001576. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:38:28,080][389401] Avg episode reward: [(0, '4739.683')] [2023-03-08 12:38:29,923][389688] Updated weights for policy 0, policy_version 175840 (0.0005) [2023-03-08 12:38:33,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12219.8, 300 sec: 12190.8). Total num frames: 90066944. Throughput: 0: 12334.5. Samples: 90038748. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:38:33,080][389401] Avg episode reward: [(0, '4736.031')] [2023-03-08 12:38:33,312][389688] Updated weights for policy 0, policy_version 175920 (0.0005) [2023-03-08 12:38:36,593][389688] Updated weights for policy 0, policy_version 176000 (0.0005) [2023-03-08 12:38:38,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 12204.7). Total num frames: 90128384. Throughput: 0: 12341.6. Samples: 90112424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:38:38,080][389401] Avg episode reward: [(0, '4737.845')] [2023-03-08 12:38:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000176032_90128384.pth... [2023-03-08 12:38:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000175312_89759744.pth [2023-03-08 12:38:39,905][389688] Updated weights for policy 0, policy_version 176080 (0.0005) [2023-03-08 12:38:43,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12288.0, 300 sec: 12218.6). Total num frames: 90189824. Throughput: 0: 12351.6. Samples: 90188304. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:38:43,080][389401] Avg episode reward: [(0, '4739.126')] [2023-03-08 12:38:43,086][389688] Updated weights for policy 0, policy_version 176160 (0.0004) [2023-03-08 12:38:46,312][389688] Updated weights for policy 0, policy_version 176240 (0.0005) [2023-03-08 12:38:48,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12424.5, 300 sec: 12246.3). Total num frames: 90255360. Throughput: 0: 12379.0. Samples: 90226752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:38:48,080][389401] Avg episode reward: [(0, '4743.763')] [2023-03-08 12:38:49,811][389688] Updated weights for policy 0, policy_version 176320 (0.0005) [2023-03-08 12:38:53,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12288.0, 300 sec: 12232.5). Total num frames: 90308608. Throughput: 0: 12289.4. Samples: 90296392. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:38:53,080][389401] Avg episode reward: [(0, '4741.356')] [2023-03-08 12:38:53,100][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000176392_90312704.pth... [2023-03-08 12:38:53,101][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000175672_89944064.pth [2023-03-08 12:38:53,459][389688] Updated weights for policy 0, policy_version 176400 (0.0005) [2023-03-08 12:38:57,050][389688] Updated weights for policy 0, policy_version 176480 (0.0005) [2023-03-08 12:38:58,079][389401] Fps is (10 sec: 11059.2, 60 sec: 12151.5, 300 sec: 12218.6). Total num frames: 90365952. Throughput: 0: 12173.2. Samples: 90364892. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:38:58,080][389401] Avg episode reward: [(0, '4741.521')] [2023-03-08 12:39:00,681][389688] Updated weights for policy 0, policy_version 176560 (0.0005) [2023-03-08 12:39:03,079][389401] Fps is (10 sec: 11468.9, 60 sec: 12083.2, 300 sec: 12204.7). Total num frames: 90423296. Throughput: 0: 12135.6. Samples: 90398728. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:39:03,080][389401] Avg episode reward: [(0, '4739.875')] [2023-03-08 12:39:04,285][389688] Updated weights for policy 0, policy_version 176640 (0.0005) [2023-03-08 12:39:07,895][389688] Updated weights for policy 0, policy_version 176720 (0.0005) [2023-03-08 12:39:08,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 12190.8). Total num frames: 90480640. Throughput: 0: 11985.0. Samples: 90466860. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:39:08,080][389401] Avg episode reward: [(0, '4740.394')] [2023-03-08 12:39:08,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000176720_90480640.pth... [2023-03-08 12:39:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000176032_90128384.pth [2023-03-08 12:39:11,407][389688] Updated weights for policy 0, policy_version 176800 (0.0005) [2023-03-08 12:39:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 12190.8). Total num frames: 90537984. Throughput: 0: 11883.0. Samples: 90536312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:39:13,080][389401] Avg episode reward: [(0, '4740.295')] [2023-03-08 12:39:14,950][389688] Updated weights for policy 0, policy_version 176880 (0.0005) [2023-03-08 12:39:18,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 12176.9). Total num frames: 90595328. Throughput: 0: 11823.9. Samples: 90570824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:39:18,080][389401] Avg episode reward: [(0, '4724.809')] [2023-03-08 12:39:18,551][389688] Updated weights for policy 0, policy_version 176960 (0.0005) [2023-03-08 12:39:22,119][389688] Updated weights for policy 0, policy_version 177040 (0.0005) [2023-03-08 12:39:23,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11810.1, 300 sec: 12176.9). Total num frames: 90652672. Throughput: 0: 11714.2. Samples: 90639564. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:39:23,080][389401] Avg episode reward: [(0, '4737.980')] [2023-03-08 12:39:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000177056_90652672.pth... [2023-03-08 12:39:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000176392_90312704.pth [2023-03-08 12:39:25,695][389688] Updated weights for policy 0, policy_version 177120 (0.0005) [2023-03-08 12:39:28,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 12176.9). Total num frames: 90710016. Throughput: 0: 11562.8. Samples: 90708628. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:39:28,090][389401] Avg episode reward: [(0, '4739.392')] [2023-03-08 12:39:29,176][389688] Updated weights for policy 0, policy_version 177200 (0.0005) [2023-03-08 12:39:32,766][389688] Updated weights for policy 0, policy_version 177280 (0.0005) [2023-03-08 12:39:33,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 12163.0). Total num frames: 90767360. Throughput: 0: 11467.7. Samples: 90742796. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:39:33,090][389401] Avg episode reward: [(0, '4736.798')] [2023-03-08 12:39:36,339][389688] Updated weights for policy 0, policy_version 177360 (0.0005) [2023-03-08 12:39:38,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11605.4, 300 sec: 12163.0). Total num frames: 90824704. Throughput: 0: 11467.2. Samples: 90812416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:39:38,090][389401] Avg episode reward: [(0, '4737.360')] [2023-03-08 12:39:38,092][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000177392_90824704.pth... [2023-03-08 12:39:38,095][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000176720_90480640.pth [2023-03-08 12:39:39,960][389688] Updated weights for policy 0, policy_version 177440 (0.0005) [2023-03-08 12:39:43,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 12163.0). Total num frames: 90882048. Throughput: 0: 11417.5. Samples: 90878680. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:39:43,090][389401] Avg episode reward: [(0, '4736.547')] [2023-03-08 12:39:43,627][389688] Updated weights for policy 0, policy_version 177520 (0.0005) [2023-03-08 12:39:46,994][389688] Updated weights for policy 0, policy_version 177600 (0.0005) [2023-03-08 12:39:48,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11468.8, 300 sec: 12163.0). Total num frames: 90943488. Throughput: 0: 11468.6. Samples: 90914816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:39:48,090][389401] Avg episode reward: [(0, '4735.453')] [2023-03-08 12:39:50,454][389688] Updated weights for policy 0, policy_version 177680 (0.0005) [2023-03-08 12:39:53,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11537.1, 300 sec: 12163.0). Total num frames: 91000832. Throughput: 0: 11548.8. Samples: 90986556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:39:53,090][389401] Avg episode reward: [(0, '4742.058')] [2023-03-08 12:39:53,094][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000177736_91000832.pth... [2023-03-08 12:39:53,096][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000177056_90652672.pth [2023-03-08 12:39:53,946][389688] Updated weights for policy 0, policy_version 177760 (0.0005) [2023-03-08 12:39:57,458][389688] Updated weights for policy 0, policy_version 177840 (0.0005) [2023-03-08 12:39:58,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 12163.0). Total num frames: 91058176. Throughput: 0: 11561.0. Samples: 91056556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:39:58,090][389401] Avg episode reward: [(0, '4739.338')] [2023-03-08 12:40:01,030][389688] Updated weights for policy 0, policy_version 177920 (0.0005) [2023-03-08 12:40:03,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 12149.2). Total num frames: 91115520. Throughput: 0: 11558.2. Samples: 91090944. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:40:03,080][389401] Avg episode reward: [(0, '4738.489')] [2023-03-08 12:40:04,461][389688] Updated weights for policy 0, policy_version 178000 (0.0005) [2023-03-08 12:40:07,760][389688] Updated weights for policy 0, policy_version 178080 (0.0004) [2023-03-08 12:40:08,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 12176.9). Total num frames: 91181056. Throughput: 0: 11647.3. Samples: 91163692. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:40:08,080][389401] Avg episode reward: [(0, '4739.173')] [2023-03-08 12:40:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000178088_91181056.pth... [2023-03-08 12:40:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000177392_90824704.pth [2023-03-08 12:40:11,169][389688] Updated weights for policy 0, policy_version 178160 (0.0005) [2023-03-08 12:40:13,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 12163.0). Total num frames: 91238400. Throughput: 0: 11698.6. Samples: 91235064. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:40:13,080][389401] Avg episode reward: [(0, '4739.568')] [2023-03-08 12:40:14,728][389688] Updated weights for policy 0, policy_version 178240 (0.0005) [2023-03-08 12:40:18,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11673.6, 300 sec: 12163.0). Total num frames: 91295744. Throughput: 0: 11701.8. Samples: 91269376. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:40:18,080][389401] Avg episode reward: [(0, '4690.925')] [2023-03-08 12:40:18,246][389688] Updated weights for policy 0, policy_version 178320 (0.0005) [2023-03-08 12:40:21,783][389688] Updated weights for policy 0, policy_version 178400 (0.0005) [2023-03-08 12:40:23,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 12149.2). Total num frames: 91353088. Throughput: 0: 11719.2. Samples: 91339780. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:40:23,080][389401] Avg episode reward: [(0, '4738.899')] [2023-03-08 12:40:23,092][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000178432_91357184.pth... [2023-03-08 12:40:23,093][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000177736_91000832.pth [2023-03-08 12:40:25,094][389688] Updated weights for policy 0, policy_version 178480 (0.0004) [2023-03-08 12:40:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 12149.2). Total num frames: 91414528. Throughput: 0: 11864.2. Samples: 91412568. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:40:28,080][389401] Avg episode reward: [(0, '4696.830')] [2023-03-08 12:40:28,599][389688] Updated weights for policy 0, policy_version 178560 (0.0005) [2023-03-08 12:40:32,252][389688] Updated weights for policy 0, policy_version 178640 (0.0005) [2023-03-08 12:40:33,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11741.9, 300 sec: 12135.3). Total num frames: 91471872. Throughput: 0: 11820.1. Samples: 91446720. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:40:33,080][389401] Avg episode reward: [(0, '4684.892')] [2023-03-08 12:40:35,813][389688] Updated weights for policy 0, policy_version 178720 (0.0005) [2023-03-08 12:40:38,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11741.8, 300 sec: 12107.5). Total num frames: 91529216. Throughput: 0: 11727.0. Samples: 91514272. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:40:38,080][389401] Avg episode reward: [(0, '4737.019')] [2023-03-08 12:40:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000178768_91529216.pth... [2023-03-08 12:40:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000178088_91181056.pth [2023-03-08 12:40:39,455][389688] Updated weights for policy 0, policy_version 178800 (0.0005) [2023-03-08 12:40:42,950][389688] Updated weights for policy 0, policy_version 178880 (0.0004) [2023-03-08 12:40:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 12093.6). Total num frames: 91586560. Throughput: 0: 11694.2. Samples: 91582796. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:40:43,080][389401] Avg episode reward: [(0, '4656.528')] [2023-03-08 12:40:46,319][389688] Updated weights for policy 0, policy_version 178960 (0.0005) [2023-03-08 12:40:48,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11741.9, 300 sec: 12079.7). Total num frames: 91648000. Throughput: 0: 11743.3. Samples: 91619392. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:40:48,080][389401] Avg episode reward: [(0, '4739.866')] [2023-03-08 12:40:49,532][389688] Updated weights for policy 0, policy_version 179040 (0.0005) [2023-03-08 12:40:52,749][389688] Updated weights for policy 0, policy_version 179120 (0.0004) [2023-03-08 12:40:53,079][389401] Fps is (10 sec: 12697.7, 60 sec: 11878.4, 300 sec: 12079.7). Total num frames: 91713536. Throughput: 0: 11818.4. Samples: 91695520. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:40:53,080][389401] Avg episode reward: [(0, '4738.442')] [2023-03-08 12:40:53,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000179128_91713536.pth... [2023-03-08 12:40:53,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000178432_91357184.pth [2023-03-08 12:40:55,928][389688] Updated weights for policy 0, policy_version 179200 (0.0004) [2023-03-08 12:40:58,079][389401] Fps is (10 sec: 12697.6, 60 sec: 11946.6, 300 sec: 12093.6). Total num frames: 91774976. Throughput: 0: 11942.8. Samples: 91772492. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:40:58,080][389401] Avg episode reward: [(0, '4697.615')] [2023-03-08 12:40:59,139][389688] Updated weights for policy 0, policy_version 179280 (0.0004) [2023-03-08 12:41:02,411][389688] Updated weights for policy 0, policy_version 179360 (0.0004) [2023-03-08 12:41:03,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12083.2, 300 sec: 12107.5). Total num frames: 91840512. Throughput: 0: 12028.0. Samples: 91810636. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:41:03,080][389401] Avg episode reward: [(0, '4726.299')] [2023-03-08 12:41:05,603][389688] Updated weights for policy 0, policy_version 179440 (0.0004) [2023-03-08 12:41:08,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 12107.5). Total num frames: 91901952. Throughput: 0: 12130.2. Samples: 91885640. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:41:08,080][389401] Avg episode reward: [(0, '4739.033')] [2023-03-08 12:41:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000179496_91901952.pth... [2023-03-08 12:41:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000178768_91529216.pth [2023-03-08 12:41:08,919][389688] Updated weights for policy 0, policy_version 179520 (0.0004) [2023-03-08 12:41:12,224][389688] Updated weights for policy 0, policy_version 179600 (0.0004) [2023-03-08 12:41:13,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12083.2, 300 sec: 12107.5). Total num frames: 91963392. Throughput: 0: 12179.7. Samples: 91960656. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:41:13,080][389401] Avg episode reward: [(0, '4737.694')] [2023-03-08 12:41:15,363][389688] Updated weights for policy 0, policy_version 179680 (0.0004) [2023-03-08 12:41:18,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 12107.5). Total num frames: 92028928. Throughput: 0: 12300.4. Samples: 92000236. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:41:18,080][389401] Avg episode reward: [(0, '4739.973')] [2023-03-08 12:41:18,610][389688] Updated weights for policy 0, policy_version 179760 (0.0004) [2023-03-08 12:41:21,961][389688] Updated weights for policy 0, policy_version 179840 (0.0004) [2023-03-08 12:41:23,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12288.0, 300 sec: 12093.6). Total num frames: 92090368. Throughput: 0: 12439.5. Samples: 92074048. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:41:23,080][389401] Avg episode reward: [(0, '4742.849')] [2023-03-08 12:41:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000179864_92090368.pth... [2023-03-08 12:41:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000179128_91713536.pth [2023-03-08 12:41:25,459][389688] Updated weights for policy 0, policy_version 179920 (0.0004) [2023-03-08 12:41:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12065.8). Total num frames: 92147712. Throughput: 0: 12518.6. Samples: 92146132. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:41:28,080][389401] Avg episode reward: [(0, '4738.963')] [2023-03-08 12:41:28,772][389688] Updated weights for policy 0, policy_version 180000 (0.0005) [2023-03-08 12:41:32,084][389688] Updated weights for policy 0, policy_version 180080 (0.0004) [2023-03-08 12:41:33,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12288.0, 300 sec: 12052.0). Total num frames: 92209152. Throughput: 0: 12542.1. Samples: 92183788. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:41:33,080][389401] Avg episode reward: [(0, '4739.578')] [2023-03-08 12:41:35,487][389688] Updated weights for policy 0, policy_version 180160 (0.0004) [2023-03-08 12:41:38,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12356.3, 300 sec: 12052.0). Total num frames: 92270592. Throughput: 0: 12456.8. Samples: 92256076. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:41:38,080][389401] Avg episode reward: [(0, '4737.141')] [2023-03-08 12:41:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000180216_92270592.pth... [2023-03-08 12:41:38,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000179496_91901952.pth [2023-03-08 12:41:38,838][389688] Updated weights for policy 0, policy_version 180240 (0.0004) [2023-03-08 12:41:42,026][389688] Updated weights for policy 0, policy_version 180320 (0.0004) [2023-03-08 12:41:43,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12052.0). Total num frames: 92336128. Throughput: 0: 12435.7. Samples: 92332096. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:41:43,080][389401] Avg episode reward: [(0, '4699.510')] [2023-03-08 12:41:45,292][389688] Updated weights for policy 0, policy_version 180400 (0.0004) [2023-03-08 12:41:48,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12492.8, 300 sec: 12038.1). Total num frames: 92397568. Throughput: 0: 12412.7. Samples: 92369208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:41:48,080][389401] Avg episode reward: [(0, '4741.116')] [2023-03-08 12:41:48,536][389688] Updated weights for policy 0, policy_version 180480 (0.0004) [2023-03-08 12:41:51,797][389688] Updated weights for policy 0, policy_version 180560 (0.0004) [2023-03-08 12:41:53,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12424.5, 300 sec: 12038.1). Total num frames: 92459008. Throughput: 0: 12433.0. Samples: 92445124. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:41:53,080][389401] Avg episode reward: [(0, '4742.001')] [2023-03-08 12:41:53,089][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000180592_92463104.pth... [2023-03-08 12:41:53,091][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000179864_92090368.pth [2023-03-08 12:41:55,245][389688] Updated weights for policy 0, policy_version 180640 (0.0004) [2023-03-08 12:41:58,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12024.2). Total num frames: 92520448. Throughput: 0: 12350.2. Samples: 92516416. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:41:58,080][389401] Avg episode reward: [(0, '4741.135')] [2023-03-08 12:41:58,662][389688] Updated weights for policy 0, policy_version 180720 (0.0005) [2023-03-08 12:42:02,271][389688] Updated weights for policy 0, policy_version 180800 (0.0005) [2023-03-08 12:42:03,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12288.0, 300 sec: 12010.3). Total num frames: 92577792. Throughput: 0: 12242.3. Samples: 92551140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:42:03,080][389401] Avg episode reward: [(0, '4739.483')] [2023-03-08 12:42:05,723][389688] Updated weights for policy 0, policy_version 180880 (0.0005) [2023-03-08 12:42:08,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12219.7, 300 sec: 11996.4). Total num frames: 92635136. Throughput: 0: 12165.4. Samples: 92621488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:42:08,080][389401] Avg episode reward: [(0, '4738.051')] [2023-03-08 12:42:08,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000180928_92635136.pth... [2023-03-08 12:42:08,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000180216_92270592.pth [2023-03-08 12:42:09,265][389688] Updated weights for policy 0, policy_version 180960 (0.0004) [2023-03-08 12:42:12,751][389688] Updated weights for policy 0, policy_version 181040 (0.0005) [2023-03-08 12:42:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12151.5, 300 sec: 11968.7). Total num frames: 92692480. Throughput: 0: 12124.9. Samples: 92691752. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:42:13,080][389401] Avg episode reward: [(0, '4739.676')] [2023-03-08 12:42:16,256][389688] Updated weights for policy 0, policy_version 181120 (0.0005) [2023-03-08 12:42:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 11982.5). Total num frames: 92753920. Throughput: 0: 12050.7. Samples: 92726068. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:42:18,080][389401] Avg episode reward: [(0, '4741.005')] [2023-03-08 12:42:19,778][389688] Updated weights for policy 0, policy_version 181200 (0.0005) [2023-03-08 12:42:23,079][389401] Fps is (10 sec: 11878.2, 60 sec: 12014.9, 300 sec: 11982.5). Total num frames: 92811264. Throughput: 0: 12007.2. Samples: 92796400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:42:23,080][389401] Avg episode reward: [(0, '4738.590')] [2023-03-08 12:42:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000181272_92811264.pth... [2023-03-08 12:42:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000180592_92463104.pth [2023-03-08 12:42:23,211][389688] Updated weights for policy 0, policy_version 181280 (0.0005) [2023-03-08 12:42:26,765][389688] Updated weights for policy 0, policy_version 181360 (0.0005) [2023-03-08 12:42:28,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11982.5). Total num frames: 92868608. Throughput: 0: 11896.6. Samples: 92867444. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:42:28,080][389401] Avg episode reward: [(0, '4742.639')] [2023-03-08 12:42:30,211][389688] Updated weights for policy 0, policy_version 181440 (0.0005) [2023-03-08 12:42:33,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12014.9, 300 sec: 11996.4). Total num frames: 92930048. Throughput: 0: 11852.7. Samples: 92902580. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:42:33,080][389401] Avg episode reward: [(0, '4740.221')] [2023-03-08 12:42:33,758][389688] Updated weights for policy 0, policy_version 181520 (0.0005) [2023-03-08 12:42:37,192][389688] Updated weights for policy 0, policy_version 181600 (0.0005) [2023-03-08 12:42:38,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11982.5). Total num frames: 92987392. Throughput: 0: 11719.7. Samples: 92972508. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:42:38,080][389401] Avg episode reward: [(0, '4741.570')] [2023-03-08 12:42:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000181616_92987392.pth... [2023-03-08 12:42:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000180928_92635136.pth [2023-03-08 12:42:40,652][389688] Updated weights for policy 0, policy_version 181680 (0.0005) [2023-03-08 12:42:43,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11996.4). Total num frames: 93048832. Throughput: 0: 11740.5. Samples: 93044736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:42:43,080][389401] Avg episode reward: [(0, '4743.693')] [2023-03-08 12:42:44,046][389688] Updated weights for policy 0, policy_version 181760 (0.0005) [2023-03-08 12:42:47,631][389688] Updated weights for policy 0, policy_version 181840 (0.0005) [2023-03-08 12:42:48,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11810.1, 300 sec: 11982.5). Total num frames: 93106176. Throughput: 0: 11737.4. Samples: 93079324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:42:48,080][389401] Avg episode reward: [(0, '4740.435')] [2023-03-08 12:42:51,123][389688] Updated weights for policy 0, policy_version 181920 (0.0005) [2023-03-08 12:42:53,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11741.9, 300 sec: 11954.8). Total num frames: 93163520. Throughput: 0: 11742.0. Samples: 93149880. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:42:53,080][389401] Avg episode reward: [(0, '4740.503')] [2023-03-08 12:42:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000181960_93163520.pth... [2023-03-08 12:42:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000181272_92811264.pth [2023-03-08 12:42:54,578][389688] Updated weights for policy 0, policy_version 182000 (0.0005) [2023-03-08 12:42:57,835][389688] Updated weights for policy 0, policy_version 182080 (0.0004) [2023-03-08 12:42:58,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11741.9, 300 sec: 11954.8). Total num frames: 93224960. Throughput: 0: 11812.7. Samples: 93223324. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:42:58,080][389401] Avg episode reward: [(0, '4742.376')] [2023-03-08 12:43:01,354][389688] Updated weights for policy 0, policy_version 182160 (0.0004) [2023-03-08 12:43:03,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11741.9, 300 sec: 11940.9). Total num frames: 93282304. Throughput: 0: 11814.8. Samples: 93257736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:43:03,080][389401] Avg episode reward: [(0, '4741.455')] [2023-03-08 12:43:04,852][389688] Updated weights for policy 0, policy_version 182240 (0.0005) [2023-03-08 12:43:08,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11940.9). Total num frames: 93343744. Throughput: 0: 11819.7. Samples: 93328284. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:43:08,080][389401] Avg episode reward: [(0, '4739.004')] [2023-03-08 12:43:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000182312_93343744.pth... [2023-03-08 12:43:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000181616_92987392.pth [2023-03-08 12:43:08,335][389688] Updated weights for policy 0, policy_version 182320 (0.0005) [2023-03-08 12:43:11,835][389688] Updated weights for policy 0, policy_version 182400 (0.0005) [2023-03-08 12:43:13,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11927.0). Total num frames: 93401088. Throughput: 0: 11791.4. Samples: 93398056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:43:13,080][389401] Avg episode reward: [(0, '4739.137')] [2023-03-08 12:43:15,309][389688] Updated weights for policy 0, policy_version 182480 (0.0005) [2023-03-08 12:43:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11927.0). Total num frames: 93462528. Throughput: 0: 11807.5. Samples: 93433920. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:43:18,080][389401] Avg episode reward: [(0, '4740.034')] [2023-03-08 12:43:18,604][389688] Updated weights for policy 0, policy_version 182560 (0.0005) [2023-03-08 12:43:22,120][389688] Updated weights for policy 0, policy_version 182640 (0.0005) [2023-03-08 12:43:23,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11913.1). Total num frames: 93519872. Throughput: 0: 11873.3. Samples: 93506808. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:43:23,080][389401] Avg episode reward: [(0, '4741.125')] [2023-03-08 12:43:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000182656_93519872.pth... [2023-03-08 12:43:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000181960_93163520.pth [2023-03-08 12:43:25,651][389688] Updated weights for policy 0, policy_version 182720 (0.0005) [2023-03-08 12:43:28,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11810.1, 300 sec: 11899.2). Total num frames: 93577216. Throughput: 0: 11814.8. Samples: 93576404. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:43:28,080][389401] Avg episode reward: [(0, '4742.649')] [2023-03-08 12:43:29,152][389688] Updated weights for policy 0, policy_version 182800 (0.0005) [2023-03-08 12:43:32,699][389688] Updated weights for policy 0, policy_version 182880 (0.0005) [2023-03-08 12:43:33,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11899.2). Total num frames: 93638656. Throughput: 0: 11811.1. Samples: 93610824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:43:33,090][389401] Avg episode reward: [(0, '4740.201')] [2023-03-08 12:43:36,219][389688] Updated weights for policy 0, policy_version 182960 (0.0005) [2023-03-08 12:43:38,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11885.3). Total num frames: 93696000. Throughput: 0: 11787.4. Samples: 93680312. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:43:38,090][389401] Avg episode reward: [(0, '4740.729')] [2023-03-08 12:43:38,093][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000183000_93696000.pth... [2023-03-08 12:43:38,096][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000182312_93343744.pth [2023-03-08 12:43:39,678][389688] Updated weights for policy 0, policy_version 183040 (0.0005) [2023-03-08 12:43:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11857.6). Total num frames: 93753344. Throughput: 0: 11738.8. Samples: 93751568. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:43:43,080][389401] Avg episode reward: [(0, '4742.876')] [2023-03-08 12:43:43,194][389688] Updated weights for policy 0, policy_version 183120 (0.0005) [2023-03-08 12:43:46,735][389688] Updated weights for policy 0, policy_version 183200 (0.0005) [2023-03-08 12:43:48,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11741.8, 300 sec: 11871.5). Total num frames: 93810688. Throughput: 0: 11743.1. Samples: 93786176. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:43:48,080][389401] Avg episode reward: [(0, '4738.680')] [2023-03-08 12:43:50,223][389688] Updated weights for policy 0, policy_version 183280 (0.0005) [2023-03-08 12:43:53,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11885.3). Total num frames: 93872128. Throughput: 0: 11721.8. Samples: 93855764. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:43:53,080][389401] Avg episode reward: [(0, '4743.187')] [2023-03-08 12:43:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000183344_93872128.pth... [2023-03-08 12:43:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000182656_93519872.pth [2023-03-08 12:43:53,695][389688] Updated weights for policy 0, policy_version 183360 (0.0004) [2023-03-08 12:43:56,957][389688] Updated weights for policy 0, policy_version 183440 (0.0004) [2023-03-08 12:43:58,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 11899.2). Total num frames: 93933568. Throughput: 0: 11810.8. Samples: 93929544. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:43:58,080][389401] Avg episode reward: [(0, '4742.206')] [2023-03-08 12:44:00,367][389688] Updated weights for policy 0, policy_version 183520 (0.0005) [2023-03-08 12:44:03,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11899.2). Total num frames: 93990912. Throughput: 0: 11827.2. Samples: 93966144. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:44:03,090][389401] Avg episode reward: [(0, '4743.009')] [2023-03-08 12:44:03,886][389688] Updated weights for policy 0, policy_version 183600 (0.0005) [2023-03-08 12:44:07,316][389688] Updated weights for policy 0, policy_version 183680 (0.0005) [2023-03-08 12:44:08,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 11913.1). Total num frames: 94052352. Throughput: 0: 11760.5. Samples: 94036032. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:44:08,080][389401] Avg episode reward: [(0, '4741.740')] [2023-03-08 12:44:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000183696_94052352.pth... [2023-03-08 12:44:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000183000_93696000.pth [2023-03-08 12:44:10,858][389688] Updated weights for policy 0, policy_version 183760 (0.0005) [2023-03-08 12:44:13,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.2, 300 sec: 11913.1). Total num frames: 94109696. Throughput: 0: 11761.5. Samples: 94105672. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:44:13,080][389401] Avg episode reward: [(0, '4741.267')] [2023-03-08 12:44:14,399][389688] Updated weights for policy 0, policy_version 183840 (0.0005) [2023-03-08 12:44:17,889][389688] Updated weights for policy 0, policy_version 183920 (0.0005) [2023-03-08 12:44:18,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 11913.1). Total num frames: 94167040. Throughput: 0: 11760.6. Samples: 94140052. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:44:18,080][389401] Avg episode reward: [(0, '4739.917')] [2023-03-08 12:44:21,136][389688] Updated weights for policy 0, policy_version 184000 (0.0004) [2023-03-08 12:44:23,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11927.0). Total num frames: 94228480. Throughput: 0: 11865.1. Samples: 94214244. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:44:23,080][389401] Avg episode reward: [(0, '4741.968')] [2023-03-08 12:44:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000184040_94228480.pth... [2023-03-08 12:44:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000183344_93872128.pth [2023-03-08 12:44:24,463][389688] Updated weights for policy 0, policy_version 184080 (0.0005) [2023-03-08 12:44:27,796][389688] Updated weights for policy 0, policy_version 184160 (0.0005) [2023-03-08 12:44:28,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11878.4, 300 sec: 11940.9). Total num frames: 94289920. Throughput: 0: 11921.0. Samples: 94288012. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:44:28,080][389401] Avg episode reward: [(0, '4741.346')] [2023-03-08 12:44:31,008][389688] Updated weights for policy 0, policy_version 184240 (0.0004) [2023-03-08 12:44:33,079][389401] Fps is (10 sec: 12697.6, 60 sec: 11946.7, 300 sec: 11968.6). Total num frames: 94355456. Throughput: 0: 12013.5. Samples: 94326784. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:44:33,080][389401] Avg episode reward: [(0, '4741.660')] [2023-03-08 12:44:34,178][389688] Updated weights for policy 0, policy_version 184320 (0.0004) [2023-03-08 12:44:37,595][389688] Updated weights for policy 0, policy_version 184400 (0.0005) [2023-03-08 12:44:38,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12014.9, 300 sec: 11982.5). Total num frames: 94416896. Throughput: 0: 12115.8. Samples: 94400976. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:44:38,092][389401] Avg episode reward: [(0, '4744.460')] [2023-03-08 12:44:38,096][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000184408_94416896.pth... [2023-03-08 12:44:38,099][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000183696_94052352.pth [2023-03-08 12:44:41,116][389688] Updated weights for policy 0, policy_version 184480 (0.0005) [2023-03-08 12:44:43,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11968.6). Total num frames: 94474240. Throughput: 0: 12057.4. Samples: 94472128. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:44:43,090][389401] Avg episode reward: [(0, '4741.645')] [2023-03-08 12:44:44,614][389688] Updated weights for policy 0, policy_version 184560 (0.0005) [2023-03-08 12:44:48,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12014.9, 300 sec: 11968.7). Total num frames: 94531584. Throughput: 0: 12020.6. Samples: 94507072. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:44:48,080][389401] Avg episode reward: [(0, '4742.532')] [2023-03-08 12:44:48,130][389688] Updated weights for policy 0, policy_version 184640 (0.0005) [2023-03-08 12:44:51,446][389688] Updated weights for policy 0, policy_version 184720 (0.0005) [2023-03-08 12:44:53,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12014.9, 300 sec: 11982.5). Total num frames: 94593024. Throughput: 0: 12076.2. Samples: 94579460. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:44:53,080][389401] Avg episode reward: [(0, '4740.977')] [2023-03-08 12:44:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000184752_94593024.pth... [2023-03-08 12:44:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000184040_94228480.pth [2023-03-08 12:44:55,022][389688] Updated weights for policy 0, policy_version 184800 (0.0005) [2023-03-08 12:44:58,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11982.5). Total num frames: 94650368. Throughput: 0: 12047.0. Samples: 94647788. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:44:58,080][389401] Avg episode reward: [(0, '4740.615')] [2023-03-08 12:44:58,594][389688] Updated weights for policy 0, policy_version 184880 (0.0005) [2023-03-08 12:45:02,152][389688] Updated weights for policy 0, policy_version 184960 (0.0005) [2023-03-08 12:45:03,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11946.7, 300 sec: 11954.8). Total num frames: 94707712. Throughput: 0: 12051.4. Samples: 94682364. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:45:03,080][389401] Avg episode reward: [(0, '4742.449')] [2023-03-08 12:45:05,636][389688] Updated weights for policy 0, policy_version 185040 (0.0005) [2023-03-08 12:45:08,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 11968.7). Total num frames: 94769152. Throughput: 0: 11967.4. Samples: 94752776. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:45:08,080][389401] Avg episode reward: [(0, '4742.148')] [2023-03-08 12:45:08,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000185096_94769152.pth... [2023-03-08 12:45:08,084][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000184408_94416896.pth [2023-03-08 12:45:09,060][389688] Updated weights for policy 0, policy_version 185120 (0.0005) [2023-03-08 12:45:12,492][389688] Updated weights for policy 0, policy_version 185200 (0.0005) [2023-03-08 12:45:13,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11946.7, 300 sec: 11968.6). Total num frames: 94826496. Throughput: 0: 11917.2. Samples: 94824288. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:45:13,080][389401] Avg episode reward: [(0, '4743.469')] [2023-03-08 12:45:15,679][389688] Updated weights for policy 0, policy_version 185280 (0.0004) [2023-03-08 12:45:18,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 11996.4). Total num frames: 94892032. Throughput: 0: 11923.4. Samples: 94863336. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:45:18,080][389401] Avg episode reward: [(0, '4742.296')] [2023-03-08 12:45:18,956][389688] Updated weights for policy 0, policy_version 185360 (0.0004) [2023-03-08 12:45:22,234][389688] Updated weights for policy 0, policy_version 185440 (0.0004) [2023-03-08 12:45:23,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12083.2, 300 sec: 11996.4). Total num frames: 94953472. Throughput: 0: 11932.7. Samples: 94937948. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:45:23,080][389401] Avg episode reward: [(0, '4744.320')] [2023-03-08 12:45:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000185456_94953472.pth... [2023-03-08 12:45:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000184752_94593024.pth [2023-03-08 12:45:25,465][389688] Updated weights for policy 0, policy_version 185520 (0.0004) [2023-03-08 12:45:28,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 12024.2). Total num frames: 95019008. Throughput: 0: 12057.3. Samples: 95014708. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:45:28,080][389401] Avg episode reward: [(0, '4739.773')] [2023-03-08 12:45:28,646][389688] Updated weights for policy 0, policy_version 185600 (0.0004) [2023-03-08 12:45:31,894][389688] Updated weights for policy 0, policy_version 185680 (0.0004) [2023-03-08 12:45:33,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12083.2, 300 sec: 12038.1). Total num frames: 95080448. Throughput: 0: 12118.3. Samples: 95052396. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:45:33,080][389401] Avg episode reward: [(0, '4744.221')] [2023-03-08 12:45:35,119][389688] Updated weights for policy 0, policy_version 185760 (0.0004) [2023-03-08 12:45:38,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 12065.8). Total num frames: 95145984. Throughput: 0: 12225.3. Samples: 95129600. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:45:38,080][389401] Avg episode reward: [(0, '4733.706')] [2023-03-08 12:45:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000185832_95145984.pth... [2023-03-08 12:45:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000185096_94769152.pth [2023-03-08 12:45:38,268][389688] Updated weights for policy 0, policy_version 185840 (0.0003) [2023-03-08 12:45:41,630][389688] Updated weights for policy 0, policy_version 185920 (0.0004) [2023-03-08 12:45:43,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12219.7, 300 sec: 12065.8). Total num frames: 95207424. Throughput: 0: 12362.3. Samples: 95204092. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:45:43,080][389401] Avg episode reward: [(0, '4732.228')] [2023-03-08 12:45:44,853][389688] Updated weights for policy 0, policy_version 186000 (0.0004) [2023-03-08 12:45:48,020][389688] Updated weights for policy 0, policy_version 186080 (0.0004) [2023-03-08 12:45:48,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12356.3, 300 sec: 12065.8). Total num frames: 95272960. Throughput: 0: 12448.2. Samples: 95242532. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:45:48,080][389401] Avg episode reward: [(0, '4743.149')] [2023-03-08 12:45:51,135][389688] Updated weights for policy 0, policy_version 186160 (0.0004) [2023-03-08 12:45:53,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12356.3, 300 sec: 12065.8). Total num frames: 95334400. Throughput: 0: 12620.3. Samples: 95320688. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2023-03-08 12:45:53,080][389401] Avg episode reward: [(0, '4743.218')] [2023-03-08 12:45:53,097][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000186208_95338496.pth... [2023-03-08 12:45:53,099][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000185456_94953472.pth [2023-03-08 12:45:54,400][389688] Updated weights for policy 0, policy_version 186240 (0.0004) [2023-03-08 12:45:57,639][389688] Updated weights for policy 0, policy_version 186320 (0.0004) [2023-03-08 12:45:58,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12492.8, 300 sec: 12065.8). Total num frames: 95399936. Throughput: 0: 12702.6. Samples: 95395904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:45:58,080][389401] Avg episode reward: [(0, '4743.383')] [2023-03-08 12:46:00,891][389688] Updated weights for policy 0, policy_version 186400 (0.0004) [2023-03-08 12:46:03,079][389401] Fps is (10 sec: 13107.1, 60 sec: 12629.3, 300 sec: 12079.7). Total num frames: 95465472. Throughput: 0: 12673.5. Samples: 95433644. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:46:03,080][389401] Avg episode reward: [(0, '4741.058')] [2023-03-08 12:46:03,973][389688] Updated weights for policy 0, policy_version 186480 (0.0003) [2023-03-08 12:46:07,112][389688] Updated weights for policy 0, policy_version 186560 (0.0004) [2023-03-08 12:46:08,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12629.3, 300 sec: 12079.7). Total num frames: 95526912. Throughput: 0: 12785.2. Samples: 95513280. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:46:08,080][389401] Avg episode reward: [(0, '4742.275')] [2023-03-08 12:46:08,096][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000186584_95531008.pth... [2023-03-08 12:46:08,098][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000185832_95145984.pth [2023-03-08 12:46:10,238][389688] Updated weights for policy 0, policy_version 186640 (0.0004) [2023-03-08 12:46:13,079][389401] Fps is (10 sec: 13107.2, 60 sec: 12834.1, 300 sec: 12093.6). Total num frames: 95596544. Throughput: 0: 12810.1. Samples: 95591164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:46:13,080][389401] Avg episode reward: [(0, '4744.106')] [2023-03-08 12:46:13,379][389688] Updated weights for policy 0, policy_version 186720 (0.0004) [2023-03-08 12:46:16,572][389688] Updated weights for policy 0, policy_version 186800 (0.0004) [2023-03-08 12:46:18,079][389401] Fps is (10 sec: 13107.2, 60 sec: 12765.9, 300 sec: 12093.6). Total num frames: 95657984. Throughput: 0: 12825.5. Samples: 95629544. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:46:18,080][389401] Avg episode reward: [(0, '4741.794')] [2023-03-08 12:46:19,678][389688] Updated weights for policy 0, policy_version 186880 (0.0004) [2023-03-08 12:46:22,893][389688] Updated weights for policy 0, policy_version 186960 (0.0004) [2023-03-08 12:46:23,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12834.1, 300 sec: 12121.4). Total num frames: 95723520. Throughput: 0: 12835.7. Samples: 95707208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:46:23,080][389401] Avg episode reward: [(0, '4742.616')] [2023-03-08 12:46:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000186960_95723520.pth... [2023-03-08 12:46:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000186208_95338496.pth [2023-03-08 12:46:26,065][389688] Updated weights for policy 0, policy_version 187040 (0.0005) [2023-03-08 12:46:28,079][389401] Fps is (10 sec: 13107.2, 60 sec: 12834.1, 300 sec: 12135.3). Total num frames: 95789056. Throughput: 0: 12913.0. Samples: 95785176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:46:28,080][389401] Avg episode reward: [(0, '4740.498')] [2023-03-08 12:46:29,155][389688] Updated weights for policy 0, policy_version 187120 (0.0004) [2023-03-08 12:46:32,281][389688] Updated weights for policy 0, policy_version 187200 (0.0004) [2023-03-08 12:46:33,079][389401] Fps is (10 sec: 13107.3, 60 sec: 12902.4, 300 sec: 12149.2). Total num frames: 95854592. Throughput: 0: 12941.0. Samples: 95824876. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:46:33,080][389401] Avg episode reward: [(0, '4740.196')] [2023-03-08 12:46:35,440][389688] Updated weights for policy 0, policy_version 187280 (0.0004) [2023-03-08 12:46:38,079][389401] Fps is (10 sec: 13107.2, 60 sec: 12902.4, 300 sec: 12149.2). Total num frames: 95920128. Throughput: 0: 12941.5. Samples: 95903056. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:46:38,080][389401] Avg episode reward: [(0, '4742.612')] [2023-03-08 12:46:38,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000187344_95920128.pth... [2023-03-08 12:46:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000186584_95531008.pth [2023-03-08 12:46:38,649][389688] Updated weights for policy 0, policy_version 187360 (0.0004) [2023-03-08 12:46:41,826][389688] Updated weights for policy 0, policy_version 187440 (0.0004) [2023-03-08 12:46:43,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12902.4, 300 sec: 12149.1). Total num frames: 95981568. Throughput: 0: 12976.7. Samples: 95979856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:46:43,080][389401] Avg episode reward: [(0, '4742.620')] [2023-03-08 12:46:45,096][389688] Updated weights for policy 0, policy_version 187520 (0.0004) [2023-03-08 12:46:48,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12834.1, 300 sec: 12149.2). Total num frames: 96043008. Throughput: 0: 12957.2. Samples: 96016716. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:46:48,080][389401] Avg episode reward: [(0, '4741.755')] [2023-03-08 12:46:48,613][389688] Updated weights for policy 0, policy_version 187600 (0.0005) [2023-03-08 12:46:51,911][389688] Updated weights for policy 0, policy_version 187680 (0.0004) [2023-03-08 12:46:53,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12834.1, 300 sec: 12149.1). Total num frames: 96104448. Throughput: 0: 12779.1. Samples: 96088340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:46:53,080][389401] Avg episode reward: [(0, '4742.999')] [2023-03-08 12:46:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000187704_96104448.pth... [2023-03-08 12:46:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000186960_95723520.pth [2023-03-08 12:46:55,094][389688] Updated weights for policy 0, policy_version 187760 (0.0004) [2023-03-08 12:46:58,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12834.1, 300 sec: 12176.9). Total num frames: 96169984. Throughput: 0: 12770.9. Samples: 96165856. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:46:58,080][389401] Avg episode reward: [(0, '4738.664')] [2023-03-08 12:46:58,368][389688] Updated weights for policy 0, policy_version 187840 (0.0004) [2023-03-08 12:47:01,763][389688] Updated weights for policy 0, policy_version 187920 (0.0005) [2023-03-08 12:47:03,079][389401] Fps is (10 sec: 12288.1, 60 sec: 12697.6, 300 sec: 12176.9). Total num frames: 96227328. Throughput: 0: 12720.8. Samples: 96201980. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:47:03,080][389401] Avg episode reward: [(0, '4743.484')] [2023-03-08 12:47:05,150][389688] Updated weights for policy 0, policy_version 188000 (0.0005) [2023-03-08 12:47:08,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12765.9, 300 sec: 12204.7). Total num frames: 96292864. Throughput: 0: 12619.8. Samples: 96275100. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:47:08,080][389401] Avg episode reward: [(0, '4741.731')] [2023-03-08 12:47:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000188072_96292864.pth... [2023-03-08 12:47:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000187344_95920128.pth [2023-03-08 12:47:08,362][389688] Updated weights for policy 0, policy_version 188080 (0.0004) [2023-03-08 12:47:11,667][389688] Updated weights for policy 0, policy_version 188160 (0.0005) [2023-03-08 12:47:13,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12629.3, 300 sec: 12204.7). Total num frames: 96354304. Throughput: 0: 12557.7. Samples: 96350272. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:47:13,080][389401] Avg episode reward: [(0, '4738.977')] [2023-03-08 12:47:15,238][389688] Updated weights for policy 0, policy_version 188240 (0.0005) [2023-03-08 12:47:18,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12561.1, 300 sec: 12204.7). Total num frames: 96411648. Throughput: 0: 12405.2. Samples: 96383112. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:47:18,080][389401] Avg episode reward: [(0, '4736.289')] [2023-03-08 12:47:18,723][389688] Updated weights for policy 0, policy_version 188320 (0.0005) [2023-03-08 12:47:22,250][389688] Updated weights for policy 0, policy_version 188400 (0.0005) [2023-03-08 12:47:23,079][389401] Fps is (10 sec: 11468.8, 60 sec: 12424.5, 300 sec: 12204.7). Total num frames: 96468992. Throughput: 0: 12249.9. Samples: 96454300. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:47:23,080][389401] Avg episode reward: [(0, '4628.766')] [2023-03-08 12:47:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000188416_96468992.pth... [2023-03-08 12:47:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000187704_96104448.pth [2023-03-08 12:47:25,411][389688] Updated weights for policy 0, policy_version 188480 (0.0004) [2023-03-08 12:47:28,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12424.5, 300 sec: 12218.6). Total num frames: 96534528. Throughput: 0: 12236.5. Samples: 96530496. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:47:28,080][389401] Avg episode reward: [(0, '4576.281')] [2023-03-08 12:47:28,666][389688] Updated weights for policy 0, policy_version 188560 (0.0004) [2023-03-08 12:47:31,871][389688] Updated weights for policy 0, policy_version 188640 (0.0003) [2023-03-08 12:47:33,079][389401] Fps is (10 sec: 12697.7, 60 sec: 12356.3, 300 sec: 12232.5). Total num frames: 96595968. Throughput: 0: 12253.2. Samples: 96568108. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:47:33,080][389401] Avg episode reward: [(0, '4658.469')] [2023-03-08 12:47:35,136][389688] Updated weights for policy 0, policy_version 188720 (0.0004) [2023-03-08 12:47:38,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 12232.5). Total num frames: 96657408. Throughput: 0: 12350.7. Samples: 96644120. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:47:38,080][389401] Avg episode reward: [(0, '4738.943')] [2023-03-08 12:47:38,089][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000188792_96661504.pth... [2023-03-08 12:47:38,091][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000188072_96292864.pth [2023-03-08 12:47:38,399][389688] Updated weights for policy 0, policy_version 188800 (0.0004) [2023-03-08 12:47:41,820][389688] Updated weights for policy 0, policy_version 188880 (0.0005) [2023-03-08 12:47:43,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12288.0, 300 sec: 12246.3). Total num frames: 96718848. Throughput: 0: 12249.9. Samples: 96717100. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:47:43,080][389401] Avg episode reward: [(0, '4739.446')] [2023-03-08 12:47:45,340][389688] Updated weights for policy 0, policy_version 188960 (0.0005) [2023-03-08 12:47:48,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12219.7, 300 sec: 12246.3). Total num frames: 96776192. Throughput: 0: 12214.1. Samples: 96751616. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:47:48,080][389401] Avg episode reward: [(0, '4738.427')] [2023-03-08 12:47:48,812][389688] Updated weights for policy 0, policy_version 189040 (0.0005) [2023-03-08 12:47:52,115][389688] Updated weights for policy 0, policy_version 189120 (0.0005) [2023-03-08 12:47:53,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12219.7, 300 sec: 12246.3). Total num frames: 96837632. Throughput: 0: 12195.1. Samples: 96823880. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:47:53,080][389401] Avg episode reward: [(0, '4737.709')] [2023-03-08 12:47:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000189144_96841728.pth... [2023-03-08 12:47:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000188416_96468992.pth [2023-03-08 12:47:55,523][389688] Updated weights for policy 0, policy_version 189200 (0.0005) [2023-03-08 12:47:58,079][389401] Fps is (10 sec: 12288.0, 60 sec: 12151.5, 300 sec: 12260.2). Total num frames: 96899072. Throughput: 0: 12106.0. Samples: 96895040. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:47:58,080][389401] Avg episode reward: [(0, '4740.257')] [2023-03-08 12:47:59,063][389688] Updated weights for policy 0, policy_version 189280 (0.0005) [2023-03-08 12:48:02,521][389688] Updated weights for policy 0, policy_version 189360 (0.0005) [2023-03-08 12:48:03,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12246.3). Total num frames: 96956416. Throughput: 0: 12176.4. Samples: 96931052. Policy #0 lag: (min: 4.0, avg: 4.0, max: 4.0) [2023-03-08 12:48:03,080][389401] Avg episode reward: [(0, '4700.119')] [2023-03-08 12:48:06,039][389688] Updated weights for policy 0, policy_version 189440 (0.0005) [2023-03-08 12:48:08,079][389401] Fps is (10 sec: 11468.7, 60 sec: 12014.9, 300 sec: 12246.3). Total num frames: 97013760. Throughput: 0: 12143.9. Samples: 97000776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:48:08,080][389401] Avg episode reward: [(0, '4740.290')] [2023-03-08 12:48:08,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000189480_97013760.pth... [2023-03-08 12:48:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000188792_96661504.pth [2023-03-08 12:48:09,627][389688] Updated weights for policy 0, policy_version 189520 (0.0005) [2023-03-08 12:48:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 12232.5). Total num frames: 97071104. Throughput: 0: 11992.0. Samples: 97070136. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:48:13,080][389401] Avg episode reward: [(0, '4738.318')] [2023-03-08 12:48:13,104][389688] Updated weights for policy 0, policy_version 189600 (0.0005) [2023-03-08 12:48:16,658][389688] Updated weights for policy 0, policy_version 189680 (0.0005) [2023-03-08 12:48:18,079][389401] Fps is (10 sec: 11878.5, 60 sec: 12014.9, 300 sec: 12246.3). Total num frames: 97132544. Throughput: 0: 11907.3. Samples: 97103936. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:48:18,080][389401] Avg episode reward: [(0, '4739.394')] [2023-03-08 12:48:19,894][389688] Updated weights for policy 0, policy_version 189760 (0.0004) [2023-03-08 12:48:23,079][389401] Fps is (10 sec: 12287.9, 60 sec: 12083.2, 300 sec: 12260.2). Total num frames: 97193984. Throughput: 0: 11888.9. Samples: 97179120. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:48:23,080][389401] Avg episode reward: [(0, '4740.106')] [2023-03-08 12:48:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000189832_97193984.pth... [2023-03-08 12:48:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000189144_96841728.pth [2023-03-08 12:48:23,155][389688] Updated weights for policy 0, policy_version 189840 (0.0004) [2023-03-08 12:48:26,353][389688] Updated weights for policy 0, policy_version 189920 (0.0004) [2023-03-08 12:48:28,079][389401] Fps is (10 sec: 12697.5, 60 sec: 12083.2, 300 sec: 12274.1). Total num frames: 97259520. Throughput: 0: 11962.9. Samples: 97255432. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:48:28,080][389401] Avg episode reward: [(0, '4743.283')] [2023-03-08 12:48:29,589][389688] Updated weights for policy 0, policy_version 190000 (0.0005) [2023-03-08 12:48:32,771][389688] Updated weights for policy 0, policy_version 190080 (0.0004) [2023-03-08 12:48:33,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12083.2, 300 sec: 12288.0). Total num frames: 97320960. Throughput: 0: 12026.7. Samples: 97292816. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:48:33,080][389401] Avg episode reward: [(0, '4741.346')] [2023-03-08 12:48:36,065][389688] Updated weights for policy 0, policy_version 190160 (0.0004) [2023-03-08 12:48:38,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 12315.8). Total num frames: 97386496. Throughput: 0: 12130.9. Samples: 97369772. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:48:38,080][389401] Avg episode reward: [(0, '4738.655')] [2023-03-08 12:48:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000190208_97386496.pth... [2023-03-08 12:48:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000189480_97013760.pth [2023-03-08 12:48:39,315][389688] Updated weights for policy 0, policy_version 190240 (0.0004) [2023-03-08 12:48:42,599][389688] Updated weights for policy 0, policy_version 190320 (0.0004) [2023-03-08 12:48:43,079][389401] Fps is (10 sec: 12697.6, 60 sec: 12151.5, 300 sec: 12329.7). Total num frames: 97447936. Throughput: 0: 12202.8. Samples: 97444164. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:48:43,080][389401] Avg episode reward: [(0, '4739.651')] [2023-03-08 12:48:45,950][389688] Updated weights for policy 0, policy_version 190400 (0.0004) [2023-03-08 12:48:48,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12151.5, 300 sec: 12315.8). Total num frames: 97505280. Throughput: 0: 12216.3. Samples: 97480784. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:48:48,080][389401] Avg episode reward: [(0, '4741.845')] [2023-03-08 12:48:49,478][389688] Updated weights for policy 0, policy_version 190480 (0.0004) [2023-03-08 12:48:52,934][389688] Updated weights for policy 0, policy_version 190560 (0.0004) [2023-03-08 12:48:53,079][389401] Fps is (10 sec: 11878.3, 60 sec: 12151.5, 300 sec: 12315.8). Total num frames: 97566720. Throughput: 0: 12231.5. Samples: 97551192. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:48:53,080][389401] Avg episode reward: [(0, '4743.408')] [2023-03-08 12:48:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000190560_97566720.pth... [2023-03-08 12:48:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000189832_97193984.pth [2023-03-08 12:48:56,559][389688] Updated weights for policy 0, policy_version 190640 (0.0005) [2023-03-08 12:48:58,079][389401] Fps is (10 sec: 11878.4, 60 sec: 12083.2, 300 sec: 12315.8). Total num frames: 97624064. Throughput: 0: 12224.1. Samples: 97620220. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:48:58,080][389401] Avg episode reward: [(0, '4740.581')] [2023-03-08 12:49:00,140][389688] Updated weights for policy 0, policy_version 190720 (0.0005) [2023-03-08 12:49:03,079][389401] Fps is (10 sec: 11468.9, 60 sec: 12083.2, 300 sec: 12301.9). Total num frames: 97681408. Throughput: 0: 12239.3. Samples: 97654704. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:49:03,080][389401] Avg episode reward: [(0, '4741.998')] [2023-03-08 12:49:03,730][389688] Updated weights for policy 0, policy_version 190800 (0.0005) [2023-03-08 12:49:07,306][389688] Updated weights for policy 0, policy_version 190880 (0.0005) [2023-03-08 12:49:08,079][389401] Fps is (10 sec: 11468.9, 60 sec: 12083.2, 300 sec: 12301.9). Total num frames: 97738752. Throughput: 0: 12091.6. Samples: 97723240. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:49:08,080][389401] Avg episode reward: [(0, '4731.736')] [2023-03-08 12:49:08,082][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000190896_97738752.pth... [2023-03-08 12:49:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000190208_97386496.pth [2023-03-08 12:49:10,952][389688] Updated weights for policy 0, policy_version 190960 (0.0005) [2023-03-08 12:49:13,079][389401] Fps is (10 sec: 11059.2, 60 sec: 12014.9, 300 sec: 12288.0). Total num frames: 97792000. Throughput: 0: 11904.4. Samples: 97791132. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:49:13,080][389401] Avg episode reward: [(0, '4738.631')] [2023-03-08 12:49:14,565][389688] Updated weights for policy 0, policy_version 191040 (0.0005) [2023-03-08 12:49:18,079][389401] Fps is (10 sec: 11059.1, 60 sec: 11946.7, 300 sec: 12274.1). Total num frames: 97849344. Throughput: 0: 11824.2. Samples: 97824904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:49:18,080][389401] Avg episode reward: [(0, '4740.356')] [2023-03-08 12:49:18,094][389688] Updated weights for policy 0, policy_version 191120 (0.0005) [2023-03-08 12:49:21,695][389688] Updated weights for policy 0, policy_version 191200 (0.0005) [2023-03-08 12:49:23,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 12274.1). Total num frames: 97910784. Throughput: 0: 11658.4. Samples: 97894400. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:49:23,080][389401] Avg episode reward: [(0, '4740.436')] [2023-03-08 12:49:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000191232_97910784.pth... [2023-03-08 12:49:23,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000190560_97566720.pth [2023-03-08 12:49:25,200][389688] Updated weights for policy 0, policy_version 191280 (0.0004) [2023-03-08 12:49:28,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11810.1, 300 sec: 12246.3). Total num frames: 97968128. Throughput: 0: 11548.0. Samples: 97963824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:49:28,080][389401] Avg episode reward: [(0, '4742.649')] [2023-03-08 12:49:28,709][389688] Updated weights for policy 0, policy_version 191360 (0.0005) [2023-03-08 12:49:32,263][389688] Updated weights for policy 0, policy_version 191440 (0.0005) [2023-03-08 12:49:33,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11741.9, 300 sec: 12232.5). Total num frames: 98025472. Throughput: 0: 11518.2. Samples: 97999104. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:49:33,080][389401] Avg episode reward: [(0, '4742.588')] [2023-03-08 12:49:35,734][389688] Updated weights for policy 0, policy_version 191520 (0.0005) [2023-03-08 12:49:38,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11605.3, 300 sec: 12232.5). Total num frames: 98082816. Throughput: 0: 11506.4. Samples: 98068980. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:49:38,090][389401] Avg episode reward: [(0, '4743.307')] [2023-03-08 12:49:38,093][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000191568_98082816.pth... [2023-03-08 12:49:38,096][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000190896_97738752.pth [2023-03-08 12:49:39,244][389688] Updated weights for policy 0, policy_version 191600 (0.0005) [2023-03-08 12:49:42,742][389688] Updated weights for policy 0, policy_version 191680 (0.0005) [2023-03-08 12:49:43,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11537.1, 300 sec: 12232.5). Total num frames: 98140160. Throughput: 0: 11549.6. Samples: 98139952. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:49:43,090][389401] Avg episode reward: [(0, '4742.632')] [2023-03-08 12:49:46,315][389688] Updated weights for policy 0, policy_version 191760 (0.0005) [2023-03-08 12:49:48,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 12218.6). Total num frames: 98197504. Throughput: 0: 11530.9. Samples: 98173592. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:49:48,090][389401] Avg episode reward: [(0, '4742.082')] [2023-03-08 12:49:49,850][389688] Updated weights for policy 0, policy_version 191840 (0.0005) [2023-03-08 12:49:53,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 12218.6). Total num frames: 98254848. Throughput: 0: 11540.7. Samples: 98242572. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:49:53,080][389401] Avg episode reward: [(0, '4744.322')] [2023-03-08 12:49:53,084][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000191912_98258944.pth... [2023-03-08 12:49:53,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000191232_97910784.pth [2023-03-08 12:49:53,440][389688] Updated weights for policy 0, policy_version 191920 (0.0005) [2023-03-08 12:49:57,055][389688] Updated weights for policy 0, policy_version 192000 (0.0005) [2023-03-08 12:49:58,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11468.8, 300 sec: 12218.6). Total num frames: 98312192. Throughput: 0: 11558.6. Samples: 98311268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:49:58,080][389401] Avg episode reward: [(0, '4741.609')] [2023-03-08 12:50:00,488][389688] Updated weights for policy 0, policy_version 192080 (0.0004) [2023-03-08 12:50:03,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11537.1, 300 sec: 12218.6). Total num frames: 98373632. Throughput: 0: 11603.0. Samples: 98347040. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:50:03,080][389401] Avg episode reward: [(0, '4742.634')] [2023-03-08 12:50:04,091][389688] Updated weights for policy 0, policy_version 192160 (0.0005) [2023-03-08 12:50:07,667][389688] Updated weights for policy 0, policy_version 192240 (0.0005) [2023-03-08 12:50:08,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11537.1, 300 sec: 12218.6). Total num frames: 98430976. Throughput: 0: 11561.4. Samples: 98414664. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:50:08,080][389401] Avg episode reward: [(0, '4662.622')] [2023-03-08 12:50:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000192248_98430976.pth... [2023-03-08 12:50:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000191568_98082816.pth [2023-03-08 12:50:11,204][389688] Updated weights for policy 0, policy_version 192320 (0.0005) [2023-03-08 12:50:13,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11605.3, 300 sec: 12190.8). Total num frames: 98488320. Throughput: 0: 11564.6. Samples: 98484232. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:50:13,080][389401] Avg episode reward: [(0, '4742.930')] [2023-03-08 12:50:14,743][389688] Updated weights for policy 0, policy_version 192400 (0.0005) [2023-03-08 12:50:18,065][389688] Updated weights for policy 0, policy_version 192480 (0.0005) [2023-03-08 12:50:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11673.6, 300 sec: 12190.8). Total num frames: 98549760. Throughput: 0: 11579.8. Samples: 98520196. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:50:18,080][389401] Avg episode reward: [(0, '4741.779')] [2023-03-08 12:50:21,312][389688] Updated weights for policy 0, policy_version 192560 (0.0004) [2023-03-08 12:50:23,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11673.6, 300 sec: 12176.9). Total num frames: 98611200. Throughput: 0: 11685.4. Samples: 98594824. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:50:23,080][389401] Avg episode reward: [(0, '4743.640')] [2023-03-08 12:50:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000192600_98611200.pth... [2023-03-08 12:50:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000191912_98258944.pth [2023-03-08 12:50:24,693][389688] Updated weights for policy 0, policy_version 192640 (0.0005) [2023-03-08 12:50:28,018][389688] Updated weights for policy 0, policy_version 192720 (0.0005) [2023-03-08 12:50:28,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11741.9, 300 sec: 12176.9). Total num frames: 98672640. Throughput: 0: 11746.8. Samples: 98668556. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:50:28,080][389401] Avg episode reward: [(0, '4743.178')] [2023-03-08 12:50:31,261][389688] Updated weights for policy 0, policy_version 192800 (0.0005) [2023-03-08 12:50:33,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11810.1, 300 sec: 12163.0). Total num frames: 98734080. Throughput: 0: 11831.6. Samples: 98706016. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:50:33,080][389401] Avg episode reward: [(0, '4742.761')] [2023-03-08 12:50:34,631][389688] Updated weights for policy 0, policy_version 192880 (0.0005) [2023-03-08 12:50:37,909][389688] Updated weights for policy 0, policy_version 192960 (0.0005) [2023-03-08 12:50:38,079][389401] Fps is (10 sec: 12287.9, 60 sec: 11878.4, 300 sec: 12163.0). Total num frames: 98795520. Throughput: 0: 11925.2. Samples: 98779208. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:50:38,080][389401] Avg episode reward: [(0, '4743.285')] [2023-03-08 12:50:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000192960_98795520.pth... [2023-03-08 12:50:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000192248_98430976.pth [2023-03-08 12:50:41,180][389688] Updated weights for policy 0, policy_version 193040 (0.0005) [2023-03-08 12:50:43,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11946.7, 300 sec: 12149.2). Total num frames: 98856960. Throughput: 0: 12086.8. Samples: 98855176. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:50:43,090][389401] Avg episode reward: [(0, '4742.757')] [2023-03-08 12:50:44,530][389688] Updated weights for policy 0, policy_version 193120 (0.0005) [2023-03-08 12:50:48,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11946.7, 300 sec: 12135.3). Total num frames: 98914304. Throughput: 0: 12061.2. Samples: 98889792. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:50:48,080][389401] Avg episode reward: [(0, '4742.271')] [2023-03-08 12:50:48,130][389688] Updated weights for policy 0, policy_version 193200 (0.0005) [2023-03-08 12:50:51,676][389688] Updated weights for policy 0, policy_version 193280 (0.0005) [2023-03-08 12:50:53,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11946.7, 300 sec: 12107.5). Total num frames: 98971648. Throughput: 0: 12104.5. Samples: 98959368. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:50:53,090][389401] Avg episode reward: [(0, '4741.814')] [2023-03-08 12:50:53,134][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000193312_98975744.pth... [2023-03-08 12:50:53,135][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000192600_98611200.pth [2023-03-08 12:50:55,287][389688] Updated weights for policy 0, policy_version 193360 (0.0005) [2023-03-08 12:50:58,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11946.7, 300 sec: 12079.7). Total num frames: 99028992. Throughput: 0: 12072.1. Samples: 99027476. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:50:58,090][389401] Avg episode reward: [(0, '4743.076')] [2023-03-08 12:50:58,974][389688] Updated weights for policy 0, policy_version 193440 (0.0005) [2023-03-08 12:51:02,572][389688] Updated weights for policy 0, policy_version 193520 (0.0005) [2023-03-08 12:51:03,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11878.4, 300 sec: 12065.8). Total num frames: 99086336. Throughput: 0: 12005.8. Samples: 99060456. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:51:03,080][389401] Avg episode reward: [(0, '4740.210')] [2023-03-08 12:51:06,162][389688] Updated weights for policy 0, policy_version 193600 (0.0005) [2023-03-08 12:51:08,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11878.4, 300 sec: 12024.2). Total num frames: 99143680. Throughput: 0: 11854.3. Samples: 99128268. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:51:08,080][389401] Avg episode reward: [(0, '4742.486')] [2023-03-08 12:51:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000193640_99143680.pth... [2023-03-08 12:51:08,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000192960_98795520.pth [2023-03-08 12:51:09,647][389688] Updated weights for policy 0, policy_version 193680 (0.0004) [2023-03-08 12:51:13,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11878.4, 300 sec: 12010.3). Total num frames: 99201024. Throughput: 0: 11813.9. Samples: 99200180. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:51:13,080][389401] Avg episode reward: [(0, '4741.591')] [2023-03-08 12:51:13,153][389688] Updated weights for policy 0, policy_version 193760 (0.0004) [2023-03-08 12:51:16,635][389688] Updated weights for policy 0, policy_version 193840 (0.0005) [2023-03-08 12:51:18,079][389401] Fps is (10 sec: 11878.4, 60 sec: 11878.4, 300 sec: 11996.4). Total num frames: 99262464. Throughput: 0: 11731.1. Samples: 99233916. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:51:18,080][389401] Avg episode reward: [(0, '4741.412')] [2023-03-08 12:51:20,198][389688] Updated weights for policy 0, policy_version 193920 (0.0005) [2023-03-08 12:51:23,079][389401] Fps is (10 sec: 11878.3, 60 sec: 11810.1, 300 sec: 11968.7). Total num frames: 99319808. Throughput: 0: 11650.7. Samples: 99303488. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:51:23,080][389401] Avg episode reward: [(0, '4741.567')] [2023-03-08 12:51:23,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000193984_99319808.pth... [2023-03-08 12:51:23,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000193312_98975744.pth [2023-03-08 12:51:23,702][389688] Updated weights for policy 0, policy_version 194000 (0.0005) [2023-03-08 12:51:27,249][389688] Updated weights for policy 0, policy_version 194080 (0.0005) [2023-03-08 12:51:28,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11741.9, 300 sec: 11940.9). Total num frames: 99377152. Throughput: 0: 11511.3. Samples: 99373184. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:51:28,080][389401] Avg episode reward: [(0, '4740.286')] [2023-03-08 12:51:30,889][389688] Updated weights for policy 0, policy_version 194160 (0.0005) [2023-03-08 12:51:33,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11673.6, 300 sec: 11913.1). Total num frames: 99434496. Throughput: 0: 11501.3. Samples: 99407352. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:51:33,080][389401] Avg episode reward: [(0, '4739.562')] [2023-03-08 12:51:34,472][389688] Updated weights for policy 0, policy_version 194240 (0.0005) [2023-03-08 12:51:38,030][389688] Updated weights for policy 0, policy_version 194320 (0.0005) [2023-03-08 12:51:38,079][389401] Fps is (10 sec: 11468.7, 60 sec: 11605.3, 300 sec: 11899.2). Total num frames: 99491840. Throughput: 0: 11478.5. Samples: 99475900. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:51:38,080][389401] Avg episode reward: [(0, '4732.159')] [2023-03-08 12:51:38,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000194320_99491840.pth... [2023-03-08 12:51:38,086][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000193640_99143680.pth [2023-03-08 12:51:41,653][389688] Updated weights for policy 0, policy_version 194400 (0.0004) [2023-03-08 12:51:43,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11885.3). Total num frames: 99549184. Throughput: 0: 11499.6. Samples: 99544960. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:51:43,080][389401] Avg episode reward: [(0, '4739.733')] [2023-03-08 12:51:45,188][389688] Updated weights for policy 0, policy_version 194480 (0.0004) [2023-03-08 12:51:48,079][389401] Fps is (10 sec: 11468.9, 60 sec: 11537.1, 300 sec: 11871.5). Total num frames: 99606528. Throughput: 0: 11519.6. Samples: 99578840. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:51:48,080][389401] Avg episode reward: [(0, '4743.320')] [2023-03-08 12:51:48,796][389688] Updated weights for policy 0, policy_version 194560 (0.0005) [2023-03-08 12:51:52,372][389688] Updated weights for policy 0, policy_version 194640 (0.0005) [2023-03-08 12:51:53,079][389401] Fps is (10 sec: 11468.8, 60 sec: 11537.1, 300 sec: 11843.7). Total num frames: 99663872. Throughput: 0: 11530.5. Samples: 99647140. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:51:53,080][389401] Avg episode reward: [(0, '4739.991')] [2023-03-08 12:51:53,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000194656_99663872.pth... [2023-03-08 12:51:53,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000193984_99319808.pth [2023-03-08 12:51:55,591][389688] Updated weights for policy 0, policy_version 194720 (0.0004) [2023-03-08 12:51:58,079][389401] Fps is (10 sec: 11878.5, 60 sec: 11605.3, 300 sec: 11857.6). Total num frames: 99725312. Throughput: 0: 11605.4. Samples: 99722424. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:51:58,080][389401] Avg episode reward: [(0, '4741.393')] [2023-03-08 12:51:58,865][389688] Updated weights for policy 0, policy_version 194800 (0.0004) [2023-03-08 12:52:02,119][389688] Updated weights for policy 0, policy_version 194880 (0.0004) [2023-03-08 12:52:03,079][389401] Fps is (10 sec: 12288.0, 60 sec: 11673.6, 300 sec: 11843.7). Total num frames: 99786752. Throughput: 0: 11676.1. Samples: 99759340. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:52:03,080][389401] Avg episode reward: [(0, '4742.116')] [2023-03-08 12:52:05,383][389688] Updated weights for policy 0, policy_version 194960 (0.0004) [2023-03-08 12:52:08,079][389401] Fps is (10 sec: 12697.4, 60 sec: 11810.1, 300 sec: 11857.6). Total num frames: 99852288. Throughput: 0: 11831.5. Samples: 99835904. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:52:08,080][389401] Avg episode reward: [(0, '4739.068')] [2023-03-08 12:52:08,083][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000195024_99852288.pth... [2023-03-08 12:52:08,085][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000194320_99491840.pth [2023-03-08 12:52:08,621][389688] Updated weights for policy 0, policy_version 195040 (0.0004) [2023-03-08 12:52:11,862][389688] Updated weights for policy 0, policy_version 195120 (0.0004) [2023-03-08 12:52:13,079][389401] Fps is (10 sec: 12697.6, 60 sec: 11878.4, 300 sec: 11871.5). Total num frames: 99913728. Throughput: 0: 11968.7. Samples: 99911776. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:52:13,080][389401] Avg episode reward: [(0, '4740.667')] [2023-03-08 12:52:15,092][389688] Updated weights for policy 0, policy_version 195200 (0.0004) [2023-03-08 12:52:18,079][389401] Fps is (10 sec: 12697.7, 60 sec: 11946.7, 300 sec: 11899.2). Total num frames: 99979264. Throughput: 0: 12053.0. Samples: 99949736. Policy #0 lag: (min: 7.0, avg: 7.0, max: 7.0) [2023-03-08 12:52:18,080][389401] Avg episode reward: [(0, '4741.171')] [2023-03-08 12:52:18,367][389688] Updated weights for policy 0, policy_version 195280 (0.0004) [2023-03-08 12:52:19,991][389644] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000000 [2023-03-08 12:52:20,303][389644] Early stopping after 2 epochs (8 sgd steps), loss delta 0.0000000 [2023-03-08 12:52:20,304][389689] Stopping RolloutWorker_w3... [2023-03-08 12:52:20,304][389727] Stopping RolloutWorker_w0... [2023-03-08 12:52:20,305][389690] Stopping RolloutWorker_w1... [2023-03-08 12:52:20,305][389689] Loop rollout_proc3_evt_loop terminating... [2023-03-08 12:52:20,305][389727] Loop rollout_proc0_evt_loop terminating... [2023-03-08 12:52:20,305][389693] Stopping RolloutWorker_w4... [2023-03-08 12:52:20,305][389692] Stopping RolloutWorker_w6... [2023-03-08 12:52:20,305][389695] Stopping RolloutWorker_w5... [2023-03-08 12:52:20,305][389690] Loop rollout_proc1_evt_loop terminating... [2023-03-08 12:52:20,305][389693] Loop rollout_proc4_evt_loop terminating... [2023-03-08 12:52:20,305][389644] Stopping Batcher_0... [2023-03-08 12:52:20,305][389692] Loop rollout_proc6_evt_loop terminating... [2023-03-08 12:52:20,305][389695] Loop rollout_proc5_evt_loop terminating... [2023-03-08 12:52:20,305][389694] Stopping RolloutWorker_w2... [2023-03-08 12:52:20,305][389691] Stopping RolloutWorker_w7... [2023-03-08 12:52:20,304][389401] Component RolloutWorker_w3 stopped! [2023-03-08 12:52:20,305][389694] Loop rollout_proc2_evt_loop terminating... [2023-03-08 12:52:20,305][389691] Loop rollout_proc7_evt_loop terminating... [2023-03-08 12:52:20,305][389644] Loop batcher_evt_loop terminating... [2023-03-08 12:52:20,305][389401] Component RolloutWorker_w0 stopped! [2023-03-08 12:52:20,305][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000195328_100007936.pth... [2023-03-08 12:52:20,306][389401] Component RolloutWorker_w1 stopped! [2023-03-08 12:52:20,306][389401] Component Batcher_0 stopped! [2023-03-08 12:52:20,306][389401] Component RolloutWorker_w4 stopped! [2023-03-08 12:52:20,306][389401] Component RolloutWorker_w6 stopped! [2023-03-08 12:52:20,307][389401] Component RolloutWorker_w5 stopped! [2023-03-08 12:52:20,307][389401] Component RolloutWorker_w2 stopped! [2023-03-08 12:52:20,307][389401] Component RolloutWorker_w7 stopped! [2023-03-08 12:52:20,308][389644] Removing /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000194656_99663872.pth [2023-03-08 12:52:20,308][389644] Saving /home/qgallouedec/gia/data/envs/metaworld/train_dir/faucet-open-v2/checkpoint_p0/checkpoint_000195328_100007936.pth... [2023-03-08 12:52:20,310][389644] Stopping LearnerWorker_p0... [2023-03-08 12:52:20,311][389644] Loop learner_proc0_evt_loop terminating... [2023-03-08 12:52:20,310][389401] Component LearnerWorker_p0 stopped! [2023-03-08 12:52:20,324][389688] Weights refcount: 2 0 [2023-03-08 12:52:20,325][389688] Stopping InferenceWorker_p0-w0... [2023-03-08 12:52:20,325][389688] Loop inference_proc0-0_evt_loop terminating... [2023-03-08 12:52:20,325][389401] Component InferenceWorker_p0-w0 stopped! [2023-03-08 12:52:20,326][389401] Waiting for process learner_proc0 to stop... [2023-03-08 12:52:20,749][389401] Waiting for process inference_proc0-0 to join... [2023-03-08 12:52:20,749][389401] Waiting for process rollout_proc0 to join... [2023-03-08 12:52:20,750][389401] Waiting for process rollout_proc1 to join... [2023-03-08 12:52:20,750][389401] Waiting for process rollout_proc2 to join... [2023-03-08 12:52:20,750][389401] Waiting for process rollout_proc3 to join... [2023-03-08 12:52:20,750][389401] Waiting for process rollout_proc4 to join... [2023-03-08 12:52:20,751][389401] Waiting for process rollout_proc5 to join... [2023-03-08 12:52:20,751][389401] Waiting for process rollout_proc6 to join... [2023-03-08 12:52:20,751][389401] Waiting for process rollout_proc7 to join... [2023-03-08 12:52:20,751][389401] Batcher 0 profile tree view: batching: 17.2767, releasing_batches: 14.9156 [2023-03-08 12:52:20,751][389401] InferenceWorker_p0-w0 profile tree view: wait_policy: 0.0000 wait_policy_total: 2869.1482 update_model: 97.5514 weight_update: 0.0004 one_step: 0.0009 handle_policy_step: 4916.0433 deserialize: 208.5893, stack: 49.8324, obs_to_device_normalize: 870.2613, forward: 2441.9650, send_messages: 364.2793 prepare_outputs: 555.6319 to_cpu: 86.9354 [2023-03-08 12:52:20,752][389401] Learner 0 profile tree view: misc: 0.1126, prepare_batch: 90.1516 train: 1147.2774 epoch_init: 0.4078, minibatch_init: 11.6695, losses_postprocess: 11.8974, kl_divergence: 4.1546, after_optimizer: 5.1795 calculate_losses: 472.2550 losses_init: 0.4196, forward_head: 233.6919, bptt_initial: 1.2927, bptt: 1.2940, tail: 111.7098, advantages_returns: 8.6923, losses: 101.4675 update: 625.9634 clip: 54.8029 [2023-03-08 12:52:20,752][389401] RolloutWorker_w0 profile tree view: wait_for_trajectories: 3.0813, enqueue_policy_requests: 125.6216, env_step: 5469.3490, overhead: 316.2793, complete_rollouts: 3.2999 save_policy_outputs: 328.4355 split_output_tensors: 159.3972 [2023-03-08 12:52:20,752][389401] RolloutWorker_w7 profile tree view: wait_for_trajectories: 3.0442, enqueue_policy_requests: 129.2160, env_step: 5466.7591, overhead: 314.3497, complete_rollouts: 3.2698 save_policy_outputs: 329.6348 split_output_tensors: 162.8464 [2023-03-08 12:52:20,752][389401] Loop Runner_EvtLoop terminating... [2023-03-08 12:52:20,753][389401] Runner profile tree view: main_loop: 8485.5302 [2023-03-08 12:52:20,753][389401] Collected {0: 100007936}, FPS: 11785.7